[2025-10-17T17:00:01.962634] [INFO ] [MAIN ] Using last completed trading day: 2025-10-17 [2025-10-17T17:00:02.174128] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-17T17:00:02.174360] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-17T17:00:02.246809] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-17T17:00:02.247332] [WARN ] [STATE ] State set to: RUNNING [2025-10-17T17:00:02.247424] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-17T17:00:02.247480] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-17T17:00:02.247618] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-17T17:00:02.247729] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-17T17:00:03.872845] [DEBUG] [SYMBOL ] Found 2420 valid NYSE symbols. [2025-10-17T17:00:03.872987] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-17T17:00:03.873191] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-17T17:00:03.873703] [INFO ] [LOCAL ] Symbols cache updated with 2368 symbols. [2025-10-17T17:00:03.873760] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-17T17:00:03.873791] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-17T17:00:03.873846] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-17T17:00:03.873879] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-17T17:00:03.873908] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-17T17:00:03.874282] [DEBUG] [LOCAL ] Found 2368 symbols in cached list. [2025-10-17T17:00:03.874349] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-17T17:00:03.874547] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-17T17:00:03.874605] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2368 valid symbols. [2025-10-17T17:00:03.874638] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-17T17:00:03.874719] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-17T17:00:03.884949] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/WNS.csv (symbol WNS no longer active). [2025-10-17T17:00:03.897037] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-17T17:00:03.907045] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/WNS.csv (symbol WNS no longer active). [2025-10-17T17:00:03.919966] [INFO ] [LOCAL ] Deleted 2 obsolete data files. [2025-10-17T17:00:03.920030] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-17T17:00:03.920065] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-17T17:00:03.920092] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-17T17:00:03.920145] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-17T17:00:03.920480] [DEBUG] [LOCAL ] Found 2368 symbols in cached list. [2025-10-17T17:00:03.920512] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-17T17:00:03.920544] [INFO ] [MAIN ] Starting incremental update for 2368 symbols. [2025-10-17T17:00:03.920571] [INFO ] [MAIN ] Running in parallel mode [2025-10-17T17:00:03.920748] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2368 symbols [2025-10-17T17:00:04.558440] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:04.582774] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:04.593919] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:04.636637] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-17T17:00:04.645375] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:04.637239] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-17T17:00:04.647410] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-17T17:00:04.647594] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-17T17:00:04.647693] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-17T17:00:04.647835] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-17T17:00:04.647953] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-17T17:00:04.647899] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-17T17:00:04.648033] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-17T17:00:04.648136] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-17T17:00:04.648271] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-17T17:00:04.648217] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-17T17:00:05.323384] [DEBUG] [LOCAL ] A: Loaded 51164 existing records from primary storage. [2025-10-17T17:00:05.356774] [INFO ] [MAIN ] A: Loaded 51164 existing records. [2025-10-17T17:00:05.340729] [DEBUG] [LOCAL ] AA: Loaded 54011 existing records from primary storage. [2025-10-17T17:00:05.485453] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:05.557908] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-17T17:00:05.601507] [INFO ] [MAIN ] AA: Loaded 54011 existing records. [2025-10-17T17:00:05.629393] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:05.668277] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-17T17:00:05.874772] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:05.880170] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-17T17:00:05.890484] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-17T17:00:05.908939] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-17T17:00:05.926446] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-17T17:00:06.009781] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:00:05.996271] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:06.025080] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-17T17:00:06.035323] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-17T17:00:06.046092] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-17T17:00:06.040627] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:00:06.060097] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-17T17:00:06.064875] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-17T17:00:06.064717] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-17T17:00:06.077026] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:00:06.128407] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-17T17:00:06.159863] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-17T17:00:06.199598] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-17T17:00:06.211724] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-17T17:00:06.220541] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-17T17:00:06.342863] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-17T17:00:06.413108] [INFO ] [MAIN ] Update Progress: 1/2368 symbols completed. AAMI took 2.4s. Estimated remaining: 1h 38m 20s. Rate: 24.1 symbols/min [2025-10-17T17:00:06.570368] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-17T17:00:06.593026] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-17T17:00:06.811040] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:06.828186] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-17T17:00:06.965687] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:06.981918] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-17T17:00:07.020415] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:07.068348] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-17T17:00:07.070079] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-17T17:00:07.087568] [DEBUG] [LOCAL ] AAP: Loaded 52218 existing records from primary storage. [2025-10-17T17:00:07.088219] [INFO ] [MAIN ] AAP: Loaded 52218 existing records. [2025-10-17T17:00:07.268546] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:07.268814] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-17T17:00:07.268881] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-17T17:00:07.269205] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-17T17:00:07.269264] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-17T17:00:07.450403] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-17T17:00:07.519222] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-17T17:00:07.637054] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:07.637379] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-17T17:00:07.941056] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-17T17:00:07.942071] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-17T17:00:08.172168] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-17T17:00:08.173037] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-17T17:00:08.609692] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T17:00:08.610843] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-17T17:00:08.651456] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T17:00:08.662230] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-17T17:00:08.828046] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-17T17:00:08.837972] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-17T17:00:08.879219] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-17T17:00:08.880132] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-17T17:00:09.145938] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-17T17:00:09.147020] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-17T17:00:09.391490] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T17:00:09.401938] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-17T17:00:09.404936] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-17T17:00:09.405718] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-17T17:00:09.932511] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-17T17:00:09.933268] [INFO ] [REMOTE ] AAM: Full fetch complete (921 records). [2025-10-17T17:00:09.933344] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-17T17:00:10.127799] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-10-17T17:00:10.128003] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:00:10.128075] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:00:10.128154] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-17T17:00:10.128249] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-17T17:00:10.128322] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-17T17:00:10.128389] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-17T17:00:10.128513] [INFO ] [MAIN ] Update Progress: 2/2368 symbols completed. AAM took 6.2s. Estimated remaining: 2h 2m 24s. Rate: 19.3 symbols/min [2025-10-17T17:00:10.333074] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:10.366738] [DEBUG] [LOCAL ] AAT: Loaded 30661 existing records from primary storage. [2025-10-17T17:00:10.367030] [INFO ] [MAIN ] AAT: Loaded 30661 existing records. [2025-10-17T17:00:10.546575] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:10.546978] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-17T17:00:10.547055] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-17T17:00:10.547538] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-17T17:00:10.547603] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-17T17:00:10.894885] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-17T17:00:10.941119] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-17T17:00:10.946518] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:10.948070] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-17T17:00:11.527840] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-10-17T17:00:11.538266] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-17T17:00:11.711040] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-17T17:00:11.716869] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-17T17:00:11.817458] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-17T17:00:11.827764] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-17T17:00:12.905295] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-17T17:00:12.915580] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-17T17:00:13.053205] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T17:00:13.060920] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-17T17:00:13.444763] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T17:00:13.454379] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-17T17:00:14.443468] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T17:00:14.449717] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-17T17:00:15.003709] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T17:00:15.015948] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-17T17:00:15.063772] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-17T17:00:15.078154] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-17T17:00:15.719804] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (4.18 seconds). [2025-10-17T17:00:15.729931] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-17T17:00:16.124769] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T17:00:16.131417] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-17T17:00:16.822932] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T17:00:16.834387] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-17T17:00:16.952769] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T17:00:16.963930] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-17T17:00:17.267486] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T17:00:17.275092] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-17T17:00:17.334892] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T17:00:17.345882] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-17T17:00:18.512913] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:00:18.523892] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-17T17:00:18.674739] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T17:00:18.681439] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-17T17:00:18.794995] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T17:00:18.807187] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-17T17:00:19.066101] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T17:00:19.077217] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-17T17:00:19.892891] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T17:00:19.899956] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-17T17:00:19.999823] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T17:00:20.010281] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-17T17:00:20.521731] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T17:00:20.557937] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-17T17:00:20.559512] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T17:00:20.571088] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-17T17:00:21.208443] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T17:00:21.216141] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-17T17:00:21.906294] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T17:00:21.919478] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-17T17:00:22.243809] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-17T17:00:22.253096] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-17T17:00:22.284989] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T17:00:22.297367] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-17T17:00:22.497683] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-17T17:00:22.509436] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-17T17:00:23.170235] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T17:00:23.176681] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-17T17:00:23.388235] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T17:00:23.401211] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-17T17:00:23.880121] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T17:00:23.898256] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-17T17:00:24.359460] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T17:00:24.371799] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-17T17:00:24.392060] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T17:00:24.396695] [INFO ] [REMOTE ] AAT: Full fetch complete (43029 records). [2025-10-17T17:00:24.396856] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-17T17:00:24.786440] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-17T17:00:24.786686] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-17T17:00:24.787175] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-17T17:00:24.787257] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-17T17:00:24.788464] [DEBUG] [LOCAL ] AAT: Trimmed 43029 records to 30862 (keeping 200 days of data) [2025-10-17T17:00:24.978223] [DEBUG] [LOCAL ] AAT: Primary data saved (30862 records). [2025-10-17T17:00:24.978595] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-17T17:00:24.978756] [INFO ] [MAIN ] Update Progress: 3/2368 symbols completed. AAT took 14.9s. Estimated remaining: 4h 36m 41s. Rate: 8.5 symbols/min [2025-10-17T17:00:25.087183] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T17:00:25.138412] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-17T17:00:25.204725] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:25.204901] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-17T17:00:25.204940] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-17T17:00:25.205052] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-17T17:00:25.205093] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-17T17:00:25.205134] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-17T17:00:25.205168] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-17T17:00:25.566120] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:25.566465] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-17T17:00:25.832211] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:00:25.832902] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-17T17:00:25.833428] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:00:25.834491] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T17:00:25.834699] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-17T17:00:25.845135] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:00:25.845685] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-17T17:00:25.845973] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-17T17:00:25.846046] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-17T17:00:25.846094] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-17T17:00:25.846148] [INFO ] [MAIN ] Update Progress: 4/2368 symbols completed. AAUC took 0.9s. Estimated remaining: 3h 35m 58s. Rate: 10.9 symbols/min [2025-10-17T17:00:25.881441] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-17T17:00:26.027872] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:26.058534] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T17:00:26.069870] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-17T17:00:26.088712] [DEBUG] [LOCAL ] AB: Loaded 25663 existing records from primary storage. [2025-10-17T17:00:26.088977] [INFO ] [MAIN ] AB: Loaded 25663 existing records. [2025-10-17T17:00:26.268634] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:26.268870] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-17T17:00:26.268919] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-17T17:00:26.269146] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-17T17:00:26.269202] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-17T17:00:26.653612] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:26.660625] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-17T17:00:26.673533] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T17:00:26.681414] [INFO ] [REMOTE ] A: Full fetch complete (73507 records). [2025-10-17T17:00:26.681549] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-17T17:00:27.075162] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-17T17:00:27.075261] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-17T17:00:27.075953] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-17T17:00:27.076026] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-17T17:00:27.077617] [DEBUG] [LOCAL ] A: Trimmed 73507 records to 51523 (keeping 200 days of data) [2025-10-17T17:00:27.397633] [DEBUG] [LOCAL ] A: Primary data saved (51523 records). [2025-10-17T17:00:27.397852] [INFO ] [MAIN ] A: Full history saved. [2025-10-17T17:00:27.398186] [INFO ] [MAIN ] Update Progress: 5/2368 symbols completed. A took 23.5s. Estimated remaining: 3h 4m 55s. Rate: 12.8 symbols/min [2025-10-17T17:00:27.573949] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:27.574340] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-10-17T17:00:27.574413] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-10-17T17:00:27.574576] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-17T17:00:27.574622] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-17T17:00:27.574712] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-17T17:00:27.574760] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-17T17:00:28.026978] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-17T17:00:28.031247] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:28.038971] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-17T17:00:28.051744] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-17T17:00:28.081439] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T17:00:28.091485] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-17T17:00:28.093395] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-17T17:00:28.102046] [INFO ] [REMOTE ] AAP: Full fetch complete (75190 records). [2025-10-17T17:00:28.102189] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-17T17:00:28.491239] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-17T17:00:28.491329] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-17T17:00:28.492074] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-17T17:00:28.492144] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-17T17:00:28.494848] [DEBUG] [LOCAL ] AAP: Trimmed 75190 records to 52578 (keeping 200 days of data) [2025-10-17T17:00:28.808024] [DEBUG] [LOCAL ] AAP: Primary data saved (52578 records). [2025-10-17T17:00:28.808169] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-17T17:00:28.808528] [INFO ] [MAIN ] Update Progress: 6/2368 symbols completed. AAP took 22.4s. Estimated remaining: 2h 43m 18s. Rate: 14.5 symbols/min [2025-10-17T17:00:28.976244] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:29.005847] [DEBUG] [LOCAL ] ABCB: Loaded 30801 existing records from primary storage. [2025-10-17T17:00:29.006141] [INFO ] [MAIN ] ABCB: Loaded 30801 existing records. [2025-10-17T17:00:29.180923] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:29.181168] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-17T17:00:29.181219] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-17T17:00:29.182243] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-17T17:00:29.182303] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-17T17:00:29.537111] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:29.537634] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-17T17:00:29.639845] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T17:00:29.650617] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-17T17:00:29.898133] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-17T17:00:29.909247] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-17T17:00:30.187190] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-17T17:00:30.195038] [INFO ] [REMOTE ] AA: Full fetch complete (77728 records). [2025-10-17T17:00:30.195237] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-17T17:00:30.598491] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-17T17:00:30.598610] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-17T17:00:30.599378] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-17T17:00:30.599565] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-17T17:00:30.602195] [DEBUG] [LOCAL ] AA: Trimmed 77728 records to 54401 (keeping 200 days of data) [2025-10-17T17:00:30.833554] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T17:00:30.847172] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-17T17:00:30.981045] [DEBUG] [LOCAL ] AA: Primary data saved (54401 records). [2025-10-17T17:00:30.981827] [INFO ] [MAIN ] AA: Full history saved. [2025-10-17T17:00:30.982915] [INFO ] [MAIN ] Update Progress: 7/2368 symbols completed. AA took 27.0s. Estimated remaining: 2h 32m 8s. Rate: 15.5 symbols/min [2025-10-17T17:00:30.982569] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T17:00:31.058497] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-17T17:00:31.168211] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:31.215934] [DEBUG] [LOCAL ] ABEV: Loaded 53668 existing records from primary storage. [2025-10-17T17:00:31.216275] [INFO ] [MAIN ] ABEV: Loaded 53668 existing records. [2025-10-17T17:00:31.393878] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:31.394097] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-17T17:00:31.394192] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-17T17:00:31.394758] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-17T17:00:31.394818] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-17T17:00:31.758848] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:31.759286] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-17T17:00:31.789597] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T17:00:31.800116] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-17T17:00:32.018910] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-17T17:00:32.025574] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-17T17:00:32.804055] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T17:00:32.813592] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-17T17:00:33.430408] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T17:00:33.436900] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-17T17:00:33.498864] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T17:00:33.510480] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-17T17:00:33.808033] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-17T17:00:33.817990] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-17T17:00:34.254785] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-17T17:00:34.263315] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-17T17:00:34.772031] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T17:00:34.780086] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-17T17:00:35.339673] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T17:00:35.351036] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-17T17:00:35.503258] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-17T17:00:35.509800] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-17T17:00:36.145155] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-17T17:00:36.153108] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-17T17:00:36.303579] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-17T17:00:36.315197] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-17T17:00:36.328219] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T17:00:36.333053] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-17T17:00:37.107053] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T17:00:37.122149] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-17T17:00:37.322629] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T17:00:37.328334] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-17T17:00:37.403464] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-17T17:00:37.410071] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-17T17:00:38.224474] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T17:00:38.248437] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-17T17:00:38.249488] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T17:00:38.255845] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-17T17:00:38.295770] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T17:00:38.302157] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-17T17:00:39.143033] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T17:00:39.154129] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-17T17:00:39.387127] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T17:00:39.392598] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-17T17:00:39.539893] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T17:00:39.547211] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-17T17:00:40.351378] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T17:00:40.354582] [INFO ] [REMOTE ] AB: Full fetch complete (44208 records). [2025-10-17T17:00:40.354722] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-17T17:00:40.355377] [FATAL] [VALIDATOR ] AB: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:00:40.355471] [FATAL] [MAIN ] AB: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:00:40.355517] [WARN ] [MAIN ] AB: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:00:40.355585] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-17T17:00:40.355704] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-17T17:00:40.355775] [INFO ] [LOCAL ] AB: Starting deletion of derivative data. [2025-10-17T17:00:40.355947] [DEBUG] [LOCAL ] AB: Deleted derivative data file. [2025-10-17T17:00:40.356047] [INFO ] [MAIN ] Update Progress: 8/2368 symbols completed. AB took 14.5s. Estimated remaining: 2h 59m 8s. Rate: 13.2 symbols/min [2025-10-17T17:00:40.544636] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:40.584137] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-17T17:00:40.602142] [DEBUG] [LOCAL ] ABG: Loaded 18453 existing records from primary storage. [2025-10-17T17:00:40.602525] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-17T17:00:40.602884] [INFO ] [MAIN ] ABG: Loaded 18453 existing records. [2025-10-17T17:00:40.768551] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T17:00:40.827390] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:40.834402] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-17T17:00:40.834904] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-17T17:00:40.835057] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-17T17:00:40.836079] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-17T17:00:40.836161] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-17T17:00:41.037264] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T17:00:41.069777] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-17T17:00:41.257079] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:41.257407] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-17T17:00:42.113790] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-17T17:00:42.118634] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-17T17:00:42.270300] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T17:00:42.281608] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-17T17:00:42.482165] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T17:00:42.499319] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-17T17:00:42.676300] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T17:00:42.693993] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-17T17:00:42.797917] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T17:00:42.802321] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-17T17:00:43.523922] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T17:00:43.528508] [INFO ] [REMOTE ] ABCB: Full fetch complete (44863 records). [2025-10-17T17:00:43.528605] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-17T17:00:43.915822] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T17:00:43.916084] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-17T17:00:43.920185] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-17T17:00:43.919435] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-17T17:00:43.921723] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-17T17:00:43.921795] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-17T17:00:43.922813] [DEBUG] [LOCAL ] ABCB: Trimmed 44863 records to 31020 (keeping 200 days of data) [2025-10-17T17:00:44.107259] [DEBUG] [LOCAL ] ABCB: Primary data saved (31020 records). [2025-10-17T17:00:44.107490] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-17T17:00:44.108983] [INFO ] [MAIN ] Update Progress: 9/2368 symbols completed. ABCB took 15.3s. Estimated remaining: 2h 55m 34s. Rate: 13.4 symbols/min [2025-10-17T17:00:44.280344] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:44.316461] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T17:00:44.327423] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-17T17:00:44.353559] [DEBUG] [LOCAL ] ABM: Loaded 32403 existing records from primary storage. [2025-10-17T17:00:44.353876] [INFO ] [MAIN ] ABM: Loaded 32403 existing records. [2025-10-17T17:00:44.533174] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:44.534071] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-17T17:00:44.534136] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-17T17:00:44.534339] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-17T17:00:44.534396] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-17T17:00:44.887396] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:44.887817] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-17T17:00:44.922635] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-17T17:00:44.934494] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-17T17:00:45.010044] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T17:00:45.014891] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-17T17:00:45.815158] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-17T17:00:45.827241] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-17T17:00:46.281408] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-17T17:00:46.282831] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T17:00:46.289568] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-17T17:00:46.297961] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-17T17:00:46.827371] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T17:00:46.839244] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-17T17:00:47.334136] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T17:00:47.338309] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-17T17:00:47.420466] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T17:00:47.426344] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-17T17:00:47.735349] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T17:00:47.749001] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-17T17:00:47.906747] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-17T17:00:47.910633] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-17T17:00:48.260576] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-17T17:00:48.266099] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-17T17:00:48.639446] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T17:00:48.651768] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-17T17:00:48.667947] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T17:00:48.673339] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-17T17:00:49.634439] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T17:00:49.645788] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-17T17:00:49.674876] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T17:00:49.681891] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-17T17:00:49.704318] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-17T17:00:49.709238] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-17T17:00:50.471539] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T17:00:50.481191] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T17:00:50.492558] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-17T17:00:50.492702] [INFO ] [REMOTE ] ABBV: Full fetch complete (77847 records). [2025-10-17T17:00:50.493709] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-17T17:00:50.901482] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-17T17:00:50.901683] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-17T17:00:50.902433] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-17T17:00:50.902500] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-17T17:00:50.904190] [DEBUG] [LOCAL ] ABBV: Trimmed 77847 records to 54465 (keeping 200 days of data) [2025-10-17T17:00:51.256092] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T17:00:51.273627] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-17T17:00:51.279308] [DEBUG] [LOCAL ] ABBV: Primary data saved (54465 records). [2025-10-17T17:00:51.280310] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-17T17:00:51.280422] [INFO ] [MAIN ] Update Progress: 10/2368 symbols completed. ABBV took 23.9s. Estimated remaining: 3h 6m 7s. Rate: 12.7 symbols/min [2025-10-17T17:00:51.430274] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T17:00:51.481678] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:51.481859] [INFO ] [REMOTE ] ABEV: Full fetch complete (77350 records). [2025-10-17T17:00:51.482457] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-17T17:00:51.843090] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-17T17:00:51.892467] [DEBUG] [LOCAL ] ABR: Loaded 52354 existing records from primary storage. [2025-10-17T17:00:51.897803] [INFO ] [REMOTE ] ABG: Full fetch complete (26725 records). [2025-10-17T17:00:51.917734] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-17T17:00:51.937176] [INFO ] [MAIN ] ABR: Loaded 52354 existing records. [2025-10-17T17:00:52.042573] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-17T17:00:52.099739] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-17T17:00:52.111169] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-17T17:00:52.186035] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-17T17:00:52.265392] [DEBUG] [LOCAL ] ABEV: Trimmed 77350 records to 54055 (keeping 200 days of data) [2025-10-17T17:00:52.324815] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:52.475934] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-17T17:00:52.487840] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T17:00:52.487166] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-17T17:00:52.544068] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-17T17:00:52.556292] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-17T17:00:52.567589] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-17T17:00:52.982400] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-17T17:00:53.001794] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-17T17:00:53.002265] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-17T17:00:53.010401] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-17T17:00:53.059555] [DEBUG] [LOCAL ] ABG: Trimmed 26725 records to 18603 (keeping 200 days of data) [2025-10-17T17:00:53.429820] [DEBUG] [LOCAL ] ABEV: Primary data saved (54055 records). [2025-10-17T17:00:53.436819] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-17T17:00:53.436516] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:53.437145] [INFO ] [MAIN ] Update Progress: 11/2368 symbols completed. ABEV took 22.5s. Estimated remaining: 2h 56m 50s. Rate: 13.3 symbols/min [2025-10-17T17:00:53.442990] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-17T17:00:53.409256] [DEBUG] [LOCAL ] ABG: Primary data saved (18603 records). [2025-10-17T17:00:53.467166] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-17T17:00:53.476560] [INFO ] [MAIN ] Update Progress: 12/2368 symbols completed. ABG took 13.1s. Estimated remaining: 2h 42m 9s. Rate: 14.5 symbols/min [2025-10-17T17:00:53.794463] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:53.860156] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:00:53.860539] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-17T17:00:53.860596] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-17T17:00:53.860746] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-17T17:00:53.860798] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-17T17:00:53.860843] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-17T17:00:53.860882] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-17T17:00:54.292392] [DEBUG] [LOCAL ] ABT: Loaded 54011 existing records from primary storage. [2025-10-17T17:00:54.292829] [INFO ] [MAIN ] ABT: Loaded 54011 existing records. [2025-10-17T17:00:54.291323] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:54.315323] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T17:00:54.360778] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-17T17:00:54.370535] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-17T17:00:54.490970] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:00:54.491150] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-17T17:00:54.491205] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-17T17:00:54.491588] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-17T17:00:54.491675] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-17T17:00:54.845452] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:00:54.845790] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-17T17:00:55.416158] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T17:00:55.426381] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-17T17:00:55.635394] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T17:00:55.639968] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-17T17:00:55.705027] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-17T17:00:55.712180] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-17T17:00:56.617897] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T17:00:56.629522] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-17T17:00:56.697779] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-17T17:00:56.705508] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-17T17:00:56.734798] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T17:00:56.739806] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-17T17:00:57.050938] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T17:00:57.061154] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-17T17:00:57.813611] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T17:00:57.818675] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-17T17:00:58.184322] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:00:58.210677] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-17T17:00:58.212259] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T17:00:58.224282] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-17T17:00:58.895456] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T17:00:58.906857] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-17T17:00:58.977158] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T17:00:58.984263] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-17T17:00:59.582374] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T17:00:59.587316] [INFO ] [REMOTE ] ABM: Full fetch complete (45009 records). [2025-10-17T17:00:59.587427] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-17T17:00:59.972037] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-17T17:00:59.972214] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-17T17:00:59.972909] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-17T17:00:59.972993] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-17T17:00:59.983835] [DEBUG] [LOCAL ] ABM: Trimmed 45009 records to 32640 (keeping 200 days of data) [2025-10-17T17:01:00.003574] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T17:01:00.078275] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-17T17:01:00.220268] [DEBUG] [LOCAL ] ABM: Primary data saved (32640 records). [2025-10-17T17:01:00.220458] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-17T17:01:00.220621] [INFO ] [MAIN ] Update Progress: 13/2368 symbols completed. ABM took 16.1s. Estimated remaining: 2h 49m 59s. Rate: 13.9 symbols/min [2025-10-17T17:01:00.396785] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:01:00.413871] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T17:01:00.420521] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-17T17:01:00.450317] [DEBUG] [LOCAL ] ACCO: Loaded 37310 existing records from primary storage. [2025-10-17T17:01:00.450729] [INFO ] [MAIN ] ACCO: Loaded 37310 existing records. [2025-10-17T17:01:00.668209] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:01:00.669056] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-17T17:01:00.670537] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T17:01:00.670729] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-17T17:01:00.681830] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-17T17:01:00.681787] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-17T17:01:00.682790] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-17T17:01:01.041755] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:01:01.042225] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-17T17:01:01.600011] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T17:01:01.605504] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-17T17:01:02.014569] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T17:01:02.026617] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-17T17:01:02.424879] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T17:01:02.430249] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-17T17:01:02.696319] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T17:01:02.703571] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-17T17:01:02.794360] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-17T17:01:02.805863] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-17T17:01:03.564885] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T17:01:03.570337] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-17T17:01:03.795413] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T17:01:03.797002] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-17T17:01:03.815392] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-17T17:01:03.816937] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-17T17:01:04.622697] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T17:01:04.633579] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-17T17:01:04.812838] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T17:01:04.818505] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-17T17:01:05.171453] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-17T17:01:05.558101] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-17T17:01:05.768702] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T17:01:05.997865] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T17:01:06.060538] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T17:01:06.358065] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-17T17:01:07.003903] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T17:01:07.158027] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-17T17:01:07.873996] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-17T17:01:07.958020] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-17T17:01:08.702691] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T17:01:08.758036] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-17T17:01:09.037750] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T17:01:09.041022] [INFO ] [REMOTE ] ACA: Full fetch complete (34274 records). [2025-10-17T17:01:09.041135] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-17T17:01:09.409724] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-17T17:01:09.409821] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-17T17:01:09.410213] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-17T17:01:09.410259] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-17T17:01:09.411080] [DEBUG] [LOCAL ] ACA: Trimmed 34274 records to 23255 (keeping 200 days of data) [2025-10-17T17:01:09.548066] [DEBUG] [LOCAL ] ACA: Primary data saved (23255 records). [2025-10-17T17:01:09.548198] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-17T17:01:09.548285] [INFO ] [MAIN ] Update Progress: 14/2368 symbols completed. ACA took 16.1s. Estimated remaining: 3h 3m 55s. Rate: 12.8 symbols/min [2025-10-17T17:01:09.563158] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-17T17:01:09.719342] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:01:09.749152] [DEBUG] [LOCAL ] ACEL: Loaded 26895 existing records from primary storage. [2025-10-17T17:01:09.749542] [INFO ] [MAIN ] ACEL: Loaded 26895 existing records. [2025-10-17T17:01:09.937920] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:01:09.938168] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-17T17:01:09.938245] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-17T17:01:09.938546] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-17T17:01:09.938606] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-17T17:01:10.310458] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:01:10.358002] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-17T17:01:10.407257] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T17:01:11.157999] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-17T17:01:11.560780] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-17T17:01:11.906473] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T17:01:11.963093] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-17T17:01:11.972182] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T17:01:12.758031] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-17T17:01:13.558026] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-17T17:01:13.767226] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T17:01:14.358059] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-17T17:01:14.953804] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-17T17:01:15.143001] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T17:01:15.157989] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-17T17:01:15.252937] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-17T17:01:15.958049] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-17T17:01:16.631840] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T17:01:16.758041] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-17T17:01:17.558018] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-17T17:01:17.862312] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T17:01:17.894133] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-17T17:01:18.358063] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-17T17:01:19.158033] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-17T17:01:19.481714] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T17:01:19.489481] [INFO ] [REMOTE ] ABR: Full fetch complete (75436 records). [2025-10-17T17:01:19.489680] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-17T17:01:19.946869] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-17T17:01:19.946962] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-17T17:01:19.947728] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-17T17:01:19.947831] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-17T17:01:19.949480] [DEBUG] [LOCAL ] ABR: Trimmed 75436 records to 52735 (keeping 200 days of data) [2025-10-17T17:01:20.002203] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-17T17:01:20.284695] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T17:01:20.297398] [DEBUG] [LOCAL ] ABR: Primary data saved (52735 records). [2025-10-17T17:01:20.297697] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-17T17:01:20.297919] [INFO ] [MAIN ] Update Progress: 15/2368 symbols completed. ABR took 29.0s. Estimated remaining: 3h 19m 41s. Rate: 11.8 symbols/min [2025-10-17T17:01:20.502406] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-17T17:01:20.505456] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:01:20.568215] [DEBUG] [LOCAL ] ACHR: Loaded 54208 existing records from primary storage. [2025-10-17T17:01:20.568540] [INFO ] [MAIN ] ACHR: Loaded 54208 existing records. [2025-10-17T17:01:20.741077] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:01:20.741333] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-17T17:01:20.741394] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-17T17:01:20.741837] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-17T17:01:20.741906] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-17T17:01:20.763124] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-17T17:01:21.102203] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:01:21.243477] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-17T17:01:21.558038] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-17T17:01:22.078881] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-17T17:01:22.358094] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-17T17:01:23.158075] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-17T17:01:23.958045] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-17T17:01:24.065418] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-17T17:01:24.101028] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T17:01:24.107930] [INFO ] [REMOTE ] ABT: Full fetch complete (77377 records). [2025-10-17T17:01:24.108104] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-17T17:01:24.108976] [FATAL] [VALIDATOR ] ABT: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:01:24.109075] [FATAL] [MAIN ] ABT: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:01:24.109119] [WARN ] [MAIN ] ABT: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:01:24.109209] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-17T17:01:24.109304] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-17T17:01:24.109373] [INFO ] [LOCAL ] ABT: Starting deletion of derivative data. [2025-10-17T17:01:24.109551] [DEBUG] [LOCAL ] ABT: Deleted derivative data file. [2025-10-17T17:01:24.109783] [INFO ] [MAIN ] Update Progress: 16/2368 symbols completed. ABT took 30.7s. Estimated remaining: 3h 16m 28s. Rate: 12.0 symbols/min [2025-10-17T17:01:24.291696] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:01:24.344767] [DEBUG] [LOCAL ] ACI: Loaded 53672 existing records from primary storage. [2025-10-17T17:01:24.345097] [INFO ] [MAIN ] ACI: Loaded 53672 existing records. [2025-10-17T17:01:24.537223] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:01:24.537707] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-17T17:01:24.537773] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-17T17:01:24.538151] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-17T17:01:24.538193] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-17T17:01:24.729779] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T17:01:24.765883] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-17T17:01:24.970722] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:01:25.558073] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-17T17:01:25.767925] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T17:01:25.775359] [INFO ] [REMOTE ] ACCO: Full fetch complete (54042 records). [2025-10-17T17:01:25.775555] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-17T17:01:26.185306] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-17T17:01:26.185389] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-17T17:01:26.185973] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-17T17:01:26.186039] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-17T17:01:26.187214] [DEBUG] [LOCAL ] ACCO: Trimmed 54042 records to 37509 (keeping 200 days of data) [2025-10-17T17:01:26.375536] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-17T17:01:26.408843] [DEBUG] [LOCAL ] ACCO: Primary data saved (37509 records). [2025-10-17T17:01:26.409012] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-17T17:01:26.409127] [INFO ] [MAIN ] Update Progress: 17/2368 symbols completed. ACCO took 26.2s. Estimated remaining: 3h 10m 8s. Rate: 12.4 symbols/min [2025-10-17T17:01:26.604084] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:01:26.646118] [DEBUG] [LOCAL ] ACM: Loaded 43294 existing records from primary storage. [2025-10-17T17:01:26.646484] [INFO ] [MAIN ] ACM: Loaded 43294 existing records. [2025-10-17T17:01:26.833080] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:01:26.833314] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-17T17:01:26.833366] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-17T17:01:26.833577] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-17T17:01:26.833637] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-17T17:01:27.227610] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:01:27.228166] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-17T17:01:27.434158] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-17T17:01:27.481899] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T17:01:27.959840] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-17T17:01:27.962598] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T17:01:28.758004] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-17T17:01:28.995998] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T17:01:29.558083] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-17T17:01:30.358007] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-17T17:01:30.465241] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T17:01:30.531782] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-10-17T17:01:30.940772] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T17:01:31.158003] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-17T17:01:31.471581] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T17:01:31.958082] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-17T17:01:32.758010] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-17T17:01:32.806673] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T17:01:33.352200] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T17:01:33.558059] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-17T17:01:34.358273] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-17T17:01:35.168542] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-17T17:01:35.173627] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-17T17:01:35.250094] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T17:01:35.458597] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T17:01:35.958044] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-17T17:01:36.758004] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-17T17:01:37.000295] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T17:01:37.076926] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T17:01:37.558050] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-17T17:01:38.358077] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-17T17:01:38.644952] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T17:01:39.158035] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-17T17:01:39.300315] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-17T17:01:39.958015] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-17T17:01:40.265582] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T17:01:40.758063] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-17T17:01:40.947484] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T17:01:41.558042] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-17T17:01:41.719603] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T17:01:41.723496] [INFO ] [REMOTE ] ACEL: Full fetch complete (38901 records). [2025-10-17T17:01:41.723602] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-17T17:01:42.102987] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-17T17:01:42.103075] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-17T17:01:42.103604] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-17T17:01:42.103694] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-17T17:01:42.104632] [DEBUG] [LOCAL ] ACEL: Trimmed 38901 records to 27028 (keeping 200 days of data) [2025-10-17T17:01:42.276080] [DEBUG] [LOCAL ] ACEL: Primary data saved (27028 records). [2025-10-17T17:01:42.276275] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-17T17:01:42.276437] [INFO ] [MAIN ] Update Progress: 18/2368 symbols completed. ACEL took 32.7s. Estimated remaining: 3h 34m 1s. Rate: 11.0 symbols/min [2025-10-17T17:01:42.361393] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-17T17:01:42.476782] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:01:42.536995] [DEBUG] [LOCAL ] ACN: Loaded 53829 existing records from primary storage. [2025-10-17T17:01:42.537486] [INFO ] [MAIN ] ACN: Loaded 53829 existing records. [2025-10-17T17:01:42.728117] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:01:42.728589] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-17T17:01:42.728754] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-17T17:01:42.729188] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-17T17:01:42.729340] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-17T17:01:43.020763] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (3.06 seconds). [2025-10-17T17:01:43.156035] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:01:43.165194] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-17T17:01:43.182241] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T17:01:43.958035] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-17T17:01:44.170782] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T17:01:44.758040] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-17T17:01:45.450222] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T17:01:45.563116] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-17T17:01:45.581235] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-17T17:01:46.358013] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-17T17:01:46.715048] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T17:01:47.146043] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T17:01:47.157990] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-17T17:01:47.762462] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T17:01:47.958051] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-17T17:01:48.725544] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T17:01:48.757998] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-17T17:01:49.558019] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-17T17:01:49.832530] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T17:01:50.359673] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-17T17:01:50.365926] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T17:01:51.158098] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-17T17:01:51.958100] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-17T17:01:52.240839] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T17:01:52.314415] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-10-17T17:01:52.758072] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-17T17:01:52.805111] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T17:01:52.811130] [INFO ] [REMOTE ] ACM: Full fetch complete (63197 records). [2025-10-17T17:01:52.811251] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-17T17:01:53.205874] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-17T17:01:53.205969] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-17T17:01:53.206663] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-17T17:01:53.206736] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-17T17:01:53.208096] [DEBUG] [LOCAL ] ACM: Trimmed 63197 records to 43560 (keeping 200 days of data) [2025-10-17T17:01:53.483596] [DEBUG] [LOCAL ] ACM: Primary data saved (43560 records). [2025-10-17T17:01:53.483760] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-17T17:01:53.484678] [INFO ] [MAIN ] Update Progress: 19/2368 symbols completed. ACM took 27.1s. Estimated remaining: 3h 45m 46s. Rate: 10.4 symbols/min [2025-10-17T17:01:53.562971] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-17T17:01:53.654870] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:01:53.693739] [DEBUG] [LOCAL ] ACP: Loaded 31216 existing records from primary storage. [2025-10-17T17:01:53.694010] [INFO ] [MAIN ] ACP: Loaded 31216 existing records. [2025-10-17T17:01:53.875606] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:01:53.876042] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-17T17:01:53.876122] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-17T17:01:53.876426] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-17T17:01:53.876488] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-17T17:01:54.004726] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-17T17:01:54.310739] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:01:54.357986] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-17T17:01:54.704081] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-17T17:01:55.158077] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-17T17:01:55.928861] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T17:01:55.958003] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-17T17:01:56.063980] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-17T17:01:56.615562] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T17:01:56.758109] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-17T17:01:57.222783] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T17:01:57.558057] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-17T17:01:58.358036] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-17T17:01:58.570204] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T17:01:58.658976] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T17:01:59.158061] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-17T17:01:59.958072] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-17T17:02:00.602000] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-17T17:02:00.758041] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-17T17:02:01.190285] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T17:02:01.206638] [INFO ] [REMOTE ] ACI: Full fetch complete (77230 records). [2025-10-17T17:02:01.206958] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-17T17:02:01.558436] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-17T17:02:01.574233] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T17:02:01.693695] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-17T17:02:01.693847] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-17T17:02:01.694628] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-17T17:02:01.694725] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-17T17:02:01.696366] [DEBUG] [LOCAL ] ACI: Trimmed 77230 records to 54062 (keeping 200 days of data) [2025-10-17T17:02:02.078496] [DEBUG] [LOCAL ] ACI: Primary data saved (54062 records). [2025-10-17T17:02:02.078728] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-17T17:02:02.078839] [INFO ] [MAIN ] Update Progress: 20/2368 symbols completed. ACI took 38.0s. Estimated remaining: 3h 51m 12s. Rate: 10.2 symbols/min [2025-10-17T17:02:02.268178] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:02:02.276157] [DEBUG] [LOCAL ] ACR: Loaded 5466 existing records from primary storage. [2025-10-17T17:02:02.276380] [INFO ] [MAIN ] ACR: Loaded 5466 existing records. [2025-10-17T17:02:02.372844] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-17T17:02:02.457325] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:02:02.457728] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-17T17:02:02.457804] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-17T17:02:02.458065] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-17T17:02:02.458130] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-17T17:02:02.786208] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T17:02:02.872263] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:02:03.158052] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-17T17:02:03.773619] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-17T17:02:03.907355] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T17:02:03.958051] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-17T17:02:04.465439] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.91 seconds). [2025-10-17T17:02:04.689360] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T17:02:04.758055] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-17T17:02:05.386041] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T17:02:05.558068] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-17T17:02:06.358052] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-17T17:02:07.110445] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T17:02:07.158009] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-17T17:02:07.958043] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-17T17:02:08.154472] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T17:02:08.758044] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-17T17:02:08.867288] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-17T17:02:08.874800] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-17T17:02:08.874981] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-17T17:02:09.261489] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-17T17:02:09.261587] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-17T17:02:09.262416] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-17T17:02:09.262498] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-17T17:02:09.264241] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 54598 (keeping 200 days of data) [2025-10-17T17:02:09.567577] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-17T17:02:09.595681] [DEBUG] [LOCAL ] ACHR: Primary data saved (54598 records). [2025-10-17T17:02:09.595819] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-17T17:02:09.595958] [INFO ] [MAIN ] Update Progress: 21/2368 symbols completed. ACHR took 49.3s. Estimated remaining: 3h 54m 6s. Rate: 10.0 symbols/min [2025-10-17T17:02:09.779572] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:02:09.799934] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T17:02:09.835681] [DEBUG] [LOCAL ] ACRE: Loaded 33901 existing records from primary storage. [2025-10-17T17:02:09.835995] [INFO ] [MAIN ] ACRE: Loaded 33901 existing records. [2025-10-17T17:02:10.031968] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:02:10.032447] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-17T17:02:10.032510] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-17T17:02:10.042389] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-17T17:02:10.042492] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-17T17:02:10.139249] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-17T17:02:10.363145] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-17T17:02:10.434801] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:02:10.443604] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-17T17:02:11.158038] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-17T17:02:11.958061] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-17T17:02:12.663788] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-17T17:02:12.701295] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T17:02:12.758008] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-17T17:02:13.208574] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T17:02:13.558035] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-17T17:02:14.352721] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T17:02:14.359898] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-17T17:02:14.883383] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T17:02:15.158058] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-17T17:02:15.198717] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-17T17:02:15.958093] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-17T17:02:16.354747] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T17:02:16.359201] [INFO ] [REMOTE ] ACP: Full fetch complete (46296 records). [2025-10-17T17:02:16.359322] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-17T17:02:16.360100] [FATAL] [VALIDATOR ] ACP: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:02:16.360190] [FATAL] [MAIN ] ACP: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:02:16.360236] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:02:16.360337] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-17T17:02:16.360455] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-17T17:02:16.360525] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-10-17T17:02:16.360792] [DEBUG] [LOCAL ] ACP: Deleted derivative data file. [2025-10-17T17:02:16.360929] [INFO ] [MAIN ] Update Progress: 22/2368 symbols completed. ACP took 22.9s. Estimated remaining: 3h 55m 23s. Rate: 10.0 symbols/min [2025-10-17T17:02:16.543323] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:02:16.553780] [DEBUG] [LOCAL ] ACV: Loaded 7694 existing records from primary storage. [2025-10-17T17:02:16.554028] [INFO ] [MAIN ] ACV: Loaded 7694 existing records. [2025-10-17T17:02:16.746600] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:02:16.746864] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-17T17:02:16.746933] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-17T17:02:16.747129] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-17T17:02:16.747190] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-17T17:02:16.762678] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-17T17:02:17.109722] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:02:17.558026] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-17T17:02:17.641411] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-17T17:02:17.808434] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T17:02:18.358043] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-17T17:02:18.978945] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T17:02:19.128035] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-17T17:02:19.157998] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-17T17:02:19.595495] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-17T17:02:19.958042] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-17T17:02:20.758098] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-17T17:02:20.798306] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-17T17:02:21.558062] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-17T17:02:22.169078] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T17:02:22.358047] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-17T17:02:22.750982] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-17T17:02:23.158061] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-17T17:02:23.536412] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T17:02:23.808786] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-17T17:02:23.958113] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-17T17:02:24.410811] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T17:02:24.758126] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-17T17:02:25.558054] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-17T17:02:26.363315] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-17T17:02:26.379288] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T17:02:26.499979] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T17:02:26.899256] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-17T17:02:27.158098] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-17T17:02:27.738926] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T17:02:27.958070] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-17T17:02:28.565286] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T17:02:28.566429] [INFO ] [REMOTE ] ACR: Full fetch complete (8554 records). [2025-10-17T17:02:28.566501] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-17T17:02:28.763144] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-17T17:02:28.937843] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-17T17:02:28.937922] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-17T17:02:28.938107] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-17T17:02:28.938170] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-17T17:02:28.938623] [DEBUG] [LOCAL ] ACR: Trimmed 8554 records to 5512 (keeping 200 days of data) [2025-10-17T17:02:28.970588] [DEBUG] [LOCAL ] ACR: Primary data saved (5512 records). [2025-10-17T17:02:28.970758] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-17T17:02:28.970856] [INFO ] [MAIN ] Update Progress: 23/2368 symbols completed. ACR took 26.9s. Estimated remaining: 4h 6m 29s. Rate: 9.5 symbols/min [2025-10-17T17:02:29.138441] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:02:29.184400] [DEBUG] [LOCAL ] ACVA: Loaded 49671 existing records from primary storage. [2025-10-17T17:02:29.184776] [INFO ] [MAIN ] ACVA: Loaded 49671 existing records. [2025-10-17T17:02:29.363040] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:02:29.363306] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-17T17:02:29.363354] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-17T17:02:29.363678] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-17T17:02:29.363736] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-17T17:02:29.579366] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-17T17:02:29.766913] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:02:30.298076] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T17:02:30.358027] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-17T17:02:31.158051] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-17T17:02:31.677972] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T17:02:31.958049] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-17T17:02:32.084585] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-17T17:02:32.092446] [INFO ] [REMOTE ] ACN: Full fetch complete (77382 records). [2025-10-17T17:02:32.092609] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-17T17:02:32.481299] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-17T17:02:32.481469] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-17T17:02:32.482229] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-17T17:02:32.482385] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-17T17:02:32.498153] [DEBUG] [LOCAL ] ACN: Trimmed 77382 records to 54216 (keeping 200 days of data) [2025-10-17T17:02:32.509243] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T17:02:32.646113] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T17:02:32.758120] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-17T17:02:32.868492] [DEBUG] [LOCAL ] ACN: Primary data saved (54216 records). [2025-10-17T17:02:32.868628] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-17T17:02:32.869742] [INFO ] [MAIN ] Update Progress: 24/2368 symbols completed. ACN took 50.6s. Estimated remaining: 4h 2m 27s. Rate: 9.7 symbols/min [2025-10-17T17:02:33.037195] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:02:33.037345] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-17T17:02:33.037382] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-17T17:02:33.037537] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-17T17:02:33.037605] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-17T17:02:33.037727] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-17T17:02:33.037808] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-17T17:02:33.403071] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:02:33.399448] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-17T17:02:33.557999] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-17T17:02:33.751766] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:02:33.752061] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-17T17:02:33.752153] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:02:33.752220] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-17T17:02:33.752299] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:02:33.752385] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-17T17:02:33.752470] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-17T17:02:33.752522] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-17T17:02:33.752579] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-17T17:02:33.752679] [INFO ] [MAIN ] Update Progress: 25/2368 symbols completed. AD took 0.9s. Estimated remaining: 3h 54m 2s. Rate: 10.0 symbols/min [2025-10-17T17:02:33.922147] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:02:33.922329] [DEBUG] [LOCAL ] ADC: No existing data file found in primary storage. [2025-10-17T17:02:33.922368] [WARN ] [MAIN ] ADC: No existing data found, performing full refresh instead. [2025-10-17T17:02:33.922493] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-17T17:02:33.922535] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-17T17:02:33.922578] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-17T17:02:33.922613] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-17T17:02:34.281976] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:02:34.357994] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-17T17:02:35.158058] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-17T17:02:35.551358] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-17T17:02:35.644775] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-17T17:02:35.958060] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-17T17:02:36.758067] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-17T17:02:37.224462] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T17:02:37.348095] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-17T17:02:37.558020] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-17T17:02:38.304829] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-17T17:02:38.358039] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-17T17:02:39.158052] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-17T17:02:39.522094] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T17:02:39.853774] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T17:02:39.855844] [INFO ] [REMOTE ] ACV: Full fetch complete (10395 records). [2025-10-17T17:02:39.855918] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-17T17:02:39.963155] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-17T17:02:40.301038] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-17T17:02:40.301147] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-17T17:02:40.301444] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-17T17:02:40.301511] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-17T17:02:40.302094] [DEBUG] [LOCAL ] ACV: Trimmed 10395 records to 7718 (keeping 200 days of data) [2025-10-17T17:02:40.350270] [DEBUG] [LOCAL ] ACV: Primary data saved (7718 records). [2025-10-17T17:02:40.350443] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-17T17:02:40.350556] [INFO ] [MAIN ] Update Progress: 26/2368 symbols completed. ACV took 24.0s. Estimated remaining: 3h 54m 51s. Rate: 10.0 symbols/min [2025-10-17T17:02:40.560483] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:02:40.602447] [DEBUG] [LOCAL ] ADCT: Loaded 35639 existing records from primary storage. [2025-10-17T17:02:40.602797] [INFO ] [MAIN ] ADCT: Loaded 35639 existing records. [2025-10-17T17:02:40.766534] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-17T17:02:40.800096] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:02:40.801084] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-17T17:02:40.801151] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-17T17:02:40.801881] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-17T17:02:40.802006] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-17T17:02:41.205987] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:02:41.497985] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T17:02:41.558025] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-17T17:02:42.305748] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:02:42.357988] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-17T17:02:42.524021] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-17T17:02:43.158111] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-17T17:02:43.829415] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T17:02:43.958097] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-17T17:02:44.472106] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T17:02:44.477316] [INFO ] [REMOTE ] ACRE: Full fetch complete (49787 records). [2025-10-17T17:02:44.477475] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-17T17:02:44.764240] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-17T17:02:44.866244] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-17T17:02:44.866336] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-17T17:02:44.866886] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-17T17:02:44.866954] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-17T17:02:44.868186] [DEBUG] [LOCAL ] ACRE: Trimmed 49787 records to 34100 (keeping 200 days of data) [2025-10-17T17:02:45.059999] [DEBUG] [LOCAL ] ACRE: Primary data saved (34100 records). [2025-10-17T17:02:45.060157] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-17T17:02:45.060253] [INFO ] [MAIN ] Update Progress: 27/2368 symbols completed. ACRE took 35.5s. Estimated remaining: 3h 52m 51s. Rate: 10.1 symbols/min [2025-10-17T17:02:45.229802] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:02:45.230075] [DEBUG] [LOCAL ] ADM: No existing data file found in primary storage. [2025-10-17T17:02:45.230122] [WARN ] [MAIN ] ADM: No existing data found, performing full refresh instead. [2025-10-17T17:02:45.230238] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-17T17:02:45.230279] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-17T17:02:45.230320] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-10-17T17:02:45.230353] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-17T17:02:45.566734] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-17T17:02:45.588187] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:02:45.619728] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T17:02:46.358016] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-17T17:02:46.514081] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T17:02:47.158063] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-17T17:02:47.261901] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:02:47.958087] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-17T17:02:48.375660] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-17T17:02:48.758111] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-17T17:02:48.985990] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T17:02:49.558073] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-17T17:02:49.778628] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-17T17:02:50.214621] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T17:02:50.358051] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-17T17:02:50.768883] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T17:02:51.158145] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-17T17:02:51.958068] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-17T17:02:52.041789] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T17:02:52.434212] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-17T17:02:52.758078] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-17T17:02:53.558078] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-17T17:02:53.897082] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-17T17:02:54.358045] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-17T17:02:54.397292] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T17:02:54.441425] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T17:02:55.158051] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-17T17:02:55.958331] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T17:02:55.958476] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-17T17:02:56.758068] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-17T17:02:57.037518] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-17T17:02:57.428628] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T17:02:57.557988] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-17T17:02:58.309846] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T17:02:58.357990] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-17T17:02:59.158018] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-17T17:02:59.552346] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T17:02:59.958062] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-17T17:03:00.092326] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T17:03:00.099193] [INFO ] [REMOTE ] ADC: Full fetch complete (66558 records). [2025-10-17T17:03:00.099337] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-17T17:03:00.499389] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-17T17:03:00.499605] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-17T17:03:00.500411] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-17T17:03:00.500469] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-17T17:03:00.502067] [DEBUG] [LOCAL ] ADC: Trimmed 66558 records to 47056 (keeping 200 days of data) [2025-10-17T17:03:00.750035] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T17:03:00.758082] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-17T17:03:00.841185] [DEBUG] [LOCAL ] ADC: Primary data saved (47056 records). [2025-10-17T17:03:00.841297] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-17T17:03:00.841373] [INFO ] [MAIN ] Update Progress: 28/2368 symbols completed. ADC took 27.1s. Estimated remaining: 4h 6m 26s. Rate: 9.5 symbols/min [2025-10-17T17:03:01.017214] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:03:01.064235] [DEBUG] [LOCAL ] ADNT: Loaded 47055 existing records from primary storage. [2025-10-17T17:03:01.064680] [INFO ] [MAIN ] ADNT: Loaded 47055 existing records. [2025-10-17T17:03:01.249172] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:03:01.249369] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-17T17:03:01.249422] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-17T17:03:01.250551] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-17T17:03:01.250617] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-17T17:03:01.563156] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-17T17:03:01.641633] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:03:01.900355] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T17:03:02.267727] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T17:03:02.358060] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-17T17:03:02.826004] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-17T17:03:03.158051] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-17T17:03:03.958051] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-17T17:03:04.263286] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T17:03:04.758019] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-17T17:03:04.786861] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T17:03:04.870576] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T17:03:05.558033] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-17T17:03:06.358004] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-17T17:03:06.389433] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T17:03:07.158039] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-17T17:03:07.543832] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-17T17:03:07.955192] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T17:03:07.963973] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-17T17:03:08.767374] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-17T17:03:08.774843] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T17:03:09.558590] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-17T17:03:09.561407] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T17:03:09.910510] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T17:03:10.358029] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-17T17:03:11.158057] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-17T17:03:11.413203] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T17:03:11.957992] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-17T17:03:12.037276] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T17:03:12.758041] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-17T17:03:12.889357] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T17:03:12.896004] [INFO ] [REMOTE ] ACVA: Full fetch complete (70624 records). [2025-10-17T17:03:12.896150] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-17T17:03:12.896956] [FATAL] [VALIDATOR ] ACVA: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:03:12.897051] [FATAL] [MAIN ] ACVA: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:03:12.897094] [WARN ] [MAIN ] ACVA: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:03:12.897135] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-17T17:03:12.897194] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-10-17T17:03:12.897230] [INFO ] [LOCAL ] ACVA: Starting deletion of derivative data. [2025-10-17T17:03:12.897481] [DEBUG] [LOCAL ] ACVA: Deleted derivative data file. [2025-10-17T17:03:12.897601] [INFO ] [MAIN ] Update Progress: 29/2368 symbols completed. ACVA took 43.9s. Estimated remaining: 4h 14m 2s. Rate: 9.2 symbols/min [2025-10-17T17:03:13.062264] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:03:13.110825] [DEBUG] [LOCAL ] ADT: Loaded 53829 existing records from primary storage. [2025-10-17T17:03:13.111122] [INFO ] [MAIN ] ADT: Loaded 53829 existing records. [2025-10-17T17:03:13.288337] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:03:13.288534] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-17T17:03:13.288582] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-17T17:03:13.288884] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-17T17:03:13.288949] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-17T17:03:13.559900] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-17T17:03:13.660969] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T17:03:13.663949] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:03:14.358030] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-17T17:03:14.540191] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T17:03:14.976987] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T17:03:15.157999] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-17T17:03:15.638407] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T17:03:15.958038] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-17T17:03:16.593838] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T17:03:16.758062] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-17T17:03:17.558053] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-17T17:03:17.720677] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T17:03:18.358041] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-17T17:03:18.514170] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T17:03:19.158013] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-17T17:03:19.239598] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T17:03:19.245292] [INFO ] [REMOTE ] ADCT: Full fetch complete (51257 records). [2025-10-17T17:03:19.245379] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-17T17:03:19.246043] [FATAL] [VALIDATOR ] ADCT: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:03:19.246130] [FATAL] [MAIN ] ADCT: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:03:19.246172] [WARN ] [MAIN ] ADCT: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:03:19.246240] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-17T17:03:19.246303] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-17T17:03:19.246339] [INFO ] [LOCAL ] ADCT: Starting deletion of derivative data. [2025-10-17T17:03:19.246477] [DEBUG] [LOCAL ] ADCT: Deleted derivative data file. [2025-10-17T17:03:19.246565] [INFO ] [MAIN ] Update Progress: 30/2368 symbols completed. ADCT took 38.9s. Estimated remaining: 4h 13m 42s. Rate: 9.2 symbols/min [2025-10-17T17:03:19.410284] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:03:19.437187] [DEBUG] [LOCAL ] ADX: Loaded 27929 existing records from primary storage. [2025-10-17T17:03:19.437440] [INFO ] [MAIN ] ADX: Loaded 27929 existing records. [2025-10-17T17:03:19.619272] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:03:19.619511] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-17T17:03:19.619569] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-17T17:03:19.619773] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-17T17:03:19.619830] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-17T17:03:19.959044] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-17T17:03:20.001730] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:03:20.081234] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T17:03:20.758073] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-17T17:03:21.040343] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T17:03:21.193390] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-17T17:03:21.558080] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-17T17:03:22.093081] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T17:03:22.358030] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-17T17:03:23.086916] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T17:03:23.158040] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-17T17:03:23.958067] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-17T17:03:24.097085] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T17:03:24.741698] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T17:03:24.757991] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-17T17:03:25.558037] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-17T17:03:26.131305] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T17:03:26.236337] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-17T17:03:26.244373] [INFO ] [REMOTE ] ADM: Full fetch complete (77451 records). [2025-10-17T17:03:26.244687] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-17T17:03:26.363208] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-17T17:03:26.698888] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-17T17:03:26.699037] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-17T17:03:26.700045] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-17T17:03:26.700119] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-17T17:03:26.702380] [DEBUG] [LOCAL ] ADM: Trimmed 77451 records to 54178 (keeping 200 days of data) [2025-10-17T17:03:26.956356] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T17:03:27.089895] [DEBUG] [LOCAL ] ADM: Primary data saved (54178 records). [2025-10-17T17:03:27.090093] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-17T17:03:27.090204] [INFO ] [MAIN ] Update Progress: 31/2368 symbols completed. ADM took 42.0s. Estimated remaining: 4h 15m 16s. Rate: 9.2 symbols/min [2025-10-17T17:03:27.166617] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-17T17:03:27.269599] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:03:27.324528] [DEBUG] [LOCAL ] AEE: Loaded 50542 existing records from primary storage. [2025-10-17T17:03:27.325012] [INFO ] [MAIN ] AEE: Loaded 50542 existing records. [2025-10-17T17:03:27.515994] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:03:27.516409] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-17T17:03:27.516474] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-17T17:03:27.516960] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-17T17:03:27.517033] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-17T17:03:27.961367] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:03:27.981324] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-17T17:03:27.987006] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T17:03:28.758018] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-17T17:03:29.150487] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-17T17:03:29.558016] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-17T17:03:29.711351] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T17:03:29.715619] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T17:03:30.358026] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-17T17:03:31.158010] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-17T17:03:31.306130] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T17:03:31.863459] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T17:03:31.958005] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-17T17:03:32.638154] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T17:03:32.644356] [INFO ] [REMOTE ] ADNT: Full fetch complete (68010 records). [2025-10-17T17:03:32.644479] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-17T17:03:32.763183] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-17T17:03:33.041221] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-17T17:03:33.041331] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-17T17:03:33.042034] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-17T17:03:33.042097] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-17T17:03:33.043921] [DEBUG] [LOCAL ] ADNT: Trimmed 68010 records to 47379 (keeping 200 days of data) [2025-10-17T17:03:33.325004] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-17T17:03:33.342411] [DEBUG] [LOCAL ] ADNT: Primary data saved (47379 records). [2025-10-17T17:03:33.342924] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-17T17:03:33.343977] [INFO ] [MAIN ] Update Progress: 32/2368 symbols completed. ADNT took 32.5s. Estimated remaining: 4h 14m 48s. Rate: 9.2 symbols/min [2025-10-17T17:03:33.507778] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:03:33.507955] [DEBUG] [LOCAL ] AEFC: No existing data file found in primary storage. [2025-10-17T17:03:33.507992] [WARN ] [MAIN ] AEFC: No existing data found, performing full refresh instead. [2025-10-17T17:03:33.508105] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-17T17:03:33.508159] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-17T17:03:33.508227] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-17T17:03:33.508272] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-17T17:03:33.568460] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-17T17:03:33.870174] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:03:34.282329] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T17:03:34.357998] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-17T17:03:34.889124] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-17T17:03:35.158033] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-17T17:03:35.958086] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-17T17:03:36.385106] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T17:03:36.685010] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T17:03:36.758229] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-17T17:03:36.925333] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-17T17:03:37.558052] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-17T17:03:37.802409] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T17:03:38.358027] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-17T17:03:38.846355] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T17:03:39.158022] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-17T17:03:39.405827] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T17:03:39.958079] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-17T17:03:40.758061] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-17T17:03:40.796239] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T17:03:41.402954] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T17:03:41.558038] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-17T17:03:42.357994] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-17T17:03:42.501733] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-17T17:03:43.137331] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T17:03:43.157981] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-17T17:03:43.958000] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-17T17:03:44.060302] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-17T17:03:44.284976] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (3.53 seconds). [2025-10-17T17:03:44.758045] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-17T17:03:44.974227] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T17:03:45.558038] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-17T17:03:45.619257] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-17T17:03:46.358022] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-17T17:03:46.839150] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T17:03:46.843560] [INFO ] [REMOTE ] ADX: Full fetch complete (41949 records). [2025-10-17T17:03:46.843687] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-17T17:03:47.170741] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-17T17:03:47.224507] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-17T17:03:47.224773] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-17T17:03:47.225448] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-17T17:03:47.225554] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-17T17:03:47.226633] [DEBUG] [LOCAL ] ADX: Trimmed 41949 records to 28160 (keeping 200 days of data) [2025-10-17T17:03:47.323743] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T17:03:47.410894] [DEBUG] [LOCAL ] ADX: Primary data saved (28160 records). [2025-10-17T17:03:47.411080] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-17T17:03:47.411226] [INFO ] [MAIN ] Update Progress: 33/2368 symbols completed. ADX took 28.2s. Estimated remaining: 4h 23m 34s. Rate: 8.9 symbols/min [2025-10-17T17:03:47.578914] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:03:47.623429] [DEBUG] [LOCAL ] AEG: Loaded 49936 existing records from primary storage. [2025-10-17T17:03:47.623756] [INFO ] [MAIN ] AEG: Loaded 49936 existing records. [2025-10-17T17:03:47.798292] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:03:47.798499] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-17T17:03:47.798547] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-17T17:03:47.798798] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-17T17:03:47.798854] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-17T17:03:47.972339] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-17T17:03:48.155918] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:03:48.758075] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-17T17:03:49.145900] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-17T17:03:49.153279] [INFO ] [REMOTE ] ADT: Full fetch complete (77365 records). [2025-10-17T17:03:49.153407] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-17T17:03:49.560143] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-17T17:03:49.564200] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-17T17:03:49.565370] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-17T17:03:49.566196] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-17T17:03:49.566361] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-17T17:03:49.568296] [DEBUG] [LOCAL ] ADT: Trimmed 77365 records to 54217 (keeping 200 days of data) [2025-10-17T17:03:49.889188] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-17T17:03:49.921028] [DEBUG] [LOCAL ] ADT: Primary data saved (54217 records). [2025-10-17T17:03:49.921175] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-17T17:03:49.921265] [INFO ] [MAIN ] Update Progress: 34/2368 symbols completed. ADT took 37.0s. Estimated remaining: 4h 18m 34s. Rate: 9.0 symbols/min [2025-10-17T17:03:50.087142] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:03:50.141197] [DEBUG] [LOCAL ] AEM: Loaded 53868 existing records from primary storage. [2025-10-17T17:03:50.141501] [INFO ] [MAIN ] AEM: Loaded 53868 existing records. [2025-10-17T17:03:50.318531] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:03:50.318751] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-17T17:03:50.318803] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-17T17:03:50.319017] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-17T17:03:50.319075] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-17T17:03:50.361053] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-17T17:03:50.579995] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-17T17:03:50.655445] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T17:03:50.719957] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:03:51.158019] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-17T17:03:51.860114] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-17T17:03:51.957995] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-17T17:03:52.081389] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T17:03:52.416402] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-17T17:03:52.758020] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-17T17:03:53.558022] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-17T17:03:54.360960] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-17T17:03:54.366123] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T17:03:55.158069] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-17T17:03:55.293916] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T17:03:55.958090] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-17T17:03:56.104064] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T17:03:56.262311] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T17:03:56.758023] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-17T17:03:57.558015] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-17T17:03:57.824029] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T17:03:58.093003] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-17T17:03:58.358040] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-17T17:03:59.158036] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-17T17:03:59.327804] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T17:03:59.745537] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T17:03:59.958057] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-17T17:03:59.991775] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-17T17:04:00.758028] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-17T17:04:01.558035] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-17T17:04:02.001575] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-17T17:04:02.361518] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-17T17:04:02.362742] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T17:04:02.366281] [INFO ] [REMOTE ] AEFC: Full fetch complete (11736 records). [2025-10-17T17:04:02.366420] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-17T17:04:02.742375] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-17T17:04:02.742503] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-17T17:04:02.742861] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-17T17:04:02.743065] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-17T17:04:02.743967] [DEBUG] [LOCAL ] AEFC: Trimmed 11736 records to 8348 (keeping 200 days of data) [2025-10-17T17:04:02.813301] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T17:04:02.836795] [DEBUG] [LOCAL ] AEFC: Primary data saved (8348 records). [2025-10-17T17:04:02.836919] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-17T17:04:02.836991] [INFO ] [MAIN ] Update Progress: 35/2368 symbols completed. AEFC took 29.5s. Estimated remaining: 4h 25m 25s. Rate: 8.8 symbols/min [2025-10-17T17:04:03.003759] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:04:03.058799] [DEBUG] [LOCAL ] AEO: Loaded 53956 existing records from primary storage. [2025-10-17T17:04:03.059142] [INFO ] [MAIN ] AEO: Loaded 53956 existing records. [2025-10-17T17:04:03.163237] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-17T17:04:03.238614] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:04:03.238828] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-17T17:04:03.238878] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-17T17:04:03.239068] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-17T17:04:03.239111] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-17T17:04:03.578143] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:04:03.958013] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-17T17:04:04.066234] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T17:04:04.758019] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-17T17:04:05.154085] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-17T17:04:05.231608] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T17:04:05.558028] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-17T17:04:06.358035] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-17T17:04:06.977378] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-17T17:04:07.158002] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-17T17:04:07.191016] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T17:04:07.958040] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-17T17:04:08.013237] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T17:04:08.758007] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-17T17:04:09.163126] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-17T17:04:09.557996] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-17T17:04:09.652406] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T17:04:10.296068] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T17:04:10.357987] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-17T17:04:11.004169] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T17:04:11.158016] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-17T17:04:11.958033] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-17T17:04:12.099252] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T17:04:12.758011] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-17T17:04:12.793377] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:04:13.558000] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-17T17:04:13.806229] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T17:04:14.358003] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-17T17:04:14.478505] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T17:04:15.081986] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-17T17:04:15.088431] [INFO ] [REMOTE ] AEE: Full fetch complete (72638 records). [2025-10-17T17:04:15.088541] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-17T17:04:15.089321] [FATAL] [VALIDATOR ] AEE: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:04:15.089413] [FATAL] [MAIN ] AEE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:04:15.089457] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:04:15.089510] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-17T17:04:15.089609] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-10-17T17:04:15.089717] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-10-17T17:04:15.089960] [DEBUG] [LOCAL ] AEE: Deleted derivative data file. [2025-10-17T17:04:15.090055] [INFO ] [MAIN ] Update Progress: 36/2368 symbols completed. AEE took 48.0s. Estimated remaining: 4h 31m 10s. Rate: 8.6 symbols/min [2025-10-17T17:04:15.163320] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-17T17:04:15.258540] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:04:15.307004] [DEBUG] [LOCAL ] AER: Loaded 48455 existing records from primary storage. [2025-10-17T17:04:15.307312] [INFO ] [MAIN ] AER: Loaded 48455 existing records. [2025-10-17T17:04:15.486466] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:04:15.486706] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-17T17:04:15.486765] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-17T17:04:15.487114] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-17T17:04:15.487172] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-17T17:04:15.847489] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:04:15.874765] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T17:04:15.958043] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-17T17:04:16.758060] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-17T17:04:17.032356] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T17:04:17.339822] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T17:04:17.558049] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-17T17:04:18.358002] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-17T17:04:18.448137] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T17:04:19.158043] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-17T17:04:19.640083] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-17T17:04:19.958042] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-17T17:04:20.133051] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T17:04:20.139815] [INFO ] [REMOTE ] AEG: Full fetch complete (70613 records). [2025-10-17T17:04:20.139976] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-17T17:04:20.524523] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-17T17:04:20.524616] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-17T17:04:20.525309] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-17T17:04:20.525373] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-17T17:04:20.526838] [DEBUG] [LOCAL ] AEG: Trimmed 70613 records to 50300 (keeping 200 days of data) [2025-10-17T17:04:20.762432] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-17T17:04:20.821046] [DEBUG] [LOCAL ] AEG: Primary data saved (50300 records). [2025-10-17T17:04:20.821205] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-17T17:04:20.821365] [INFO ] [MAIN ] Update Progress: 37/2368 symbols completed. AEG took 33.4s. Estimated remaining: 4h 29m 45s. Rate: 8.6 symbols/min [2025-10-17T17:04:20.874133] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T17:04:21.558006] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-17T17:04:21.935633] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-17T17:04:22.060847] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T17:04:22.358045] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-17T17:04:23.158089] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-17T17:04:23.412809] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T17:04:23.958045] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-17T17:04:24.408097] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-17T17:04:24.470492] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-17T17:04:24.758041] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-17T17:04:25.558014] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-17T17:04:25.999289] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T17:04:26.357990] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-17T17:04:26.627773] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T17:04:27.158003] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-17T17:04:27.600881] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-17T17:04:27.607588] [INFO ] [REMOTE ] AEM: Full fetch complete (77062 records). [2025-10-17T17:04:27.607707] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-17T17:04:27.608482] [FATAL] [VALIDATOR ] AEM: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:04:27.608570] [FATAL] [MAIN ] AEM: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:04:27.608637] [WARN ] [MAIN ] AEM: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:04:27.608734] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-17T17:04:27.608800] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-10-17T17:04:27.608838] [INFO ] [LOCAL ] AEM: Starting deletion of derivative data. [2025-10-17T17:04:27.608985] [DEBUG] [LOCAL ] AEM: Deleted derivative data file. [2025-10-17T17:04:27.609849] [INFO ] [MAIN ] Update Progress: 38/2368 symbols completed. AEM took 37.7s. Estimated remaining: 4h 29m 28s. Rate: 8.6 symbols/min [2025-10-17T17:04:28.281571] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T17:04:28.293259] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-17T17:04:28.826737] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T17:04:28.838950] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-17T17:04:30.407046] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-17T17:04:30.419807] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-17T17:04:30.514337] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:04:30.524543] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-17T17:04:32.018488] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T17:04:32.028056] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-17T17:04:32.092744] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T17:04:32.100583] [INFO ] [REMOTE ] AEO: Full fetch complete (77647 records). [2025-10-17T17:04:32.100798] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-17T17:04:32.498028] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-17T17:04:32.498124] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-17T17:04:32.498950] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-17T17:04:32.499019] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-17T17:04:32.500674] [DEBUG] [LOCAL ] AEO: Trimmed 77647 records to 54346 (keeping 200 days of data) [2025-10-17T17:04:32.829418] [DEBUG] [LOCAL ] AEO: Primary data saved (54346 records). [2025-10-17T17:04:32.829560] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-17T17:04:32.830873] [INFO ] [MAIN ] Update Progress: 39/2368 symbols completed. AEO took 30.0s. Estimated remaining: 4h 27m 39s. Rate: 8.7 symbols/min [2025-10-17T17:04:33.738336] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T17:04:33.748869] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-17T17:04:35.105332] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T17:04:35.117135] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-17T17:04:36.733181] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T17:04:36.743270] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-17T17:04:38.481308] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T17:04:38.487662] [INFO ] [REMOTE ] AER: Full fetch complete (69941 records). [2025-10-17T17:04:38.487785] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-17T17:04:38.869501] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-17T17:04:38.869578] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-17T17:04:38.870231] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-17T17:04:38.870295] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-17T17:04:38.871574] [DEBUG] [LOCAL ] AER: Trimmed 69941 records to 48795 (keeping 200 days of data) [2025-10-17T17:04:39.169328] [DEBUG] [LOCAL ] AER: Primary data saved (48795 records). [2025-10-17T17:04:39.169466] [INFO ] [MAIN ] AER: Full history saved. [2025-10-17T17:04:39.170568] [INFO ] [MAIN ] Update Progress: 40/2368 symbols completed. AER took 24.1s. Estimated remaining: 4h 26m 60s. Rate: 8.7 symbols/min [2025-10-17T17:04:39.704745] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:04:39.862323] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:04:39.855152] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:04:39.881803] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:04:39.878275] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-17T17:04:39.882446] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-17T17:04:39.882942] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-17T17:04:39.883010] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-17T17:04:39.883181] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-17T17:04:39.883287] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-17T17:04:39.999812] [DEBUG] [LOCAL ] AFB: Loaded 11274 existing records from primary storage. [2025-10-17T17:04:40.004263] [INFO ] [MAIN ] AFB: Loaded 11274 existing records. [2025-10-17T17:04:40.254831] [DEBUG] [LOCAL ] AES: Loaded 54059 existing records from primary storage. [2025-10-17T17:04:40.283922] [INFO ] [MAIN ] AES: Loaded 54059 existing records. [2025-10-17T17:04:40.361531] [DEBUG] [LOCAL ] AESI: Loaded 50127 existing records from primary storage. [2025-10-17T17:04:40.432478] [INFO ] [MAIN ] AESI: Loaded 50127 existing records. [2025-10-17T17:04:40.689722] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:04:40.813527] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:04:40.832167] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-17T17:04:40.832383] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-17T17:04:40.895025] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-17T17:04:40.906328] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-17T17:04:40.907268] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-17T17:04:40.921210] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:04:40.953508] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-17T17:04:40.987154] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-17T17:04:41.016118] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:04:41.040527] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-17T17:04:41.040632] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-17T17:04:41.052403] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-17T17:04:41.052315] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-17T17:04:41.094425] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-17T17:04:41.105791] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-17T17:04:41.199285] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:04:41.361467] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-17T17:04:41.402523] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:04:41.423452] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-17T17:04:41.476841] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:04:41.570175] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-17T17:04:41.676502] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-17T17:04:41.740306] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-17T17:04:41.802451] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-17T17:04:41.912994] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:04:41.932093] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-17T17:04:41.928593] [INFO ] [MAIN ] Update Progress: 41/2368 symbols completed. AEXA took 2.8s. Estimated remaining: 4h 22m 59s. Rate: 8.8 symbols/min [2025-10-17T17:04:42.134097] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:04:42.186889] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-17T17:04:42.186413] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:04:42.225111] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-17T17:04:42.302319] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:04:42.340474] [DEBUG] [LOCAL ] AFG: Loaded 32434 existing records from primary storage. [2025-10-17T17:04:42.340794] [INFO ] [MAIN ] AFG: Loaded 32434 existing records. [2025-10-17T17:04:42.511518] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:04:42.511747] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-17T17:04:42.511809] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-17T17:04:42.512121] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-17T17:04:42.512200] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-17T17:04:42.863296] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:04:42.863801] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-17T17:04:42.874138] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-17T17:04:42.877062] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-17T17:04:43.650922] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T17:04:43.655276] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-17T17:04:43.874429] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T17:04:43.883583] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-17T17:04:43.964444] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T17:04:43.969825] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-17T17:04:44.149178] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T17:04:44.151984] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-17T17:04:44.294149] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-17T17:04:44.304938] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-17T17:04:44.799786] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-17T17:04:44.803340] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-17T17:04:44.871745] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T17:04:44.877690] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-17T17:04:45.022793] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T17:04:45.031724] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-17T17:04:45.379509] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T17:04:45.558029] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-17T17:04:46.035920] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T17:04:46.362562] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-17T17:04:46.373461] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T17:04:46.375144] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-17T17:04:46.459266] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T17:04:47.158027] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-17T17:04:47.604427] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T17:04:47.958073] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-17T17:04:48.758085] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-17T17:04:48.985269] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T17:04:49.074325] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-17T17:04:49.558023] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-17T17:04:50.364712] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-17T17:04:50.385574] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T17:04:50.969354] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T17:04:51.158036] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-17T17:04:51.669029] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-17T17:04:51.944616] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T17:04:51.957995] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-17T17:04:52.758096] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-17T17:04:53.295378] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T17:04:53.558032] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-17T17:04:53.612243] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T17:04:54.358042] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-17T17:04:55.158067] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-17T17:04:55.796279] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-17T17:04:55.907697] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T17:04:55.931962] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T17:04:55.958016] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-17T17:04:56.758005] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-17T17:04:56.795324] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T17:04:56.797244] [INFO ] [REMOTE ] AFB: Full fetch complete (16494 records). [2025-10-17T17:04:56.797312] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-17T17:04:57.162750] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-17T17:04:57.162856] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-17T17:04:57.163156] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-17T17:04:57.163204] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-17T17:04:57.163968] [DEBUG] [LOCAL ] AFB: Trimmed 16494 records to 11315 (keeping 200 days of data) [2025-10-17T17:04:57.230124] [DEBUG] [LOCAL ] AFB: Primary data saved (11315 records). [2025-10-17T17:04:57.230260] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-17T17:04:57.230343] [INFO ] [MAIN ] Update Progress: 42/2368 symbols completed. AFB took 18.1s. Estimated remaining: 4h 30m 44s. Rate: 8.6 symbols/min [2025-10-17T17:04:57.400623] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:04:57.400781] [DEBUG] [LOCAL ] AFGB: No existing data file found in primary storage. [2025-10-17T17:04:57.400823] [WARN ] [MAIN ] AFGB: No existing data found, performing full refresh instead. [2025-10-17T17:04:57.400933] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-17T17:04:57.400973] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-17T17:04:57.401014] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-17T17:04:57.401046] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-17T17:04:57.558596] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-17T17:04:57.763924] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:04:58.358003] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-17T17:04:58.760234] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T17:04:58.840145] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-17T17:04:59.066686] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-17T17:04:59.158009] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-17T17:04:59.958073] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-17T17:05:00.185186] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T17:05:00.494628] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-17T17:05:00.758081] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-17T17:05:01.558053] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-17T17:05:01.893558] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-17T17:05:02.236351] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T17:05:02.358074] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-17T17:05:02.785741] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-17T17:05:03.158046] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-17T17:05:03.790454] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-17T17:05:03.958229] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-17T17:05:04.316611] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-17T17:05:04.758046] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-17T17:05:05.213328] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-17T17:05:05.558027] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-17T17:05:06.358020] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-17T17:05:06.932552] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T17:05:07.158000] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-17T17:05:07.632117] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-17T17:05:07.958054] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-17T17:05:08.743859] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T17:05:08.758032] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-17T17:05:08.867999] [DEBUG] [REMOTE ] AFG: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-17T17:05:08.868308] [WARN ] [REMOTE ] AFG: No data returned for month 2025-08 [2025-10-17T17:05:08.868412] [FATAL] [REMOTE ] AFG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:05:08.868540] [FATAL] [MAIN ] AFG: Failed to fetch primary data. [2025-10-17T17:05:08.868628] [WARN ] [MAIN ] AFG: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:05:08.868742] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-17T17:05:08.868824] [DEBUG] [LOCAL ] AFG: No primary data file found to delete. [2025-10-17T17:05:08.868865] [INFO ] [LOCAL ] AFG: Starting deletion of derivative data. [2025-10-17T17:05:08.869152] [DEBUG] [LOCAL ] AFG: Deleted derivative data file. [2025-10-17T17:05:08.869243] [INFO ] [MAIN ] Update Progress: 43/2368 symbols completed. AFG took 26.9s. Estimated remaining: 4h 34m 49s. Rate: 8.5 symbols/min [2025-10-17T17:05:09.047959] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:05:09.053221] [DEBUG] [LOCAL ] AFGC: Loaded 2570 existing records from primary storage. [2025-10-17T17:05:09.053441] [INFO ] [MAIN ] AFGC: Loaded 2570 existing records. [2025-10-17T17:05:09.238417] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:05:09.238695] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-17T17:05:09.238756] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-17T17:05:09.238919] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-17T17:05:09.238979] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-17T17:05:09.580555] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-17T17:05:09.585177] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:05:10.016743] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-17T17:05:10.166047] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-17T17:05:10.358013] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-17T17:05:10.922091] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-17T17:05:11.158040] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-17T17:05:11.700561] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-17T17:05:11.958000] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-17T17:05:12.758040] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-17T17:05:13.213929] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-17T17:05:13.558008] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-17T17:05:13.943708] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-17T17:05:14.030458] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T17:05:14.358033] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-17T17:05:14.752778] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-17T17:05:15.158042] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-17T17:05:15.958084] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-17T17:05:16.758048] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-17T17:05:16.801502] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T17:05:17.231019] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-17T17:05:17.231893] [INFO ] [REMOTE ] AFGB: Full fetch complete (3489 records). [2025-10-17T17:05:17.231966] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-17T17:05:17.232392] [FATAL] [VALIDATOR ] AFGB: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:05:17.232479] [FATAL] [MAIN ] AFGB: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:05:17.232523] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:05:17.232565] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-17T17:05:17.232622] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-17T17:05:17.232691] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-10-17T17:05:17.232751] [DEBUG] [LOCAL ] AFGB: No derivative data file found to delete. [2025-10-17T17:05:17.232808] [INFO ] [MAIN ] Update Progress: 44/2368 symbols completed. AFGB took 20.0s. Estimated remaining: 4h 35m 49s. Rate: 8.4 symbols/min [2025-10-17T17:05:17.411181] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:05:17.416043] [DEBUG] [LOCAL ] AFGD: Loaded 1786 existing records from primary storage. [2025-10-17T17:05:17.416233] [INFO ] [MAIN ] AFGD: Loaded 1786 existing records. [2025-10-17T17:05:17.571234] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-17T17:05:17.612102] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:05:17.612322] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-17T17:05:17.612371] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-17T17:05:17.612527] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-17T17:05:17.612584] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-17T17:05:17.974124] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:05:18.006259] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-17T17:05:18.053360] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-17T17:05:18.358049] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-17T17:05:19.158034] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-17T17:05:19.844064] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-17T17:05:19.958081] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-17T17:05:20.181757] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T17:05:20.758048] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-17T17:05:21.558081] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-17T17:05:21.718762] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T17:05:22.085570] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-17T17:05:22.358018] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-17T17:05:22.408601] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T17:05:22.417667] [INFO ] [REMOTE ] AESI: Full fetch complete (71418 records). [2025-10-17T17:05:22.417934] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-17T17:05:22.863189] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-17T17:05:22.869751] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-17T17:05:22.869902] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-17T17:05:22.870948] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-17T17:05:22.871038] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-17T17:05:22.873243] [DEBUG] [LOCAL ] AESI: Trimmed 71418 records to 50515 (keeping 200 days of data) [2025-10-17T17:05:23.167467] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-17T17:05:23.203111] [DEBUG] [LOCAL ] AESI: Primary data saved (50515 records). [2025-10-17T17:05:23.203240] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-17T17:05:23.204800] [INFO ] [MAIN ] Update Progress: 45/2368 symbols completed. AESI took 44.0s. Estimated remaining: 4h 34m 42s. Rate: 8.5 symbols/min [2025-10-17T17:05:23.370501] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:05:23.375570] [DEBUG] [LOCAL ] AFGE: Loaded 2380 existing records from primary storage. [2025-10-17T17:05:23.375769] [INFO ] [MAIN ] AFGE: Loaded 2380 existing records. [2025-10-17T17:05:23.549581] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:05:23.549810] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-17T17:05:23.549858] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-17T17:05:23.550004] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-17T17:05:23.550060] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-17T17:05:23.825917] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-17T17:05:23.910397] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:05:23.958096] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-17T17:05:24.400352] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-17T17:05:24.758042] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-17T17:05:25.205112] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-17T17:05:25.558037] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-17T17:05:26.014871] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-17T17:05:26.358047] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-17T17:05:26.938159] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-17T17:05:27.158081] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-17T17:05:27.512321] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-17T17:05:27.958036] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-17T17:05:28.414481] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-17T17:05:28.758046] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-17T17:05:29.112113] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-17T17:05:29.558048] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-17T17:05:29.914157] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-17T17:05:30.358049] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-17T17:05:30.854477] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-17T17:05:30.855341] [INFO ] [REMOTE ] AFGC: Full fetch complete (3646 records). [2025-10-17T17:05:30.855433] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-17T17:05:31.164013] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-17T17:05:31.209845] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-17T17:05:31.209969] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-17T17:05:31.210124] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-17T17:05:31.210207] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-17T17:05:31.210571] [DEBUG] [LOCAL ] AFGC: Trimmed 3646 records to 2584 (keeping 200 days of data) [2025-10-17T17:05:31.226712] [DEBUG] [LOCAL ] AFGC: Primary data saved (2584 records). [2025-10-17T17:05:31.226793] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-17T17:05:31.226885] [INFO ] [MAIN ] Update Progress: 46/2368 symbols completed. AFGC took 22.4s. Estimated remaining: 4h 35m 22s. Rate: 8.4 symbols/min [2025-10-17T17:05:31.392038] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:05:31.446552] [DEBUG] [LOCAL ] AFL: Loaded 53580 existing records from primary storage. [2025-10-17T17:05:31.446892] [INFO ] [MAIN ] AFL: Loaded 53580 existing records. [2025-10-17T17:05:31.621131] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:05:31.621320] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-17T17:05:31.621366] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-17T17:05:31.621587] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-17T17:05:31.621638] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-17T17:05:31.722770] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T17:05:31.961265] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-17T17:05:31.983611] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:05:32.455114] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-17T17:05:32.758036] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-17T17:05:33.194732] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T17:05:33.558041] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-17T17:05:34.358017] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-17T17:05:35.158080] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-17T17:05:35.558904] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-17T17:05:35.769493] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-17T17:05:35.958040] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-17T17:05:36.589098] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-17T17:05:36.598072] [INFO ] [REMOTE ] AES: Full fetch complete (77846 records). [2025-10-17T17:05:36.598276] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-17T17:05:36.762465] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-17T17:05:36.986318] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-17T17:05:36.986406] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-17T17:05:36.987157] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-17T17:05:36.987228] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-17T17:05:36.989000] [DEBUG] [LOCAL ] AES: Trimmed 77846 records to 54448 (keeping 200 days of data) [2025-10-17T17:05:37.296037] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-17T17:05:37.321490] [DEBUG] [LOCAL ] AES: Primary data saved (54448 records). [2025-10-17T17:05:37.321627] [INFO ] [MAIN ] AES: Full history saved. [2025-10-17T17:05:37.321744] [INFO ] [MAIN ] Update Progress: 47/2368 symbols completed. AES took 58.2s. Estimated remaining: 4h 34m 24s. Rate: 8.5 symbols/min [2025-10-17T17:05:37.493423] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:05:37.541123] [DEBUG] [LOCAL ] AG: Loaded 54033 existing records from primary storage. [2025-10-17T17:05:37.541546] [INFO ] [MAIN ] AG: Loaded 54033 existing records. [2025-10-17T17:05:37.563227] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-17T17:05:37.724824] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:05:37.725148] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-17T17:05:37.725237] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-17T17:05:37.725599] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-17T17:05:37.725789] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-17T17:05:37.938675] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-17T17:05:38.068102] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-17T17:05:38.151666] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:05:38.358039] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-17T17:05:38.809698] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-17T17:05:39.158038] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-17T17:05:39.958031] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-17T17:05:40.268541] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-17T17:05:40.451908] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T17:05:40.758035] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-17T17:05:41.110113] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-17T17:05:41.558090] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-17T17:05:42.126372] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-17T17:05:42.358032] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-17T17:05:42.787730] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-17T17:05:43.158053] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-17T17:05:43.958040] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-17T17:05:44.402544] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-17T17:05:44.403328] [INFO ] [REMOTE ] AFGE: Full fetch complete (3384 records). [2025-10-17T17:05:44.403407] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-17T17:05:44.762898] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-17T17:05:44.787062] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-17T17:05:44.787208] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-17T17:05:44.787417] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-17T17:05:44.787540] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-17T17:05:44.788391] [DEBUG] [LOCAL ] AFGE: Trimmed 3384 records to 2387 (keeping 200 days of data) [2025-10-17T17:05:44.803851] [DEBUG] [LOCAL ] AFGE: Primary data saved (2387 records). [2025-10-17T17:05:44.803935] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-17T17:05:44.804050] [INFO ] [MAIN ] Update Progress: 48/2368 symbols completed. AFGE took 21.6s. Estimated remaining: 4h 34m 36s. Rate: 8.4 symbols/min [2025-10-17T17:05:44.998841] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T17:05:45.001156] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:05:45.061405] [DEBUG] [LOCAL ] AGCO: Loaded 42651 existing records from primary storage. [2025-10-17T17:05:45.061727] [INFO ] [MAIN ] AGCO: Loaded 42651 existing records. [2025-10-17T17:05:45.241018] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:05:45.241226] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-17T17:05:45.241279] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-17T17:05:45.241555] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-17T17:05:45.241614] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-17T17:05:45.563102] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-17T17:05:45.601790] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:05:46.142899] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T17:05:46.358005] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-17T17:05:46.582109] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T17:05:47.158072] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-17T17:05:47.805744] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T17:05:47.958037] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-17T17:05:48.758071] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-17T17:05:49.214465] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T17:05:49.272789] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-17T17:05:49.558054] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-17T17:05:50.012199] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-17T17:05:50.358036] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-17T17:05:50.718580] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T17:05:51.158034] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-17T17:05:51.609848] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-17T17:05:51.958038] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-17T17:05:52.366010] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-17T17:05:52.366826] [INFO ] [REMOTE ] AFGD: Full fetch complete (2838 records). [2025-10-17T17:05:52.366895] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-17T17:05:52.752509] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-17T17:05:52.752623] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-17T17:05:52.752807] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-17T17:05:52.752946] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-17T17:05:52.753460] [DEBUG] [LOCAL ] AFGD: Trimmed 2838 records to 1791 (keeping 200 days of data) [2025-10-17T17:05:52.762388] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-17T17:05:52.765224] [DEBUG] [LOCAL ] AFGD: Primary data saved (1791 records). [2025-10-17T17:05:52.765317] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-17T17:05:52.765728] [INFO ] [MAIN ] Update Progress: 49/2368 symbols completed. AFGD took 35.5s. Estimated remaining: 4h 35m 10s. Rate: 8.4 symbols/min [2025-10-17T17:05:52.975127] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:05:52.977060] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T17:05:53.009827] [DEBUG] [LOCAL ] AGD: Loaded 19404 existing records from primary storage. [2025-10-17T17:05:53.010060] [INFO ] [MAIN ] AGD: Loaded 19404 existing records. [2025-10-17T17:05:53.194044] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:05:53.194308] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-17T17:05:53.194357] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-17T17:05:53.194621] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-17T17:05:53.194720] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-17T17:05:53.558273] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-17T17:05:53.560755] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:05:54.358026] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-17T17:05:54.640548] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T17:05:55.168441] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-17T17:05:55.174290] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T17:05:55.216402] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-17T17:05:55.958035] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-17T17:05:56.752490] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T17:05:56.757973] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-17T17:05:57.050322] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T17:05:57.413723] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-17T17:05:57.558058] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-17T17:05:58.358013] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-17T17:05:58.916003] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T17:05:59.158083] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-17T17:05:59.958020] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-17T17:06:00.063422] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T17:06:00.200315] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T17:06:00.758021] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-17T17:06:01.537060] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T17:06:01.558017] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-17T17:06:02.358024] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-17T17:06:02.722820] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T17:06:03.158041] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-17T17:06:03.840602] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-17T17:06:03.930523] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T17:06:03.957988] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-17T17:06:04.122098] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-17T17:06:04.758037] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-17T17:06:05.191319] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-17T17:06:05.557995] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-17T17:06:05.931941] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T17:06:06.358041] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-17T17:06:07.158036] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-17T17:06:07.642200] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-17T17:06:07.958091] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-17T17:06:07.993116] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T17:06:08.758012] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-17T17:06:09.196323] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-17T17:06:09.219753] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T17:06:09.558025] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-17T17:06:10.349462] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T17:06:10.358228] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-17T17:06:11.158047] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-17T17:06:11.574969] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-17T17:06:11.958008] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-17T17:06:12.266272] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-17T17:06:12.323126] [INFO ] [REMOTE ] AFL: Full fetch complete (77070 records). [2025-10-17T17:06:12.324189] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T17:06:12.324312] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-17T17:06:12.705666] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-17T17:06:12.705754] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-17T17:06:12.706446] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-17T17:06:12.706490] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-17T17:06:12.707900] [DEBUG] [LOCAL ] AFL: Trimmed 77070 records to 53965 (keeping 200 days of data) [2025-10-17T17:06:12.763531] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-17T17:06:13.037564] [DEBUG] [LOCAL ] AFL: Primary data saved (53965 records). [2025-10-17T17:06:13.037864] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-17T17:06:13.039037] [INFO ] [MAIN ] Update Progress: 50/2368 symbols completed. AFL took 41.8s. Estimated remaining: 4h 45m 12s. Rate: 8.1 symbols/min [2025-10-17T17:06:13.205408] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:06:13.258151] [DEBUG] [LOCAL ] AGI: Loaded 53813 existing records from primary storage. [2025-10-17T17:06:13.258460] [INFO ] [MAIN ] AGI: Loaded 53813 existing records. [2025-10-17T17:06:13.428414] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:06:13.428574] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-17T17:06:13.428621] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-17T17:06:13.429027] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-17T17:06:13.429085] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-17T17:06:13.564878] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-17T17:06:13.780591] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:06:13.836223] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T17:06:13.887567] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T17:06:13.893314] [INFO ] [REMOTE ] AGCO: Full fetch complete (61683 records). [2025-10-17T17:06:13.893409] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-17T17:06:14.281939] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-17T17:06:14.282085] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-17T17:06:14.282841] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-17T17:06:14.282950] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-17T17:06:14.296751] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-17T17:06:14.301570] [DEBUG] [LOCAL ] AGCO: Trimmed 61683 records to 42964 (keeping 200 days of data) [2025-10-17T17:06:14.361884] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-17T17:06:14.572006] [DEBUG] [LOCAL ] AGCO: Primary data saved (42964 records). [2025-10-17T17:06:14.572140] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-17T17:06:14.572222] [INFO ] [MAIN ] Update Progress: 51/2368 symbols completed. AGCO took 29.8s. Estimated remaining: 4h 40m 39s. Rate: 8.3 symbols/min [2025-10-17T17:06:14.735884] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:06:14.790074] [DEBUG] [LOCAL ] AGL: Loaded 52970 existing records from primary storage. [2025-10-17T17:06:14.790400] [INFO ] [MAIN ] AGL: Loaded 52970 existing records. [2025-10-17T17:06:14.960537] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:06:14.960816] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-17T17:06:14.960863] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-17T17:06:14.961272] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-17T17:06:14.961329] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-17T17:06:15.163252] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-17T17:06:15.316996] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:06:15.958073] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-17T17:06:16.171806] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T17:06:16.758043] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-17T17:06:17.081114] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T17:06:17.171244] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T17:06:17.557999] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-17T17:06:18.358039] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-17T17:06:18.477951] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T17:06:18.600528] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T17:06:18.604293] [INFO ] [REMOTE ] AGD: Full fetch complete (26568 records). [2025-10-17T17:06:18.604364] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-17T17:06:18.961339] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-17T17:06:18.961416] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-17T17:06:18.961749] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-17T17:06:18.961812] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-17T17:06:18.962844] [DEBUG] [LOCAL ] AGD: Trimmed 26568 records to 19496 (keeping 200 days of data) [2025-10-17T17:06:19.077832] [DEBUG] [LOCAL ] AGD: Primary data saved (19496 records). [2025-10-17T17:06:19.077964] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-17T17:06:19.078045] [INFO ] [MAIN ] Update Progress: 52/2368 symbols completed. AGD took 26.3s. Estimated remaining: 4h 38m 29s. Rate: 8.3 symbols/min [2025-10-17T17:06:19.165574] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-17T17:06:19.244368] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:06:19.256719] [DEBUG] [LOCAL ] AGM: Loaded 10792 existing records from primary storage. [2025-10-17T17:06:19.256927] [INFO ] [MAIN ] AGM: Loaded 10792 existing records. [2025-10-17T17:06:19.427687] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:06:19.427918] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-17T17:06:19.427965] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-17T17:06:19.428140] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-17T17:06:19.428177] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-17T17:06:19.778045] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:06:19.958031] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-17T17:06:20.216283] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T17:06:20.687520] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T17:06:20.758056] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-17T17:06:21.434777] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-17T17:06:21.451240] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-17T17:06:21.558024] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-17T17:06:22.358079] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-17T17:06:23.158078] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-17T17:06:23.778449] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-17T17:06:23.786218] [INFO ] [REMOTE ] AG: Full fetch complete (77781 records). [2025-10-17T17:06:23.786381] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-17T17:06:23.965125] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-17T17:06:24.189027] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-17T17:06:24.189133] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-17T17:06:24.190029] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-17T17:06:24.190106] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-17T17:06:24.191746] [DEBUG] [LOCAL ] AG: Trimmed 77781 records to 54423 (keeping 200 days of data) [2025-10-17T17:06:24.306693] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-17T17:06:24.547062] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-17T17:06:24.558205] [DEBUG] [LOCAL ] AG: Primary data saved (54423 records). [2025-10-17T17:06:24.558352] [INFO ] [MAIN ] AG: Full history saved. [2025-10-17T17:06:24.558460] [INFO ] [MAIN ] Update Progress: 53/2368 symbols completed. AG took 47.2s. Estimated remaining: 4h 37m 6s. Rate: 8.4 symbols/min [2025-10-17T17:06:24.690169] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T17:06:24.761377] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:06:24.761545] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-17T17:06:24.789041] [DEBUG] [LOCAL ] AGO: Loaded 28168 existing records from primary storage. [2025-10-17T17:06:24.789286] [INFO ] [MAIN ] AGO: Loaded 28168 existing records. [2025-10-17T17:06:24.964354] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:06:24.964550] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-17T17:06:24.964611] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-17T17:06:24.964956] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-17T17:06:24.965011] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-17T17:06:25.313551] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:06:25.558046] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-17T17:06:26.358113] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-17T17:06:26.477046] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T17:06:27.078600] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-17T17:06:27.157982] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-17T17:06:27.546898] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T17:06:27.768824] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T17:06:27.958073] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-17T17:06:28.758094] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-17T17:06:29.104453] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T17:06:29.558077] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-17T17:06:30.295786] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T17:06:30.358034] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-17T17:06:30.784914] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-17T17:06:31.158048] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-17T17:06:31.806311] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T17:06:31.958066] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-17T17:06:32.758065] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-17T17:06:32.787882] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T17:06:32.811205] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-17T17:06:33.558067] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-17T17:06:33.975530] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T17:06:34.358042] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-17T17:06:35.158085] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-17T17:06:35.315093] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T17:06:35.333238] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-17T17:06:35.958034] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-17T17:06:36.758080] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-17T17:06:37.056901] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-17T17:06:37.557987] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-17T17:06:37.754872] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T17:06:37.970459] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T17:06:38.358050] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-17T17:06:38.391525] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T17:06:39.158042] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-17T17:06:39.958007] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-17T17:06:39.997742] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T17:06:40.293386] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-17T17:06:40.758021] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-17T17:06:41.189830] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-17T17:06:41.558079] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-17T17:06:41.687058] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T17:06:41.689250] [INFO ] [REMOTE ] AGM: Full fetch complete (13302 records). [2025-10-17T17:06:41.689325] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-17T17:06:42.067066] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-17T17:06:42.067192] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-17T17:06:42.067442] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-17T17:06:42.067485] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-17T17:06:42.068034] [DEBUG] [LOCAL ] AGM: Trimmed 13302 records to 10847 (keeping 200 days of data) [2025-10-17T17:06:42.134331] [DEBUG] [LOCAL ] AGM: Primary data saved (10847 records). [2025-10-17T17:06:42.134457] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-17T17:06:42.134538] [INFO ] [MAIN ] Update Progress: 54/2368 symbols completed. AGM took 23.1s. Estimated remaining: 4h 44m 24s. Rate: 8.1 symbols/min [2025-10-17T17:06:42.302174] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:06:42.338869] [DEBUG] [LOCAL ] AGRO: Loaded 33278 existing records from primary storage. [2025-10-17T17:06:42.339171] [INFO ] [MAIN ] AGRO: Loaded 33278 existing records. [2025-10-17T17:06:42.369579] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-17T17:06:42.520271] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:06:42.520498] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-17T17:06:42.520557] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-17T17:06:42.520954] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-17T17:06:42.521011] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-17T17:06:42.895796] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:06:43.158007] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-17T17:06:43.344299] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T17:06:43.958031] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-17T17:06:44.154480] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:06:44.230597] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T17:06:44.758008] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-17T17:06:44.782497] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T17:06:45.558075] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-17T17:06:46.224010] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T17:06:46.358054] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-17T17:06:46.900202] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T17:06:47.158016] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-17T17:06:47.958037] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-17T17:06:47.996828] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:06:48.071020] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-17T17:06:48.758031] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-17T17:06:49.279824] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T17:06:49.558071] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-17T17:06:50.358039] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-17T17:06:50.700460] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T17:06:50.735386] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-17T17:06:51.158073] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-17T17:06:51.958047] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-17T17:06:52.470256] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-17T17:06:52.504082] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T17:06:52.758024] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-17T17:06:53.129009] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T17:06:53.558069] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-17T17:06:54.043539] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T17:06:54.358066] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-17T17:06:55.158030] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-17T17:06:55.199447] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T17:06:55.430879] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T17:06:55.958048] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-17T17:06:56.634337] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T17:06:56.758033] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-17T17:06:57.558048] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-17T17:06:57.763434] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T17:06:57.767748] [INFO ] [REMOTE ] AGO: Full fetch complete (39768 records). [2025-10-17T17:06:57.767840] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-17T17:06:58.117309] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-17T17:06:58.159719] [INFO ] [REMOTE ] AGL: Full fetch complete (75897 records). [2025-10-17T17:06:58.162067] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-17T17:06:58.259498] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-17T17:06:58.290683] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-17T17:06:58.291442] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-17T17:06:58.296906] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-17T17:06:58.370715] [DEBUG] [LOCAL ] AGO: Trimmed 39768 records to 28374 (keeping 200 days of data) [2025-10-17T17:06:58.370852] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-17T17:06:58.716500] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-17T17:06:58.716607] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-17T17:06:58.717583] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-17T17:06:58.718154] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-17T17:06:58.742500] [DEBUG] [LOCAL ] AGL: Trimmed 75897 records to 53357 (keeping 200 days of data) [2025-10-17T17:06:58.745041] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T17:06:58.907563] [DEBUG] [LOCAL ] AGO: Primary data saved (28374 records). [2025-10-17T17:06:58.908441] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-17T17:06:58.908875] [INFO ] [MAIN ] Update Progress: 55/2368 symbols completed. AGO took 34.4s. Estimated remaining: 4h 50m 52s. Rate: 8.0 symbols/min [2025-10-17T17:06:59.109244] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:06:59.160927] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-17T17:06:59.285950] [DEBUG] [LOCAL ] AGX: Loaded 33089 existing records from primary storage. [2025-10-17T17:06:59.307573] [INFO ] [MAIN ] AGX: Loaded 33089 existing records. [2025-10-17T17:06:59.405784] [DEBUG] [LOCAL ] AGL: Primary data saved (53357 records). [2025-10-17T17:06:59.421739] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-17T17:06:59.429929] [INFO ] [MAIN ] Update Progress: 56/2368 symbols completed. AGL took 44.9s. Estimated remaining: 4h 45m 55s. Rate: 8.1 symbols/min [2025-10-17T17:06:59.626760] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:06:59.630030] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-17T17:06:59.630407] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-17T17:06:59.641941] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-17T17:06:59.642046] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-17T17:06:59.826111] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:00.152575] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:00.155510] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-17T17:07:00.157925] [DEBUG] [LOCAL ] AHH: Loaded 40838 existing records from primary storage. [2025-10-17T17:07:00.158817] [INFO ] [MAIN ] AHH: Loaded 40838 existing records. [2025-10-17T17:07:00.377718] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-17T17:07:00.400315] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:07:00.400819] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-17T17:07:00.400881] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-17T17:07:00.412062] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-17T17:07:00.412197] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-17T17:07:00.690156] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T17:07:00.763151] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-17T17:07:00.863068] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:01.558039] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-17T17:07:01.986300] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T17:07:02.358070] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-17T17:07:02.589398] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-17T17:07:02.596709] [INFO ] [REMOTE ] AGI: Full fetch complete (76897 records). [2025-10-17T17:07:02.596863] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-17T17:07:02.597764] [FATAL] [VALIDATOR ] AGI: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:07:02.597858] [FATAL] [MAIN ] AGI: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:07:02.597901] [WARN ] [MAIN ] AGI: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:07:02.597964] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-17T17:07:02.598044] [DEBUG] [LOCAL ] AGI: No primary data file found to delete. [2025-10-17T17:07:02.598099] [INFO ] [LOCAL ] AGI: Starting deletion of derivative data. [2025-10-17T17:07:02.598460] [DEBUG] [LOCAL ] AGI: Deleted derivative data file. [2025-10-17T17:07:02.598558] [INFO ] [MAIN ] Update Progress: 57/2368 symbols completed. AGI took 49.6s. Estimated remaining: 4h 42m 55s. Rate: 8.2 symbols/min [2025-10-17T17:07:02.772940] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:02.773138] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-17T17:07:02.773178] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-17T17:07:02.773298] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-17T17:07:02.773341] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-17T17:07:02.773382] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-17T17:07:02.773417] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-17T17:07:03.088610] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T17:07:03.165394] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-17T17:07:03.180053] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:03.761167] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T17:07:03.958066] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-17T17:07:04.490953] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T17:07:04.758068] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-17T17:07:05.411317] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T17:07:05.558050] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-17T17:07:05.986195] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-17T17:07:05.990705] [INFO ] [REMOTE ] AGRO: Full fetch complete (49042 records). [2025-10-17T17:07:05.990815] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-17T17:07:06.371057] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-17T17:07:06.398882] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-17T17:07:06.398952] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-17T17:07:06.399512] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-17T17:07:06.399577] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-17T17:07:06.400848] [DEBUG] [LOCAL ] AGRO: Trimmed 49042 records to 33606 (keeping 200 days of data) [2025-10-17T17:07:06.602480] [DEBUG] [LOCAL ] AGRO: Primary data saved (33606 records). [2025-10-17T17:07:06.602630] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-17T17:07:06.602757] [INFO ] [MAIN ] Update Progress: 58/2368 symbols completed. AGRO took 24.5s. Estimated remaining: 4h 40m 34s. Rate: 8.2 symbols/min [2025-10-17T17:07:06.706393] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:07:06.722573] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-17T17:07:06.732952] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:07:06.754410] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-17T17:07:06.761279] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:07:06.761388] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-17T17:07:06.779562] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-17T17:07:06.779475] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:06.780052] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-17T17:07:06.780128] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-17T17:07:06.780207] [INFO ] [MAIN ] Update Progress: 59/2368 symbols completed. AHL took 4.2s. Estimated remaining: 4h 35m 49s. Rate: 8.4 symbols/min [2025-10-17T17:07:06.958290] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:06.976965] [DEBUG] [LOCAL ] AHT: Loaded 6425 existing records from primary storage. [2025-10-17T17:07:06.977195] [INFO ] [MAIN ] AHT: Loaded 6425 existing records. [2025-10-17T17:07:07.096981] [DEBUG] [LOCAL ] AHR: Loaded 49438 existing records from primary storage. [2025-10-17T17:07:07.113270] [INFO ] [MAIN ] AHR: Loaded 49438 existing records. [2025-10-17T17:07:07.224598] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:07:07.184432] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-17T17:07:07.249350] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-17T17:07:07.271149] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-17T17:07:07.276750] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-17T17:07:07.286560] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-17T17:07:07.454046] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:07:07.494031] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-17T17:07:07.494694] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-17T17:07:07.508705] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-17T17:07:07.526902] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-17T17:07:07.532164] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-17T17:07:07.984760] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-17T17:07:08.026244] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:08.163959] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:08.757999] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-17T17:07:08.933275] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T17:07:09.558046] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-17T17:07:09.604672] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T17:07:10.224727] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T17:07:10.358006] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-17T17:07:10.582315] [DEBUG] [REMOTE ] AHR: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-17T17:07:10.582615] [WARN ] [REMOTE ] AHR: No data returned for month 2025-01 [2025-10-17T17:07:10.582751] [FATAL] [REMOTE ] AHR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:07:10.582883] [FATAL] [MAIN ] AHR: Failed to fetch primary data. [2025-10-17T17:07:10.582967] [WARN ] [MAIN ] AHR: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:07:10.583058] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-17T17:07:10.583139] [DEBUG] [LOCAL ] AHR: No primary data file found to delete. [2025-10-17T17:07:10.583180] [INFO ] [LOCAL ] AHR: Starting deletion of derivative data. [2025-10-17T17:07:10.583292] [DEBUG] [LOCAL ] AHR: Deleted derivative data file. [2025-10-17T17:07:10.583360] [INFO ] [MAIN ] Update Progress: 60/2368 symbols completed. AHR took 4.0s. Estimated remaining: 4h 33m 32s. Rate: 8.4 symbols/min [2025-10-17T17:07:10.696192] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T17:07:10.769235] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:10.823801] [DEBUG] [LOCAL ] AI: Loaded 54155 existing records from primary storage. [2025-10-17T17:07:10.824122] [INFO ] [MAIN ] AI: Loaded 54155 existing records. [2025-10-17T17:07:10.997185] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:07:10.997396] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-17T17:07:10.997444] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-17T17:07:10.997850] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-17T17:07:10.997907] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-17T17:07:11.169629] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-17T17:07:11.349732] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:11.958032] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-17T17:07:12.759091] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T17:07:12.758336] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-17T17:07:13.558020] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-17T17:07:13.955172] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-17T17:07:14.271370] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-17T17:07:14.357981] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-17T17:07:14.875272] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T17:07:15.158049] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-17T17:07:15.958090] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-17T17:07:16.660802] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-17T17:07:16.758000] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-17T17:07:16.799515] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:07:17.031006] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T17:07:17.359189] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T17:07:17.558037] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-17T17:07:18.358047] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-17T17:07:18.846265] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T17:07:19.158040] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-17T17:07:19.850842] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-17T17:07:19.958054] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-17T17:07:20.212485] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T17:07:20.758060] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-17T17:07:20.839533] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-17T17:07:21.558035] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-17T17:07:22.358100] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-17T17:07:22.525288] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T17:07:22.876797] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-17T17:07:23.158078] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-17T17:07:23.915401] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-17T17:07:23.957990] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-17T17:07:24.710996] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T17:07:24.757989] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-17T17:07:25.558031] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-17T17:07:26.109545] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-17T17:07:26.315604] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-17T17:07:26.357988] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-17T17:07:26.387328] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T17:07:27.158054] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-17T17:07:27.958039] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-17T17:07:28.383952] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T17:07:28.618478] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T17:07:28.758021] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-17T17:07:29.106913] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-17T17:07:29.558041] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-17T17:07:30.090162] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-17T17:07:30.358059] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-17T17:07:30.922029] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T17:07:30.926321] [INFO ] [REMOTE ] AGX: Full fetch complete (48983 records). [2025-10-17T17:07:30.926494] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-17T17:07:31.163191] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-17T17:07:31.309828] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-17T17:07:31.309914] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-17T17:07:31.310546] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-17T17:07:31.310633] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-17T17:07:31.311717] [DEBUG] [LOCAL ] AGX: Trimmed 48983 records to 33316 (keeping 200 days of data) [2025-10-17T17:07:31.518740] [DEBUG] [LOCAL ] AGX: Primary data saved (33316 records). [2025-10-17T17:07:31.518890] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-17T17:07:31.519028] [INFO ] [MAIN ] Update Progress: 61/2368 symbols completed. AGX took 32.6s. Estimated remaining: 4h 42m 8s. Rate: 8.2 symbols/min [2025-10-17T17:07:31.689207] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:31.741287] [DEBUG] [LOCAL ] AIG: Loaded 53860 existing records from primary storage. [2025-10-17T17:07:31.741693] [INFO ] [MAIN ] AIG: Loaded 53860 existing records. [2025-10-17T17:07:31.954829] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T17:07:31.961129] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:07:31.969976] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-17T17:07:31.961407] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-17T17:07:31.971966] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-17T17:07:31.972241] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-17T17:07:31.972346] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-17T17:07:32.083157] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T17:07:32.338221] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:32.758095] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-17T17:07:33.279736] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-17T17:07:33.558033] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-17T17:07:34.341183] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-17T17:07:34.358000] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-17T17:07:34.961013] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T17:07:35.158046] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-17T17:07:35.958075] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-17T17:07:36.678127] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-17T17:07:36.757994] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-17T17:07:36.983989] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-17T17:07:37.062842] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T17:07:37.558042] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-17T17:07:37.655069] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T17:07:38.358070] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-17T17:07:39.080293] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T17:07:39.082004] [INFO ] [REMOTE ] AHT: Full fetch complete (9138 records). [2025-10-17T17:07:39.082119] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-17T17:07:39.165044] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-17T17:07:39.459684] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-17T17:07:39.459777] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-17T17:07:39.459975] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-17T17:07:39.460014] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-17T17:07:39.460513] [DEBUG] [LOCAL ] AHT: Trimmed 9138 records to 6493 (keeping 200 days of data) [2025-10-17T17:07:39.503374] [DEBUG] [LOCAL ] AHT: Primary data saved (6493 records). [2025-10-17T17:07:39.503574] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-17T17:07:39.503749] [INFO ] [MAIN ] Update Progress: 62/2368 symbols completed. AHT took 32.7s. Estimated remaining: 4h 42m 25s. Rate: 8.2 symbols/min [2025-10-17T17:07:39.677011] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:39.677276] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-17T17:07:39.677325] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-17T17:07:39.677442] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-17T17:07:39.677485] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-17T17:07:39.677593] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-17T17:07:39.677635] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-17T17:07:39.960104] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-17T17:07:40.069796] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:40.101363] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-17T17:07:40.471532] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T17:07:40.477850] [INFO ] [REMOTE ] AHH: Full fetch complete (59640 records). [2025-10-17T17:07:40.477979] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-17T17:07:40.763780] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-17T17:07:40.864431] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-17T17:07:40.864636] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-17T17:07:40.865294] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-17T17:07:40.865342] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-17T17:07:40.866534] [DEBUG] [LOCAL ] AHH: Trimmed 59640 records to 41118 (keeping 200 days of data) [2025-10-17T17:07:41.102908] [DEBUG] [LOCAL ] AHH: Primary data saved (41118 records). [2025-10-17T17:07:41.103156] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-17T17:07:41.103261] [INFO ] [MAIN ] Update Progress: 63/2368 symbols completed. AHH took 41.7s. Estimated remaining: 4h 38m 47s. Rate: 8.3 symbols/min [2025-10-17T17:07:41.283372] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:41.312412] [DEBUG] [LOCAL ] AIN: Loaded 24655 existing records from primary storage. [2025-10-17T17:07:41.312801] [INFO ] [MAIN ] AIN: Loaded 24655 existing records. [2025-10-17T17:07:41.500658] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:07:41.500951] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-17T17:07:41.501005] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-17T17:07:41.501276] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-17T17:07:41.501317] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-17T17:07:41.565844] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-17T17:07:41.773320] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:07:41.802196] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-17T17:07:41.819914] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:07:41.830514] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-17T17:07:41.835768] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:07:41.861090] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-17T17:07:41.898938] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-17T17:07:41.903796] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:41.904197] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-17T17:07:41.904338] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-17T17:07:41.904567] [INFO ] [MAIN ] Update Progress: 64/2368 symbols completed. AII took 2.4s. Estimated remaining: 4h 34m 47s. Rate: 8.4 symbols/min [2025-10-17T17:07:42.123727] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:42.132223] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-17T17:07:42.157375] [DEBUG] [LOCAL ] AIO: Loaded 13450 existing records from primary storage. [2025-10-17T17:07:42.157709] [INFO ] [MAIN ] AIO: Loaded 13450 existing records. [2025-10-17T17:07:42.329770] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:07:42.329993] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-17T17:07:42.330043] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-17T17:07:42.330225] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-17T17:07:42.330282] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-17T17:07:42.363273] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-17T17:07:42.681189] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:42.989864] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-17T17:07:43.158031] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-17T17:07:43.695836] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T17:07:43.958041] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-17T17:07:44.291010] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T17:07:44.689312] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T17:07:44.758066] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-17T17:07:45.558050] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-17T17:07:46.358010] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-17T17:07:46.390460] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T17:07:47.158092] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-17T17:07:47.349283] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T17:07:47.958030] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-17T17:07:48.247768] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.69 seconds). [2025-10-17T17:07:48.255400] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-17T17:07:48.255555] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-17T17:07:48.674192] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-17T17:07:48.674333] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-17T17:07:48.675329] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-17T17:07:48.675400] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-17T17:07:48.678010] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 54545 (keeping 200 days of data) [2025-10-17T17:07:48.770006] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-17T17:07:48.913804] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T17:07:49.050635] [DEBUG] [LOCAL ] AI: Primary data saved (54545 records). [2025-10-17T17:07:49.050883] [INFO ] [MAIN ] AI: Full history saved. [2025-10-17T17:07:49.051011] [INFO ] [MAIN ] Update Progress: 65/2368 symbols completed. AI took 38.5s. Estimated remaining: 4h 34m 40s. Rate: 8.4 symbols/min [2025-10-17T17:07:49.229998] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:07:49.262809] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-17T17:07:49.299934] [DEBUG] [LOCAL ] AIR: Loaded 29128 existing records from primary storage. [2025-10-17T17:07:49.300297] [INFO ] [MAIN ] AIR: Loaded 29128 existing records. [2025-10-17T17:07:49.487003] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:07:49.487344] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-17T17:07:49.487398] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-17T17:07:49.487813] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-17T17:07:49.487872] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-17T17:07:49.559998] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-17T17:07:49.756680] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-17T17:07:49.888516] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:07:50.178418] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-17T17:07:50.358059] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-17T17:07:51.158006] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-17T17:07:51.397065] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T17:07:51.958052] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-17T17:07:52.043484] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-17T17:07:52.758038] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-17T17:07:53.140250] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T17:07:53.247203] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-17T17:07:53.558056] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-17T17:07:54.358016] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-17T17:07:55.158032] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-17T17:07:55.319039] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T17:07:55.817097] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T17:07:55.958020] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-17T17:07:56.439290] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T17:07:56.758008] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-17T17:07:57.065542] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T17:07:57.558008] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-17T17:07:57.740693] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-17T17:07:58.358025] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-17T17:07:59.158012] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-17T17:07:59.236384] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:07:59.371862] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-17T17:07:59.638181] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-17T17:07:59.958063] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-17T17:08:00.758037] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-17T17:08:01.351198] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-17T17:08:01.558032] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-17T17:08:02.045077] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T17:08:02.358042] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-17T17:08:02.869250] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T17:08:03.158016] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-17T17:08:03.547522] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-17T17:08:03.958038] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-17T17:08:04.325909] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T17:08:04.725090] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T17:08:04.757987] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-17T17:08:05.558002] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-17T17:08:05.575500] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T17:08:06.358032] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-17T17:08:07.158033] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-17T17:08:07.331923] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T17:08:07.355016] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T17:08:07.871830] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T17:08:07.874184] [INFO ] [REMOTE ] AIO: Full fetch complete (20086 records). [2025-10-17T17:08:07.874284] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-17T17:08:07.963141] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-17T17:08:08.241134] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-17T17:08:08.241212] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-17T17:08:08.241481] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-17T17:08:08.241522] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-17T17:08:08.242108] [DEBUG] [LOCAL ] AIO: Trimmed 20086 records to 13513 (keeping 200 days of data) [2025-10-17T17:08:08.329077] [DEBUG] [LOCAL ] AIO: Primary data saved (13513 records). [2025-10-17T17:08:08.329305] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-17T17:08:08.329419] [INFO ] [MAIN ] Update Progress: 66/2368 symbols completed. AIO took 26.4s. Estimated remaining: 4h 41m 36s. Rate: 8.2 symbols/min [2025-10-17T17:08:08.522571] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:08:08.553320] [DEBUG] [LOCAL ] AIT: Loaded 27175 existing records from primary storage. [2025-10-17T17:08:08.553636] [INFO ] [MAIN ] AIT: Loaded 27175 existing records. [2025-10-17T17:08:08.751372] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:08:08.751612] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-17T17:08:08.751689] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-17T17:08:08.751980] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-17T17:08:08.752037] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-17T17:08:08.764085] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-17T17:08:09.161907] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:08:09.557992] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-17T17:08:09.607813] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:08:10.006473] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T17:08:10.358054] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-17T17:08:10.879258] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T17:08:11.158007] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-17T17:08:11.405161] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T17:08:11.958050] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-17T17:08:12.484144] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T17:08:12.758030] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-17T17:08:12.976257] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T17:08:12.979957] [INFO ] [REMOTE ] AIN: Full fetch complete (33688 records). [2025-10-17T17:08:12.980042] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-17T17:08:13.341028] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-17T17:08:13.341126] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-17T17:08:13.341501] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-17T17:08:13.341543] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-17T17:08:13.342302] [DEBUG] [LOCAL ] AIN: Trimmed 33688 records to 24822 (keeping 200 days of data) [2025-10-17T17:08:13.486183] [DEBUG] [LOCAL ] AIN: Primary data saved (24822 records). [2025-10-17T17:08:13.486323] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-17T17:08:13.486409] [INFO ] [MAIN ] Update Progress: 67/2368 symbols completed. AIN took 32.4s. Estimated remaining: 4h 40m 13s. Rate: 8.2 symbols/min [2025-10-17T17:08:13.564080] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-17T17:08:13.662287] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:08:13.701801] [DEBUG] [LOCAL ] AIV: Loaded 41824 existing records from primary storage. [2025-10-17T17:08:13.702108] [INFO ] [MAIN ] AIV: Loaded 41824 existing records. [2025-10-17T17:08:13.881147] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:08:13.881482] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-17T17:08:13.881562] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-17T17:08:13.881979] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-17T17:08:13.882038] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-17T17:08:14.100117] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T17:08:14.306245] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:08:14.357990] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-17T17:08:15.158094] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-17T17:08:15.355318] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T17:08:15.964353] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-17T17:08:15.989671] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T17:08:16.642558] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T17:08:16.758020] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-17T17:08:17.507392] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T17:08:17.558070] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-17T17:08:18.041075] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T17:08:18.358044] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-17T17:08:19.158029] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-17T17:08:19.311266] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T17:08:19.318722] [INFO ] [REMOTE ] AIG: Full fetch complete (77560 records). [2025-10-17T17:08:19.318854] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-17T17:08:19.713085] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-17T17:08:19.713229] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-17T17:08:19.714023] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-17T17:08:19.714090] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-17T17:08:19.715581] [DEBUG] [LOCAL ] AIG: Trimmed 77560 records to 54247 (keeping 200 days of data) [2025-10-17T17:08:19.962489] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-17T17:08:19.978674] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T17:08:20.091510] [DEBUG] [LOCAL ] AIG: Primary data saved (54247 records). [2025-10-17T17:08:20.091666] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-17T17:08:20.091768] [INFO ] [MAIN ] Update Progress: 68/2368 symbols completed. AIG took 48.6s. Estimated remaining: 4h 39m 42s. Rate: 8.2 symbols/min [2025-10-17T17:08:20.259633] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:08:20.287579] [DEBUG] [LOCAL ] AIZ: Loaded 29712 existing records from primary storage. [2025-10-17T17:08:20.287921] [INFO ] [MAIN ] AIZ: Loaded 29712 existing records. [2025-10-17T17:08:20.481224] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:08:20.481455] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-17T17:08:20.481576] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-17T17:08:20.483917] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-17T17:08:20.484003] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-17T17:08:20.604228] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T17:08:20.763213] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-17T17:08:20.861554] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:08:21.440296] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:08:21.558017] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-17T17:08:22.185329] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T17:08:22.358056] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-17T17:08:22.833859] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T17:08:23.158093] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-17T17:08:23.856690] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T17:08:23.958065] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-17T17:08:24.270767] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T17:08:24.758060] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-17T17:08:25.130903] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T17:08:25.558071] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-17T17:08:25.758601] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T17:08:26.358122] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-17T17:08:27.029821] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T17:08:27.157993] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-17T17:08:27.763754] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T17:08:27.958005] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-17T17:08:28.173409] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-17T17:08:28.758040] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-17T17:08:29.028272] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T17:08:29.558028] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-17T17:08:30.351259] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T17:08:30.356452] [INFO ] [REMOTE ] AIR: Full fetch complete (40277 records). [2025-10-17T17:08:30.356541] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-17T17:08:30.367701] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-17T17:08:30.729900] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-17T17:08:30.730056] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-17T17:08:30.730506] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-17T17:08:30.730551] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-17T17:08:30.731504] [DEBUG] [LOCAL ] AIR: Trimmed 40277 records to 29335 (keeping 200 days of data) [2025-10-17T17:08:30.848526] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T17:08:30.921603] [DEBUG] [LOCAL ] AIR: Primary data saved (29335 records). [2025-10-17T17:08:30.921770] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-17T17:08:30.921866] [INFO ] [MAIN ] Update Progress: 69/2368 symbols completed. AIR took 41.9s. Estimated remaining: 4h 41m 33s. Rate: 8.2 symbols/min [2025-10-17T17:08:31.086566] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:08:31.092329] [DEBUG] [LOCAL ] AIZN: Loaded 3972 existing records from primary storage. [2025-10-17T17:08:31.092526] [INFO ] [MAIN ] AIZN: Loaded 3972 existing records. [2025-10-17T17:08:31.165437] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-17T17:08:31.268534] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:08:31.269059] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-17T17:08:31.269115] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-17T17:08:31.269307] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-17T17:08:31.269364] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-17T17:08:31.620239] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:08:31.939454] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T17:08:31.957987] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-17T17:08:32.252746] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T17:08:32.696932] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-17T17:08:32.758045] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-17T17:08:33.540064] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-17T17:08:33.557988] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-17T17:08:34.154699] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T17:08:34.358114] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-17T17:08:35.158099] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-17T17:08:35.558395] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T17:08:35.562365] [INFO ] [REMOTE ] AIT: Full fetch complete (39221 records). [2025-10-17T17:08:35.562470] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-17T17:08:35.933133] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-17T17:08:35.933218] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-17T17:08:35.933687] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-17T17:08:35.933752] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-17T17:08:35.934842] [DEBUG] [LOCAL ] AIT: Trimmed 39221 records to 27357 (keeping 200 days of data) [2025-10-17T17:08:35.993189] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-17T17:08:36.117792] [DEBUG] [LOCAL ] AIT: Primary data saved (27357 records). [2025-10-17T17:08:36.117932] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-17T17:08:36.118032] [INFO ] [MAIN ] Update Progress: 70/2368 symbols completed. AIT took 27.8s. Estimated remaining: 4h 40m 15s. Rate: 8.2 symbols/min [2025-10-17T17:08:36.298364] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:08:36.349362] [DEBUG] [LOCAL ] AJG: Loaded 46920 existing records from primary storage. [2025-10-17T17:08:36.349754] [INFO ] [MAIN ] AJG: Loaded 46920 existing records. [2025-10-17T17:08:36.540366] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:08:36.540962] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-17T17:08:36.541212] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-17T17:08:36.544399] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-17T17:08:36.544530] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-17T17:08:36.544693] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-17T17:08:36.765880] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-17T17:08:36.876188] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T17:08:36.953516] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:08:37.442270] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-17T17:08:37.558053] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-17T17:08:38.358066] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-17T17:08:38.364452] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T17:08:39.158052] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-17T17:08:39.903243] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T17:08:39.958038] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-17T17:08:40.658108] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T17:08:40.758033] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-17T17:08:41.072253] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-17T17:08:41.444980] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T17:08:41.558045] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-17T17:08:42.358038] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-17T17:08:43.158047] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-17T17:08:43.200898] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T17:08:43.739776] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T17:08:43.825488] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T17:08:43.958065] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-17T17:08:44.758063] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-17T17:08:45.546206] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T17:08:45.562310] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-17T17:08:46.108108] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-17T17:08:46.268948] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T17:08:46.358021] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-17T17:08:47.158063] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-17T17:08:47.522224] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-17T17:08:47.958046] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-17T17:08:48.527331] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-17T17:08:48.758039] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-17T17:08:48.868507] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T17:08:48.875280] [INFO ] [REMOTE ] AIV: Full fetch complete (60411 records). [2025-10-17T17:08:48.875404] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-17T17:08:49.206160] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-17T17:08:49.261977] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-17T17:08:49.262061] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-17T17:08:49.262670] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-17T17:08:49.262736] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-17T17:08:49.263989] [DEBUG] [LOCAL ] AIV: Trimmed 60411 records to 42194 (keeping 200 days of data) [2025-10-17T17:08:49.504996] [DEBUG] [LOCAL ] AIV: Primary data saved (42194 records). [2025-10-17T17:08:49.505124] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-17T17:08:49.505206] [INFO ] [MAIN ] Update Progress: 71/2368 symbols completed. AIV took 36.0s. Estimated remaining: 4h 43m 24s. Rate: 8.1 symbols/min [2025-10-17T17:08:49.566362] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-17T17:08:49.677101] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:08:49.677291] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-17T17:08:49.677348] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-17T17:08:49.677483] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-17T17:08:49.677558] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-17T17:08:49.677613] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-17T17:08:49.677680] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-17T17:08:50.043432] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:08:50.358052] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-17T17:08:51.147038] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T17:08:51.157979] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-17T17:08:51.957997] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-17T17:08:51.997730] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T17:08:52.266161] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T17:08:52.585258] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-17T17:08:52.586403] [INFO ] [REMOTE ] AIZN: Full fetch complete (5864 records). [2025-10-17T17:08:52.586471] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-17T17:08:52.759827] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-17T17:08:52.941077] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-17T17:08:52.941174] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-17T17:08:52.941363] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-17T17:08:52.941404] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-17T17:08:52.941809] [DEBUG] [LOCAL ] AIZN: Trimmed 5864 records to 3995 (keeping 200 days of data) [2025-10-17T17:08:52.965287] [DEBUG] [LOCAL ] AIZN: Primary data saved (3995 records). [2025-10-17T17:08:52.965360] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-17T17:08:52.965446] [INFO ] [MAIN ] Update Progress: 72/2368 symbols completed. AIZN took 22.0s. Estimated remaining: 4h 41m 11s. Rate: 8.2 symbols/min [2025-10-17T17:08:53.130732] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:08:53.174273] [DEBUG] [LOCAL ] AKR: Loaded 46457 existing records from primary storage. [2025-10-17T17:08:53.174569] [INFO ] [MAIN ] AKR: Loaded 46457 existing records. [2025-10-17T17:08:53.282134] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-17T17:08:53.355287] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:08:53.355510] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-17T17:08:53.355558] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-17T17:08:53.355958] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-17T17:08:53.356015] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-17T17:08:53.566850] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-17T17:08:53.723553] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:08:54.358033] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-17T17:08:54.831980] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-17T17:08:54.974954] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T17:08:55.158030] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-17T17:08:55.958079] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-17T17:08:56.511349] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-17T17:08:56.758041] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-17T17:08:57.321077] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T17:08:57.558026] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-17T17:08:58.025846] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T17:08:58.153219] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T17:08:58.358057] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-17T17:08:58.799744] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-17T17:08:59.158038] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-17T17:08:59.958029] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-17T17:09:00.501709] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-17T17:09:00.595840] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T17:09:00.758000] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-17T17:09:01.558016] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-17T17:09:01.683169] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T17:09:02.358015] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-17T17:09:02.607166] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T17:09:03.158030] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-17T17:09:03.706933] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-17T17:09:03.731558] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T17:09:03.958034] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-17T17:09:04.322343] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-17T17:09:04.758047] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-17T17:09:05.557997] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-17T17:09:05.702675] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T17:09:05.706120] [INFO ] [REMOTE ] AIZ: Full fetch complete (42641 records). [2025-10-17T17:09:05.706227] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-17T17:09:05.706904] [FATAL] [VALIDATOR ] AIZ: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:09:05.706989] [FATAL] [MAIN ] AIZ: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:09:05.707032] [WARN ] [MAIN ] AIZ: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:09:05.707072] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-17T17:09:05.707128] [DEBUG] [LOCAL ] AIZ: No primary data file found to delete. [2025-10-17T17:09:05.707163] [INFO ] [LOCAL ] AIZ: Starting deletion of derivative data. [2025-10-17T17:09:05.707311] [DEBUG] [LOCAL ] AIZ: Deleted derivative data file. [2025-10-17T17:09:05.707399] [INFO ] [MAIN ] Update Progress: 73/2368 symbols completed. AIZ took 45.6s. Estimated remaining: 4h 43m 53s. Rate: 8.1 symbols/min [2025-10-17T17:09:05.875623] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:05.899879] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-17T17:09:05.917019] [DEBUG] [LOCAL ] AL: Loaded 45074 existing records from primary storage. [2025-10-17T17:09:05.917345] [INFO ] [MAIN ] AL: Loaded 45074 existing records. [2025-10-17T17:09:06.099084] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:09:06.099462] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-17T17:09:06.099525] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-17T17:09:06.100267] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-17T17:09:06.100326] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-17T17:09:06.363172] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-17T17:09:06.449474] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:09:07.158025] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-17T17:09:07.958121] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-17T17:09:08.171864] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T17:09:08.355797] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-17T17:09:08.758000] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-17T17:09:08.879801] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-17T17:09:09.241166] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-17T17:09:09.242363] [INFO ] [REMOTE ] AKA: Full fetch complete (2748 records). [2025-10-17T17:09:09.242431] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-17T17:09:09.424109] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T17:09:09.424314] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:09:09.424383] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:09:09.424457] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-17T17:09:09.424534] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-17T17:09:09.424603] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-17T17:09:09.424703] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-17T17:09:09.424774] [INFO ] [MAIN ] Update Progress: 74/2368 symbols completed. AKA took 19.9s. Estimated remaining: 4h 41m 51s. Rate: 8.1 symbols/min [2025-10-17T17:09:09.563182] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-17T17:09:09.594891] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:09.647334] [DEBUG] [LOCAL ] ALB: Loaded 53733 existing records from primary storage. [2025-10-17T17:09:09.647741] [INFO ] [MAIN ] ALB: Loaded 53733 existing records. [2025-10-17T17:09:09.822291] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:09:09.822504] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-17T17:09:09.822550] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-17T17:09:09.823054] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-17T17:09:09.823111] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-17T17:09:10.171197] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:09:10.358051] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-17T17:09:11.073032] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T17:09:11.158033] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-17T17:09:11.958039] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-17T17:09:12.209750] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T17:09:12.395158] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-17T17:09:12.758092] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-17T17:09:13.460055] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T17:09:13.558015] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-17T17:09:14.309050] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T17:09:14.358029] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-17T17:09:15.158036] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-17T17:09:15.222075] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T17:09:15.958035] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-17T17:09:16.029175] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T17:09:16.600743] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T17:09:16.758058] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-17T17:09:17.436187] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:09:17.558151] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-17T17:09:18.346456] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T17:09:18.357976] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-17T17:09:19.158006] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-17T17:09:19.309114] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T17:09:19.869383] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T17:09:19.957997] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-17T17:09:20.588060] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T17:09:20.594419] [INFO ] [REMOTE ] AJG: Full fetch complete (69038 records). [2025-10-17T17:09:20.594568] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-17T17:09:20.766388] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-17T17:09:20.986752] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-17T17:09:20.986832] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-17T17:09:20.987556] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-17T17:09:20.987620] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-17T17:09:20.989518] [DEBUG] [LOCAL ] AJG: Trimmed 69038 records to 47258 (keeping 200 days of data) [2025-10-17T17:09:21.245616] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T17:09:21.321790] [DEBUG] [LOCAL ] AJG: Primary data saved (47258 records). [2025-10-17T17:09:21.321915] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-17T17:09:21.323126] [INFO ] [MAIN ] Update Progress: 75/2368 symbols completed. AJG took 45.2s. Estimated remaining: 4h 44m 2s. Rate: 8.1 symbols/min [2025-10-17T17:09:21.487685] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:21.541975] [DEBUG] [LOCAL ] ALC: Loaded 51569 existing records from primary storage. [2025-10-17T17:09:21.542288] [INFO ] [MAIN ] ALC: Loaded 51569 existing records. [2025-10-17T17:09:21.563149] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-17T17:09:21.734149] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:09:21.734455] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-17T17:09:21.734530] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-17T17:09:21.734995] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-17T17:09:21.735090] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-17T17:09:22.135595] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:09:22.158095] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T17:09:22.357992] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-17T17:09:23.158058] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-17T17:09:23.753041] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-17T17:09:23.958006] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-17T17:09:24.058150] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:09:24.758104] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-17T17:09:24.904332] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T17:09:25.498108] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:09:25.557991] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-17T17:09:26.059496] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-17T17:09:26.358037] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-17T17:09:27.145396] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T17:09:27.158033] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-17T17:09:27.761863] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T17:09:27.958053] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-17T17:09:28.412584] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T17:09:28.758046] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-17T17:09:29.558038] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-17T17:09:29.624926] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T17:09:30.201249] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T17:09:30.358035] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-17T17:09:30.948490] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-17T17:09:31.158047] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-17T17:09:31.958007] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-17T17:09:32.122541] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T17:09:32.715538] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T17:09:32.722263] [INFO ] [REMOTE ] AL: Full fetch complete (63553 records). [2025-10-17T17:09:32.722384] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-17T17:09:32.765671] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-17T17:09:33.124866] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-17T17:09:33.124955] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-17T17:09:33.125603] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-17T17:09:33.125670] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-17T17:09:33.126931] [DEBUG] [LOCAL ] AL: Trimmed 63553 records to 45438 (keeping 200 days of data) [2025-10-17T17:09:33.406985] [DEBUG] [LOCAL ] AL: Primary data saved (45438 records). [2025-10-17T17:09:33.407124] [INFO ] [MAIN ] AL: Full history saved. [2025-10-17T17:09:33.407267] [INFO ] [MAIN ] Update Progress: 76/2368 symbols completed. AL took 27.7s. Estimated remaining: 4h 46m 15s. Rate: 8.0 symbols/min [2025-10-17T17:09:33.580584] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:33.576950] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-17T17:09:33.612780] [DEBUG] [LOCAL ] ALE: Loaded 32255 existing records from primary storage. [2025-10-17T17:09:33.613052] [INFO ] [MAIN ] ALE: Loaded 32255 existing records. [2025-10-17T17:09:33.793903] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:09:33.794140] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-17T17:09:33.794187] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-17T17:09:33.794419] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-17T17:09:33.794486] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-17T17:09:34.203854] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:09:34.208957] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-17T17:09:34.308247] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T17:09:34.314766] [INFO ] [REMOTE ] AKR: Full fetch complete (65472 records). [2025-10-17T17:09:34.314903] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-17T17:09:34.368460] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-17T17:09:34.691661] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-17T17:09:34.691750] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-17T17:09:34.692359] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-17T17:09:34.692401] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-17T17:09:34.693623] [DEBUG] [LOCAL ] AKR: Trimmed 65472 records to 46788 (keeping 200 days of data) [2025-10-17T17:09:34.969486] [DEBUG] [LOCAL ] AKR: Primary data saved (46788 records). [2025-10-17T17:09:34.969635] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-17T17:09:34.969759] [INFO ] [MAIN ] Update Progress: 77/2368 symbols completed. AKR took 42.0s. Estimated remaining: 4h 43m 11s. Rate: 8.1 symbols/min [2025-10-17T17:09:35.158150] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-17T17:09:35.444414] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T17:09:35.644108] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T17:09:35.958013] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-17T17:09:36.757994] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-17T17:09:37.205003] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T17:09:37.207589] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-17T17:09:37.558086] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-17T17:09:38.358048] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-17T17:09:38.417555] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T17:09:38.687598] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T17:09:39.158030] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-17T17:09:39.958001] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-17T17:09:40.072336] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T17:09:40.547689] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-17T17:09:40.758036] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-17T17:09:41.337477] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T17:09:41.558024] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-17T17:09:41.932760] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T17:09:42.358085] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-17T17:09:43.158042] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-17T17:09:43.283214] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T17:09:43.957990] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-17T17:09:44.413391] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-17T17:09:44.439997] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-17T17:09:44.758041] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-17T17:09:45.558020] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-17T17:09:45.711149] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T17:09:45.981887] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T17:09:46.358039] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-17T17:09:47.158090] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-17T17:09:47.566086] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-17T17:09:47.898228] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T17:09:47.958012] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-17T17:09:48.633029] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T17:09:48.758038] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-17T17:09:49.372012] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T17:09:49.381252] [INFO ] [REMOTE ] ALC: Full fetch complete (73680 records). [2025-10-17T17:09:49.381397] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-17T17:09:49.570610] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-17T17:09:49.784164] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-17T17:09:49.784311] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-17T17:09:49.785060] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-17T17:09:49.785153] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-17T17:09:49.793996] [DEBUG] [LOCAL ] ALC: Trimmed 73680 records to 51959 (keeping 200 days of data) [2025-10-17T17:09:49.807520] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T17:09:50.113248] [DEBUG] [LOCAL ] ALC: Primary data saved (51959 records). [2025-10-17T17:09:50.113388] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-17T17:09:50.114291] [INFO ] [MAIN ] Update Progress: 78/2368 symbols completed. ALC took 28.8s. Estimated remaining: 4h 46m 50s. Rate: 8.0 symbols/min [2025-10-17T17:09:50.358028] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-17T17:09:51.121295] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T17:09:51.158002] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-17T17:09:51.795437] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T17:09:51.958026] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-17T17:09:53.075085] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T17:09:53.086832] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-17T17:09:53.252907] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T17:09:53.258613] [INFO ] [REMOTE ] ALE: Full fetch complete (44014 records). [2025-10-17T17:09:53.258778] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-17T17:09:53.632087] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-17T17:09:53.632192] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-17T17:09:53.632712] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-17T17:09:53.632776] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-17T17:09:53.633857] [DEBUG] [LOCAL ] ALE: Trimmed 44014 records to 32507 (keeping 200 days of data) [2025-10-17T17:09:53.825580] [DEBUG] [LOCAL ] ALE: Primary data saved (32507 records). [2025-10-17T17:09:53.825763] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-17T17:09:53.825872] [INFO ] [MAIN ] Update Progress: 79/2368 symbols completed. ALE took 20.4s. Estimated remaining: 4h 44m 52s. Rate: 8.0 symbols/min [2025-10-17T17:09:55.720106] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.63 seconds). [2025-10-17T17:09:55.727383] [INFO ] [REMOTE ] ALB: Full fetch complete (77070 records). [2025-10-17T17:09:55.727521] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-17T17:09:56.108889] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-17T17:09:56.108974] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-17T17:09:56.109760] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-17T17:09:56.109824] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-17T17:09:56.111326] [DEBUG] [LOCAL ] ALB: Trimmed 77070 records to 54123 (keeping 200 days of data) [2025-10-17T17:09:56.439449] [DEBUG] [LOCAL ] ALB: Primary data saved (54123 records). [2025-10-17T17:09:56.439630] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-17T17:09:56.439783] [INFO ] [MAIN ] Update Progress: 80/2368 symbols completed. ALB took 47.0s. Estimated remaining: 4h 42m 26s. Rate: 8.1 symbols/min [2025-10-17T17:09:57.015565] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:57.155295] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:57.158285] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:57.137595] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:57.159068] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-17T17:09:57.159350] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-17T17:09:57.159526] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-17T17:09:57.159623] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-17T17:09:57.159748] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-17T17:09:57.159835] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-17T17:09:57.296124] [DEBUG] [LOCAL ] ALG: Loaded 9812 existing records from primary storage. [2025-10-17T17:09:57.320292] [INFO ] [MAIN ] ALG: Loaded 9812 existing records. [2025-10-17T17:09:57.488732] [DEBUG] [LOCAL ] ALEX: Loaded 31407 existing records from primary storage. [2025-10-17T17:09:57.569073] [INFO ] [MAIN ] ALEX: Loaded 31407 existing records. [2025-10-17T17:09:57.716959] [DEBUG] [LOCAL ] ALIT: Loaded 53175 existing records from primary storage. [2025-10-17T17:09:57.769311] [INFO ] [MAIN ] ALIT: Loaded 53175 existing records. [2025-10-17T17:09:57.924207] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:09:58.001003] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-17T17:09:58.027941] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-17T17:09:58.072307] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:09:58.081989] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-17T17:09:58.084124] [INFO ] [REMOTE ] ALH: Fetching primary data for 2024-12. [2025-10-17T17:09:58.099341] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-17T17:09:58.124058] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:09:58.135679] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-17T17:09:58.148493] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-17T17:09:58.204149] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-17T17:09:58.216083] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-17T17:09:58.274188] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:09:58.359052] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-17T17:09:58.386352] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-17T17:09:58.407190] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-17T17:09:58.447756] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-17T17:09:58.508930] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:09:58.608778] [WARN ] [REMOTE ] ALH: No data returned for month 2024-12 [2025-10-17T17:09:58.685465] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:09:58.768001] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-17T17:09:58.826901] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:09:58.892235] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-17T17:09:58.923676] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-17T17:09:58.983948] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-17T17:09:59.045961] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-17T17:09:59.087823] [INFO ] [MAIN ] Update Progress: 81/2368 symbols completed. ALH took 2.5s. Estimated remaining: 4h 40m 4s. Rate: 8.2 symbols/min [2025-10-17T17:09:59.139419] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:09:59.155112] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-17T17:09:59.355262] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:09:59.386959] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-17T17:09:59.544126] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:09:59.568263] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-17T17:09:59.570288] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:09:59.627418] [DEBUG] [LOCAL ] ALK: Loaded 53470 existing records from primary storage. [2025-10-17T17:09:59.628054] [INFO ] [MAIN ] ALK: Loaded 53470 existing records. [2025-10-17T17:09:59.820005] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:09:59.820381] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-17T17:09:59.820487] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-17T17:09:59.820804] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-17T17:09:59.820865] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-17T17:10:00.198450] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:10:00.199076] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-17T17:10:00.283705] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T17:10:00.286752] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-17T17:10:00.907047] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T17:10:00.913833] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-17T17:10:01.602575] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-17T17:10:01.606569] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-17T17:10:01.643531] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-17T17:10:01.658121] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-17T17:10:02.262733] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T17:10:02.270542] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-17T17:10:02.281080] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T17:10:02.284853] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-17T17:10:02.344743] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-17T17:10:02.357988] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-17T17:10:03.134357] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-17T17:10:03.157982] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-17T17:10:03.358548] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-17T17:10:03.441147] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T17:10:03.863804] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T17:10:03.958045] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-17T17:10:04.758009] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-17T17:10:04.935520] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T17:10:05.166273] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T17:10:05.558018] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-17T17:10:05.802371] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T17:10:06.358051] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-17T17:10:07.158068] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-17T17:10:07.186041] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T17:10:07.958037] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-17T17:10:08.372494] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-17T17:10:08.426401] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T17:10:08.758065] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-17T17:10:09.558059] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-17T17:10:09.737085] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T17:10:10.306514] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T17:10:10.358022] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-17T17:10:10.798120] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-17T17:10:11.158031] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-17T17:10:11.420483] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T17:10:11.958042] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-17T17:10:12.758039] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-17T17:10:12.879126] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T17:10:13.509932] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-17T17:10:13.557994] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-17T17:10:14.358016] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-17T17:10:14.811805] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-17T17:10:15.148622] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T17:10:15.158372] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-17T17:10:15.215036] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-17T17:10:15.958095] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-17T17:10:16.758024] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-17T17:10:16.848689] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T17:10:17.330216] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-17T17:10:17.558064] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-17T17:10:18.358006] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-17T17:10:18.398987] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:10:18.452019] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T17:10:19.158091] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-17T17:10:19.958043] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-17T17:10:20.156467] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T17:10:20.593305] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T17:10:20.758077] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-17T17:10:21.558027] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-17T17:10:21.937032] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-17T17:10:22.358027] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-17T17:10:22.425021] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T17:10:23.158339] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-17T17:10:23.161669] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-17T17:10:23.166716] [INFO ] [REMOTE ] ALEX: Full fetch complete (44592 records). [2025-10-17T17:10:23.166797] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-17T17:10:23.584207] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-17T17:10:23.584317] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-17T17:10:23.584865] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-17T17:10:23.584935] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-17T17:10:23.586104] [DEBUG] [LOCAL ] ALEX: Trimmed 44592 records to 31633 (keeping 200 days of data) [2025-10-17T17:10:23.780704] [DEBUG] [LOCAL ] ALEX: Primary data saved (31633 records). [2025-10-17T17:10:23.780893] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-17T17:10:23.780998] [INFO ] [MAIN ] Update Progress: 82/2368 symbols completed. ALEX took 27.3s. Estimated remaining: 4h 48m 0s. Rate: 7.9 symbols/min [2025-10-17T17:10:23.957843] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:10:23.958041] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-17T17:10:24.005888] [DEBUG] [LOCAL ] ALL: Loaded 50161 existing records from primary storage. [2025-10-17T17:10:24.006243] [INFO ] [MAIN ] ALL: Loaded 50161 existing records. [2025-10-17T17:10:24.213625] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:10:24.215563] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-17T17:10:24.217009] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-17T17:10:24.216877] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T17:10:24.217376] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-17T17:10:24.222766] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-17T17:10:24.403256] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T17:10:24.668082] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:10:24.758057] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-17T17:10:25.558034] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-17T17:10:25.780064] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T17:10:26.354033] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T17:10:26.357971] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-17T17:10:26.412001] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T17:10:27.111814] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-17T17:10:27.157981] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-17T17:10:27.781472] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-17T17:10:27.783027] [INFO ] [REMOTE ] ALG: Full fetch complete (15354 records). [2025-10-17T17:10:27.783097] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-17T17:10:27.964295] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-17T17:10:28.145979] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-17T17:10:28.146062] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-17T17:10:28.146382] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-17T17:10:28.146425] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-17T17:10:28.146943] [DEBUG] [LOCAL ] ALG: Trimmed 15354 records to 9877 (keeping 200 days of data) [2025-10-17T17:10:28.214158] [DEBUG] [LOCAL ] ALG: Primary data saved (9877 records). [2025-10-17T17:10:28.214449] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-17T17:10:28.214749] [INFO ] [MAIN ] Update Progress: 83/2368 symbols completed. ALG took 31.8s. Estimated remaining: 4h 46m 27s. Rate: 8.0 symbols/min [2025-10-17T17:10:28.383361] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:10:28.432113] [DEBUG] [LOCAL ] ALLE: Loaded 44517 existing records from primary storage. [2025-10-17T17:10:28.432429] [INFO ] [MAIN ] ALLE: Loaded 44517 existing records. [2025-10-17T17:10:28.628144] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:10:28.628368] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-17T17:10:28.628446] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-17T17:10:28.629057] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-17T17:10:28.629129] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-17T17:10:28.763238] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-17T17:10:29.002517] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:10:29.558043] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-17T17:10:29.952282] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-17T17:10:30.358061] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-17T17:10:30.811527] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T17:10:31.163925] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-17T17:10:31.168453] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T17:10:31.176428] [INFO ] [REMOTE ] ALIT: Full fetch complete (76608 records). [2025-10-17T17:10:31.176537] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-17T17:10:31.565024] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-17T17:10:31.565116] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-17T17:10:31.565866] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-17T17:10:31.565933] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-17T17:10:31.567458] [DEBUG] [LOCAL ] ALIT: Trimmed 76608 records to 53560 (keeping 200 days of data) [2025-10-17T17:10:31.880271] [DEBUG] [LOCAL ] ALIT: Primary data saved (53560 records). [2025-10-17T17:10:31.880404] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-17T17:10:31.880498] [INFO ] [MAIN ] Update Progress: 84/2368 symbols completed. ALIT took 35.4s. Estimated remaining: 4h 44m 35s. Rate: 8.0 symbols/min [2025-10-17T17:10:31.958933] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-17T17:10:32.056040] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:10:32.094745] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T17:10:32.152205] [DEBUG] [LOCAL ] ALLY: Loaded 53610 existing records from primary storage. [2025-10-17T17:10:32.152534] [INFO ] [MAIN ] ALLY: Loaded 53610 existing records. [2025-10-17T17:10:32.329839] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:10:32.330126] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-17T17:10:32.330190] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-17T17:10:32.330470] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-17T17:10:32.330531] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-17T17:10:32.687212] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:10:32.710525] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T17:10:32.757994] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-17T17:10:33.558000] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-17T17:10:34.153800] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-17T17:10:34.161217] [INFO ] [REMOTE ] ALK: Full fetch complete (77019 records). [2025-10-17T17:10:34.161391] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-17T17:10:34.382579] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-17T17:10:34.551896] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T17:10:34.611174] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-17T17:10:34.611247] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-17T17:10:34.611989] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-17T17:10:34.612068] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-17T17:10:34.613417] [DEBUG] [LOCAL ] ALK: Trimmed 77019 records to 53860 (keeping 200 days of data) [2025-10-17T17:10:34.920824] [DEBUG] [LOCAL ] ALK: Primary data saved (53860 records). [2025-10-17T17:10:34.920964] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-17T17:10:34.921044] [INFO ] [MAIN ] Update Progress: 85/2368 symbols completed. ALK took 35.8s. Estimated remaining: 4h 42m 28s. Rate: 8.1 symbols/min [2025-10-17T17:10:35.099707] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:10:35.141266] [DEBUG] [LOCAL ] ALSN: Loaded 43767 existing records from primary storage. [2025-10-17T17:10:35.141622] [INFO ] [MAIN ] ALSN: Loaded 43767 existing records. [2025-10-17T17:10:35.163254] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-17T17:10:35.340872] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:10:35.341108] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-17T17:10:35.341172] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-17T17:10:35.341375] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-17T17:10:35.341433] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-17T17:10:35.547256] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T17:10:35.757954] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:10:35.957990] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-17T17:10:36.483140] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-17T17:10:36.758038] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-17T17:10:36.926827] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T17:10:37.558009] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-17T17:10:37.696268] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T17:10:38.358054] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-17T17:10:38.526637] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-17T17:10:38.906109] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T17:10:39.158035] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-17T17:10:39.655080] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T17:10:39.958054] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-17T17:10:40.579824] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T17:10:40.758025] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-17T17:10:41.037965] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T17:10:41.558028] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-17T17:10:42.358044] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-17T17:10:42.440144] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T17:10:43.158042] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-17T17:10:43.234005] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:10:43.945740] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T17:10:43.957982] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-17T17:10:44.758030] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-17T17:10:44.838796] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:10:45.553237] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-17T17:10:45.562423] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-17T17:10:46.358046] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-17T17:10:46.600300] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-17T17:10:47.044807] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T17:10:47.158082] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-17T17:10:47.850223] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-17T17:10:47.958043] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-17T17:10:48.758014] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-17T17:10:48.862694] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T17:10:49.558012] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-17T17:10:49.653633] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T17:10:49.948244] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T17:10:50.358056] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-17T17:10:51.158042] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-17T17:10:51.217108] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T17:10:51.958049] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-17T17:10:52.008578] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T17:10:52.758042] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-17T17:10:53.498016] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-17T17:10:53.535018] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T17:10:53.557991] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-17T17:10:54.232208] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T17:10:54.358036] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-17T17:10:55.158074] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-17T17:10:55.391316] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T17:10:55.958039] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-17T17:10:56.016422] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T17:10:56.758013] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-17T17:10:56.843129] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T17:10:57.558031] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-17T17:10:57.807723] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T17:10:57.814755] [INFO ] [REMOTE ] ALL: Full fetch complete (72539 records). [2025-10-17T17:10:57.814894] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-17T17:10:58.209302] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-17T17:10:58.209381] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-17T17:10:58.210128] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-17T17:10:58.210192] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-17T17:10:58.211618] [DEBUG] [LOCAL ] ALL: Trimmed 72539 records to 50503 (keeping 200 days of data) [2025-10-17T17:10:58.394289] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-17T17:10:58.531323] [DEBUG] [LOCAL ] ALL: Primary data saved (50503 records). [2025-10-17T17:10:58.531462] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-17T17:10:58.532484] [INFO ] [MAIN ] Update Progress: 86/2368 symbols completed. ALL took 34.8s. Estimated remaining: 4h 49m 30s. Rate: 7.9 symbols/min [2025-10-17T17:10:58.712926] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-17T17:10:58.754371] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:10:58.754946] [DEBUG] [LOCAL ] ALTG: No existing data file found in primary storage. [2025-10-17T17:10:58.754991] [WARN ] [MAIN ] ALTG: No existing data found, performing full refresh instead. [2025-10-17T17:10:58.755103] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-17T17:10:58.755145] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-17T17:10:58.755185] [DEBUG] [LOCAL ] ALTG: No primary data file found to delete. [2025-10-17T17:10:58.755217] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-17T17:10:59.088669] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T17:10:59.135219] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:10:59.135348] [INFO ] [REMOTE ] ALLE: Full fetch complete (64834 records). [2025-10-17T17:10:59.135863] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-17T17:10:59.166735] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-17T17:10:59.514330] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-17T17:10:59.514407] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-17T17:10:59.515035] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-17T17:10:59.515106] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-17T17:10:59.516350] [DEBUG] [LOCAL ] ALLE: Trimmed 64834 records to 44772 (keeping 200 days of data) [2025-10-17T17:10:59.790928] [DEBUG] [LOCAL ] ALLE: Primary data saved (44772 records). [2025-10-17T17:10:59.791053] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-17T17:10:59.792225] [INFO ] [MAIN ] Update Progress: 87/2368 symbols completed. ALLE took 31.6s. Estimated remaining: 4h 46m 36s. Rate: 8.0 symbols/min [2025-10-17T17:10:59.961069] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-17T17:10:59.964288] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:10:59.977191] [DEBUG] [LOCAL ] ALUR: Loaded 9589 existing records from primary storage. [2025-10-17T17:10:59.977414] [INFO ] [MAIN ] ALUR: Loaded 9589 existing records. [2025-10-17T17:11:00.162589] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T17:11:00.202735] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:11:00.203772] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-17T17:11:00.203832] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-17T17:11:00.204503] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-17T17:11:00.204563] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-17T17:11:00.556551] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:11:00.704791] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T17:11:00.758034] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-17T17:11:01.009921] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T17:11:01.558046] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-17T17:11:02.358010] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-17T17:11:02.633684] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T17:11:02.640021] [INFO ] [REMOTE ] ALSN: Full fetch complete (62574 records). [2025-10-17T17:11:02.640130] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-17T17:11:03.051072] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-17T17:11:03.051354] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-17T17:11:03.052069] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-17T17:11:03.052211] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-17T17:11:03.073409] [DEBUG] [LOCAL ] ALSN: Trimmed 62574 records to 44062 (keeping 200 days of data) [2025-10-17T17:11:03.074563] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T17:11:03.176936] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-17T17:11:03.332635] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T17:11:03.376772] [DEBUG] [LOCAL ] ALSN: Primary data saved (44062 records). [2025-10-17T17:11:03.376942] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-17T17:11:03.377049] [INFO ] [MAIN ] Update Progress: 88/2368 symbols completed. ALSN took 28.5s. Estimated remaining: 4h 44m 46s. Rate: 8.0 symbols/min [2025-10-17T17:11:03.547776] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:11:03.586554] [DEBUG] [LOCAL ] ALV: Loaded 42481 existing records from primary storage. [2025-10-17T17:11:03.586861] [INFO ] [MAIN ] ALV: Loaded 42481 existing records. [2025-10-17T17:11:03.759851] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:11:03.760053] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-17T17:11:03.760100] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-17T17:11:03.760581] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-17T17:11:03.760638] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-17T17:11:03.964569] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-17T17:11:04.122906] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:11:04.471022] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T17:11:04.758008] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-17T17:11:05.558003] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-17T17:11:05.673316] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T17:11:06.358030] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-17T17:11:06.392057] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T17:11:06.451872] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T17:11:07.158032] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-17T17:11:07.919265] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T17:11:07.958014] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-17T17:11:08.722243] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T17:11:08.758116] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-17T17:11:09.402721] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-17T17:11:09.558048] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-17T17:11:09.939907] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-17T17:11:10.358078] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-17T17:11:11.105001] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T17:11:11.142069] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-17T17:11:11.157980] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-17T17:11:11.958009] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-17T17:11:12.226748] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-17T17:11:12.758037] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-17T17:11:13.445675] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T17:11:13.558023] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-17T17:11:13.657423] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T17:11:14.358037] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-17T17:11:14.886412] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T17:11:15.158040] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-17T17:11:15.304523] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-17T17:11:15.958034] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-17T17:11:16.494061] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-17T17:11:16.717894] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T17:11:16.725295] [INFO ] [REMOTE ] ALLY: Full fetch complete (77218 records). [2025-10-17T17:11:16.725429] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-17T17:11:16.763186] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-17T17:11:17.112574] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-17T17:11:17.112677] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-17T17:11:17.113450] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-17T17:11:17.113498] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-17T17:11:17.115075] [DEBUG] [LOCAL ] ALLY: Trimmed 77218 records to 54000 (keeping 200 days of data) [2025-10-17T17:11:17.428224] [DEBUG] [LOCAL ] ALLY: Primary data saved (54000 records). [2025-10-17T17:11:17.428362] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-17T17:11:17.428442] [INFO ] [MAIN ] Update Progress: 89/2368 symbols completed. ALLY took 45.5s. Estimated remaining: 4h 47m 26s. Rate: 7.9 symbols/min [2025-10-17T17:11:17.531957] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T17:11:17.563130] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-17T17:11:17.631427] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:11:17.640750] [DEBUG] [LOCAL ] ALX: Loaded 7061 existing records from primary storage. [2025-10-17T17:11:17.641039] [INFO ] [MAIN ] ALX: Loaded 7061 existing records. [2025-10-17T17:11:17.811614] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:11:17.811909] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-17T17:11:17.811963] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-17T17:11:17.812118] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-17T17:11:17.812175] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-17T17:11:18.179298] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:11:18.312490] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-17T17:11:18.314408] [INFO ] [REMOTE ] ALUR: Full fetch complete (18842 records). [2025-10-17T17:11:18.314481] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-17T17:11:18.365984] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-17T17:11:18.690417] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-17T17:11:18.690507] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-17T17:11:18.690875] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-17T17:11:18.690942] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-17T17:11:18.691598] [DEBUG] [LOCAL ] ALUR: Trimmed 18842 records to 9640 (keeping 200 days of data) [2025-10-17T17:11:18.744629] [DEBUG] [LOCAL ] ALUR: Primary data saved (9640 records). [2025-10-17T17:11:18.744925] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-17T17:11:18.745008] [INFO ] [MAIN ] Update Progress: 90/2368 symbols completed. ALUR took 19.0s. Estimated remaining: 4h 44m 41s. Rate: 8.0 symbols/min [2025-10-17T17:11:18.916546] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:11:18.977761] [DEBUG] [LOCAL ] AM: Loaded 52320 existing records from primary storage. [2025-10-17T17:11:18.978106] [INFO ] [MAIN ] AM: Loaded 52320 existing records. [2025-10-17T17:11:19.045942] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-17T17:11:19.163440] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-17T17:11:19.166701] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:11:19.168103] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-17T17:11:19.168196] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-17T17:11:19.168669] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-17T17:11:19.168731] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-17T17:11:19.560088] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:11:19.924806] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-17T17:11:19.957992] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-17T17:11:20.454820] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-17T17:11:20.758083] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-17T17:11:21.558032] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-17T17:11:22.358024] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-17T17:11:22.508491] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T17:11:22.764875] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T17:11:22.830439] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-17T17:11:23.158045] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-17T17:11:23.657451] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-17T17:11:23.958100] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-17T17:11:24.758002] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-17T17:11:25.558015] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-17T17:11:25.609880] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T17:11:25.766170] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T17:11:26.358098] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-17T17:11:27.158066] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-17T17:11:27.612707] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T17:11:27.841688] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T17:11:27.958086] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-17T17:11:28.146034] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-17T17:11:28.758030] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-17T17:11:29.511534] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T17:11:29.558047] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-17T17:11:29.687272] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T17:11:30.358029] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-17T17:11:30.448120] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T17:11:31.158004] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-17T17:11:31.286581] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T17:11:31.958070] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-17T17:11:32.715541] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T17:11:32.758006] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-17T17:11:32.872372] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T17:11:33.558037] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-17T17:11:33.917912] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-17T17:11:34.358037] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-17T17:11:35.113749] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-17T17:11:35.158030] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-17T17:11:35.166252] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T17:11:35.958048] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-17T17:11:36.486889] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T17:11:36.758047] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-17T17:11:37.558046] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-17T17:11:37.601950] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:11:37.800134] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T17:11:37.803518] [INFO ] [REMOTE ] ALTG: Full fetch complete (33440 records). [2025-10-17T17:11:37.803609] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-17T17:11:38.224136] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-17T17:11:38.224232] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-17T17:11:38.224689] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-17T17:11:38.224751] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-17T17:11:38.225707] [DEBUG] [LOCAL ] ALTG: Trimmed 33440 records to 23632 (keeping 200 days of data) [2025-10-17T17:11:38.361107] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-17T17:11:38.364277] [DEBUG] [LOCAL ] ALTG: Primary data saved (23632 records). [2025-10-17T17:11:38.364344] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-17T17:11:38.364514] [INFO ] [MAIN ] Update Progress: 91/2368 symbols completed. ALTG took 39.8s. Estimated remaining: 4h 49m 36s. Rate: 7.9 symbols/min [2025-10-17T17:11:38.531692] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:11:38.571465] [DEBUG] [LOCAL ] AMBC: Loaded 36530 existing records from primary storage. [2025-10-17T17:11:38.571796] [INFO ] [MAIN ] AMBC: Loaded 36530 existing records. [2025-10-17T17:11:38.749675] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:11:38.749874] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-17T17:11:38.749923] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-17T17:11:38.750185] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-17T17:11:38.750226] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-17T17:11:38.992919] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-17T17:11:39.118097] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:11:39.157995] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-17T17:11:39.160801] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T17:11:39.957999] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-17T17:11:40.530603] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T17:11:40.758025] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-17T17:11:40.796908] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T17:11:41.558037] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-17T17:11:42.357994] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-17T17:11:42.508231] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T17:11:42.684186] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T17:11:43.051699] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-17T17:11:43.053712] [INFO ] [REMOTE ] ALX: Full fetch complete (7929 records). [2025-10-17T17:11:43.053783] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-17T17:11:43.163106] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-17T17:11:43.432319] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-17T17:11:43.432413] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-17T17:11:43.432711] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-17T17:11:43.432774] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-17T17:11:43.433325] [DEBUG] [LOCAL ] ALX: Trimmed 7929 records to 7141 (keeping 200 days of data) [2025-10-17T17:11:43.478082] [DEBUG] [LOCAL ] ALX: Primary data saved (7141 records). [2025-10-17T17:11:43.478206] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-17T17:11:43.478298] [INFO ] [MAIN ] Update Progress: 92/2368 symbols completed. ALX took 26.0s. Estimated remaining: 4h 48m 26s. Rate: 7.9 symbols/min [2025-10-17T17:11:43.656180] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:11:43.698329] [DEBUG] [LOCAL ] AMBP: Loaded 44894 existing records from primary storage. [2025-10-17T17:11:43.698703] [INFO ] [MAIN ] AMBP: Loaded 44894 existing records. [2025-10-17T17:11:43.888971] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:11:43.889259] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-17T17:11:43.889320] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-17T17:11:43.889696] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-17T17:11:43.889814] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-17T17:11:43.963992] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-17T17:11:44.256128] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:11:44.758079] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-17T17:11:45.008304] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T17:11:45.558002] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-17T17:11:45.589151] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T17:11:46.358000] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-17T17:11:46.522228] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T17:11:46.876930] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T17:11:47.158007] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-17T17:11:47.256031] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-17T17:11:47.958067] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-17T17:11:48.619112] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T17:11:48.758038] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-17T17:11:49.558019] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-17T17:11:50.093046] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-17T17:11:50.190528] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T17:11:50.358065] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-17T17:11:51.139216] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T17:11:51.157995] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-17T17:11:51.966816] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-17T17:11:51.972479] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T17:11:52.650429] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T17:11:52.657864] [INFO ] [REMOTE ] ALV: Full fetch complete (62218 records). [2025-10-17T17:11:52.658052] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-17T17:11:52.766469] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-17T17:11:53.066120] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-17T17:11:53.066220] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-17T17:11:53.066899] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-17T17:11:53.066964] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-17T17:11:53.068373] [DEBUG] [LOCAL ] ALV: Trimmed 62218 records to 42843 (keeping 200 days of data) [2025-10-17T17:11:53.334220] [DEBUG] [LOCAL ] ALV: Primary data saved (42843 records). [2025-10-17T17:11:53.334424] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-17T17:11:53.335149] [INFO ] [MAIN ] Update Progress: 93/2368 symbols completed. ALV took 50.0s. Estimated remaining: 4h 49m 14s. Rate: 7.9 symbols/min [2025-10-17T17:11:53.504986] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:11:53.505269] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-17T17:11:53.505324] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-17T17:11:53.505595] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-17T17:11:53.505698] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-17T17:11:53.505767] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-17T17:11:53.505814] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-17T17:11:53.567717] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-17T17:11:53.830186] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T17:11:53.916867] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:11:54.358027] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-17T17:11:54.540614] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T17:11:54.750042] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T17:11:55.158039] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-17T17:11:55.816141] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T17:11:55.957997] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-17T17:11:56.758037] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-17T17:11:56.850023] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T17:11:56.972277] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:11:56.972579] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-17T17:11:56.972689] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:11:56.972742] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-17T17:11:56.972777] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:11:56.972857] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-17T17:11:56.972952] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-17T17:11:56.973007] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-17T17:11:56.973050] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-17T17:11:56.973096] [INFO ] [MAIN ] Update Progress: 94/2368 symbols completed. AMBQ took 3.6s. Estimated remaining: 4h 47m 30s. Rate: 7.9 symbols/min [2025-10-17T17:11:57.160431] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:11:57.219569] [DEBUG] [LOCAL ] AMC: Loaded 54152 existing records from primary storage. [2025-10-17T17:11:57.220085] [INFO ] [MAIN ] AMC: Loaded 54152 existing records. [2025-10-17T17:11:57.411730] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:11:57.433273] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-17T17:11:57.433421] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-17T17:11:57.434264] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-17T17:11:57.435839] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-17T17:11:57.435739] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T17:11:57.563088] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-17T17:11:57.830624] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:11:58.358044] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-17T17:11:58.924075] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T17:11:59.158022] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-17T17:11:59.910695] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T17:11:59.918245] [INFO ] [REMOTE ] AM: Full fetch complete (75702 records). [2025-10-17T17:11:59.918416] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-17T17:11:59.964074] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-17T17:12:00.314009] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-17T17:12:00.314112] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-17T17:12:00.315012] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-17T17:12:00.315082] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-17T17:12:00.316948] [DEBUG] [LOCAL ] AM: Trimmed 75702 records to 52670 (keeping 200 days of data) [2025-10-17T17:12:00.669522] [DEBUG] [LOCAL ] AM: Primary data saved (52670 records). [2025-10-17T17:12:00.669901] [INFO ] [MAIN ] AM: Full history saved. [2025-10-17T17:12:00.671287] [INFO ] [MAIN ] Update Progress: 95/2368 symbols completed. AM took 41.9s. Estimated remaining: 4h 45m 49s. Rate: 8.0 symbols/min [2025-10-17T17:12:00.763261] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-17T17:12:00.880759] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:12:00.961339] [DEBUG] [LOCAL ] AMCR: Loaded 54059 existing records from primary storage. [2025-10-17T17:12:00.962139] [INFO ] [MAIN ] AMCR: Loaded 54059 existing records. [2025-10-17T17:12:01.307378] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-17T17:12:01.314708] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:12:01.331477] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-17T17:12:01.331568] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-17T17:12:01.332107] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-17T17:12:01.332169] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-17T17:12:01.567578] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-17T17:12:01.795793] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T17:12:01.868978] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:12:02.358024] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-17T17:12:03.158032] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-17T17:12:03.430313] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-17T17:12:03.492221] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-17T17:12:03.876421] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T17:12:03.958027] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-17T17:12:04.516037] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T17:12:04.758038] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-17T17:12:04.843292] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T17:12:05.558013] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-17T17:12:06.357992] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-17T17:12:06.798428] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-17T17:12:06.956007] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T17:12:06.961523] [INFO ] [REMOTE ] AMBC: Full fetch complete (51879 records). [2025-10-17T17:12:06.961672] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-17T17:12:07.163114] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-17T17:12:07.340612] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-17T17:12:07.340725] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-17T17:12:07.341294] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-17T17:12:07.341377] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-17T17:12:07.342589] [DEBUG] [LOCAL ] AMBC: Trimmed 51879 records to 36767 (keeping 200 days of data) [2025-10-17T17:12:07.538724] [DEBUG] [LOCAL ] AMBC: Primary data saved (36767 records). [2025-10-17T17:12:07.538855] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-17T17:12:07.538932] [INFO ] [MAIN ] Update Progress: 96/2368 symbols completed. AMBC took 29.2s. Estimated remaining: 4h 45m 26s. Rate: 8.0 symbols/min [2025-10-17T17:12:07.702764] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:12:07.755097] [DEBUG] [LOCAL ] AME: Loaded 49020 existing records from primary storage. [2025-10-17T17:12:07.755393] [INFO ] [MAIN ] AME: Loaded 49020 existing records. [2025-10-17T17:12:07.927010] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:12:07.927202] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-17T17:12:07.927247] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-17T17:12:07.927464] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-17T17:12:07.927524] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-17T17:12:07.969392] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-17T17:12:08.282096] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:12:08.650777] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-17T17:12:08.758011] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-17T17:12:08.856025] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T17:12:09.559409] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-17T17:12:09.562130] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T17:12:10.357992] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-17T17:12:10.544000] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T17:12:11.158040] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-17T17:12:11.484512] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-17T17:12:11.958024] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-17T17:12:12.066062] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T17:12:12.342276] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T17:12:12.758090] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-17T17:12:13.558030] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-17T17:12:14.291382] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T17:12:14.357997] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-17T17:12:14.613618] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-17T17:12:14.845805] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T17:12:15.158021] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-17T17:12:15.958059] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-17T17:12:16.588102] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-17T17:12:16.757987] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-17T17:12:16.987436] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T17:12:17.371340] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T17:12:17.558020] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-17T17:12:18.358082] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-17T17:12:18.524591] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T17:12:19.158073] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-17T17:12:19.435003] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T17:12:19.938459] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-17T17:12:19.944480] [INFO ] [REMOTE ] AMBP: Full fetch complete (65147 records). [2025-10-17T17:12:19.944635] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-17T17:12:19.966545] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-17T17:12:20.324783] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-17T17:12:20.324866] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-17T17:12:20.325492] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-17T17:12:20.325535] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-17T17:12:20.326868] [DEBUG] [LOCAL ] AMBP: Trimmed 65147 records to 45132 (keeping 200 days of data) [2025-10-17T17:12:20.575428] [DEBUG] [LOCAL ] AMBP: Primary data saved (45132 records). [2025-10-17T17:12:20.575551] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-17T17:12:20.575630] [INFO ] [MAIN ] Update Progress: 97/2368 symbols completed. AMBP took 37.1s. Estimated remaining: 4h 47m 27s. Rate: 7.9 symbols/min [2025-10-17T17:12:20.744249] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:12:20.763107] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-17T17:12:20.765036] [DEBUG] [LOCAL ] AMG: Loaded 20310 existing records from primary storage. [2025-10-17T17:12:20.765219] [INFO ] [MAIN ] AMG: Loaded 20310 existing records. [2025-10-17T17:12:20.946131] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:12:20.946327] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-17T17:12:20.946375] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-17T17:12:20.946595] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-17T17:12:20.946683] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-17T17:12:21.345232] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:12:21.339784] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-17T17:12:21.558009] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-17T17:12:21.980502] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-17T17:12:22.358019] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-17T17:12:22.588170] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-17T17:12:22.938357] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-17T17:12:23.158080] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-17T17:12:23.845470] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-17T17:12:23.958006] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-17T17:12:24.279698] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T17:12:24.758057] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-17T17:12:25.558017] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-17T17:12:26.305551] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T17:12:26.357995] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-17T17:12:27.139292] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (3.18 seconds). [2025-10-17T17:12:27.157983] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-17T17:12:27.200732] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T17:12:27.958105] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-17T17:12:28.181515] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T17:12:28.758141] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-17T17:12:29.001420] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T17:12:29.495767] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-17T17:12:29.557992] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-17T17:12:30.358018] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-17T17:12:30.446104] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T17:12:31.158038] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-17T17:12:31.492288] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-17T17:12:31.904925] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-17T17:12:31.957992] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-17T17:12:32.758086] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-17T17:12:33.077512] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T17:12:33.558083] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-17T17:12:33.601967] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-17T17:12:34.225692] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-17T17:12:34.358004] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-17T17:12:35.157995] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-17T17:12:35.335215] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T17:12:35.342485] [INFO ] [REMOTE ] AME: Full fetch complete (70026 records). [2025-10-17T17:12:35.342596] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-17T17:12:35.679516] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-17T17:12:35.766276] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-17T17:12:35.766362] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-17T17:12:35.767092] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-17T17:12:35.767156] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-17T17:12:35.768576] [DEBUG] [LOCAL ] AME: Trimmed 70026 records to 49338 (keeping 200 days of data) [2025-10-17T17:12:35.966680] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-17T17:12:36.090208] [DEBUG] [LOCAL ] AME: Primary data saved (49338 records). [2025-10-17T17:12:36.090355] [INFO ] [MAIN ] AME: Full history saved. [2025-10-17T17:12:36.092478] [INFO ] [MAIN ] Update Progress: 98/2368 symbols completed. AME took 28.6s. Estimated remaining: 4h 50m 23s. Rate: 7.8 symbols/min [2025-10-17T17:12:36.259986] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:12:36.324257] [DEBUG] [LOCAL ] AMH: Loaded 52220 existing records from primary storage. [2025-10-17T17:12:36.324615] [INFO ] [MAIN ] AMH: Loaded 52220 existing records. [2025-10-17T17:12:36.497115] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:12:36.497331] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-17T17:12:36.497379] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-17T17:12:36.497730] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-17T17:12:36.497786] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-17T17:12:36.767724] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-17T17:12:36.849223] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:12:37.558031] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-17T17:12:37.660621] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T17:12:37.789835] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-17T17:12:38.008669] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-17T17:12:38.358019] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-17T17:12:39.158087] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-17T17:12:39.325078] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T17:12:39.958074] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-17T17:12:40.704682] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-17T17:12:40.712710] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-17T17:12:40.712857] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-17T17:12:40.758397] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-17T17:12:40.846173] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-17T17:12:41.150871] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-17T17:12:41.149671] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-17T17:12:41.150993] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-17T17:12:41.158847] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-17T17:12:41.158930] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-17T17:12:41.159571] [INFO ] [REMOTE ] AMCR: Full fetch complete (77842 records). [2025-10-17T17:12:41.159940] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-17T17:12:41.191795] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 54542 (keeping 200 days of data) [2025-10-17T17:12:41.563329] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-17T17:12:41.785279] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-17T17:12:41.814142] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-17T17:12:41.820686] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-17T17:12:41.821590] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-17T17:12:41.837154] [DEBUG] [LOCAL ] AMCR: Trimmed 77842 records to 54449 (keeping 200 days of data) [2025-10-17T17:12:42.038235] [DEBUG] [LOCAL ] AMC: Primary data saved (54542 records). [2025-10-17T17:12:42.042208] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-17T17:12:42.046195] [INFO ] [MAIN ] Update Progress: 99/2368 symbols completed. AMC took 45.1s. Estimated remaining: 4h 49m 36s. Rate: 7.8 symbols/min [2025-10-17T17:12:42.385876] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:12:42.438776] [DEBUG] [LOCAL ] AMCR: Primary data saved (54449 records). [2025-10-17T17:12:42.439347] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-17T17:12:42.440470] [INFO ] [MAIN ] Update Progress: 100/2368 symbols completed. AMCR took 41.8s. Estimated remaining: 4h 46m 43s. Rate: 7.9 symbols/min [2025-10-17T17:12:42.587631] [DEBUG] [LOCAL ] AMN: Loaded 42102 existing records from primary storage. [2025-10-17T17:12:42.588870] [INFO ] [MAIN ] AMN: Loaded 42102 existing records. [2025-10-17T17:12:42.612056] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T17:12:42.744521] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-17T17:12:42.842890] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:12:42.913586] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-17T17:12:42.909085] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:12:42.924364] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-17T17:12:42.924989] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-17T17:12:42.925875] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-17T17:12:42.925935] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-17T17:12:43.166156] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-17T17:12:43.224308] [DEBUG] [LOCAL ] AMP: Loaded 32286 existing records from primary storage. [2025-10-17T17:12:43.246148] [INFO ] [MAIN ] AMP: Loaded 32286 existing records. [2025-10-17T17:12:43.341584] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:12:43.493986] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:12:43.494222] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-17T17:12:43.494270] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-17T17:12:43.494572] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-17T17:12:43.494629] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-17T17:12:43.843173] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:12:43.958022] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-17T17:12:44.044016] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-17T17:12:44.544139] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T17:12:44.758029] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-17T17:12:45.558018] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-17T17:12:45.849933] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T17:12:45.965497] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T17:12:45.968411] [INFO ] [REMOTE ] AMG: Full fetch complete (29621 records). [2025-10-17T17:12:45.968486] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-17T17:12:46.333723] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-17T17:12:46.333814] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-17T17:12:46.334183] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-17T17:12:46.334223] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-17T17:12:46.335046] [DEBUG] [LOCAL ] AMG: Trimmed 29621 records to 20485 (keeping 200 days of data) [2025-10-17T17:12:46.388012] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-17T17:12:46.461814] [DEBUG] [LOCAL ] AMG: Primary data saved (20485 records). [2025-10-17T17:12:46.461942] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-17T17:12:46.462020] [INFO ] [MAIN ] Update Progress: 101/2368 symbols completed. AMG took 25.9s. Estimated remaining: 4h 45m 16s. Rate: 7.9 symbols/min [2025-10-17T17:12:46.626470] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:12:46.674894] [DEBUG] [LOCAL ] AMPX: Loaded 52728 existing records from primary storage. [2025-10-17T17:12:46.675202] [INFO ] [MAIN ] AMPX: Loaded 52728 existing records. [2025-10-17T17:12:46.848218] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:12:46.848458] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-17T17:12:46.848505] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-17T17:12:46.848970] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-17T17:12:46.849026] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-17T17:12:47.159981] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-17T17:12:47.218461] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:12:47.287726] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T17:12:47.891508] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T17:12:47.958077] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-17T17:12:48.758058] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-17T17:12:48.872562] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T17:12:49.558042] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-17T17:12:49.876445] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T17:12:49.924740] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T17:12:50.358055] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-17T17:12:51.100674] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:12:51.157985] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-17T17:12:51.575616] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T17:12:51.958034] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-17T17:12:52.764432] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-17T17:12:52.766455] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T17:12:53.558163] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-17T17:12:53.896890] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-17T17:12:54.358024] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-17T17:12:54.414571] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T17:12:55.088071] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T17:12:55.158063] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-17T17:12:55.958043] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-17T17:12:56.044207] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T17:12:56.684318] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-17T17:12:56.758063] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-17T17:12:57.558019] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-17T17:12:57.669034] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T17:12:58.358037] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-17T17:12:58.735671] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-17T17:12:58.783421] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-17T17:12:59.158078] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-17T17:12:59.970563] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-17T17:12:59.977573] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T17:13:00.514417] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T17:13:00.758060] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-17T17:13:01.248360] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T17:13:01.558026] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-17T17:13:02.358068] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-17T17:13:02.907729] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T17:13:03.158058] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-17T17:13:03.898574] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T17:13:03.958018] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-17T17:13:04.088123] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T17:13:04.758058] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-17T17:13:05.550773] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T17:13:05.560303] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-17T17:13:06.260739] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (5.50 seconds). [2025-10-17T17:13:06.312712] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T17:13:06.357980] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-17T17:13:06.994989] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T17:13:07.158045] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-17T17:13:07.858910] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:13:07.958002] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-17T17:13:08.605613] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T17:13:08.758089] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-17T17:13:09.521893] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T17:13:09.557993] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-17T17:13:10.092291] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T17:13:10.358047] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-17T17:13:11.158038] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-17T17:13:11.728115] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T17:13:11.937273] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-17T17:13:11.957992] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-17T17:13:12.652365] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T17:13:12.657931] [INFO ] [REMOTE ] AMN: Full fetch complete (60092 records). [2025-10-17T17:13:12.658043] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-17T17:13:12.658840] [FATAL] [VALIDATOR ] AMN: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:13:12.658906] [FATAL] [MAIN ] AMN: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:13:12.658945] [WARN ] [MAIN ] AMN: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:13:12.658984] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-17T17:13:12.659040] [DEBUG] [LOCAL ] AMN: No primary data file found to delete. [2025-10-17T17:13:12.659089] [INFO ] [LOCAL ] AMN: Starting deletion of derivative data. [2025-10-17T17:13:12.659235] [DEBUG] [LOCAL ] AMN: Deleted derivative data file. [2025-10-17T17:13:12.659324] [INFO ] [MAIN ] Update Progress: 102/2368 symbols completed. AMN took 30.6s. Estimated remaining: 4h 52m 2s. Rate: 7.8 symbols/min [2025-10-17T17:13:12.758817] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-17T17:13:12.827921] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:13:12.864524] [DEBUG] [LOCAL ] AMPY: Loaded 39500 existing records from primary storage. [2025-10-17T17:13:12.864850] [INFO ] [MAIN ] AMPY: Loaded 39500 existing records. [2025-10-17T17:13:13.041792] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:13:13.042015] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-17T17:13:13.042063] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-17T17:13:13.042259] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-17T17:13:13.042301] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-17T17:13:13.400839] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:13:13.557992] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-17T17:13:13.992575] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-17T17:13:14.217154] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T17:13:14.358050] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-17T17:13:15.086343] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T17:13:15.158032] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-17T17:13:15.610014] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T17:13:15.958110] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-17T17:13:16.570759] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T17:13:16.576417] [INFO ] [REMOTE ] AMP: Full fetch complete (47562 records). [2025-10-17T17:13:16.576584] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-17T17:13:16.759140] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-17T17:13:16.967548] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-17T17:13:16.967683] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-17T17:13:16.968202] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-17T17:13:16.968263] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-17T17:13:16.969321] [DEBUG] [LOCAL ] AMP: Trimmed 47562 records to 32543 (keeping 200 days of data) [2025-10-17T17:13:17.173867] [DEBUG] [LOCAL ] AMP: Primary data saved (32543 records). [2025-10-17T17:13:17.174012] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-17T17:13:17.174101] [INFO ] [MAIN ] Update Progress: 103/2368 symbols completed. AMP took 34.7s. Estimated remaining: 4h 50m 44s. Rate: 7.8 symbols/min [2025-10-17T17:13:17.348881] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:13:17.378438] [DEBUG] [LOCAL ] AMR: Loaded 29158 existing records from primary storage. [2025-10-17T17:13:17.378777] [INFO ] [MAIN ] AMR: Loaded 29158 existing records. [2025-10-17T17:13:17.560536] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-17T17:13:17.565328] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:13:17.567095] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-17T17:13:17.567174] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-17T17:13:17.567480] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-17T17:13:17.567564] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-17T17:13:17.938763] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:13:18.236845] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-17T17:13:18.358035] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-17T17:13:18.564787] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-17T17:13:18.604460] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T17:13:18.611719] [INFO ] [REMOTE ] AMH: Full fetch complete (75082 records). [2025-10-17T17:13:18.611831] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-17T17:13:18.986336] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-17T17:13:18.986417] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-17T17:13:18.987134] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-17T17:13:18.987199] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-17T17:13:18.988582] [DEBUG] [LOCAL ] AMH: Trimmed 75082 records to 52597 (keeping 200 days of data) [2025-10-17T17:13:19.169245] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-17T17:13:19.319230] [DEBUG] [LOCAL ] AMH: Primary data saved (52597 records). [2025-10-17T17:13:19.319401] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-17T17:13:19.319502] [INFO ] [MAIN ] Update Progress: 104/2368 symbols completed. AMH took 43.2s. Estimated remaining: 4h 48m 35s. Rate: 7.8 symbols/min [2025-10-17T17:13:19.486019] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T17:13:19.510678] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:13:19.549059] [DEBUG] [LOCAL ] AMRC: Loaded 38803 existing records from primary storage. [2025-10-17T17:13:19.549374] [INFO ] [MAIN ] AMRC: Loaded 38803 existing records. [2025-10-17T17:13:19.728071] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:13:19.728288] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-17T17:13:19.728337] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-17T17:13:19.728875] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-17T17:13:19.728934] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-17T17:13:19.968607] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-17T17:13:20.082663] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:13:20.292877] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T17:13:20.758047] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-17T17:13:21.081248] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T17:13:21.558032] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-17T17:13:21.873862] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T17:13:22.358010] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-17T17:13:22.453098] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-17T17:13:23.158033] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-17T17:13:23.958010] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-17T17:13:24.006208] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T17:13:24.476226] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T17:13:24.758049] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-17T17:13:25.322757] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-17T17:13:25.558018] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-17T17:13:25.884586] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T17:13:26.358041] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-17T17:13:27.158038] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-17T17:13:27.334177] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:13:27.359086] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T17:13:27.958049] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-17T17:13:28.470002] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T17:13:28.758005] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-17T17:13:29.423984] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T17:13:29.558034] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-17T17:13:30.267285] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T17:13:30.358047] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-17T17:13:30.682063] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T17:13:31.158078] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-17T17:13:31.486099] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T17:13:31.958084] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-17T17:13:32.758075] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-17T17:13:33.271565] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T17:13:33.558050] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-17T17:13:33.713536] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-17T17:13:33.721579] [INFO ] [REMOTE ] AMPX: Full fetch complete (75210 records). [2025-10-17T17:13:33.721782] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-17T17:13:34.039126] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T17:13:34.153616] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-17T17:13:34.153727] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-17T17:13:34.154458] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-17T17:13:34.154520] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-17T17:13:34.156001] [DEBUG] [LOCAL ] AMPX: Trimmed 75210 records to 53118 (keeping 200 days of data) [2025-10-17T17:13:34.358049] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-17T17:13:34.467359] [DEBUG] [LOCAL ] AMPX: Primary data saved (53118 records). [2025-10-17T17:13:34.467480] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-17T17:13:34.467593] [INFO ] [MAIN ] Update Progress: 105/2368 symbols completed. AMPX took 48.0s. Estimated remaining: 4h 51m 9s. Rate: 7.8 symbols/min [2025-10-17T17:13:34.634503] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:13:34.634687] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-17T17:13:34.634740] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-17T17:13:34.634885] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-17T17:13:34.634987] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-17T17:13:34.635051] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-17T17:13:34.635086] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-17T17:13:35.018537] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:13:35.062000] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T17:13:35.157990] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-17T17:13:35.958000] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-17T17:13:36.018984] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T17:13:36.462207] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T17:13:36.758030] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-17T17:13:36.964619] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:13:36.965001] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-17T17:13:36.965092] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:13:36.965140] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-17T17:13:36.965205] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:13:36.965278] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-17T17:13:36.965346] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-17T17:13:36.965383] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-17T17:13:36.965422] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-17T17:13:36.965469] [INFO ] [MAIN ] Update Progress: 106/2368 symbols completed. AMRZ took 2.5s. Estimated remaining: 4h 49m 10s. Rate: 7.8 symbols/min [2025-10-17T17:13:37.139788] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:13:37.174556] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T17:13:37.217231] [DEBUG] [LOCAL ] AMT: Loaded 52860 existing records from primary storage. [2025-10-17T17:13:37.217586] [INFO ] [MAIN ] AMT: Loaded 52860 existing records. [2025-10-17T17:13:37.388974] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:13:37.389208] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-17T17:13:37.389256] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-17T17:13:37.389685] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-17T17:13:37.389742] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-17T17:13:37.563465] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-17T17:13:37.763679] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:13:38.358026] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-17T17:13:39.133109] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T17:13:39.158035] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-17T17:13:39.570428] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-17T17:13:39.958056] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-17T17:13:40.442237] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T17:13:40.758078] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-17T17:13:41.558118] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-17T17:13:41.867943] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T17:13:42.247817] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T17:13:42.254800] [INFO ] [REMOTE ] AMPY: Full fetch complete (53080 records). [2025-10-17T17:13:42.254970] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-17T17:13:42.363286] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-17T17:13:42.634254] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-17T17:13:42.634348] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-17T17:13:42.634938] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-17T17:13:42.635001] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-17T17:13:42.636056] [DEBUG] [LOCAL ] AMPY: Trimmed 53080 records to 39876 (keeping 200 days of data) [2025-10-17T17:13:42.852198] [DEBUG] [LOCAL ] AMPY: Primary data saved (39876 records). [2025-10-17T17:13:42.852338] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-17T17:13:42.852419] [INFO ] [MAIN ] Update Progress: 107/2368 symbols completed. AMPY took 30.2s. Estimated remaining: 4h 48m 25s. Rate: 7.8 symbols/min [2025-10-17T17:13:43.027326] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:13:43.048690] [DEBUG] [LOCAL ] AMTB: Loaded 20672 existing records from primary storage. [2025-10-17T17:13:43.048938] [INFO ] [MAIN ] AMTB: Loaded 20672 existing records. [2025-10-17T17:13:43.160546] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-17T17:13:43.174337] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T17:13:43.229400] [INFO ] [REMOTE ] AMR: Full fetch complete (40613 records). [2025-10-17T17:13:43.253919] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:13:43.254128] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-17T17:13:43.254998] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-17T17:13:43.255111] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-17T17:13:43.255514] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-17T17:13:43.297984] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-17T17:13:44.012261] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:13:44.029726] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-17T17:13:44.029550] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-17T17:13:44.031059] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-17T17:13:44.031756] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-17T17:13:44.031844] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-17T17:13:44.060685] [DEBUG] [LOCAL ] AMR: Trimmed 40613 records to 29322 (keeping 200 days of data) [2025-10-17T17:13:44.062397] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T17:13:44.249220] [DEBUG] [LOCAL ] AMR: Primary data saved (29322 records). [2025-10-17T17:13:44.249375] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-17T17:13:44.250766] [INFO ] [MAIN ] Update Progress: 108/2368 symbols completed. AMR took 27.1s. Estimated remaining: 4h 46m 6s. Rate: 7.9 symbols/min [2025-10-17T17:13:44.475722] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:13:44.483280] [DEBUG] [LOCAL ] AMTD: Loaded 3819 existing records from primary storage. [2025-10-17T17:13:44.483545] [INFO ] [MAIN ] AMTD: Loaded 3819 existing records. [2025-10-17T17:13:44.660990] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:13:44.661238] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-17T17:13:44.661287] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-17T17:13:44.661468] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-17T17:13:44.661526] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-17T17:13:44.758399] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-17T17:13:44.968792] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T17:13:45.067683] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:13:45.081211] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T17:13:45.558039] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-17T17:13:46.348559] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T17:13:46.358019] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-17T17:13:46.526886] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-17T17:13:46.979209] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-17T17:13:47.158092] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-17T17:13:47.686169] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-17T17:13:47.958033] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-17T17:13:48.758052] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-17T17:13:48.955429] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-17T17:13:49.343962] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T17:13:49.558008] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-17T17:13:50.358137] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-17T17:13:51.157999] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-17T17:13:51.295403] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-17T17:13:51.478895] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T17:13:51.958047] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-17T17:13:52.758055] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-17T17:13:53.110831] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-17T17:13:53.147182] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T17:13:53.558012] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-17T17:13:53.781607] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T17:13:54.358035] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-17T17:13:55.158011] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-17T17:13:55.250682] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T17:13:55.256791] [INFO ] [REMOTE ] AMRC: Full fetch complete (54386 records). [2025-10-17T17:13:55.256941] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-17T17:13:55.647474] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-17T17:13:55.647584] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-17T17:13:55.648519] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-17T17:13:55.648609] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-17T17:13:55.649978] [DEBUG] [LOCAL ] AMRC: Trimmed 54386 records to 39116 (keeping 200 days of data) [2025-10-17T17:13:55.872817] [DEBUG] [LOCAL ] AMRC: Primary data saved (39116 records). [2025-10-17T17:13:55.872988] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-17T17:13:55.873132] [INFO ] [MAIN ] Update Progress: 109/2368 symbols completed. AMRC took 36.6s. Estimated remaining: 4h 47m 22s. Rate: 7.9 symbols/min [2025-10-17T17:13:55.921933] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T17:13:55.963123] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-17T17:13:56.057480] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:13:56.109392] [DEBUG] [LOCAL ] AMTM: Loaded 50899 existing records from primary storage. [2025-10-17T17:13:56.109768] [INFO ] [MAIN ] AMTM: Loaded 50899 existing records. [2025-10-17T17:13:56.301099] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:13:56.301475] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-17T17:13:56.301635] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-17T17:13:56.301983] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-17T17:13:56.302183] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-17T17:13:56.527775] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-17T17:13:56.721281] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:13:56.732919] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-17T17:13:56.757984] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-17T17:13:57.558088] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-17T17:13:57.836742] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T17:13:57.964429] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-17T17:13:58.358027] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-17T17:13:58.821707] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-17T17:13:59.158031] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-17T17:13:59.958002] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-17T17:14:00.758033] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-17T17:14:01.312604] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-17T17:14:01.558053] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-17T17:14:01.744390] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-17T17:14:02.053033] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-17T17:14:02.358039] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-17T17:14:03.121050] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T17:14:03.158050] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-17T17:14:03.692500] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-17T17:14:03.958096] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-17T17:14:04.758106] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-17T17:14:05.075799] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-17T17:14:05.226216] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T17:14:05.561409] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-17T17:14:05.566733] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T17:14:06.358044] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-17T17:14:06.617878] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-17T17:14:06.621192] [INFO ] [REMOTE ] AMTB: Full fetch complete (29693 records). [2025-10-17T17:14:06.621285] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-17T17:14:06.986015] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-17T17:14:06.986093] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-17T17:14:06.986467] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-17T17:14:06.986532] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-17T17:14:06.987259] [DEBUG] [LOCAL ] AMTB: Trimmed 29693 records to 20848 (keeping 200 days of data) [2025-10-17T17:14:07.108259] [DEBUG] [LOCAL ] AMTB: Primary data saved (20848 records). [2025-10-17T17:14:07.108392] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-17T17:14:07.108488] [INFO ] [MAIN ] Update Progress: 110/2368 symbols completed. AMTB took 24.3s. Estimated remaining: 4h 48m 28s. Rate: 7.8 symbols/min [2025-10-17T17:14:07.170803] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-17T17:14:07.323284] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:14:07.334020] [DEBUG] [LOCAL ] AMWL: Loaded 9671 existing records from primary storage. [2025-10-17T17:14:07.334235] [INFO ] [MAIN ] AMWL: Loaded 9671 existing records. [2025-10-17T17:14:07.516144] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:14:07.516480] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-17T17:14:07.516534] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-17T17:14:07.516770] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-17T17:14:07.516831] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-17T17:14:07.949235] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:14:07.958024] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-17T17:14:08.128614] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T17:14:08.536395] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T17:14:08.758040] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-17T17:14:09.174009] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-17T17:14:09.291994] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-17T17:14:09.558038] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-17T17:14:10.131214] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-17T17:14:10.358042] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-17T17:14:11.022369] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-17T17:14:11.158041] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-17T17:14:11.958064] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-17T17:14:12.698320] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-17T17:14:12.758056] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-17T17:14:13.381636] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-17T17:14:13.558057] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-17T17:14:14.358000] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-17T17:14:14.563337] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T17:14:15.128147] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-17T17:14:15.129347] [INFO ] [REMOTE ] AMTD: Full fetch complete (5528 records). [2025-10-17T17:14:15.129417] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-17T17:14:15.162203] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-17T17:14:15.529755] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-17T17:14:15.529941] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-17T17:14:15.530153] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-17T17:14:15.530302] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-17T17:14:15.531124] [DEBUG] [LOCAL ] AMTD: Trimmed 5528 records to 3828 (keeping 200 days of data) [2025-10-17T17:14:15.553735] [DEBUG] [LOCAL ] AMTD: Primary data saved (3828 records). [2025-10-17T17:14:15.553907] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-17T17:14:15.554017] [INFO ] [MAIN ] Update Progress: 111/2368 symbols completed. AMTD took 31.3s. Estimated remaining: 4h 48m 37s. Rate: 7.8 symbols/min [2025-10-17T17:14:15.750876] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:14:15.753273] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-17T17:14:15.812424] [DEBUG] [LOCAL ] AMX: Loaded 49533 existing records from primary storage. [2025-10-17T17:14:15.812767] [INFO ] [MAIN ] AMX: Loaded 49533 existing records. [2025-10-17T17:14:15.960622] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-17T17:14:15.991490] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:14:15.991879] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-17T17:14:15.991931] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-17T17:14:15.992282] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-17T17:14:15.992337] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-17T17:14:16.290621] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T17:14:16.359580] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:14:16.758104] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-17T17:14:17.511025] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T17:14:17.557995] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-17T17:14:17.813928] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T17:14:18.357995] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-17T17:14:18.396539] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-17T17:14:19.158036] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-17T17:14:19.958002] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-17T17:14:20.064179] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T17:14:20.072356] [INFO ] [REMOTE ] AMT: Full fetch complete (76179 records). [2025-10-17T17:14:20.072527] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-17T17:14:20.504401] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-17T17:14:20.504550] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-17T17:14:20.505670] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-17T17:14:20.505782] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-17T17:14:20.507995] [DEBUG] [LOCAL ] AMT: Trimmed 76179 records to 53232 (keeping 200 days of data) [2025-10-17T17:14:20.760728] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-17T17:14:20.887924] [DEBUG] [LOCAL ] AMT: Primary data saved (53232 records). [2025-10-17T17:14:20.888134] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-17T17:14:20.889192] [INFO ] [MAIN ] Update Progress: 112/2368 symbols completed. AMT took 43.9s. Estimated remaining: 4h 47m 42s. Rate: 7.8 symbols/min [2025-10-17T17:14:21.071307] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:14:21.125226] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T17:14:21.146012] [DEBUG] [LOCAL ] AN: Loaded 31615 existing records from primary storage. [2025-10-17T17:14:21.146247] [INFO ] [MAIN ] AN: Loaded 31615 existing records. [2025-10-17T17:14:21.322354] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:14:21.322680] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-17T17:14:21.322757] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-17T17:14:21.323239] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-17T17:14:21.323298] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-17T17:14:21.434636] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-17T17:14:21.565019] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-17T17:14:21.694194] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:14:21.766245] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T17:14:22.358045] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-17T17:14:23.158056] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-17T17:14:23.185344] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T17:14:23.874554] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T17:14:23.958007] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-17T17:14:24.181525] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T17:14:24.758031] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-17T17:14:25.355312] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T17:14:25.468079] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-17T17:14:25.558000] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-17T17:14:26.358010] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-17T17:14:26.391219] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T17:14:27.158022] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-17T17:14:27.889025] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-17T17:14:27.912536] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T17:14:27.958013] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-17T17:14:28.758017] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-17T17:14:28.794185] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T17:14:29.558031] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-17T17:14:30.343346] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T17:14:30.357981] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-17T17:14:30.632167] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T17:14:30.634925] [INFO ] [REMOTE ] AMWL: Full fetch complete (14639 records). [2025-10-17T17:14:30.634994] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-17T17:14:30.989345] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-17T17:14:30.989424] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-17T17:14:30.989719] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-17T17:14:30.989784] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-17T17:14:30.990352] [DEBUG] [LOCAL ] AMWL: Trimmed 14639 records to 9827 (keeping 200 days of data) [2025-10-17T17:14:31.042614] [DEBUG] [LOCAL ] AMWL: Primary data saved (9827 records). [2025-10-17T17:14:31.042769] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-17T17:14:31.042855] [INFO ] [MAIN ] Update Progress: 113/2368 symbols completed. AMWL took 23.9s. Estimated remaining: 4h 48m 24s. Rate: 7.8 symbols/min [2025-10-17T17:14:31.163140] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-17T17:14:31.217310] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:14:31.270190] [DEBUG] [LOCAL ] ANET: Loaded 54156 existing records from primary storage. [2025-10-17T17:14:31.270510] [INFO ] [MAIN ] ANET: Loaded 54156 existing records. [2025-10-17T17:14:31.445982] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:14:31.446195] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-17T17:14:31.446245] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-17T17:14:31.446621] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-17T17:14:31.446717] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-17T17:14:31.798137] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:14:31.958045] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-17T17:14:32.068937] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T17:14:32.758036] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-17T17:14:33.085729] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-17T17:14:33.558072] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-17T17:14:33.916294] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T17:14:34.358007] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-17T17:14:34.445585] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T17:14:35.158037] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-17T17:14:35.355763] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T17:14:35.958119] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-17T17:14:36.592829] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-17T17:14:36.733984] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T17:14:36.757990] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-17T17:14:37.558013] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-17T17:14:37.754329] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T17:14:38.266162] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T17:14:38.358002] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-17T17:14:39.158042] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-17T17:14:39.739596] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T17:14:39.883358] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-17T17:14:39.958032] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-17T17:14:40.451692] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T17:14:40.758074] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-17T17:14:41.558030] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-17T17:14:42.219239] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-17T17:14:42.358007] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-17T17:14:42.644361] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T17:14:42.651346] [INFO ] [REMOTE ] AMTM: Full fetch complete (73831 records). [2025-10-17T17:14:42.651490] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-17T17:14:42.985014] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T17:14:43.065601] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-17T17:14:43.065706] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-17T17:14:43.066474] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-17T17:14:43.066517] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-17T17:14:43.067992] [DEBUG] [LOCAL ] AMTM: Trimmed 73831 records to 51234 (keeping 200 days of data) [2025-10-17T17:14:43.158730] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-17T17:14:43.362626] [DEBUG] [LOCAL ] AMTM: Primary data saved (51234 records). [2025-10-17T17:14:43.362788] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-17T17:14:43.362870] [INFO ] [MAIN ] Update Progress: 114/2368 symbols completed. AMTM took 47.5s. Estimated remaining: 4h 49m 48s. Rate: 7.8 symbols/min [2025-10-17T17:14:43.530042] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:14:43.578733] [DEBUG] [LOCAL ] ANF: Loaded 52463 existing records from primary storage. [2025-10-17T17:14:43.579058] [INFO ] [MAIN ] ANF: Loaded 52463 existing records. [2025-10-17T17:14:43.754764] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:14:43.754990] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-17T17:14:43.755037] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-17T17:14:43.755510] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-17T17:14:43.755547] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-17T17:14:43.968777] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-17T17:14:44.184606] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:14:44.187221] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T17:14:44.220635] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T17:14:44.758084] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-17T17:14:45.558027] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-17T17:14:46.358021] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-17T17:14:46.534060] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-17T17:14:46.537616] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T17:14:46.580171] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T17:14:47.158050] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-17T17:14:47.958099] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-17T17:14:47.994703] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:14:48.758027] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-17T17:14:49.169818] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-17T17:14:49.456082] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T17:14:49.558035] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-17T17:14:50.358001] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-17T17:14:50.627144] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T17:14:51.158031] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-17T17:14:51.715543] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-17T17:14:51.792889] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T17:14:51.958041] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-17T17:14:52.154231] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T17:14:52.158406] [INFO ] [REMOTE ] AN: Full fetch complete (47085 records). [2025-10-17T17:14:52.158497] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-17T17:14:52.559148] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-17T17:14:52.559239] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-17T17:14:52.559914] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-17T17:14:52.559982] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-17T17:14:52.561242] [DEBUG] [LOCAL ] AN: Trimmed 47085 records to 31816 (keeping 200 days of data) [2025-10-17T17:14:52.758259] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-17T17:14:52.768340] [DEBUG] [LOCAL ] AN: Primary data saved (31816 records). [2025-10-17T17:14:52.768512] [INFO ] [MAIN ] AN: Full history saved. [2025-10-17T17:14:52.768664] [INFO ] [MAIN ] Update Progress: 115/2368 symbols completed. AN took 31.9s. Estimated remaining: 4h 50m 14s. Rate: 7.8 symbols/min [2025-10-17T17:14:52.966507] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:14:52.966709] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-17T17:14:52.966761] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-17T17:14:52.966879] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-17T17:14:52.966924] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-17T17:14:52.966967] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-17T17:14:52.967000] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-17T17:14:53.308731] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:14:53.558047] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-17T17:14:53.751178] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:14:53.751662] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-17T17:14:53.751775] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:14:53.751839] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-17T17:14:53.751904] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:14:53.751978] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-17T17:14:53.752097] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-17T17:14:53.752166] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-17T17:14:53.752242] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-17T17:14:53.752330] [INFO ] [MAIN ] Update Progress: 116/2368 symbols completed. ANGX took 1.0s. Estimated remaining: 4h 47m 55s. Rate: 7.8 symbols/min [2025-10-17T17:14:53.957675] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:14:53.977201] [DEBUG] [LOCAL ] ANRO: Loaded 19575 existing records from primary storage. [2025-10-17T17:14:53.977450] [INFO ] [MAIN ] ANRO: Loaded 19575 existing records. [2025-10-17T17:14:54.156736] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:14:54.157049] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-17T17:14:54.157197] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-17T17:14:54.157628] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-17T17:14:54.157760] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-17T17:14:54.365484] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-17T17:14:54.529352] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-17T17:14:54.579469] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:14:54.607636] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T17:14:55.158035] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-17T17:14:55.958145] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-17T17:14:56.116184] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T17:14:56.758011] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-17T17:14:56.970762] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T17:14:56.977950] [INFO ] [REMOTE ] AMX: Full fetch complete (70987 records). [2025-10-17T17:14:56.978097] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-17T17:14:57.410730] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T17:14:57.409534] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-17T17:14:57.410854] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-17T17:14:57.418494] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-17T17:14:57.418557] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-17T17:14:57.419922] [DEBUG] [LOCAL ] AMX: Trimmed 70987 records to 49908 (keeping 200 days of data) [2025-10-17T17:14:57.590479] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-17T17:14:57.716877] [DEBUG] [LOCAL ] AMX: Primary data saved (49908 records). [2025-10-17T17:14:57.717023] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-17T17:14:57.717898] [INFO ] [MAIN ] Update Progress: 117/2368 symbols completed. AMX took 42.2s. Estimated remaining: 4h 46m 36s. Rate: 7.9 symbols/min [2025-10-17T17:14:58.358137] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-17T17:14:58.466294] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T17:14:58.598732] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T17:14:59.158039] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-17T17:14:59.965753] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-17T17:14:59.967416] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T17:15:00.695312] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-17T17:15:00.758030] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-17T17:15:01.558061] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-17T17:15:02.264627] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-17T17:15:02.330350] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T17:15:02.358027] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-17T17:15:03.158101] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-17T17:15:03.495553] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T17:15:03.958038] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-17T17:15:04.189370] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-17T17:15:04.758116] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-17T17:15:04.886189] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T17:15:05.122270] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T17:15:05.558065] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-17T17:15:06.358040] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-17T17:15:07.065935] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T17:15:07.116481] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-17T17:15:07.123931] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-17T17:15:07.124054] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-17T17:15:07.166312] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-17T17:15:07.507261] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-17T17:15:07.507339] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-17T17:15:07.508119] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-17T17:15:07.508182] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-17T17:15:07.509624] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 54546 (keeping 200 days of data) [2025-10-17T17:15:07.627441] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T17:15:07.854469] [DEBUG] [LOCAL ] ANET: Primary data saved (54546 records). [2025-10-17T17:15:07.854633] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-17T17:15:07.854753] [INFO ] [MAIN ] Update Progress: 118/2368 symbols completed. ANET took 36.8s. Estimated remaining: 4h 47m 16s. Rate: 7.8 symbols/min [2025-10-17T17:15:07.958038] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-17T17:15:08.953437] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-17T17:15:08.958058] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-17T17:15:09.561673] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-17T17:15:09.574091] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-17T17:15:09.913763] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T17:15:10.358092] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-17T17:15:11.383322] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T17:15:11.394509] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-17T17:15:11.419564] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-17T17:15:11.958064] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-17T17:15:12.878949] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:15:12.894046] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-17T17:15:12.968607] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T17:15:12.972820] [INFO ] [REMOTE ] ANRO: Full fetch complete (29839 records). [2025-10-17T17:15:12.972898] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-17T17:15:13.340139] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-17T17:15:13.340215] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-17T17:15:13.340587] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-17T17:15:13.340628] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-17T17:15:13.341373] [DEBUG] [LOCAL ] ANRO: Trimmed 29839 records to 19753 (keeping 200 days of data) [2025-10-17T17:15:13.447535] [DEBUG] [LOCAL ] ANRO: Primary data saved (19753 records). [2025-10-17T17:15:13.447728] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-17T17:15:13.447829] [INFO ] [MAIN ] Update Progress: 119/2368 symbols completed. ANRO took 19.7s. Estimated remaining: 4h 46m 29s. Rate: 7.9 symbols/min [2025-10-17T17:15:14.623119] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T17:15:14.631359] [INFO ] [REMOTE ] ANF: Full fetch complete (75786 records). [2025-10-17T17:15:14.631586] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-17T17:15:15.054380] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-17T17:15:15.054719] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-17T17:15:15.055498] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-17T17:15:15.055544] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-17T17:15:15.057121] [DEBUG] [LOCAL ] ANF: Trimmed 75786 records to 52835 (keeping 200 days of data) [2025-10-17T17:15:15.363184] [DEBUG] [LOCAL ] ANF: Primary data saved (52835 records). [2025-10-17T17:15:15.363321] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-17T17:15:15.363399] [INFO ] [MAIN ] Update Progress: 120/2368 symbols completed. ANF took 32.0s. Estimated remaining: 4h 44m 34s. Rate: 7.9 symbols/min [2025-10-17T17:15:15.975350] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:15:16.014958] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:15:16.048559] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-17T17:15:16.067466] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:15:16.065526] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:15:16.068155] [DEBUG] [LOCAL ] AOMR: No existing data file found in primary storage. [2025-10-17T17:15:16.068066] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-17T17:15:16.068389] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-17T17:15:16.068561] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-17T17:15:16.068232] [WARN ] [MAIN ] AOMR: No existing data found, performing full refresh instead. [2025-10-17T17:15:16.068983] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-17T17:15:16.068810] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-17T17:15:16.069109] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-17T17:15:16.069474] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-17T17:15:16.081098] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-10-17T17:15:16.090555] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-17T17:15:16.268615] [DEBUG] [LOCAL ] ANVS: Loaded 24112 existing records from primary storage. [2025-10-17T17:15:16.305624] [INFO ] [MAIN ] ANVS: Loaded 24112 existing records. [2025-10-17T17:15:16.377232] [DEBUG] [LOCAL ] AOD: Loaded 31036 existing records from primary storage. [2025-10-17T17:15:16.411372] [INFO ] [MAIN ] AOD: Loaded 31036 existing records. [2025-10-17T17:15:16.956869] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:15:17.068718] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-17T17:15:17.068984] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-17T17:15:17.110076] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-17T17:15:17.141794] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-17T17:15:17.197741] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:15:17.182336] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:15:17.225508] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-17T17:15:17.248408] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-17T17:15:17.254501] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-17T17:15:17.318727] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-17T17:15:17.383772] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:15:17.387986] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-17T17:15:17.388466] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-17T17:15:17.607629] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:15:17.686757] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-17T17:15:17.704224] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:15:17.725933] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-17T17:15:17.726045] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:15:17.726220] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-17T17:15:17.726303] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-17T17:15:17.731993] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-17T17:15:17.747580] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-17T17:15:17.755441] [INFO ] [MAIN ] Update Progress: 121/2368 symbols completed. AOMD took 2.4s. Estimated remaining: 4h 42m 50s. Rate: 7.9 symbols/min [2025-10-17T17:15:17.886369] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:15:17.893538] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-17T17:15:18.191262] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:15:18.206430] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-17T17:15:18.226708] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:15:18.267884] [DEBUG] [LOCAL ] AON: Loaded 45501 existing records from primary storage. [2025-10-17T17:15:18.268203] [INFO ] [MAIN ] AON: Loaded 45501 existing records. [2025-10-17T17:15:18.442777] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:15:18.442997] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-17T17:15:18.443063] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-17T17:15:18.443436] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-17T17:15:18.443490] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-17T17:15:18.555878] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T17:15:18.574695] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-17T17:15:18.807741] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:15:18.808139] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-17T17:15:19.295994] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T17:15:19.298892] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-17T17:15:19.373315] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T17:15:19.397622] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-17T17:15:19.399135] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T17:15:19.966372] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-17T17:15:19.967475] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T17:15:20.110950] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T17:15:20.721113] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-17T17:15:20.757995] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-17T17:15:20.869200] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T17:15:21.558018] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-17T17:15:21.971423] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T17:15:22.358046] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-17T17:15:23.163125] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-17T17:15:23.175433] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T17:15:23.590695] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-17T17:15:23.958037] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-17T17:15:24.758048] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-17T17:15:24.894748] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T17:15:24.944530] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T17:15:25.558039] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-17T17:15:26.141500] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T17:15:26.173523] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-17T17:15:26.358033] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-17T17:15:27.158094] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-17T17:15:27.488944] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T17:15:27.957994] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-17T17:15:28.115592] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-17T17:15:28.758006] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-17T17:15:29.064079] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T17:15:29.558030] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-17T17:15:29.712346] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-17T17:15:30.358026] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-17T17:15:30.458958] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T17:15:31.158009] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-17T17:15:31.212234] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-17T17:15:31.958024] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-17T17:15:32.769898] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-17T17:15:32.772685] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T17:15:33.558008] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-17T17:15:33.651773] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T17:15:34.137851] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-17T17:15:34.358066] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-17T17:15:34.763267] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-17T17:15:35.158083] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-17T17:15:35.182772] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T17:15:35.958042] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-17T17:15:36.758013] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-17T17:15:36.964762] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T17:15:37.091911] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T17:15:37.251298] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-17T17:15:37.558022] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-17T17:15:38.358014] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-17T17:15:38.796283] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T17:15:39.158089] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-17T17:15:39.282826] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T17:15:39.958089] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-17T17:15:40.214094] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-17T17:15:40.758101] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-17T17:15:40.957039] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T17:15:41.558041] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-17T17:15:42.243042] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T17:15:42.358052] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-17T17:15:42.500010] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T17:15:42.503469] [INFO ] [REMOTE ] AOMR: Full fetch complete (23243 records). [2025-10-17T17:15:42.503555] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-17T17:15:42.920018] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-17T17:15:42.920122] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-17T17:15:42.920522] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-17T17:15:42.920585] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-17T17:15:42.921330] [DEBUG] [LOCAL ] AOMR: Trimmed 23243 records to 16681 (keeping 200 days of data) [2025-10-17T17:15:43.022594] [DEBUG] [LOCAL ] AOMR: Primary data saved (16681 records). [2025-10-17T17:15:43.022773] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-17T17:15:43.022919] [INFO ] [MAIN ] Update Progress: 122/2368 symbols completed. AOMR took 27.6s. Estimated remaining: 4h 48m 9s. Rate: 7.8 symbols/min [2025-10-17T17:15:43.163202] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-17T17:15:43.214216] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:15:43.245218] [DEBUG] [LOCAL ] AORT: Loaded 29387 existing records from primary storage. [2025-10-17T17:15:43.245490] [INFO ] [MAIN ] AORT: Loaded 29387 existing records. [2025-10-17T17:15:43.450672] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:15:43.451001] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-17T17:15:43.451061] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-17T17:15:43.451237] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-17T17:15:43.451277] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-17T17:15:43.831590] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:15:43.883513] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T17:15:43.958047] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-17T17:15:44.649268] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T17:15:44.758025] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-17T17:15:45.115304] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T17:15:45.558062] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-17T17:15:46.060315] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T17:15:46.064977] [INFO ] [REMOTE ] AOD: Full fetch complete (44503 records). [2025-10-17T17:15:46.065088] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-17T17:15:46.065743] [FATAL] [VALIDATOR ] AOD: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:15:46.065832] [FATAL] [MAIN ] AOD: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:15:46.065875] [WARN ] [MAIN ] AOD: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:15:46.065915] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-17T17:15:46.065975] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-10-17T17:15:46.066011] [INFO ] [LOCAL ] AOD: Starting deletion of derivative data. [2025-10-17T17:15:46.066178] [DEBUG] [LOCAL ] AOD: Deleted derivative data file. [2025-10-17T17:15:46.066272] [INFO ] [MAIN ] Update Progress: 123/2368 symbols completed. AOD took 30.7s. Estimated remaining: 4h 46m 36s. Rate: 7.8 symbols/min [2025-10-17T17:15:46.230928] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:15:46.231119] [DEBUG] [LOCAL ] AOS: No existing data file found in primary storage. [2025-10-17T17:15:46.231157] [WARN ] [MAIN ] AOS: No existing data found, performing full refresh instead. [2025-10-17T17:15:46.231266] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-17T17:15:46.231307] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-17T17:15:46.231351] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-10-17T17:15:46.231383] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-17T17:15:46.370838] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-17T17:15:46.596346] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:15:46.660854] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T17:15:46.665772] [INFO ] [REMOTE ] ANVS: Full fetch complete (36879 records). [2025-10-17T17:15:46.665899] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-17T17:15:47.038253] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-17T17:15:47.038333] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-17T17:15:47.038835] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-17T17:15:47.038897] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-17T17:15:47.039744] [DEBUG] [LOCAL ] ANVS: Trimmed 36879 records to 24303 (keeping 200 days of data) [2025-10-17T17:15:47.159552] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-17T17:15:47.187321] [DEBUG] [LOCAL ] ANVS: Primary data saved (24303 records). [2025-10-17T17:15:47.187418] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-17T17:15:47.187538] [INFO ] [MAIN ] Update Progress: 124/2368 symbols completed. ANVS took 31.8s. Estimated remaining: 4h 44m 30s. Rate: 7.9 symbols/min [2025-10-17T17:15:47.360620] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:15:47.369993] [DEBUG] [LOCAL ] AP: Loaded 7398 existing records from primary storage. [2025-10-17T17:15:47.370157] [INFO ] [MAIN ] AP: Loaded 7398 existing records. [2025-10-17T17:15:47.570510] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:15:47.570730] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-17T17:15:47.570805] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-17T17:15:47.570974] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-17T17:15:47.571040] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-17T17:15:47.939499] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T17:15:47.961852] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:15:47.969832] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-17T17:15:48.659973] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T17:15:48.758039] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-17T17:15:49.335532] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T17:15:49.558086] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-17T17:15:49.929150] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T17:15:50.358036] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-17T17:15:50.938693] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T17:15:51.158026] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-17T17:15:51.506280] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-17T17:15:51.958041] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-17T17:15:52.737330] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T17:15:52.757983] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-17T17:15:52.853415] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T17:15:53.384488] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-17T17:15:53.558033] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-17T17:15:54.129314] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-17T17:15:54.358062] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-17T17:15:55.158067] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-17T17:15:55.766743] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-17T17:15:55.958072] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-17T17:15:56.083558] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T17:15:56.758022] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-17T17:15:57.159877] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-17T17:15:57.558045] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-17T17:15:58.358044] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-17T17:15:59.164828] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-17T17:15:59.184291] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-17T17:15:59.548389] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-17T17:15:59.614107] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T17:15:59.641337] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-17T17:15:59.958002] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-17T17:16:00.639913] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-17T17:16:00.758049] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-17T17:16:01.558023] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-17T17:16:02.340346] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-17T17:16:02.357993] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-17T17:16:02.825893] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-17T17:16:03.158040] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-17T17:16:03.445898] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T17:16:03.958051] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-17T17:16:04.758089] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-17T17:16:05.242231] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-17T17:16:05.557996] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-17T17:16:05.943287] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T17:16:06.365126] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-17T17:16:06.369632] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T17:16:07.158063] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-17T17:16:07.188736] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T17:16:07.194789] [INFO ] [REMOTE ] AON: Full fetch complete (65030 records). [2025-10-17T17:16:07.194927] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-17T17:16:07.581344] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-17T17:16:07.581440] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-17T17:16:07.582199] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-17T17:16:07.582275] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-17T17:16:07.583725] [DEBUG] [LOCAL ] AON: Trimmed 65030 records to 45813 (keeping 200 days of data) [2025-10-17T17:16:07.872247] [DEBUG] [LOCAL ] AON: Primary data saved (45813 records). [2025-10-17T17:16:07.872534] [INFO ] [MAIN ] AON: Full history saved. [2025-10-17T17:16:07.872723] [INFO ] [MAIN ] Update Progress: 125/2368 symbols completed. AON took 50.0s. Estimated remaining: 4h 48m 17s. Rate: 7.8 symbols/min [2025-10-17T17:16:07.965106] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-17T17:16:08.047476] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:16:08.047942] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-10-17T17:16:08.048007] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-10-17T17:16:08.048246] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-17T17:16:08.048308] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-17T17:16:08.048363] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-17T17:16:08.048470] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-17T17:16:08.214675] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T17:16:08.469023] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:16:08.485848] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T17:16:08.492321] [INFO ] [REMOTE ] AORT: Full fetch complete (42328 records). [2025-10-17T17:16:08.492535] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-17T17:16:08.746304] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T17:16:08.763153] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-17T17:16:08.946511] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-17T17:16:08.946595] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-17T17:16:08.947126] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-17T17:16:08.947189] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-17T17:16:08.948363] [DEBUG] [LOCAL ] AORT: Trimmed 42328 records to 29531 (keeping 200 days of data) [2025-10-17T17:16:09.117406] [DEBUG] [LOCAL ] AORT: Primary data saved (29531 records). [2025-10-17T17:16:09.117568] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-17T17:16:09.117679] [INFO ] [MAIN ] Update Progress: 126/2368 symbols completed. AORT took 26.1s. Estimated remaining: 4h 46m 14s. Rate: 7.8 symbols/min [2025-10-17T17:16:09.294064] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:16:09.345911] [DEBUG] [LOCAL ] APD: Loaded 45857 existing records from primary storage. [2025-10-17T17:16:09.346235] [INFO ] [MAIN ] APD: Loaded 45857 existing records. [2025-10-17T17:16:09.538496] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:16:09.538729] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-17T17:16:09.538783] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-17T17:16:09.539133] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-17T17:16:09.539172] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-17T17:16:09.568851] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-17T17:16:09.907098] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:16:10.358086] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-17T17:16:10.612226] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T17:16:10.920954] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-17T17:16:11.152039] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T17:16:11.158546] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-17T17:16:11.958077] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-17T17:16:12.503986] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T17:16:12.758087] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-17T17:16:13.558053] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-17T17:16:13.628485] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T17:16:14.196110] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T17:16:14.358060] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-17T17:16:15.118483] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T17:16:15.158009] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-17T17:16:15.283777] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T17:16:15.958013] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-17T17:16:16.606600] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T17:16:16.758030] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-17T17:16:17.558051] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-17T17:16:17.776297] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-17T17:16:18.042888] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-17T17:16:18.259688] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T17:16:18.358048] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-17T17:16:19.158078] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-17T17:16:19.694249] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T17:16:19.958049] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-17T17:16:20.758007] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-17T17:16:20.937054] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:16:21.340891] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T17:16:21.347564] [INFO ] [REMOTE ] AOS: Full fetch complete (70995 records). [2025-10-17T17:16:21.347735] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-17T17:16:21.563222] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-17T17:16:21.787038] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-17T17:16:21.787126] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-17T17:16:21.787908] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-17T17:16:21.787973] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-17T17:16:21.789413] [DEBUG] [LOCAL ] AOS: Trimmed 70995 records to 49475 (keeping 200 days of data) [2025-10-17T17:16:22.132713] [DEBUG] [LOCAL ] AOS: Primary data saved (49475 records). [2025-10-17T17:16:22.132878] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-17T17:16:22.132963] [INFO ] [MAIN ] Update Progress: 127/2368 symbols completed. AOS took 36.1s. Estimated remaining: 4h 47m 41s. Rate: 7.8 symbols/min [2025-10-17T17:16:22.259553] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-17T17:16:22.317229] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:16:22.365872] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-17T17:16:22.369430] [DEBUG] [LOCAL ] APG: Loaded 50964 existing records from primary storage. [2025-10-17T17:16:22.369869] [INFO ] [MAIN ] APG: Loaded 50964 existing records. [2025-10-17T17:16:22.552468] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:16:22.552784] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-17T17:16:22.552920] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-17T17:16:22.553207] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-17T17:16:22.553298] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-17T17:16:22.914035] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:16:22.938017] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-17T17:16:23.158092] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-17T17:16:23.811288] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T17:16:23.958026] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-17T17:16:24.611846] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T17:16:24.758023] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-17T17:16:24.848125] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T17:16:24.849488] [INFO ] [REMOTE ] AP: Full fetch complete (9035 records). [2025-10-17T17:16:24.849565] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-17T17:16:24.850152] [FATAL] [VALIDATOR ] AP: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:16:24.850242] [FATAL] [MAIN ] AP: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:16:24.850284] [WARN ] [MAIN ] AP: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:16:24.850359] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-17T17:16:24.850425] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-10-17T17:16:24.850460] [INFO ] [LOCAL ] AP: Starting deletion of derivative data. [2025-10-17T17:16:24.850580] [DEBUG] [LOCAL ] AP: Deleted derivative data file. [2025-10-17T17:16:24.850688] [INFO ] [MAIN ] Update Progress: 128/2368 symbols completed. AP took 37.7s. Estimated remaining: 4h 46m 6s. Rate: 7.8 symbols/min [2025-10-17T17:16:25.015441] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:16:25.015622] [DEBUG] [LOCAL ] APH: No existing data file found in primary storage. [2025-10-17T17:16:25.015716] [WARN ] [MAIN ] APH: No existing data found, performing full refresh instead. [2025-10-17T17:16:25.015871] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-17T17:16:25.015937] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-17T17:16:25.015993] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-10-17T17:16:25.016036] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-17T17:16:25.369985] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:16:25.558023] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-17T17:16:26.358052] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-17T17:16:26.698272] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T17:16:26.769872] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-17T17:16:27.158096] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-17T17:16:27.730073] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T17:16:27.958054] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-17T17:16:28.758020] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-17T17:16:29.016987] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T17:16:29.558012] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-17T17:16:29.665363] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T17:16:30.255289] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T17:16:30.358024] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-17T17:16:31.158044] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-17T17:16:31.243414] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T17:16:31.959925] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-17T17:16:31.965552] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T17:16:32.582996] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T17:16:32.758047] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-17T17:16:33.558013] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-17T17:16:34.087680] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-17T17:16:34.226118] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-17T17:16:34.358033] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-17T17:16:34.903550] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-17T17:16:35.158040] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-17T17:16:35.751225] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T17:16:35.758480] [INFO ] [REMOTE ] APAM: Full fetch complete (52144 records). [2025-10-17T17:16:35.758726] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-17T17:16:35.964196] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-17T17:16:36.155952] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-17T17:16:36.156053] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-17T17:16:36.156631] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-17T17:16:36.156712] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-17T17:16:36.157775] [DEBUG] [LOCAL ] APAM: Trimmed 52144 records to 36578 (keeping 200 days of data) [2025-10-17T17:16:36.371024] [DEBUG] [LOCAL ] APAM: Primary data saved (36578 records). [2025-10-17T17:16:36.371162] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-17T17:16:36.371276] [INFO ] [MAIN ] Update Progress: 129/2368 symbols completed. APAM took 28.5s. Estimated remaining: 4h 47m 6s. Rate: 7.8 symbols/min [2025-10-17T17:16:36.539010] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:16:36.590725] [DEBUG] [LOCAL ] APLE: Loaded 52352 existing records from primary storage. [2025-10-17T17:16:36.591027] [INFO ] [MAIN ] APLE: Loaded 52352 existing records. [2025-10-17T17:16:36.760593] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-17T17:16:36.765378] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:16:36.766565] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-17T17:16:36.766687] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-17T17:16:36.767264] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-17T17:16:36.767324] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-17T17:16:37.123117] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:16:37.150423] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-17T17:16:37.558054] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-17T17:16:38.193665] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-17T17:16:38.324505] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T17:16:38.358043] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-17T17:16:39.036062] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T17:16:39.158070] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-17T17:16:39.958068] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-17T17:16:40.195000] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-17T17:16:40.758131] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-17T17:16:41.144831] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T17:16:41.558025] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-17T17:16:41.873172] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T17:16:42.358011] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-17T17:16:43.081464] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-17T17:16:43.157982] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-17T17:16:43.491573] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-17T17:16:43.958104] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-17T17:16:44.376478] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-17T17:16:44.758074] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-17T17:16:45.339604] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-17T17:16:45.552165] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T17:16:45.563517] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-17T17:16:46.358065] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-17T17:16:46.517680] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T17:16:47.158054] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-17T17:16:47.465084] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-17T17:16:47.568572] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-17T17:16:47.958051] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-17T17:16:48.752070] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T17:16:48.763136] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-17T17:16:49.371964] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T17:16:49.378416] [INFO ] [REMOTE ] APD: Full fetch complete (67350 records). [2025-10-17T17:16:49.378530] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-17T17:16:49.565925] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-17T17:16:49.781909] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-17T17:16:49.782028] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-17T17:16:49.782970] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-17T17:16:49.783041] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-17T17:16:49.784918] [DEBUG] [LOCAL ] APD: Trimmed 67350 records to 46187 (keeping 200 days of data) [2025-10-17T17:16:50.102630] [DEBUG] [LOCAL ] APD: Primary data saved (46187 records). [2025-10-17T17:16:50.102858] [INFO ] [MAIN ] APD: Full history saved. [2025-10-17T17:16:50.104856] [INFO ] [MAIN ] Update Progress: 130/2368 symbols completed. APD took 41.0s. Estimated remaining: 4h 48m 42s. Rate: 7.8 symbols/min [2025-10-17T17:16:50.292551] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:16:50.362688] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-17T17:16:50.374432] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T17:16:50.409036] [DEBUG] [LOCAL ] APO: Loaded 53779 existing records from primary storage. [2025-10-17T17:16:50.409518] [INFO ] [MAIN ] APO: Loaded 53779 existing records. [2025-10-17T17:16:50.596400] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:16:50.596792] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-17T17:16:50.596855] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-17T17:16:50.597451] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-17T17:16:50.597541] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-17T17:16:50.970834] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:16:51.158058] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-17T17:16:51.496844] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T17:16:51.733716] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T17:16:51.958055] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-17T17:16:52.758009] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-17T17:16:53.558017] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-17T17:16:53.627568] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-17T17:16:53.885499] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T17:16:54.358069] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-17T17:16:54.496328] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T17:16:54.503546] [INFO ] [REMOTE ] APG: Full fetch complete (72204 records). [2025-10-17T17:16:54.503732] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-17T17:16:54.887033] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-17T17:16:54.887120] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-17T17:16:54.887871] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-17T17:16:54.887938] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-17T17:16:54.889348] [DEBUG] [LOCAL ] APG: Trimmed 72204 records to 51343 (keeping 200 days of data) [2025-10-17T17:16:55.169686] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-17T17:16:55.189179] [DEBUG] [LOCAL ] APG: Primary data saved (51343 records). [2025-10-17T17:16:55.189320] [INFO ] [MAIN ] APG: Full history saved. [2025-10-17T17:16:55.189401] [INFO ] [MAIN ] Update Progress: 131/2368 symbols completed. APG took 33.1s. Estimated remaining: 4h 47m 49s. Rate: 7.8 symbols/min [2025-10-17T17:16:55.358930] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:16:55.368328] [DEBUG] [LOCAL ] APOS: Loaded 7359 existing records from primary storage. [2025-10-17T17:16:55.368570] [INFO ] [MAIN ] APOS: Loaded 7359 existing records. [2025-10-17T17:16:55.546279] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:16:55.546605] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-17T17:16:55.546689] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-17T17:16:55.546925] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-17T17:16:55.546992] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-17T17:16:55.850071] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-17T17:16:55.955381] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:16:55.967349] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-17T17:16:55.988639] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T17:16:56.758035] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-17T17:16:57.027118] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T17:16:57.032995] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T17:16:57.558034] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-17T17:16:58.220992] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-17T17:16:58.319570] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T17:16:58.358015] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-17T17:16:59.158032] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-17T17:16:59.958081] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-17T17:17:00.267013] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-17T17:17:00.758124] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-17T17:17:01.558146] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-17T17:17:01.913812] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T17:17:01.949019] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-17T17:17:01.952818] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-17T17:17:02.358086] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-17T17:17:03.073872] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-17T17:17:03.093731] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-17T17:17:03.158069] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-17T17:17:03.721306] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T17:17:03.958042] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-17T17:17:04.758071] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-17T17:17:05.558038] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-17T17:17:06.214937] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-17T17:17:06.262341] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-17T17:17:06.357998] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-17T17:17:06.824812] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-17T17:17:07.158064] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-17T17:17:07.958012] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-17T17:17:08.003690] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T17:17:08.758059] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-17T17:17:08.794473] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T17:17:09.335012] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-17T17:17:09.343235] [INFO ] [REMOTE ] APLE: Full fetch complete (74734 records). [2025-10-17T17:17:09.343472] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-17T17:17:09.563614] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-17T17:17:09.766466] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-17T17:17:09.766619] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-17T17:17:09.767581] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-17T17:17:09.767672] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-17T17:17:09.769728] [DEBUG] [LOCAL ] APLE: Trimmed 74734 records to 52733 (keeping 200 days of data) [2025-10-17T17:17:10.109078] [DEBUG] [LOCAL ] APLE: Primary data saved (52733 records). [2025-10-17T17:17:10.109288] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-17T17:17:10.109395] [INFO ] [MAIN ] Update Progress: 132/2368 symbols completed. APLE took 33.7s. Estimated remaining: 4h 49m 43s. Rate: 7.7 symbols/min [2025-10-17T17:17:10.342203] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:17:10.343715] [DEBUG] [LOCAL ] APTV: No existing data file found in primary storage. [2025-10-17T17:17:10.343774] [WARN ] [MAIN ] APTV: No existing data found, performing full refresh instead. [2025-10-17T17:17:10.343952] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-17T17:17:10.344037] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-17T17:17:10.344109] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-17T17:17:10.344146] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-17T17:17:10.377971] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-17T17:17:10.728290] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:17:10.902997] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-17T17:17:11.158009] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-17T17:17:11.348528] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-17T17:17:11.695998] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-17T17:17:11.699130] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-17T17:17:11.958028] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-17T17:17:12.480820] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-17T17:17:12.758050] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-17T17:17:13.558042] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-17T17:17:14.358067] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-17T17:17:15.035008] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T17:17:15.037408] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-17T17:17:15.039091] [INFO ] [REMOTE ] APOS: Full fetch complete (10232 records). [2025-10-17T17:17:15.039266] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-17T17:17:15.047044] [FATAL] [VALIDATOR ] APOS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:17:15.047985] [FATAL] [MAIN ] APOS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:17:15.048125] [WARN ] [MAIN ] APOS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:17:15.048203] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-17T17:17:15.048284] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-17T17:17:15.048324] [INFO ] [LOCAL ] APOS: Starting deletion of derivative data. [2025-10-17T17:17:15.048574] [DEBUG] [LOCAL ] APOS: Deleted derivative data file. [2025-10-17T17:17:15.048780] [INFO ] [MAIN ] Update Progress: 133/2368 symbols completed. APOS took 19.9s. Estimated remaining: 4h 48m 48s. Rate: 7.7 symbols/min [2025-10-17T17:17:15.048504] [INFO ] [REMOTE ] APH: Full fetch complete (77869 records). [2025-10-17T17:17:15.069871] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-17T17:17:15.162768] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-17T17:17:15.396502] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:17:15.658365] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-17T17:17:15.658480] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-17T17:17:15.659377] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-17T17:17:15.659719] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-17T17:17:15.685874] [DEBUG] [LOCAL ] APH: Trimmed 77869 records to 54471 (keeping 200 days of data) [2025-10-17T17:17:15.785383] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-17T17:17:15.796098] [DEBUG] [LOCAL ] AQN: Loaded 52131 existing records from primary storage. [2025-10-17T17:17:15.835614] [INFO ] [MAIN ] AQN: Loaded 52131 existing records. [2025-10-17T17:17:15.959743] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-17T17:17:16.041914] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:17:16.044633] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-17T17:17:16.046461] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-17T17:17:16.050105] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-17T17:17:16.051890] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-17T17:17:16.501741] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:17:16.660987] [DEBUG] [LOCAL ] APH: Primary data saved (54471 records). [2025-10-17T17:17:16.661131] [INFO ] [MAIN ] APH: Full history saved. [2025-10-17T17:17:16.663730] [INFO ] [MAIN ] Update Progress: 134/2368 symbols completed. APH took 51.8s. Estimated remaining: 4h 46m 58s. Rate: 7.8 symbols/min [2025-10-17T17:17:16.762099] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-17T17:17:16.834666] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:17:16.842750] [DEBUG] [LOCAL ] AQNB: Loaded 4077 existing records from primary storage. [2025-10-17T17:17:16.842987] [INFO ] [MAIN ] AQNB: Loaded 4077 existing records. [2025-10-17T17:17:17.021978] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:17:17.022298] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-17T17:17:17.022404] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-17T17:17:17.022799] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-17T17:17:17.022957] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-17T17:17:17.357848] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-17T17:17:17.426873] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:17:17.515014] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T17:17:17.557993] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-17T17:17:18.369331] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-17T17:17:18.375980] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T17:17:18.406666] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T17:17:19.158127] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-17T17:17:19.958073] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-17T17:17:20.513672] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-17T17:17:20.758095] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-17T17:17:21.250437] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T17:17:21.299594] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T17:17:21.347800] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-17T17:17:21.558026] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-17T17:17:22.358130] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-17T17:17:23.034162] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T17:17:23.158081] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-17T17:17:23.604400] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-17T17:17:23.960421] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-17T17:17:23.968302] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T17:17:24.758061] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-17T17:17:25.358035] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-17T17:17:25.558043] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-17T17:17:25.897440] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T17:17:25.904533] [INFO ] [REMOTE ] APO: Full fetch complete (77076 records). [2025-10-17T17:17:25.904699] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-17T17:17:25.905505] [FATAL] [VALIDATOR ] APO: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:17:25.905596] [FATAL] [MAIN ] APO: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:17:25.905673] [WARN ] [MAIN ] APO: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:17:25.905739] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-17T17:17:25.905819] [DEBUG] [LOCAL ] APO: No primary data file found to delete. [2025-10-17T17:17:25.905907] [INFO ] [LOCAL ] APO: Starting deletion of derivative data. [2025-10-17T17:17:25.906213] [DEBUG] [LOCAL ] APO: Deleted derivative data file. [2025-10-17T17:17:25.907339] [INFO ] [MAIN ] Update Progress: 135/2368 symbols completed. APO took 35.8s. Estimated remaining: 4h 47m 15s. Rate: 7.8 symbols/min [2025-10-17T17:17:26.076743] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:17:26.133726] [DEBUG] [LOCAL ] AR: Loaded 53977 existing records from primary storage. [2025-10-17T17:17:26.134277] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T17:17:26.136567] [INFO ] [MAIN ] AR: Loaded 53977 existing records. [2025-10-17T17:17:26.310668] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:17:26.310870] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-17T17:17:26.310925] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-17T17:17:26.311297] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-17T17:17:26.311353] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-17T17:17:26.364495] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-17T17:17:26.667109] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:17:26.973128] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-17T17:17:27.158027] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-17T17:17:27.958068] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-17T17:17:28.643782] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-17T17:17:28.758036] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-17T17:17:29.177741] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-17T17:17:29.245789] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-17T17:17:29.558050] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-17T17:17:30.358127] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-17T17:17:30.764710] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-17T17:17:31.158084] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-17T17:17:31.728853] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T17:17:31.817232] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-17T17:17:31.958086] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-17T17:17:32.541781] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-17T17:17:32.542776] [INFO ] [REMOTE ] AQNB: Full fetch complete (5438 records). [2025-10-17T17:17:32.542845] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-17T17:17:32.763230] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-17T17:17:32.904623] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-17T17:17:32.904759] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-17T17:17:32.905012] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-17T17:17:32.905067] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-17T17:17:32.905433] [DEBUG] [LOCAL ] AQNB: Trimmed 5438 records to 4088 (keeping 200 days of data) [2025-10-17T17:17:32.929858] [DEBUG] [LOCAL ] AQNB: Primary data saved (4088 records). [2025-10-17T17:17:32.929942] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-17T17:17:32.930036] [INFO ] [MAIN ] Update Progress: 136/2368 symbols completed. AQNB took 16.3s. Estimated remaining: 4h 46m 56s. Rate: 7.8 symbols/min [2025-10-17T17:17:33.097158] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:17:33.097368] [DEBUG] [LOCAL ] ARCO: No existing data file found in primary storage. [2025-10-17T17:17:33.097408] [WARN ] [MAIN ] ARCO: No existing data found, performing full refresh instead. [2025-10-17T17:17:33.097554] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-17T17:17:33.097603] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-17T17:17:33.097668] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-17T17:17:33.097724] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-17T17:17:33.445705] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:17:33.558020] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-17T17:17:34.358020] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-17T17:17:34.672431] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T17:17:34.830454] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T17:17:35.158103] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-17T17:17:35.958006] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-17T17:17:36.051139] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T17:17:36.758008] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-17T17:17:36.975144] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T17:17:37.547103] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T17:17:37.564516] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-17T17:17:38.246888] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T17:17:38.358078] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-17T17:17:39.158032] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-17T17:17:39.712137] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-17T17:17:39.958073] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-17T17:17:40.244938] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-17T17:17:40.649436] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T17:17:40.758041] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-17T17:17:41.558031] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-17T17:17:42.358042] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-17T17:17:42.668058] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-10-17T17:17:43.158079] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-17T17:17:43.675056] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-10-17T17:17:43.958080] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-17T17:17:44.074867] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-17T17:17:44.538811] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T17:17:44.758177] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-17T17:17:45.118388] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-10-17T17:17:45.557998] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-17T17:17:45.752153] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T17:17:46.358061] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-17T17:17:46.400175] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:17:47.158001] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-17T17:17:47.205551] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T17:17:47.958053] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-17T17:17:48.126734] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T17:17:48.745923] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T17:17:48.758154] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-17T17:17:49.558081] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-17T17:17:49.728486] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T17:17:50.358071] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-17T17:17:50.458572] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T17:17:51.158056] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-17T17:17:51.384090] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T17:17:51.958039] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-17T17:17:52.600034] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-17T17:17:52.736250] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T17:17:52.757994] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-17T17:17:53.558011] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-17T17:17:53.760072] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T17:17:53.768778] [INFO ] [REMOTE ] APTV: Full fetch complete (75924 records). [2025-10-17T17:17:53.768987] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-17T17:17:54.179309] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-17T17:17:54.179404] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-17T17:17:54.180159] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-17T17:17:54.180234] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-17T17:17:54.181996] [DEBUG] [LOCAL ] APTV: Trimmed 75924 records to 52719 (keeping 200 days of data) [2025-10-17T17:17:54.361732] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-17T17:17:54.419668] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T17:17:54.543920] [DEBUG] [LOCAL ] APTV: Primary data saved (52719 records). [2025-10-17T17:17:54.544056] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-17T17:17:54.544129] [INFO ] [MAIN ] Update Progress: 137/2368 symbols completed. APTV took 44.4s. Estimated remaining: 4h 50m 35s. Rate: 7.7 symbols/min [2025-10-17T17:17:54.716830] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:17:54.734730] [DEBUG] [LOCAL ] ARDC: Loaded 15429 existing records from primary storage. [2025-10-17T17:17:54.734973] [INFO ] [MAIN ] ARDC: Loaded 15429 existing records. [2025-10-17T17:17:54.912675] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:17:54.912909] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-17T17:17:54.912985] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-17T17:17:54.913197] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-17T17:17:54.913275] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-17T17:17:55.166851] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-17T17:17:55.286774] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:17:55.332981] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T17:17:55.339790] [INFO ] [REMOTE ] AQN: Full fetch complete (75000 records). [2025-10-17T17:17:55.339924] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-17T17:17:55.340767] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:17:55.340859] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:17:55.340904] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:17:55.340974] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-17T17:17:55.341043] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-17T17:17:55.341085] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-10-17T17:17:55.341211] [DEBUG] [LOCAL ] AQN: Deleted derivative data file. [2025-10-17T17:17:55.341307] [INFO ] [MAIN ] Update Progress: 138/2368 symbols completed. AQN took 40.3s. Estimated remaining: 4h 48m 34s. Rate: 7.7 symbols/min [2025-10-17T17:17:55.511860] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:17:55.539434] [DEBUG] [LOCAL ] ARDT: Loaded 27912 existing records from primary storage. [2025-10-17T17:17:55.539791] [INFO ] [MAIN ] ARDT: Loaded 27912 existing records. [2025-10-17T17:17:55.722358] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:17:55.722569] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-17T17:17:55.722629] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-17T17:17:55.722853] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-17T17:17:55.722899] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-17T17:17:55.967825] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-17T17:17:56.086476] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:17:56.275180] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T17:17:56.758042] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-17T17:17:56.877109] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T17:17:56.893538] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T17:17:57.558070] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-17T17:17:57.916614] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T17:17:58.345586] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T17:17:58.357979] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-17T17:17:59.158033] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-17T17:17:59.221311] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T17:17:59.958049] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-17T17:18:00.758047] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-17T17:18:01.264729] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-17T17:18:01.447210] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T17:18:01.558065] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-17T17:18:02.358092] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-17T17:18:02.553870] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T17:18:02.560077] [INFO ] [REMOTE ] ARCO: Full fetch complete (65151 records). [2025-10-17T17:18:02.560226] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-17T17:18:02.943309] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-17T17:18:02.943409] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-17T17:18:02.944084] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-17T17:18:02.944268] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-17T17:18:02.954258] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T17:18:02.958168] [DEBUG] [LOCAL ] ARCO: Trimmed 65151 records to 45143 (keeping 200 days of data) [2025-10-17T17:18:03.160729] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-17T17:18:03.226336] [DEBUG] [LOCAL ] ARCO: Primary data saved (45143 records). [2025-10-17T17:18:03.226510] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-17T17:18:03.226628] [INFO ] [MAIN ] Update Progress: 139/2368 symbols completed. ARCO took 30.3s. Estimated remaining: 4h 48m 28s. Rate: 7.7 symbols/min [2025-10-17T17:18:03.392966] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:18:03.440251] [DEBUG] [LOCAL ] ARE: Loaded 51360 existing records from primary storage. [2025-10-17T17:18:03.440580] [INFO ] [MAIN ] ARE: Loaded 51360 existing records. [2025-10-17T17:18:03.614254] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:18:03.614513] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-17T17:18:03.614579] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-17T17:18:03.615020] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-17T17:18:03.615077] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-17T17:18:03.968449] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-17T17:18:03.974603] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:18:04.010210] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T17:18:04.576071] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T17:18:04.751440] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-17T17:18:04.757989] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-17T17:18:05.558036] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-17T17:18:06.361382] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-17T17:18:06.364918] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T17:18:06.468480] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T17:18:07.158037] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-17T17:18:07.331195] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T17:18:07.958010] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-17T17:18:08.070469] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-17T17:18:08.758100] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-17T17:18:09.557999] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-17T17:18:09.688534] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T17:18:10.357998] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-17T17:18:10.635027] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T17:18:10.967699] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-17T17:18:11.217954] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-17T17:18:11.230800] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T17:18:11.958056] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-17T17:18:12.758008] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-17T17:18:12.833994] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T17:18:13.558001] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-17T17:18:13.796421] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T17:18:14.015849] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-17T17:18:14.358047] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-17T17:18:15.158045] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-17T17:18:15.379419] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T17:18:15.958026] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-17T17:18:16.073561] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T17:18:16.108431] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T17:18:16.758037] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-17T17:18:17.558011] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-17T17:18:17.820399] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T17:18:18.090720] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-17T17:18:18.358062] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-17T17:18:19.107687] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T17:18:19.158036] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-17T17:18:19.772691] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-17T17:18:19.781436] [INFO ] [REMOTE ] AR: Full fetch complete (77737 records). [2025-10-17T17:18:19.781745] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-17T17:18:19.965733] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-17T17:18:20.186256] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-17T17:18:20.186353] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-17T17:18:20.187183] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-17T17:18:20.187250] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-17T17:18:20.189236] [DEBUG] [LOCAL ] AR: Trimmed 77737 records to 54366 (keeping 200 days of data) [2025-10-17T17:18:20.502580] [DEBUG] [LOCAL ] AR: Primary data saved (54366 records). [2025-10-17T17:18:20.502751] [INFO ] [MAIN ] AR: Full history saved. [2025-10-17T17:18:20.504137] [INFO ] [MAIN ] Update Progress: 140/2368 symbols completed. AR took 54.6s. Estimated remaining: 4h 50m 51s. Rate: 7.7 symbols/min [2025-10-17T17:18:20.676475] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:18:20.676764] [DEBUG] [LOCAL ] ARES: No existing data file found in primary storage. [2025-10-17T17:18:20.676811] [WARN ] [MAIN ] ARES: No existing data found, performing full refresh instead. [2025-10-17T17:18:20.676888] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-17T17:18:20.676924] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-17T17:18:20.676963] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-17T17:18:20.676994] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-17T17:18:20.770234] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-17T17:18:21.047850] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:18:21.329563] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-17T17:18:21.368598] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T17:18:21.558036] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-17T17:18:21.781105] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T17:18:22.358117] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-17T17:18:23.158019] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-17T17:18:23.772710] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-17T17:18:23.958077] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-17T17:18:24.057299] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T17:18:24.201229] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T17:18:24.205082] [INFO ] [REMOTE ] ARDC: Full fetch complete (21383 records). [2025-10-17T17:18:24.205179] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-17T17:18:24.205943] [FATAL] [VALIDATOR ] ARDC: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:18:24.206090] [FATAL] [MAIN ] ARDC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:18:24.206146] [WARN ] [MAIN ] ARDC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:18:24.206222] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-17T17:18:24.206297] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-10-17T17:18:24.206337] [INFO ] [LOCAL ] ARDC: Starting deletion of derivative data. [2025-10-17T17:18:24.206499] [DEBUG] [LOCAL ] ARDC: Deleted derivative data file. [2025-10-17T17:18:24.206596] [INFO ] [MAIN ] Update Progress: 141/2368 symbols completed. ARDC took 29.7s. Estimated remaining: 4h 49m 38s. Rate: 7.7 symbols/min [2025-10-17T17:18:24.380443] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:18:24.425840] [DEBUG] [LOCAL ] ARI: Loaded 44048 existing records from primary storage. [2025-10-17T17:18:24.426247] [INFO ] [MAIN ] ARI: Loaded 44048 existing records. [2025-10-17T17:18:24.623438] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:18:24.623724] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-17T17:18:24.623784] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-17T17:18:24.623983] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-17T17:18:24.624024] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-17T17:18:24.766158] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-17T17:18:24.990410] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:18:25.061123] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T17:18:25.558022] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-17T17:18:26.180230] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T17:18:26.358046] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-17T17:18:26.967629] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T17:18:26.972203] [INFO ] [REMOTE ] ARDT: Full fetch complete (41612 records). [2025-10-17T17:18:26.972294] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-17T17:18:27.164270] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-17T17:18:27.379662] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-17T17:18:27.379774] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-17T17:18:27.380306] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-17T17:18:27.380352] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-17T17:18:27.381373] [DEBUG] [LOCAL ] ARDT: Trimmed 41612 records to 28112 (keeping 200 days of data) [2025-10-17T17:18:27.552800] [DEBUG] [LOCAL ] ARDT: Primary data saved (28112 records). [2025-10-17T17:18:27.552969] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-17T17:18:27.553086] [INFO ] [MAIN ] Update Progress: 142/2368 symbols completed. ARDT took 32.2s. Estimated remaining: 4h 48m 21s. Rate: 7.7 symbols/min [2025-10-17T17:18:27.724537] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:18:27.724766] [DEBUG] [LOCAL ] ARLO: No existing data file found in primary storage. [2025-10-17T17:18:27.724812] [WARN ] [MAIN ] ARLO: No existing data found, performing full refresh instead. [2025-10-17T17:18:27.724927] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-17T17:18:27.724969] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-17T17:18:27.725030] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-17T17:18:27.725065] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-17T17:18:27.963266] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-17T17:18:28.083201] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:18:28.110526] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T17:18:28.664520] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T17:18:28.758062] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-17T17:18:29.558013] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-17T17:18:29.832571] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-17T17:18:30.357996] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-17T17:18:30.599855] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T17:18:30.973407] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T17:18:31.158015] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-17T17:18:31.958008] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-17T17:18:32.556910] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-17T17:18:32.716758] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T17:18:32.757989] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-17T17:18:33.558024] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-17T17:18:33.897343] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-17T17:18:34.357999] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-17T17:18:34.533944] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:18:34.904172] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T17:18:35.158025] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-17T17:18:35.629581] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T17:18:35.958032] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-17T17:18:36.745224] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T17:18:36.758046] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-17T17:18:37.558017] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-17T17:18:37.716088] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T17:18:38.358094] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-17T17:18:38.502555] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T17:18:39.158043] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-17T17:18:39.378775] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T17:18:39.385814] [INFO ] [REMOTE ] ARE: Full fetch complete (72629 records). [2025-10-17T17:18:39.385976] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-17T17:18:39.386912] [FATAL] [VALIDATOR ] ARE: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:18:39.387017] [FATAL] [MAIN ] ARE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:18:39.387062] [WARN ] [MAIN ] ARE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:18:39.387130] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-17T17:18:39.387254] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-17T17:18:39.387321] [INFO ] [LOCAL ] ARE: Starting deletion of derivative data. [2025-10-17T17:18:39.387554] [DEBUG] [LOCAL ] ARE: Deleted derivative data file. [2025-10-17T17:18:39.389010] [INFO ] [MAIN ] Update Progress: 143/2368 symbols completed. ARE took 36.2s. Estimated remaining: 4h 49m 16s. Rate: 7.7 symbols/min [2025-10-17T17:18:39.562777] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:18:39.620028] [DEBUG] [LOCAL ] ARMK: Loaded 50753 existing records from primary storage. [2025-10-17T17:18:39.620438] [INFO ] [MAIN ] ARMK: Loaded 50753 existing records. [2025-10-17T17:18:39.804941] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:18:39.805423] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-17T17:18:39.805575] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-17T17:18:39.806044] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-17T17:18:39.806109] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-17T17:18:39.983679] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T17:18:39.980462] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-17T17:18:40.228898] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:18:40.671282] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T17:18:40.758036] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-17T17:18:41.558030] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-17T17:18:41.724607] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T17:18:42.358143] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-17T17:18:42.586040] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T17:18:43.016529] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-17T17:18:43.158016] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-17T17:18:43.671256] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T17:18:43.958060] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-17T17:18:44.407739] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T17:18:44.758034] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-17T17:18:45.543841] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T17:18:45.557972] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-17T17:18:46.017255] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T17:18:46.358029] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-17T17:18:46.662434] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T17:18:47.158036] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-17T17:18:47.896156] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T17:18:47.958063] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-17T17:18:48.758053] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-17T17:18:49.071036] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T17:18:49.249746] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T17:18:49.558023] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-17T17:18:50.363182] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-17T17:18:50.380472] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T17:18:50.817764] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T17:18:51.158062] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-17T17:18:51.549207] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-17T17:18:51.958040] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-17T17:18:52.758019] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-17T17:18:52.791933] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T17:18:53.558022] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-17T17:18:53.586043] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T17:18:54.312143] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T17:18:54.319546] [INFO ] [REMOTE ] ARI: Full fetch complete (62470 records). [2025-10-17T17:18:54.319763] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-17T17:18:54.365766] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-17T17:18:54.740021] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-17T17:18:54.740108] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-17T17:18:54.740998] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-17T17:18:54.741073] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-17T17:18:54.742777] [DEBUG] [LOCAL ] ARI: Trimmed 62470 records to 44332 (keeping 200 days of data) [2025-10-17T17:18:55.014509] [DEBUG] [LOCAL ] ARI: Primary data saved (44332 records). [2025-10-17T17:18:55.014694] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-17T17:18:55.014926] [INFO ] [MAIN ] Update Progress: 144/2368 symbols completed. ARI took 30.8s. Estimated remaining: 4h 51m 9s. Rate: 7.6 symbols/min [2025-10-17T17:18:55.159797] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-17T17:18:55.187148] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:18:55.187389] [DEBUG] [LOCAL ] AROC: No existing data file found in primary storage. [2025-10-17T17:18:55.187594] [WARN ] [MAIN ] AROC: No existing data found, performing full refresh instead. [2025-10-17T17:18:55.187840] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-17T17:18:55.187992] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-17T17:18:55.188063] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-10-17T17:18:55.188100] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-17T17:18:55.331957] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T17:18:55.608007] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:18:55.958018] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-17T17:18:56.164106] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-17T17:18:56.758043] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-17T17:18:57.044453] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T17:18:57.050407] [INFO ] [REMOTE ] ARLO: Full fetch complete (63225 records). [2025-10-17T17:18:57.050513] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-17T17:18:57.431586] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-17T17:18:57.431721] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-17T17:18:57.432452] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-17T17:18:57.432636] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-17T17:18:57.434008] [DEBUG] [LOCAL ] ARLO: Trimmed 63225 records to 44394 (keeping 200 days of data) [2025-10-17T17:18:57.560718] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-17T17:18:57.619538] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T17:18:57.662143] [INFO ] [REMOTE ] ARES: Full fetch complete (71556 records). [2025-10-17T17:18:57.666120] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-17T17:18:58.024373] [DEBUG] [LOCAL ] ARLO: Primary data saved (44394 records). [2025-10-17T17:18:58.024711] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-17T17:18:58.024874] [INFO ] [MAIN ] Update Progress: 145/2368 symbols completed. ARLO took 30.5s. Estimated remaining: 4h 49m 47s. Rate: 7.7 symbols/min [2025-10-17T17:18:58.226524] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-17T17:18:58.226711] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-17T17:18:58.227830] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-17T17:18:58.227955] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-17T17:18:58.237168] [DEBUG] [LOCAL ] ARES: Trimmed 71556 records to 50486 (keeping 200 days of data) [2025-10-17T17:18:58.380288] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:18:58.458990] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T17:18:58.492194] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-17T17:18:58.625956] [DEBUG] [LOCAL ] ARR: Loaded 52502 existing records from primary storage. [2025-10-17T17:18:58.628060] [INFO ] [MAIN ] ARR: Loaded 52502 existing records. [2025-10-17T17:18:58.817992] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:18:58.819575] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-17T17:18:58.820598] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-17T17:18:58.822667] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-17T17:18:58.822988] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-17T17:18:59.194753] [DEBUG] [LOCAL ] ARES: Primary data saved (50486 records). [2025-10-17T17:18:59.205472] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-17T17:18:59.207360] [INFO ] [MAIN ] Update Progress: 146/2368 symbols completed. ARES took 38.7s. Estimated remaining: 4h 47m 58s. Rate: 7.7 symbols/min [2025-10-17T17:18:59.315866] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:18:59.373831] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-17T17:18:59.464340] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:18:59.493318] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-17T17:18:59.542810] [DEBUG] [LOCAL ] ARW: Loaded 33338 existing records from primary storage. [2025-10-17T17:18:59.543118] [INFO ] [MAIN ] ARW: Loaded 33338 existing records. [2025-10-17T17:18:59.722741] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:18:59.722964] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-17T17:18:59.723013] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-17T17:18:59.723376] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-17T17:18:59.723439] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-17T17:18:59.959852] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-17T17:19:00.111435] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:19:00.335466] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T17:19:00.758088] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-17T17:19:01.558158] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-17T17:19:01.731101] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-17T17:19:02.077338] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-17T17:19:02.358090] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-17T17:19:02.637471] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-17T17:19:02.733454] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T17:19:03.158051] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-17T17:19:03.891856] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T17:19:03.957984] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-17T17:19:04.758116] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-17T17:19:04.814426] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T17:19:05.558047] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-17T17:19:05.618629] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T17:19:06.358060] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-17T17:19:06.968132] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-17T17:19:07.125805] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T17:19:07.158010] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-17T17:19:07.958186] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-17T17:19:08.154198] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T17:19:08.757188] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T17:19:08.767099] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-17T17:19:09.366451] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T17:19:09.558067] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-17T17:19:10.205306] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T17:19:10.358021] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-17T17:19:11.158064] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-17T17:19:11.448687] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T17:19:11.963344] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-17T17:19:11.990872] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T17:19:12.758012] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-17T17:19:13.182700] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T17:19:13.558045] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-17T17:19:13.746500] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T17:19:14.313608] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T17:19:14.358047] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-17T17:19:15.158067] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-17T17:19:15.276785] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T17:19:15.284639] [INFO ] [REMOTE ] ARMK: Full fetch complete (72989 records). [2025-10-17T17:19:15.284914] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-17T17:19:15.642063] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-17T17:19:15.730733] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-17T17:19:15.730840] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-17T17:19:15.731673] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-17T17:19:15.731745] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-17T17:19:15.733368] [DEBUG] [LOCAL ] ARMK: Trimmed 72989 records to 51136 (keeping 200 days of data) [2025-10-17T17:19:15.965675] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-17T17:19:16.040540] [DEBUG] [LOCAL ] ARMK: Primary data saved (51136 records). [2025-10-17T17:19:16.040734] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-17T17:19:16.041681] [INFO ] [MAIN ] Update Progress: 147/2368 symbols completed. ARMK took 36.7s. Estimated remaining: 4h 50m 7s. Rate: 7.7 symbols/min [2025-10-17T17:19:16.213215] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:19:16.214579] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-17T17:19:16.214634] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-17T17:19:16.214854] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-17T17:19:16.214910] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-17T17:19:16.214953] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-17T17:19:16.214987] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-17T17:19:16.596170] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:19:16.758023] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-17T17:19:17.162711] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:19:17.163027] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-17T17:19:17.163117] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:19:17.163163] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-17T17:19:17.163197] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:19:17.163235] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-17T17:19:17.163295] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-17T17:19:17.163333] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-17T17:19:17.163371] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-17T17:19:17.163417] [INFO ] [MAIN ] Update Progress: 148/2368 symbols completed. ARX took 1.1s. Estimated remaining: 4h 48m 19s. Rate: 7.7 symbols/min [2025-10-17T17:19:17.340228] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:19:17.370789] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-17T17:19:17.411506] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T17:19:17.466224] [DEBUG] [LOCAL ] AS: Loaded 53564 existing records from primary storage. [2025-10-17T17:19:17.466528] [INFO ] [MAIN ] AS: Loaded 53564 existing records. [2025-10-17T17:19:17.563323] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-17T17:19:17.644296] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:19:17.644510] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-17T17:19:17.644558] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-17T17:19:17.645288] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-17T17:19:17.645345] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-17T17:19:17.991830] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:19:18.358044] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-17T17:19:19.158087] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-17T17:19:19.584326] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-17T17:19:19.958036] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-17T17:19:20.148608] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T17:19:20.758058] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-17T17:19:20.915347] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T17:19:21.557989] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-17T17:19:21.882690] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-17T17:19:22.254009] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T17:19:22.358012] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-17T17:19:22.969513] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T17:19:23.158025] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-17T17:19:23.958039] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-17T17:19:24.230561] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T17:19:24.238071] [INFO ] [REMOTE ] AROC: Full fetch complete (71311 records). [2025-10-17T17:19:24.238434] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-17T17:19:24.652945] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-17T17:19:24.653153] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-17T17:19:24.654429] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-17T17:19:24.654537] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-17T17:19:24.679865] [DEBUG] [LOCAL ] AROC: Trimmed 71311 records to 49789 (keeping 200 days of data) [2025-10-17T17:19:24.680708] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T17:19:24.782279] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-17T17:19:25.009540] [DEBUG] [LOCAL ] AROC: Primary data saved (49789 records). [2025-10-17T17:19:25.009781] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-17T17:19:25.009886] [INFO ] [MAIN ] Update Progress: 149/2368 symbols completed. AROC took 30.0s. Estimated remaining: 4h 48m 12s. Rate: 7.7 symbols/min [2025-10-17T17:19:25.183780] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:19:25.204081] [DEBUG] [LOCAL ] ASA: Loaded 15405 existing records from primary storage. [2025-10-17T17:19:25.204420] [INFO ] [MAIN ] ASA: Loaded 15405 existing records. [2025-10-17T17:19:25.389486] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:19:25.389803] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-17T17:19:25.389856] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-17T17:19:25.390155] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-17T17:19:25.390248] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-17T17:19:25.559299] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-17T17:19:25.765266] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:19:25.799766] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T17:19:25.953891] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T17:19:26.358003] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-17T17:19:26.725951] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T17:19:27.158099] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-17T17:19:27.859220] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-17T17:19:27.958033] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-17T17:19:28.474842] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-17T17:19:28.541115] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-17T17:19:28.758038] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-17T17:19:29.558035] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-17T17:19:30.358053] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-17T17:19:30.727437] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T17:19:30.779256] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T17:19:30.839385] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-17T17:19:31.158101] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-17T17:19:31.958167] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-17T17:19:32.526298] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-17T17:19:32.758046] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-17T17:19:33.446042] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T17:19:33.453313] [INFO ] [REMOTE ] ARR: Full fetch complete (75468 records). [2025-10-17T17:19:33.453429] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-17T17:19:33.559072] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-17T17:19:33.855528] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-17T17:19:33.855618] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-17T17:19:33.856429] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-17T17:19:33.856495] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-17T17:19:33.858109] [DEBUG] [LOCAL ] ARR: Trimmed 75468 records to 52880 (keeping 200 days of data) [2025-10-17T17:19:34.090051] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-17T17:19:34.213902] [DEBUG] [LOCAL ] ARR: Primary data saved (52880 records). [2025-10-17T17:19:34.214061] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-17T17:19:34.214165] [INFO ] [MAIN ] Update Progress: 150/2368 symbols completed. ARR took 36.2s. Estimated remaining: 4h 48m 25s. Rate: 7.7 symbols/min [2025-10-17T17:19:34.362736] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-17T17:19:34.382869] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T17:19:34.454132] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:19:34.516972] [DEBUG] [LOCAL ] ASAN: Loaded 53123 existing records from primary storage. [2025-10-17T17:19:34.517399] [INFO ] [MAIN ] ASAN: Loaded 53123 existing records. [2025-10-17T17:19:34.780401] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:19:34.780782] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-17T17:19:34.780861] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-17T17:19:34.781398] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-17T17:19:34.781486] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-17T17:19:35.163232] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-17T17:19:35.295434] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:19:35.842593] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:19:35.957990] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-17T17:19:36.758067] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-17T17:19:36.886529] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T17:19:37.147215] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-17T17:19:37.152573] [INFO ] [REMOTE ] ARW: Full fetch complete (48485 records). [2025-10-17T17:19:37.152786] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-17T17:19:37.535515] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-17T17:19:37.535630] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-17T17:19:37.536317] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-17T17:19:37.536438] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-17T17:19:37.538277] [DEBUG] [LOCAL ] ARW: Trimmed 48485 records to 33602 (keeping 200 days of data) [2025-10-17T17:19:37.590456] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-17T17:19:37.754608] [DEBUG] [LOCAL ] ARW: Primary data saved (33602 records). [2025-10-17T17:19:37.754829] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-17T17:19:37.754936] [INFO ] [MAIN ] Update Progress: 151/2368 symbols completed. ARW took 38.5s. Estimated remaining: 4h 47m 14s. Rate: 7.7 symbols/min [2025-10-17T17:19:37.941700] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:19:38.000662] [DEBUG] [LOCAL ] ASB: Loaded 50019 existing records from primary storage. [2025-10-17T17:19:38.001106] [INFO ] [MAIN ] ASB: Loaded 50019 existing records. [2025-10-17T17:19:38.192442] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:19:38.192760] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-17T17:19:38.192820] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-17T17:19:38.193278] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-17T17:19:38.193319] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-17T17:19:38.359814] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-17T17:19:38.624091] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:19:38.697196] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-17T17:19:38.720974] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T17:19:39.158112] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-17T17:19:39.958115] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-17T17:19:40.176678] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T17:19:40.531112] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-17T17:19:40.758105] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-17T17:19:40.990834] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T17:19:41.558034] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-17T17:19:42.358070] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-17T17:19:42.592679] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T17:19:43.111558] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T17:19:43.158003] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-17T17:19:43.944632] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T17:19:43.957980] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-17T17:19:44.375317] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T17:19:44.758094] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-17T17:19:45.513137] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T17:19:45.557994] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-17T17:19:46.358056] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-17T17:19:46.485056] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T17:19:46.810528] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-17T17:19:47.158068] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-17T17:19:47.490027] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T17:19:47.958069] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-17T17:19:48.763747] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-17T17:19:48.769842] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T17:19:49.558008] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-17T17:19:49.793793] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T17:19:50.357990] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-17T17:19:50.417507] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-17T17:19:50.603552] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T17:19:51.158055] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-17T17:19:51.958022] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-17T17:19:52.139081] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:19:52.570438] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-17T17:19:52.595066] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T17:19:52.758023] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-17T17:19:53.558007] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-17T17:19:54.358012] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-17T17:19:54.495472] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T17:19:55.158006] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-17T17:19:55.432312] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T17:19:55.958000] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-17T17:19:55.988100] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T17:19:56.720830] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T17:19:56.757985] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-17T17:19:57.558111] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-17T17:19:57.923475] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T17:19:58.302773] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-17T17:19:58.358083] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-17T17:19:58.492358] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T17:19:59.158090] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-17T17:19:59.958099] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-17T17:20:00.358573] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-17T17:20:00.366713] [INFO ] [REMOTE ] AS: Full fetch complete (76881 records). [2025-10-17T17:20:00.366879] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-17T17:20:00.772534] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-17T17:20:00.768569] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-17T17:20:00.772796] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-17T17:20:00.775055] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-17T17:20:00.775145] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-17T17:20:00.776915] [DEBUG] [LOCAL ] AS: Trimmed 76881 records to 53954 (keeping 200 days of data) [2025-10-17T17:20:01.127204] [DEBUG] [LOCAL ] AS: Primary data saved (53954 records). [2025-10-17T17:20:01.127426] [INFO ] [MAIN ] AS: Full history saved. [2025-10-17T17:20:01.128675] [INFO ] [MAIN ] Update Progress: 152/2368 symbols completed. AS took 44.0s. Estimated remaining: 4h 50m 54s. Rate: 7.6 symbols/min [2025-10-17T17:20:01.311226] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:01.360605] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-17T17:20:01.360895] [DEBUG] [LOCAL ] ASBA: Loaded 3483 existing records from primary storage. [2025-10-17T17:20:01.372801] [INFO ] [MAIN ] ASBA: Loaded 3483 existing records. [2025-10-17T17:20:01.551473] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:01.551712] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-17T17:20:01.551783] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-17T17:20:01.551961] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-17T17:20:01.552014] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-17T17:20:01.568145] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-17T17:20:01.981545] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:01.985208] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-17T17:20:02.358071] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-17T17:20:03.120877] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-17T17:20:03.124722] [INFO ] [REMOTE ] ASA: Full fetch complete (20407 records). [2025-10-17T17:20:03.124803] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-17T17:20:03.167531] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-17T17:20:03.495139] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-17T17:20:03.495226] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-17T17:20:03.495553] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-17T17:20:03.495595] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-17T17:20:03.496200] [DEBUG] [LOCAL ] ASA: Trimmed 20407 records to 15654 (keeping 200 days of data) [2025-10-17T17:20:03.587791] [DEBUG] [LOCAL ] ASA: Primary data saved (15654 records). [2025-10-17T17:20:03.587963] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-17T17:20:03.588058] [INFO ] [MAIN ] Update Progress: 153/2368 symbols completed. ASA took 38.6s. Estimated remaining: 4h 49m 28s. Rate: 7.7 symbols/min [2025-10-17T17:20:03.763955] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:03.802477] [DEBUG] [LOCAL ] ASC: Loaded 37642 existing records from primary storage. [2025-10-17T17:20:03.802818] [INFO ] [MAIN ] ASC: Loaded 37642 existing records. [2025-10-17T17:20:03.985845] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:03.986148] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-17T17:20:03.986260] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-17T17:20:03.986556] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-17T17:20:03.986610] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-17T17:20:04.088215] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-17T17:20:04.121988] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-17T17:20:04.219542] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-17T17:20:04.398982] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:04.429903] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-17T17:20:04.579316] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-17T17:20:04.758023] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-17T17:20:05.558033] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-17T17:20:05.942045] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-17T17:20:06.358038] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-17T17:20:06.467821] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T17:20:06.474678] [INFO ] [REMOTE ] ASB: Full fetch complete (71762 records). [2025-10-17T17:20:06.474849] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-17T17:20:06.475794] [FATAL] [VALIDATOR ] ASB: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:20:06.475888] [FATAL] [MAIN ] ASB: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:20:06.475931] [WARN ] [MAIN ] ASB: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:20:06.475986] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-17T17:20:06.476082] [DEBUG] [LOCAL ] ASB: No primary data file found to delete. [2025-10-17T17:20:06.476133] [INFO ] [LOCAL ] ASB: Starting deletion of derivative data. [2025-10-17T17:20:06.476291] [DEBUG] [LOCAL ] ASB: Deleted derivative data file. [2025-10-17T17:20:06.477511] [INFO ] [MAIN ] Update Progress: 154/2368 symbols completed. ASB took 28.7s. Estimated remaining: 4h 48m 9s. Rate: 7.7 symbols/min [2025-10-17T17:20:06.670811] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:06.697001] [DEBUG] [LOCAL ] ASG: Loaded 19723 existing records from primary storage. [2025-10-17T17:20:06.697286] [INFO ] [MAIN ] ASG: Loaded 19723 existing records. [2025-10-17T17:20:06.870062] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:06.870252] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-17T17:20:06.870324] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-17T17:20:06.870544] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-17T17:20:06.870614] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-17T17:20:07.163117] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-17T17:20:07.221000] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:07.823164] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-17T17:20:07.958005] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-17T17:20:08.593190] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-17T17:20:08.758038] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-17T17:20:09.558025] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-17T17:20:09.671809] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (3.31 seconds). [2025-10-17T17:20:09.990029] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-17T17:20:10.358070] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-17T17:20:10.674898] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T17:20:11.158039] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-17T17:20:11.550317] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-17T17:20:11.958072] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-17T17:20:12.168734] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T17:20:12.758103] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-17T17:20:13.558035] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-17T17:20:14.088319] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T17:20:14.204925] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-17T17:20:14.212589] [INFO ] [REMOTE ] ASAN: Full fetch complete (76642 records). [2025-10-17T17:20:14.212758] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-17T17:20:14.364383] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-17T17:20:14.645098] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-17T17:20:14.645188] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-17T17:20:14.646025] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-17T17:20:14.646102] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-17T17:20:14.647758] [DEBUG] [LOCAL ] ASAN: Trimmed 76642 records to 53507 (keeping 200 days of data) [2025-10-17T17:20:14.975380] [DEBUG] [LOCAL ] ASAN: Primary data saved (53507 records). [2025-10-17T17:20:14.975536] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-17T17:20:14.975621] [INFO ] [MAIN ] Update Progress: 155/2368 symbols completed. ASAN took 40.8s. Estimated remaining: 4h 48m 11s. Rate: 7.7 symbols/min [2025-10-17T17:20:15.157572] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:15.158164] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-17T17:20:15.200606] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T17:20:15.229536] [DEBUG] [LOCAL ] ASGI: Loaded 23140 existing records from primary storage. [2025-10-17T17:20:15.229892] [INFO ] [MAIN ] ASGI: Loaded 23140 existing records. [2025-10-17T17:20:15.431850] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T17:20:15.437725] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:15.442279] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-17T17:20:15.442899] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-17T17:20:15.443424] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-17T17:20:15.443489] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-17T17:20:15.811665] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:15.958041] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-17T17:20:16.027677] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T17:20:16.758057] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-17T17:20:17.271833] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T17:20:17.322347] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T17:20:17.558021] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-17T17:20:18.358051] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-17T17:20:18.773622] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T17:20:18.878855] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-17T17:20:19.158074] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-17T17:20:19.958074] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-17T17:20:20.213858] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T17:20:20.758013] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-17T17:20:21.398494] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T17:20:21.558027] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-17T17:20:21.699188] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-17T17:20:22.358014] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-17T17:20:22.673721] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T17:20:23.158031] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-17T17:20:23.415325] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T17:20:23.963121] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-17T17:20:23.970590] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T17:20:24.758033] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-17T17:20:25.050960] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T17:20:25.558022] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-17T17:20:25.797152] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T17:20:26.358098] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-17T17:20:26.751038] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-17T17:20:27.158110] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-17T17:20:27.320463] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T17:20:27.322017] [INFO ] [REMOTE ] ASBA: Full fetch complete (5312 records). [2025-10-17T17:20:27.322135] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-17T17:20:27.785733] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-17T17:20:27.785828] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-17T17:20:27.786001] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-17T17:20:27.786044] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-17T17:20:27.786526] [DEBUG] [LOCAL ] ASBA: Trimmed 5312 records to 3617 (keeping 200 days of data) [2025-10-17T17:20:27.809751] [DEBUG] [LOCAL ] ASBA: Primary data saved (3617 records). [2025-10-17T17:20:27.809908] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-17T17:20:27.810000] [INFO ] [MAIN ] Update Progress: 156/2368 symbols completed. ASBA took 26.7s. Estimated remaining: 4h 49m 14s. Rate: 7.6 symbols/min [2025-10-17T17:20:27.972709] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-17T17:20:28.011924] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:28.052231] [DEBUG] [LOCAL ] ASGN: Loaded 36906 existing records from primary storage. [2025-10-17T17:20:28.052559] [INFO ] [MAIN ] ASGN: Loaded 36906 existing records. [2025-10-17T17:20:28.248899] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:28.249165] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-17T17:20:28.249218] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-17T17:20:28.249420] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-17T17:20:28.249461] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-17T17:20:28.654178] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:28.722939] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T17:20:28.758002] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-17T17:20:29.065992] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T17:20:29.558049] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-17T17:20:30.298712] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T17:20:30.358018] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-17T17:20:30.657768] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T17:20:31.158060] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-17T17:20:31.824392] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T17:20:31.958005] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-17T17:20:32.300950] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T17:20:32.758082] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-17T17:20:33.523075] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T17:20:33.557989] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-17T17:20:33.941836] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T17:20:34.358092] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-17T17:20:35.158008] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-17T17:20:35.187417] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T17:20:35.778167] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T17:20:35.958030] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-17T17:20:36.612682] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T17:20:36.758035] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-17T17:20:37.490148] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T17:20:37.557999] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-17T17:20:38.210350] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T17:20:38.358015] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-17T17:20:38.967246] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T17:20:39.158055] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-17T17:20:39.472039] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T17:20:39.477238] [INFO ] [REMOTE ] ASC: Full fetch complete (56124 records). [2025-10-17T17:20:39.477347] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-17T17:20:39.848833] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-17T17:20:39.848918] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-17T17:20:39.849534] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-17T17:20:39.849574] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-17T17:20:39.850634] [DEBUG] [LOCAL ] ASC: Trimmed 56124 records to 37898 (keeping 200 days of data) [2025-10-17T17:20:39.959123] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-17T17:20:40.074591] [DEBUG] [LOCAL ] ASC: Primary data saved (37898 records). [2025-10-17T17:20:40.074778] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-17T17:20:40.074871] [INFO ] [MAIN ] Update Progress: 157/2368 symbols completed. ASC took 36.5s. Estimated remaining: 4h 50m 9s. Rate: 7.6 symbols/min [2025-10-17T17:20:40.287206] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T17:20:40.757985] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-17T17:20:41.075375] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T17:20:41.558009] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-17T17:20:41.901380] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T17:20:42.358061] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-17T17:20:42.593701] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-17T17:20:43.158097] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-17T17:20:43.759096] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-17T17:20:43.958008] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-17T17:20:44.427960] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T17:20:44.432548] [INFO ] [REMOTE ] ASGI: Full fetch complete (33316 records). [2025-10-17T17:20:44.432795] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-17T17:20:44.768548] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-17T17:20:44.822496] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-17T17:20:44.822622] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-17T17:20:44.823247] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-17T17:20:44.823310] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-17T17:20:44.824603] [DEBUG] [LOCAL ] ASGI: Trimmed 33316 records to 23311 (keeping 200 days of data) [2025-10-17T17:20:44.985486] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T17:20:44.995743] [INFO ] [REMOTE ] ASG: Full fetch complete (30919 records). [2025-10-17T17:20:44.996824] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-17T17:20:45.100546] [DEBUG] [LOCAL ] ASGI: Primary data saved (23311 records). [2025-10-17T17:20:45.104672] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-17T17:20:45.105168] [INFO ] [MAIN ] Update Progress: 158/2368 symbols completed. ASGI took 30.1s. Estimated remaining: 4h 49m 21s. Rate: 7.6 symbols/min [2025-10-17T17:20:45.397857] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-17T17:20:45.397936] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-17T17:20:45.398340] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-17T17:20:45.398403] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-17T17:20:45.399246] [DEBUG] [LOCAL ] ASG: Trimmed 30919 records to 19812 (keeping 200 days of data) [2025-10-17T17:20:45.508988] [DEBUG] [LOCAL ] ASG: Primary data saved (19812 records). [2025-10-17T17:20:45.509144] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-17T17:20:45.509229] [INFO ] [MAIN ] Update Progress: 159/2368 symbols completed. ASG took 39.0s. Estimated remaining: 4h 47m 29s. Rate: 7.7 symbols/min [2025-10-17T17:20:46.334426] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T17:20:46.341709] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-17T17:20:47.698205] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T17:20:47.705554] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-17T17:20:49.219741] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-17T17:20:49.228214] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-17T17:20:50.725938] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T17:20:50.734403] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-17T17:20:52.163622] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T17:20:52.172148] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-17T17:20:53.692951] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-17T17:20:53.698806] [INFO ] [REMOTE ] ASGN: Full fetch complete (53396 records). [2025-10-17T17:20:53.698938] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-17T17:20:54.078004] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-17T17:20:54.078122] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-17T17:20:54.078736] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-17T17:20:54.078800] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-17T17:20:54.080032] [DEBUG] [LOCAL ] ASGN: Trimmed 53396 records to 37201 (keeping 200 days of data) [2025-10-17T17:20:54.297326] [DEBUG] [LOCAL ] ASGN: Primary data saved (37201 records). [2025-10-17T17:20:54.297496] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-17T17:20:54.298530] [INFO ] [MAIN ] Update Progress: 160/2368 symbols completed. ASGN took 26.5s. Estimated remaining: 4h 47m 35s. Rate: 7.7 symbols/min [2025-10-17T17:20:54.942892] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:55.024722] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:55.093831] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:55.097968] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:20:55.110819] [DEBUG] [LOCAL ] ASR: Loaded 9418 existing records from primary storage. [2025-10-17T17:20:55.111127] [INFO ] [MAIN ] ASR: Loaded 9418 existing records. [2025-10-17T17:20:55.236481] [DEBUG] [LOCAL ] ASIX: Loaded 23274 existing records from primary storage. [2025-10-17T17:20:55.263738] [INFO ] [MAIN ] ASIX: Loaded 23274 existing records. [2025-10-17T17:20:55.295452] [DEBUG] [LOCAL ] ASH: Loaded 37839 existing records from primary storage. [2025-10-17T17:20:55.371916] [INFO ] [MAIN ] ASH: Loaded 37839 existing records. [2025-10-17T17:20:55.371241] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:55.432870] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-17T17:20:55.474346] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-17T17:20:55.562371] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-17T17:20:55.582605] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-17T17:20:55.656956] [DEBUG] [LOCAL ] ASPN: Loaded 50279 existing records from primary storage. [2025-10-17T17:20:55.793830] [INFO ] [MAIN ] ASPN: Loaded 50279 existing records. [2025-10-17T17:20:55.879599] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:55.908956] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-17T17:20:55.903719] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:55.920438] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-17T17:20:55.982424] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-17T17:20:55.994574] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-17T17:20:55.946505] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-17T17:20:56.037555] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-17T17:20:56.136108] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-17T17:20:56.242562] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-17T17:20:56.443923] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:20:56.497198] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-17T17:20:56.535754] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-17T17:20:56.627791] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:56.642091] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-17T17:20:56.647602] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-17T17:20:56.663907] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-17T17:20:57.149024] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:57.202987] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-17T17:20:57.442168] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:57.448169] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-17T17:20:57.525124] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:20:57.525480] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-17T17:20:57.565337] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-17T17:20:57.567387] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-17T17:20:58.215599] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T17:20:58.217739] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-17T17:20:58.555156] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T17:20:58.559003] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-17T17:20:58.833367] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T17:20:58.840188] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-17T17:20:58.861279] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-17T17:20:58.863441] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-17T17:20:59.196697] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T17:20:59.207070] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-17T17:20:59.381458] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T17:20:59.385543] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-17T17:20:59.611784] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-17T17:20:59.613882] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-17T17:21:00.335965] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T17:21:00.339935] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-17T17:21:00.355999] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-17T17:21:00.359214] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-17T17:21:00.383150] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T17:21:00.757996] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-17T17:21:01.160345] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-17T17:21:01.366562] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-17T17:21:01.542797] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-17T17:21:01.558052] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-17T17:21:02.310816] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T17:21:02.357993] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-17T17:21:03.158044] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-17T17:21:03.436272] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T17:21:03.961338] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-17T17:21:03.968303] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T17:21:04.008002] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T17:21:04.758065] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-17T17:21:05.553443] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-17T17:21:05.557971] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-17T17:21:05.748363] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T17:21:06.065554] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-17T17:21:06.358025] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-17T17:21:07.158034] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-17T17:21:07.662439] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T17:21:07.958022] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-17T17:21:08.336189] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T17:21:08.758049] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-17T17:21:09.451424] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T17:21:09.557990] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-17T17:21:09.786379] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T17:21:10.358051] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-17T17:21:11.158020] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-17T17:21:11.297109] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T17:21:11.433864] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T17:21:11.797521] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T17:21:11.958049] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-17T17:21:12.758083] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-17T17:21:12.793465] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T17:21:13.558020] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-17T17:21:13.654967] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T17:21:14.358073] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-17T17:21:15.163122] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-17T17:21:15.178810] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T17:21:15.285326] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T17:21:15.286862] [INFO ] [REMOTE ] ASR: Full fetch complete (12436 records). [2025-10-17T17:21:15.286931] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-17T17:21:15.658571] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-17T17:21:15.658667] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-17T17:21:15.658926] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-17T17:21:15.658966] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-17T17:21:15.659407] [DEBUG] [LOCAL ] ASR: Trimmed 12436 records to 9527 (keeping 200 days of data) [2025-10-17T17:21:15.716585] [DEBUG] [LOCAL ] ASR: Primary data saved (9527 records). [2025-10-17T17:21:15.716737] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-17T17:21:15.716826] [INFO ] [MAIN ] Update Progress: 161/2368 symbols completed. ASR took 21.4s. Estimated remaining: 4h 50m 34s. Rate: 7.6 symbols/min [2025-10-17T17:21:15.897184] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:21:15.955124] [DEBUG] [LOCAL ] ASX: Loaded 53264 existing records from primary storage. [2025-10-17T17:21:15.955444] [INFO ] [MAIN ] ASX: Loaded 53264 existing records. [2025-10-17T17:21:15.967059] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-17T17:21:16.149461] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:21:16.157073] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-17T17:21:16.168581] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-17T17:21:16.170028] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-17T17:21:16.169957] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T17:21:16.170228] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-17T17:21:16.534879] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:21:16.758030] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-17T17:21:17.558027] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-17T17:21:17.903275] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-17T17:21:18.357995] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-17T17:21:18.797741] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-17T17:21:18.843150] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T17:21:19.158046] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-17T17:21:19.538443] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T17:21:19.542782] [INFO ] [REMOTE ] ASIX: Full fetch complete (31047 records). [2025-10-17T17:21:19.542918] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-17T17:21:19.934914] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-17T17:21:19.934993] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-17T17:21:19.935405] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-17T17:21:19.935446] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-17T17:21:19.936242] [DEBUG] [LOCAL ] ASIX: Trimmed 31047 records to 23435 (keeping 200 days of data) [2025-10-17T17:21:19.992439] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-17T17:21:20.080530] [DEBUG] [LOCAL ] ASIX: Primary data saved (23435 records). [2025-10-17T17:21:20.080684] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-17T17:21:20.080782] [INFO ] [MAIN ] Update Progress: 162/2368 symbols completed. ASIX took 25.8s. Estimated remaining: 4h 49m 38s. Rate: 7.6 symbols/min [2025-10-17T17:21:20.249606] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:21:20.285743] [DEBUG] [LOCAL ] ATEN: Loaded 38592 existing records from primary storage. [2025-10-17T17:21:20.286037] [INFO ] [MAIN ] ATEN: Loaded 38592 existing records. [2025-10-17T17:21:20.461754] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:21:20.461992] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-17T17:21:20.462042] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-17T17:21:20.462361] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-17T17:21:20.462418] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-17T17:21:20.759896] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-17T17:21:20.841923] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:21:20.913448] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T17:21:21.558025] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-17T17:21:21.970634] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-17T17:21:22.358041] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-17T17:21:22.625269] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T17:21:22.804803] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T17:21:23.158057] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-17T17:21:23.958015] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-17T17:21:24.214663] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-17T17:21:24.295611] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T17:21:24.758058] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-17T17:21:25.251613] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T17:21:25.558063] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-17T17:21:26.358103] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-17T17:21:26.593415] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T17:21:26.603400] [INFO ] [REMOTE ] ASPN: Full fetch complete (72642 records). [2025-10-17T17:21:26.603594] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-17T17:21:27.049319] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-17T17:21:27.049449] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-17T17:21:27.050530] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-17T17:21:27.050690] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-17T17:21:27.052828] [DEBUG] [LOCAL ] ASPN: Trimmed 72642 records to 50648 (keeping 200 days of data) [2025-10-17T17:21:27.159155] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-17T17:21:27.175259] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T17:21:27.386698] [DEBUG] [LOCAL ] ASPN: Primary data saved (50648 records). [2025-10-17T17:21:27.386889] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-17T17:21:27.386990] [INFO ] [MAIN ] Update Progress: 163/2368 symbols completed. ASPN took 33.1s. Estimated remaining: 4h 49m 22s. Rate: 7.6 symbols/min [2025-10-17T17:21:27.560329] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:21:27.592060] [DEBUG] [LOCAL ] ATGE: Loaded 31229 existing records from primary storage. [2025-10-17T17:21:27.592332] [INFO ] [MAIN ] ATGE: Loaded 31229 existing records. [2025-10-17T17:21:27.779835] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:21:27.780868] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-17T17:21:27.780928] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-17T17:21:27.781615] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-17T17:21:27.781699] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-17T17:21:27.990835] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-17T17:21:27.981542] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T17:21:28.174791] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:21:28.758057] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-17T17:21:29.145393] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-17T17:21:29.295104] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T17:21:29.558034] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-17T17:21:30.134019] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T17:21:30.358048] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-17T17:21:30.831336] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-17T17:21:31.158042] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-17T17:21:31.958033] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-17T17:21:32.098439] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T17:21:32.758091] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-17T17:21:32.787559] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T17:21:32.793267] [INFO ] [REMOTE ] ASH: Full fetch complete (55686 records). [2025-10-17T17:21:32.793361] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-17T17:21:33.172181] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T17:21:33.212146] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-17T17:21:33.212213] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-17T17:21:33.212806] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-17T17:21:33.212875] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-17T17:21:33.213924] [DEBUG] [LOCAL ] ASH: Trimmed 55686 records to 38148 (keeping 200 days of data) [2025-10-17T17:21:33.443010] [DEBUG] [LOCAL ] ASH: Primary data saved (38148 records). [2025-10-17T17:21:33.443142] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-17T17:21:33.443224] [INFO ] [MAIN ] Update Progress: 164/2368 symbols completed. ASH took 39.1s. Estimated remaining: 4h 48m 50s. Rate: 7.6 symbols/min [2025-10-17T17:21:33.563138] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-17T17:21:33.615723] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:21:33.647095] [DEBUG] [LOCAL ] ATHM: Loaded 31712 existing records from primary storage. [2025-10-17T17:21:33.647392] [INFO ] [MAIN ] ATHM: Loaded 31712 existing records. [2025-10-17T17:21:33.821341] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:21:33.821550] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-17T17:21:33.821597] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-17T17:21:33.821846] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-17T17:21:33.821902] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-17T17:21:34.181233] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:21:34.205876] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T17:21:34.358020] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-17T17:21:35.157999] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-17T17:21:35.730763] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-17T17:21:35.958110] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-17T17:21:36.447456] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-17T17:21:36.595032] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T17:21:36.758045] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-17T17:21:37.526527] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T17:21:37.557986] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-17T17:21:38.242899] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-17T17:21:38.358045] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-17T17:21:38.770599] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T17:21:39.158027] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-17T17:21:39.961465] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-17T17:21:39.967063] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T17:21:40.673866] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-17T17:21:40.757993] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-17T17:21:41.481973] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T17:21:41.558032] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-17T17:21:41.815924] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T17:21:42.358020] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-17T17:21:42.841754] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T17:21:43.158027] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-17T17:21:43.958063] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-17T17:21:44.167305] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T17:21:44.683404] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T17:21:44.758030] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-17T17:21:45.051329] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T17:21:45.558067] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-17T17:21:45.896356] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T17:21:45.901148] [INFO ] [REMOTE ] ATEN: Full fetch complete (56884 records). [2025-10-17T17:21:45.901254] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-17T17:21:46.279780] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-17T17:21:46.279874] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-17T17:21:46.280518] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-17T17:21:46.280561] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-17T17:21:46.282143] [DEBUG] [LOCAL ] ATEN: Trimmed 56884 records to 38815 (keeping 200 days of data) [2025-10-17T17:21:46.368718] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-17T17:21:46.518318] [DEBUG] [LOCAL ] ATEN: Primary data saved (38815 records). [2025-10-17T17:21:46.518535] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-17T17:21:46.518724] [INFO ] [MAIN ] Update Progress: 165/2368 symbols completed. ATEN took 26.4s. Estimated remaining: 4h 49m 52s. Rate: 7.6 symbols/min [2025-10-17T17:21:46.689487] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:21:46.698495] [DEBUG] [LOCAL ] ATHS: Loaded 6668 existing records from primary storage. [2025-10-17T17:21:46.698763] [INFO ] [MAIN ] ATHS: Loaded 6668 existing records. [2025-10-17T17:21:46.878824] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:21:46.879221] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-17T17:21:46.879389] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-17T17:21:46.879679] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-17T17:21:46.879818] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-17T17:21:47.051968] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T17:21:47.166117] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-17T17:21:47.302164] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:21:47.958084] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-17T17:21:48.208190] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T17:21:48.667116] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:21:48.758026] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-17T17:21:49.278432] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-17T17:21:49.558031] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-17T17:21:49.978342] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T17:21:50.358028] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-17T17:21:51.158075] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-17T17:21:51.426492] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T17:21:51.747796] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T17:21:51.958037] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-17T17:21:52.188815] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T17:21:52.758033] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-17T17:21:53.092181] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T17:21:53.558086] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-17T17:21:54.358013] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-17T17:21:54.466471] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T17:21:54.820782] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T17:21:55.158014] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-17T17:21:55.229016] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T17:21:55.958042] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-17T17:21:56.307171] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-17T17:21:56.758053] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-17T17:21:57.558016] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-17T17:21:57.824715] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T17:21:57.832324] [INFO ] [REMOTE ] ASX: Full fetch complete (76784 records). [2025-10-17T17:21:57.832445] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-17T17:21:58.292836] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-17T17:21:58.293086] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-17T17:21:58.295209] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T17:21:58.294499] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-17T17:21:58.301908] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-17T17:21:58.303555] [DEBUG] [LOCAL ] ASX: Trimmed 76784 records to 53653 (keeping 200 days of data) [2025-10-17T17:21:58.358388] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-17T17:21:58.650332] [DEBUG] [LOCAL ] ASX: Primary data saved (53653 records). [2025-10-17T17:21:58.650486] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-17T17:21:58.651755] [INFO ] [MAIN ] Update Progress: 166/2368 symbols completed. ASX took 42.9s. Estimated remaining: 4h 50m 40s. Rate: 7.6 symbols/min [2025-10-17T17:21:58.837720] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:21:58.848389] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T17:21:58.910616] [DEBUG] [LOCAL ] ATI: Loaded 51723 existing records from primary storage. [2025-10-17T17:21:58.910999] [INFO ] [MAIN ] ATI: Loaded 51723 existing records. [2025-10-17T17:21:59.129677] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:21:59.129911] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-17T17:21:59.129980] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-17T17:21:59.130226] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-17T17:21:59.130291] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-17T17:21:59.163273] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-17T17:21:59.485486] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:21:59.499257] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T17:21:59.958009] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-17T17:21:59.980771] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T17:22:00.758017] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-17T17:22:01.558097] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-17T17:22:02.082341] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-17T17:22:02.264969] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T17:22:02.268906] [INFO ] [REMOTE ] ATHM: Full fetch complete (49698 records). [2025-10-17T17:22:02.269002] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-17T17:22:02.269610] [FATAL] [VALIDATOR ] ATHM: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:22:02.269734] [FATAL] [MAIN ] ATHM: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:22:02.269788] [WARN ] [MAIN ] ATHM: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:22:02.269845] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-17T17:22:02.269951] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-10-17T17:22:02.270017] [INFO ] [LOCAL ] ATHM: Starting deletion of derivative data. [2025-10-17T17:22:02.270180] [DEBUG] [LOCAL ] ATHM: Deleted derivative data file. [2025-10-17T17:22:02.270289] [INFO ] [MAIN ] Update Progress: 167/2368 symbols completed. ATHM took 28.8s. Estimated remaining: 4h 49m 35s. Rate: 7.6 symbols/min [2025-10-17T17:22:02.367297] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-17T17:22:02.441834] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:22:02.487693] [DEBUG] [LOCAL ] ATKR: Loaded 35500 existing records from primary storage. [2025-10-17T17:22:02.488115] [INFO ] [MAIN ] ATKR: Loaded 35500 existing records. [2025-10-17T17:22:02.701258] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:22:02.701621] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-17T17:22:02.701762] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-17T17:22:02.707171] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-17T17:22:02.712006] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-17T17:22:02.756418] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T17:22:02.799685] [INFO ] [REMOTE ] ATGE: Full fetch complete (45995 records). [2025-10-17T17:22:02.804975] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-17T17:22:03.146293] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T17:22:03.176391] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-17T17:22:03.426881] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:22:03.530482] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-17T17:22:03.530603] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-17T17:22:03.531484] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-17T17:22:03.531564] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-17T17:22:03.533020] [DEBUG] [LOCAL ] ATGE: Trimmed 45995 records to 31377 (keeping 200 days of data) [2025-10-17T17:22:03.749277] [DEBUG] [LOCAL ] ATGE: Primary data saved (31377 records). [2025-10-17T17:22:03.749430] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-17T17:22:03.749530] [INFO ] [MAIN ] Update Progress: 168/2368 symbols completed. ATGE took 36.4s. Estimated remaining: 4h 48m 3s. Rate: 7.6 symbols/min [2025-10-17T17:22:03.935439] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:22:03.961189] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-17T17:22:03.980048] [DEBUG] [LOCAL ] ATMU: Loaded 39185 existing records from primary storage. [2025-10-17T17:22:03.980410] [INFO ] [MAIN ] ATMU: Loaded 39185 existing records. [2025-10-17T17:22:04.158970] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:22:04.159266] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-17T17:22:04.159323] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-17T17:22:04.159678] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-17T17:22:04.159740] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-17T17:22:04.523248] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:22:04.573321] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T17:22:04.758030] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-17T17:22:05.557994] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-17T17:22:05.664021] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:22:05.839541] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T17:22:06.358048] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-17T17:22:06.937733] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T17:22:07.035955] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T17:22:07.157991] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-17T17:22:07.850037] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T17:22:07.958262] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-17T17:22:08.758095] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-17T17:22:09.530015] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T17:22:09.557982] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-17T17:22:09.604084] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T17:22:10.358299] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-17T17:22:11.097271] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:22:11.158051] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-17T17:22:11.953327] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T17:22:11.961575] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-17T17:22:12.655536] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T17:22:12.758072] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-17T17:22:13.317741] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T17:22:13.558047] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-17T17:22:14.160718] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T17:22:14.358057] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-17T17:22:15.090243] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T17:22:15.157989] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-17T17:22:15.937734] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T17:22:15.957992] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-17T17:22:16.671813] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T17:22:16.758073] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-17T17:22:17.558014] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-17T17:22:17.789389] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T17:22:18.358014] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-17T17:22:18.480579] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T17:22:18.860303] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T17:22:19.158036] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-17T17:22:19.416908] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T17:22:19.958030] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-17T17:22:20.301551] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T17:22:20.758009] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-17T17:22:20.771877] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T17:22:21.558048] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-17T17:22:22.242905] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T17:22:22.358049] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-17T17:22:23.112821] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T17:22:23.157987] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-17T17:22:23.777159] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T17:22:23.958037] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-17T17:22:24.561969] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T17:22:24.758027] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-17T17:22:25.397355] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T17:22:25.519353] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T17:22:25.524706] [INFO ] [REMOTE ] ATKR: Full fetch complete (53369 records). [2025-10-17T17:22:25.524806] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-17T17:22:25.563973] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-17T17:22:25.907324] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-17T17:22:25.907401] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-17T17:22:25.908028] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-17T17:22:25.908091] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-17T17:22:25.909162] [DEBUG] [LOCAL ] ATKR: Trimmed 53369 records to 35684 (keeping 200 days of data) [2025-10-17T17:22:26.156380] [DEBUG] [LOCAL ] ATKR: Primary data saved (35684 records). [2025-10-17T17:22:26.156525] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-17T17:22:26.156623] [INFO ] [MAIN ] Update Progress: 169/2368 symbols completed. ATKR took 23.9s. Estimated remaining: 4h 51m 5s. Rate: 7.6 symbols/min [2025-10-17T17:22:26.326546] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:22:26.367800] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-17T17:22:26.370673] [DEBUG] [LOCAL ] ATO: Loaded 42086 existing records from primary storage. [2025-10-17T17:22:26.370981] [INFO ] [MAIN ] ATO: Loaded 42086 existing records. [2025-10-17T17:22:26.553799] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:22:26.554034] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-17T17:22:26.554083] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-17T17:22:26.554406] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-17T17:22:26.554464] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-17T17:22:26.920790] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:22:27.158053] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-17T17:22:27.438344] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-17T17:22:27.819115] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-17T17:22:27.905548] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T17:22:27.958090] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-17T17:22:28.554739] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T17:22:28.556375] [INFO ] [REMOTE ] ATHS: Full fetch complete (9600 records). [2025-10-17T17:22:28.556475] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-17T17:22:28.765981] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-17T17:22:28.994172] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-17T17:22:28.994258] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-17T17:22:28.994514] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-17T17:22:28.994577] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-17T17:22:28.995050] [DEBUG] [LOCAL ] ATHS: Trimmed 9600 records to 6713 (keeping 200 days of data) [2025-10-17T17:22:29.037815] [DEBUG] [LOCAL ] ATHS: Primary data saved (6713 records). [2025-10-17T17:22:29.037951] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-17T17:22:29.038034] [INFO ] [MAIN ] Update Progress: 170/2368 symbols completed. ATHS took 42.5s. Estimated remaining: 4h 49m 52s. Rate: 7.6 symbols/min [2025-10-17T17:22:29.206178] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:22:29.238850] [DEBUG] [LOCAL ] ATR: Loaded 30763 existing records from primary storage. [2025-10-17T17:22:29.239127] [INFO ] [MAIN ] ATR: Loaded 30763 existing records. [2025-10-17T17:22:29.435538] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:22:29.435853] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-17T17:22:29.435917] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-17T17:22:29.436214] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-17T17:22:29.436274] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-17T17:22:29.563134] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-17T17:22:29.818535] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:22:29.896035] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T17:22:30.358044] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-17T17:22:31.158061] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-17T17:22:31.465637] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T17:22:31.958032] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-17T17:22:32.085407] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T17:22:32.749142] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T17:22:32.757978] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-17T17:22:32.788239] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-17T17:22:33.558042] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-17T17:22:33.922201] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T17:22:34.358075] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-17T17:22:35.044368] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T17:22:35.158037] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-17T17:22:35.958047] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-17T17:22:36.342671] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T17:22:36.398612] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-17T17:22:36.758053] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-17T17:22:37.398486] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T17:22:37.558060] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-17T17:22:38.027942] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T17:22:38.358088] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-17T17:22:39.160828] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-17T17:22:39.164529] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T17:22:39.659011] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T17:22:39.958024] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-17T17:22:40.758009] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-17T17:22:40.828789] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T17:22:40.835804] [INFO ] [REMOTE ] ATI: Full fetch complete (74040 records). [2025-10-17T17:22:40.835924] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-17T17:22:41.232535] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-17T17:22:41.232663] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-17T17:22:41.233458] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-17T17:22:41.233536] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-17T17:22:41.235385] [DEBUG] [LOCAL ] ATI: Trimmed 74040 records to 52088 (keeping 200 days of data) [2025-10-17T17:22:41.361074] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T17:22:41.563717] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-17T17:22:41.568849] [DEBUG] [LOCAL ] ATI: Primary data saved (52088 records). [2025-10-17T17:22:41.569059] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-17T17:22:41.569159] [INFO ] [MAIN ] Update Progress: 171/2368 symbols completed. ATI took 42.9s. Estimated remaining: 4h 50m 43s. Rate: 7.6 symbols/min [2025-10-17T17:22:41.740366] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:22:41.758708] [DEBUG] [LOCAL ] ATS: Loaded 17690 existing records from primary storage. [2025-10-17T17:22:41.758962] [INFO ] [MAIN ] ATS: Loaded 17690 existing records. [2025-10-17T17:22:41.952136] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:22:41.952481] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-17T17:22:41.952542] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-17T17:22:41.952806] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-17T17:22:41.952865] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-17T17:22:42.327084] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:22:42.341564] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-17T17:22:42.346901] [INFO ] [REMOTE ] ATMU: Full fetch complete (56889 records). [2025-10-17T17:22:42.347005] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-17T17:22:42.367701] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-17T17:22:42.730868] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-17T17:22:42.730967] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-17T17:22:42.731591] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-17T17:22:42.731638] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-17T17:22:42.732996] [DEBUG] [LOCAL ] ATMU: Trimmed 56889 records to 39475 (keeping 200 days of data) [2025-10-17T17:22:42.962058] [DEBUG] [LOCAL ] ATMU: Primary data saved (39475 records). [2025-10-17T17:22:42.962183] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-17T17:22:42.962262] [INFO ] [MAIN ] Update Progress: 172/2368 symbols completed. ATMU took 39.2s. Estimated remaining: 4h 49m 11s. Rate: 7.6 symbols/min [2025-10-17T17:22:43.078270] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T17:22:43.152949] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:22:43.157989] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-17T17:22:43.196417] [DEBUG] [LOCAL ] ATUS: Loaded 50229 existing records from primary storage. [2025-10-17T17:22:43.196752] [INFO ] [MAIN ] ATUS: Loaded 50229 existing records. [2025-10-17T17:22:43.374412] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:22:43.374747] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-17T17:22:43.375004] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-17T17:22:43.375335] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-17T17:22:43.375405] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-17T17:22:43.733806] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:22:43.958022] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-17T17:22:44.202438] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T17:22:44.332347] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T17:22:44.758013] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-17T17:22:45.558047] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-17T17:22:45.683774] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T17:22:46.358091] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-17T17:22:46.424290] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T17:22:46.569370] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T17:22:47.158052] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-17T17:22:47.648203] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T17:22:47.958048] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-17T17:22:48.661863] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T17:22:48.758022] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-17T17:22:49.024264] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T17:22:49.558032] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-17T17:22:50.296096] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T17:22:50.357983] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-17T17:22:50.800533] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T17:22:51.158055] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-17T17:22:51.852843] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T17:22:51.958009] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-17T17:22:52.758023] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-17T17:22:53.558040] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-17T17:23:05.717973] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (13.76 seconds). [2025-10-17T17:23:05.740756] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (12.98 seconds). [2025-10-17T17:23:05.745894] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-17T17:23:05.741343] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-17T17:23:05.922849] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (12.36 seconds). [2025-10-17T17:23:05.932617] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-17T17:23:06.221570] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (15.06 seconds). [2025-10-17T17:23:06.228967] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-17T17:23:07.290400] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:23:07.295000] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-17T17:23:07.364875] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T17:23:07.371891] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-17T17:23:07.515421] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T17:23:07.525171] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-17T17:23:07.782892] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-17T17:23:07.788868] [INFO ] [REMOTE ] ATO: Full fetch complete (60691 records). [2025-10-17T17:23:07.788973] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-17T17:23:08.180426] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-17T17:23:08.180535] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-17T17:23:08.181287] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-17T17:23:08.181355] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-17T17:23:08.183042] [DEBUG] [LOCAL ] ATO: Trimmed 60691 records to 42359 (keeping 200 days of data) [2025-10-17T17:23:08.460200] [DEBUG] [LOCAL ] ATO: Primary data saved (42359 records). [2025-10-17T17:23:08.460356] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-17T17:23:08.460499] [INFO ] [MAIN ] Update Progress: 173/2368 symbols completed. ATO took 42.3s. Estimated remaining: 4h 52m 47s. Rate: 7.5 symbols/min [2025-10-17T17:23:08.586588] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-17T17:23:08.632933] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-17T17:23:08.673463] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:08.681677] [DEBUG] [LOCAL ] AU: No existing data file found in primary storage. [2025-10-17T17:23:08.683855] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T17:23:08.682277] [WARN ] [MAIN ] AU: No existing data found, performing full refresh instead. [2025-10-17T17:23:08.689374] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-17T17:23:08.689497] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-17T17:23:08.689674] [INFO ] [REMOTE ] ATR: Full fetch complete (43987 records). [2025-10-17T17:23:08.689576] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-10-17T17:23:08.689962] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-17T17:23:08.690233] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-17T17:23:09.395757] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:09.415706] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-17T17:23:09.507958] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-17T17:23:09.551145] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-17T17:23:09.551370] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-17T17:23:09.551967] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-17T17:23:09.552469] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-17T17:23:09.552383] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-17T17:23:09.554515] [DEBUG] [LOCAL ] ATR: Trimmed 43987 records to 30974 (keeping 200 days of data) [2025-10-17T17:23:09.749327] [DEBUG] [LOCAL ] ATR: Primary data saved (30974 records). [2025-10-17T17:23:09.749678] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-17T17:23:09.749839] [INFO ] [MAIN ] Update Progress: 174/2368 symbols completed. ATR took 40.7s. Estimated remaining: 4h 51m 14s. Rate: 7.5 symbols/min [2025-10-17T17:23:09.866847] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-17T17:23:09.883328] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-17T17:23:09.980725] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:10.024481] [DEBUG] [LOCAL ] AUB: Loaded 46391 existing records from primary storage. [2025-10-17T17:23:10.024833] [INFO ] [MAIN ] AUB: Loaded 46391 existing records. [2025-10-17T17:23:10.200620] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:23:10.200880] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-17T17:23:10.200927] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-17T17:23:10.201228] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-17T17:23:10.201267] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-17T17:23:10.551545] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:10.551936] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-17T17:23:10.916866] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T17:23:10.921499] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-17T17:23:11.296845] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T17:23:11.308510] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-17T17:23:11.459603] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-17T17:23:11.470727] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-17T17:23:11.701788] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-17T17:23:11.705828] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-17T17:23:11.796038] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T17:23:11.804779] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-17T17:23:12.461081] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T17:23:12.466472] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-17T17:23:12.964463] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T17:23:12.975692] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-17T17:23:13.236302] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T17:23:13.247097] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-17T17:23:13.414918] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T17:23:13.433938] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-17T17:23:13.435091] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T17:23:13.440394] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-17T17:23:14.241303] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T17:23:14.252592] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-17T17:23:14.375329] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T17:23:14.379359] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-17T17:23:14.763300] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T17:23:14.773577] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-17T17:23:14.820034] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T17:23:14.828134] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-17T17:23:15.019496] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-17T17:23:15.021741] [INFO ] [REMOTE ] ATS: Full fetch complete (25464 records). [2025-10-17T17:23:15.021812] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-17T17:23:15.022285] [FATAL] [VALIDATOR ] ATS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:23:15.022363] [FATAL] [MAIN ] ATS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:23:15.022408] [WARN ] [MAIN ] ATS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:23:15.022466] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-17T17:23:15.022556] [DEBUG] [LOCAL ] ATS: No primary data file found to delete. [2025-10-17T17:23:15.022608] [INFO ] [LOCAL ] ATS: Starting deletion of derivative data. [2025-10-17T17:23:15.022825] [DEBUG] [LOCAL ] ATS: Deleted derivative data file. [2025-10-17T17:23:15.022914] [INFO ] [MAIN ] Update Progress: 175/2368 symbols completed. ATS took 33.5s. Estimated remaining: 4h 50m 32s. Rate: 7.5 symbols/min [2025-10-17T17:23:15.187071] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:15.193007] [DEBUG] [LOCAL ] AUNA: Loaded 5158 existing records from primary storage. [2025-10-17T17:23:15.193169] [INFO ] [MAIN ] AUNA: Loaded 5158 existing records. [2025-10-17T17:23:15.367841] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:23:15.368025] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-17T17:23:15.368070] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-17T17:23:15.368196] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-17T17:23:15.368233] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-17T17:23:15.639043] [DEBUG] [REMOTE ] ATUS: Error fetching primary data for 2025-08: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-17T17:23:15.641686] [WARN ] [REMOTE ] ATUS: No data returned for month 2025-08 [2025-10-17T17:23:15.641791] [FATAL] [REMOTE ] ATUS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:23:15.647628] [FATAL] [MAIN ] ATUS: Failed to fetch primary data. [2025-10-17T17:23:15.657943] [WARN ] [MAIN ] ATUS: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:23:15.668249] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-17T17:23:15.694079] [DEBUG] [LOCAL ] ATUS: No primary data file found to delete. [2025-10-17T17:23:15.701109] [INFO ] [LOCAL ] ATUS: Starting deletion of derivative data. [2025-10-17T17:23:15.722848] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:15.723195] [DEBUG] [LOCAL ] ATUS: Deleted derivative data file. [2025-10-17T17:23:15.723155] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-17T17:23:15.724058] [INFO ] [MAIN ] Update Progress: 176/2368 symbols completed. ATUS took 32.8s. Estimated remaining: 4h 48m 54s. Rate: 7.6 symbols/min [2025-10-17T17:23:15.903071] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:15.941859] [DEBUG] [LOCAL ] AVA: Loaded 39001 existing records from primary storage. [2025-10-17T17:23:15.942166] [INFO ] [MAIN ] AVA: Loaded 39001 existing records. [2025-10-17T17:23:16.132139] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:23:16.132367] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-17T17:23:16.132421] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-17T17:23:16.132838] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-17T17:23:16.132896] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-17T17:23:16.492972] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:16.493366] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-17T17:23:16.708738] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T17:23:16.740310] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T17:23:16.757970] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-17T17:23:16.926846] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-17T17:23:17.569721] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-17T17:23:17.574731] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T17:23:18.310421] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-17T17:23:18.358036] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-17T17:23:18.560438] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T17:23:19.033946] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T17:23:19.157996] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-17T17:23:19.958014] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-17T17:23:20.076241] [DEBUG] [REMOTE ] AUB: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-17T17:23:20.076540] [WARN ] [REMOTE ] AUB: No data returned for month 2025-05 [2025-10-17T17:23:20.076696] [FATAL] [REMOTE ] AUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:23:20.076816] [FATAL] [MAIN ] AUB: Failed to fetch primary data. [2025-10-17T17:23:20.076902] [WARN ] [MAIN ] AUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:23:20.076998] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-17T17:23:20.077077] [DEBUG] [LOCAL ] AUB: No primary data file found to delete. [2025-10-17T17:23:20.077118] [INFO ] [LOCAL ] AUB: Starting deletion of derivative data. [2025-10-17T17:23:20.077269] [DEBUG] [LOCAL ] AUB: Deleted derivative data file. [2025-10-17T17:23:20.077351] [INFO ] [MAIN ] Update Progress: 177/2368 symbols completed. AUB took 10.3s. Estimated remaining: 4h 48m 2s. Rate: 7.6 symbols/min [2025-10-17T17:23:20.162546] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-17T17:23:20.264998] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:20.276865] [DEBUG] [LOCAL ] AVAL: Loaded 8650 existing records from primary storage. [2025-10-17T17:23:20.277177] [INFO ] [MAIN ] AVAL: Loaded 8650 existing records. [2025-10-17T17:23:20.466010] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:23:20.466431] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-17T17:23:20.466492] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-17T17:23:20.466821] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-17T17:23:20.466887] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-17T17:23:20.763454] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-17T17:23:20.876768] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:21.558036] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-17T17:23:22.137430] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T17:23:22.358061] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-17T17:23:22.730389] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-17T17:23:22.916327] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-17T17:23:23.158051] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-17T17:23:23.958047] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-17T17:23:24.546809] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T17:23:24.758027] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-17T17:23:25.558040] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-17T17:23:25.989907] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T17:23:26.245609] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T17:23:26.289840] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-17T17:23:26.357992] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-17T17:23:27.158038] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-17T17:23:27.653548] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T17:23:27.834538] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-17T17:23:27.958060] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-17T17:23:28.758112] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-17T17:23:29.558046] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-17T17:23:29.561138] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-17T17:23:30.191975] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-17T17:23:30.357999] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-17T17:23:30.835773] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-17T17:23:31.158035] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-17T17:23:31.951725] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T17:23:31.958003] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-17T17:23:32.038613] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:23:32.698315] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-17T17:23:32.700211] [INFO ] [REMOTE ] AUNA: Full fetch complete (7759 records). [2025-10-17T17:23:32.700300] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-17T17:23:32.763260] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-17T17:23:33.066671] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-17T17:23:33.066764] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-17T17:23:33.066977] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-17T17:23:33.067016] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-17T17:23:33.067394] [DEBUG] [LOCAL ] AUNA: Trimmed 7759 records to 5186 (keeping 200 days of data) [2025-10-17T17:23:33.096481] [DEBUG] [LOCAL ] AUNA: Primary data saved (5186 records). [2025-10-17T17:23:33.096580] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-17T17:23:33.096690] [INFO ] [MAIN ] Update Progress: 178/2368 symbols completed. AUNA took 18.1s. Estimated remaining: 4h 48m 58s. Rate: 7.6 symbols/min [2025-10-17T17:23:33.262625] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:33.307104] [DEBUG] [LOCAL ] AVB: Loaded 42587 existing records from primary storage. [2025-10-17T17:23:33.307413] [INFO ] [MAIN ] AVB: Loaded 42587 existing records. [2025-10-17T17:23:33.481372] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:23:33.481607] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-17T17:23:33.481682] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-17T17:23:33.481940] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-17T17:23:33.481995] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-17T17:23:33.563124] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-17T17:23:33.847405] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:34.358025] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-17T17:23:34.994942] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-17T17:23:35.030523] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T17:23:35.044877] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-17T17:23:35.157997] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-17T17:23:35.779711] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T17:23:35.958098] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-17T17:23:36.758040] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-17T17:23:37.558058] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-17T17:23:38.018494] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-17T17:23:38.226447] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T17:23:38.260009] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T17:23:38.358049] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-17T17:23:39.158040] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-17T17:23:39.958035] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-17T17:23:40.005245] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T17:23:40.755358] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T17:23:40.763273] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-17T17:23:40.917784] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T17:23:41.558032] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-17T17:23:41.950591] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T17:23:42.358073] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-17T17:23:43.158071] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-17T17:23:43.248898] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-17T17:23:43.549315] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T17:23:43.958043] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-17T17:23:44.577972] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T17:23:44.758039] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-17T17:23:45.558030] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-17T17:23:46.349375] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T17:23:46.354486] [INFO ] [REMOTE ] AVA: Full fetch complete (55531 records). [2025-10-17T17:23:46.354636] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-17T17:23:46.386553] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-17T17:23:46.747406] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-17T17:23:46.747807] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-17T17:23:46.749379] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-17T17:23:46.749588] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-17T17:23:46.772963] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (2.81 seconds). [2025-10-17T17:23:46.773249] [DEBUG] [LOCAL ] AVA: Trimmed 55531 records to 39279 (keeping 200 days of data) [2025-10-17T17:23:46.781418] [INFO ] [REMOTE ] AU: Full fetch complete (76566 records). [2025-10-17T17:23:46.781795] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-17T17:23:46.988680] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T17:23:47.109373] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T17:23:47.160894] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-17T17:23:47.473607] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-17T17:23:47.474065] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-17T17:23:47.481709] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-17T17:23:47.481795] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-17T17:23:47.507437] [DEBUG] [LOCAL ] AU: Trimmed 76566 records to 53857 (keeping 200 days of data) [2025-10-17T17:23:47.510962] [DEBUG] [LOCAL ] AVA: Primary data saved (39279 records). [2025-10-17T17:23:47.511392] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-17T17:23:47.511496] [INFO ] [MAIN ] Update Progress: 179/2368 symbols completed. AVA took 31.8s. Estimated remaining: 4h 50m 9s. Rate: 7.5 symbols/min [2025-10-17T17:23:47.780970] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:47.782294] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-17T17:23:47.782712] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-17T17:23:47.784025] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-17T17:23:47.785016] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-17T17:23:47.785874] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-17T17:23:47.787439] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-17T17:23:47.963197] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-17T17:23:48.316907] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:48.440239] [DEBUG] [LOCAL ] AU: Primary data saved (53857 records). [2025-10-17T17:23:48.440400] [INFO ] [MAIN ] AU: Full history saved. [2025-10-17T17:23:48.440478] [INFO ] [MAIN ] Update Progress: 180/2368 symbols completed. AU took 40.0s. Estimated remaining: 4h 48m 36s. Rate: 7.6 symbols/min [2025-10-17T17:23:48.614436] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:48.614834] [DEBUG] [LOCAL ] AVD: No existing data file found in primary storage. [2025-10-17T17:23:48.614888] [WARN ] [MAIN ] AVD: No existing data found, performing full refresh instead. [2025-10-17T17:23:48.614999] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-17T17:23:48.615041] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-17T17:23:48.615088] [DEBUG] [LOCAL ] AVD: No primary data file found to delete. [2025-10-17T17:23:48.615126] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-17T17:23:48.762339] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-17T17:23:48.827448] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-17T17:23:48.984861] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:49.006690] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T17:23:49.048076] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:23:49.048319] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-17T17:23:49.048408] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:23:49.048484] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-17T17:23:49.048549] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:23:49.048620] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-17T17:23:49.048719] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-17T17:23:49.048763] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-17T17:23:49.048804] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-17T17:23:49.048849] [INFO ] [MAIN ] Update Progress: 181/2368 symbols completed. AVBC took 1.5s. Estimated remaining: 4h 46m 60s. Rate: 7.6 symbols/min [2025-10-17T17:23:49.217428] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:49.245149] [DEBUG] [LOCAL ] AVK: Loaded 18751 existing records from primary storage. [2025-10-17T17:23:49.245455] [INFO ] [MAIN ] AVK: Loaded 18751 existing records. [2025-10-17T17:23:49.438703] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:23:49.438910] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-17T17:23:49.438962] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-17T17:23:49.439279] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-17T17:23:49.439337] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-17T17:23:49.563151] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-17T17:23:49.804388] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:50.358032] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-17T17:23:51.020922] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-17T17:23:51.157996] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-17T17:23:51.734673] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T17:23:51.957999] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-17T17:23:51.979172] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T17:23:52.758013] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-17T17:23:53.098786] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T17:23:53.561831] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-17T17:23:53.564742] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T17:23:54.358105] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-17T17:23:54.537563] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T17:23:54.776003] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-17T17:23:55.158102] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-17T17:23:55.958073] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-17T17:23:56.284290] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T17:23:56.463524] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-17T17:23:56.758063] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-17T17:23:57.558055] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-17T17:23:57.871086] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T17:23:57.873017] [INFO ] [REMOTE ] AVAL: Full fetch complete (14935 records). [2025-10-17T17:23:57.873137] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-17T17:23:58.239526] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-17T17:23:58.239615] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-17T17:23:58.239916] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-17T17:23:58.239970] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-17T17:23:58.240443] [DEBUG] [LOCAL ] AVAL: Trimmed 14935 records to 8705 (keeping 200 days of data) [2025-10-17T17:23:58.292038] [DEBUG] [LOCAL ] AVAL: Primary data saved (8705 records). [2025-10-17T17:23:58.292143] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-17T17:23:58.292223] [INFO ] [MAIN ] Update Progress: 182/2368 symbols completed. AVAL took 38.2s. Estimated remaining: 4h 47m 8s. Rate: 7.6 symbols/min [2025-10-17T17:23:58.363126] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-17T17:23:58.478286] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:23:58.512132] [DEBUG] [LOCAL ] AVNS: Loaded 33913 existing records from primary storage. [2025-10-17T17:23:58.512407] [INFO ] [MAIN ] AVNS: Loaded 33913 existing records. [2025-10-17T17:23:58.646779] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T17:23:58.714061] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:23:58.714267] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-17T17:23:58.714315] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-17T17:23:58.714522] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-17T17:23:58.714572] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-17T17:23:59.062425] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:23:59.158014] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-17T17:23:59.390597] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T17:23:59.958056] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-17T17:24:00.446723] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-17T17:24:00.758088] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-17T17:24:01.155482] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-17T17:24:01.558032] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-17T17:24:02.091039] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-17T17:24:02.358017] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-17T17:24:02.624062] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T17:24:03.158067] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-17T17:24:03.757089] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T17:24:03.958024] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-17T17:24:04.012248] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T17:24:04.758060] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-17T17:24:05.558071] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-17T17:24:05.630942] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T17:24:05.957328] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-17T17:24:06.357996] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-17T17:24:06.735304] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-17T17:24:07.158092] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-17T17:24:07.928510] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T17:24:07.958002] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-17T17:24:08.390261] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-17T17:24:08.758097] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-17T17:24:09.215401] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T17:24:09.558036] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-17T17:24:09.830387] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T17:24:10.358089] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-17T17:24:10.501560] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-17T17:24:11.158040] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-17T17:24:11.958638] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-17T17:24:11.972809] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T17:24:12.274838] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T17:24:12.758066] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-17T17:24:13.113346] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T17:24:13.558051] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-17T17:24:14.358023] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-17T17:24:14.502850] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T17:24:14.775679] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T17:24:14.778479] [INFO ] [REMOTE ] AVD: Full fetch complete (32787 records). [2025-10-17T17:24:14.778631] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-17T17:24:15.158092] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-17T17:24:15.170409] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-17T17:24:15.170509] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-17T17:24:15.171781] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-17T17:24:15.171847] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-17T17:24:15.172901] [DEBUG] [LOCAL ] AVD: Trimmed 32787 records to 22021 (keeping 200 days of data) [2025-10-17T17:24:15.292356] [DEBUG] [LOCAL ] AVD: Primary data saved (22021 records). [2025-10-17T17:24:15.292480] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-17T17:24:15.292551] [INFO ] [MAIN ] Update Progress: 183/2368 symbols completed. AVD took 26.9s. Estimated remaining: 4h 48m 49s. Rate: 7.6 symbols/min [2025-10-17T17:24:15.464783] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:24:15.509163] [DEBUG] [LOCAL ] AVNT: Loaded 39339 existing records from primary storage. [2025-10-17T17:24:15.509526] [INFO ] [MAIN ] AVNT: Loaded 39339 existing records. [2025-10-17T17:24:15.687546] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T17:24:15.725510] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:24:15.726917] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-17T17:24:15.726998] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-17T17:24:15.727286] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-17T17:24:15.727354] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-17T17:24:15.967000] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-17T17:24:16.097870] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:24:16.336026] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-17T17:24:16.758117] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-17T17:24:17.372309] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T17:24:17.558039] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-17T17:24:18.063253] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T17:24:18.358141] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-17T17:24:19.048121] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T17:24:19.158037] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-17T17:24:19.383750] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-17T17:24:19.958109] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-17T17:24:20.758102] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-17T17:24:21.169219] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-17T17:24:21.175365] [INFO ] [REMOTE ] AVB: Full fetch complete (59166 records). [2025-10-17T17:24:21.175519] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-17T17:24:21.494517] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T17:24:21.568633] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-17T17:24:21.595801] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-17T17:24:21.595977] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-17T17:24:21.596779] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-17T17:24:21.596845] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-17T17:24:21.598607] [DEBUG] [LOCAL ] AVB: Trimmed 59166 records to 42866 (keeping 200 days of data) [2025-10-17T17:24:21.866816] [DEBUG] [LOCAL ] AVB: Primary data saved (42866 records). [2025-10-17T17:24:21.866942] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-17T17:24:21.867051] [INFO ] [MAIN ] Update Progress: 184/2368 symbols completed. AVB took 48.8s. Estimated remaining: 4h 48m 25s. Rate: 7.6 symbols/min [2025-10-17T17:24:21.983248] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-17T17:24:22.030785] [INFO ] [REMOTE ] AVK: Full fetch complete (26680 records). [2025-10-17T17:24:22.053121] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-17T17:24:22.055572] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:24:22.363124] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-17T17:24:22.520635] [DEBUG] [LOCAL ] AVTR: Loaded 53962 existing records from primary storage. [2025-10-17T17:24:22.519379] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-17T17:24:22.520868] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-17T17:24:22.521344] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-17T17:24:22.521501] [INFO ] [MAIN ] AVTR: Loaded 53962 existing records. [2025-10-17T17:24:22.564686] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-17T17:24:22.640095] [DEBUG] [LOCAL ] AVK: Trimmed 26680 records to 18858 (keeping 200 days of data) [2025-10-17T17:24:22.755183] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:24:22.755541] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-17T17:24:22.764289] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-17T17:24:22.764956] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-17T17:24:22.765127] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-17T17:24:23.250839] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:24:23.256721] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-17T17:24:23.261842] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T17:24:23.280138] [DEBUG] [LOCAL ] AVK: Primary data saved (18858 records). [2025-10-17T17:24:23.280363] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-17T17:24:23.280472] [INFO ] [MAIN ] Update Progress: 185/2368 symbols completed. AVK took 34.2s. Estimated remaining: 4h 47m 0s. Rate: 7.6 symbols/min [2025-10-17T17:24:23.471881] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:24:23.472256] [DEBUG] [LOCAL ] AVY: No existing data file found in primary storage. [2025-10-17T17:24:23.472393] [WARN ] [MAIN ] AVY: No existing data found, performing full refresh instead. [2025-10-17T17:24:23.472623] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-17T17:24:23.472751] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-17T17:24:23.472809] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-17T17:24:23.472845] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-17T17:24:23.616128] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T17:24:23.899156] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:24:23.958067] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-17T17:24:24.736786] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T17:24:24.757999] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-17T17:24:25.347844] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T17:24:25.558051] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-17T17:24:26.155665] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T17:24:26.358108] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-17T17:24:27.105115] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T17:24:27.157988] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-17T17:24:27.900098] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T17:24:27.958035] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-17T17:24:28.758016] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-17T17:24:28.859537] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T17:24:29.388004] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T17:24:29.558075] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-17T17:24:30.358034] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-17T17:24:30.461141] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T17:24:31.022046] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T17:24:31.158029] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-17T17:24:31.504881] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-17T17:24:31.958047] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-17T17:24:32.763108] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-17T17:24:32.777350] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T17:24:33.492541] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T17:24:33.557997] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-17T17:24:34.358029] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-17T17:24:34.499841] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T17:24:35.121317] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T17:24:35.158018] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-17T17:24:35.966367] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-17T17:24:35.998633] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T17:24:36.205186] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T17:24:36.758027] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-17T17:24:37.558004] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-17T17:24:37.870107] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T17:24:38.335682] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T17:24:38.357999] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-17T17:24:38.727628] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T17:24:39.158063] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-17T17:24:39.857701] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T17:24:39.958037] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-17T17:24:40.280265] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T17:24:40.285016] [INFO ] [REMOTE ] AVNS: Full fetch complete (48385 records). [2025-10-17T17:24:40.285128] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-17T17:24:40.659033] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-17T17:24:40.659133] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-17T17:24:40.659740] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-17T17:24:40.659807] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-17T17:24:40.660999] [DEBUG] [LOCAL ] AVNS: Trimmed 48385 records to 34111 (keeping 200 days of data) [2025-10-17T17:24:40.758869] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-17T17:24:40.856376] [DEBUG] [LOCAL ] AVNS: Primary data saved (34111 records). [2025-10-17T17:24:40.856519] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-17T17:24:40.856598] [INFO ] [MAIN ] Update Progress: 186/2368 symbols completed. AVNS took 42.6s. Estimated remaining: 4h 48m 46s. Rate: 7.6 symbols/min [2025-10-17T17:24:41.025745] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:24:41.049484] [DEBUG] [LOCAL ] AWF: Loaded 24143 existing records from primary storage. [2025-10-17T17:24:41.049782] [INFO ] [MAIN ] AWF: Loaded 24143 existing records. [2025-10-17T17:24:41.234795] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:24:41.235241] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-17T17:24:41.235356] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-17T17:24:41.235801] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-17T17:24:41.235864] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-17T17:24:41.368119] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T17:24:41.563115] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-17T17:24:41.630717] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:24:42.333785] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T17:24:42.357997] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-17T17:24:43.044555] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T17:24:43.158047] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-17T17:24:43.798782] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T17:24:43.958062] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-17T17:24:44.542619] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T17:24:44.758023] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-17T17:24:45.562288] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-17T17:24:45.564431] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T17:24:45.570505] [INFO ] [REMOTE ] AVNT: Full fetch complete (56363 records). [2025-10-17T17:24:45.570892] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-17T17:24:45.972126] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-17T17:24:45.972291] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-17T17:24:45.973038] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-17T17:24:45.973105] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-17T17:24:45.974750] [DEBUG] [LOCAL ] AVNT: Trimmed 56363 records to 39562 (keeping 200 days of data) [2025-10-17T17:24:46.257603] [DEBUG] [LOCAL ] AVNT: Primary data saved (39562 records). [2025-10-17T17:24:46.259532] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-17T17:24:46.259774] [INFO ] [MAIN ] Update Progress: 187/2368 symbols completed. AVNT took 31.0s. Estimated remaining: 4h 48m 9s. Rate: 7.6 symbols/min [2025-10-17T17:24:46.259396] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:24:46.363707] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-17T17:24:46.450016] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:24:46.482579] [DEBUG] [LOCAL ] AWI: Loaded 25598 existing records from primary storage. [2025-10-17T17:24:46.483089] [INFO ] [MAIN ] AWI: Loaded 25598 existing records. [2025-10-17T17:24:46.671445] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:24:46.671726] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-17T17:24:46.671785] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-17T17:24:46.671981] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-17T17:24:46.672019] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-17T17:24:47.050884] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:24:47.079057] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T17:24:47.158010] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-17T17:24:47.552210] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T17:24:47.958056] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-17T17:24:48.758064] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-17T17:24:49.045821] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-17T17:24:49.096813] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T17:24:49.558037] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-17T17:24:49.911878] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T17:24:50.358045] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-17T17:24:50.872947] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T17:24:51.040983] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T17:24:51.158052] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-17T17:24:51.958056] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-17T17:24:52.307787] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T17:24:52.758093] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-17T17:24:53.569562] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-17T17:24:53.571751] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T17:24:53.882581] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T17:24:54.358047] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-17T17:24:55.016044] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T17:24:55.138089] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T17:24:55.157984] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-17T17:24:55.958019] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-17T17:24:56.578719] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T17:24:56.758057] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-17T17:24:57.503120] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T17:24:57.509084] [INFO ] [REMOTE ] AVY: Full fetch complete (56647 records). [2025-10-17T17:24:57.509232] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-17T17:24:57.563297] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-17T17:24:57.889167] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-17T17:24:57.889243] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-17T17:24:57.889846] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-17T17:24:57.889908] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-17T17:24:57.891031] [DEBUG] [LOCAL ] AVY: Trimmed 56647 records to 38653 (keeping 200 days of data) [2025-10-17T17:24:58.126705] [DEBUG] [LOCAL ] AVY: Primary data saved (38653 records). [2025-10-17T17:24:58.126835] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-17T17:24:58.126906] [INFO ] [MAIN ] Update Progress: 188/2368 symbols completed. AVY took 34.8s. Estimated remaining: 4h 48m 46s. Rate: 7.5 symbols/min [2025-10-17T17:24:58.310897] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T17:24:58.328507] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:24:58.360375] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-17T17:24:58.382682] [DEBUG] [LOCAL ] AWK: Loaded 48909 existing records from primary storage. [2025-10-17T17:24:58.383042] [INFO ] [MAIN ] AWK: Loaded 48909 existing records. [2025-10-17T17:24:58.559150] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:24:58.559391] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-17T17:24:58.559437] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-17T17:24:58.559747] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-17T17:24:58.559808] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-17T17:24:58.687060] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T17:24:58.925343] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:24:59.158012] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-17T17:24:59.539045] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T17:24:59.958036] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-17T17:25:00.757994] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-17T17:25:01.258424] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-17T17:25:01.321634] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T17:25:01.558030] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-17T17:25:02.068689] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T17:25:02.358041] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-17T17:25:02.912933] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T17:25:03.158076] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-17T17:25:03.511355] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T17:25:03.958039] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-17T17:25:04.758015] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-17T17:25:04.884841] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T17:25:05.433041] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:25:05.558047] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-17T17:25:05.795047] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T17:25:06.358032] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-17T17:25:07.158085] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-17T17:25:07.587591] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-17T17:25:07.738514] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-17T17:25:07.958082] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-17T17:25:08.758085] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-17T17:25:09.196286] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-17T17:25:09.233031] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T17:25:09.238781] [INFO ] [REMOTE ] AWF: Full fetch complete (35909 records). [2025-10-17T17:25:09.238952] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-17T17:25:09.563238] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-17T17:25:09.621865] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-17T17:25:09.621942] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-17T17:25:09.622372] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-17T17:25:09.622412] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-17T17:25:09.623184] [DEBUG] [LOCAL ] AWF: Trimmed 35909 records to 24387 (keeping 200 days of data) [2025-10-17T17:25:09.765408] [DEBUG] [LOCAL ] AWF: Primary data saved (24387 records). [2025-10-17T17:25:09.765539] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-17T17:25:09.765618] [INFO ] [MAIN ] Update Progress: 189/2368 symbols completed. AWF took 28.9s. Estimated remaining: 4h 49m 21s. Rate: 7.5 symbols/min [2025-10-17T17:25:09.932799] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:25:09.956009] [DEBUG] [LOCAL ] AWP: Loaded 21759 existing records from primary storage. [2025-10-17T17:25:09.956253] [INFO ] [MAIN ] AWP: Loaded 21759 existing records. [2025-10-17T17:25:10.131453] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:25:10.142307] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-17T17:25:10.142628] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T17:25:10.146560] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-17T17:25:10.146932] [INFO ] [REMOTE ] AWI: Full fetch complete (36045 records). [2025-10-17T17:25:10.147085] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-17T17:25:10.147047] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-17T17:25:10.147254] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-17T17:25:10.362873] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-17T17:25:10.857135] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:25:10.895625] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-17T17:25:10.895736] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-17T17:25:10.896181] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-17T17:25:10.896223] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-17T17:25:10.897061] [DEBUG] [LOCAL ] AWI: Trimmed 36045 records to 25722 (keeping 200 days of data) [2025-10-17T17:25:11.051759] [DEBUG] [LOCAL ] AWI: Primary data saved (25722 records). [2025-10-17T17:25:11.051895] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-17T17:25:11.051981] [INFO ] [MAIN ] Update Progress: 190/2368 symbols completed. AWI took 24.8s. Estimated remaining: 4h 47m 56s. Rate: 7.6 symbols/min [2025-10-17T17:25:11.163143] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-17T17:25:11.220141] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:25:11.240774] [DEBUG] [LOCAL ] AWR: Loaded 23000 existing records from primary storage. [2025-10-17T17:25:11.241040] [INFO ] [MAIN ] AWR: Loaded 23000 existing records. [2025-10-17T17:25:11.417942] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:25:11.418385] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-17T17:25:11.418529] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-17T17:25:11.418958] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-17T17:25:11.419111] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-17T17:25:11.780439] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-17T17:25:11.820269] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:25:11.958005] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-17T17:25:12.267302] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T17:25:12.730085] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T17:25:12.758039] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-17T17:25:13.558039] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-17T17:25:13.996067] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T17:25:14.030007] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T17:25:14.358044] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-17T17:25:15.158029] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-17T17:25:15.426231] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T17:25:15.437222] [INFO ] [REMOTE ] AVTR: Full fetch complete (77647 records). [2025-10-17T17:25:15.437388] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-17T17:25:15.844466] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-17T17:25:15.844555] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-17T17:25:15.845366] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-17T17:25:15.845430] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-17T17:25:15.846948] [DEBUG] [LOCAL ] AVTR: Trimmed 77647 records to 54352 (keeping 200 days of data) [2025-10-17T17:25:15.958188] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-17T17:25:16.099736] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T17:25:16.210085] [DEBUG] [LOCAL ] AVTR: Primary data saved (54352 records). [2025-10-17T17:25:16.210237] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-17T17:25:16.210322] [INFO ] [MAIN ] Update Progress: 191/2368 symbols completed. AVTR took 54.3s. Estimated remaining: 4h 47m 17s. Rate: 7.6 symbols/min [2025-10-17T17:25:16.380142] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:25:16.407262] [DEBUG] [LOCAL ] AX: Loaded 28285 existing records from primary storage. [2025-10-17T17:25:16.407562] [INFO ] [MAIN ] AX: Loaded 28285 existing records. [2025-10-17T17:25:16.563455] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T17:25:16.602422] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:25:16.602592] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-17T17:25:16.602695] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-17T17:25:16.602957] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-17T17:25:16.602996] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-17T17:25:16.758038] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-17T17:25:16.971032] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:25:17.001051] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T17:25:17.558039] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-17T17:25:17.902086] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T17:25:18.358067] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-17T17:25:18.633154] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T17:25:19.158091] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-17T17:25:19.831769] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T17:25:19.958068] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-17T17:25:20.574575] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T17:25:20.758036] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-17T17:25:21.376117] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T17:25:21.558045] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-17T17:25:21.813813] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T17:25:22.358064] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-17T17:25:22.579188] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T17:25:23.158048] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-17T17:25:23.438370] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T17:25:23.958020] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-17T17:25:24.323528] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T17:25:24.758046] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-17T17:25:25.404794] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T17:25:25.558041] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-17T17:25:26.054468] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T17:25:26.358106] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-17T17:25:26.872305] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T17:25:27.158045] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-17T17:25:27.958087] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-17T17:25:28.235714] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T17:25:28.554955] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T17:25:28.758008] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-17T17:25:28.987407] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T17:25:29.558021] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-17T17:25:30.025690] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T17:25:30.358031] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-17T17:25:30.803545] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-17T17:25:31.158033] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-17T17:25:31.958005] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-17T17:25:32.130493] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T17:25:32.196633] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T17:25:32.758020] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-17T17:25:32.990689] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-17T17:25:33.558049] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-17T17:25:34.358037] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-17T17:25:34.426102] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T17:25:34.836328] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T17:25:35.158043] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-17T17:25:35.245776] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-17T17:25:35.958075] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-17T17:25:36.123829] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-17T17:25:36.758048] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-17T17:25:37.557985] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-17T17:25:37.598150] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T17:25:37.795458] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T17:25:37.803149] [INFO ] [REMOTE ] AWP: Full fetch complete (31876 records). [2025-10-17T17:25:37.803937] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-17T17:25:38.176563] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-17T17:25:38.176673] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-17T17:25:38.177110] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-17T17:25:38.177153] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-17T17:25:38.178895] [DEBUG] [LOCAL ] AWP: Trimmed 31876 records to 21887 (keeping 200 days of data) [2025-10-17T17:25:38.302102] [DEBUG] [LOCAL ] AWP: Primary data saved (21887 records). [2025-10-17T17:25:38.302228] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-17T17:25:38.302305] [INFO ] [MAIN ] Update Progress: 192/2368 symbols completed. AWP took 28.5s. Estimated remaining: 4h 49m 50s. Rate: 7.5 symbols/min [2025-10-17T17:25:38.364444] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-17T17:25:38.495571] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:25:38.543091] [DEBUG] [LOCAL ] AXL: Loaded 50921 existing records from primary storage. [2025-10-17T17:25:38.543416] [INFO ] [MAIN ] AXL: Loaded 50921 existing records. [2025-10-17T17:25:38.713041] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T17:25:38.748968] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:25:38.749614] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-17T17:25:38.749954] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-17T17:25:38.750345] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-17T17:25:38.750403] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-17T17:25:39.159240] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:25:39.159364] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-17T17:25:39.957998] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-17T17:25:40.247407] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T17:25:40.254672] [INFO ] [REMOTE ] AWK: Full fetch complete (70882 records). [2025-10-17T17:25:40.254833] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-17T17:25:40.661843] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T17:25:40.692843] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-17T17:25:40.693184] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-17T17:25:40.693994] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-17T17:25:40.694079] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-17T17:25:40.695968] [DEBUG] [LOCAL ] AWK: Trimmed 70882 records to 49233 (keeping 200 days of data) [2025-10-17T17:25:40.760578] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-17T17:25:41.000557] [DEBUG] [LOCAL ] AWK: Primary data saved (49233 records). [2025-10-17T17:25:41.000770] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-17T17:25:41.001740] [INFO ] [MAIN ] Update Progress: 193/2368 symbols completed. AWK took 42.9s. Estimated remaining: 4h 48m 42s. Rate: 7.5 symbols/min [2025-10-17T17:25:41.179011] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:25:41.231583] [DEBUG] [LOCAL ] AXP: Loaded 53555 existing records from primary storage. [2025-10-17T17:25:41.231943] [INFO ] [MAIN ] AXP: Loaded 53555 existing records. [2025-10-17T17:25:41.407547] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:25:41.407855] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-17T17:25:41.407918] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-17T17:25:41.408485] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-17T17:25:41.408549] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-17T17:25:41.586876] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-17T17:25:41.808726] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:25:41.835702] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T17:25:42.038992] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-17T17:25:42.358019] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-17T17:25:42.476225] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T17:25:43.158004] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-17T17:25:43.762710] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T17:25:43.958034] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-17T17:25:44.288224] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T17:25:44.758031] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-17T17:25:45.554373] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T17:25:45.564000] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-17T17:25:45.607329] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T17:25:45.610819] [INFO ] [REMOTE ] AWR: Full fetch complete (32324 records). [2025-10-17T17:25:45.610902] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-17T17:25:45.969469] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-17T17:25:45.969548] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-17T17:25:45.969993] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-17T17:25:45.970057] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-17T17:25:45.970886] [DEBUG] [LOCAL ] AWR: Trimmed 32324 records to 23114 (keeping 200 days of data) [2025-10-17T17:25:46.107275] [DEBUG] [LOCAL ] AWR: Primary data saved (23114 records). [2025-10-17T17:25:46.107398] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-17T17:25:46.107495] [INFO ] [MAIN ] Update Progress: 194/2368 symbols completed. AWR took 35.1s. Estimated remaining: 4h 48m 2s. Rate: 7.5 symbols/min [2025-10-17T17:25:46.272477] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:25:46.272670] [DEBUG] [LOCAL ] AXR: No existing data file found in primary storage. [2025-10-17T17:25:46.272725] [WARN ] [MAIN ] AXR: No existing data found, performing full refresh instead. [2025-10-17T17:25:46.272837] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-17T17:25:46.272878] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-17T17:25:46.272918] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-17T17:25:46.272950] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-17T17:25:46.365918] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-17T17:25:46.620005] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:25:46.982384] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-17T17:25:46.986164] [INFO ] [REMOTE ] AX: Full fetch complete (42053 records). [2025-10-17T17:25:46.986270] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-17T17:25:46.986840] [FATAL] [VALIDATOR ] AX: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:25:46.986930] [FATAL] [MAIN ] AX: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:25:46.986992] [WARN ] [MAIN ] AX: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:25:46.987063] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-17T17:25:46.987128] [DEBUG] [LOCAL ] AX: No primary data file found to delete. [2025-10-17T17:25:46.987163] [INFO ] [LOCAL ] AX: Starting deletion of derivative data. [2025-10-17T17:25:46.987378] [DEBUG] [LOCAL ] AX: Deleted derivative data file. [2025-10-17T17:25:46.987485] [INFO ] [MAIN ] Update Progress: 195/2368 symbols completed. AX took 30.8s. Estimated remaining: 4h 46m 35s. Rate: 7.6 symbols/min [2025-10-17T17:25:47.154142] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:25:47.158061] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-17T17:25:47.192385] [DEBUG] [LOCAL ] AXS: Loaded 38896 existing records from primary storage. [2025-10-17T17:25:47.192700] [INFO ] [MAIN ] AXS: Loaded 38896 existing records. [2025-10-17T17:25:47.368638] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:25:47.368866] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-17T17:25:47.368912] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-17T17:25:47.369301] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-17T17:25:47.369356] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-17T17:25:47.727071] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:25:47.844705] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T17:25:47.884618] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T17:25:47.958029] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-17T17:25:48.758092] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-17T17:25:49.336195] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T17:25:49.558037] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-17T17:25:50.206937] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T17:25:50.358027] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-17T17:25:50.808120] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T17:25:50.826013] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T17:25:51.158040] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-17T17:25:51.958041] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-17T17:25:52.531014] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T17:25:52.758061] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-17T17:25:53.558008] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-17T17:25:54.062899] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-17T17:25:54.096488] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-17T17:25:54.141925] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T17:25:54.358058] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-17T17:25:55.158087] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-17T17:25:55.958131] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-17T17:25:56.394721] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-17T17:25:56.758079] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-17T17:25:56.952422] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T17:25:57.342018] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T17:25:57.398807] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T17:25:57.558071] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-17T17:25:58.140063] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-17T17:25:58.358084] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-17T17:25:59.158097] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-17T17:25:59.727258] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-17T17:25:59.958077] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-17T17:26:00.173518] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T17:26:00.758052] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-17T17:26:01.558075] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-17T17:26:01.884494] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T17:26:02.190972] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-17T17:26:02.358052] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-17T17:26:02.488955] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T17:26:02.667290] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-17T17:26:03.158037] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-17T17:26:03.731184] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T17:26:03.958106] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-17T17:26:04.547098] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T17:26:04.548207] [INFO ] [REMOTE ] AXR: Full fetch complete (4435 records). [2025-10-17T17:26:04.548333] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-17T17:26:04.763706] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-17T17:26:04.928725] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-17T17:26:04.928854] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-17T17:26:04.929063] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-17T17:26:04.929148] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-17T17:26:04.929816] [DEBUG] [LOCAL ] AXR: Trimmed 4435 records to 2975 (keeping 200 days of data) [2025-10-17T17:26:04.949001] [DEBUG] [LOCAL ] AXR: Primary data saved (2975 records). [2025-10-17T17:26:04.949154] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-17T17:26:04.949239] [INFO ] [MAIN ] Update Progress: 196/2368 symbols completed. AXR took 18.8s. Estimated remaining: 4h 48m 19s. Rate: 7.5 symbols/min [2025-10-17T17:26:05.124225] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:26:05.193828] [DEBUG] [LOCAL ] AXTA: Loaded 52641 existing records from primary storage. [2025-10-17T17:26:05.194345] [INFO ] [MAIN ] AXTA: Loaded 52641 existing records. [2025-10-17T17:26:05.401309] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:26:05.401663] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-17T17:26:05.401732] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-17T17:26:05.402215] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-17T17:26:05.402275] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-17T17:26:05.563372] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-17T17:26:05.782731] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:26:06.358060] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-17T17:26:07.158043] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-17T17:26:07.193526] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-17T17:26:07.266879] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T17:26:07.958078] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-17T17:26:08.058191] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:26:08.636559] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T17:26:08.758091] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-17T17:26:09.558018] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-17T17:26:09.665937] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T17:26:10.357995] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-17T17:26:10.472133] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T17:26:10.661987] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T17:26:11.158070] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-17T17:26:11.958050] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-17T17:26:12.060009] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T17:26:12.371572] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T17:26:12.758067] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-17T17:26:13.222711] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T17:26:13.558039] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-17T17:26:14.358096] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-17T17:26:14.456968] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T17:26:15.158046] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-17T17:26:15.718386] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-17T17:26:15.958025] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-17T17:26:16.167792] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T17:26:16.683235] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T17:26:16.758009] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-17T17:26:17.558092] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-17T17:26:18.063441] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-17T17:26:18.235213] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:26:18.358051] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-17T17:26:19.158059] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-17T17:26:19.608485] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-17T17:26:19.615601] [INFO ] [REMOTE ] AXL: Full fetch complete (73085 records). [2025-10-17T17:26:19.615785] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-17T17:26:19.972038] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T17:26:19.970471] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-17T17:26:20.044792] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-17T17:26:20.044906] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-17T17:26:20.044542] [INFO ] [REMOTE ] AXS: Full fetch complete (55938 records). [2025-10-17T17:26:20.045724] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-17T17:26:20.045948] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-17T17:26:20.046071] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-17T17:26:20.154399] [DEBUG] [LOCAL ] AXL: Trimmed 73085 records to 51268 (keeping 200 days of data) [2025-10-17T17:26:20.670239] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-17T17:26:20.671726] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-17T17:26:20.673033] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-17T17:26:20.673114] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-17T17:26:20.684490] [DEBUG] [LOCAL ] AXS: Trimmed 55938 records to 39196 (keeping 200 days of data) [2025-10-17T17:26:20.887273] [DEBUG] [LOCAL ] AXL: Primary data saved (51268 records). [2025-10-17T17:26:20.891137] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-17T17:26:20.891319] [INFO ] [MAIN ] Update Progress: 197/2368 symbols completed. AXL took 42.6s. Estimated remaining: 4h 49m 39s. Rate: 7.5 symbols/min [2025-10-17T17:26:21.024614] [DEBUG] [LOCAL ] AXS: Primary data saved (39196 records). [2025-10-17T17:26:21.024780] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-17T17:26:21.024880] [INFO ] [MAIN ] Update Progress: 198/2368 symbols completed. AXS took 34.0s. Estimated remaining: 4h 48m 4s. Rate: 7.5 symbols/min [2025-10-17T17:26:21.201054] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T17:26:21.213215] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-17T17:26:22.232600] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-17T17:26:22.244463] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-17T17:26:22.966700] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T17:26:22.977832] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-17T17:26:24.377357] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-17T17:26:24.392948] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-17T17:26:24.527550] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T17:26:24.538624] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-17T17:26:26.063783] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T17:26:26.075919] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-17T17:26:26.243587] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T17:26:26.256729] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-17T17:26:27.820028] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T17:26:27.832275] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-17T17:26:28.387047] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-17T17:26:28.395493] [INFO ] [REMOTE ] AXP: Full fetch complete (77092 records). [2025-10-17T17:26:28.395806] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-17T17:26:28.836278] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-17T17:26:28.836377] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-17T17:26:28.837308] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-17T17:26:28.837378] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-17T17:26:28.839033] [DEBUG] [LOCAL ] AXP: Trimmed 77092 records to 53945 (keeping 200 days of data) [2025-10-17T17:26:29.201637] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T17:26:29.214427] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-17T17:26:29.236946] [DEBUG] [LOCAL ] AXP: Primary data saved (53945 records). [2025-10-17T17:26:29.237107] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-17T17:26:29.238313] [INFO ] [MAIN ] Update Progress: 199/2368 symbols completed. AXP took 48.2s. Estimated remaining: 4h 47m 59s. Rate: 7.5 symbols/min [2025-10-17T17:26:30.858101] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T17:26:30.865678] [INFO ] [REMOTE ] AXTA: Full fetch complete (75391 records). [2025-10-17T17:26:30.865813] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-17T17:26:31.256676] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-17T17:26:31.256763] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-17T17:26:31.257525] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-17T17:26:31.257591] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-17T17:26:31.259072] [DEBUG] [LOCAL ] AXTA: Trimmed 75391 records to 53031 (keeping 200 days of data) [2025-10-17T17:26:31.571907] [DEBUG] [LOCAL ] AXTA: Primary data saved (53031 records). [2025-10-17T17:26:31.572136] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-17T17:26:31.573087] [INFO ] [MAIN ] Update Progress: 200/2368 symbols completed. AXTA took 26.6s. Estimated remaining: 4h 46m 50s. Rate: 7.6 symbols/min [2025-10-17T17:26:32.062456] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:26:32.245715] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:26:32.275175] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:26:32.252677] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:26:32.276424] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-17T17:26:32.276618] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-17T17:26:32.276796] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-17T17:26:32.276863] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-17T17:26:32.276942] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-17T17:26:32.277027] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-17T17:26:32.313116] [DEBUG] [LOCAL ] AZO: Loaded 11071 existing records from primary storage. [2025-10-17T17:26:32.347210] [INFO ] [MAIN ] AZO: Loaded 11071 existing records. [2025-10-17T17:26:32.588693] [DEBUG] [LOCAL ] AYI: Loaded 25059 existing records from primary storage. [2025-10-17T17:26:32.588597] [DEBUG] [LOCAL ] AZZ: Loaded 22902 existing records from primary storage. [2025-10-17T17:26:32.614940] [INFO ] [MAIN ] AYI: Loaded 25059 existing records. [2025-10-17T17:26:32.637993] [INFO ] [MAIN ] AZZ: Loaded 22902 existing records. [2025-10-17T17:26:32.982134] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:26:32.990234] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-17T17:26:33.042304] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-17T17:26:33.153594] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-17T17:26:33.219244] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:26:33.266424] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:26:33.266865] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-17T17:26:33.270561] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:26:33.267699] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-17T17:26:33.237543] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-17T17:26:33.282275] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-17T17:26:33.292163] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-17T17:26:33.292340] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-17T17:26:33.301715] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-17T17:26:33.306932] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-17T17:26:33.301583] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-17T17:26:33.338709] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-17T17:26:34.216217] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:26:34.307445] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-17T17:26:34.349793] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:26:34.356968] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-17T17:26:34.435829] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:26:34.436140] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-17T17:26:34.779415] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T17:26:34.786192] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-17T17:26:35.107598] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-17T17:26:35.111170] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-17T17:26:35.317223] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-17T17:26:35.322671] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-17T17:26:35.519934] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T17:26:35.524366] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-17T17:26:35.897442] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T17:26:35.903481] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-17T17:26:36.021268] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T17:26:36.024066] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-17T17:26:36.101864] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:26:36.102178] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-17T17:26:36.102268] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:26:36.102359] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-17T17:26:36.102444] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:26:36.102531] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-17T17:26:36.102613] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-17T17:26:36.102711] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-17T17:26:36.102785] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-17T17:26:36.102851] [INFO ] [MAIN ] Update Progress: 201/2368 symbols completed. B took 4.5s. Estimated remaining: 4h 46m 5s. Rate: 7.6 symbols/min [2025-10-17T17:26:36.268901] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:26:36.325384] [DEBUG] [LOCAL ] BA: Loaded 54180 existing records from primary storage. [2025-10-17T17:26:36.325707] [INFO ] [MAIN ] BA: Loaded 54180 existing records. [2025-10-17T17:26:36.503853] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:26:36.504056] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-17T17:26:36.504102] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-17T17:26:36.504520] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-17T17:26:36.504558] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-17T17:26:36.768911] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T17:26:36.807243] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-17T17:26:36.884701] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T17:26:36.897571] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:26:36.900319] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-17T17:26:36.919623] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T17:26:37.557989] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-17T17:26:37.915184] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T17:26:38.358007] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-17T17:26:38.570123] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T17:26:39.159089] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-17T17:26:39.184112] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-17T17:26:39.214372] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T17:26:39.958066] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-17T17:26:40.231693] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T17:26:40.758081] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-17T17:26:41.558012] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-17T17:26:42.086448] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-17T17:26:42.125456] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-17T17:26:42.358063] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-17T17:26:42.516182] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-17T17:26:43.158037] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-17T17:26:43.958012] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-17T17:26:44.245979] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T17:26:44.269460] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T17:26:44.758010] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-17T17:26:44.881026] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T17:26:45.558032] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-17T17:26:46.358044] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-17T17:26:46.467946] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-17T17:26:46.988386] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-17T17:26:47.158017] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-17T17:26:47.395201] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T17:26:47.958068] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-17T17:26:48.758043] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-17T17:26:49.060752] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-17T17:26:49.489598] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-17T17:26:49.558042] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-17T17:26:50.341093] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T17:26:50.357987] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-17T17:26:50.399293] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T17:26:51.158058] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-17T17:26:51.958050] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-17T17:26:52.218784] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T17:26:52.741935] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T17:26:52.757992] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-17T17:26:52.860450] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-17T17:26:53.558083] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-17T17:26:53.695062] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T17:26:54.358071] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-17T17:26:54.694379] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T17:26:55.158005] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-17T17:26:55.641177] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T17:26:55.944967] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T17:26:55.946868] [INFO ] [REMOTE ] AZO: Full fetch complete (15923 records). [2025-10-17T17:26:55.946939] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-17T17:26:55.967848] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-17T17:26:56.321389] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-17T17:26:56.321469] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-17T17:26:56.321781] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-17T17:26:56.321841] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-17T17:26:56.322550] [DEBUG] [LOCAL ] AZO: Trimmed 15923 records to 11148 (keeping 200 days of data) [2025-10-17T17:26:56.391208] [DEBUG] [LOCAL ] AZO: Primary data saved (11148 records). [2025-10-17T17:26:56.391344] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-17T17:26:56.391426] [INFO ] [MAIN ] Update Progress: 202/2368 symbols completed. AZO took 24.8s. Estimated remaining: 4h 48m 10s. Rate: 7.5 symbols/min [2025-10-17T17:26:56.558388] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:26:56.613929] [DEBUG] [LOCAL ] BABA: Loaded 54210 existing records from primary storage. [2025-10-17T17:26:56.614263] [INFO ] [MAIN ] BABA: Loaded 54210 existing records. [2025-10-17T17:26:56.763269] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-17T17:26:56.795047] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:26:56.796515] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-17T17:26:56.796579] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-17T17:26:56.797118] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-17T17:26:56.797176] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-17T17:26:57.203771] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:26:57.558068] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-17T17:26:57.925990] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-17T17:26:58.358117] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-17T17:26:58.513954] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-17T17:26:58.572055] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T17:26:59.158032] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-17T17:26:59.958036] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-17T17:27:00.758090] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-17T17:27:01.111899] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-17T17:27:01.298282] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.94 seconds). [2025-10-17T17:27:01.558061] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-17T17:27:01.889791] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-17T17:27:02.231484] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T17:27:02.358095] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-17T17:27:02.460072] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-17T17:27:02.464617] [INFO ] [REMOTE ] AZZ: Full fetch complete (31995 records). [2025-10-17T17:27:02.464823] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-17T17:27:02.849031] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-17T17:27:02.849136] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-17T17:27:02.849764] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-17T17:27:02.849838] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-17T17:27:02.851208] [DEBUG] [LOCAL ] AZZ: Trimmed 31995 records to 23075 (keeping 200 days of data) [2025-10-17T17:27:03.007455] [DEBUG] [LOCAL ] AZZ: Primary data saved (23075 records). [2025-10-17T17:27:03.007996] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-17T17:27:03.008111] [INFO ] [MAIN ] Update Progress: 203/2368 symbols completed. AZZ took 31.4s. Estimated remaining: 4h 47m 48s. Rate: 7.5 symbols/min [2025-10-17T17:27:03.166341] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-17T17:27:03.196566] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:27:03.261771] [DEBUG] [LOCAL ] BAC: Loaded 54198 existing records from primary storage. [2025-10-17T17:27:03.262457] [INFO ] [MAIN ] BAC: Loaded 54198 existing records. [2025-10-17T17:27:03.451687] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:27:03.452043] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-17T17:27:03.452098] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-17T17:27:03.452752] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-17T17:27:03.452829] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-17T17:27:03.828126] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:27:03.958053] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-17T17:27:04.758102] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-17T17:27:04.955416] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-17T17:27:05.097052] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T17:27:05.208821] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-17T17:27:05.558030] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-17T17:27:06.358086] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-17T17:27:06.830284] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T17:27:06.836266] [INFO ] [REMOTE ] AYI: Full fetch complete (37011 records). [2025-10-17T17:27:06.836476] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-17T17:27:07.159369] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-17T17:27:07.354740] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-17T17:27:07.354950] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-17T17:27:07.355466] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-17T17:27:07.355545] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-17T17:27:07.391318] [DEBUG] [LOCAL ] AYI: Trimmed 37011 records to 25175 (keeping 200 days of data) [2025-10-17T17:27:07.393741] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-17T17:27:07.571365] [DEBUG] [LOCAL ] AYI: Primary data saved (25175 records). [2025-10-17T17:27:07.571502] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-17T17:27:07.571589] [INFO ] [MAIN ] Update Progress: 204/2368 symbols completed. AYI took 36.0s. Estimated remaining: 4h 47m 3s. Rate: 7.5 symbols/min [2025-10-17T17:27:07.748780] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:27:07.798133] [DEBUG] [LOCAL ] BAH: Loaded 52097 existing records from primary storage. [2025-10-17T17:27:07.798454] [INFO ] [MAIN ] BAH: Loaded 52097 existing records. [2025-10-17T17:27:07.966896] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-17T17:27:07.973539] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:27:07.974903] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-17T17:27:07.974972] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-17T17:27:07.975355] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-17T17:27:07.975397] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-17T17:27:08.324673] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:27:08.668950] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-17T17:27:08.758029] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-17T17:27:09.558073] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-17T17:27:09.754773] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-17T17:27:10.358056] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-17T17:27:10.532347] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-17T17:27:11.158117] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-17T17:27:11.429460] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T17:27:11.503339] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-17T17:27:11.511885] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-17T17:27:11.512068] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-17T17:27:11.916218] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-17T17:27:11.916312] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-17T17:27:11.917102] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-17T17:27:11.917169] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-17T17:27:11.918760] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 54570 (keeping 200 days of data) [2025-10-17T17:27:11.969795] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-17T17:27:12.267244] [DEBUG] [LOCAL ] BA: Primary data saved (54570 records). [2025-10-17T17:27:12.267401] [INFO ] [MAIN ] BA: Full history saved. [2025-10-17T17:27:12.268150] [INFO ] [MAIN ] Update Progress: 205/2368 symbols completed. BA took 36.2s. Estimated remaining: 4h 46m 21s. Rate: 7.6 symbols/min [2025-10-17T17:27:12.436675] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:27:12.475314] [DEBUG] [LOCAL ] BAK: Loaded 39589 existing records from primary storage. [2025-10-17T17:27:12.475671] [INFO ] [MAIN ] BAK: Loaded 39589 existing records. [2025-10-17T17:27:12.653419] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:27:12.653670] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-17T17:27:12.653731] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-17T17:27:12.654061] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-17T17:27:12.654102] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-17T17:27:13.026287] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:27:13.026965] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-17T17:27:13.139195] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-10-17T17:27:13.193755] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-17T17:27:13.557993] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-17T17:27:13.757453] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T17:27:14.358086] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-17T17:27:15.111889] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-17T17:27:15.158048] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-17T17:27:15.958074] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-17T17:27:16.033832] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-17T17:27:16.686882] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-17T17:27:16.757987] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-17T17:27:17.054371] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-17T17:27:17.558008] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-17T17:27:17.652187] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T17:27:18.358036] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-17T17:27:19.158044] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-17T17:27:19.313366] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-17T17:27:19.915248] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T17:27:19.958026] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-17T17:27:20.125379] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-17T17:27:20.587995] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T17:27:20.758019] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-17T17:27:21.558007] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-17T17:27:21.668290] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T17:27:22.358032] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-17T17:27:23.147278] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-17T17:27:23.158332] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-17T17:27:23.958085] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-17T17:27:24.137799] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:27:24.241020] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-17T17:27:24.545895] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-17T17:27:24.758084] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-17T17:27:25.558039] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-17T17:27:26.111060] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-17T17:27:26.358007] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-17T17:27:26.518865] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T17:27:27.158032] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-17T17:27:27.958063] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-17T17:27:28.295671] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-17T17:27:28.758049] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-17T17:27:28.799338] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-17T17:27:29.015190] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T17:27:29.062412] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T17:27:29.558068] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-17T17:27:30.358046] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-17T17:27:31.158064] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-17T17:27:31.270569] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T17:27:31.381730] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-17T17:27:31.897093] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T17:27:31.958039] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-17T17:27:32.758073] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-17T17:27:33.228588] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-17T17:27:33.558007] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-17T17:27:33.722504] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T17:27:34.358049] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-17T17:27:35.158037] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-17T17:27:35.590448] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-17T17:27:35.849437] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T17:27:35.891342] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-17T17:27:35.958018] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-17T17:27:36.758086] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-17T17:27:37.100150] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T17:27:37.107437] [INFO ] [REMOTE ] BAH: Full fetch complete (75236 records). [2025-10-17T17:27:37.107593] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-17T17:27:37.512297] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-17T17:27:37.512378] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-17T17:27:37.513131] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-17T17:27:37.513196] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-17T17:27:37.514576] [DEBUG] [LOCAL ] BAH: Trimmed 75236 records to 52467 (keeping 200 days of data) [2025-10-17T17:27:37.570252] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-17T17:27:37.834553] [DEBUG] [LOCAL ] BAH: Primary data saved (52467 records). [2025-10-17T17:27:37.834716] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-17T17:27:37.835363] [INFO ] [MAIN ] Update Progress: 206/2368 symbols completed. BAH took 30.3s. Estimated remaining: 4h 49m 18s. Rate: 7.5 symbols/min [2025-10-17T17:27:38.001250] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:27:38.050286] [DEBUG] [LOCAL ] BALL: Loaded 52278 existing records from primary storage. [2025-10-17T17:27:38.050598] [INFO ] [MAIN ] BALL: Loaded 52278 existing records. [2025-10-17T17:27:38.226821] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:27:38.227155] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-17T17:27:38.227208] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-17T17:27:38.227497] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-17T17:27:38.227555] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-17T17:27:38.581765] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:27:38.582087] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-17T17:27:38.603074] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-17T17:27:38.611088] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-17T17:27:38.611212] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-17T17:27:39.001598] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-17T17:27:39.001714] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-17T17:27:39.002476] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-17T17:27:39.002521] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-17T17:27:39.004091] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 54600 (keeping 200 days of data) [2025-10-17T17:27:39.371323] [DEBUG] [LOCAL ] BABA: Primary data saved (54600 records). [2025-10-17T17:27:39.374393] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-17T17:27:39.373979] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T17:27:39.374808] [INFO ] [MAIN ] Update Progress: 207/2368 symbols completed. BABA took 43.0s. Estimated remaining: 4h 48m 2s. Rate: 7.5 symbols/min [2025-10-17T17:27:39.477728] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-17T17:27:39.488468] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.73 seconds). [2025-10-17T17:27:39.542581] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-17T17:27:39.549362] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-17T17:27:39.634840] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:27:39.672346] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-17T17:27:39.678367] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-17T17:27:39.696956] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-17T17:27:39.707382] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-17T17:27:39.707456] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-17T17:27:39.707535] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-17T17:27:40.407107] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:27:40.407524] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-17T17:27:40.408235] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-17T17:27:40.408177] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-17T17:27:40.409190] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-17T17:27:40.410229] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-17T17:27:40.412341] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 54588 (keeping 200 days of data) [2025-10-17T17:27:40.549008] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T17:27:40.759446] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-17T17:27:40.788366] [DEBUG] [LOCAL ] BAC: Primary data saved (54588 records). [2025-10-17T17:27:40.788970] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-17T17:27:40.789060] [INFO ] [MAIN ] Update Progress: 208/2368 symbols completed. BAC took 37.8s. Estimated remaining: 4h 46m 46s. Rate: 7.5 symbols/min [2025-10-17T17:27:40.967580] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:27:41.021627] [DEBUG] [LOCAL ] BAM: Loaded 52489 existing records from primary storage. [2025-10-17T17:27:41.022073] [INFO ] [MAIN ] BAM: Loaded 52489 existing records. [2025-10-17T17:27:41.205879] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:27:41.206312] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-17T17:27:41.206370] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-17T17:27:41.206863] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-17T17:27:41.206924] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-17T17:27:41.396683] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T17:27:41.575036] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-17T17:27:41.614866] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:27:41.629026] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T17:27:42.190457] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T17:27:42.358009] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-17T17:27:42.651022] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T17:27:43.158045] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-17T17:27:43.958001] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-17T17:27:44.130514] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-17T17:27:44.619230] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T17:27:44.625164] [INFO ] [REMOTE ] BAK: Full fetch complete (56883 records). [2025-10-17T17:27:44.625272] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-17T17:27:44.773300] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-17T17:27:45.025087] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-17T17:27:45.025189] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-17T17:27:45.025942] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-17T17:27:45.026070] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-17T17:27:45.027324] [DEBUG] [LOCAL ] BAK: Trimmed 56883 records to 39871 (keeping 200 days of data) [2025-10-17T17:27:45.252329] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T17:27:45.271230] [DEBUG] [LOCAL ] BAK: Primary data saved (39871 records). [2025-10-17T17:27:45.271344] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-17T17:27:45.271418] [INFO ] [MAIN ] Update Progress: 209/2368 symbols completed. BAK took 33.0s. Estimated remaining: 4h 46m 2s. Rate: 7.5 symbols/min [2025-10-17T17:27:45.448379] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:27:45.504042] [DEBUG] [LOCAL ] BANC: Loaded 51734 existing records from primary storage. [2025-10-17T17:27:45.504354] [INFO ] [MAIN ] BANC: Loaded 51734 existing records. [2025-10-17T17:27:45.567331] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-17T17:27:45.700787] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:27:45.701045] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-17T17:27:45.701099] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-17T17:27:45.701530] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-17T17:27:45.701588] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-17T17:27:46.074465] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:27:46.358005] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-17T17:27:46.657823] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T17:27:46.972617] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-17T17:27:47.158012] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-17T17:27:47.245997] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T17:27:47.908029] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-17T17:27:47.957992] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-17T17:27:48.758075] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-17T17:27:49.482014] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T17:27:49.565298] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-17T17:27:49.567774] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T17:27:50.358067] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-17T17:27:51.158067] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-17T17:27:51.324323] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T17:27:51.368634] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T17:27:51.958026] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-17T17:27:52.762183] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-17T17:27:52.764775] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T17:27:52.798944] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T17:27:53.558085] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-17T17:27:54.358008] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-17T17:27:54.391079] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T17:27:54.464310] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T17:27:55.158042] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-17T17:27:55.958023] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-17T17:27:56.217955] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T17:27:56.526543] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T17:27:56.589283] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-17T17:27:56.758001] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-17T17:27:57.288716] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-17T17:27:57.558049] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-17T17:27:58.358047] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-17T17:27:59.158074] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-17T17:27:59.335399] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:27:59.958098] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-17T17:28:00.166340] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T17:28:00.645328] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T17:28:00.758013] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-17T17:28:01.334052] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T17:28:01.558026] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-17T17:28:02.358087] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-17T17:28:02.694406] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T17:28:03.158002] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-17T17:28:03.336574] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:28:03.958065] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-17T17:28:04.097930] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T17:28:04.532493] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-17T17:28:04.723426] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-17T17:28:04.726330] [INFO ] [REMOTE ] BALY: Full fetch complete (16297 records). [2025-10-17T17:28:04.726421] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-17T17:28:04.763157] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-17T17:28:04.911461] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T17:28:04.911789] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:28:04.911876] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:28:04.911970] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-17T17:28:04.912063] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-17T17:28:04.912118] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-17T17:28:04.912165] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-17T17:28:04.912225] [INFO ] [MAIN ] Update Progress: 210/2368 symbols completed. BALY took 25.5s. Estimated remaining: 4h 47m 54s. Rate: 7.5 symbols/min [2025-10-17T17:28:05.087108] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:28:05.114609] [DEBUG] [LOCAL ] BAP: Loaded 25985 existing records from primary storage. [2025-10-17T17:28:05.114889] [INFO ] [MAIN ] BAP: Loaded 25985 existing records. [2025-10-17T17:28:05.290152] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:28:05.290395] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-17T17:28:05.290454] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-17T17:28:05.290961] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-17T17:28:05.291021] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-17T17:28:05.563104] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-17T17:28:05.641994] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:28:06.358023] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-17T17:28:06.555203] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-17T17:28:07.158051] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-17T17:28:07.280930] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T17:28:07.824817] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T17:28:07.958043] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-17T17:28:08.710283] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T17:28:08.758041] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-17T17:28:09.100619] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T17:28:09.558027] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-17T17:28:10.358063] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-17T17:28:10.398008] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:28:11.158032] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-17T17:28:11.282149] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T17:28:11.958126] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-17T17:28:12.103226] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T17:28:12.552402] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T17:28:12.758054] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-17T17:28:13.558029] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-17T17:28:13.853582] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T17:28:13.861232] [INFO ] [REMOTE ] BALL: Full fetch complete (75578 records). [2025-10-17T17:28:13.861411] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-17T17:28:14.264063] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-17T17:28:14.264170] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-17T17:28:14.264948] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-17T17:28:14.265130] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-17T17:28:14.266597] [DEBUG] [LOCAL ] BALL: Trimmed 75578 records to 52656 (keeping 200 days of data) [2025-10-17T17:28:14.358749] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-17T17:28:14.607156] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T17:28:14.632691] [DEBUG] [LOCAL ] BALL: Primary data saved (52656 records). [2025-10-17T17:28:14.633141] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-17T17:28:14.633411] [INFO ] [MAIN ] Update Progress: 211/2368 symbols completed. BALL took 36.8s. Estimated remaining: 4h 48m 4s. Rate: 7.5 symbols/min [2025-10-17T17:28:14.817799] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:28:14.835576] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T17:28:14.876051] [DEBUG] [LOCAL ] BARK: Loaded 38444 existing records from primary storage. [2025-10-17T17:28:14.876366] [INFO ] [MAIN ] BARK: Loaded 38444 existing records. [2025-10-17T17:28:15.054226] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:28:15.054431] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-17T17:28:15.054479] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-17T17:28:15.054889] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-17T17:28:15.054948] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-17T17:28:15.163110] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-17T17:28:15.408615] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:28:15.958081] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-17T17:28:16.155492] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T17:28:16.202260] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T17:28:16.758067] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-17T17:28:17.558011] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-17T17:28:17.693247] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T17:28:18.058878] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-17T17:28:18.358030] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-17T17:28:19.158012] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-17T17:28:19.186454] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T17:28:19.267968] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T17:28:19.958083] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-17T17:28:20.702426] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T17:28:20.757990] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-17T17:28:21.558042] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-17T17:28:21.609534] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T17:28:22.358006] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-17T17:28:22.689370] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T17:28:22.697832] [INFO ] [REMOTE ] BAM: Full fetch complete (75097 records). [2025-10-17T17:28:22.721124] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-17T17:28:22.723262] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T17:28:23.123059] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-17T17:28:23.123161] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-17T17:28:23.124046] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-17T17:28:23.124114] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-17T17:28:23.125587] [DEBUG] [LOCAL ] BAM: Trimmed 75097 records to 52877 (keeping 200 days of data) [2025-10-17T17:28:23.178386] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-17T17:28:23.447924] [DEBUG] [LOCAL ] BAM: Primary data saved (52877 records). [2025-10-17T17:28:23.448085] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-17T17:28:23.448183] [INFO ] [MAIN ] Update Progress: 212/2368 symbols completed. BAM took 42.7s. Estimated remaining: 4h 48m 4s. Rate: 7.5 symbols/min [2025-10-17T17:28:23.622751] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:28:23.676117] [DEBUG] [LOCAL ] BAX: Loaded 53919 existing records from primary storage. [2025-10-17T17:28:23.676448] [INFO ] [MAIN ] BAX: Loaded 53919 existing records. [2025-10-17T17:28:23.864337] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:28:23.864910] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-17T17:28:23.864973] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-17T17:28:23.873404] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-17T17:28:23.887623] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-17T17:28:23.930779] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T17:28:23.963673] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-17T17:28:24.283060] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:28:24.758043] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-17T17:28:25.069454] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T17:28:25.076694] [INFO ] [REMOTE ] BANC: Full fetch complete (74180 records). [2025-10-17T17:28:25.076861] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-17T17:28:25.077703] [FATAL] [VALIDATOR ] BANC: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:28:25.077802] [FATAL] [MAIN ] BANC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:28:25.077866] [WARN ] [MAIN ] BANC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:28:25.077955] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-17T17:28:25.078038] [DEBUG] [LOCAL ] BANC: No primary data file found to delete. [2025-10-17T17:28:25.078132] [INFO ] [LOCAL ] BANC: Starting deletion of derivative data. [2025-10-17T17:28:25.078317] [DEBUG] [LOCAL ] BANC: Deleted derivative data file. [2025-10-17T17:28:25.079113] [INFO ] [MAIN ] Update Progress: 213/2368 symbols completed. BANC took 39.8s. Estimated remaining: 4h 46m 51s. Rate: 7.5 symbols/min [2025-10-17T17:28:25.256104] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:28:25.271845] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T17:28:25.325938] [DEBUG] [LOCAL ] BB: Loaded 53298 existing records from primary storage. [2025-10-17T17:28:25.326270] [INFO ] [MAIN ] BB: Loaded 53298 existing records. [2025-10-17T17:28:25.501617] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:28:25.501849] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-17T17:28:25.501900] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-17T17:28:25.502391] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-17T17:28:25.502448] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-17T17:28:25.564034] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-17T17:28:25.857135] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:28:26.125823] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T17:28:26.358016] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-17T17:28:26.922414] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T17:28:27.158043] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-17T17:28:27.776189] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T17:28:27.958031] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-17T17:28:28.588999] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T17:28:28.592842] [INFO ] [REMOTE ] BAP: Full fetch complete (37442 records). [2025-10-17T17:28:28.592948] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-17T17:28:28.762734] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-17T17:28:28.976884] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-17T17:28:28.976967] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-17T17:28:28.977425] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-17T17:28:28.977465] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-17T17:28:28.978366] [DEBUG] [LOCAL ] BAP: Trimmed 37442 records to 26192 (keeping 200 days of data) [2025-10-17T17:28:29.134855] [DEBUG] [LOCAL ] BAP: Primary data saved (26192 records). [2025-10-17T17:28:29.134987] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-17T17:28:29.135064] [INFO ] [MAIN ] Update Progress: 214/2368 symbols completed. BAP took 24.2s. Estimated remaining: 4h 46m 4s. Rate: 7.5 symbols/min [2025-10-17T17:28:29.302723] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:28:29.354478] [DEBUG] [LOCAL ] BBAI: Loaded 54210 existing records from primary storage. [2025-10-17T17:28:29.355062] [INFO ] [MAIN ] BBAI: Loaded 54210 existing records. [2025-10-17T17:28:29.492550] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T17:28:29.563075] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-17T17:28:29.586444] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:28:29.588241] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-17T17:28:29.588371] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-17T17:28:29.588625] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-17T17:28:29.588721] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-17T17:28:29.951213] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:28:30.358089] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-17T17:28:30.845673] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-17T17:28:31.089283] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T17:28:31.157997] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-17T17:28:31.958042] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-17T17:28:32.758070] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-17T17:28:32.855416] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T17:28:33.201566] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-10-17T17:28:33.558008] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-17T17:28:33.790210] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T17:28:34.358025] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-17T17:28:34.823488] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-17T17:28:35.158030] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-17T17:28:35.857249] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T17:28:35.963843] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-17T17:28:35.969426] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-17T17:28:36.758032] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-17T17:28:37.378075] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-17T17:28:37.379396] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-17T17:28:37.558030] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-17T17:28:38.358023] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-17T17:28:38.928486] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T17:28:39.158008] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-17T17:28:39.268978] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-10-17T17:28:39.958093] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-17T17:28:40.086299] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T17:28:40.562289] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T17:28:40.567919] [INFO ] [REMOTE ] BARK: Full fetch complete (56314 records). [2025-10-17T17:28:40.568082] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-17T17:28:40.763134] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-17T17:28:40.978102] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-17T17:28:40.978204] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-17T17:28:40.979063] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-17T17:28:40.979149] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-17T17:28:40.981040] [DEBUG] [LOCAL ] BARK: Trimmed 56314 records to 38766 (keeping 200 days of data) [2025-10-17T17:28:41.204537] [DEBUG] [LOCAL ] BARK: Primary data saved (38766 records). [2025-10-17T17:28:41.204715] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-17T17:28:41.204837] [INFO ] [MAIN ] Update Progress: 215/2368 symbols completed. BARK took 26.6s. Estimated remaining: 4h 46m 37s. Rate: 7.5 symbols/min [2025-10-17T17:28:41.369239] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:28:41.410354] [DEBUG] [LOCAL ] BBAR: Loaded 42696 existing records from primary storage. [2025-10-17T17:28:41.410685] [INFO ] [MAIN ] BBAR: Loaded 42696 existing records. [2025-10-17T17:28:41.563236] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-17T17:28:41.601538] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:28:41.601899] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-17T17:28:41.601960] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-17T17:28:41.602337] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-17T17:28:41.602393] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-17T17:28:41.965362] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:28:42.081179] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-17T17:28:42.358009] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-17T17:28:42.516997] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T17:28:43.158043] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-17T17:28:43.958065] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-17T17:28:44.016553] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T17:28:44.355922] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-10-17T17:28:44.758084] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-17T17:28:44.917263] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T17:28:45.558036] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-17T17:28:45.924564] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T17:28:45.972619] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T17:28:46.358065] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-17T17:28:47.158046] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-17T17:28:47.444799] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T17:28:47.904420] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T17:28:47.957987] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-17T17:28:48.758141] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-17T17:28:49.423282] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T17:28:49.558786] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-17T17:28:49.558717] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-17T17:28:50.358045] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-17T17:28:50.667725] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T17:28:51.133637] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T17:28:51.157976] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-17T17:28:51.958022] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-17T17:28:52.685898] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T17:28:52.757980] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-17T17:28:53.000425] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-17T17:28:53.558030] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-17T17:28:53.987987] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-17T17:28:54.324316] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T17:28:54.357978] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-17T17:28:55.158030] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-17T17:28:55.888565] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T17:28:55.958002] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-17T17:28:56.202498] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-17T17:28:56.758006] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-17T17:28:56.868141] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T17:28:57.284426] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-17T17:28:57.558039] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-17T17:28:58.358050] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-17T17:28:59.158035] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-17T17:28:59.489672] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-17T17:28:59.573850] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-10-17T17:28:59.640994] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-17T17:28:59.958106] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-17T17:29:00.758147] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-17T17:29:01.357934] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-17T17:29:01.558116] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-17T17:29:01.639141] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T17:29:01.645539] [INFO ] [REMOTE ] BBAR: Full fetch complete (61305 records). [2025-10-17T17:29:01.645718] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-17T17:29:02.035372] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-17T17:29:02.035506] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-17T17:29:02.036398] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-17T17:29:02.036471] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-17T17:29:02.038422] [DEBUG] [LOCAL ] BBAR: Trimmed 61305 records to 42985 (keeping 200 days of data) [2025-10-17T17:29:02.312304] [DEBUG] [LOCAL ] BBAR: Primary data saved (42985 records). [2025-10-17T17:29:02.312485] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-17T17:29:02.312587] [INFO ] [MAIN ] Update Progress: 216/2368 symbols completed. BBAR took 21.1s. Estimated remaining: 4h 48m 40s. Rate: 7.5 symbols/min [2025-10-17T17:29:02.358945] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-17T17:29:02.499121] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:02.556667] [DEBUG] [LOCAL ] BBD: Loaded 53650 existing records from primary storage. [2025-10-17T17:29:02.557150] [INFO ] [MAIN ] BBD: Loaded 53650 existing records. [2025-10-17T17:29:02.747908] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:29:02.748490] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-17T17:29:02.748679] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-17T17:29:02.749125] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-17T17:29:02.749188] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-17T17:29:03.140473] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-17T17:29:03.215536] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-17T17:29:03.241967] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:03.351067] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-17T17:29:03.958095] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-17T17:29:04.758106] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-17T17:29:05.196097] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-10-17T17:29:05.512937] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-17T17:29:05.520595] [INFO ] [REMOTE ] BB: Full fetch complete (76989 records). [2025-10-17T17:29:05.520782] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-17T17:29:05.563362] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-17T17:29:05.919154] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-17T17:29:05.952990] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-17T17:29:05.953176] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-17T17:29:05.954005] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-17T17:29:05.954116] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-17T17:29:05.955518] [DEBUG] [LOCAL ] BB: Trimmed 76989 records to 53673 (keeping 200 days of data) [2025-10-17T17:29:06.251864] [DEBUG] [LOCAL ] BB: Primary data saved (53673 records). [2025-10-17T17:29:06.252073] [INFO ] [MAIN ] BB: Full history saved. [2025-10-17T17:29:06.252731] [INFO ] [MAIN ] Update Progress: 217/2368 symbols completed. BB took 41.2s. Estimated remaining: 4h 47m 51s. Rate: 7.5 symbols/min [2025-10-17T17:29:06.363103] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-17T17:29:06.422814] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:06.423077] [DEBUG] [LOCAL ] BBDC: No existing data file found in primary storage. [2025-10-17T17:29:06.423128] [WARN ] [MAIN ] BBDC: No existing data found, performing full refresh instead. [2025-10-17T17:29:06.423239] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-17T17:29:06.423280] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-17T17:29:06.423321] [DEBUG] [LOCAL ] BBDC: No primary data file found to delete. [2025-10-17T17:29:06.423356] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-17T17:29:06.775562] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:06.817968] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-17T17:29:07.158056] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-17T17:29:07.958103] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-17T17:29:08.068180] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-17T17:29:08.205325] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T17:29:08.667264] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T17:29:08.758049] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-17T17:29:09.557989] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-17T17:29:09.648782] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T17:29:10.358003] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-17T17:29:10.452151] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T17:29:10.804172] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T17:29:11.158048] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-17T17:29:11.933506] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T17:29:11.958007] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-17T17:29:12.758074] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-17T17:29:13.558081] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-17T17:29:13.766731] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T17:29:14.120540] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.96 seconds). [2025-10-17T17:29:14.146558] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-17T17:29:14.147038] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-17T17:29:14.148333] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T17:29:14.364897] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-17T17:29:14.586220] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-17T17:29:14.586316] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-17T17:29:14.587244] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-17T17:29:14.587323] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-17T17:29:14.588933] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 54600 (keeping 200 days of data) [2025-10-17T17:29:14.901246] [DEBUG] [LOCAL ] BBAI: Primary data saved (54600 records). [2025-10-17T17:29:14.901384] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-17T17:29:14.901462] [INFO ] [MAIN ] Update Progress: 218/2368 symbols completed. BBAI took 45.8s. Estimated remaining: 4h 47m 49s. Rate: 7.5 symbols/min [2025-10-17T17:29:15.068963] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:15.076108] [DEBUG] [LOCAL ] BBDO: Loaded 5066 existing records from primary storage. [2025-10-17T17:29:15.076291] [INFO ] [MAIN ] BBDO: Loaded 5066 existing records. [2025-10-17T17:29:15.164475] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-17T17:29:15.253954] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:29:15.254163] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-17T17:29:15.254210] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-17T17:29:15.254361] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-17T17:29:15.254399] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-17T17:29:15.636872] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-17T17:29:15.635732] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:15.644575] [INFO ] [REMOTE ] BAX: Full fetch complete (77614 records). [2025-10-17T17:29:15.644705] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-17T17:29:15.967231] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-17T17:29:16.041715] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-17T17:29:16.041881] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-17T17:29:16.042705] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-17T17:29:16.042770] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-17T17:29:16.044234] [DEBUG] [LOCAL ] BAX: Trimmed 77614 records to 54309 (keeping 200 days of data) [2025-10-17T17:29:16.401737] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T17:29:16.417429] [DEBUG] [LOCAL ] BAX: Primary data saved (54309 records). [2025-10-17T17:29:16.418312] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-17T17:29:16.418474] [INFO ] [MAIN ] Update Progress: 219/2368 symbols completed. BAX took 53.0s. Estimated remaining: 4h 46m 37s. Rate: 7.5 symbols/min [2025-10-17T17:29:16.596399] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T17:29:16.631562] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:16.652142] [DEBUG] [LOCAL ] BBN: Loaded 18148 existing records from primary storage. [2025-10-17T17:29:16.652387] [INFO ] [MAIN ] BBN: Loaded 18148 existing records. [2025-10-17T17:29:16.763121] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-17T17:29:16.838094] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:29:16.838428] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-17T17:29:16.838479] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-17T17:29:16.838801] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-17T17:29:16.838859] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-17T17:29:17.024702] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-17T17:29:17.213819] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:17.558053] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-17T17:29:18.336425] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T17:29:18.357980] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-17T17:29:18.759735] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-17T17:29:19.158075] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-17T17:29:19.820471] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T17:29:19.834469] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T17:29:19.958044] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-17T17:29:20.758045] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-17T17:29:20.925581] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T17:29:21.558032] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-17T17:29:22.172570] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T17:29:22.358048] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-17T17:29:22.472832] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T17:29:23.158040] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-17T17:29:23.337344] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-17T17:29:23.958049] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-17T17:29:24.111495] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-17T17:29:24.758022] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-17T17:29:25.210980] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T17:29:25.558017] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-17T17:29:25.796937] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T17:29:26.358027] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-17T17:29:27.035480] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:29:27.158086] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-17T17:29:27.882801] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-17T17:29:27.958011] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-17T17:29:28.160786] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-17T17:29:28.628806] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-17T17:29:28.758025] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-17T17:29:29.558041] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-17T17:29:30.255293] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T17:29:30.260748] [INFO ] [REMOTE ] BBDC: Full fetch complete (48854 records). [2025-10-17T17:29:30.260845] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-17T17:29:30.363902] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-17T17:29:30.656069] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-17T17:29:30.656151] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-17T17:29:30.656772] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-17T17:29:30.656837] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-17T17:29:30.657891] [DEBUG] [LOCAL ] BBDC: Trimmed 48854 records to 33616 (keeping 200 days of data) [2025-10-17T17:29:30.855933] [DEBUG] [LOCAL ] BBDC: Primary data saved (33616 records). [2025-10-17T17:29:30.856286] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-17T17:29:30.856404] [INFO ] [MAIN ] Update Progress: 220/2368 symbols completed. BBDC took 24.6s. Estimated remaining: 4h 47m 32s. Rate: 7.5 symbols/min [2025-10-17T17:29:31.055831] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:31.057627] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-17T17:29:31.057488] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T17:29:31.057754] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-17T17:29:31.058009] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-17T17:29:31.068559] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-17T17:29:31.068633] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-17T17:29:31.068713] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-17T17:29:31.163402] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-17T17:29:31.190498] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-17T17:29:31.429573] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:31.958035] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-17T17:29:32.164170] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:29:32.164474] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-17T17:29:32.164562] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:29:32.164608] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-17T17:29:32.164663] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:29:32.164728] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-17T17:29:32.164787] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-17T17:29:32.164839] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-17T17:29:32.164880] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-17T17:29:32.164926] [INFO ] [MAIN ] Update Progress: 221/2368 symbols completed. BBT took 1.3s. Estimated remaining: 4h 46m 18s. Rate: 7.5 symbols/min [2025-10-17T17:29:32.342089] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:32.342507] [DEBUG] [LOCAL ] BBU: No existing data file found in primary storage. [2025-10-17T17:29:32.342838] [WARN ] [MAIN ] BBU: No existing data found, performing full refresh instead. [2025-10-17T17:29:32.343002] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-17T17:29:32.343076] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-17T17:29:32.343149] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-17T17:29:32.343219] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-17T17:29:32.696305] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:32.758016] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-17T17:29:32.964176] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T17:29:33.558037] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-17T17:29:33.606491] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T17:29:34.173438] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-17T17:29:34.358024] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-17T17:29:34.842696] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-17T17:29:35.158032] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-17T17:29:35.819748] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-17T17:29:35.958041] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-17T17:29:36.522028] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T17:29:36.757997] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-17T17:29:37.398857] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-17T17:29:37.558064] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-17T17:29:38.358046] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-17T17:29:39.134839] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T17:29:39.136222] [INFO ] [REMOTE ] BBDO: Full fetch complete (7492 records). [2025-10-17T17:29:39.136291] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-17T17:29:39.167266] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-17T17:29:39.510332] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-17T17:29:39.510466] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-17T17:29:39.510810] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-17T17:29:39.510983] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-17T17:29:39.523221] [DEBUG] [LOCAL ] BBDO: Trimmed 7492 records to 5104 (keeping 200 days of data) [2025-10-17T17:29:39.559353] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-17T17:29:39.591182] [DEBUG] [LOCAL ] BBDO: Primary data saved (5104 records). [2025-10-17T17:29:39.591328] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-17T17:29:39.591416] [INFO ] [MAIN ] Update Progress: 222/2368 symbols completed. BBDO took 24.7s. Estimated remaining: 4h 46m 5s. Rate: 7.5 symbols/min [2025-10-17T17:29:39.761555] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:39.776751] [DEBUG] [LOCAL ] BBUC: Loaded 13949 existing records from primary storage. [2025-10-17T17:29:39.776987] [INFO ] [MAIN ] BBUC: Loaded 13949 existing records. [2025-10-17T17:29:39.844525] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T17:29:39.963391] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-17T17:29:39.963244] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:29:39.964863] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-17T17:29:39.964951] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-17T17:29:39.965190] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-17T17:29:39.965247] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-17T17:29:40.329066] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:40.758037] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-17T17:29:41.558068] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-17T17:29:41.832706] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T17:29:41.964813] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T17:29:42.141388] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-17T17:29:42.358110] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-17T17:29:43.102113] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-17T17:29:43.158108] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-17T17:29:43.842446] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T17:29:43.958032] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-17T17:29:44.758044] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-17T17:29:45.528363] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T17:29:45.558016] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-17T17:29:45.755236] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T17:29:45.763444] [INFO ] [REMOTE ] BBD: Full fetch complete (77276 records). [2025-10-17T17:29:45.763693] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-17T17:29:46.165617] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-17T17:29:46.165865] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-17T17:29:46.166828] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-17T17:29:46.166897] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-17T17:29:46.168533] [DEBUG] [LOCAL ] BBD: Trimmed 77276 records to 54039 (keeping 200 days of data) [2025-10-17T17:29:46.352041] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T17:29:46.377724] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-17T17:29:46.500102] [DEBUG] [LOCAL ] BBD: Primary data saved (54039 records). [2025-10-17T17:29:46.500272] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-17T17:29:46.500359] [INFO ] [MAIN ] Update Progress: 223/2368 symbols completed. BBD took 44.2s. Estimated remaining: 4h 45m 46s. Rate: 7.5 symbols/min [2025-10-17T17:29:46.665205] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:46.712849] [DEBUG] [LOCAL ] BBVA: Loaded 49475 existing records from primary storage. [2025-10-17T17:29:46.713202] [INFO ] [MAIN ] BBVA: Loaded 49475 existing records. [2025-10-17T17:29:46.895215] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:29:46.895464] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-17T17:29:46.895513] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-17T17:29:46.895914] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-17T17:29:46.895999] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-17T17:29:46.992841] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-17T17:29:47.163735] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-17T17:29:47.258725] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:47.673234] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T17:29:47.958056] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-17T17:29:48.758073] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-17T17:29:48.999271] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T17:29:49.558066] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-17T17:29:50.101876] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-17T17:29:50.358085] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-17T17:29:50.588134] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T17:29:50.645220] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-17T17:29:51.158099] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-17T17:29:51.958048] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-17T17:29:52.395448] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T17:29:52.662047] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-17T17:29:52.758086] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-17T17:29:53.417259] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T17:29:53.558068] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-17T17:29:54.358098] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-17T17:29:54.467139] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T17:29:55.158036] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-17T17:29:55.489727] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T17:29:55.958087] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-17T17:29:56.081390] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-17T17:29:56.083782] [INFO ] [REMOTE ] BBU: Full fetch complete (7445 records). [2025-10-17T17:29:56.083854] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-17T17:29:56.431564] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-17T17:29:56.431662] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-17T17:29:56.431873] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-17T17:29:56.431914] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-17T17:29:56.432307] [DEBUG] [LOCAL ] BBU: Trimmed 7445 records to 5708 (keeping 200 days of data) [2025-10-17T17:29:56.465056] [DEBUG] [LOCAL ] BBU: Primary data saved (5708 records). [2025-10-17T17:29:56.465181] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-17T17:29:56.465252] [INFO ] [MAIN ] Update Progress: 224/2368 symbols completed. BBU took 24.3s. Estimated remaining: 4h 45m 57s. Rate: 7.5 symbols/min [2025-10-17T17:29:56.634956] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:56.674081] [DEBUG] [LOCAL ] BBW: Loaded 27636 existing records from primary storage. [2025-10-17T17:29:56.674332] [INFO ] [MAIN ] BBW: Loaded 27636 existing records. [2025-10-17T17:29:56.763285] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-17T17:29:56.854924] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:29:56.855229] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-17T17:29:56.855279] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-17T17:29:56.855633] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-17T17:29:56.855735] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-17T17:29:57.219853] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:57.558046] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-17T17:29:57.641692] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T17:29:57.945709] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T17:29:57.948113] [INFO ] [REMOTE ] BBN: Full fetch complete (25376 records). [2025-10-17T17:29:57.948195] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-17T17:29:58.342604] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-17T17:29:58.342708] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-17T17:29:58.343091] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-17T17:29:58.343133] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-17T17:29:58.343790] [DEBUG] [LOCAL ] BBN: Trimmed 25376 records to 18233 (keeping 200 days of data) [2025-10-17T17:29:58.390040] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-17T17:29:58.455671] [DEBUG] [LOCAL ] BBN: Primary data saved (18233 records). [2025-10-17T17:29:58.455837] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-17T17:29:58.455934] [INFO ] [MAIN ] Update Progress: 225/2368 symbols completed. BBN took 42.0s. Estimated remaining: 4h 44m 52s. Rate: 7.5 symbols/min [2025-10-17T17:29:58.622813] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:29:58.674947] [DEBUG] [LOCAL ] BBWI: Loaded 53974 existing records from primary storage. [2025-10-17T17:29:58.675280] [INFO ] [MAIN ] BBWI: Loaded 53974 existing records. [2025-10-17T17:29:58.853465] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:29:58.853819] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-17T17:29:58.853881] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-17T17:29:58.854398] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-17T17:29:58.854437] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-17T17:29:59.132686] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T17:29:59.160166] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-17T17:29:59.244614] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:29:59.358767] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T17:29:59.958043] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-17T17:30:00.758109] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-17T17:30:01.310270] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-17T17:30:01.558048] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-17T17:30:01.857666] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T17:30:02.330588] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T17:30:02.357997] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-17T17:30:03.158084] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-17T17:30:03.547699] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T17:30:03.958006] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-17T17:30:04.266019] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-17T17:30:04.301340] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T17:30:04.758044] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-17T17:30:05.549293] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T17:30:05.557975] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-17T17:30:06.358002] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-17T17:30:06.678462] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-17T17:30:06.717093] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T17:30:06.935795] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T17:30:07.158042] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-17T17:30:07.957999] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-17T17:30:08.329938] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T17:30:08.758078] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-17T17:30:09.558007] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-17T17:30:09.805502] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T17:30:10.099808] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T17:30:10.358071] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-17T17:30:11.158003] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-17T17:30:11.442305] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T17:30:11.958048] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-17T17:30:12.308550] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T17:30:12.577679] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T17:30:12.758026] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-17T17:30:13.558061] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-17T17:30:13.590275] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T17:30:13.710162] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T17:30:14.358032] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-17T17:30:14.773837] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-17T17:30:15.158044] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-17T17:30:15.450323] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T17:30:15.958030] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-17T17:30:16.471611] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T17:30:16.758083] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-17T17:30:17.189976] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-17T17:30:17.193133] [INFO ] [REMOTE ] BBUC: Full fetch complete (19110 records). [2025-10-17T17:30:17.193222] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-17T17:30:17.558574] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-17T17:30:17.588343] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-17T17:30:17.588425] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-17T17:30:17.588829] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-17T17:30:17.588891] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-17T17:30:17.589474] [DEBUG] [LOCAL ] BBUC: Trimmed 19110 records to 14077 (keeping 200 days of data) [2025-10-17T17:30:17.680994] [DEBUG] [LOCAL ] BBUC: Primary data saved (14077 records). [2025-10-17T17:30:17.681141] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-17T17:30:17.681227] [INFO ] [MAIN ] Update Progress: 226/2368 symbols completed. BBUC took 38.1s. Estimated remaining: 4h 46m 31s. Rate: 7.5 symbols/min [2025-10-17T17:30:17.852250] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:30:17.915496] [DEBUG] [LOCAL ] BBY: Loaded 53831 existing records from primary storage. [2025-10-17T17:30:17.915881] [INFO ] [MAIN ] BBY: Loaded 53831 existing records. [2025-10-17T17:30:18.099630] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:30:18.099897] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-17T17:30:18.099948] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-17T17:30:18.100506] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-17T17:30:18.100565] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-17T17:30:18.362491] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-17T17:30:18.485480] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:30:18.512682] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T17:30:18.539323] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-17T17:30:19.158024] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-17T17:30:19.958003] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-17T17:30:20.206747] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T17:30:20.758000] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-17T17:30:20.950231] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T17:30:21.326516] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T17:30:21.558026] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-17T17:30:22.358009] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-17T17:30:22.588146] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T17:30:22.713272] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T17:30:23.158049] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-17T17:30:23.957992] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-17T17:30:24.060323] [DEBUG] [REMOTE ] BBWI: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-17T17:30:24.060663] [WARN ] [REMOTE ] BBWI: No data returned for month 2025-07 [2025-10-17T17:30:24.060756] [FATAL] [REMOTE ] BBWI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:30:24.060844] [FATAL] [MAIN ] BBWI: Failed to fetch primary data. [2025-10-17T17:30:24.060909] [WARN ] [MAIN ] BBWI: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:30:24.060999] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-17T17:30:24.061103] [DEBUG] [LOCAL ] BBWI: No primary data file found to delete. [2025-10-17T17:30:24.061148] [INFO ] [LOCAL ] BBWI: Starting deletion of derivative data. [2025-10-17T17:30:24.061300] [DEBUG] [LOCAL ] BBWI: Deleted derivative data file. [2025-10-17T17:30:24.061384] [INFO ] [MAIN ] Update Progress: 227/2368 symbols completed. BBWI took 25.6s. Estimated remaining: 4h 46m 7s. Rate: 7.5 symbols/min [2025-10-17T17:30:24.247809] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:30:24.248075] [DEBUG] [LOCAL ] BC: No existing data file found in primary storage. [2025-10-17T17:30:24.248197] [WARN ] [MAIN ] BC: No existing data found, performing full refresh instead. [2025-10-17T17:30:24.248346] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-17T17:30:24.248497] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-17T17:30:24.248599] [DEBUG] [LOCAL ] BC: No primary data file found to delete. [2025-10-17T17:30:24.248682] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-17T17:30:24.390986] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-17T17:30:24.664454] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:30:24.758015] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-17T17:30:25.484709] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-17T17:30:25.557995] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-17T17:30:26.314506] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T17:30:26.358009] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-17T17:30:27.158054] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-17T17:30:27.316942] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-17T17:30:27.906079] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T17:30:27.957986] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-17T17:30:28.594903] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T17:30:28.600058] [INFO ] [REMOTE ] BBW: Full fetch complete (39754 records). [2025-10-17T17:30:28.600157] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-17T17:30:28.760401] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-17T17:30:28.986512] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-17T17:30:28.986604] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-17T17:30:28.987145] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-17T17:30:28.987212] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-17T17:30:28.988284] [DEBUG] [LOCAL ] BBW: Trimmed 39754 records to 27830 (keeping 200 days of data) [2025-10-17T17:30:29.161686] [DEBUG] [LOCAL ] BBW: Primary data saved (27830 records). [2025-10-17T17:30:29.161840] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-17T17:30:29.161968] [INFO ] [MAIN ] Update Progress: 228/2368 symbols completed. BBW took 32.7s. Estimated remaining: 4h 45m 32s. Rate: 7.5 symbols/min [2025-10-17T17:30:29.337007] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:30:29.395767] [DEBUG] [LOCAL ] BCAT: Loaded 34487 existing records from primary storage. [2025-10-17T17:30:29.397942] [INFO ] [MAIN ] BCAT: Loaded 34487 existing records. [2025-10-17T17:30:29.397752] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T17:30:29.564350] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-17T17:30:29.588752] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:30:29.589019] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-17T17:30:29.589069] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-17T17:30:29.589408] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-17T17:30:29.589449] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-17T17:30:29.936966] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:30:30.358066] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-17T17:30:30.496093] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T17:30:30.965967] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T17:30:31.158019] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-17T17:30:31.839329] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T17:30:31.958051] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-17T17:30:32.758036] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-17T17:30:33.354373] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-17T17:30:33.362405] [INFO ] [REMOTE ] BBVA: Full fetch complete (71805 records). [2025-10-17T17:30:33.362629] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-17T17:30:33.570761] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-17T17:30:33.809390] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-17T17:30:33.821604] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-17T17:30:33.823466] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-17T17:30:33.825117] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-17T17:30:33.824691] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T17:30:33.835259] [DEBUG] [LOCAL ] BBVA: Trimmed 71805 records to 49862 (keeping 200 days of data) [2025-10-17T17:30:34.167432] [DEBUG] [LOCAL ] BBVA: Primary data saved (49862 records). [2025-10-17T17:30:34.167636] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-17T17:30:34.167784] [INFO ] [MAIN ] Update Progress: 229/2368 symbols completed. BBVA took 47.7s. Estimated remaining: 4h 44m 56s. Rate: 7.5 symbols/min [2025-10-17T17:30:34.360077] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-17T17:30:34.407680] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:30:34.448483] [DEBUG] [LOCAL ] BCC: Loaded 28737 existing records from primary storage. [2025-10-17T17:30:34.448973] [INFO ] [MAIN ] BCC: Loaded 28737 existing records. [2025-10-17T17:30:34.695358] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:30:34.717898] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-17T17:30:34.718132] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-17T17:30:34.718942] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-17T17:30:34.721241] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-17T17:30:34.721120] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T17:30:35.116779] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:30:35.158008] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-17T17:30:35.332068] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T17:30:35.763785] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T17:30:35.958023] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-17T17:30:36.653383] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:30:36.757998] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-17T17:30:37.442265] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T17:30:37.558036] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-17T17:30:38.223325] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T17:30:38.358002] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-17T17:30:39.158000] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-17T17:30:39.394466] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T17:30:39.840245] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T17:30:39.957992] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-17T17:30:40.379838] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T17:30:40.758018] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-17T17:30:41.463600] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T17:30:41.557996] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-17T17:30:42.358022] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-17T17:30:43.024459] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-17T17:30:43.059886] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T17:30:43.158046] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-17T17:30:43.958105] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-17T17:30:43.987632] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T17:30:44.758071] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-17T17:30:44.858367] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T17:30:44.865026] [INFO ] [REMOTE ] BC: Full fetch complete (63667 records). [2025-10-17T17:30:44.865283] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-17T17:30:45.257561] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T17:30:45.279717] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-17T17:30:45.280214] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-17T17:30:45.281090] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-17T17:30:45.281179] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-17T17:30:45.282580] [DEBUG] [LOCAL ] BC: Trimmed 63667 records to 44654 (keeping 200 days of data) [2025-10-17T17:30:45.549775] [DEBUG] [LOCAL ] BC: Primary data saved (44654 records). [2025-10-17T17:30:45.549941] [INFO ] [MAIN ] BC: Full history saved. [2025-10-17T17:30:45.550064] [INFO ] [MAIN ] Update Progress: 230/2368 symbols completed. BC took 21.5s. Estimated remaining: 4h 45m 19s. Rate: 7.5 symbols/min [2025-10-17T17:30:45.563289] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-17T17:30:45.719606] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:30:45.769573] [DEBUG] [LOCAL ] BCE: Loaded 52634 existing records from primary storage. [2025-10-17T17:30:45.769935] [INFO ] [MAIN ] BCE: Loaded 52634 existing records. [2025-10-17T17:30:45.943070] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:30:45.943537] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-17T17:30:45.943699] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-17T17:30:45.944327] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-17T17:30:45.944395] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-17T17:30:46.316966] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T17:30:46.321471] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:30:46.357983] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-17T17:30:47.158024] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-17T17:30:47.378131] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T17:30:47.958029] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-17T17:30:48.490979] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T17:30:48.664509] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-17T17:30:48.758021] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-17T17:30:49.558013] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-17T17:30:49.918807] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-17T17:30:50.012670] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T17:30:50.358065] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-17T17:30:51.158049] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-17T17:30:51.178108] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T17:30:51.958049] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-17T17:30:52.397244] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T17:30:52.758070] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-17T17:30:52.986706] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T17:30:53.092064] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T17:30:53.558034] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-17T17:30:54.358065] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-17T17:30:54.619834] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T17:30:54.958996] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T17:30:55.158080] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-17T17:30:55.504136] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T17:30:55.958113] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-17T17:30:56.684579] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T17:30:56.758052] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-17T17:30:57.558045] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-17T17:30:57.832598] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T17:30:58.266728] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T17:30:58.358014] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-17T17:30:59.158046] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-17T17:30:59.562579] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-17T17:30:59.841563] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T17:30:59.846690] [INFO ] [REMOTE ] BCAT: Full fetch complete (50025 records). [2025-10-17T17:30:59.846835] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-17T17:30:59.963243] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-17T17:31:00.234165] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-17T17:31:00.234292] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-17T17:31:00.235061] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-17T17:31:00.235130] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-17T17:31:00.236808] [DEBUG] [LOCAL ] BCAT: Trimmed 50025 records to 34802 (keeping 200 days of data) [2025-10-17T17:31:00.466300] [DEBUG] [LOCAL ] BCAT: Primary data saved (34802 records). [2025-10-17T17:31:00.466566] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-17T17:31:00.466810] [INFO ] [MAIN ] Update Progress: 231/2368 symbols completed. BCAT took 31.3s. Estimated remaining: 4h 46m 15s. Rate: 7.5 symbols/min [2025-10-17T17:31:00.659584] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:31:00.659895] [DEBUG] [LOCAL ] BCH: No existing data file found in primary storage. [2025-10-17T17:31:00.659955] [WARN ] [MAIN ] BCH: No existing data found, performing full refresh instead. [2025-10-17T17:31:00.660098] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-17T17:31:00.660141] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-17T17:31:00.660184] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-10-17T17:31:00.660218] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-17T17:31:00.763407] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-17T17:31:01.062312] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:31:01.451788] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-17T17:31:01.459269] [INFO ] [REMOTE ] BBY: Full fetch complete (77399 records). [2025-10-17T17:31:01.459405] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-17T17:31:01.561178] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-17T17:31:01.918968] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T17:31:01.919325] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-17T17:31:01.919701] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-17T17:31:01.926995] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-17T17:31:01.928105] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-17T17:31:01.931302] [DEBUG] [LOCAL ] BBY: Trimmed 77399 records to 54218 (keeping 200 days of data) [2025-10-17T17:31:02.265076] [DEBUG] [LOCAL ] BBY: Primary data saved (54218 records). [2025-10-17T17:31:02.265214] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-17T17:31:02.265295] [INFO ] [MAIN ] Update Progress: 232/2368 symbols completed. BBY took 44.6s. Estimated remaining: 4h 45m 10s. Rate: 7.5 symbols/min [2025-10-17T17:31:02.362724] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-17T17:31:02.438546] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:31:02.465012] [DEBUG] [LOCAL ] BCO: Loaded 25583 existing records from primary storage. [2025-10-17T17:31:02.465273] [INFO ] [MAIN ] BCO: Loaded 25583 existing records. [2025-10-17T17:31:02.652636] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:31:02.653244] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-17T17:31:02.653445] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-17T17:31:02.653745] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-17T17:31:02.663788] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-17T17:31:02.724919] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T17:31:02.821016] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T17:31:03.093462] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:31:03.158045] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-17T17:31:03.615160] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T17:31:03.958045] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-17T17:31:04.220957] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T17:31:04.758053] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-17T17:31:05.325082] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-17T17:31:05.558003] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-17T17:31:05.846150] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T17:31:06.358111] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-17T17:31:06.877712] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T17:31:07.158103] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-17T17:31:07.958026] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-17T17:31:08.216984] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-17T17:31:08.354695] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T17:31:08.758027] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-17T17:31:09.212827] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T17:31:09.558021] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-17T17:31:10.102592] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T17:31:10.358072] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-17T17:31:11.038195] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T17:31:11.158019] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-17T17:31:11.590116] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-17T17:31:11.958037] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-17T17:31:12.483128] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-17T17:31:12.758052] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-17T17:31:13.349248] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T17:31:13.558024] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-17T17:31:14.049148] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T17:31:14.358056] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-17T17:31:14.638342] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T17:31:15.158035] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-17T17:31:15.877081] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-17T17:31:15.881809] [INFO ] [REMOTE ] BCC: Full fetch complete (41136 records). [2025-10-17T17:31:15.881947] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-17T17:31:15.882639] [FATAL] [VALIDATOR ] BCC: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:31:15.882752] [FATAL] [MAIN ] BCC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:31:15.882813] [WARN ] [MAIN ] BCC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:31:15.882859] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-17T17:31:15.882915] [DEBUG] [LOCAL ] BCC: No primary data file found to delete. [2025-10-17T17:31:15.882950] [INFO ] [LOCAL ] BCC: Starting deletion of derivative data. [2025-10-17T17:31:15.883072] [DEBUG] [LOCAL ] BCC: Deleted derivative data file. [2025-10-17T17:31:15.883144] [INFO ] [MAIN ] Update Progress: 233/2368 symbols completed. BCC took 41.7s. Estimated remaining: 4h 45m 53s. Rate: 7.5 symbols/min [2025-10-17T17:31:15.963169] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-17T17:31:16.059830] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:31:16.113715] [DEBUG] [LOCAL ] BCS: Loaded 53832 existing records from primary storage. [2025-10-17T17:31:16.114056] [INFO ] [MAIN ] BCS: Loaded 53832 existing records. [2025-10-17T17:31:16.298247] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:31:16.298530] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-17T17:31:16.298582] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-17T17:31:16.299072] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-17T17:31:16.299139] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-17T17:31:16.713050] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:31:16.716495] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T17:31:16.758022] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-17T17:31:17.274027] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T17:31:17.558106] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-17T17:31:18.358073] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-17T17:31:18.705321] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-17T17:31:18.789452] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-17T17:31:19.158028] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-17T17:31:19.815682] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T17:31:19.958032] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-17T17:31:20.447937] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T17:31:20.758063] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-17T17:31:21.558025] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-17T17:31:21.669451] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T17:31:22.183325] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T17:31:22.188931] [INFO ] [REMOTE ] BCH: Full fetch complete (41965 records). [2025-10-17T17:31:22.189077] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-17T17:31:22.363872] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-17T17:31:22.589975] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-17T17:31:22.590066] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-17T17:31:22.590593] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-17T17:31:22.590637] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-17T17:31:22.591745] [DEBUG] [LOCAL ] BCH: Trimmed 41965 records to 30818 (keeping 200 days of data) [2025-10-17T17:31:22.770301] [DEBUG] [LOCAL ] BCH: Primary data saved (30818 records). [2025-10-17T17:31:22.770454] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-17T17:31:22.770530] [INFO ] [MAIN ] Update Progress: 234/2368 symbols completed. BCH took 22.3s. Estimated remaining: 4h 45m 34s. Rate: 7.5 symbols/min [2025-10-17T17:31:22.941046] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:31:22.976029] [DEBUG] [LOCAL ] BCSF: Loaded 28381 existing records from primary storage. [2025-10-17T17:31:22.976451] [INFO ] [MAIN ] BCSF: Loaded 28381 existing records. [2025-10-17T17:31:23.162250] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:31:23.158568] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-17T17:31:23.162901] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-17T17:31:23.163994] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-17T17:31:23.164375] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-17T17:31:23.164434] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-17T17:31:23.536354] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-17T17:31:23.567802] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:31:23.958065] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-17T17:31:24.180581] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T17:31:24.685381] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T17:31:24.758041] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-17T17:31:24.860959] [DEBUG] [REMOTE ] BCO: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-17T17:31:24.861280] [WARN ] [REMOTE ] BCO: No data returned for month 2025-05 [2025-10-17T17:31:24.861371] [FATAL] [REMOTE ] BCO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:31:24.861454] [FATAL] [MAIN ] BCO: Failed to fetch primary data. [2025-10-17T17:31:24.861521] [WARN ] [MAIN ] BCO: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:31:24.861598] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-17T17:31:24.861691] [DEBUG] [LOCAL ] BCO: No primary data file found to delete. [2025-10-17T17:31:24.861751] [INFO ] [LOCAL ] BCO: Starting deletion of derivative data. [2025-10-17T17:31:24.861902] [DEBUG] [LOCAL ] BCO: Deleted derivative data file. [2025-10-17T17:31:24.861992] [INFO ] [MAIN ] Update Progress: 235/2368 symbols completed. BCO took 22.6s. Estimated remaining: 4h 44m 33s. Rate: 7.5 symbols/min [2025-10-17T17:31:25.036108] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:31:25.036346] [DEBUG] [LOCAL ] BCX: No existing data file found in primary storage. [2025-10-17T17:31:25.036391] [WARN ] [MAIN ] BCX: No existing data found, performing full refresh instead. [2025-10-17T17:31:25.036506] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-17T17:31:25.036547] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-17T17:31:25.036591] [DEBUG] [LOCAL ] BCX: No primary data file found to delete. [2025-10-17T17:31:25.036623] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-17T17:31:25.408872] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:31:25.518330] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T17:31:25.558016] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-17T17:31:26.358047] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-17T17:31:26.847105] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-17T17:31:27.158025] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-17T17:31:27.958021] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-17T17:31:28.119082] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T17:31:28.126330] [INFO ] [REMOTE ] BCE: Full fetch complete (76118 records). [2025-10-17T17:31:28.126477] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-17T17:31:28.578973] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-17T17:31:28.579126] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-17T17:31:28.586010] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-17T17:31:28.586139] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-17T17:31:28.599753] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T17:31:28.606354] [DEBUG] [LOCAL ] BCE: Trimmed 76118 records to 53022 (keeping 200 days of data) [2025-10-17T17:31:28.781763] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-17T17:31:28.945220] [DEBUG] [LOCAL ] BCE: Primary data saved (53022 records). [2025-10-17T17:31:28.945377] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-17T17:31:28.945463] [INFO ] [MAIN ] Update Progress: 236/2368 symbols completed. BCE took 43.4s. Estimated remaining: 4h 43m 49s. Rate: 7.5 symbols/min [2025-10-17T17:31:29.131266] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:31:29.156594] [DEBUG] [LOCAL ] BDC: Loaded 24680 existing records from primary storage. [2025-10-17T17:31:29.156880] [INFO ] [MAIN ] BDC: Loaded 24680 existing records. [2025-10-17T17:31:29.338887] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:31:29.339098] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-17T17:31:29.339147] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-17T17:31:29.339473] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-17T17:31:29.339530] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-17T17:31:29.564370] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-17T17:31:29.707388] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:31:29.996067] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-17T17:31:30.083202] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T17:31:30.358036] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-17T17:31:30.473934] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T17:31:31.158014] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-17T17:31:31.286599] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T17:31:31.958023] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-17T17:31:32.302512] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T17:31:32.758003] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-17T17:31:33.141768] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T17:31:33.558026] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-17T17:31:34.358073] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-17T17:31:34.575063] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T17:31:34.614139] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T17:31:35.158017] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-17T17:31:35.469874] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T17:31:35.958099] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-17T17:31:36.758012] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-17T17:31:37.113787] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T17:31:37.148750] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T17:31:37.558025] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-17T17:31:38.042795] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T17:31:38.358045] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-17T17:31:38.585600] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T17:31:39.158051] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-17T17:31:39.958015] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-17T17:31:40.259773] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T17:31:40.421634] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T17:31:40.758004] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-17T17:31:41.049250] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T17:31:41.558031] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-17T17:31:42.358068] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-17T17:31:42.532441] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T17:31:42.724921] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-17T17:31:43.158034] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-17T17:31:43.559826] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T17:31:43.958036] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-17T17:31:44.758047] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-17T17:31:44.953355] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T17:31:45.101464] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T17:31:45.558071] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-17T17:31:46.200818] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-17T17:31:46.358052] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-17T17:31:46.778737] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T17:31:46.782889] [INFO ] [REMOTE ] BCX: Full fetch complete (33802 records). [2025-10-17T17:31:46.782979] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-17T17:31:47.170560] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-17T17:31:47.187152] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-17T17:31:47.187300] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-17T17:31:47.187851] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-17T17:31:47.187949] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-17T17:31:47.188949] [DEBUG] [LOCAL ] BCX: Trimmed 33802 records to 22404 (keeping 200 days of data) [2025-10-17T17:31:47.330341] [DEBUG] [LOCAL ] BCX: Primary data saved (22404 records). [2025-10-17T17:31:47.330475] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-17T17:31:47.330548] [INFO ] [MAIN ] Update Progress: 237/2368 symbols completed. BCX took 22.5s. Estimated remaining: 4h 45m 15s. Rate: 7.5 symbols/min [2025-10-17T17:31:47.551696] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-17T17:31:47.958102] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-17T17:31:48.069987] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-17T17:31:48.758099] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-17T17:31:49.558016] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-17T17:31:49.890511] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-17T17:31:49.997235] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T17:31:50.358035] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-17T17:31:50.434452] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-17T17:31:51.158053] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-17T17:31:51.958067] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-17T17:31:52.098760] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-17T17:31:52.365452] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-17T17:31:52.373095] [INFO ] [REMOTE ] BCS: Full fetch complete (77513 records). [2025-10-17T17:31:52.373254] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-17T17:31:52.765914] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-17T17:31:52.765242] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-17T17:31:52.766797] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-17T17:31:52.767687] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-17T17:31:52.767846] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-17T17:31:52.769489] [DEBUG] [LOCAL ] BCS: Trimmed 77513 records to 54222 (keeping 200 days of data) [2025-10-17T17:31:53.104708] [DEBUG] [LOCAL ] BCS: Primary data saved (54222 records). [2025-10-17T17:31:53.104867] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-17T17:31:53.104950] [INFO ] [MAIN ] Update Progress: 238/2368 symbols completed. BCS took 37.2s. Estimated remaining: 4h 44m 46s. Rate: 7.5 symbols/min [2025-10-17T17:31:53.308762] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T17:31:53.558027] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-17T17:31:54.175472] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T17:31:54.358022] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-17T17:31:54.665722] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-17T17:31:55.158076] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-17T17:31:55.520819] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-17T17:31:55.958069] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-17T17:31:56.570481] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T17:31:56.758062] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-17T17:31:57.159350] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-17T17:31:57.558138] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-17T17:31:58.082697] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T17:31:58.088077] [INFO ] [REMOTE ] BCSF: Full fetch complete (39642 records). [2025-10-17T17:31:58.088214] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-17T17:31:58.514197] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-17T17:31:58.514310] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-17T17:31:58.515189] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-17T17:31:58.515260] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-17T17:31:58.516540] [DEBUG] [LOCAL ] BCSF: Trimmed 39642 records to 28764 (keeping 200 days of data) [2025-10-17T17:31:58.703230] [DEBUG] [LOCAL ] BCSF: Primary data saved (28764 records). [2025-10-17T17:31:58.703574] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-17T17:31:58.709537] [INFO ] [MAIN ] Update Progress: 239/2368 symbols completed. BCSF took 35.9s. Estimated remaining: 4h 44m 17s. Rate: 7.5 symbols/min [2025-10-17T17:31:58.719122] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T17:31:58.724624] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-17T17:31:59.841305] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T17:31:59.844927] [INFO ] [REMOTE ] BDC: Full fetch complete (35859 records). [2025-10-17T17:31:59.845060] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-17T17:32:00.214963] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-17T17:32:00.215088] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-17T17:32:00.215558] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-17T17:32:00.215603] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-17T17:32:00.216399] [DEBUG] [LOCAL ] BDC: Trimmed 35859 records to 24777 (keeping 200 days of data) [2025-10-17T17:32:00.368394] [DEBUG] [LOCAL ] BDC: Primary data saved (24777 records). [2025-10-17T17:32:00.368529] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-17T17:32:00.368612] [INFO ] [MAIN ] Update Progress: 240/2368 symbols completed. BDC took 31.4s. Estimated remaining: 4h 43m 13s. Rate: 7.5 symbols/min [2025-10-17T17:32:01.085544] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:01.141332] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:01.080941] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:01.144454] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:01.209600] [DEBUG] [LOCAL ] BDJ: Loaded 29694 existing records from primary storage. [2025-10-17T17:32:01.211525] [INFO ] [MAIN ] BDJ: Loaded 29694 existing records. [2025-10-17T17:32:01.365949] [DEBUG] [LOCAL ] BE: Loaded 54051 existing records from primary storage. [2025-10-17T17:32:01.349417] [DEBUG] [LOCAL ] BDN: Loaded 48013 existing records from primary storage. [2025-10-17T17:32:01.383265] [INFO ] [MAIN ] BE: Loaded 54051 existing records. [2025-10-17T17:32:01.387315] [INFO ] [MAIN ] BDN: Loaded 48013 existing records. [2025-10-17T17:32:01.558099] [DEBUG] [LOCAL ] BDX: Loaded 52564 existing records from primary storage. [2025-10-17T17:32:01.688405] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:32:01.731940] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-17T17:32:01.721420] [INFO ] [MAIN ] BDX: Loaded 52564 existing records. [2025-10-17T17:32:01.737507] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-17T17:32:01.837690] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-17T17:32:01.881710] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-17T17:32:01.910243] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:32:02.025461] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-17T17:32:02.089960] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-17T17:32:02.206092] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-17T17:32:02.232361] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:32:02.264633] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-17T17:32:02.275142] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-17T17:32:02.418851] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:32:02.351024] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-17T17:32:02.517383] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-17T17:32:02.517686] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-17T17:32:02.480248] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-17T17:32:02.536267] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-17T17:32:02.674411] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-17T17:32:02.784226] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-17T17:32:03.263097] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:03.346544] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-17T17:32:03.631445] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:03.681882] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-17T17:32:03.739735] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:03.742913] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-17T17:32:03.823916] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:03.824219] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-17T17:32:04.895503] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T17:32:04.902070] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-17T17:32:05.531592] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T17:32:05.541461] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-17T17:32:05.722475] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T17:32:05.733372] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-17T17:32:05.786552] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-17T17:32:05.793334] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-17T17:32:05.852134] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-17T17:32:05.863051] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-17T17:32:06.971151] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T17:32:06.977163] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-17T17:32:07.207006] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T17:32:07.216855] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-17T17:32:07.449224] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T17:32:07.698362] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T17:32:07.781335] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-17T17:32:07.958014] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-17T17:32:08.409622] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T17:32:08.758094] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-17T17:32:09.558258] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-17T17:32:09.887409] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-17T17:32:10.045986] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-17T17:32:10.358039] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-17T17:32:11.105465] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T17:32:11.158005] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-17T17:32:11.228238] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-17T17:32:11.958055] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-17T17:32:12.758015] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-17T17:32:12.921638] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T17:32:13.558039] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-17T17:32:14.250977] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-17T17:32:14.296265] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T17:32:14.358039] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-17T17:32:15.158006] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-17T17:32:15.560686] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-17T17:32:15.958003] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-17T17:32:16.051325] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T17:32:16.542727] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T17:32:16.758036] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-17T17:32:17.558024] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-17T17:32:17.865734] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T17:32:18.358017] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-17T17:32:18.424578] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T17:32:18.769373] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-17T17:32:19.158028] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-17T17:32:19.958060] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-17T17:32:20.411040] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-17T17:32:20.758084] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-17T17:32:21.558019] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-17T17:32:21.653446] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T17:32:21.721144] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T17:32:21.762997] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-17T17:32:22.358065] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-17T17:32:23.158000] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-17T17:32:23.296299] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T17:32:23.958017] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-17T17:32:24.173141] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T17:32:24.348875] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T17:32:24.758066] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-17T17:32:25.558079] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-17T17:32:25.768452] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T17:32:26.358080] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-17T17:32:26.391885] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T17:32:27.132940] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T17:32:27.137624] [INFO ] [REMOTE ] BDJ: Full fetch complete (42991 records). [2025-10-17T17:32:27.137775] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-17T17:32:27.168325] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-17T17:32:27.534241] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-17T17:32:27.534324] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-17T17:32:27.534871] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-17T17:32:27.534942] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-17T17:32:27.536027] [DEBUG] [LOCAL ] BDJ: Trimmed 42991 records to 29832 (keeping 200 days of data) [2025-10-17T17:32:27.714891] [DEBUG] [LOCAL ] BDJ: Primary data saved (29832 records). [2025-10-17T17:32:27.715041] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-17T17:32:27.715127] [INFO ] [MAIN ] Update Progress: 241/2368 symbols completed. BDJ took 27.3s. Estimated remaining: 4h 45m 55s. Rate: 7.4 symbols/min [2025-10-17T17:32:27.886336] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:27.886524] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-17T17:32:27.886671] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-17T17:32:27.886789] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-17T17:32:27.886831] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-17T17:32:27.886873] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-17T17:32:27.886905] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-17T17:32:27.960123] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-17T17:32:28.298907] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T17:32:28.304723] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:28.758049] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-17T17:32:29.194704] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T17:32:29.558002] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-17T17:32:29.813814] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T17:32:30.358082] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-17T17:32:30.553940] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T17:32:30.560978] [INFO ] [REMOTE ] BDX: Full fetch complete (75557 records). [2025-10-17T17:32:30.561136] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-17T17:32:30.960085] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-17T17:32:30.960272] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-17T17:32:30.961170] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-17T17:32:30.961257] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-17T17:32:30.956191] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-17T17:32:30.964420] [DEBUG] [LOCAL ] BDX: Trimmed 75557 records to 52951 (keeping 200 days of data) [2025-10-17T17:32:31.165629] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-17T17:32:31.318071] [DEBUG] [LOCAL ] BDX: Primary data saved (52951 records). [2025-10-17T17:32:31.318218] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-17T17:32:31.318329] [INFO ] [MAIN ] Update Progress: 242/2368 symbols completed. BDX took 30.9s. Estimated remaining: 4h 45m 8s. Rate: 7.5 symbols/min [2025-10-17T17:32:31.499350] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:31.534025] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-17T17:32:31.547563] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-17T17:32:31.595625] [DEBUG] [LOCAL ] BEKE: Loaded 53596 existing records from primary storage. [2025-10-17T17:32:31.596007] [INFO ] [MAIN ] BEKE: Loaded 53596 existing records. [2025-10-17T17:32:31.793008] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:32:31.793268] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-17T17:32:31.793318] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-17T17:32:31.793812] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-17T17:32:31.793873] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-17T17:32:31.968829] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-17T17:32:32.164614] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:32.383496] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-17T17:32:32.758024] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-17T17:32:33.558076] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-17T17:32:33.985843] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-17T17:32:34.358021] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-17T17:32:34.560335] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T17:32:35.158215] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-17T17:32:35.668201] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T17:32:35.958033] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-17T17:32:36.243582] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T17:32:36.249961] [INFO ] [REMOTE ] BDN: Full fetch complete (69073 records). [2025-10-17T17:32:36.250175] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-17T17:32:36.251156] [FATAL] [VALIDATOR ] BDN: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:32:36.251262] [FATAL] [MAIN ] BDN: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:32:36.251348] [WARN ] [MAIN ] BDN: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:32:36.251444] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-17T17:32:36.251547] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-10-17T17:32:36.251635] [INFO ] [LOCAL ] BDN: Starting deletion of derivative data. [2025-10-17T17:32:36.251868] [DEBUG] [LOCAL ] BDN: Deleted derivative data file. [2025-10-17T17:32:36.251988] [INFO ] [MAIN ] Update Progress: 243/2368 symbols completed. BDN took 35.9s. Estimated remaining: 4h 44m 33s. Rate: 7.5 symbols/min [2025-10-17T17:32:36.420330] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:36.468904] [DEBUG] [LOCAL ] BEN: Loaded 53511 existing records from primary storage. [2025-10-17T17:32:36.469255] [INFO ] [MAIN ] BEN: Loaded 53511 existing records. [2025-10-17T17:32:36.641667] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:32:36.641870] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-17T17:32:36.641940] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-17T17:32:36.642259] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-17T17:32:36.642316] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-17T17:32:36.763179] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-17T17:32:37.002012] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:37.179901] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-17T17:32:37.558046] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-17T17:32:37.883081] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-17T17:32:38.173378] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-17T17:32:38.358069] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-17T17:32:38.590681] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-17T17:32:39.158083] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-17T17:32:39.958035] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-17T17:32:40.758062] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-17T17:32:40.940258] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T17:32:41.065989] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-17T17:32:41.558032] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-17T17:32:41.738512] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T17:32:41.909818] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-17T17:32:42.358041] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-17T17:32:43.158028] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-17T17:32:43.958023] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-17T17:32:44.343067] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-17T17:32:44.758046] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-17T17:32:45.558006] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-17T17:32:45.589871] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-17T17:32:45.791816] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T17:32:46.073475] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-17T17:32:46.074335] [INFO ] [REMOTE ] BEDU: Full fetch complete (1326 records). [2025-10-17T17:32:46.074585] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-17T17:32:46.266998] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-17T17:32:46.267245] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:32:46.267314] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:32:46.267392] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-17T17:32:46.267482] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-17T17:32:46.267542] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-17T17:32:46.267627] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-17T17:32:46.267731] [INFO ] [MAIN ] Update Progress: 244/2368 symbols completed. BEDU took 18.6s. Estimated remaining: 4h 44m 42s. Rate: 7.5 symbols/min [2025-10-17T17:32:46.364468] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-17T17:32:46.445256] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:46.445533] [DEBUG] [LOCAL ] BEP: No existing data file found in primary storage. [2025-10-17T17:32:46.445573] [WARN ] [MAIN ] BEP: No existing data found, performing full refresh instead. [2025-10-17T17:32:46.445730] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-17T17:32:46.445779] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-17T17:32:46.445823] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-10-17T17:32:46.445857] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-17T17:32:46.843768] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:46.903601] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-17T17:32:47.158048] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-17T17:32:47.958098] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-17T17:32:48.123721] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T17:32:48.683836] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T17:32:48.758069] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-17T17:32:49.558098] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-17T17:32:50.358055] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-17T17:32:50.599179] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T17:32:50.654084] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-10-17T17:32:51.131478] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T17:32:51.158014] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-17T17:32:51.958012] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-17T17:32:52.420756] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T17:32:52.758072] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-17T17:32:53.019813] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T17:32:53.372471] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T17:32:53.558017] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-17T17:32:54.358075] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-17T17:32:55.158032] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-17T17:32:55.267423] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T17:32:55.508887] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-17T17:32:55.516856] [INFO ] [REMOTE ] BE: Full fetch complete (77813 records). [2025-10-17T17:32:55.517177] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-17T17:32:55.959574] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-17T17:32:55.982439] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T17:32:55.982775] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-17T17:32:55.993376] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-17T17:32:55.995038] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-17T17:32:55.995166] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-17T17:32:55.997102] [DEBUG] [LOCAL ] BE: Trimmed 77813 records to 54441 (keeping 200 days of data) [2025-10-17T17:32:56.331915] [DEBUG] [LOCAL ] BE: Primary data saved (54441 records). [2025-10-17T17:32:56.332063] [INFO ] [MAIN ] BE: Full history saved. [2025-10-17T17:32:56.332192] [INFO ] [MAIN ] Update Progress: 245/2368 symbols completed. BE took 56.0s. Estimated remaining: 4h 44m 52s. Rate: 7.5 symbols/min [2025-10-17T17:32:56.506633] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:32:56.553220] [DEBUG] [LOCAL ] BEPC: Loaded 46866 existing records from primary storage. [2025-10-17T17:32:56.553618] [INFO ] [MAIN ] BEPC: Loaded 46866 existing records. [2025-10-17T17:32:56.746566] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:32:56.746959] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-17T17:32:56.747030] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-17T17:32:56.747395] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-17T17:32:56.747485] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-17T17:32:56.780183] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-17T17:32:57.136432] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:32:57.183128] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T17:32:57.239707] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T17:32:57.558056] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-17T17:32:58.337623] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T17:32:58.358061] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-17T17:32:59.158050] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-17T17:32:59.592157] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-17T17:32:59.943298] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T17:32:59.957996] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-17T17:33:00.758062] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-17T17:33:01.116527] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T17:33:01.558064] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-17T17:33:01.631907] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T17:33:02.358074] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-17T17:33:02.935605] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-17T17:33:03.158062] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-17T17:33:03.226274] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T17:33:03.958075] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-17T17:33:04.191883] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T17:33:04.746587] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T17:33:04.757978] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-17T17:33:05.268371] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T17:33:05.558058] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-17T17:33:06.147924] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T17:33:06.358052] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-17T17:33:07.158077] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-17T17:33:07.393251] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T17:33:07.857636] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T17:33:07.958063] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-17T17:33:08.758076] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-17T17:33:09.056076] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T17:33:09.465976] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T17:33:09.473202] [INFO ] [REMOTE ] BEP: Full fetch complete (59310 records). [2025-10-17T17:33:09.473387] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-17T17:33:09.563249] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-17T17:33:09.878863] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-17T17:33:09.878993] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-17T17:33:09.879973] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-17T17:33:09.880052] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-17T17:33:09.881899] [DEBUG] [LOCAL ] BEP: Trimmed 59310 records to 39645 (keeping 200 days of data) [2025-10-17T17:33:10.137008] [DEBUG] [LOCAL ] BEP: Primary data saved (39645 records). [2025-10-17T17:33:10.137216] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-17T17:33:10.137311] [INFO ] [MAIN ] Update Progress: 246/2368 symbols completed. BEP took 23.9s. Estimated remaining: 4h 45m 33s. Rate: 7.4 symbols/min [2025-10-17T17:33:10.321411] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:33:10.331075] [DEBUG] [LOCAL ] BEPH: Loaded 5205 existing records from primary storage. [2025-10-17T17:33:10.331338] [INFO ] [MAIN ] BEPH: Loaded 5205 existing records. [2025-10-17T17:33:10.363155] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-17T17:33:10.529624] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:33:10.530281] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-17T17:33:10.530392] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-17T17:33:10.530864] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-17T17:33:10.531134] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-17T17:33:10.641430] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T17:33:10.683201] [INFO ] [REMOTE ] BEN: Full fetch complete (77085 records). [2025-10-17T17:33:10.713023] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-17T17:33:11.164946] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:33:11.201777] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-17T17:33:11.386407] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-17T17:33:11.386520] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-17T17:33:11.387430] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-17T17:33:11.387524] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-17T17:33:11.389943] [DEBUG] [LOCAL ] BEN: Trimmed 77085 records to 53896 (keeping 200 days of data) [2025-10-17T17:33:11.658845] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-17T17:33:11.776409] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-17T17:33:11.798984] [DEBUG] [LOCAL ] BEN: Primary data saved (53896 records). [2025-10-17T17:33:11.799113] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-17T17:33:11.799788] [INFO ] [MAIN ] Update Progress: 247/2368 symbols completed. BEN took 35.5s. Estimated remaining: 4h 44m 30s. Rate: 7.5 symbols/min [2025-10-17T17:33:11.961266] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-17T17:33:11.983879] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:33:11.996965] [DEBUG] [LOCAL ] BEPI: Loaded 3629 existing records from primary storage. [2025-10-17T17:33:11.997950] [INFO ] [MAIN ] BEPI: Loaded 3629 existing records. [2025-10-17T17:33:12.259509] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T17:33:12.257191] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:33:12.270529] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-17T17:33:12.270887] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-17T17:33:12.271573] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-17T17:33:12.271636] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-17T17:33:12.637155] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:33:12.758063] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-17T17:33:13.482266] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-17T17:33:13.558041] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-17T17:33:13.780244] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T17:33:13.878214] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-17T17:33:14.358025] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-17T17:33:15.158061] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-17T17:33:15.645547] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T17:33:15.920196] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T17:33:15.957999] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-17T17:33:16.758046] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-17T17:33:17.391527] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T17:33:17.558058] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-17T17:33:18.358092] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-17T17:33:18.566619] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T17:33:18.648698] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-17T17:33:19.158045] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-17T17:33:19.257624] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T17:33:19.667395] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T17:33:19.958048] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-17T17:33:20.562210] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T17:33:20.758034] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-17T17:33:21.349845] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T17:33:21.558041] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-17T17:33:22.358054] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-17T17:33:23.158082] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-17T17:33:23.298681] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T17:33:23.306251] [INFO ] [REMOTE ] BEKE: Full fetch complete (77335 records). [2025-10-17T17:33:23.306386] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-17T17:33:23.803190] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-17T17:33:23.803495] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-17T17:33:23.804799] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-17T17:33:23.805031] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-17T17:33:23.830423] [DEBUG] [LOCAL ] BEKE: Trimmed 77335 records to 53980 (keeping 200 days of data) [2025-10-17T17:33:23.831342] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T17:33:23.947901] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T17:33:23.958130] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-17T17:33:24.185445] [DEBUG] [LOCAL ] BEKE: Primary data saved (53980 records). [2025-10-17T17:33:24.185595] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-17T17:33:24.186837] [INFO ] [MAIN ] Update Progress: 248/2368 symbols completed. BEKE took 52.9s. Estimated remaining: 4h 44m 59s. Rate: 7.4 symbols/min [2025-10-17T17:33:24.355966] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:33:24.362200] [DEBUG] [LOCAL ] BEPJ: Loaded 3119 existing records from primary storage. [2025-10-17T17:33:24.362386] [INFO ] [MAIN ] BEPJ: Loaded 3119 existing records. [2025-10-17T17:33:24.538893] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:33:24.545865] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-17T17:33:24.545944] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-17T17:33:24.546224] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-17T17:33:24.548704] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-17T17:33:24.549268] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-17T17:33:24.763208] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-17T17:33:24.904044] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:33:25.395246] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T17:33:25.558023] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-17T17:33:26.026313] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-17T17:33:26.358087] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-17T17:33:26.978627] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T17:33:27.158053] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-17T17:33:27.705408] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-17T17:33:27.958050] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-17T17:33:28.544892] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-17T17:33:28.758049] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-17T17:33:29.350784] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T17:33:29.558015] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-17T17:33:30.101807] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-17T17:33:30.358032] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-17T17:33:31.037832] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-17T17:33:31.158056] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-17T17:33:31.958033] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-17T17:33:32.492790] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-17T17:33:32.651365] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T17:33:32.758023] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-17T17:33:33.558050] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-17T17:33:34.318551] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-17T17:33:34.319946] [INFO ] [REMOTE ] BEPH: Full fetch complete (7589 records). [2025-10-17T17:33:34.320087] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-17T17:33:34.363173] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-17T17:33:34.465838] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T17:33:34.525815] [INFO ] [REMOTE ] BEPC: Full fetch complete (68934 records). [2025-10-17T17:33:34.534732] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-17T17:33:35.039034] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-17T17:33:35.038830] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-17T17:33:35.044404] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-17T17:33:35.069297] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-17T17:33:35.077338] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-17T17:33:35.080744] [DEBUG] [LOCAL ] BEPH: Trimmed 7589 records to 5233 (keeping 200 days of data) [2025-10-17T17:33:35.158088] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-17T17:33:35.255124] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-17T17:33:35.256503] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-17T17:33:35.262109] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-17T17:33:35.264370] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-17T17:33:35.264248] [DEBUG] [LOCAL ] BEPH: Primary data saved (5233 records). [2025-10-17T17:33:35.264598] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-17T17:33:35.265008] [INFO ] [MAIN ] Update Progress: 249/2368 symbols completed. BEPH took 25.1s. Estimated remaining: 4h 45m 17s. Rate: 7.4 symbols/min [2025-10-17T17:33:35.347533] [DEBUG] [LOCAL ] BEPC: Trimmed 68934 records to 47230 (keeping 200 days of data) [2025-10-17T17:33:35.535613] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:33:35.651251] [DEBUG] [LOCAL ] BFAM: Loaded 34121 existing records from primary storage. [2025-10-17T17:33:35.682909] [INFO ] [MAIN ] BFAM: Loaded 34121 existing records. [2025-10-17T17:33:35.827262] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-17T17:33:35.952259] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:33:35.964986] [DEBUG] [LOCAL ] BEPC: Primary data saved (47230 records). [2025-10-17T17:33:35.965806] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-17T17:33:35.965162] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-17T17:33:35.966063] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-17T17:33:35.965929] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-17T17:33:35.966243] [INFO ] [MAIN ] Update Progress: 250/2368 symbols completed. BEPC took 39.6s. Estimated remaining: 4h 44m 6s. Rate: 7.5 symbols/min [2025-10-17T17:33:35.973947] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-17T17:33:35.989081] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-17T17:33:36.270931] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:33:36.509360] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:33:36.521638] [DEBUG] [LOCAL ] BFH: Loaded 41891 existing records from primary storage. [2025-10-17T17:33:36.521940] [INFO ] [MAIN ] BFH: Loaded 41891 existing records. [2025-10-17T17:33:36.623923] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-17T17:33:36.702861] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:33:36.703064] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-17T17:33:36.703111] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-17T17:33:36.703448] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-17T17:33:36.703504] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-17T17:33:36.763289] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-17T17:33:37.046887] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:33:37.539797] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T17:33:37.558050] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-17T17:33:38.094736] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-17T17:33:38.358066] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-17T17:33:39.158126] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-17T17:33:39.916707] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T17:33:39.958004] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-17T17:33:40.486514] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T17:33:40.758057] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-17T17:33:41.295264] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T17:33:41.558008] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-17T17:33:41.716688] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-17T17:33:42.029375] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-17T17:33:42.358049] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-17T17:33:42.825123] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T17:33:43.158079] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-17T17:33:43.958051] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-17T17:33:44.409316] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-17T17:33:44.691269] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T17:33:44.692267] [INFO ] [REMOTE ] BEPI: Full fetch complete (4713 records). [2025-10-17T17:33:44.692335] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-17T17:33:44.763226] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-17T17:33:45.057092] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-17T17:33:45.057190] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-17T17:33:45.057362] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-17T17:33:45.057404] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-17T17:33:45.057834] [DEBUG] [LOCAL ] BEPI: Trimmed 4713 records to 3648 (keeping 200 days of data) [2025-10-17T17:33:45.080303] [DEBUG] [LOCAL ] BEPI: Primary data saved (3648 records). [2025-10-17T17:33:45.080376] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-17T17:33:45.080447] [INFO ] [MAIN ] Update Progress: 251/2368 symbols completed. BEPI took 33.3s. Estimated remaining: 4h 44m 7s. Rate: 7.5 symbols/min [2025-10-17T17:33:45.248995] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:33:45.263208] [DEBUG] [LOCAL ] BFK: Loaded 13686 existing records from primary storage. [2025-10-17T17:33:45.263444] [INFO ] [MAIN ] BFK: Loaded 13686 existing records. [2025-10-17T17:33:45.441618] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:33:45.441833] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-17T17:33:45.441882] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-17T17:33:45.442056] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-17T17:33:45.442096] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-17T17:33:45.563212] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-17T17:33:45.808138] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:33:46.075320] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T17:33:46.358029] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-17T17:33:47.076510] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T17:33:47.158003] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-17T17:33:47.684176] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-17T17:33:47.958062] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-17T17:33:48.758073] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-17T17:33:48.808121] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T17:33:48.897565] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-17T17:33:49.558008] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-17T17:33:49.747591] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T17:33:50.358101] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-17T17:33:51.050202] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-17T17:33:51.158014] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-17T17:33:51.333118] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T17:33:51.574216] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-17T17:33:51.958076] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-17T17:33:52.571495] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T17:33:52.758037] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-17T17:33:53.192027] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-17T17:33:53.558057] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-17T17:33:54.358054] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-17T17:33:54.941480] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T17:33:55.158060] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-17T17:33:55.841915] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T17:33:55.958064] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-17T17:33:56.334234] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-17T17:33:56.335065] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4384 records). [2025-10-17T17:33:56.335132] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-17T17:33:56.700041] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-17T17:33:56.700150] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-17T17:33:56.700392] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-17T17:33:56.700473] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-17T17:33:56.701101] [DEBUG] [LOCAL ] BEPJ: Trimmed 4384 records to 3122 (keeping 200 days of data) [2025-10-17T17:33:56.730472] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3122 records). [2025-10-17T17:33:56.735758] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-17T17:33:56.735886] [INFO ] [MAIN ] Update Progress: 252/2368 symbols completed. BEPJ took 32.5s. Estimated remaining: 4h 44m 29s. Rate: 7.4 symbols/min [2025-10-17T17:33:56.760300] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-17T17:33:56.832274] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T17:33:56.946060] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:33:56.999184] [DEBUG] [LOCAL ] BFLY: Loaded 52222 existing records from primary storage. [2025-10-17T17:33:56.999535] [INFO ] [MAIN ] BFLY: Loaded 52222 existing records. [2025-10-17T17:33:57.170078] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:33:57.170324] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-17T17:33:57.170372] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-17T17:33:57.170834] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-17T17:33:57.170891] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-17T17:33:57.516971] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:33:57.558156] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-17T17:33:57.609843] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-17T17:33:58.358067] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-17T17:33:59.024631] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T17:33:59.158030] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-17T17:33:59.958171] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-17T17:34:00.176472] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T17:34:00.592557] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T17:34:00.758093] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-17T17:34:00.925880] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T17:34:01.558067] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-17T17:34:02.131063] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T17:34:02.358085] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-17T17:34:02.469195] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T17:34:03.158063] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-17T17:34:03.957993] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-17T17:34:04.008597] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T17:34:04.202189] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T17:34:04.758028] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-17T17:34:05.540196] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T17:34:05.558030] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-17T17:34:05.735999] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T17:34:06.358017] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-17T17:34:06.376072] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T17:34:07.158036] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-17T17:34:07.835919] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T17:34:07.958018] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-17T17:34:08.414897] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T17:34:08.758002] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-17T17:34:09.501449] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T17:34:09.557994] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-17T17:34:10.265459] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T17:34:10.270564] [INFO ] [REMOTE ] BFAM: Full fetch complete (47097 records). [2025-10-17T17:34:10.270698] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-17T17:34:10.271284] [FATAL] [VALIDATOR ] BFAM: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:34:10.271372] [FATAL] [MAIN ] BFAM: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:34:10.271414] [WARN ] [MAIN ] BFAM: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:34:10.271454] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-17T17:34:10.271509] [DEBUG] [LOCAL ] BFAM: No primary data file found to delete. [2025-10-17T17:34:10.271544] [INFO ] [LOCAL ] BFAM: Starting deletion of derivative data. [2025-10-17T17:34:10.271736] [DEBUG] [LOCAL ] BFAM: Deleted derivative data file. [2025-10-17T17:34:10.271827] [INFO ] [MAIN ] Update Progress: 253/2368 symbols completed. BFAM took 35.0s. Estimated remaining: 4h 45m 7s. Rate: 7.4 symbols/min [2025-10-17T17:34:10.365857] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-17T17:34:10.441274] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:34:10.441439] [DEBUG] [LOCAL ] BFS: No existing data file found in primary storage. [2025-10-17T17:34:10.441482] [WARN ] [MAIN ] BFS: No existing data found, performing full refresh instead. [2025-10-17T17:34:10.441592] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-17T17:34:10.441632] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-17T17:34:10.441713] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-17T17:34:10.441756] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-17T17:34:10.785678] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:34:11.033624] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T17:34:11.039919] [INFO ] [REMOTE ] BFH: Full fetch complete (60189 records). [2025-10-17T17:34:11.040073] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-17T17:34:11.163109] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-17T17:34:11.361503] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-17T17:34:11.444510] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-17T17:34:11.444622] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-17T17:34:11.445369] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-17T17:34:11.445422] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-17T17:34:11.446724] [DEBUG] [LOCAL ] BFH: Trimmed 60189 records to 42165 (keeping 200 days of data) [2025-10-17T17:34:11.700964] [DEBUG] [LOCAL ] BFH: Primary data saved (42165 records). [2025-10-17T17:34:11.701093] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-17T17:34:11.701179] [INFO ] [MAIN ] Update Progress: 254/2368 symbols completed. BFH took 35.7s. Estimated remaining: 4h 44m 3s. Rate: 7.4 symbols/min [2025-10-17T17:34:11.890427] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:34:11.905941] [DEBUG] [LOCAL ] BFZ: Loaded 12108 existing records from primary storage. [2025-10-17T17:34:11.906183] [INFO ] [MAIN ] BFZ: Loaded 12108 existing records. [2025-10-17T17:34:11.969291] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-17T17:34:12.088865] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:34:12.089093] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-17T17:34:12.089143] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-17T17:34:12.089323] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-17T17:34:12.089403] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-17T17:34:12.461968] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:34:12.758032] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-17T17:34:12.894958] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T17:34:13.103963] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T17:34:13.560098] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-17T17:34:13.562231] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-17T17:34:14.358038] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-17T17:34:15.158014] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-17T17:34:15.388766] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T17:34:15.405472] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-17T17:34:15.958067] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-17T17:34:16.397608] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T17:34:16.758014] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-17T17:34:16.861403] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T17:34:17.558032] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-17T17:34:18.358012] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-17T17:34:18.480377] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T17:34:18.497342] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T17:34:18.501486] [INFO ] [REMOTE ] BFK: Full fetch complete (19103 records). [2025-10-17T17:34:18.501575] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-17T17:34:18.873917] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-17T17:34:18.873999] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-17T17:34:18.874427] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-17T17:34:18.874467] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-17T17:34:18.875117] [DEBUG] [LOCAL ] BFK: Trimmed 19103 records to 13862 (keeping 200 days of data) [2025-10-17T17:34:18.961931] [DEBUG] [LOCAL ] BFK: Primary data saved (13862 records). [2025-10-17T17:34:18.962078] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-17T17:34:18.962166] [INFO ] [MAIN ] Update Progress: 255/2368 symbols completed. BFK took 33.9s. Estimated remaining: 4h 43m 49s. Rate: 7.4 symbols/min [2025-10-17T17:34:19.138912] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:34:19.158064] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-17T17:34:19.194220] [DEBUG] [LOCAL ] BG: Loaded 50912 existing records from primary storage. [2025-10-17T17:34:19.194541] [INFO ] [MAIN ] BG: Loaded 50912 existing records. [2025-10-17T17:34:19.309451] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T17:34:19.391295] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:34:19.391543] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-17T17:34:19.391594] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-17T17:34:19.391948] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-17T17:34:19.392007] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-17T17:34:19.759861] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:34:19.958058] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-17T17:34:20.761310] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-17T17:34:20.783066] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T17:34:20.915012] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T17:34:21.558049] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-17T17:34:22.198738] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-17T17:34:22.358065] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-17T17:34:22.504566] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T17:34:23.158012] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-17T17:34:23.208976] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T17:34:23.958026] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-17T17:34:24.758021] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-17T17:34:24.850614] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T17:34:24.903246] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-17T17:34:25.298352] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-17T17:34:25.558041] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-17T17:34:26.358041] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-17T17:34:27.148814] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-17T17:34:27.157983] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-17T17:34:27.210072] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T17:34:27.914971] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T17:34:27.958050] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-17T17:34:28.760389] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-17T17:34:28.764382] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T17:34:29.558035] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-17T17:34:30.358015] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-17T17:34:30.513102] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-17T17:34:30.719944] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-17T17:34:31.158043] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-17T17:34:31.195466] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-17T17:34:31.958025] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-17T17:34:32.758072] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-17T17:34:33.558044] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-17T17:34:33.847727] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-10-17T17:34:34.358096] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-17T17:34:34.409180] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-17T17:34:34.445363] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T17:34:34.896468] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-17T17:34:35.129528] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-17T17:34:35.158029] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-17T17:34:35.958020] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-17T17:34:36.138217] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-17T17:34:36.758085] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-17T17:34:37.558034] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-17T17:34:37.772758] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T17:34:37.852446] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T17:34:38.358027] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-17T17:34:38.412442] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T17:34:39.158050] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-17T17:34:39.958000] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-17T17:34:40.109730] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T17:34:40.134621] [INFO ] [REMOTE ] BFS: Full fetch complete (12996 records). [2025-10-17T17:34:40.137413] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-17T17:34:40.138965] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T17:34:40.149295] [FATAL] [VALIDATOR ] BFS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:34:40.149806] [FATAL] [MAIN ] BFS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:34:40.149987] [WARN ] [MAIN ] BFS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:34:40.150069] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-17T17:34:40.150497] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-17T17:34:40.150561] [INFO ] [LOCAL ] BFS: Starting deletion of derivative data. [2025-10-17T17:34:40.150604] [DEBUG] [LOCAL ] BFS: No derivative data file found to delete. [2025-10-17T17:34:40.150681] [INFO ] [MAIN ] Update Progress: 256/2368 symbols completed. BFS took 29.9s. Estimated remaining: 4h 45m 29s. Rate: 7.4 symbols/min [2025-10-17T17:34:40.320287] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:34:40.320453] [DEBUG] [LOCAL ] BGB: No existing data file found in primary storage. [2025-10-17T17:34:40.320492] [WARN ] [MAIN ] BGB: No existing data found, performing full refresh instead. [2025-10-17T17:34:40.320639] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-17T17:34:40.320758] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-17T17:34:40.320808] [DEBUG] [LOCAL ] BGB: No primary data file found to delete. [2025-10-17T17:34:40.320843] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-17T17:34:40.672436] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:34:40.757995] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-17T17:34:40.967578] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T17:34:40.970612] [INFO ] [REMOTE ] BFZ: Full fetch complete (17502 records). [2025-10-17T17:34:40.970733] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-17T17:34:41.356925] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-17T17:34:41.357017] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-17T17:34:41.357376] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-17T17:34:41.357416] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-17T17:34:41.358006] [DEBUG] [LOCAL ] BFZ: Trimmed 17502 records to 12201 (keeping 200 days of data) [2025-10-17T17:34:41.433992] [DEBUG] [LOCAL ] BFZ: Primary data saved (12201 records). [2025-10-17T17:34:41.434132] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-17T17:34:41.434241] [INFO ] [MAIN ] Update Progress: 257/2368 symbols completed. BFZ took 29.7s. Estimated remaining: 4h 44m 25s. Rate: 7.4 symbols/min [2025-10-17T17:34:41.563183] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-17T17:34:41.613613] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:34:41.633083] [DEBUG] [LOCAL ] BGH: Loaded 17362 existing records from primary storage. [2025-10-17T17:34:41.633320] [INFO ] [MAIN ] BGH: Loaded 17362 existing records. [2025-10-17T17:34:41.848286] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:34:41.848508] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-17T17:34:41.848558] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-17T17:34:41.848795] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-17T17:34:41.848866] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-17T17:34:42.211026] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:34:42.358059] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-17T17:34:42.437499] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:34:43.158060] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-17T17:34:43.545614] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T17:34:43.894037] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-17T17:34:43.902586] [INFO ] [REMOTE ] BFLY: Full fetch complete (75511 records). [2025-10-17T17:34:43.902841] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-17T17:34:43.969402] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-17T17:34:44.324061] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-17T17:34:44.324201] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-17T17:34:44.325270] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-17T17:34:44.325346] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-17T17:34:44.327171] [DEBUG] [LOCAL ] BFLY: Trimmed 75511 records to 52605 (keeping 200 days of data) [2025-10-17T17:34:44.623869] [DEBUG] [LOCAL ] BFLY: Primary data saved (52605 records). [2025-10-17T17:34:44.623995] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-17T17:34:44.624125] [INFO ] [MAIN ] Update Progress: 258/2368 symbols completed. BFLY took 47.9s. Estimated remaining: 4h 43m 37s. Rate: 7.4 symbols/min [2025-10-17T17:34:44.777980] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-17T17:34:44.795232] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:34:44.832334] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T17:34:44.847448] [DEBUG] [LOCAL ] BGR: Loaded 13687 existing records from primary storage. [2025-10-17T17:34:44.847997] [INFO ] [MAIN ] BGR: Loaded 13687 existing records. [2025-10-17T17:34:44.984350] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T17:34:45.055529] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:34:45.055784] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-17T17:34:45.055844] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-17T17:34:45.056022] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-17T17:34:45.056073] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-17T17:34:45.434418] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:34:45.558010] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-17T17:34:45.872835] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T17:34:46.358037] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-17T17:34:47.158039] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-17T17:34:47.443969] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T17:34:47.479044] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-17T17:34:47.614011] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-17T17:34:47.958124] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-17T17:34:48.758080] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-17T17:34:49.558049] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-17T17:34:49.775791] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T17:34:49.803187] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T17:34:50.358070] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-17T17:34:50.475377] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-17T17:34:51.158044] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-17T17:34:51.410285] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T17:34:51.958041] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-17T17:34:52.052938] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T17:34:52.758034] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-17T17:34:53.294900] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T17:34:53.558038] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-17T17:34:54.358012] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-17T17:34:54.536290] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T17:34:54.672087] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T17:34:55.158013] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-17T17:34:55.284700] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T17:34:55.958030] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-17T17:34:56.758056] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-17T17:34:57.402770] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T17:34:57.449051] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-17T17:34:57.456459] [INFO ] [REMOTE ] BG: Full fetch complete (73023 records). [2025-10-17T17:34:57.456597] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-17T17:34:57.563185] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-17T17:34:57.844361] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-17T17:34:57.844439] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-17T17:34:57.845389] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-17T17:34:57.845453] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-17T17:34:57.846812] [DEBUG] [LOCAL ] BG: Trimmed 73023 records to 51286 (keeping 200 days of data) [2025-10-17T17:34:58.157284] [DEBUG] [LOCAL ] BG: Primary data saved (51286 records). [2025-10-17T17:34:58.157452] [INFO ] [MAIN ] BG: Full history saved. [2025-10-17T17:34:58.157615] [INFO ] [MAIN ] Update Progress: 259/2368 symbols completed. BG took 39.2s. Estimated remaining: 4h 44m 13s. Rate: 7.4 symbols/min [2025-10-17T17:34:58.329732] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:34:58.358058] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-17T17:34:58.378722] [DEBUG] [LOCAL ] BGS: Loaded 50921 existing records from primary storage. [2025-10-17T17:34:58.379078] [INFO ] [MAIN ] BGS: Loaded 50921 existing records. [2025-10-17T17:34:58.567286] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:34:58.567674] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-17T17:34:58.567803] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-17T17:34:58.568233] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-17T17:34:58.568313] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-17T17:34:58.946293] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:34:59.039528] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T17:34:59.052706] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-17T17:34:59.157993] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-17T17:34:59.323430] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T17:34:59.958057] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-17T17:35:00.110962] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T17:35:00.758079] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-17T17:35:01.222473] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-17T17:35:01.558072] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-17T17:35:02.358042] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-17T17:35:02.530043] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-17T17:35:02.938837] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-17T17:35:03.158024] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-17T17:35:03.715510] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T17:35:03.958092] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-17T17:35:04.201900] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T17:35:04.205270] [INFO ] [REMOTE ] BGB: Full fetch complete (26851 records). [2025-10-17T17:35:04.205530] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-17T17:35:04.623462] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-17T17:35:04.623577] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-17T17:35:04.624371] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-17T17:35:04.624440] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-17T17:35:04.625423] [DEBUG] [LOCAL ] BGB: Trimmed 26851 records to 18257 (keeping 200 days of data) [2025-10-17T17:35:04.744394] [DEBUG] [LOCAL ] BGB: Primary data saved (18257 records). [2025-10-17T17:35:04.744591] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-17T17:35:04.744699] [INFO ] [MAIN ] Update Progress: 260/2368 symbols completed. BGB took 24.6s. Estimated remaining: 4h 43m 53s. Rate: 7.4 symbols/min [2025-10-17T17:35:04.763315] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-17T17:35:04.945066] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:35:04.957965] [DEBUG] [LOCAL ] BGSF: Loaded 8063 existing records from primary storage. [2025-10-17T17:35:04.958288] [INFO ] [MAIN ] BGSF: Loaded 8063 existing records. [2025-10-17T17:35:05.158570] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:35:05.158904] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-17T17:35:05.158956] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-17T17:35:05.159265] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-17T17:35:05.159323] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-17T17:35:05.538718] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:35:05.563137] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-17T17:35:05.581855] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T17:35:05.730143] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T17:35:06.358045] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-17T17:35:06.629844] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T17:35:07.158077] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-17T17:35:07.958041] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-17T17:35:08.060714] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T17:35:08.090929] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T17:35:08.758036] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-17T17:35:09.558119] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-17T17:35:10.358062] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-17T17:35:10.475749] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-17T17:35:10.577407] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-17T17:35:11.158000] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-17T17:35:11.380562] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T17:35:11.451702] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-17T17:35:11.713172] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T17:35:11.958021] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-17T17:35:12.638664] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T17:35:12.758067] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-17T17:35:13.558036] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-17T17:35:14.358047] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-17T17:35:14.480025] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T17:35:14.886590] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T17:35:15.158034] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-17T17:35:15.958017] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-17T17:35:16.218918] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T17:35:16.219229] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T17:35:16.758098] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-17T17:35:17.119110] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T17:35:17.122125] [INFO ] [REMOTE ] BGH: Full fetch complete (22817 records). [2025-10-17T17:35:17.122200] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-17T17:35:17.123533] [FATAL] [VALIDATOR ] BGH: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:35:17.123630] [FATAL] [MAIN ] BGH: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:35:17.123710] [WARN ] [MAIN ] BGH: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:35:17.123757] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-17T17:35:17.123814] [DEBUG] [LOCAL ] BGH: No primary data file found to delete. [2025-10-17T17:35:17.123851] [INFO ] [LOCAL ] BGH: Starting deletion of derivative data. [2025-10-17T17:35:17.123968] [DEBUG] [LOCAL ] BGH: Deleted derivative data file. [2025-10-17T17:35:17.124035] [INFO ] [MAIN ] Update Progress: 261/2368 symbols completed. BGH took 35.7s. Estimated remaining: 4h 44m 19s. Rate: 7.4 symbols/min [2025-10-17T17:35:17.294020] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:35:17.311853] [DEBUG] [LOCAL ] BGT: Loaded 16514 existing records from primary storage. [2025-10-17T17:35:17.312126] [INFO ] [MAIN ] BGT: Loaded 16514 existing records. [2025-10-17T17:35:17.492686] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:35:17.492904] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-17T17:35:17.492950] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-17T17:35:17.493152] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-17T17:35:17.493190] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-17T17:35:17.561485] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-17T17:35:17.690587] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T17:35:17.872753] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:35:18.358042] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-17T17:35:19.158015] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-17T17:35:19.404129] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T17:35:19.425119] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T17:35:19.754757] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T17:35:19.958020] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-17T17:35:20.758006] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-17T17:35:20.937066] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-17T17:35:21.558004] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-17T17:35:21.874120] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T17:35:22.194063] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-17T17:35:22.358066] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-17T17:35:22.967988] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-17T17:35:23.158033] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-17T17:35:23.958028] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-17T17:35:24.136112] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-17T17:35:24.138584] [INFO ] [REMOTE ] BGR: Full fetch complete (19967 records). [2025-10-17T17:35:24.138724] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-17T17:35:24.520910] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-17T17:35:24.521000] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-17T17:35:24.521380] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-17T17:35:24.521423] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-17T17:35:24.522044] [DEBUG] [LOCAL ] BGR: Trimmed 19967 records to 13773 (keeping 200 days of data) [2025-10-17T17:35:24.569744] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-17T17:35:24.615939] [DEBUG] [LOCAL ] BGR: Primary data saved (13773 records). [2025-10-17T17:35:24.616086] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-17T17:35:24.616175] [INFO ] [MAIN ] Update Progress: 262/2368 symbols completed. BGR took 40.0s. Estimated remaining: 4h 44m 7s. Rate: 7.4 symbols/min [2025-10-17T17:35:24.765297] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-17T17:35:24.793795] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:35:24.809434] [DEBUG] [LOCAL ] BGX: Loaded 11261 existing records from primary storage. [2025-10-17T17:35:24.809719] [INFO ] [MAIN ] BGX: Loaded 11261 existing records. [2025-10-17T17:35:24.986022] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:35:24.986268] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-17T17:35:24.986327] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-17T17:35:24.986504] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-17T17:35:24.986563] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-17T17:35:25.343198] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:35:25.558028] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-17T17:35:26.358044] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-17T17:35:26.424572] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T17:35:26.569485] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T17:35:26.874918] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-17T17:35:27.158052] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-17T17:35:27.958040] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-17T17:35:28.212476] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T17:35:28.758046] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-17T17:35:29.558028] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-17T17:35:29.580191] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T17:35:29.652102] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T17:35:30.358002] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-17T17:35:30.855824] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T17:35:31.158074] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-17T17:35:31.958071] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-17T17:35:32.025380] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T17:35:32.069002] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T17:35:32.758004] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-17T17:35:32.894098] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-17T17:35:33.545454] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T17:35:33.557986] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-17T17:35:34.358066] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-17T17:35:34.374003] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T17:35:35.158074] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-17T17:35:35.362915] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T17:35:35.958116] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-17T17:35:36.681908] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T17:35:36.758011] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-17T17:35:36.860840] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T17:35:37.558058] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-17T17:35:38.339838] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T17:35:38.357976] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-17T17:35:38.568546] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T17:35:38.575598] [INFO ] [REMOTE ] BGS: Full fetch complete (72683 records). [2025-10-17T17:35:38.575743] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-17T17:35:38.958067] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-17T17:35:38.958197] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-17T17:35:38.959081] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-17T17:35:38.959219] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-17T17:35:38.960734] [DEBUG] [LOCAL ] BGS: Trimmed 72683 records to 51299 (keeping 200 days of data) [2025-10-17T17:35:39.183576] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T17:35:39.158748] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-17T17:35:39.269763] [DEBUG] [LOCAL ] BGS: Primary data saved (51299 records). [2025-10-17T17:35:39.269900] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-17T17:35:39.270493] [INFO ] [MAIN ] Update Progress: 263/2368 symbols completed. BGS took 41.1s. Estimated remaining: 4h 44m 51s. Rate: 7.4 symbols/min [2025-10-17T17:35:39.440606] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:35:39.462884] [DEBUG] [LOCAL ] BGY: Loaded 22120 existing records from primary storage. [2025-10-17T17:35:39.463151] [INFO ] [MAIN ] BGY: Loaded 22120 existing records. [2025-10-17T17:35:39.634601] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:35:39.634847] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-17T17:35:39.634895] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-17T17:35:39.635096] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-17T17:35:39.635155] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-17T17:35:39.961726] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-17T17:35:40.003121] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:35:40.243505] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T17:35:40.568268] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T17:35:40.758021] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-17T17:35:41.558023] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-17T17:35:41.930951] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T17:35:42.357991] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-17T17:35:42.443220] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T17:35:43.158074] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-17T17:35:43.488007] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T17:35:43.958006] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-17T17:35:44.284984] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T17:35:44.758083] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-17T17:35:45.167506] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T17:35:45.170007] [INFO ] [REMOTE ] BGSF: Full fetch complete (9604 records). [2025-10-17T17:35:45.170181] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-17T17:35:45.525181] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-17T17:35:45.525326] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-17T17:35:45.525573] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-17T17:35:45.525614] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-17T17:35:45.526126] [DEBUG] [LOCAL ] BGSF: Trimmed 9604 records to 8117 (keeping 200 days of data) [2025-10-17T17:35:45.560224] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-17T17:35:45.575911] [DEBUG] [LOCAL ] BGSF: Primary data saved (8117 records). [2025-10-17T17:35:45.576028] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-17T17:35:45.576111] [INFO ] [MAIN ] Update Progress: 264/2368 symbols completed. BGSF took 40.8s. Estimated remaining: 4h 44m 28s. Rate: 7.4 symbols/min [2025-10-17T17:35:45.747785] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:35:45.807892] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T17:35:45.824869] [DEBUG] [LOCAL ] BH: Loaded 16356 existing records from primary storage. [2025-10-17T17:35:45.825120] [INFO ] [MAIN ] BH: Loaded 16356 existing records. [2025-10-17T17:35:46.011426] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:35:46.011690] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-17T17:35:46.011754] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-17T17:35:46.011946] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-17T17:35:46.011987] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-17T17:35:46.358934] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-17T17:35:46.373042] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:35:46.381240] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-17T17:35:47.158037] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-17T17:35:47.589083] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-17T17:35:47.958004] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-17T17:35:48.076359] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T17:35:48.758076] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-17T17:35:48.824728] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T17:35:49.558038] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-17T17:35:49.789854] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T17:35:49.792239] [INFO ] [REMOTE ] BGT: Full fetch complete (24206 records). [2025-10-17T17:35:49.792330] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-17T17:35:50.160934] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-17T17:35:50.161014] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-17T17:35:50.161397] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-17T17:35:50.161438] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-17T17:35:50.162084] [DEBUG] [LOCAL ] BGT: Trimmed 24206 records to 16635 (keeping 200 days of data) [2025-10-17T17:35:50.259095] [DEBUG] [LOCAL ] BGT: Primary data saved (16635 records). [2025-10-17T17:35:50.259234] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-17T17:35:50.259314] [INFO ] [MAIN ] Update Progress: 265/2368 symbols completed. BGT took 33.1s. Estimated remaining: 4h 43m 53s. Rate: 7.4 symbols/min [2025-10-17T17:35:50.364847] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-17T17:35:50.448699] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:35:50.493906] [DEBUG] [LOCAL ] BHC: Loaded 47069 existing records from primary storage. [2025-10-17T17:35:50.494235] [INFO ] [MAIN ] BHC: Loaded 47069 existing records. [2025-10-17T17:35:50.689329] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:35:50.689777] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-17T17:35:50.689933] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-17T17:35:50.690441] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-17T17:35:50.690503] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-17T17:35:50.826983] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T17:35:51.091134] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:35:51.158050] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-17T17:35:51.442377] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T17:35:51.958094] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-17T17:35:52.283144] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T17:35:52.679303] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T17:35:52.758075] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-17T17:35:53.558032] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-17T17:35:53.643632] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T17:35:54.148810] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T17:35:54.358092] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-17T17:35:55.158027] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-17T17:35:55.779238] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T17:35:55.915681] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-17T17:35:55.958007] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-17T17:35:56.688158] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-17T17:35:56.758032] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-17T17:35:57.557999] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-17T17:35:57.702737] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-17T17:35:58.358040] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-17T17:35:58.590973] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T17:35:58.593754] [INFO ] [REMOTE ] BGX: Full fetch complete (16660 records). [2025-10-17T17:35:58.593863] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-17T17:35:58.964223] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-17T17:35:58.964363] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-17T17:35:58.965021] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-17T17:35:58.965090] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-17T17:35:58.965972] [DEBUG] [LOCAL ] BGX: Trimmed 16660 records to 11350 (keeping 200 days of data) [2025-10-17T17:35:59.033019] [DEBUG] [LOCAL ] BGX: Primary data saved (11350 records). [2025-10-17T17:35:59.033173] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-17T17:35:59.033264] [INFO ] [MAIN ] Update Progress: 266/2368 symbols completed. BGX took 34.4s. Estimated remaining: 4h 43m 50s. Rate: 7.4 symbols/min [2025-10-17T17:35:59.168053] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-17T17:35:59.199967] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:35:59.223409] [DEBUG] [LOCAL ] BHE: Loaded 24043 existing records from primary storage. [2025-10-17T17:35:59.223699] [INFO ] [MAIN ] BHE: Loaded 24043 existing records. [2025-10-17T17:35:59.394469] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:35:59.394716] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-17T17:35:59.394774] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-17T17:35:59.394999] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-17T17:35:59.395039] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-17T17:35:59.744168] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:35:59.886213] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-17T17:35:59.958006] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-17T17:36:00.758046] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-17T17:36:00.864084] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T17:36:01.558005] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-17T17:36:01.807194] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T17:36:01.852034] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T17:36:02.358106] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-17T17:36:02.980481] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T17:36:03.158060] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-17T17:36:03.495437] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T17:36:03.926467] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T17:36:03.958015] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-17T17:36:04.758019] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-17T17:36:04.892940] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T17:36:05.558028] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-17T17:36:05.832419] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T17:36:06.358059] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-17T17:36:07.145479] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T17:36:07.157986] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-17T17:36:07.431521] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T17:36:07.434793] [INFO ] [REMOTE ] BGY: Full fetch complete (33018 records). [2025-10-17T17:36:07.434873] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-17T17:36:07.435395] [FATAL] [VALIDATOR ] BGY: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:36:07.435479] [FATAL] [MAIN ] BGY: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:36:07.435521] [WARN ] [MAIN ] BGY: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:36:07.435561] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-17T17:36:07.435617] [DEBUG] [LOCAL ] BGY: No primary data file found to delete. [2025-10-17T17:36:07.435681] [INFO ] [LOCAL ] BGY: Starting deletion of derivative data. [2025-10-17T17:36:07.435867] [DEBUG] [LOCAL ] BGY: Deleted derivative data file. [2025-10-17T17:36:07.436057] [INFO ] [MAIN ] Update Progress: 267/2368 symbols completed. BGY took 28.2s. Estimated remaining: 4h 43m 45s. Rate: 7.4 symbols/min [2025-10-17T17:36:07.601803] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:36:07.601993] [DEBUG] [LOCAL ] BHK: No existing data file found in primary storage. [2025-10-17T17:36:07.602031] [WARN ] [MAIN ] BHK: No existing data found, performing full refresh instead. [2025-10-17T17:36:07.602172] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-17T17:36:07.602247] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-17T17:36:07.602307] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-10-17T17:36:07.602342] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-17T17:36:07.950127] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:36:07.957980] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-17T17:36:08.710811] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T17:36:08.758009] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-17T17:36:09.142161] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T17:36:09.558028] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-17T17:36:09.784560] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T17:36:10.358102] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-17T17:36:11.150258] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T17:36:11.160276] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-17T17:36:11.212388] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-17T17:36:11.958001] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-17T17:36:12.113789] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T17:36:12.758014] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-17T17:36:13.439327] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T17:36:13.558007] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-17T17:36:13.663002] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-17T17:36:14.358039] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-17T17:36:15.028223] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T17:36:15.158019] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-17T17:36:15.636438] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T17:36:15.958029] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-17T17:36:16.101197] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-17T17:36:16.758089] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-17T17:36:17.558090] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-17T17:36:17.726392] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T17:36:17.768409] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T17:36:18.358068] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-17T17:36:18.757092] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-17T17:36:19.158095] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-17T17:36:19.753685] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T17:36:19.966462] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-17T17:36:19.969013] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T17:36:20.758027] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-17T17:36:21.558022] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-17T17:36:21.786885] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T17:36:21.812270] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T17:36:22.358022] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-17T17:36:22.613395] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T17:36:23.158081] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-17T17:36:23.543264] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-17T17:36:23.958055] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-17T17:36:24.746463] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T17:36:24.758119] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-17T17:36:25.268510] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T17:36:25.445552] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-17T17:36:25.558041] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-17T17:36:26.358084] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-17T17:36:26.745357] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-17T17:36:27.158049] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-17T17:36:27.958027] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-17T17:36:28.224577] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-17T17:36:28.253496] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T17:36:28.260350] [INFO ] [REMOTE ] BHC: Full fetch complete (67489 records). [2025-10-17T17:36:28.260504] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-17T17:36:28.644438] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-17T17:36:28.644520] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-17T17:36:28.645267] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-17T17:36:28.645330] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-17T17:36:28.646582] [DEBUG] [LOCAL ] BHC: Trimmed 67489 records to 47402 (keeping 200 days of data) [2025-10-17T17:36:28.758087] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-17T17:36:28.908664] [DEBUG] [LOCAL ] BHC: Primary data saved (47402 records). [2025-10-17T17:36:28.908813] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-17T17:36:28.908898] [INFO ] [MAIN ] Update Progress: 268/2368 symbols completed. BHC took 38.6s. Estimated remaining: 4h 45m 21s. Rate: 7.4 symbols/min [2025-10-17T17:36:29.033760] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T17:36:29.088388] [INFO ] [REMOTE ] BH: Full fetch complete (19539 records). [2025-10-17T17:36:29.090920] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:36:29.091232] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-17T17:36:29.465780] [DEBUG] [LOCAL ] BHP: Loaded 53762 existing records from primary storage. [2025-10-17T17:36:29.491094] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-17T17:36:29.491286] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-17T17:36:29.491695] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-17T17:36:29.491223] [INFO ] [MAIN ] BHP: Loaded 53762 existing records. [2025-10-17T17:36:29.491795] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-17T17:36:29.559757] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-17T17:36:29.560595] [DEBUG] [LOCAL ] BH: Trimmed 19539 records to 16442 (keeping 200 days of data) [2025-10-17T17:36:29.741105] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:36:29.742275] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-17T17:36:29.744748] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-17T17:36:29.745774] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-17T17:36:29.746169] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-17T17:36:29.838979] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T17:36:30.135286] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:36:30.143894] [DEBUG] [LOCAL ] BH: Primary data saved (16442 records). [2025-10-17T17:36:30.143978] [INFO ] [MAIN ] BH: Full history saved. [2025-10-17T17:36:30.144050] [INFO ] [MAIN ] Update Progress: 269/2368 symbols completed. BH took 44.6s. Estimated remaining: 4h 44m 19s. Rate: 7.4 symbols/min [2025-10-17T17:36:30.309045] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:36:30.330728] [DEBUG] [LOCAL ] BHR: Loaded 22248 existing records from primary storage. [2025-10-17T17:36:30.330997] [INFO ] [MAIN ] BHR: Loaded 22248 existing records. [2025-10-17T17:36:30.363103] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-17T17:36:30.504695] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:36:30.504880] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-17T17:36:30.504926] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-17T17:36:30.505173] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-17T17:36:30.505228] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-17T17:36:30.851538] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:36:31.096094] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T17:36:31.157985] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-17T17:36:31.957995] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-17T17:36:32.266578] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T17:36:32.299596] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T17:36:32.303084] [INFO ] [REMOTE ] BHK: Full fetch complete (30460 records). [2025-10-17T17:36:32.303160] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-17T17:36:32.664132] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-17T17:36:32.664207] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-17T17:36:32.664674] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-17T17:36:32.664734] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-17T17:36:32.665423] [DEBUG] [LOCAL ] BHK: Trimmed 30460 records to 23994 (keeping 200 days of data) [2025-10-17T17:36:32.763720] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-17T17:36:32.806693] [DEBUG] [LOCAL ] BHK: Primary data saved (23994 records). [2025-10-17T17:36:32.806815] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-17T17:36:32.806884] [INFO ] [MAIN ] Update Progress: 270/2368 symbols completed. BHK took 25.4s. Estimated remaining: 4h 43m 28s. Rate: 7.4 symbols/min [2025-10-17T17:36:32.981666] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:36:32.981943] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-17T17:36:32.982053] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-17T17:36:32.982278] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-17T17:36:32.982333] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-17T17:36:32.982377] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-17T17:36:32.982410] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-17T17:36:33.138630] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T17:36:33.349716] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:36:33.557992] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-17T17:36:33.703223] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T17:36:33.706559] [INFO ] [REMOTE ] BHE: Full fetch complete (36366 records). [2025-10-17T17:36:33.706669] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-17T17:36:33.973879] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-17T17:36:34.079286] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-17T17:36:34.079366] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-17T17:36:34.079899] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-17T17:36:34.079961] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-17T17:36:34.080738] [DEBUG] [LOCAL ] BHE: Trimmed 36366 records to 24249 (keeping 200 days of data) [2025-10-17T17:36:34.225028] [DEBUG] [LOCAL ] BHE: Primary data saved (24249 records). [2025-10-17T17:36:34.225158] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-17T17:36:34.225239] [INFO ] [MAIN ] Update Progress: 271/2368 symbols completed. BHE took 35.2s. Estimated remaining: 4h 42m 29s. Rate: 7.4 symbols/min [2025-10-17T17:36:34.373362] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-17T17:36:34.407282] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:36:34.458102] [DEBUG] [LOCAL ] BHVN: Loaded 50989 existing records from primary storage. [2025-10-17T17:36:34.458459] [INFO ] [MAIN ] BHVN: Loaded 50989 existing records. [2025-10-17T17:36:34.643561] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:36:34.643813] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-17T17:36:34.643863] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-17T17:36:34.644095] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-17T17:36:34.644152] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-17T17:36:34.989926] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:36:35.158073] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-17T17:36:35.958036] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-17T17:36:36.507622] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-17T17:36:36.585316] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T17:36:36.758053] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-17T17:36:37.087916] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T17:36:37.558065] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-17T17:36:38.305600] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T17:36:38.358042] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-17T17:36:38.751462] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-17T17:36:39.158101] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-17T17:36:39.320038] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T17:36:39.459369] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-17T17:36:39.958085] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-17T17:36:40.758072] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-17T17:36:41.558060] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-17T17:36:41.741854] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T17:36:41.890917] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-17T17:36:41.987795] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T17:36:42.358001] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-17T17:36:42.689831] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-17T17:36:43.158104] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-17T17:36:43.958112] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-17T17:36:44.434927] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-17T17:36:44.758047] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-17T17:36:45.110688] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T17:36:45.558035] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-17T17:36:45.971977] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T17:36:46.358032] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-17T17:36:46.757342] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-17T17:36:47.158033] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-17T17:36:47.250389] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T17:36:47.958006] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-17T17:36:48.625199] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T17:36:48.757993] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-17T17:36:49.108017] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-17T17:36:49.126172] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T17:36:49.558029] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-17T17:36:50.358033] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-17T17:36:51.168596] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-17T17:36:51.170894] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T17:36:51.539249] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-17T17:36:51.958023] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-17T17:36:52.329551] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T17:36:52.758015] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-17T17:36:52.979922] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T17:36:53.558041] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-17T17:36:54.358029] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-17T17:36:54.571720] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T17:36:54.858393] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-17T17:36:54.925867] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T17:36:55.158049] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-17T17:36:55.958088] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-17T17:36:56.444918] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-17T17:36:56.445731] [INFO ] [REMOTE ] BHV: Full fetch complete (1398 records). [2025-10-17T17:36:56.445801] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-17T17:36:56.623841] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-17T17:36:56.624184] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:36:56.624256] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:36:56.624330] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-17T17:36:56.624394] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-17T17:36:56.624431] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-17T17:36:56.624470] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-17T17:36:56.624529] [INFO ] [MAIN ] Update Progress: 272/2368 symbols completed. BHV took 23.8s. Estimated remaining: 4h 44m 11s. Rate: 7.4 symbols/min [2025-10-17T17:36:56.766949] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-17T17:36:56.793716] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:36:56.852792] [DEBUG] [LOCAL ] BILL: Loaded 52887 existing records from primary storage. [2025-10-17T17:36:56.853272] [INFO ] [MAIN ] BILL: Loaded 52887 existing records. [2025-10-17T17:36:57.057840] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:36:57.058560] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-17T17:36:57.058764] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-17T17:36:57.059326] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-17T17:36:57.059411] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-17T17:36:57.389268] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-17T17:36:57.496730] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:36:57.558004] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-17T17:36:58.358032] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-17T17:36:58.528664] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T17:36:59.158116] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-17T17:36:59.495083] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-17T17:36:59.918218] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T17:36:59.957993] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-17T17:37:00.308252] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T17:37:00.758030] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-17T17:37:01.267037] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T17:37:01.558034] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-17T17:37:02.368856] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-17T17:37:02.371528] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T17:37:03.158093] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-17T17:37:03.503470] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T17:37:03.654950] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-17T17:37:03.662470] [INFO ] [REMOTE ] BHP: Full fetch complete (77442 records). [2025-10-17T17:37:03.662622] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-17T17:37:03.958700] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-17T17:37:04.057508] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-17T17:37:04.057600] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-17T17:37:04.058579] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-17T17:37:04.058669] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-17T17:37:04.060231] [DEBUG] [LOCAL ] BHP: Trimmed 77442 records to 54152 (keeping 200 days of data) [2025-10-17T17:37:04.395216] [DEBUG] [LOCAL ] BHP: Primary data saved (54152 records). [2025-10-17T17:37:04.395406] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-17T17:37:04.395568] [INFO ] [MAIN ] Update Progress: 273/2368 symbols completed. BHP took 35.5s. Estimated remaining: 4h 43m 60s. Rate: 7.4 symbols/min [2025-10-17T17:37:04.575556] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:37:04.599507] [DEBUG] [LOCAL ] BIO: Loaded 24218 existing records from primary storage. [2025-10-17T17:37:04.599780] [INFO ] [MAIN ] BIO: Loaded 24218 existing records. [2025-10-17T17:37:04.775057] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-17T17:37:04.779141] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:37:04.781071] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-17T17:37:04.781271] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-17T17:37:04.781921] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-17T17:37:04.782018] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-17T17:37:04.921796] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T17:37:05.096893] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T17:37:05.139499] [INFO ] [REMOTE ] BHR: Full fetch complete (31440 records). [2025-10-17T17:37:05.149953] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-17T17:37:05.267044] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:37:05.563202] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-17T17:37:05.629732] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-17T17:37:05.630021] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-17T17:37:05.630796] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-17T17:37:05.630864] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-17T17:37:05.632074] [DEBUG] [LOCAL ] BHR: Trimmed 31440 records to 22426 (keeping 200 days of data) [2025-10-17T17:37:05.763269] [DEBUG] [LOCAL ] BHR: Primary data saved (22426 records). [2025-10-17T17:37:05.763417] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-17T17:37:05.763554] [INFO ] [MAIN ] Update Progress: 274/2368 symbols completed. BHR took 35.6s. Estimated remaining: 4h 43m 0s. Rate: 7.4 symbols/min [2025-10-17T17:37:05.948066] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:37:05.987226] [DEBUG] [LOCAL ] BIP: Loaded 39510 existing records from primary storage. [2025-10-17T17:37:05.987605] [INFO ] [MAIN ] BIP: Loaded 39510 existing records. [2025-10-17T17:37:06.164120] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:37:06.164362] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-17T17:37:06.164409] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-17T17:37:06.164789] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-17T17:37:06.164849] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-17T17:37:06.370232] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-17T17:37:06.577058] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:37:06.608379] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T17:37:07.044444] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T17:37:07.158015] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-17T17:37:07.451967] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T17:37:07.958036] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-17T17:37:08.758038] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-17T17:37:08.963694] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T17:37:09.558044] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-17T17:37:09.718554] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T17:37:10.111779] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T17:37:10.358045] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-17T17:37:10.613968] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T17:37:11.158059] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-17T17:37:11.958036] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-17T17:37:12.114212] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T17:37:12.147855] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T17:37:12.758032] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-17T17:37:13.526859] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T17:37:13.557985] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-17T17:37:14.024395] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T17:37:14.358064] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-17T17:37:14.833631] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T17:37:15.158069] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-17T17:37:15.918622] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T17:37:15.958007] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-17T17:37:16.359552] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T17:37:16.758023] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-17T17:37:17.504136] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T17:37:17.558008] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-17T17:37:18.357994] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-17T17:37:18.411708] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T17:37:19.025576] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T17:37:19.158060] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-17T17:37:19.848514] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T17:37:19.958043] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-17T17:37:20.758019] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-17T17:37:21.062532] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T17:37:21.270576] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T17:37:21.558042] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-17T17:37:22.358007] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-17T17:37:22.620470] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T17:37:22.670134] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T17:37:23.158084] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-17T17:37:23.411664] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T17:37:23.958044] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-17T17:37:24.758065] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-17T17:37:25.066499] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-17T17:37:25.074382] [INFO ] [REMOTE ] BHVN: Full fetch complete (70536 records). [2025-10-17T17:37:25.074603] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-17T17:37:25.466463] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-17T17:37:25.466584] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-17T17:37:25.467814] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-17T17:37:25.467884] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-17T17:37:25.469962] [DEBUG] [LOCAL ] BHVN: Trimmed 70536 records to 51375 (keeping 200 days of data) [2025-10-17T17:37:25.559177] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-17T17:37:25.801973] [DEBUG] [LOCAL ] BHVN: Primary data saved (51375 records). [2025-10-17T17:37:25.802217] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-17T17:37:25.803376] [INFO ] [MAIN ] Update Progress: 275/2368 symbols completed. BHVN took 51.6s. Estimated remaining: 4h 44m 23s. Rate: 7.4 symbols/min [2025-10-17T17:37:25.988482] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:37:26.031011] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-17T17:37:26.083777] [DEBUG] [LOCAL ] BIPC: Loaded 41583 existing records from primary storage. [2025-10-17T17:37:26.084172] [INFO ] [MAIN ] BIPC: Loaded 41583 existing records. [2025-10-17T17:37:26.264613] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T17:37:26.311479] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:37:26.312455] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-17T17:37:26.312542] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-17T17:37:26.313068] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-17T17:37:26.313144] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-17T17:37:26.363304] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-17T17:37:26.703272] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:37:26.850964] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T17:37:27.158073] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-17T17:37:27.958080] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-17T17:37:28.346325] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-17T17:37:28.355007] [INFO ] [REMOTE ] BILL: Full fetch complete (76104 records). [2025-10-17T17:37:28.355218] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-17T17:37:28.771756] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-17T17:37:28.765492] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T17:37:28.792069] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-17T17:37:28.800529] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-17T17:37:28.801810] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-17T17:37:28.801911] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-17T17:37:28.804147] [DEBUG] [LOCAL ] BILL: Trimmed 76104 records to 53277 (keeping 200 days of data) [2025-10-17T17:37:29.136767] [DEBUG] [LOCAL ] BILL: Primary data saved (53277 records). [2025-10-17T17:37:29.136987] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-17T17:37:29.137091] [INFO ] [MAIN ] Update Progress: 276/2368 symbols completed. BILL took 32.5s. Estimated remaining: 4h 43m 38s. Rate: 7.4 symbols/min [2025-10-17T17:37:29.316419] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:37:29.322563] [DEBUG] [LOCAL ] BIPH: Loaded 2526 existing records from primary storage. [2025-10-17T17:37:29.322911] [INFO ] [MAIN ] BIPH: Loaded 2526 existing records. [2025-10-17T17:37:29.514399] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:37:29.515075] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-17T17:37:29.515137] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-17T17:37:29.515358] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-17T17:37:29.515442] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-17T17:37:29.563167] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-17T17:37:29.614542] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T17:37:29.950199] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:37:30.007567] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T17:37:30.358036] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-17T17:37:31.071122] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T17:37:31.158063] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-17T17:37:31.438989] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T17:37:31.958093] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-17T17:37:32.247185] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T17:37:32.659042] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-17T17:37:32.758038] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-17T17:37:33.558045] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-17T17:37:34.359859] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-17T17:37:34.364330] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T17:37:34.829735] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T17:37:34.945821] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T17:37:35.158066] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-17T17:37:35.958130] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-17T17:37:36.387840] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-17T17:37:36.717904] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T17:37:36.758092] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-17T17:37:37.438384] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-17T17:37:37.558045] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-17T17:37:38.358085] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-17T17:37:39.079209] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-17T17:37:39.086284] [INFO ] [REMOTE ] BIP: Full fetch complete (57566 records). [2025-10-17T17:37:39.086509] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-17T17:37:39.163289] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-17T17:37:39.469293] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-17T17:37:39.469383] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-17T17:37:39.470135] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-17T17:37:39.470198] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-17T17:37:39.471490] [DEBUG] [LOCAL ] BIP: Trimmed 57566 records to 39830 (keeping 200 days of data) [2025-10-17T17:37:39.708903] [DEBUG] [LOCAL ] BIP: Primary data saved (39830 records). [2025-10-17T17:37:39.709306] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-17T17:37:39.709425] [INFO ] [MAIN ] Update Progress: 277/2368 symbols completed. BIP took 33.9s. Estimated remaining: 4h 43m 48s. Rate: 7.4 symbols/min [2025-10-17T17:37:39.793386] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-17T17:37:39.958022] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-17T17:37:40.189211] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T17:37:40.758067] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-17T17:37:41.060682] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T17:37:41.558119] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-17T17:37:41.997578] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-17T17:37:42.358087] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-17T17:37:42.411313] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T17:37:42.879772] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-17T17:37:43.158052] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-17T17:37:43.958055] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-17T17:37:44.177595] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T17:37:44.181054] [INFO ] [REMOTE ] BIO: Full fetch complete (34302 records). [2025-10-17T17:37:44.181188] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-17T17:37:44.577508] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-17T17:37:44.577630] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-17T17:37:44.578305] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-17T17:37:44.578372] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-17T17:37:44.579369] [DEBUG] [LOCAL ] BIO: Trimmed 34302 records to 24345 (keeping 200 days of data) [2025-10-17T17:37:44.730628] [DEBUG] [LOCAL ] BIO: Primary data saved (24345 records). [2025-10-17T17:37:44.730858] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-17T17:37:44.730966] [INFO ] [MAIN ] Update Progress: 278/2368 symbols completed. BIO took 40.3s. Estimated remaining: 4h 43m 17s. Rate: 7.4 symbols/min [2025-10-17T17:37:44.758133] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-17T17:37:45.195723] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-17T17:37:45.373373] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T17:37:45.558042] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-17T17:37:46.358037] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-17T17:37:46.972978] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T17:37:47.104072] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-17T17:37:47.158089] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-17T17:37:47.597176] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-17T17:37:47.958055] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-17T17:37:48.758084] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-17T17:37:49.222312] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-17T17:37:49.223458] [INFO ] [REMOTE ] BIPH: Full fetch complete (3967 records). [2025-10-17T17:37:49.223531] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-17T17:37:49.648987] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T17:37:49.649201] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-17T17:37:49.658844] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-17T17:37:49.659535] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-17T17:37:49.659629] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-17T17:37:49.660586] [DEBUG] [LOCAL ] BIPH: Trimmed 3967 records to 2538 (keeping 200 days of data) [2025-10-17T17:37:49.661557] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-17T17:37:49.680343] [DEBUG] [LOCAL ] BIPH: Primary data saved (2538 records). [2025-10-17T17:37:49.680437] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-17T17:37:49.680524] [INFO ] [MAIN ] Update Progress: 279/2368 symbols completed. BIPH took 20.5s. Estimated remaining: 4h 42m 45s. Rate: 7.4 symbols/min [2025-10-17T17:37:51.211530] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T17:37:51.220459] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-17T17:37:53.123364] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T17:37:53.130138] [INFO ] [REMOTE ] BIPC: Full fetch complete (60309 records). [2025-10-17T17:37:53.130299] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-17T17:37:53.534319] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-17T17:37:53.534485] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-17T17:37:53.535450] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-17T17:37:53.535517] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-17T17:37:53.537402] [DEBUG] [LOCAL ] BIPC: Trimmed 60309 records to 41904 (keeping 200 days of data) [2025-10-17T17:37:53.805326] [DEBUG] [LOCAL ] BIPC: Primary data saved (41904 records). [2025-10-17T17:37:53.805502] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-17T17:37:53.806223] [INFO ] [MAIN ] Update Progress: 280/2368 symbols completed. BIPC took 28.0s. Estimated remaining: 4h 42m 7s. Rate: 7.4 symbols/min [2025-10-17T17:37:54.486746] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:37:54.544628] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:37:54.543098] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:37:54.578455] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:37:54.588354] [DEBUG] [LOCAL ] BIPI: Loaded 3012 existing records from primary storage. [2025-10-17T17:37:54.588899] [INFO ] [MAIN ] BIPI: Loaded 3012 existing records. [2025-10-17T17:37:54.604984] [DEBUG] [LOCAL ] BIPJ: Loaded 3180 existing records from primary storage. [2025-10-17T17:37:54.614866] [INFO ] [MAIN ] BIPJ: Loaded 3180 existing records. [2025-10-17T17:37:54.908780] [DEBUG] [LOCAL ] BIT: Loaded 23884 existing records from primary storage. [2025-10-17T17:37:54.944808] [INFO ] [MAIN ] BIT: Loaded 23884 existing records. [2025-10-17T17:37:54.949062] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:37:55.015547] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-17T17:37:55.033605] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-17T17:37:55.033211] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:37:55.049893] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-17T17:37:55.070374] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-17T17:37:55.105262] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-17T17:37:55.070443] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-17T17:37:55.131487] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-17T17:37:55.121034] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-17T17:37:55.136686] [DEBUG] [LOCAL ] BIRK: Loaded 51493 existing records from primary storage. [2025-10-17T17:37:55.160986] [INFO ] [MAIN ] BIRK: Loaded 51493 existing records. [2025-10-17T17:37:55.649706] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:37:55.710971] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-17T17:37:55.760566] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-17T17:37:55.819525] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-17T17:37:55.830253] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-17T17:37:55.986934] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:37:56.187244] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-17T17:37:56.197608] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-17T17:37:56.265838] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:37:56.293462] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-17T17:37:56.282262] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-17T17:37:56.360002] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-17T17:37:56.444682] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:37:56.472433] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-17T17:37:56.747480] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:37:56.764143] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-17T17:37:56.969218] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:37:56.969570] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-17T17:37:57.085089] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-17T17:37:57.086716] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-17T17:37:57.164371] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-17T17:37:57.167949] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-17T17:37:57.568582] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-17T17:37:57.570041] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-17T17:37:57.736767] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-17T17:37:57.738237] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-17T17:37:57.883433] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T17:37:57.889266] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-17T17:37:58.038002] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-17T17:37:58.080922] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-17T17:37:58.358042] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-17T17:37:58.876169] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T17:37:58.895928] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T17:37:58.947942] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T17:37:59.158066] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-17T17:37:59.714964] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T17:37:59.958054] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-17T17:38:00.758049] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-17T17:38:01.212691] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-17T17:38:01.558075] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-17T17:38:01.925659] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-17T17:38:02.358041] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-17T17:38:02.521943] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-17T17:38:02.804157] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-17T17:38:03.158072] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-17T17:38:03.617032] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-17T17:38:03.958047] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-17T17:38:04.758016] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-17T17:38:04.992514] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T17:38:05.558077] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-17T17:38:06.301191] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:38:06.358078] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-17T17:38:06.599154] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T17:38:07.158079] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-17T17:38:07.569715] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T17:38:07.826276] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T17:38:07.958036] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-17T17:38:08.426797] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-17T17:38:08.758033] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-17T17:38:09.409959] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-17T17:38:09.558034] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-17T17:38:10.358032] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-17T17:38:10.922347] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T17:38:11.158076] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-17T17:38:11.315442] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T17:38:11.958050] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-17T17:38:12.532102] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-17T17:38:12.758030] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-17T17:38:13.558004] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-17T17:38:13.681925] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T17:38:13.816101] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T17:38:13.881711] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-17T17:38:14.358069] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-17T17:38:15.158053] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-17T17:38:15.759379] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-17T17:38:15.958007] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-17T17:38:16.076531] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T17:38:16.386714] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-17T17:38:16.758023] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-17T17:38:17.325107] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-17T17:38:17.326065] [INFO ] [REMOTE ] BIPI: Full fetch complete (4733 records). [2025-10-17T17:38:17.326133] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-17T17:38:17.566744] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-17T17:38:17.704024] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-17T17:38:17.704120] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-17T17:38:17.704351] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-17T17:38:17.704412] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-17T17:38:17.704848] [DEBUG] [LOCAL ] BIPI: Trimmed 4733 records to 3038 (keeping 200 days of data) [2025-10-17T17:38:17.723542] [DEBUG] [LOCAL ] BIPI: Primary data saved (3038 records). [2025-10-17T17:38:17.723694] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-17T17:38:17.723802] [INFO ] [MAIN ] Update Progress: 281/2368 symbols completed. BIPI took 23.9s. Estimated remaining: 4h 43m 56s. Rate: 7.4 symbols/min [2025-10-17T17:38:17.888943] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:38:17.938959] [DEBUG] [LOCAL ] BJ: Loaded 51977 existing records from primary storage. [2025-10-17T17:38:17.939294] [INFO ] [MAIN ] BJ: Loaded 51977 existing records. [2025-10-17T17:38:18.110247] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:38:18.110485] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-17T17:38:18.110532] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-17T17:38:18.111030] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-17T17:38:18.111086] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-17T17:38:18.361444] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-17T17:38:18.461983] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:38:18.595447] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T17:38:18.747163] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-17T17:38:19.158090] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-17T17:38:19.751249] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T17:38:19.752253] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4283 records). [2025-10-17T17:38:19.752325] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-17T17:38:19.963258] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-17T17:38:20.136051] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-17T17:38:20.136127] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-17T17:38:20.136259] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-17T17:38:20.136298] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-17T17:38:20.136661] [DEBUG] [LOCAL ] BIPJ: Trimmed 4283 records to 3197 (keeping 200 days of data) [2025-10-17T17:38:20.155248] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3197 records). [2025-10-17T17:38:20.155319] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-17T17:38:20.155389] [INFO ] [MAIN ] Update Progress: 282/2368 symbols completed. BIPJ took 26.3s. Estimated remaining: 4h 43m 6s. Rate: 7.4 symbols/min [2025-10-17T17:38:20.317771] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:38:20.370769] [DEBUG] [LOCAL ] BK: Loaded 53933 existing records from primary storage. [2025-10-17T17:38:20.371123] [INFO ] [MAIN ] BK: Loaded 53933 existing records. [2025-10-17T17:38:20.550494] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:38:20.550729] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-17T17:38:20.550784] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-17T17:38:20.551231] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-17T17:38:20.551289] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-17T17:38:20.764091] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-17T17:38:20.900099] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:38:21.202321] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T17:38:21.558055] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-17T17:38:22.358014] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-17T17:38:22.628770] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T17:38:23.158086] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-17T17:38:23.351926] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T17:38:23.690135] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-17T17:38:23.958043] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-17T17:38:24.758017] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-17T17:38:24.861507] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:38:25.558046] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-17T17:38:25.643386] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T17:38:26.234820] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T17:38:26.358039] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-17T17:38:27.158184] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-17T17:38:27.409278] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T17:38:27.640122] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T17:38:27.644684] [INFO ] [REMOTE ] BIT: Full fetch complete (32177 records). [2025-10-17T17:38:27.644784] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-17T17:38:27.963326] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-17T17:38:28.058277] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-17T17:38:28.058360] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-17T17:38:28.058889] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-17T17:38:28.058952] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-17T17:38:28.059627] [DEBUG] [LOCAL ] BIT: Trimmed 32177 records to 24078 (keeping 200 days of data) [2025-10-17T17:38:28.201711] [DEBUG] [LOCAL ] BIT: Primary data saved (24078 records). [2025-10-17T17:38:28.201849] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-17T17:38:28.201934] [INFO ] [MAIN ] Update Progress: 283/2368 symbols completed. BIT took 34.4s. Estimated remaining: 4h 42m 57s. Rate: 7.4 symbols/min [2025-10-17T17:38:28.371613] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:38:28.433792] [DEBUG] [LOCAL ] BKD: Loaded 50839 existing records from primary storage. [2025-10-17T17:38:28.434190] [INFO ] [MAIN ] BKD: Loaded 50839 existing records. [2025-10-17T17:38:28.637580] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:38:28.637880] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-17T17:38:28.637937] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-17T17:38:28.638364] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-17T17:38:28.638430] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-17T17:38:28.758206] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-17T17:38:29.251876] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:38:29.256907] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-17T17:38:29.558258] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-17T17:38:29.712795] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T17:38:30.358044] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-17T17:38:30.455077] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T17:38:31.158074] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-17T17:38:31.439295] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T17:38:31.447226] [INFO ] [REMOTE ] BIRK: Full fetch complete (73369 records). [2025-10-17T17:38:31.447403] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-17T17:38:31.876476] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-17T17:38:31.876715] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-17T17:38:31.877539] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-17T17:38:31.877603] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-17T17:38:31.879006] [DEBUG] [LOCAL ] BIRK: Trimmed 73369 records to 51882 (keeping 200 days of data) [2025-10-17T17:38:31.961208] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-17T17:38:32.207096] [DEBUG] [LOCAL ] BIRK: Primary data saved (51882 records). [2025-10-17T17:38:32.210493] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-17T17:38:32.210717] [INFO ] [MAIN ] Update Progress: 284/2368 symbols completed. BIRK took 38.4s. Estimated remaining: 4h 42m 18s. Rate: 7.4 symbols/min [2025-10-17T17:38:32.212391] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T17:38:32.390533] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:38:32.426021] [DEBUG] [LOCAL ] BKE: Loaded 34197 existing records from primary storage. [2025-10-17T17:38:32.426477] [INFO ] [MAIN ] BKE: Loaded 34197 existing records. [2025-10-17T17:38:32.610561] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:38:32.611115] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-17T17:38:32.611223] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-17T17:38:32.621168] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-17T17:38:32.638017] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-17T17:38:32.706964] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T17:38:32.763169] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-17T17:38:33.078922] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:38:33.558040] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-17T17:38:33.808296] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T17:38:34.358051] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-17T17:38:34.609303] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T17:38:35.158041] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-17T17:38:35.249265] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T17:38:35.957992] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-17T17:38:36.317522] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-17T17:38:36.758002] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-17T17:38:37.055716] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-17T17:38:37.498910] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:38:37.558053] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-17T17:38:38.358078] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-17T17:38:38.547416] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T17:38:39.158006] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-17T17:38:39.321818] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-17T17:38:39.481708] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-17T17:38:39.958034] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-17T17:38:40.758011] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-17T17:38:40.898466] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T17:38:41.391006] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T17:38:41.558042] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-17T17:38:42.302353] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T17:38:42.358015] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-17T17:38:42.874588] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T17:38:43.158071] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-17T17:38:43.810532] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T17:38:43.958029] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-17T17:38:44.724068] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T17:38:44.757989] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-17T17:38:45.333250] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T17:38:45.558023] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-17T17:38:46.247181] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T17:38:46.358032] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-17T17:38:47.158046] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-17T17:38:47.390855] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T17:38:47.958070] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-17T17:38:48.339683] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-17T17:38:48.758091] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-17T17:38:49.093526] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-17T17:38:49.558013] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-17T17:38:49.928932] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-17T17:38:49.936328] [INFO ] [REMOTE ] BK: Full fetch complete (77678 records). [2025-10-17T17:38:49.936454] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-17T17:38:50.351361] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-17T17:38:50.352899] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T17:38:50.360257] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-17T17:38:50.360443] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-17T17:38:50.362546] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-17T17:38:50.362988] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-17T17:38:50.364468] [DEBUG] [LOCAL ] BK: Trimmed 77678 records to 54323 (keeping 200 days of data) [2025-10-17T17:38:50.695699] [DEBUG] [LOCAL ] BK: Primary data saved (54323 records). [2025-10-17T17:38:50.695841] [INFO ] [MAIN ] BK: Full history saved. [2025-10-17T17:38:50.695925] [INFO ] [MAIN ] Update Progress: 285/2368 symbols completed. BK took 30.5s. Estimated remaining: 4h 43m 26s. Rate: 7.3 symbols/min [2025-10-17T17:38:50.865067] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:38:50.898884] [DEBUG] [LOCAL ] BKH: Loaded 37416 existing records from primary storage. [2025-10-17T17:38:50.899164] [INFO ] [MAIN ] BKH: Loaded 37416 existing records. [2025-10-17T17:38:51.087175] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:38:51.087412] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-17T17:38:51.087495] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-17T17:38:51.088547] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-17T17:38:51.088731] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-17T17:38:51.163100] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-17T17:38:51.455813] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:38:51.485165] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-17T17:38:51.958000] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-17T17:38:52.046519] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T17:38:52.518343] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T17:38:52.758070] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-17T17:38:53.056068] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T17:38:53.558073] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-17T17:38:54.262999] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:38:54.358029] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-17T17:38:55.026307] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T17:38:55.157994] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-17T17:38:55.958008] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-17T17:38:56.038724] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T17:38:56.477695] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T17:38:56.758038] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-17T17:38:57.072091] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T17:38:57.558029] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-17T17:38:58.358083] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-17T17:38:58.571384] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T17:38:59.073847] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T17:38:59.158117] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-17T17:38:59.789246] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T17:38:59.958078] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-17T17:39:00.758116] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-17T17:39:01.357755] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-17T17:39:01.366848] [INFO ] [REMOTE ] BJ: Full fetch complete (74432 records). [2025-10-17T17:39:01.367126] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-17T17:39:01.558502] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-17T17:39:01.816547] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T17:39:01.883697] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-17T17:39:01.884269] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-17T17:39:01.885424] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-17T17:39:01.885545] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-17T17:39:01.888428] [DEBUG] [LOCAL ] BJ: Trimmed 74432 records to 52353 (keeping 200 days of data) [2025-10-17T17:39:01.999786] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-17T17:39:02.276008] [DEBUG] [LOCAL ] BJ: Primary data saved (52353 records). [2025-10-17T17:39:02.276249] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-17T17:39:02.276363] [INFO ] [MAIN ] Update Progress: 286/2368 symbols completed. BJ took 44.6s. Estimated remaining: 4h 43m 43s. Rate: 7.3 symbols/min [2025-10-17T17:39:02.363243] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-17T17:39:02.469496] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:39:02.513458] [DEBUG] [LOCAL ] BKKT: Loaded 36968 existing records from primary storage. [2025-10-17T17:39:02.513911] [INFO ] [MAIN ] BKKT: Loaded 36968 existing records. [2025-10-17T17:39:02.700279] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:39:02.700616] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-17T17:39:02.700708] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-17T17:39:02.701437] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-17T17:39:02.701506] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-17T17:39:03.085235] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:39:03.158009] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-17T17:39:03.451966] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T17:39:03.482933] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T17:39:03.487993] [INFO ] [REMOTE ] BKE: Full fetch complete (50185 records). [2025-10-17T17:39:03.488078] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-17T17:39:03.488806] [FATAL] [VALIDATOR ] BKE: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:39:03.488896] [FATAL] [MAIN ] BKE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:39:03.488939] [WARN ] [MAIN ] BKE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:39:03.488997] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-17T17:39:03.489055] [DEBUG] [LOCAL ] BKE: No primary data file found to delete. [2025-10-17T17:39:03.489090] [INFO ] [LOCAL ] BKE: Starting deletion of derivative data. [2025-10-17T17:39:03.489230] [DEBUG] [LOCAL ] BKE: Deleted derivative data file. [2025-10-17T17:39:03.489314] [INFO ] [MAIN ] Update Progress: 287/2368 symbols completed. BKE took 31.3s. Estimated remaining: 4h 42m 44s. Rate: 7.4 symbols/min [2025-10-17T17:39:03.659872] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:39:03.669381] [DEBUG] [LOCAL ] BKN: Loaded 7345 existing records from primary storage. [2025-10-17T17:39:03.669548] [INFO ] [MAIN ] BKN: Loaded 7345 existing records. [2025-10-17T17:39:03.843696] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:39:03.843878] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-17T17:39:03.843924] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-17T17:39:03.844102] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-17T17:39:03.844158] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-17T17:39:03.963162] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-17T17:39:04.196962] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:39:04.758038] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-17T17:39:05.175052] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-17T17:39:05.268805] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T17:39:05.558061] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-17T17:39:06.358007] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-17T17:39:06.412585] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T17:39:07.158038] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-17T17:39:07.220162] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T17:39:07.291756] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T17:39:07.958069] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-17T17:39:08.626297] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T17:39:08.758021] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-17T17:39:09.558006] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-17T17:39:09.758112] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T17:39:09.766054] [INFO ] [REMOTE ] BKD: Full fetch complete (72109 records). [2025-10-17T17:39:09.766395] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-17T17:39:10.158390] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-17T17:39:10.158608] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-17T17:39:10.159511] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-17T17:39:10.159592] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-17T17:39:10.180238] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T17:39:10.187638] [DEBUG] [LOCAL ] BKD: Trimmed 72109 records to 51205 (keeping 200 days of data) [2025-10-17T17:39:10.382147] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-17T17:39:10.485136] [DEBUG] [LOCAL ] BKD: Primary data saved (51205 records). [2025-10-17T17:39:10.485310] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-17T17:39:10.486735] [INFO ] [MAIN ] Update Progress: 288/2368 symbols completed. BKD took 42.3s. Estimated remaining: 4h 42m 27s. Rate: 7.4 symbols/min [2025-10-17T17:39:10.661409] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:39:10.717264] [DEBUG] [LOCAL ] BKSY: Loaded 49090 existing records from primary storage. [2025-10-17T17:39:10.717626] [INFO ] [MAIN ] BKSY: Loaded 49090 existing records. [2025-10-17T17:39:10.927163] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:39:10.927669] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-17T17:39:10.927748] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-17T17:39:10.928056] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-17T17:39:10.943417] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-17T17:39:10.988538] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T17:39:11.163380] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-17T17:39:11.341287] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:39:11.958000] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-17T17:39:12.061426] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T17:39:12.104687] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T17:39:12.757999] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-17T17:39:13.389262] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T17:39:13.558033] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-17T17:39:13.783515] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T17:39:14.358011] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-17T17:39:15.115164] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-17T17:39:15.158424] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-17T17:39:15.163048] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T17:39:15.933236] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-17T17:39:15.957991] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-17T17:39:16.689453] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-17T17:39:16.758035] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-17T17:39:17.558032] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-17T17:39:17.565838] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T17:39:18.358058] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-17T17:39:19.085013] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-17T17:39:19.158007] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-17T17:39:19.226058] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T17:39:19.766870] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T17:39:19.958054] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-17T17:39:20.758090] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-17T17:39:21.101940] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T17:39:21.558071] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-17T17:39:22.313831] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T17:39:22.357986] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-17T17:39:22.887481] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T17:39:23.158023] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-17T17:39:23.958061] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-17T17:39:24.081912] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T17:39:24.088919] [INFO ] [REMOTE ] BKH: Full fetch complete (52915 records). [2025-10-17T17:39:24.089138] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-17T17:39:24.503633] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-17T17:39:24.503770] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-17T17:39:24.504677] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-17T17:39:24.504750] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-17T17:39:24.506386] [DEBUG] [LOCAL ] BKH: Trimmed 52915 records to 37744 (keeping 200 days of data) [2025-10-17T17:39:24.732517] [DEBUG] [LOCAL ] BKH: Primary data saved (37744 records). [2025-10-17T17:39:24.732761] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-17T17:39:24.732889] [INFO ] [MAIN ] Update Progress: 289/2368 symbols completed. BKH took 34.0s. Estimated remaining: 4h 43m 3s. Rate: 7.3 symbols/min [2025-10-17T17:39:24.764074] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-17T17:39:24.909932] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:39:24.925823] [DEBUG] [LOCAL ] BKT: Loaded 12606 existing records from primary storage. [2025-10-17T17:39:24.926231] [INFO ] [MAIN ] BKT: Loaded 12606 existing records. [2025-10-17T17:39:25.110186] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:39:25.110612] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-17T17:39:25.110841] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-17T17:39:25.111102] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-17T17:39:25.111247] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-17T17:39:25.322067] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T17:39:25.464219] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-17T17:39:25.555130] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:39:25.555914] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T17:39:25.557877] [INFO ] [REMOTE ] BKN: Full fetch complete (11216 records). [2025-10-17T17:39:25.557995] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-17T17:39:25.557963] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-17T17:39:25.908932] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-17T17:39:25.909020] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-17T17:39:25.909306] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-17T17:39:25.909345] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-17T17:39:25.909822] [DEBUG] [LOCAL ] BKN: Trimmed 11216 records to 7394 (keeping 200 days of data) [2025-10-17T17:39:25.953386] [DEBUG] [LOCAL ] BKN: Primary data saved (7394 records). [2025-10-17T17:39:25.953507] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-17T17:39:25.953590] [INFO ] [MAIN ] Update Progress: 290/2368 symbols completed. BKN took 22.5s. Estimated remaining: 4h 42m 5s. Rate: 7.4 symbols/min [2025-10-17T17:39:26.117744] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:39:26.157189] [DEBUG] [LOCAL ] BKU: Loaded 42528 existing records from primary storage. [2025-10-17T17:39:26.157562] [INFO ] [MAIN ] BKU: Loaded 42528 existing records. [2025-10-17T17:39:26.350695] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:39:26.350938] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-17T17:39:26.350992] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-17T17:39:26.351234] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-17T17:39:26.351289] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-17T17:39:26.363891] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-17T17:39:26.699770] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:39:27.158038] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-17T17:39:27.526270] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T17:39:27.857328] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-17T17:39:27.957999] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-17T17:39:28.012823] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T17:39:28.758067] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-17T17:39:29.419076] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T17:39:29.558032] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-17T17:39:30.358017] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-17T17:39:30.430878] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T17:39:31.066606] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-17T17:39:31.157996] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-17T17:39:31.602310] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T17:39:31.958039] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-17T17:39:32.758092] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-17T17:39:32.843926] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T17:39:33.558066] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-17T17:39:33.922840] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T17:39:34.358894] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-17T17:39:34.368814] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T17:39:34.380049] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-17T17:39:35.157998] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-17T17:39:35.958171] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-17T17:39:35.969671] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-17T17:39:36.619398] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-17T17:39:36.758052] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-17T17:39:37.558032] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-17T17:39:37.855162] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T17:39:38.358057] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-17T17:39:38.496771] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-17T17:39:38.650270] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T17:39:39.158159] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-17T17:39:39.780035] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T17:39:39.958056] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-17T17:39:39.966259] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T17:39:40.758083] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-17T17:39:41.558041] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-17T17:39:42.010050] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-17T17:39:42.162066] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T17:39:42.358073] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-17T17:39:42.407902] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T17:39:43.158092] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-17T17:39:43.820302] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T17:39:43.958075] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-17T17:39:44.758072] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-17T17:39:45.187007] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-17T17:39:45.423455] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T17:39:45.558060] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-17T17:39:46.358019] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-17T17:39:47.050310] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-17T17:39:47.158046] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-17T17:39:47.184233] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-17T17:39:47.191550] [INFO ] [REMOTE ] BKKT: Full fetch complete (51581 records). [2025-10-17T17:39:47.191714] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-17T17:39:47.593324] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-17T17:39:47.593429] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-17T17:39:47.594124] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-17T17:39:47.594189] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-17T17:39:47.595344] [DEBUG] [LOCAL ] BKKT: Trimmed 51581 records to 37334 (keeping 200 days of data) [2025-10-17T17:39:47.814054] [DEBUG] [LOCAL ] BKKT: Primary data saved (37334 records). [2025-10-17T17:39:47.814214] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-17T17:39:47.814303] [INFO ] [MAIN ] Update Progress: 291/2368 symbols completed. BKKT took 45.5s. Estimated remaining: 4h 43m 35s. Rate: 7.3 symbols/min [2025-10-17T17:39:47.927798] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-17T17:39:47.968998] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-17T17:39:48.002872] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:39:48.032508] [DEBUG] [LOCAL ] BKV: Loaded 29852 existing records from primary storage. [2025-10-17T17:39:48.032815] [INFO ] [MAIN ] BKV: Loaded 29852 existing records. [2025-10-17T17:39:48.211612] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:39:48.211986] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-17T17:39:48.212082] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-17T17:39:48.212304] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-17T17:39:48.212385] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-17T17:39:48.404350] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-17T17:39:48.487502] [INFO ] [REMOTE ] BKSY: Full fetch complete (70445 records). [2025-10-17T17:39:48.503088] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-17T17:39:48.703967] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:39:48.764458] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-17T17:39:49.000353] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-17T17:39:48.999792] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-17T17:39:49.000509] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-17T17:39:49.004091] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-17T17:39:49.004568] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-17T17:39:49.006212] [DEBUG] [LOCAL ] BKSY: Trimmed 70445 records to 49470 (keeping 200 days of data) [2025-10-17T17:39:49.291158] [DEBUG] [LOCAL ] BKSY: Primary data saved (49470 records). [2025-10-17T17:39:49.291290] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-17T17:39:49.292493] [INFO ] [MAIN ] Update Progress: 292/2368 symbols completed. BKSY took 38.8s. Estimated remaining: 4h 42m 39s. Rate: 7.3 symbols/min [2025-10-17T17:39:49.462124] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:39:49.504897] [DEBUG] [LOCAL ] BLCO: Loaded 35460 existing records from primary storage. [2025-10-17T17:39:49.505239] [INFO ] [MAIN ] BLCO: Loaded 35460 existing records. [2025-10-17T17:39:49.565797] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-17T17:39:49.683576] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:39:49.683855] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-17T17:39:49.683907] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-17T17:39:49.684155] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-17T17:39:49.684211] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-17T17:39:50.040147] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:39:50.197928] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T17:39:50.358036] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-17T17:39:51.158195] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-17T17:39:51.159459] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T17:39:51.497719] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T17:39:51.958070] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-17T17:39:52.589529] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T17:39:52.758074] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-17T17:39:53.558016] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-17T17:39:53.668156] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-17T17:39:53.672142] [INFO ] [REMOTE ] BKT: Full fetch complete (16450 records). [2025-10-17T17:39:53.672427] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-17T17:39:53.790629] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T17:39:54.066116] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-17T17:39:54.066193] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-17T17:39:54.066560] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-17T17:39:54.066600] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-17T17:39:54.067131] [DEBUG] [LOCAL ] BKT: Trimmed 16450 records to 12781 (keeping 200 days of data) [2025-10-17T17:39:54.148370] [DEBUG] [LOCAL ] BKT: Primary data saved (12781 records). [2025-10-17T17:39:54.148551] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-17T17:39:54.148693] [INFO ] [MAIN ] Update Progress: 293/2368 symbols completed. BKT took 29.4s. Estimated remaining: 4h 42m 7s. Rate: 7.4 symbols/min [2025-10-17T17:39:54.316853] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:39:54.344409] [DEBUG] [LOCAL ] BLD: Loaded 27593 existing records from primary storage. [2025-10-17T17:39:54.344689] [INFO ] [MAIN ] BLD: Loaded 27593 existing records. [2025-10-17T17:39:54.364590] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-17T17:39:54.520900] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:39:54.521149] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-17T17:39:54.521219] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-17T17:39:54.521565] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-17T17:39:54.521637] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-17T17:39:54.901606] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:39:54.922716] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T17:39:55.158028] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-17T17:39:55.958062] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-17T17:39:56.015353] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T17:39:56.471456] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T17:39:56.758081] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-17T17:39:57.243712] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T17:39:57.558027] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-17T17:39:58.207076] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T17:39:58.358007] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-17T17:39:58.817006] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T17:39:59.158036] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-17T17:39:59.958015] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-17T17:40:00.258580] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T17:40:00.265190] [INFO ] [REMOTE ] BKU: Full fetch complete (60837 records). [2025-10-17T17:40:00.265304] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-17T17:40:00.687982] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-17T17:40:00.688153] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-17T17:40:00.689404] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-17T17:40:00.689504] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-17T17:40:00.691476] [DEBUG] [LOCAL ] BKU: Trimmed 60837 records to 42897 (keeping 200 days of data) [2025-10-17T17:40:00.759753] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-17T17:40:00.985726] [DEBUG] [LOCAL ] BKU: Primary data saved (42897 records). [2025-10-17T17:40:00.986033] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-17T17:40:00.986241] [INFO ] [MAIN ] Update Progress: 294/2368 symbols completed. BKU took 35.0s. Estimated remaining: 4h 41m 50s. Rate: 7.4 symbols/min [2025-10-17T17:40:01.181817] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T17:40:01.212724] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:40:01.276473] [DEBUG] [LOCAL ] BLDR: Loaded 52281 existing records from primary storage. [2025-10-17T17:40:01.276957] [INFO ] [MAIN ] BLDR: Loaded 52281 existing records. [2025-10-17T17:40:01.487932] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:40:01.488471] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-17T17:40:01.488533] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-17T17:40:01.489638] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-17T17:40:01.489735] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-17T17:40:01.567168] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-17T17:40:01.831456] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T17:40:01.916587] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:40:02.358063] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-17T17:40:02.516030] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T17:40:03.030200] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T17:40:03.158075] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-17T17:40:03.626466] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T17:40:03.958090] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-17T17:40:04.595953] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T17:40:04.758052] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-17T17:40:05.106465] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T17:40:05.558066] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-17T17:40:06.363532] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-17T17:40:06.367764] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T17:40:07.158067] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-17T17:40:07.378072] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T17:40:07.409034] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T17:40:07.958070] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-17T17:40:08.600544] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T17:40:08.758033] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-17T17:40:09.558050] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-17T17:40:09.671127] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T17:40:10.025387] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T17:40:10.358036] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-17T17:40:10.928191] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-17T17:40:11.158042] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-17T17:40:11.361989] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-17T17:40:11.958016] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-17T17:40:12.459332] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-17T17:40:12.758104] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-17T17:40:13.281307] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T17:40:13.558025] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-17T17:40:13.873338] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T17:40:14.358044] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-17T17:40:14.912334] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-17T17:40:15.157996] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-17T17:40:15.532114] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T17:40:15.958041] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-17T17:40:16.758044] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-17T17:40:16.796210] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:40:17.558023] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-17T17:40:17.892939] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-17T17:40:18.133822] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T17:40:18.138725] [INFO ] [REMOTE ] BKV: Full fetch complete (44905 records). [2025-10-17T17:40:18.138818] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-17T17:40:18.363106] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-17T17:40:18.530112] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-17T17:40:18.530232] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-17T17:40:18.530913] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-17T17:40:18.531116] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-17T17:40:18.551444] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-17T17:40:18.550445] [DEBUG] [LOCAL ] BKV: Trimmed 44905 records to 30117 (keeping 200 days of data) [2025-10-17T17:40:18.730182] [DEBUG] [LOCAL ] BKV: Primary data saved (30117 records). [2025-10-17T17:40:18.730335] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-17T17:40:18.730420] [INFO ] [MAIN ] Update Progress: 295/2368 symbols completed. BKV took 30.9s. Estimated remaining: 4h 42m 49s. Rate: 7.3 symbols/min [2025-10-17T17:40:18.895205] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:40:18.909355] [DEBUG] [LOCAL ] BLE: Loaded 13880 existing records from primary storage. [2025-10-17T17:40:18.909556] [INFO ] [MAIN ] BLE: Loaded 13880 existing records. [2025-10-17T17:40:19.080379] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:40:19.080608] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-17T17:40:19.080825] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-17T17:40:19.081040] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-17T17:40:19.081080] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-17T17:40:19.163126] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-17T17:40:19.436615] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:40:19.778625] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T17:40:19.958145] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-17T17:40:20.758087] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-17T17:40:20.950188] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T17:40:21.113492] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T17:40:21.558009] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-17T17:40:22.017152] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-17T17:40:22.358108] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-17T17:40:23.158079] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-17T17:40:23.322378] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T17:40:23.582633] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T17:40:23.646177] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T17:40:23.958093] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-17T17:40:24.755104] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T17:40:24.758599] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-17T17:40:25.558032] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-17T17:40:25.778468] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T17:40:26.358043] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-17T17:40:27.002600] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T17:40:27.007383] [INFO ] [REMOTE ] BLCO: Full fetch complete (52271 records). [2025-10-17T17:40:27.007573] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-17T17:40:27.162923] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-17T17:40:27.399061] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-17T17:40:27.399147] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-17T17:40:27.399878] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-17T17:40:27.399981] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-17T17:40:27.401281] [DEBUG] [LOCAL ] BLCO: Trimmed 52271 records to 35655 (keeping 200 days of data) [2025-10-17T17:40:27.606851] [DEBUG] [LOCAL ] BLCO: Primary data saved (35655 records). [2025-10-17T17:40:27.606995] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-17T17:40:27.607078] [INFO ] [MAIN ] Update Progress: 296/2368 symbols completed. BLCO took 38.3s. Estimated remaining: 4h 42m 46s. Rate: 7.3 symbols/min [2025-10-17T17:40:27.781955] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:40:27.816582] [DEBUG] [LOCAL ] BLK: Loaded 34632 existing records from primary storage. [2025-10-17T17:40:27.817035] [INFO ] [MAIN ] BLK: Loaded 34632 existing records. [2025-10-17T17:40:27.958325] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-17T17:40:28.000869] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:40:28.001193] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-17T17:40:28.001399] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-17T17:40:28.001888] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-17T17:40:28.001948] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-17T17:40:28.372349] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-17T17:40:28.444131] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:40:28.629563] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-17T17:40:28.745304] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-17T17:40:28.757999] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-17T17:40:29.543944] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-17T17:40:29.558017] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-17T17:40:30.358099] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-17T17:40:30.762345] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T17:40:30.766236] [INFO ] [REMOTE ] BLD: Full fetch complete (39873 records). [2025-10-17T17:40:30.766345] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-17T17:40:31.159504] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-17T17:40:31.159176] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-17T17:40:31.159703] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-17T17:40:31.161401] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-17T17:40:31.161466] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-17T17:40:31.162888] [DEBUG] [LOCAL ] BLD: Trimmed 39873 records to 27717 (keeping 200 days of data) [2025-10-17T17:40:31.343984] [DEBUG] [LOCAL ] BLD: Primary data saved (27717 records). [2025-10-17T17:40:31.344123] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-17T17:40:31.344210] [INFO ] [MAIN ] Update Progress: 297/2368 symbols completed. BLD took 37.2s. Estimated remaining: 4h 42m 7s. Rate: 7.3 symbols/min [2025-10-17T17:40:31.507821] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:40:31.553173] [DEBUG] [LOCAL ] BLND: Loaded 49649 existing records from primary storage. [2025-10-17T17:40:31.553514] [INFO ] [MAIN ] BLND: Loaded 49649 existing records. [2025-10-17T17:40:31.724431] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:40:31.724675] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-17T17:40:31.724736] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-17T17:40:31.725053] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-17T17:40:31.725092] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-17T17:40:31.963337] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-17T17:40:32.079888] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:40:32.363606] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T17:40:32.758050] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-17T17:40:33.016536] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-17T17:40:33.058913] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T17:40:33.558099] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-17T17:40:34.355438] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-17T17:40:34.358400] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-17T17:40:34.593188] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T17:40:35.158067] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-17T17:40:35.958059] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-17T17:40:36.095889] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-17T17:40:36.554086] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-17T17:40:36.757995] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-17T17:40:37.558075] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-17T17:40:37.695284] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T17:40:38.343574] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T17:40:38.357973] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-17T17:40:38.671279] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T17:40:39.158010] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-17T17:40:39.232447] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T17:40:39.234443] [INFO ] [REMOTE ] BLE: Full fetch complete (19696 records). [2025-10-17T17:40:39.234528] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-17T17:40:39.589217] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-17T17:40:39.589297] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-17T17:40:39.589698] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-17T17:40:39.589759] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-17T17:40:39.590309] [DEBUG] [LOCAL ] BLE: Trimmed 19696 records to 13930 (keeping 200 days of data) [2025-10-17T17:40:39.670055] [DEBUG] [LOCAL ] BLE: Primary data saved (13930 records). [2025-10-17T17:40:39.670194] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-17T17:40:39.670275] [INFO ] [MAIN ] Update Progress: 298/2368 symbols completed. BLE took 20.9s. Estimated remaining: 4h 41m 59s. Rate: 7.3 symbols/min [2025-10-17T17:40:39.835088] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:40:39.835276] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-17T17:40:39.835316] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-17T17:40:39.835429] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-17T17:40:39.835486] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-17T17:40:39.835527] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-17T17:40:39.835560] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-17T17:40:39.971856] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-17T17:40:40.188374] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:40:40.758017] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-17T17:40:40.842607] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T17:40:41.558003] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-17T17:40:41.775142] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:40:41.775451] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-17T17:40:41.775566] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:40:41.775616] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-17T17:40:41.775678] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:40:41.775752] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-17T17:40:41.775816] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-17T17:40:41.775851] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-17T17:40:41.775891] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-17T17:40:41.775939] [INFO ] [MAIN ] Update Progress: 299/2368 symbols completed. BLSH took 2.1s. Estimated remaining: 4h 41m 9s. Rate: 7.4 symbols/min [2025-10-17T17:40:41.949720] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:40:41.979108] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-17T17:40:41.999327] [DEBUG] [LOCAL ] BLW: Loaded 13261 existing records from primary storage. [2025-10-17T17:40:41.999560] [INFO ] [MAIN ] BLW: Loaded 13261 existing records. [2025-10-17T17:40:42.171799] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:40:42.171953] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-17T17:40:42.171998] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-17T17:40:42.172272] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-17T17:40:42.172328] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-17T17:40:42.376187] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-17T17:40:42.529623] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:40:42.622027] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-17T17:40:43.158014] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-17T17:40:43.958052] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-17T17:40:44.034630] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T17:40:44.199191] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T17:40:44.758022] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-17T17:40:45.558027] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-17T17:40:45.580130] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T17:40:45.820211] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T17:40:46.358031] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-17T17:40:47.158007] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-17T17:40:47.258995] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T17:40:47.678313] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-17T17:40:47.958010] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-17T17:40:48.270622] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T17:40:48.758093] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-17T17:40:49.403274] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T17:40:49.558038] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-17T17:40:50.358041] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-17T17:40:50.813837] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-17T17:40:50.821403] [INFO ] [REMOTE ] BLDR: Full fetch complete (74700 records). [2025-10-17T17:40:50.821584] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-17T17:40:51.168893] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-17T17:40:51.229763] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-17T17:40:51.229877] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-17T17:40:51.230892] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-17T17:40:51.230994] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-17T17:40:51.233145] [DEBUG] [LOCAL ] BLDR: Trimmed 74700 records to 52629 (keeping 200 days of data) [2025-10-17T17:40:51.360142] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-17T17:40:51.379089] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T17:40:51.608620] [DEBUG] [LOCAL ] BLDR: Primary data saved (52629 records). [2025-10-17T17:40:51.608792] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-17T17:40:51.608879] [INFO ] [MAIN ] Update Progress: 300/2368 symbols completed. BLDR took 50.6s. Estimated remaining: 4h 41m 13s. Rate: 7.4 symbols/min [2025-10-17T17:40:51.774739] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:40:51.792828] [DEBUG] [LOCAL ] BLX: Loaded 15678 existing records from primary storage. [2025-10-17T17:40:51.793064] [INFO ] [MAIN ] BLX: Loaded 15678 existing records. [2025-10-17T17:40:51.968387] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-17T17:40:51.973993] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:40:51.975223] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-17T17:40:51.975284] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-17T17:40:51.975515] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-17T17:40:51.975574] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-17T17:40:52.323324] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:40:52.758033] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-17T17:40:53.139743] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T17:40:53.558044] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-17T17:40:53.620612] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T17:40:53.673109] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-17T17:40:54.358082] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-17T17:40:54.661261] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T17:40:55.158045] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-17T17:40:55.958002] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-17T17:40:56.037343] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T17:40:56.113328] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-17T17:40:56.758004] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-17T17:40:57.189974] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-17T17:40:57.558023] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-17T17:40:58.358044] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-17T17:40:58.671232] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T17:40:59.158009] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-17T17:40:59.280321] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T17:40:59.296184] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T17:40:59.958103] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-17T17:41:00.758051] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-17T17:41:00.774807] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T17:41:01.133476] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T17:41:01.558035] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-17T17:41:01.998880] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T17:41:02.358033] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-17T17:41:03.158041] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-17T17:41:03.206222] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T17:41:03.284540] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T17:41:03.958027] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-17T17:41:04.765518] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-17T17:41:04.770294] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T17:41:04.778023] [INFO ] [REMOTE ] BLND: Full fetch complete (72298 records). [2025-10-17T17:41:04.778176] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-17T17:41:05.165831] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-17T17:41:05.165913] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-17T17:41:05.166698] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-17T17:41:05.166760] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-17T17:41:05.168154] [DEBUG] [LOCAL ] BLND: Trimmed 72298 records to 50014 (keeping 200 days of data) [2025-10-17T17:41:05.444525] [DEBUG] [LOCAL ] BLND: Primary data saved (50014 records). [2025-10-17T17:41:05.444697] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-17T17:41:05.444800] [INFO ] [MAIN ] Update Progress: 301/2368 symbols completed. BLND took 34.1s. Estimated remaining: 4h 41m 44s. Rate: 7.3 symbols/min [2025-10-17T17:41:05.568063] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-17T17:41:05.626799] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:41:05.656528] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T17:41:05.664526] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-17T17:41:05.694737] [DEBUG] [LOCAL ] BMA: Loaded 36440 existing records from primary storage. [2025-10-17T17:41:05.695032] [INFO ] [MAIN ] BMA: Loaded 36440 existing records. [2025-10-17T17:41:05.868228] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:41:05.868459] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-17T17:41:05.868509] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-17T17:41:05.868818] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-17T17:41:05.868876] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-17T17:41:06.241242] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:41:06.358005] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-17T17:41:06.796922] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-17T17:41:07.158035] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-17T17:41:07.918535] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T17:41:07.957998] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-17T17:41:08.743993] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T17:41:08.749418] [INFO ] [REMOTE ] BLK: Full fetch complete (52957 records). [2025-10-17T17:41:08.749519] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-17T17:41:08.763145] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-17T17:41:08.884575] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T17:41:09.141258] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-17T17:41:09.141337] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-17T17:41:09.141976] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-17T17:41:09.142039] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-17T17:41:09.143143] [DEBUG] [LOCAL ] BLK: Trimmed 52957 records to 34882 (keeping 200 days of data) [2025-10-17T17:41:09.367162] [DEBUG] [LOCAL ] BLK: Primary data saved (34882 records). [2025-10-17T17:41:09.367293] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-17T17:41:09.367375] [INFO ] [MAIN ] Update Progress: 302/2368 symbols completed. BLK took 41.8s. Estimated remaining: 4h 41m 6s. Rate: 7.3 symbols/min [2025-10-17T17:41:09.535595] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:41:09.547927] [DEBUG] [LOCAL ] BME: Loaded 11376 existing records from primary storage. [2025-10-17T17:41:09.548134] [INFO ] [MAIN ] BME: Loaded 11376 existing records. [2025-10-17T17:41:09.563128] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-17T17:41:09.729607] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:41:09.729869] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-17T17:41:09.729916] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-17T17:41:09.730108] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-17T17:41:09.730147] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-17T17:41:10.087571] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:41:10.358038] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-17T17:41:10.778089] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T17:41:11.097357] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-17T17:41:11.166870] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T17:41:11.166027] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-17T17:41:11.958098] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-17T17:41:12.618594] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T17:41:12.758029] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-17T17:41:12.909038] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T17:41:13.558040] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-17T17:41:14.127403] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T17:41:14.190582] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-17T17:41:14.358085] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-17T17:41:15.158101] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-17T17:41:15.401591] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T17:41:15.958130] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-17T17:41:16.652801] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T17:41:16.758035] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-17T17:41:17.055526] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T17:41:17.558041] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-17T17:41:18.288152] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T17:41:18.358040] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-17T17:41:18.650265] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T17:41:19.158057] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-17T17:41:19.289839] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T17:41:19.958025] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-17T17:41:20.033510] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-17T17:41:20.758056] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-17T17:41:20.918547] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T17:41:20.921080] [INFO ] [REMOTE ] BLW: Full fetch complete (19222 records). [2025-10-17T17:41:20.921177] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-17T17:41:21.293908] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-17T17:41:21.293998] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-17T17:41:21.294363] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-17T17:41:21.294403] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-17T17:41:21.294981] [DEBUG] [LOCAL ] BLW: Trimmed 19222 records to 13364 (keeping 200 days of data) [2025-10-17T17:41:21.378986] [DEBUG] [LOCAL ] BLW: Primary data saved (13364 records). [2025-10-17T17:41:21.379180] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-17T17:41:21.379343] [INFO ] [MAIN ] Update Progress: 303/2368 symbols completed. BLW took 39.6s. Estimated remaining: 4h 41m 24s. Rate: 7.3 symbols/min [2025-10-17T17:41:21.545024] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:41:21.560326] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-17T17:41:21.573300] [DEBUG] [LOCAL ] BMEZ: Loaded 26080 existing records from primary storage. [2025-10-17T17:41:21.573580] [INFO ] [MAIN ] BMEZ: Loaded 26080 existing records. [2025-10-17T17:41:21.747555] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:41:21.747791] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-17T17:41:21.747841] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-17T17:41:21.748127] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-17T17:41:21.748194] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-17T17:41:22.145044] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:41:22.170674] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T17:41:22.185258] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-17T17:41:22.358103] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-17T17:41:23.135562] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T17:41:23.138326] [INFO ] [REMOTE ] BLX: Full fetch complete (22499 records). [2025-10-17T17:41:23.138415] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-17T17:41:23.163406] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-17T17:41:23.523262] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-17T17:41:23.523364] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-17T17:41:23.523812] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-17T17:41:23.523875] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-17T17:41:23.524930] [DEBUG] [LOCAL ] BLX: Trimmed 22499 records to 15775 (keeping 200 days of data) [2025-10-17T17:41:23.625364] [DEBUG] [LOCAL ] BLX: Primary data saved (15775 records). [2025-10-17T17:41:23.625517] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-17T17:41:23.625616] [INFO ] [MAIN ] Update Progress: 304/2368 symbols completed. BLX took 32.0s. Estimated remaining: 4h 40m 36s. Rate: 7.4 symbols/min [2025-10-17T17:41:23.800421] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:41:23.834526] [DEBUG] [LOCAL ] BMI: Loaded 24756 existing records from primary storage. [2025-10-17T17:41:23.834910] [INFO ] [MAIN ] BMI: Loaded 24756 existing records. [2025-10-17T17:41:23.963128] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-17T17:41:24.026914] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:41:24.027203] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-17T17:41:24.027297] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-17T17:41:24.027757] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-17T17:41:24.027829] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-17T17:41:24.138531] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-17T17:41:24.397272] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:41:24.758063] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-17T17:41:25.264683] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T17:41:25.466887] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T17:41:25.557991] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-17T17:41:26.358026] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-17T17:41:27.115924] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T17:41:27.157983] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-17T17:41:27.616411] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T17:41:27.958048] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-17T17:41:28.758799] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-17T17:41:28.760733] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-17T17:41:28.766877] [INFO ] [REMOTE ] BMA: Full fetch complete (52113 records). [2025-10-17T17:41:28.766974] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-17T17:41:29.161766] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-17T17:41:29.161892] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-17T17:41:29.162677] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-17T17:41:29.162747] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-17T17:41:29.163959] [DEBUG] [LOCAL ] BMA: Trimmed 52113 records to 36733 (keeping 200 days of data) [2025-10-17T17:41:29.388926] [DEBUG] [LOCAL ] BMA: Primary data saved (36733 records). [2025-10-17T17:41:29.389076] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-17T17:41:29.389178] [INFO ] [MAIN ] Update Progress: 305/2368 symbols completed. BMA took 23.9s. Estimated remaining: 4h 40m 12s. Rate: 7.4 symbols/min [2025-10-17T17:41:29.560795] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-17T17:41:29.563765] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:41:29.586812] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T17:41:29.599864] [DEBUG] [LOCAL ] BMN: Loaded 2621 existing records from primary storage. [2025-10-17T17:41:29.600151] [INFO ] [MAIN ] BMN: Loaded 2621 existing records. [2025-10-17T17:41:29.688199] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T17:41:29.797197] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:41:29.797471] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-17T17:41:29.797533] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-17T17:41:29.797710] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-17T17:41:29.797766] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-17T17:41:30.148510] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:41:30.358091] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-17T17:41:30.375061] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T17:41:30.516485] [DEBUG] [REMOTE ] BMEZ: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-17T17:41:30.516816] [WARN ] [REMOTE ] BMEZ: No data returned for month 2025-01 [2025-10-17T17:41:30.516904] [FATAL] [REMOTE ] BMEZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:41:30.516986] [FATAL] [MAIN ] BMEZ: Failed to fetch primary data. [2025-10-17T17:41:30.517057] [WARN ] [MAIN ] BMEZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:41:30.517140] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-17T17:41:30.517228] [DEBUG] [LOCAL ] BMEZ: No primary data file found to delete. [2025-10-17T17:41:30.517284] [INFO ] [LOCAL ] BMEZ: Starting deletion of derivative data. [2025-10-17T17:41:30.517465] [DEBUG] [LOCAL ] BMEZ: Deleted derivative data file. [2025-10-17T17:41:30.517558] [INFO ] [MAIN ] Update Progress: 306/2368 symbols completed. BMEZ took 9.1s. Estimated remaining: 4h 39m 16s. Rate: 7.4 symbols/min [2025-10-17T17:41:30.690454] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:41:30.729767] [DEBUG] [LOCAL ] BMO: Loaded 41606 existing records from primary storage. [2025-10-17T17:41:30.730121] [INFO ] [MAIN ] BMO: Loaded 41606 existing records. [2025-10-17T17:41:30.903813] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:41:30.904028] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-17T17:41:30.904082] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-17T17:41:30.904282] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-17T17:41:30.904320] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-17T17:41:31.163334] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-17T17:41:31.261603] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:41:31.958034] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-17T17:41:32.240738] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T17:41:32.469758] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-17T17:41:32.758054] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-17T17:41:33.558028] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-17T17:41:33.708820] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T17:41:34.358044] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-17T17:41:35.126694] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T17:41:35.157994] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-17T17:41:35.433793] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T17:41:35.958043] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-17T17:41:36.758013] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-17T17:41:36.884603] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T17:41:37.366372] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-17T17:41:37.558014] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-17T17:41:37.626410] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T17:41:38.013423] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-17T17:41:38.358080] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-17T17:41:39.158078] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-17T17:41:39.849475] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T17:41:39.958030] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-17T17:41:40.300205] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T17:41:40.758006] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-17T17:41:40.858477] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T17:41:41.450867] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-17T17:41:41.557990] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-17T17:41:42.358029] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-17T17:41:42.902527] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T17:41:43.158030] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-17T17:41:43.515109] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T17:41:43.958065] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-17T17:41:44.030010] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-17T17:41:44.479306] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-17T17:41:44.758036] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-17T17:41:45.558053] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-17T17:41:45.927987] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-17T17:41:46.358107] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-17T17:41:46.461142] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-17T17:41:46.463368] [INFO ] [REMOTE ] BME: Full fetch complete (15879 records). [2025-10-17T17:41:46.463469] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-17T17:41:46.831827] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-17T17:41:46.831933] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-17T17:41:46.832318] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-17T17:41:46.832360] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-17T17:41:46.833045] [DEBUG] [LOCAL ] BME: Trimmed 15879 records to 11421 (keeping 200 days of data) [2025-10-17T17:41:46.906557] [DEBUG] [LOCAL ] BME: Primary data saved (11421 records). [2025-10-17T17:41:46.906766] [INFO ] [MAIN ] BME: Full history saved. [2025-10-17T17:41:46.906896] [INFO ] [MAIN ] Update Progress: 307/2368 symbols completed. BME took 37.5s. Estimated remaining: 4h 40m 3s. Rate: 7.4 symbols/min [2025-10-17T17:41:47.075079] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:41:47.128345] [DEBUG] [LOCAL ] BMY: Loaded 54147 existing records from primary storage. [2025-10-17T17:41:47.128688] [INFO ] [MAIN ] BMY: Loaded 54147 existing records. [2025-10-17T17:41:47.169209] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-17T17:41:47.322479] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:41:47.322749] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-17T17:41:47.322806] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-17T17:41:47.323054] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-17T17:41:47.323121] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-17T17:41:47.649080] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-17T17:41:47.732631] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:41:47.750917] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-17T17:41:47.958080] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-17T17:41:48.758112] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-17T17:41:49.558042] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-17T17:41:50.022629] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T17:41:50.026736] [INFO ] [REMOTE ] BMI: Full fetch complete (33606 records). [2025-10-17T17:41:50.026825] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-17T17:41:50.132323] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-17T17:41:50.340926] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-17T17:41:50.363459] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-17T17:41:50.489163] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-17T17:41:50.489273] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-17T17:41:50.490049] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-17T17:41:50.490117] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-17T17:41:50.491050] [DEBUG] [LOCAL ] BMI: Trimmed 33606 records to 24957 (keeping 200 days of data) [2025-10-17T17:41:50.652016] [DEBUG] [LOCAL ] BMI: Primary data saved (24957 records). [2025-10-17T17:41:50.652158] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-17T17:41:50.652246] [INFO ] [MAIN ] Update Progress: 308/2368 symbols completed. BMI took 27.0s. Estimated remaining: 4h 39m 26s. Rate: 7.4 symbols/min [2025-10-17T17:41:50.818373] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:41:50.818547] [DEBUG] [LOCAL ] BN: No existing data file found in primary storage. [2025-10-17T17:41:50.818585] [WARN ] [MAIN ] BN: No existing data found, performing full refresh instead. [2025-10-17T17:41:50.818753] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-17T17:41:50.818825] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-17T17:41:50.818880] [DEBUG] [LOCAL ] BN: No primary data file found to delete. [2025-10-17T17:41:50.818914] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-17T17:41:51.169232] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-17T17:41:51.173857] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:41:51.620980] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-17T17:41:51.958085] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-17T17:41:52.373161] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-17T17:41:52.758093] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-17T17:41:53.267706] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T17:41:53.558055] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-17T17:41:54.358062] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-17T17:41:54.623955] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T17:41:55.053800] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:41:55.157994] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-17T17:41:55.958064] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-17T17:41:56.242626] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T17:41:56.544416] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-17T17:41:56.565566] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T17:41:56.758031] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-17T17:41:57.558047] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-17T17:41:58.256309] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T17:41:58.358024] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-17T17:41:59.158021] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-17T17:41:59.239631] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T17:41:59.599522] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-17T17:41:59.958021] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-17T17:42:00.084790] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T17:42:00.454909] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-17T17:42:00.758032] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-17T17:42:01.251861] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-17T17:42:01.558024] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-17T17:42:02.358047] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-17T17:42:03.005077] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-17T17:42:03.006088] [INFO ] [REMOTE ] BMN: Full fetch complete (3707 records). [2025-10-17T17:42:03.006161] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-17T17:42:03.168711] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-17T17:42:03.381585] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-17T17:42:03.381684] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-17T17:42:03.381822] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-17T17:42:03.381862] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-17T17:42:03.382200] [DEBUG] [LOCAL ] BMN: Trimmed 3707 records to 2635 (keeping 200 days of data) [2025-10-17T17:42:03.399510] [DEBUG] [LOCAL ] BMN: Primary data saved (2635 records). [2025-10-17T17:42:03.399583] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-17T17:42:03.399673] [INFO ] [MAIN ] Update Progress: 309/2368 symbols completed. BMN took 34.0s. Estimated remaining: 4h 39m 48s. Rate: 7.4 symbols/min [2025-10-17T17:42:03.600005] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:42:03.635286] [DEBUG] [LOCAL ] BNED: Loaded 28780 existing records from primary storage. [2025-10-17T17:42:03.635766] [INFO ] [MAIN ] BNED: Loaded 28780 existing records. [2025-10-17T17:42:03.797746] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-17T17:42:03.903078] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:42:03.903375] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-17T17:42:03.903428] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-17T17:42:03.903820] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-17T17:42:03.903884] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-17T17:42:03.964415] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-17T17:42:04.304158] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:42:04.758039] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-17T17:42:05.306795] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-17T17:42:05.558033] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-17T17:42:05.689687] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T17:42:06.358012] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-17T17:42:06.727230] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T17:42:07.158019] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-17T17:42:07.283194] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T17:42:07.958033] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-17T17:42:08.045434] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T17:42:08.758008] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-17T17:42:09.115762] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-17T17:42:09.385825] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T17:42:09.558018] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-17T17:42:10.358100] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-17T17:42:10.692469] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T17:42:10.698587] [INFO ] [REMOTE ] BMO: Full fetch complete (60024 records). [2025-10-17T17:42:10.698780] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-17T17:42:11.093400] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-17T17:42:11.093571] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-17T17:42:11.094311] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-17T17:42:11.094375] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-17T17:42:11.095849] [DEBUG] [LOCAL ] BMO: Trimmed 60024 records to 41935 (keeping 200 days of data) [2025-10-17T17:42:11.160380] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-17T17:42:11.359907] [DEBUG] [LOCAL ] BMO: Primary data saved (41935 records). [2025-10-17T17:42:11.360036] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-17T17:42:11.360115] [INFO ] [MAIN ] Update Progress: 310/2368 symbols completed. BMO took 40.8s. Estimated remaining: 4h 39m 39s. Rate: 7.4 symbols/min [2025-10-17T17:42:11.533197] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:42:11.540107] [DEBUG] [LOCAL ] BNH: Loaded 5044 existing records from primary storage. [2025-10-17T17:42:11.540317] [INFO ] [MAIN ] BNH: Loaded 5044 existing records. [2025-10-17T17:42:11.692430] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-17T17:42:11.766593] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:42:11.766819] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-17T17:42:11.766867] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-17T17:42:11.767119] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-17T17:42:11.767176] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-17T17:42:11.975631] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-17T17:42:12.131853] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:42:12.195853] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T17:42:12.624091] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-17T17:42:12.758065] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-17T17:42:13.428275] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-17T17:42:13.558000] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-17T17:42:13.647387] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T17:42:14.358024] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-17T17:42:14.702775] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T17:42:15.158072] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-17T17:42:15.756626] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T17:42:15.958099] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-17T17:42:16.512334] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-17T17:42:16.758096] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-17T17:42:17.269510] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T17:42:17.558031] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-17T17:42:18.357990] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-17T17:42:18.889334] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-17T17:42:18.927210] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-17T17:42:19.158055] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-17T17:42:19.734991] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-17T17:42:19.958051] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-17T17:42:20.226200] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-17T17:42:20.545762] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T17:42:20.758037] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-17T17:42:21.558049] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-17T17:42:22.123930] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-17T17:42:22.358077] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-17T17:42:22.482525] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-17T17:42:22.490314] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-17T17:42:22.490472] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-17T17:42:22.912365] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-17T17:42:22.912439] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-17T17:42:22.913276] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-17T17:42:22.913369] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-17T17:42:22.914833] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 54537 (keeping 200 days of data) [2025-10-17T17:42:23.191851] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-17T17:42:23.246517] [DEBUG] [LOCAL ] BMY: Primary data saved (54537 records). [2025-10-17T17:42:23.246791] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-17T17:42:23.247531] [INFO ] [MAIN ] Update Progress: 311/2368 symbols completed. BMY took 36.3s. Estimated remaining: 4h 39m 55s. Rate: 7.3 symbols/min [2025-10-17T17:42:23.422121] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:42:23.427637] [DEBUG] [LOCAL ] BNJ: Loaded 2620 existing records from primary storage. [2025-10-17T17:42:23.427894] [INFO ] [MAIN ] BNJ: Loaded 2620 existing records. [2025-10-17T17:42:23.665362] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T17:42:23.705179] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:42:23.706106] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-17T17:42:23.706156] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-17T17:42:23.706279] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-17T17:42:23.706321] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-17T17:42:23.967755] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-17T17:42:24.055914] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:42:24.758142] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-17T17:42:24.988772] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T17:42:25.039824] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T17:42:25.558028] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-17T17:42:25.646591] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-17T17:42:26.358154] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-17T17:42:26.887968] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-17T17:42:26.889141] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-17T17:42:27.158076] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-17T17:42:27.958020] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-17T17:42:27.968887] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T17:42:28.758072] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-17T17:42:29.558103] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-17T17:42:29.717492] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T17:42:30.044896] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T17:42:30.331696] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T17:42:30.357986] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-17T17:42:30.826592] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-17T17:42:31.158041] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-17T17:42:31.716639] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-17T17:42:31.958044] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-17T17:42:32.758038] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-17T17:42:33.558078] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-17T17:42:33.940464] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T17:42:34.029151] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T17:42:34.030194] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T17:42:34.036373] [INFO ] [REMOTE ] BNED: Full fetch complete (42394 records). [2025-10-17T17:42:34.036490] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-17T17:42:34.371423] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-17T17:42:34.424408] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-17T17:42:34.424495] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-17T17:42:34.425076] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-17T17:42:34.425140] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-17T17:42:34.426245] [DEBUG] [LOCAL ] BNED: Trimmed 42394 records to 28914 (keeping 200 days of data) [2025-10-17T17:42:34.590098] [DEBUG] [LOCAL ] BNED: Primary data saved (28914 records). [2025-10-17T17:42:34.590244] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-17T17:42:34.590328] [INFO ] [MAIN ] Update Progress: 312/2368 symbols completed. BNED took 31.2s. Estimated remaining: 4h 40m 8s. Rate: 7.3 symbols/min [2025-10-17T17:42:34.766559] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:42:34.813186] [DEBUG] [LOCAL ] BNL: Loaded 47629 existing records from primary storage. [2025-10-17T17:42:34.813509] [INFO ] [MAIN ] BNL: Loaded 47629 existing records. [2025-10-17T17:42:34.998713] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:42:34.998969] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-17T17:42:34.999018] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-17T17:42:34.999222] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-17T17:42:34.999261] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-17T17:42:35.162573] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-17T17:42:35.302087] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T17:42:35.402213] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:42:35.958104] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-17T17:42:36.672260] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-17T17:42:36.758059] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-17T17:42:37.206689] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-17T17:42:37.220233] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-17T17:42:37.223263] [INFO ] [REMOTE ] BN: Full fetch complete (76953 records). [2025-10-17T17:42:37.223424] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-17T17:42:37.561830] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-17T17:42:37.608423] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-17T17:42:37.608510] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-17T17:42:37.609350] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-17T17:42:37.609416] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-17T17:42:37.611059] [DEBUG] [LOCAL ] BN: Trimmed 76953 records to 53768 (keeping 200 days of data) [2025-10-17T17:42:37.936622] [DEBUG] [LOCAL ] BN: Primary data saved (53768 records). [2025-10-17T17:42:37.937405] [INFO ] [MAIN ] BN: Full history saved. [2025-10-17T17:42:37.937525] [INFO ] [MAIN ] Update Progress: 313/2368 symbols completed. BN took 47.3s. Estimated remaining: 4h 39m 28s. Rate: 7.4 symbols/min [2025-10-17T17:42:38.117108] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:42:38.169992] [DEBUG] [LOCAL ] BNS: Loaded 51872 existing records from primary storage. [2025-10-17T17:42:38.170200] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T17:42:38.171768] [INFO ] [MAIN ] BNS: Loaded 51872 existing records. [2025-10-17T17:42:38.364412] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:42:38.359330] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-17T17:42:38.364861] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-17T17:42:38.366094] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-17T17:42:38.366845] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-17T17:42:38.367039] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-17T17:42:38.745534] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:42:39.066861] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T17:42:39.068213] [INFO ] [REMOTE ] BNH: Full fetch complete (6856 records). [2025-10-17T17:42:39.068287] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-17T17:42:39.163191] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-17T17:42:39.425686] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-17T17:42:39.425768] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-17T17:42:39.425950] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-17T17:42:39.425988] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-17T17:42:39.426359] [DEBUG] [LOCAL ] BNH: Trimmed 6856 records to 5065 (keeping 200 days of data) [2025-10-17T17:42:39.457598] [DEBUG] [LOCAL ] BNH: Primary data saved (5065 records). [2025-10-17T17:42:39.457723] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-17T17:42:39.457813] [INFO ] [MAIN ] Update Progress: 314/2368 symbols completed. BNH took 28.1s. Estimated remaining: 4h 38m 37s. Rate: 7.4 symbols/min [2025-10-17T17:42:39.624334] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:42:39.630282] [DEBUG] [LOCAL ] BNT: Loaded 3543 existing records from primary storage. [2025-10-17T17:42:39.630455] [INFO ] [MAIN ] BNT: Loaded 3543 existing records. [2025-10-17T17:42:39.711526] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-17T17:42:39.807929] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:42:39.808111] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-17T17:42:39.808158] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-17T17:42:39.808288] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-17T17:42:39.808325] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-17T17:42:39.962691] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-17T17:42:40.161096] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:42:40.566674] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T17:42:40.758023] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-17T17:42:41.233952] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-17T17:42:41.558029] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-17T17:42:41.980468] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-17T17:42:42.358096] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-17T17:42:42.893671] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-17T17:42:43.158076] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-17T17:42:43.766034] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-17T17:42:43.958089] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-17T17:42:44.758069] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-17T17:42:45.239469] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-17T17:42:45.558000] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-17T17:42:45.630090] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T17:42:45.882925] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-17T17:42:46.358046] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-17T17:42:47.158039] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-17T17:42:47.707945] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-17T17:42:47.709096] [INFO ] [REMOTE ] BNJ: Full fetch complete (3986 records). [2025-10-17T17:42:47.709164] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-17T17:42:47.960882] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-17T17:42:48.083807] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-17T17:42:48.083933] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-17T17:42:48.084218] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-17T17:42:48.084339] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-17T17:42:48.084859] [DEBUG] [LOCAL ] BNJ: Trimmed 3986 records to 2639 (keeping 200 days of data) [2025-10-17T17:42:48.134091] [DEBUG] [LOCAL ] BNJ: Primary data saved (2639 records). [2025-10-17T17:42:48.134872] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-17T17:42:48.136897] [INFO ] [MAIN ] Update Progress: 315/2368 symbols completed. BNJ took 24.9s. Estimated remaining: 4h 38m 32s. Rate: 7.4 symbols/min [2025-10-17T17:42:48.136740] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T17:42:48.323578] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:42:48.323797] [DEBUG] [LOCAL ] BNY: No existing data file found in primary storage. [2025-10-17T17:42:48.323877] [WARN ] [MAIN ] BNY: No existing data found, performing full refresh instead. [2025-10-17T17:42:48.324020] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-17T17:42:48.324063] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-17T17:42:48.324304] [DEBUG] [LOCAL ] BNY: No primary data file found to delete. [2025-10-17T17:42:48.324339] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-17T17:42:48.692035] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:42:48.758025] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-17T17:42:49.557999] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-17T17:42:49.658379] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:42:49.697414] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-17T17:42:49.918228] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-17T17:42:50.358026] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-17T17:42:50.966087] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-17T17:42:51.158095] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-17T17:42:51.958055] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-17T17:42:52.758060] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-17T17:42:52.788335] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T17:42:53.371239] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-17T17:42:53.420874] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T17:42:53.558029] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-17T17:42:54.358049] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-17T17:42:54.414836] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T17:42:55.158048] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-17T17:42:55.784102] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-17T17:42:55.809391] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T17:42:55.958032] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-17T17:42:56.758057] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-17T17:42:57.558045] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-17T17:42:57.607063] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T17:42:57.610287] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T17:42:58.358033] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-17T17:42:58.373186] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T17:42:59.158034] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-17T17:42:59.887324] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-17T17:42:59.958062] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-17T17:43:00.099265] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T17:43:00.758002] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-17T17:43:00.841435] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-17T17:43:01.558047] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-17T17:43:02.358036] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-17T17:43:03.073016] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T17:43:03.166803] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-17T17:43:03.171892] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T17:43:03.958072] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-17T17:43:04.508041] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-17T17:43:04.651440] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (3.89 seconds). [2025-10-17T17:43:04.758000] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-17T17:43:05.183275] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T17:43:05.558036] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-17T17:43:05.606968] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T17:43:05.608858] [INFO ] [REMOTE ] BNY: Full fetch complete (10388 records). [2025-10-17T17:43:05.608934] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-17T17:43:05.981660] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-17T17:43:05.981750] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-17T17:43:05.981997] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-17T17:43:05.982037] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-17T17:43:05.982465] [DEBUG] [LOCAL ] BNY: Trimmed 10388 records to 7307 (keeping 200 days of data) [2025-10-17T17:43:06.025936] [DEBUG] [LOCAL ] BNY: Primary data saved (7307 records). [2025-10-17T17:43:06.026044] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-17T17:43:06.026117] [INFO ] [MAIN ] Update Progress: 316/2368 symbols completed. BNY took 17.9s. Estimated remaining: 4h 39m 27s. Rate: 7.3 symbols/min [2025-10-17T17:43:06.191092] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:43:06.215095] [DEBUG] [LOCAL ] BOC: Loaded 18699 existing records from primary storage. [2025-10-17T17:43:06.216257] [INFO ] [MAIN ] BOC: Loaded 18699 existing records. [2025-10-17T17:43:06.363209] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-17T17:43:06.405333] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:43:06.406405] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-17T17:43:06.406747] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-17T17:43:06.407392] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-17T17:43:06.407699] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-17T17:43:06.824055] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:43:06.865217] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-17T17:43:07.055024] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T17:43:07.158071] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-17T17:43:07.958123] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-17T17:43:08.765368] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-17T17:43:08.785408] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T17:43:09.054629] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T17:43:09.505861] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T17:43:09.558047] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-17T17:43:10.302691] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-17T17:43:10.358078] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-17T17:43:11.158060] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-17T17:43:11.284827] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T17:43:11.958048] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-17T17:43:12.398667] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-17T17:43:12.758075] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-17T17:43:12.811178] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T17:43:13.558040] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-17T17:43:14.358106] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-17T17:43:14.687560] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T17:43:14.954768] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-17T17:43:15.170100] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-17T17:43:15.173315] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T17:43:15.958043] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-17T17:43:16.219566] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T17:43:16.758054] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-17T17:43:17.558023] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-17T17:43:17.816583] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T17:43:17.855582] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T17:43:18.358069] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-17T17:43:19.163384] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-17T17:43:19.173160] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T17:43:19.180434] [INFO ] [REMOTE ] BNL: Full fetch complete (67301 records). [2025-10-17T17:43:19.180586] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-17T17:43:19.508627] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T17:43:19.618372] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-17T17:43:19.618469] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-17T17:43:19.619281] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-17T17:43:19.619352] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-17T17:43:19.620884] [DEBUG] [LOCAL ] BNL: Trimmed 67301 records to 47981 (keeping 200 days of data) [2025-10-17T17:43:19.915110] [DEBUG] [LOCAL ] BNL: Primary data saved (47981 records). [2025-10-17T17:43:19.915260] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-17T17:43:19.915348] [INFO ] [MAIN ] Update Progress: 317/2368 symbols completed. BNL took 45.3s. Estimated remaining: 4h 39m 56s. Rate: 7.3 symbols/min [2025-10-17T17:43:19.958033] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-17T17:43:20.003067] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T17:43:20.004401] [INFO ] [REMOTE ] BNT: Full fetch complete (4767 records). [2025-10-17T17:43:20.004474] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-17T17:43:20.370210] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-17T17:43:20.370287] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-17T17:43:20.370431] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-17T17:43:20.370470] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-17T17:43:20.370853] [DEBUG] [LOCAL ] BNT: Trimmed 4767 records to 3594 (keeping 200 days of data) [2025-10-17T17:43:20.392466] [DEBUG] [LOCAL ] BNT: Primary data saved (3594 records). [2025-10-17T17:43:20.392538] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-17T17:43:20.392610] [INFO ] [MAIN ] Update Progress: 318/2368 symbols completed. BNT took 40.9s. Estimated remaining: 4h 38m 58s. Rate: 7.3 symbols/min [2025-10-17T17:43:20.758125] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-17T17:43:20.971115] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T17:43:21.558047] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-17T17:43:22.400447] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T17:43:22.411088] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-17T17:43:22.628074] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T17:43:23.158048] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-17T17:43:24.153568] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T17:43:24.165802] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-17T17:43:24.215045] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T17:43:24.758067] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-17T17:43:25.859152] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T17:43:25.863837] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-17T17:43:25.964088] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T17:43:26.358099] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-17T17:43:26.973415] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T17:43:26.977701] [INFO ] [REMOTE ] BOC: Full fetch complete (25893 records). [2025-10-17T17:43:26.977838] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-17T17:43:27.353027] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-17T17:43:27.353120] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-17T17:43:27.353541] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-17T17:43:27.353583] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-17T17:43:27.354346] [DEBUG] [LOCAL ] BOC: Trimmed 25893 records to 18798 (keeping 200 days of data) [2025-10-17T17:43:27.460500] [DEBUG] [LOCAL ] BOC: Primary data saved (18798 records). [2025-10-17T17:43:27.460673] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-17T17:43:27.460796] [INFO ] [MAIN ] Update Progress: 319/2368 symbols completed. BOC took 21.4s. Estimated remaining: 4h 38m 43s. Rate: 7.4 symbols/min [2025-10-17T17:43:28.270583] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T17:43:28.282010] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-17T17:43:30.066718] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T17:43:30.074070] [INFO ] [REMOTE ] BNS: Full fetch complete (74675 records). [2025-10-17T17:43:30.074233] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-17T17:43:30.480740] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-17T17:43:30.480830] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-17T17:43:30.481600] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-17T17:43:30.481662] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-17T17:43:30.483040] [DEBUG] [LOCAL ] BNS: Trimmed 74675 records to 52255 (keeping 200 days of data) [2025-10-17T17:43:30.795699] [DEBUG] [LOCAL ] BNS: Primary data saved (52255 records). [2025-10-17T17:43:30.795901] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-17T17:43:30.796855] [INFO ] [MAIN ] Update Progress: 320/2368 symbols completed. BNS took 52.9s. Estimated remaining: 4h 38m 4s. Rate: 7.4 symbols/min [2025-10-17T17:43:31.485573] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:43:31.464830] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:43:31.575331] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:43:31.594397] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:43:31.651959] [DEBUG] [LOCAL ] BOE: Loaded 18339 existing records from primary storage. [2025-10-17T17:43:31.654222] [DEBUG] [LOCAL ] BOND: Loaded 32683 existing records from primary storage. [2025-10-17T17:43:31.654630] [INFO ] [MAIN ] BOND: Loaded 32683 existing records. [2025-10-17T17:43:31.654542] [INFO ] [MAIN ] BOE: Loaded 18339 existing records. [2025-10-17T17:43:31.724518] [DEBUG] [LOCAL ] BOH: Loaded 30879 existing records from primary storage. [2025-10-17T17:43:31.811951] [INFO ] [MAIN ] BOH: Loaded 30879 existing records. [2025-10-17T17:43:31.823165] [DEBUG] [LOCAL ] BOOT: Loaded 40066 existing records from primary storage. [2025-10-17T17:43:31.888754] [INFO ] [MAIN ] BOOT: Loaded 40066 existing records. [2025-10-17T17:43:32.214202] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:43:32.339390] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:43:32.335679] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-17T17:43:32.373487] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-17T17:43:32.389878] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-17T17:43:32.421435] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-17T17:43:32.432805] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-17T17:43:32.426367] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:43:32.435348] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-17T17:43:32.435279] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-17T17:43:32.435214] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-17T17:43:32.451465] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-17T17:43:32.455274] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:43:32.489638] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-17T17:43:32.489800] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-17T17:43:32.475706] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-17T17:43:32.505362] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-17T17:43:32.540419] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-17T17:43:32.577255] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-17T17:43:32.587635] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-17T17:43:33.667173] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:43:33.716862] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-17T17:43:33.811463] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:43:33.834329] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:43:33.850968] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-17T17:43:33.861699] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-17T17:43:33.916618] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:43:33.916904] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-17T17:43:35.099446] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T17:43:35.104425] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-17T17:43:35.189791] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T17:43:35.196610] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-17T17:43:35.268575] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T17:43:35.275267] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-17T17:43:35.369188] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T17:43:35.377202] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-17T17:43:35.913017] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T17:43:35.918422] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-17T17:43:36.426359] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T17:43:36.433372] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-17T17:43:36.562017] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T17:43:36.569837] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-17T17:43:36.952373] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T17:43:36.957141] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-17T17:43:37.124103] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T17:43:37.559552] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-17T17:43:37.562907] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T17:43:37.861823] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T17:43:37.997395] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T17:43:38.358046] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-17T17:43:39.068041] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T17:43:39.158042] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-17T17:43:39.574808] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-17T17:43:39.958092] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-17T17:43:40.493982] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T17:43:40.758052] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-17T17:43:41.558036] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-17T17:43:41.645414] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T17:43:42.097183] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T17:43:42.357139] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-17T17:43:42.362376] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-17T17:43:43.158122] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-17T17:43:43.864790] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T17:43:43.958011] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-17T17:43:44.189628] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T17:43:44.758049] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-17T17:43:45.558030] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-17T17:43:45.810127] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T17:43:45.901931] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T17:43:46.358024] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-17T17:43:46.904508] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T17:43:47.158057] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-17T17:43:47.374143] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-17T17:43:47.958044] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-17T17:43:48.310607] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T17:43:48.758025] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-17T17:43:49.056394] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T17:43:49.558027] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-17T17:43:49.731584] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T17:43:50.358051] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-17T17:43:50.988252] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T17:43:51.158031] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-17T17:43:51.230180] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-17T17:43:51.958119] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-17T17:43:52.758053] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-17T17:43:52.857894] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T17:43:53.343574] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T17:43:53.558021] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-17T17:43:53.666125] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T17:43:54.358026] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-17T17:43:54.947147] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T17:43:55.154512] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-17T17:43:55.162240] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-17T17:43:55.958034] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-17T17:43:56.758005] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-17T17:43:56.841007] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T17:43:57.307222] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-17T17:43:57.558047] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-17T17:43:57.931247] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T17:43:58.358092] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-17T17:43:58.996134] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-17T17:43:59.158066] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-17T17:43:59.728757] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T17:43:59.733907] [INFO ] [REMOTE ] BOH: Full fetch complete (45451 records). [2025-10-17T17:43:59.734101] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-17T17:43:59.963152] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-17T17:44:00.123085] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-17T17:44:00.123168] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-17T17:44:00.123744] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-17T17:44:00.123807] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-17T17:44:00.124790] [DEBUG] [LOCAL ] BOH: Trimmed 45451 records to 31214 (keeping 200 days of data) [2025-10-17T17:44:00.321625] [DEBUG] [LOCAL ] BOH: Primary data saved (31214 records). [2025-10-17T17:44:00.321782] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-17T17:44:00.321889] [INFO ] [MAIN ] Update Progress: 321/2368 symbols completed. BOH took 29.5s. Estimated remaining: 4h 40m 12s. Rate: 7.3 symbols/min [2025-10-17T17:44:00.492820] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:00.540809] [DEBUG] [LOCAL ] BORR: Loaded 51498 existing records from primary storage. [2025-10-17T17:44:00.541118] [INFO ] [MAIN ] BORR: Loaded 51498 existing records. [2025-10-17T17:44:00.722530] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:44:00.722878] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-17T17:44:00.723026] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-17T17:44:00.729715] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-17T17:44:00.740785] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-17T17:44:00.773217] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T17:44:00.772030] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-17T17:44:01.126847] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:01.136042] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T17:44:01.139572] [INFO ] [REMOTE ] BOE: Full fetch complete (26745 records). [2025-10-17T17:44:01.139672] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-17T17:44:01.509819] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-17T17:44:01.509915] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-17T17:44:01.510391] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-17T17:44:01.510438] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-17T17:44:01.511188] [DEBUG] [LOCAL ] BOE: Trimmed 26745 records to 18435 (keeping 200 days of data) [2025-10-17T17:44:01.565716] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-17T17:44:01.622585] [DEBUG] [LOCAL ] BOE: Primary data saved (18435 records). [2025-10-17T17:44:01.622758] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-17T17:44:01.622862] [INFO ] [MAIN ] Update Progress: 322/2368 symbols completed. BOE took 30.8s. Estimated remaining: 4h 39m 20s. Rate: 7.3 symbols/min [2025-10-17T17:44:01.821622] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:01.849588] [DEBUG] [LOCAL ] BOW: Loaded 23436 existing records from primary storage. [2025-10-17T17:44:01.849909] [INFO ] [MAIN ] BOW: Loaded 23436 existing records. [2025-10-17T17:44:02.025084] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:44:02.025330] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-17T17:44:02.025380] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-17T17:44:02.025553] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-17T17:44:02.025593] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-17T17:44:02.360888] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-17T17:44:02.382953] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:03.066550] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T17:44:03.071608] [INFO ] [REMOTE ] BOND: Full fetch complete (46612 records). [2025-10-17T17:44:03.071734] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-17T17:44:03.166835] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-17T17:44:03.440983] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-17T17:44:03.441060] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-17T17:44:03.441626] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-17T17:44:03.441707] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-17T17:44:03.442614] [DEBUG] [LOCAL ] BOND: Trimmed 46612 records to 32938 (keeping 200 days of data) [2025-10-17T17:44:03.647207] [DEBUG] [LOCAL ] BOND: Primary data saved (32938 records). [2025-10-17T17:44:03.647375] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-17T17:44:03.647498] [INFO ] [MAIN ] Update Progress: 323/2368 symbols completed. BOND took 32.8s. Estimated remaining: 4h 38m 33s. Rate: 7.3 symbols/min [2025-10-17T17:44:03.821083] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:03.868772] [DEBUG] [LOCAL ] BOX: Loaded 50563 existing records from primary storage. [2025-10-17T17:44:03.869096] [INFO ] [MAIN ] BOX: Loaded 50563 existing records. [2025-10-17T17:44:04.045092] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:44:04.045344] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-17T17:44:04.045399] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-17T17:44:04.045808] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-17T17:44:04.045866] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-17T17:44:04.409558] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:04.410147] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-17T17:44:04.423432] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T17:44:04.457068] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-17T17:44:04.758067] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-17T17:44:05.564836] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-17T17:44:05.566867] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (4.79 seconds). [2025-10-17T17:44:06.083525] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T17:44:06.357994] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-17T17:44:06.553038] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T17:44:06.558793] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T17:44:07.158011] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-17T17:44:07.957990] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-17T17:44:08.056467] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T17:44:08.061851] [INFO ] [REMOTE ] BOOT: Full fetch complete (60084 records). [2025-10-17T17:44:08.061956] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-17T17:44:08.463833] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-17T17:44:08.463951] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-17T17:44:08.464638] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-17T17:44:08.464847] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-17T17:44:08.475590] [DEBUG] [LOCAL ] BOOT: Trimmed 60084 records to 40347 (keeping 200 days of data) [2025-10-17T17:44:08.494165] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T17:44:08.740042] [DEBUG] [LOCAL ] BOOT: Primary data saved (40347 records). [2025-10-17T17:44:08.740166] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-17T17:44:08.740242] [INFO ] [MAIN ] Update Progress: 324/2368 symbols completed. BOOT took 37.9s. Estimated remaining: 4h 38m 5s. Rate: 7.4 symbols/min [2025-10-17T17:44:08.763206] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-17T17:44:08.919569] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:08.970856] [DEBUG] [LOCAL ] BP: Loaded 54098 existing records from primary storage. [2025-10-17T17:44:08.971294] [INFO ] [MAIN ] BP: Loaded 54098 existing records. [2025-10-17T17:44:09.156572] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:44:09.156870] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-17T17:44:09.156921] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-17T17:44:09.157182] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-17T17:44:09.157240] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-17T17:44:09.538351] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:09.563304] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-17T17:44:09.580538] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T17:44:09.696352] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T17:44:10.358071] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-17T17:44:11.158085] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-17T17:44:11.328691] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T17:44:11.633629] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T17:44:11.958081] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-17T17:44:12.702517] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:44:12.758068] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-17T17:44:13.558034] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-17T17:44:14.170967] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-17T17:44:14.358008] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-17T17:44:14.701005] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T17:44:14.798036] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-17T17:44:15.158037] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-17T17:44:15.958100] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-17T17:44:16.507818] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-17T17:44:16.758078] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-17T17:44:17.056178] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T17:44:17.558032] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-17T17:44:17.939306] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-17T17:44:18.358044] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-17T17:44:18.662546] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-17T17:44:18.816404] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-17T17:44:19.158091] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-17T17:44:19.964679] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-17T17:44:19.997281] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T17:44:20.758084] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-17T17:44:20.944693] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-17T17:44:21.013890] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T17:44:21.558046] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-17T17:44:22.358026] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-17T17:44:22.388419] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T17:44:22.432887] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T17:44:23.158121] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-17T17:44:23.958102] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-17T17:44:24.584151] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-17T17:44:24.758015] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-17T17:44:24.935725] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T17:44:25.167284] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-17T17:44:25.558068] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-17T17:44:26.192476] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T17:44:26.292728] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-17T17:44:26.358055] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-17T17:44:27.158002] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-17T17:44:27.554837] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T17:44:27.559930] [INFO ] [REMOTE ] BOW: Full fetch complete (32117 records). [2025-10-17T17:44:27.560085] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-17T17:44:27.952048] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-17T17:44:27.952181] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-17T17:44:27.952664] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-17T17:44:27.952725] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-17T17:44:27.953477] [DEBUG] [LOCAL ] BOW: Trimmed 32117 records to 23579 (keeping 200 days of data) [2025-10-17T17:44:27.999988] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-17T17:44:28.088267] [DEBUG] [LOCAL ] BOW: Primary data saved (23579 records). [2025-10-17T17:44:28.088398] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-17T17:44:28.088478] [INFO ] [MAIN ] Update Progress: 325/2368 symbols completed. BOW took 26.5s. Estimated remaining: 4h 39m 7s. Rate: 7.3 symbols/min [2025-10-17T17:44:28.256510] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:28.291812] [DEBUG] [LOCAL ] BR: Loaded 35110 existing records from primary storage. [2025-10-17T17:44:28.292098] [INFO ] [MAIN ] BR: Loaded 35110 existing records. [2025-10-17T17:44:28.469782] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:44:28.470034] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-17T17:44:28.470082] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-17T17:44:28.470357] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-17T17:44:28.470414] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-17T17:44:28.763384] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-17T17:44:28.847482] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:29.190749] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-17T17:44:29.558062] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-17T17:44:29.994720] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T17:44:30.229055] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T17:44:30.358029] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-17T17:44:31.157998] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-17T17:44:31.251992] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T17:44:31.958089] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-17T17:44:32.674404] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-17T17:44:32.758080] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-17T17:44:32.855968] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:44:33.558031] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-17T17:44:33.657928] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T17:44:34.358079] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-17T17:44:34.817176] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-17T17:44:35.017848] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T17:44:35.158053] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-17T17:44:35.958067] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-17T17:44:36.515725] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-17T17:44:36.526244] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T17:44:36.525469] [INFO ] [REMOTE ] BOX: Full fetch complete (72306 records). [2025-10-17T17:44:36.533433] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-17T17:44:36.765446] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-17T17:44:36.919330] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-17T17:44:36.919410] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-17T17:44:36.920201] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-17T17:44:36.920265] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-17T17:44:36.921626] [DEBUG] [LOCAL ] BOX: Trimmed 72306 records to 50897 (keeping 200 days of data) [2025-10-17T17:44:37.213514] [DEBUG] [LOCAL ] BOX: Primary data saved (50897 records). [2025-10-17T17:44:37.213678] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-17T17:44:37.214155] [INFO ] [MAIN ] Update Progress: 326/2368 symbols completed. BOX took 33.6s. Estimated remaining: 4h 39m 5s. Rate: 7.3 symbols/min [2025-10-17T17:44:37.384583] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:37.433458] [DEBUG] [LOCAL ] BRBR: Loaded 52076 existing records from primary storage. [2025-10-17T17:44:37.433791] [INFO ] [MAIN ] BRBR: Loaded 52076 existing records. [2025-10-17T17:44:37.574503] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-17T17:44:37.616500] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:44:37.616719] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-17T17:44:37.616785] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-17T17:44:37.617105] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-17T17:44:37.617166] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-17T17:44:38.017834] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:38.020249] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-17T17:44:38.358109] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-17T17:44:38.709386] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-17T17:44:39.120136] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T17:44:39.157995] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-17T17:44:39.958006] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-17T17:44:40.178155] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T17:44:40.185244] [INFO ] [REMOTE ] BORR: Full fetch complete (74595 records). [2025-10-17T17:44:40.185390] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-17T17:44:40.585785] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-17T17:44:40.585907] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-17T17:44:40.586884] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-17T17:44:40.586987] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-17T17:44:40.588610] [DEBUG] [LOCAL ] BORR: Trimmed 74595 records to 51855 (keeping 200 days of data) [2025-10-17T17:44:40.780472] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-17T17:44:40.813332] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T17:44:40.927806] [DEBUG] [LOCAL ] BORR: Primary data saved (51855 records). [2025-10-17T17:44:40.928025] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-17T17:44:40.928141] [INFO ] [MAIN ] Update Progress: 327/2368 symbols completed. BORR took 40.6s. Estimated remaining: 4h 38m 29s. Rate: 7.3 symbols/min [2025-10-17T17:44:41.110683] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:41.137163] [DEBUG] [LOCAL ] BRC: Loaded 18774 existing records from primary storage. [2025-10-17T17:44:41.137628] [INFO ] [MAIN ] BRC: Loaded 18774 existing records. [2025-10-17T17:44:41.323321] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:44:41.323617] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-17T17:44:41.323700] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-17T17:44:41.323987] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-17T17:44:41.324027] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-17T17:44:41.568508] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-17T17:44:41.697913] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:41.909595] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-17T17:44:42.358043] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-17T17:44:42.445052] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T17:44:42.793082] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-17T17:44:43.158036] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-17T17:44:43.958081] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-17T17:44:44.438225] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-17T17:44:44.736328] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T17:44:44.757990] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-17T17:44:45.148181] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T17:44:45.558015] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-17T17:44:46.257341] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T17:44:46.358043] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-17T17:44:46.640197] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T17:44:47.158037] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-17T17:44:47.657241] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T17:44:47.941088] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T17:44:47.958073] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-17T17:44:48.758059] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-17T17:44:49.558004] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-17T17:44:49.593818] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T17:44:50.358041] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-17T17:44:51.023441] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T17:44:51.157993] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-17T17:44:51.528179] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.77 seconds). [2025-10-17T17:44:51.535810] [INFO ] [REMOTE ] BP: Full fetch complete (77882 records). [2025-10-17T17:44:51.535936] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-17T17:44:51.931798] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-17T17:44:51.931908] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-17T17:44:51.932798] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-17T17:44:51.932942] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-17T17:44:51.934551] [DEBUG] [LOCAL ] BP: Trimmed 77882 records to 54488 (keeping 200 days of data) [2025-10-17T17:44:51.987134] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-17T17:44:52.088372] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T17:44:52.301761] [DEBUG] [LOCAL ] BP: Primary data saved (54488 records). [2025-10-17T17:44:52.301895] [INFO ] [MAIN ] BP: Full history saved. [2025-10-17T17:44:52.302409] [INFO ] [MAIN ] Update Progress: 328/2368 symbols completed. BP took 43.6s. Estimated remaining: 4h 38m 40s. Rate: 7.3 symbols/min [2025-10-17T17:44:52.469083] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:52.469296] [DEBUG] [LOCAL ] BRCC: No existing data file found in primary storage. [2025-10-17T17:44:52.469372] [WARN ] [MAIN ] BRCC: No existing data found, performing full refresh instead. [2025-10-17T17:44:52.469576] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-17T17:44:52.469672] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-17T17:44:52.469885] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-10-17T17:44:52.469942] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-17T17:44:52.760829] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-17T17:44:52.843783] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T17:44:52.847166] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:53.223983] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T17:44:53.558025] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-17T17:44:54.358012] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-17T17:44:54.634298] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T17:44:54.658890] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T17:44:55.158030] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-17T17:44:55.632110] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-17T17:44:55.958035] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-17T17:44:56.753718] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T17:44:56.763534] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-17T17:44:57.558011] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-17T17:44:57.622363] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T17:44:58.281830] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-17T17:44:58.287176] [INFO ] [REMOTE ] BR: Full fetch complete (50043 records). [2025-10-17T17:44:58.287297] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-17T17:44:58.364395] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-17T17:44:58.685316] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-17T17:44:58.685509] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-17T17:44:58.686236] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-17T17:44:58.686380] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-17T17:44:58.701117] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T17:44:58.706694] [DEBUG] [LOCAL ] BR: Trimmed 50043 records to 35340 (keeping 200 days of data) [2025-10-17T17:44:58.924368] [DEBUG] [LOCAL ] BR: Primary data saved (35340 records). [2025-10-17T17:44:58.924506] [INFO ] [MAIN ] BR: Full history saved. [2025-10-17T17:44:58.924589] [INFO ] [MAIN ] Update Progress: 329/2368 symbols completed. BR took 30.8s. Estimated remaining: 4h 38m 22s. Rate: 7.3 symbols/min [2025-10-17T17:44:59.093493] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:44:59.093678] [DEBUG] [LOCAL ] BRO: No existing data file found in primary storage. [2025-10-17T17:44:59.093732] [WARN ] [MAIN ] BRO: No existing data found, performing full refresh instead. [2025-10-17T17:44:59.093865] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-17T17:44:59.093910] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-17T17:44:59.093950] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-17T17:44:59.093982] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-17T17:44:59.167633] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-17T17:44:59.446632] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:44:59.958063] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-17T17:45:00.227480] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T17:45:00.620305] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T17:45:00.758077] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-17T17:45:01.558038] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-17T17:45:01.847681] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T17:45:02.358011] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-17T17:45:02.359586] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T17:45:03.158023] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-17T17:45:03.232627] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T17:45:03.958124] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-17T17:45:04.137537] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T17:45:04.180034] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-17T17:45:04.758037] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-17T17:45:05.558051] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-17T17:45:05.628437] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T17:45:06.358039] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-17T17:45:06.570748] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T17:45:07.158018] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-17T17:45:07.391994] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T17:45:07.392450] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T17:45:07.958081] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-17T17:45:08.758108] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-17T17:45:08.830162] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T17:45:08.993088] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T17:45:09.004049] [INFO ] [REMOTE ] BRBR: Full fetch complete (72601 records). [2025-10-17T17:45:09.004288] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-17T17:45:09.005385] [FATAL] [VALIDATOR ] BRBR: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:45:09.005526] [FATAL] [MAIN ] BRBR: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:45:09.005593] [WARN ] [MAIN ] BRBR: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:45:09.005711] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-17T17:45:09.005811] [DEBUG] [LOCAL ] BRBR: No primary data file found to delete. [2025-10-17T17:45:09.005869] [INFO ] [LOCAL ] BRBR: Starting deletion of derivative data. [2025-10-17T17:45:09.006103] [DEBUG] [LOCAL ] BRBR: Deleted derivative data file. [2025-10-17T17:45:09.006747] [INFO ] [MAIN ] Update Progress: 330/2368 symbols completed. BRBR took 31.8s. Estimated remaining: 4h 38m 26s. Rate: 7.3 symbols/min [2025-10-17T17:45:09.227994] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:45:09.288812] [DEBUG] [LOCAL ] BROS: Loaded 53690 existing records from primary storage. [2025-10-17T17:45:09.289215] [INFO ] [MAIN ] BROS: Loaded 53690 existing records. [2025-10-17T17:45:09.463429] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:45:09.463639] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-17T17:45:09.463720] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-17T17:45:09.464021] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-17T17:45:09.464076] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-17T17:45:09.561828] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-17T17:45:09.811041] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:45:10.358109] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-17T17:45:10.788036] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T17:45:11.130517] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T17:45:11.157992] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-17T17:45:11.958003] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-17T17:45:12.399450] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-17T17:45:12.682676] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-17T17:45:12.758010] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-17T17:45:12.980873] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T17:45:13.558029] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-17T17:45:13.915694] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T17:45:14.358087] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-17T17:45:15.158087] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-17T17:45:15.474274] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T17:45:15.958058] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-17T17:45:16.124618] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T17:45:16.758063] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-17T17:45:17.204339] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-17T17:45:17.241806] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T17:45:17.246172] [INFO ] [REMOTE ] BRC: Full fetch complete (28522 records). [2025-10-17T17:45:17.246292] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-17T17:45:17.563146] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-17T17:45:17.622828] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-17T17:45:17.622911] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-17T17:45:17.623355] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-17T17:45:17.623396] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-17T17:45:17.624286] [DEBUG] [LOCAL ] BRC: Trimmed 28522 records to 18893 (keeping 200 days of data) [2025-10-17T17:45:17.740014] [DEBUG] [LOCAL ] BRC: Primary data saved (18893 records). [2025-10-17T17:45:17.740166] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-17T17:45:17.740253] [INFO ] [MAIN ] Update Progress: 331/2368 symbols completed. BRC took 36.8s. Estimated remaining: 4h 38m 21s. Rate: 7.3 symbols/min [2025-10-17T17:45:17.910866] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:45:17.911082] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-17T17:45:17.911126] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-17T17:45:17.911250] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-17T17:45:17.911291] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-17T17:45:17.911332] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-17T17:45:17.911366] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-17T17:45:18.285446] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:45:18.317808] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T17:45:18.358003] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-17T17:45:19.158071] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-17T17:45:19.285627] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-17T17:45:19.958080] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-17T17:45:20.084251] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T17:45:20.652249] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:45:20.652568] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-17T17:45:20.652691] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:45:20.652751] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-17T17:45:20.652789] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:45:20.652855] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-17T17:45:20.652925] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-17T17:45:20.652971] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-17T17:45:20.653013] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-17T17:45:20.653063] [INFO ] [MAIN ] Update Progress: 332/2368 symbols completed. BRSL took 2.9s. Estimated remaining: 4h 37m 40s. Rate: 7.3 symbols/min [2025-10-17T17:45:20.762356] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-17T17:45:20.852706] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T17:45:20.888419] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:45:20.924771] [DEBUG] [LOCAL ] BRSP: Loaded 37050 existing records from primary storage. [2025-10-17T17:45:20.925098] [INFO ] [MAIN ] BRSP: Loaded 37050 existing records. [2025-10-17T17:45:21.163876] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:45:21.164097] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-17T17:45:21.164143] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-17T17:45:21.164417] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-17T17:45:21.164474] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-17T17:45:21.525776] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:45:21.558047] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-17T17:45:22.358100] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-17T17:45:22.803731] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T17:45:23.155738] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T17:45:23.164332] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-17T17:45:23.958078] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-17T17:45:24.330957] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T17:45:24.758050] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-17T17:45:25.034945] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T17:45:25.504579] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T17:45:25.510047] [INFO ] [REMOTE ] BRCC: Full fetch complete (57463 records). [2025-10-17T17:45:25.510151] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-17T17:45:25.563218] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-17T17:45:25.906493] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-17T17:45:25.906583] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-17T17:45:25.907281] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-17T17:45:25.907347] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-17T17:45:25.908732] [DEBUG] [LOCAL ] BRCC: Trimmed 57463 records to 40784 (keeping 200 days of data) [2025-10-17T17:45:26.133749] [DEBUG] [LOCAL ] BRCC: Primary data saved (40784 records). [2025-10-17T17:45:26.133872] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-17T17:45:26.133942] [INFO ] [MAIN ] Update Progress: 333/2368 symbols completed. BRCC took 33.8s. Estimated remaining: 4h 37m 16s. Rate: 7.3 symbols/min [2025-10-17T17:45:26.304307] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T17:45:26.349050] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:45:26.349286] [DEBUG] [LOCAL ] BRT: No existing data file found in primary storage. [2025-10-17T17:45:26.349342] [WARN ] [MAIN ] BRT: No existing data found, performing full refresh instead. [2025-10-17T17:45:26.349503] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-17T17:45:26.349557] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-17T17:45:26.349603] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-17T17:45:26.349674] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-17T17:45:26.363208] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-17T17:45:26.726047] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:45:27.084759] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T17:45:27.158106] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-17T17:45:27.881824] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T17:45:27.958029] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-17T17:45:28.707109] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T17:45:28.758012] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-17T17:45:28.811319] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T17:45:29.360592] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T17:45:29.558032] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-17T17:45:30.358033] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-17T17:45:30.847893] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T17:45:31.158047] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-17T17:45:31.460840] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T17:45:31.471319] [INFO ] [REMOTE ] BRO: Full fetch complete (74971 records). [2025-10-17T17:45:31.471521] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-17T17:45:31.794226] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-17T17:45:31.886617] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-17T17:45:31.886729] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-17T17:45:31.887639] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-17T17:45:31.887723] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-17T17:45:31.889764] [DEBUG] [LOCAL ] BRO: Trimmed 74971 records to 52839 (keeping 200 days of data) [2025-10-17T17:45:31.979741] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-17T17:45:32.217705] [DEBUG] [LOCAL ] BRO: Primary data saved (52839 records). [2025-10-17T17:45:32.217848] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-17T17:45:32.217921] [INFO ] [MAIN ] Update Progress: 334/2368 symbols completed. BRO took 33.3s. Estimated remaining: 4h 36m 55s. Rate: 7.3 symbols/min [2025-10-17T17:45:32.392509] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:45:32.392709] [DEBUG] [LOCAL ] BRW: No existing data file found in primary storage. [2025-10-17T17:45:32.392765] [WARN ] [MAIN ] BRW: No existing data found, performing full refresh instead. [2025-10-17T17:45:32.392881] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-17T17:45:32.392944] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-17T17:45:32.393012] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-17T17:45:32.393085] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-17T17:45:32.762720] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:45:32.762818] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-17T17:45:33.557991] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-17T17:45:33.650480] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T17:45:33.696080] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T17:45:34.219051] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-17T17:45:34.358059] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-17T17:45:34.460638] [DEBUG] [REMOTE ] BROS: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-17T17:45:34.460983] [WARN ] [REMOTE ] BROS: No data returned for month 2025-06 [2025-10-17T17:45:34.461075] [FATAL] [REMOTE ] BROS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:45:34.461175] [FATAL] [MAIN ] BROS: Failed to fetch primary data. [2025-10-17T17:45:34.461247] [WARN ] [MAIN ] BROS: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:45:34.461324] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-17T17:45:34.461388] [DEBUG] [LOCAL ] BROS: No primary data file found to delete. [2025-10-17T17:45:34.461425] [INFO ] [LOCAL ] BROS: Starting deletion of derivative data. [2025-10-17T17:45:34.461536] [DEBUG] [LOCAL ] BROS: Deleted derivative data file. [2025-10-17T17:45:34.461999] [INFO ] [MAIN ] Update Progress: 335/2368 symbols completed. BROS took 25.5s. Estimated remaining: 4h 36m 11s. Rate: 7.4 symbols/min [2025-10-17T17:45:34.636290] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:45:34.636506] [DEBUG] [LOCAL ] BRX: No existing data file found in primary storage. [2025-10-17T17:45:34.636571] [WARN ] [MAIN ] BRX: No existing data found, performing full refresh instead. [2025-10-17T17:45:34.636769] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-17T17:45:34.636823] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-17T17:45:34.636869] [DEBUG] [LOCAL ] BRX: No primary data file found to delete. [2025-10-17T17:45:34.636904] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-17T17:45:34.995426] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:45:35.158024] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-17T17:45:35.958027] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-17T17:45:36.758008] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-17T17:45:36.859057] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:45:36.912500] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T17:45:37.443422] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T17:45:37.558026] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-17T17:45:38.358036] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-17T17:45:39.158016] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-17T17:45:39.224196] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T17:45:39.963460] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-17T17:45:39.969544] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T17:45:40.384610] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T17:45:40.454440] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-17T17:45:40.758078] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-17T17:45:41.558030] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-17T17:45:42.358052] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-17T17:45:42.410710] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T17:45:42.539696] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T17:45:42.799280] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-17T17:45:43.158074] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-17T17:45:43.958060] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-17T17:45:44.655394] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T17:45:44.669294] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T17:45:44.758030] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-17T17:45:45.371622] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-17T17:45:45.558046] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-17T17:45:46.358018] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-17T17:45:46.517971] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T17:45:47.105509] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-17T17:45:47.107146] [INFO ] [REMOTE ] BRT: Full fetch complete (7055 records). [2025-10-17T17:45:47.107240] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-17T17:45:47.163984] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-17T17:45:47.470498] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-17T17:45:47.470577] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-17T17:45:47.470825] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-17T17:45:47.470887] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-17T17:45:47.471320] [DEBUG] [LOCAL ] BRT: Trimmed 7055 records to 5316 (keeping 200 days of data) [2025-10-17T17:45:47.504080] [DEBUG] [LOCAL ] BRT: Primary data saved (5316 records). [2025-10-17T17:45:47.504208] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-17T17:45:47.504317] [INFO ] [MAIN ] Update Progress: 336/2368 symbols completed. BRT took 21.4s. Estimated remaining: 4h 36m 32s. Rate: 7.3 symbols/min [2025-10-17T17:45:47.709932] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:45:47.745734] [DEBUG] [LOCAL ] BSAC: Loaded 33148 existing records from primary storage. [2025-10-17T17:45:47.746028] [INFO ] [MAIN ] BSAC: Loaded 33148 existing records. [2025-10-17T17:45:47.922577] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:45:47.922805] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-17T17:45:47.922865] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-17T17:45:47.923174] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-17T17:45:47.923241] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-17T17:45:47.965380] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-17T17:45:48.272270] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:45:48.597412] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T17:45:48.758032] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-17T17:45:49.558068] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-17T17:45:49.658035] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T17:45:50.126977] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T17:45:50.305556] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T17:45:50.357995] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-17T17:45:51.158013] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-17T17:45:51.388766] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-17T17:45:51.958056] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-17T17:45:52.267467] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-17T17:45:52.758035] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-17T17:45:53.558042] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-17T17:45:53.776035] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T17:45:53.849841] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T17:45:54.357993] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-17T17:45:54.745809] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T17:45:55.158033] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-17T17:45:55.721148] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T17:45:55.958053] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-17T17:45:56.758041] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-17T17:45:56.866967] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T17:45:56.948565] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-17T17:45:57.558028] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-17T17:45:58.258460] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T17:45:58.358088] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-17T17:45:58.523618] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T17:45:59.158035] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-17T17:45:59.575794] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-17T17:45:59.958090] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-17T17:46:00.758094] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-17T17:46:01.132069] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T17:46:01.250557] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T17:46:01.558112] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-17T17:46:02.358038] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-17T17:46:02.423433] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T17:46:02.429910] [INFO ] [REMOTE ] BRSP: Full fetch complete (53985 records). [2025-10-17T17:46:02.430110] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-17T17:46:02.431174] [FATAL] [VALIDATOR ] BRSP: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:46:02.431271] [FATAL] [MAIN ] BRSP: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:46:02.431316] [WARN ] [MAIN ] BRSP: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:46:02.431361] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-17T17:46:02.431444] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-10-17T17:46:02.431504] [INFO ] [LOCAL ] BRSP: Starting deletion of derivative data. [2025-10-17T17:46:02.431701] [DEBUG] [LOCAL ] BRSP: Deleted derivative data file. [2025-10-17T17:46:02.431807] [INFO ] [MAIN ] Update Progress: 337/2368 symbols completed. BRSP took 41.8s. Estimated remaining: 4h 37m 5s. Rate: 7.3 symbols/min [2025-10-17T17:46:02.629587] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:46:02.629958] [DEBUG] [LOCAL ] BSBR: No existing data file found in primary storage. [2025-10-17T17:46:02.630005] [WARN ] [MAIN ] BSBR: No existing data found, performing full refresh instead. [2025-10-17T17:46:02.630228] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-17T17:46:02.630286] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-17T17:46:02.630333] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-10-17T17:46:02.630369] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-17T17:46:03.077761] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:46:03.158032] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-17T17:46:03.281768] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T17:46:03.958066] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-17T17:46:04.012499] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T17:46:04.638370] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T17:46:04.763316] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-17T17:46:04.780662] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-17T17:46:05.558069] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-17T17:46:06.358079] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-17T17:46:07.158066] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-17T17:46:07.801665] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-17T17:46:07.958052] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-17T17:46:08.037635] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (3.27 seconds). [2025-10-17T17:46:08.167708] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-17T17:46:08.321033] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T17:46:08.758061] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-17T17:46:09.155149] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T17:46:09.159683] [INFO ] [REMOTE ] BRW: Full fetch complete (30294 records). [2025-10-17T17:46:09.160068] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-17T17:46:09.564997] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-17T17:46:09.573532] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-17T17:46:09.574904] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-17T17:46:09.575691] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-17T17:46:09.575818] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-17T17:46:09.577238] [DEBUG] [LOCAL ] BRW: Trimmed 30294 records to 21211 (keeping 200 days of data) [2025-10-17T17:46:09.714122] [DEBUG] [LOCAL ] BRW: Primary data saved (21211 records). [2025-10-17T17:46:09.714299] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-17T17:46:09.714414] [INFO ] [MAIN ] Update Progress: 338/2368 symbols completed. BRW took 37.5s. Estimated remaining: 4h 36m 51s. Rate: 7.3 symbols/min [2025-10-17T17:46:09.908708] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:46:09.921805] [DEBUG] [LOCAL ] BSL: Loaded 8327 existing records from primary storage. [2025-10-17T17:46:09.922077] [INFO ] [MAIN ] BSL: Loaded 8327 existing records. [2025-10-17T17:46:10.131430] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:46:10.132030] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-17T17:46:10.132336] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-17T17:46:10.141604] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-17T17:46:10.150705] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-17T17:46:10.226075] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T17:46:10.364680] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-17T17:46:10.555001] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:46:10.932628] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T17:46:11.158084] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-17T17:46:11.958037] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-17T17:46:12.132467] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T17:46:12.499236] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-17T17:46:12.558951] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T17:46:12.758067] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-17T17:46:13.558098] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-17T17:46:14.167548] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-17T17:46:14.358074] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-17T17:46:14.976626] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T17:46:15.158070] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-17T17:46:15.958035] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-17T17:46:16.083716] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T17:46:16.200538] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T17:46:16.209112] [INFO ] [REMOTE ] BRX: Full fetch complete (75151 records). [2025-10-17T17:46:16.209367] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-17T17:46:16.653795] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-17T17:46:16.653962] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-17T17:46:16.655129] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-17T17:46:16.655201] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-17T17:46:16.657616] [DEBUG] [LOCAL ] BRX: Trimmed 75151 records to 52572 (keeping 200 days of data) [2025-10-17T17:46:16.760042] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-17T17:46:17.025406] [DEBUG] [LOCAL ] BRX: Primary data saved (52572 records). [2025-10-17T17:46:17.025634] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-17T17:46:17.025790] [INFO ] [MAIN ] Update Progress: 339/2368 symbols completed. BRX took 42.6s. Estimated remaining: 4h 36m 38s. Rate: 7.3 symbols/min [2025-10-17T17:46:17.224285] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:46:17.264009] [DEBUG] [LOCAL ] BSM: Loaded 32574 existing records from primary storage. [2025-10-17T17:46:17.264675] [INFO ] [MAIN ] BSM: Loaded 32574 existing records. [2025-10-17T17:46:17.488671] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T17:46:17.521172] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:46:17.522961] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-17T17:46:17.523077] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-17T17:46:17.523460] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-17T17:46:17.523531] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-17T17:46:17.563180] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-17T17:46:17.942445] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:46:18.087159] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T17:46:18.358104] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-17T17:46:19.010537] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T17:46:19.158112] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-17T17:46:19.827303] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T17:46:19.835286] [INFO ] [REMOTE ] BSAC: Full fetch complete (44986 records). [2025-10-17T17:46:19.835499] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-17T17:46:19.963134] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-17T17:46:20.325587] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-17T17:46:20.325749] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-17T17:46:20.326703] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-17T17:46:20.326781] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-17T17:46:20.331916] [DEBUG] [LOCAL ] BSAC: Trimmed 44986 records to 33351 (keeping 200 days of data) [2025-10-17T17:46:20.543701] [DEBUG] [LOCAL ] BSAC: Primary data saved (33351 records). [2025-10-17T17:46:20.544098] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-17T17:46:20.544291] [INFO ] [MAIN ] Update Progress: 340/2368 symbols completed. BSAC took 33.0s. Estimated remaining: 4h 36m 2s. Rate: 7.3 symbols/min [2025-10-17T17:46:20.684638] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-17T17:46:20.751988] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:46:20.752313] [DEBUG] [LOCAL ] BST: No existing data file found in primary storage. [2025-10-17T17:46:20.752416] [WARN ] [MAIN ] BST: No existing data found, performing full refresh instead. [2025-10-17T17:46:20.752856] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-17T17:46:20.753020] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-17T17:46:20.753088] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-17T17:46:20.753132] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-17T17:46:20.758389] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-17T17:46:20.901230] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T17:46:21.255759] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:46:21.558064] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-17T17:46:21.666184] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T17:46:22.358017] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-17T17:46:22.805423] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T17:46:23.158036] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-17T17:46:23.550620] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T17:46:23.958099] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-17T17:46:24.405442] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T17:46:24.758067] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-17T17:46:25.363277] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T17:46:25.558019] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-17T17:46:25.722066] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-17T17:46:26.358034] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-17T17:46:27.158027] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-17T17:46:27.195441] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:46:27.746371] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-17T17:46:27.898352] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T17:46:27.957995] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-17T17:46:28.758060] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-17T17:46:29.306171] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-17T17:46:29.558010] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-17T17:46:29.827045] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T17:46:30.358052] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-17T17:46:30.931699] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T17:46:31.158032] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-17T17:46:31.702445] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T17:46:31.958003] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-17T17:46:32.254451] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T17:46:32.757999] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-17T17:46:33.196288] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T17:46:33.558026] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-17T17:46:33.965960] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T17:46:34.245898] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-17T17:46:34.358027] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-17T17:46:35.158035] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-17T17:46:35.274357] [DEBUG] [REMOTE ] BSL: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-17T17:46:35.274719] [WARN ] [REMOTE ] BSL: No data returned for month 2025-07 [2025-10-17T17:46:35.274810] [FATAL] [REMOTE ] BSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:46:35.274889] [FATAL] [MAIN ] BSL: Failed to fetch primary data. [2025-10-17T17:46:35.274951] [WARN ] [MAIN ] BSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:46:35.275022] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-17T17:46:35.275087] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-10-17T17:46:35.275123] [INFO ] [LOCAL ] BSL: Starting deletion of derivative data. [2025-10-17T17:46:35.275237] [DEBUG] [LOCAL ] BSL: Deleted derivative data file. [2025-10-17T17:46:35.275302] [INFO ] [MAIN ] Update Progress: 341/2368 symbols completed. BSL took 25.6s. Estimated remaining: 4h 36m 33s. Rate: 7.3 symbols/min [2025-10-17T17:46:35.449383] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:46:35.449607] [DEBUG] [LOCAL ] BSTZ: No existing data file found in primary storage. [2025-10-17T17:46:35.449683] [WARN ] [MAIN ] BSTZ: No existing data found, performing full refresh instead. [2025-10-17T17:46:35.449798] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-17T17:46:35.449841] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-17T17:46:35.449882] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-17T17:46:35.449914] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-17T17:46:35.822530] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:46:35.837229] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T17:46:35.958010] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-17T17:46:36.758039] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-17T17:46:37.279094] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T17:46:37.558029] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-17T17:46:38.192972] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T17:46:38.331753] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T17:46:38.358025] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-17T17:46:39.158033] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-17T17:46:39.506407] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T17:46:39.958024] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-17T17:46:40.325878] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T17:46:40.758046] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-17T17:46:41.490092] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T17:46:41.558108] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-17T17:46:41.809354] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T17:46:42.358043] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-17T17:46:42.811680] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T17:46:43.158029] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-17T17:46:43.796630] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T17:46:43.802839] [INFO ] [REMOTE ] BSBR: Full fetch complete (51129 records). [2025-10-17T17:46:43.803001] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-17T17:46:43.965791] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-17T17:46:44.207469] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-17T17:46:44.207716] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-17T17:46:44.208414] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-17T17:46:44.208465] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-17T17:46:44.209768] [DEBUG] [LOCAL ] BSBR: Trimmed 51129 records to 36277 (keeping 200 days of data) [2025-10-17T17:46:44.304566] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T17:46:44.432803] [DEBUG] [LOCAL ] BSBR: Primary data saved (36277 records). [2025-10-17T17:46:44.432958] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-17T17:46:44.433043] [INFO ] [MAIN ] Update Progress: 342/2368 symbols completed. BSBR took 42.0s. Estimated remaining: 4h 36m 30s. Rate: 7.3 symbols/min [2025-10-17T17:46:44.600445] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:46:44.651312] [DEBUG] [LOCAL ] BSX: Loaded 54078 existing records from primary storage. [2025-10-17T17:46:44.651616] [INFO ] [MAIN ] BSX: Loaded 54078 existing records. [2025-10-17T17:46:44.763235] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-17T17:46:44.830850] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:46:44.831029] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-17T17:46:44.831116] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-17T17:46:44.831382] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-17T17:46:44.831429] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-17T17:46:45.193241] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:46:45.268744] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-17T17:46:45.558041] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-17T17:46:45.804049] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T17:46:46.358042] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-17T17:46:46.757495] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T17:46:47.158068] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-17T17:46:47.376083] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T17:46:47.958082] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-17T17:46:48.450908] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T17:46:48.758027] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-17T17:46:49.273404] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T17:46:49.278521] [INFO ] [REMOTE ] BSM: Full fetch complete (46940 records). [2025-10-17T17:46:49.278725] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-17T17:46:49.563194] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-17T17:46:49.679760] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-17T17:46:49.679897] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-17T17:46:49.681037] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-17T17:46:49.681131] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-17T17:46:49.699238] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-17T17:46:49.705623] [DEBUG] [LOCAL ] BSM: Trimmed 46940 records to 32822 (keeping 200 days of data) [2025-10-17T17:46:49.930079] [DEBUG] [LOCAL ] BSM: Primary data saved (32822 records). [2025-10-17T17:46:49.930237] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-17T17:46:49.930324] [INFO ] [MAIN ] Update Progress: 343/2368 symbols completed. BSM took 32.9s. Estimated remaining: 4h 36m 6s. Rate: 7.3 symbols/min [2025-10-17T17:46:50.100330] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:46:50.108097] [DEBUG] [LOCAL ] BTA: Loaded 5735 existing records from primary storage. [2025-10-17T17:46:50.108285] [INFO ] [MAIN ] BTA: Loaded 5735 existing records. [2025-10-17T17:46:50.280939] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:46:50.281196] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-17T17:46:50.281243] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-17T17:46:50.281397] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-17T17:46:50.281454] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-17T17:46:50.363137] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-17T17:46:50.648008] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:46:51.158065] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-17T17:46:51.485997] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T17:46:51.549589] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-17T17:46:51.958141] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-17T17:46:52.010504] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T17:46:52.758098] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-17T17:46:53.558093] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-17T17:46:53.624536] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T17:46:53.667234] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T17:46:54.358110] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-17T17:46:55.146625] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T17:46:55.157997] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-17T17:46:55.369903] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T17:46:55.803336] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-17T17:46:55.958069] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-17T17:46:56.758054] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-17T17:46:57.073474] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T17:46:57.372815] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T17:46:57.558023] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-17T17:46:58.358076] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-17T17:46:59.158016] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-17T17:46:59.430818] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-17T17:46:59.539526] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T17:46:59.958083] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-17T17:47:00.429314] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T17:47:00.434598] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36705 records). [2025-10-17T17:47:00.434893] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-17T17:47:00.763137] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-17T17:47:00.833233] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-17T17:47:00.833326] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-17T17:47:00.833856] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-17T17:47:00.833922] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-17T17:47:00.834979] [DEBUG] [LOCAL ] BSTZ: Trimmed 36705 records to 25243 (keeping 200 days of data) [2025-10-17T17:47:00.989395] [DEBUG] [LOCAL ] BSTZ: Primary data saved (25243 records). [2025-10-17T17:47:00.989537] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-17T17:47:00.989614] [INFO ] [MAIN ] Update Progress: 344/2368 symbols completed. BSTZ took 25.7s. Estimated remaining: 4h 36m 15s. Rate: 7.3 symbols/min [2025-10-17T17:47:01.165456] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:01.183414] [DEBUG] [LOCAL ] BTCM: Loaded 17122 existing records from primary storage. [2025-10-17T17:47:01.183661] [INFO ] [MAIN ] BTCM: Loaded 17122 existing records. [2025-10-17T17:47:01.362007] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:47:01.362183] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-17T17:47:01.362231] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-17T17:47:01.362386] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-10-17T17:47:01.362450] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-17T17:47:01.576177] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-17T17:47:01.727504] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:02.280691] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-17T17:47:02.300262] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T17:47:02.303146] [INFO ] [REMOTE ] BST: Full fetch complete (28356 records). [2025-10-17T17:47:02.303294] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-17T17:47:02.303883] [FATAL] [VALIDATOR ] BST: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:47:02.303978] [FATAL] [MAIN ] BST: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:47:02.304022] [WARN ] [MAIN ] BST: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:47:02.304089] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-17T17:47:02.304155] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-17T17:47:02.304193] [INFO ] [LOCAL ] BST: Starting deletion of derivative data. [2025-10-17T17:47:02.304233] [DEBUG] [LOCAL ] BST: No derivative data file found to delete. [2025-10-17T17:47:02.304294] [INFO ] [MAIN ] Update Progress: 345/2368 symbols completed. BST took 41.8s. Estimated remaining: 4h 35m 26s. Rate: 7.3 symbols/min [2025-10-17T17:47:02.363275] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-17T17:47:02.484898] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:02.533092] [DEBUG] [LOCAL ] BTE: Loaded 53118 existing records from primary storage. [2025-10-17T17:47:02.533397] [INFO ] [MAIN ] BTE: Loaded 53118 existing records. [2025-10-17T17:47:02.719428] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:47:02.719669] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-17T17:47:02.719731] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-17T17:47:02.720014] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-17T17:47:02.720053] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-17T17:47:03.074839] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:47:03.079802] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:03.157987] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-17T17:47:03.734731] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T17:47:03.958023] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-17T17:47:04.263037] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T17:47:04.359543] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-17T17:47:04.758049] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-17T17:47:05.558033] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-17T17:47:06.358002] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-17T17:47:06.583356] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T17:47:06.817372] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T17:47:07.106536] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T17:47:07.158061] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-17T17:47:07.958093] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-17T17:47:08.758045] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-17T17:47:09.083296] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T17:47:09.241422] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T17:47:09.387511] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-17T17:47:09.558000] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-17T17:47:10.358080] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-17T17:47:11.027006] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-17T17:47:11.028590] [INFO ] [REMOTE ] BTA: Full fetch complete (9544 records). [2025-10-17T17:47:11.028693] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-17T17:47:11.170126] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-17T17:47:11.399027] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-17T17:47:11.399125] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-17T17:47:11.399424] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-17T17:47:11.399503] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-17T17:47:11.400024] [DEBUG] [LOCAL ] BTA: Trimmed 9544 records to 5810 (keeping 200 days of data) [2025-10-17T17:47:11.438119] [DEBUG] [LOCAL ] BTA: Primary data saved (5810 records). [2025-10-17T17:47:11.438345] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-17T17:47:11.438449] [INFO ] [MAIN ] Update Progress: 346/2368 symbols completed. BTA took 21.5s. Estimated remaining: 4h 35m 24s. Rate: 7.3 symbols/min [2025-10-17T17:47:11.621756] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-17T17:47:11.657729] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:11.707259] [DEBUG] [LOCAL ] BTI: Loaded 53986 existing records from primary storage. [2025-10-17T17:47:11.707601] [INFO ] [MAIN ] BTI: Loaded 53986 existing records. [2025-10-17T17:47:11.888679] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:47:11.888945] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-17T17:47:11.889015] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-17T17:47:11.889451] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-17T17:47:11.889509] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-17T17:47:11.963516] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-17T17:47:12.157033] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T17:47:12.267368] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:12.758054] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-17T17:47:13.557999] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-17T17:47:13.616244] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T17:47:13.649119] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T17:47:14.358041] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-17T17:47:14.922010] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-17T17:47:15.158080] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-17T17:47:15.773010] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-17T17:47:15.958100] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-17T17:47:16.758122] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-17T17:47:16.770314] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T17:47:16.953979] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T17:47:17.558007] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-17T17:47:18.230458] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T17:47:18.358018] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-17T17:47:19.019933] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-17T17:47:19.158006] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-17T17:47:19.498296] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-17T17:47:19.803869] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-17T17:47:19.958059] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-17T17:47:20.758141] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-17T17:47:21.558051] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-17T17:47:21.866712] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T17:47:22.358078] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-17T17:47:22.731239] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-17T17:47:23.141260] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T17:47:23.158007] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-17T17:47:23.958052] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-17T17:47:24.197029] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T17:47:24.758105] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-17T17:47:24.799540] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T17:47:25.558068] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-17T17:47:25.869626] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-17T17:47:25.931867] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T17:47:26.358151] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-17T17:47:27.158084] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-17T17:47:27.238792] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:47:27.958080] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-17T17:47:28.321104] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T17:47:28.459269] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-17T17:47:28.758074] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-17T17:47:29.564043] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-17T17:47:29.578025] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T17:47:29.747064] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T17:47:29.750824] [INFO ] [REMOTE ] BTCM: Full fetch complete (20327 records). [2025-10-17T17:47:29.750934] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-17T17:47:30.116118] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-17T17:47:30.116195] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-17T17:47:30.116578] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-17T17:47:30.116620] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-17T17:47:30.117363] [DEBUG] [LOCAL ] BTCM: Trimmed 20327 records to 17289 (keeping 200 days of data) [2025-10-17T17:47:30.212121] [DEBUG] [LOCAL ] BTCM: Primary data saved (17289 records). [2025-10-17T17:47:30.212269] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-17T17:47:30.212353] [INFO ] [MAIN ] Update Progress: 347/2368 symbols completed. BTCM took 29.2s. Estimated remaining: 4h 36m 17s. Rate: 7.3 symbols/min [2025-10-17T17:47:30.377824] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-17T17:47:30.382485] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:30.393351] [DEBUG] [LOCAL ] BTO: Loaded 8975 existing records from primary storage. [2025-10-17T17:47:30.393578] [INFO ] [MAIN ] BTO: Loaded 8975 existing records. [2025-10-17T17:47:30.566549] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:47:30.566787] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-17T17:47:30.566838] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-17T17:47:30.567010] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-17T17:47:30.567065] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-17T17:47:30.984975] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:31.158002] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-17T17:47:31.581727] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-17T17:47:31.958063] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-17T17:47:32.544008] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-17T17:47:32.551509] [INFO ] [REMOTE ] BSX: Full fetch complete (77856 records). [2025-10-17T17:47:32.551638] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-17T17:47:32.758499] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-17T17:47:32.955729] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-17T17:47:32.955839] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-17T17:47:32.956759] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-17T17:47:32.956842] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-17T17:47:32.988428] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T17:47:32.986759] [DEBUG] [LOCAL ] BSX: Trimmed 77856 records to 54468 (keeping 200 days of data) [2025-10-17T17:47:33.319673] [DEBUG] [LOCAL ] BSX: Primary data saved (54468 records). [2025-10-17T17:47:33.319814] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-17T17:47:33.319894] [INFO ] [MAIN ] Update Progress: 348/2368 symbols completed. BSX took 48.9s. Estimated remaining: 4h 35m 40s. Rate: 7.3 symbols/min [2025-10-17T17:47:33.494505] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:33.494683] [DEBUG] [LOCAL ] BTT: No existing data file found in primary storage. [2025-10-17T17:47:33.494736] [WARN ] [MAIN ] BTT: No existing data found, performing full refresh instead. [2025-10-17T17:47:33.494847] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-17T17:47:33.494889] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-17T17:47:33.494933] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-17T17:47:33.494965] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-17T17:47:33.558607] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-17T17:47:33.769842] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T17:47:33.870484] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:33.931144] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T17:47:34.358034] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-17T17:47:35.141055] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T17:47:35.157982] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-17T17:47:35.331895] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T17:47:35.958065] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-17T17:47:35.972807] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T17:47:36.065798] [DEBUG] [REMOTE ] BTE: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-17T17:47:36.066120] [WARN ] [REMOTE ] BTE: No data returned for month 2025-09 [2025-10-17T17:47:36.066211] [FATAL] [REMOTE ] BTE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:47:36.066313] [FATAL] [MAIN ] BTE: Failed to fetch primary data. [2025-10-17T17:47:36.066380] [WARN ] [MAIN ] BTE: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:47:36.066454] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-17T17:47:36.066519] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-10-17T17:47:36.066555] [INFO ] [LOCAL ] BTE: Starting deletion of derivative data. [2025-10-17T17:47:36.066773] [DEBUG] [LOCAL ] BTE: Deleted derivative data file. [2025-10-17T17:47:36.067232] [INFO ] [MAIN ] Update Progress: 349/2368 symbols completed. BTE took 33.8s. Estimated remaining: 4h 34m 60s. Rate: 7.3 symbols/min [2025-10-17T17:47:36.231913] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:36.287252] [DEBUG] [LOCAL ] BTU: Loaded 53714 existing records from primary storage. [2025-10-17T17:47:36.287773] [INFO ] [MAIN ] BTU: Loaded 53714 existing records. [2025-10-17T17:47:36.473961] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:47:36.474353] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-17T17:47:36.474481] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-17T17:47:36.475211] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-17T17:47:36.475290] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-17T17:47:36.763209] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-17T17:47:36.890910] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:37.558021] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-17T17:47:38.344579] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T17:47:38.357984] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-17T17:47:39.158003] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-17T17:47:39.197630] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-17T17:47:39.231591] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-17T17:47:39.958029] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-17T17:47:40.701735] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T17:47:40.758009] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-17T17:47:40.849122] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T17:47:41.558037] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-17T17:47:41.575076] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T17:47:42.358033] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-17T17:47:43.158042] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-17T17:47:43.469611] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-17T17:47:43.957994] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-17T17:47:44.466362] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-17T17:47:44.487841] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T17:47:44.758018] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-17T17:47:45.533030] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T17:47:45.558003] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-17T17:47:46.358036] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-17T17:47:46.488614] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T17:47:46.747825] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T17:47:47.158041] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-17T17:47:47.958010] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-17T17:47:48.055629] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T17:47:48.238317] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T17:47:48.758038] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-17T17:47:49.558020] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-17T17:47:49.647886] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T17:47:50.169523] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-17T17:47:50.177527] [INFO ] [REMOTE ] BTI: Full fetch complete (77637 records). [2025-10-17T17:47:50.177766] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-17T17:47:50.359360] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-17T17:47:50.586720] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-17T17:47:50.586819] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-17T17:47:50.587722] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-17T17:47:50.587794] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-17T17:47:50.589310] [DEBUG] [LOCAL ] BTI: Trimmed 77637 records to 54375 (keeping 200 days of data) [2025-10-17T17:47:50.920007] [DEBUG] [LOCAL ] BTI: Primary data saved (54375 records). [2025-10-17T17:47:50.920138] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-17T17:47:50.920722] [INFO ] [MAIN ] Update Progress: 350/2368 symbols completed. BTI took 39.5s. Estimated remaining: 4h 35m 30s. Rate: 7.3 symbols/min [2025-10-17T17:47:51.088099] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:51.088323] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-17T17:47:51.088422] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-17T17:47:51.088573] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-17T17:47:51.088780] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-17T17:47:51.088892] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-17T17:47:51.088988] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-17T17:47:51.163272] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-17T17:47:51.447427] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:51.476777] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T17:47:51.497340] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T17:47:51.960184] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T17:47:51.959328] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-17T17:47:52.157915] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:47:52.158172] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-17T17:47:52.158258] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:47:52.158304] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-17T17:47:52.158336] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:47:52.158384] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-17T17:47:52.158434] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-17T17:47:52.158478] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-17T17:47:52.158516] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-17T17:47:52.158560] [INFO ] [MAIN ] Update Progress: 351/2368 symbols completed. BTX took 1.2s. Estimated remaining: 4h 34m 42s. Rate: 7.3 symbols/min [2025-10-17T17:47:52.325404] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:52.353661] [DEBUG] [LOCAL ] BTZ: Loaded 22717 existing records from primary storage. [2025-10-17T17:47:52.353972] [INFO ] [MAIN ] BTZ: Loaded 22717 existing records. [2025-10-17T17:47:52.527200] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:47:52.527405] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-17T17:47:52.527475] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-17T17:47:52.527777] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-17T17:47:52.527841] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-17T17:47:52.763250] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-17T17:47:52.883485] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:53.558065] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-17T17:47:54.358076] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-17T17:47:54.738171] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T17:47:55.121572] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T17:47:55.157980] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-17T17:47:55.255245] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-17T17:47:55.952828] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T17:47:55.954789] [INFO ] [REMOTE ] BTO: Full fetch complete (13317 records). [2025-10-17T17:47:55.954880] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-17T17:47:55.966108] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-17T17:47:56.331414] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-17T17:47:56.331833] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-17T17:47:56.332365] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-17T17:47:56.332414] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-17T17:47:56.333320] [DEBUG] [LOCAL ] BTO: Trimmed 13317 records to 9046 (keeping 200 days of data) [2025-10-17T17:47:56.393032] [DEBUG] [LOCAL ] BTO: Primary data saved (9046 records). [2025-10-17T17:47:56.393298] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-17T17:47:56.393445] [INFO ] [MAIN ] Update Progress: 352/2368 symbols completed. BTO took 26.2s. Estimated remaining: 4h 34m 11s. Rate: 7.4 symbols/min [2025-10-17T17:47:56.578001] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:47:56.639255] [DEBUG] [LOCAL ] BUD: Loaded 52981 existing records from primary storage. [2025-10-17T17:47:56.639722] [INFO ] [MAIN ] BUD: Loaded 52981 existing records. [2025-10-17T17:47:56.763312] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-17T17:47:56.831921] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:47:56.832237] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-17T17:47:56.832291] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-17T17:47:56.832746] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-17T17:47:56.832806] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-17T17:47:57.214815] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:47:57.344330] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T17:47:57.558086] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-17T17:47:57.771764] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-17T17:47:58.358031] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-17T17:47:59.158097] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-17T17:47:59.343286] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T17:47:59.645752] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-17T17:47:59.963426] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-17T17:47:59.971738] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T17:48:00.758032] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-17T17:48:00.917685] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-17T17:48:01.558034] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-17T17:48:02.222567] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T17:48:02.358084] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-17T17:48:03.158116] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-17T17:48:03.438044] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T17:48:03.500146] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T17:48:03.958065] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-17T17:48:04.069123] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T17:48:04.758029] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-17T17:48:05.558057] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-17T17:48:05.936707] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-17T17:48:06.358062] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-17T17:48:06.592014] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T17:48:06.776190] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T17:48:07.158058] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-17T17:48:07.958020] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-17T17:48:08.320416] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-17T17:48:08.758052] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-17T17:48:09.042177] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T17:48:09.196746] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-17T17:48:09.558035] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-17T17:48:09.922763] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T17:48:10.358165] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-17T17:48:11.156084] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T17:48:11.158030] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-17T17:48:11.159158] [INFO ] [REMOTE ] BTT: Full fetch complete (22582 records). [2025-10-17T17:48:11.159240] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-17T17:48:11.159797] [FATAL] [VALIDATOR ] BTT: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:48:11.159879] [FATAL] [MAIN ] BTT: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:48:11.160013] [WARN ] [MAIN ] BTT: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:48:11.160126] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-17T17:48:11.160199] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-17T17:48:11.160248] [INFO ] [LOCAL ] BTT: Starting deletion of derivative data. [2025-10-17T17:48:11.160315] [DEBUG] [LOCAL ] BTT: No derivative data file found to delete. [2025-10-17T17:48:11.160384] [INFO ] [MAIN ] Update Progress: 353/2368 symbols completed. BTT took 37.8s. Estimated remaining: 4h 34m 41s. Rate: 7.3 symbols/min [2025-10-17T17:48:11.339684] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:48:11.353425] [DEBUG] [LOCAL ] BUI: Loaded 12010 existing records from primary storage. [2025-10-17T17:48:11.353729] [INFO ] [MAIN ] BUI: Loaded 12010 existing records. [2025-10-17T17:48:11.556770] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:48:11.557044] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-17T17:48:11.557179] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-17T17:48:11.557425] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-17T17:48:11.557586] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-17T17:48:11.715859] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-17T17:48:11.951741] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:48:11.957985] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-17T17:48:12.204684] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T17:48:12.758009] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-17T17:48:12.940561] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T17:48:13.558042] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-17T17:48:14.357055] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-17T17:48:14.359907] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-17T17:48:14.660561] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T17:48:15.158003] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-17T17:48:15.467278] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T17:48:15.958040] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-17T17:48:16.758060] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-17T17:48:16.834916] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T17:48:16.870157] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T17:48:17.558062] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-17T17:48:18.309093] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T17:48:18.357982] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-17T17:48:18.804135] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T17:48:19.158004] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-17T17:48:19.360436] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-17T17:48:19.958083] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-17T17:48:20.758048] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-17T17:48:20.815524] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-17T17:48:20.864128] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T17:48:21.558037] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-17T17:48:21.887633] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T17:48:22.358028] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-17T17:48:23.157996] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-17T17:48:23.447071] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T17:48:23.532694] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T17:48:23.536722] [INFO ] [REMOTE ] BTZ: Full fetch complete (33286 records). [2025-10-17T17:48:23.536905] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-17T17:48:23.923385] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-17T17:48:23.921084] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T17:48:23.924684] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-17T17:48:23.927251] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-17T17:48:23.927731] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-17T17:48:23.929270] [DEBUG] [LOCAL ] BTZ: Trimmed 33286 records to 22828 (keeping 200 days of data) [2025-10-17T17:48:23.979383] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-17T17:48:24.074155] [DEBUG] [LOCAL ] BTZ: Primary data saved (22828 records). [2025-10-17T17:48:24.074353] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-17T17:48:24.074511] [INFO ] [MAIN ] Update Progress: 354/2368 symbols completed. BTZ took 31.9s. Estimated remaining: 4h 34m 60s. Rate: 7.3 symbols/min [2025-10-17T17:48:24.244007] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:48:24.291026] [DEBUG] [LOCAL ] BUR: Loaded 45717 existing records from primary storage. [2025-10-17T17:48:24.291333] [INFO ] [MAIN ] BUR: Loaded 45717 existing records. [2025-10-17T17:48:24.467663] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:48:24.467901] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-17T17:48:24.467951] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-17T17:48:24.468292] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-17T17:48:24.468346] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-17T17:48:24.763385] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-17T17:48:24.861625] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:48:25.558006] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-17T17:48:26.065788] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-17T17:48:26.358066] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-17T17:48:26.367845] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T17:48:26.797022] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T17:48:26.804516] [INFO ] [REMOTE ] BTU: Full fetch complete (77273 records). [2025-10-17T17:48:26.804688] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-17T17:48:27.178570] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-17T17:48:27.204195] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-17T17:48:27.204290] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-17T17:48:27.205288] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-17T17:48:27.205357] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-17T17:48:27.207004] [DEBUG] [LOCAL ] BTU: Trimmed 77273 records to 54104 (keeping 200 days of data) [2025-10-17T17:48:27.543796] [DEBUG] [LOCAL ] BTU: Primary data saved (54104 records). [2025-10-17T17:48:27.543974] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-17T17:48:27.544550] [INFO ] [MAIN ] Update Progress: 355/2368 symbols completed. BTU took 51.5s. Estimated remaining: 4h 34m 25s. Rate: 7.3 symbols/min [2025-10-17T17:48:27.716963] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:48:27.760525] [DEBUG] [LOCAL ] BURL: Loaded 46016 existing records from primary storage. [2025-10-17T17:48:27.760871] [INFO ] [MAIN ] BURL: Loaded 46016 existing records. [2025-10-17T17:48:27.937480] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:48:27.937813] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-17T17:48:27.937901] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-17T17:48:27.938188] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-17T17:48:27.938247] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-17T17:48:27.970718] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-17T17:48:28.347910] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:48:28.351245] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T17:48:28.758126] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-17T17:48:28.792358] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T17:48:28.890395] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-17T17:48:29.558096] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-17T17:48:30.358066] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-17T17:48:30.626035] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T17:48:30.633524] [INFO ] [REMOTE ] BUD: Full fetch complete (76494 records). [2025-10-17T17:48:30.633737] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-17T17:48:31.035324] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-17T17:48:31.035526] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-17T17:48:31.036474] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-17T17:48:31.036540] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-17T17:48:31.038060] [DEBUG] [LOCAL ] BUD: Trimmed 76494 records to 53369 (keeping 200 days of data) [2025-10-17T17:48:31.164400] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-17T17:48:31.178027] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-17T17:48:31.196420] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T17:48:31.408694] [DEBUG] [LOCAL ] BUD: Primary data saved (53369 records). [2025-10-17T17:48:31.408832] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-17T17:48:31.408914] [INFO ] [MAIN ] Update Progress: 356/2368 symbols completed. BUD took 35.0s. Estimated remaining: 4h 33m 52s. Rate: 7.3 symbols/min [2025-10-17T17:48:31.608668] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:48:31.624133] [DEBUG] [LOCAL ] BUXX: Loaded 15455 existing records from primary storage. [2025-10-17T17:48:31.624324] [INFO ] [MAIN ] BUXX: Loaded 15455 existing records. [2025-10-17T17:48:31.800443] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:48:31.800733] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-17T17:48:31.800790] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-17T17:48:31.801038] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-17T17:48:31.801094] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-17T17:48:31.969377] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-17T17:48:32.148192] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:48:32.758049] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-17T17:48:32.966586] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T17:48:33.328677] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-17T17:48:33.371468] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T17:48:33.558038] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-17T17:48:34.304212] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T17:48:34.357991] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-17T17:48:35.108121] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T17:48:35.158050] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-17T17:48:35.958097] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-17T17:48:36.130542] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T17:48:36.758082] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-17T17:48:37.008131] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T17:48:37.558033] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-17T17:48:38.346370] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T17:48:38.357975] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-17T17:48:38.587017] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T17:48:39.158022] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-17T17:48:39.963207] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-17T17:48:39.985755] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T17:48:40.720614] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T17:48:40.757985] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-17T17:48:40.991968] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T17:48:41.558000] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-17T17:48:41.745454] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T17:48:41.747867] [INFO ] [REMOTE ] BUI: Full fetch complete (16687 records). [2025-10-17T17:48:41.747960] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-17T17:48:42.129150] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-17T17:48:42.129237] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-17T17:48:42.129623] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-17T17:48:42.129708] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-17T17:48:42.130601] [DEBUG] [LOCAL ] BUI: Trimmed 16687 records to 12102 (keeping 200 days of data) [2025-10-17T17:48:42.210431] [DEBUG] [LOCAL ] BUI: Primary data saved (12102 records). [2025-10-17T17:48:42.210550] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-17T17:48:42.210635] [INFO ] [MAIN ] Update Progress: 357/2368 symbols completed. BUI took 31.1s. Estimated remaining: 4h 33m 59s. Rate: 7.3 symbols/min [2025-10-17T17:48:42.358060] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-17T17:48:43.158051] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-17T17:48:43.196437] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T17:48:43.289784] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T17:48:43.958078] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-17T17:48:44.660417] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:48:44.757999] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-17T17:48:45.558000] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-17T17:48:45.750445] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T17:48:46.307116] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T17:48:46.358019] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-17T17:48:46.646453] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T17:48:47.158058] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-17T17:48:47.958083] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-17T17:48:48.060464] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T17:48:48.549497] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-17T17:48:48.758021] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-17T17:48:48.828846] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T17:48:49.558031] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-17T17:48:50.358004] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-17T17:48:50.698837] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-17T17:48:51.158020] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-17T17:48:51.174618] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T17:48:51.348708] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T17:48:51.958043] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-17T17:48:52.691286] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T17:48:52.758054] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-17T17:48:53.189370] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-17T17:48:53.558046] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-17T17:48:54.358078] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-17T17:48:54.425104] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T17:48:55.158107] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-17T17:48:55.271580] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-17T17:48:55.274555] [INFO ] [REMOTE ] BUXX: Full fetch complete (20651 records). [2025-10-17T17:48:55.274720] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-17T17:48:55.440922] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T17:48:55.490401] [INFO ] [REMOTE ] BUR: Full fetch complete (64260 records). [2025-10-17T17:48:55.516633] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-17T17:48:56.217571] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-17T17:48:56.223388] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-17T17:48:56.223879] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-17T17:48:56.223957] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-17T17:48:56.261343] [DEBUG] [LOCAL ] BUXX: Trimmed 20651 records to 15594 (keeping 200 days of data) [2025-10-17T17:48:56.448844] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-17T17:48:56.452595] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-17T17:48:56.462885] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-17T17:48:56.465418] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-17T17:48:56.470713] [DEBUG] [LOCAL ] BUR: Trimmed 64260 records to 46071 (keeping 200 days of data) [2025-10-17T17:48:56.477266] [DEBUG] [LOCAL ] BUXX: Primary data saved (15594 records). [2025-10-17T17:48:56.535420] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-17T17:48:56.562162] [INFO ] [MAIN ] Update Progress: 358/2368 symbols completed. BUXX took 25.2s. Estimated remaining: 4h 34m 25s. Rate: 7.3 symbols/min [2025-10-17T17:48:56.753565] [DEBUG] [LOCAL ] BUR: Primary data saved (46071 records). [2025-10-17T17:48:56.753830] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-17T17:48:56.754436] [INFO ] [MAIN ] Update Progress: 359/2368 symbols completed. BUR took 32.7s. Estimated remaining: 4h 33m 32s. Rate: 7.3 symbols/min [2025-10-17T17:48:56.783410] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T17:48:56.793894] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-17T17:48:58.480465] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T17:48:58.490269] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-17T17:49:00.100156] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T17:49:00.106173] [INFO ] [REMOTE ] BURL: Full fetch complete (65841 records). [2025-10-17T17:49:00.106275] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-17T17:49:00.498007] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-17T17:49:00.498094] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-17T17:49:00.498906] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-17T17:49:00.498974] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-17T17:49:00.500376] [DEBUG] [LOCAL ] BURL: Trimmed 65841 records to 46304 (keeping 200 days of data) [2025-10-17T17:49:00.791719] [DEBUG] [LOCAL ] BURL: Primary data saved (46304 records). [2025-10-17T17:49:00.791857] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-17T17:49:00.792375] [INFO ] [MAIN ] Update Progress: 360/2368 symbols completed. BURL took 33.2s. Estimated remaining: 4h 33m 1s. Rate: 7.4 symbols/min [2025-10-17T17:49:01.357085] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:01.464441] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:01.480251] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:01.499204] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:01.568130] [DEBUG] [LOCAL ] BV: Loaded 38827 existing records from primary storage. [2025-10-17T17:49:01.579025] [INFO ] [MAIN ] BV: Loaded 38827 existing records. [2025-10-17T17:49:01.617164] [DEBUG] [LOCAL ] BW: Loaded 40868 existing records from primary storage. [2025-10-17T17:49:01.658308] [INFO ] [MAIN ] BW: Loaded 40868 existing records. [2025-10-17T17:49:01.701568] [DEBUG] [LOCAL ] BWA: Loaded 52519 existing records from primary storage. [2025-10-17T17:49:01.740755] [DEBUG] [LOCAL ] BVN: Loaded 44679 existing records from primary storage. [2025-10-17T17:49:01.756531] [INFO ] [MAIN ] BWA: Loaded 52519 existing records. [2025-10-17T17:49:01.759170] [INFO ] [MAIN ] BVN: Loaded 44679 existing records. [2025-10-17T17:49:02.066455] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:02.233731] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:02.234072] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-17T17:49:02.280275] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-17T17:49:02.285586] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:02.280205] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-17T17:49:02.303373] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-17T17:49:02.313424] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-17T17:49:02.313540] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-17T17:49:02.340376] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-17T17:49:02.340438] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-17T17:49:02.340499] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-17T17:49:02.340870] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-17T17:49:02.340719] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-17T17:49:02.343787] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:02.396005] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-17T17:49:02.384949] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-17T17:49:02.410500] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-17T17:49:02.469429] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-17T17:49:02.489206] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-17T17:49:03.552043] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:03.604540] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-17T17:49:03.749455] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:03.784532] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:03.784835] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-17T17:49:03.800212] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-17T17:49:03.806349] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:03.807312] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-17T17:49:05.300988] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:49:05.307902] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-17T17:49:05.507349] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T17:49:05.516915] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-17T17:49:05.594871] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T17:49:05.604452] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-17T17:49:05.793370] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T17:49:05.804169] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-17T17:49:06.575885] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T17:49:06.582747] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-17T17:49:06.673704] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T17:49:06.683265] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-17T17:49:07.098898] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T17:49:07.107295] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-17T17:49:07.145135] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T17:49:07.155482] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-17T17:49:07.879438] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T17:49:07.891050] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-17T17:49:08.062115] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T17:49:08.070038] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-17T17:49:08.621508] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T17:49:08.763200] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-17T17:49:08.796388] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T17:49:09.370163] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T17:49:09.558038] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-17T17:49:09.632415] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T17:49:09.977479] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T17:49:10.358035] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-17T17:49:10.990792] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T17:49:11.158048] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-17T17:49:11.957250] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-17T17:49:11.966585] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-17T17:49:12.758013] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-17T17:49:13.081016] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T17:49:13.472295] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T17:49:13.558007] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-17T17:49:13.895191] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T17:49:14.358053] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-17T17:49:15.100183] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T17:49:15.157991] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-17T17:49:15.958022] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-17T17:49:16.302208] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T17:49:16.736176] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T17:49:16.758002] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-17T17:49:17.472411] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T17:49:17.557990] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-17T17:49:17.717416] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-17T17:49:18.358107] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-17T17:49:18.967497] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T17:49:19.158039] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-17T17:49:19.958034] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-17T17:49:20.002258] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T17:49:20.589255] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T17:49:20.758031] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-17T17:49:21.563239] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-17T17:49:21.579474] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T17:49:22.260067] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T17:49:22.357987] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-17T17:49:23.158013] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-17T17:49:23.255192] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T17:49:23.824265] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T17:49:23.958014] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-17T17:49:24.604702] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T17:49:24.758078] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-17T17:49:25.513341] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T17:49:25.557994] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-17T17:49:26.358117] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-17T17:49:26.516493] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T17:49:27.158044] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-17T17:49:27.548515] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-17T17:49:27.555320] [INFO ] [REMOTE ] BVN: Full fetch complete (63322 records). [2025-10-17T17:49:27.555436] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-17T17:49:27.937259] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-17T17:49:27.937333] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-17T17:49:27.938073] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-17T17:49:27.938137] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-17T17:49:27.939336] [DEBUG] [LOCAL ] BVN: Trimmed 63322 records to 45065 (keeping 200 days of data) [2025-10-17T17:49:27.987339] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-17T17:49:28.197770] [DEBUG] [LOCAL ] BVN: Primary data saved (45065 records). [2025-10-17T17:49:28.197919] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-17T17:49:28.198004] [INFO ] [MAIN ] Update Progress: 361/2368 symbols completed. BVN took 27.4s. Estimated remaining: 4h 34m 40s. Rate: 7.3 symbols/min [2025-10-17T17:49:28.379599] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:28.409395] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-17T17:49:28.430024] [DEBUG] [LOCAL ] BWG: Loaded 12662 existing records from primary storage. [2025-10-17T17:49:28.430268] [INFO ] [MAIN ] BWG: Loaded 12662 existing records. [2025-10-17T17:49:28.606279] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:28.606543] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-17T17:49:28.606594] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-17T17:49:28.606814] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-17T17:49:28.606876] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-17T17:49:28.763107] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-17T17:49:29.012431] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:29.035216] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T17:49:29.043226] [INFO ] [REMOTE ] BW: Full fetch complete (59467 records). [2025-10-17T17:49:29.043430] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-17T17:49:29.422922] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-17T17:49:29.423003] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-17T17:49:29.423865] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-17T17:49:29.423934] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-17T17:49:29.425165] [DEBUG] [LOCAL ] BW: Trimmed 59467 records to 41213 (keeping 200 days of data) [2025-10-17T17:49:29.581098] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-17T17:49:29.651072] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T17:49:29.658165] [INFO ] [REMOTE ] BV: Full fetch complete (54833 records). [2025-10-17T17:49:29.661424] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-17T17:49:29.804718] [DEBUG] [LOCAL ] BW: Primary data saved (41213 records). [2025-10-17T17:49:29.822392] [INFO ] [MAIN ] BW: Full history saved. [2025-10-17T17:49:29.842433] [INFO ] [MAIN ] Update Progress: 362/2368 symbols completed. BW took 29.0s. Estimated remaining: 4h 33m 55s. Rate: 7.3 symbols/min [2025-10-17T17:49:30.234342] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:30.272490] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-17T17:49:30.272556] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-17T17:49:30.273242] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-17T17:49:30.273357] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-17T17:49:30.274811] [DEBUG] [LOCAL ] BV: Trimmed 54833 records to 39100 (keeping 200 days of data) [2025-10-17T17:49:30.391037] [DEBUG] [LOCAL ] BWLP: Loaded 32486 existing records from primary storage. [2025-10-17T17:49:30.392595] [INFO ] [MAIN ] BWLP: Loaded 32486 existing records. [2025-10-17T17:49:30.528247] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T17:49:30.544243] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-17T17:49:30.677928] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:30.704261] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-17T17:49:30.704398] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-17T17:49:30.758122] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-17T17:49:30.758226] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-17T17:49:30.758895] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-17T17:49:30.927035] [DEBUG] [LOCAL ] BV: Primary data saved (39100 records). [2025-10-17T17:49:30.945560] [INFO ] [MAIN ] BV: Full history saved. [2025-10-17T17:49:30.947834] [INFO ] [MAIN ] Update Progress: 363/2368 symbols completed. BV took 30.2s. Estimated remaining: 4h 33m 8s. Rate: 7.3 symbols/min [2025-10-17T17:49:31.168292] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-17T17:49:31.300665] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:31.415096] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:31.416588] [DEBUG] [LOCAL ] BWMX: Loaded 7843 existing records from primary storage. [2025-10-17T17:49:31.417216] [INFO ] [MAIN ] BWMX: Loaded 7843 existing records. [2025-10-17T17:49:31.540218] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-17T17:49:31.633112] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:31.633440] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-17T17:49:31.633492] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-17T17:49:31.633836] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-17T17:49:31.633898] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-17T17:49:31.963252] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-17T17:49:32.026085] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:32.758041] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-17T17:49:33.018852] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T17:49:33.408249] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-17T17:49:33.558017] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-17T17:49:33.748388] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T17:49:34.358065] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-17T17:49:35.158069] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-17T17:49:35.176372] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-17T17:49:35.331039] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T17:49:35.958031] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-17T17:49:36.632345] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T17:49:36.758018] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-17T17:49:36.766243] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-17T17:49:37.558075] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-17T17:49:38.113812] [DEBUG] [REMOTE ] BWMX: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-17T17:49:38.114396] [WARN ] [REMOTE ] BWMX: No data returned for month 2025-01 [2025-10-17T17:49:38.114548] [FATAL] [REMOTE ] BWMX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:49:38.114769] [FATAL] [MAIN ] BWMX: Failed to fetch primary data. [2025-10-17T17:49:38.115004] [WARN ] [MAIN ] BWMX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:49:38.121828] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-17T17:49:38.132252] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-10-17T17:49:38.133572] [INFO ] [LOCAL ] BWMX: Starting deletion of derivative data. [2025-10-17T17:49:38.133454] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T17:49:38.140224] [DEBUG] [LOCAL ] BWMX: Deleted derivative data file. [2025-10-17T17:49:38.141114] [INFO ] [MAIN ] Update Progress: 364/2368 symbols completed. BWMX took 7.2s. Estimated remaining: 4h 32m 55s. Rate: 7.3 symbols/min [2025-10-17T17:49:38.305486] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:38.312051] [DEBUG] [LOCAL ] BWNB: Loaded 4220 existing records from primary storage. [2025-10-17T17:49:38.312227] [INFO ] [MAIN ] BWNB: Loaded 4220 existing records. [2025-10-17T17:49:38.363268] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-17T17:49:38.491795] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:38.492047] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-17T17:49:38.492103] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-17T17:49:38.492229] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-17T17:49:38.492341] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-17T17:49:38.851552] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:39.158035] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-17T17:49:39.254180] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-17T17:49:39.958027] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-17T17:49:40.585722] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-17T17:49:40.758031] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-17T17:49:41.019839] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-17T17:49:41.250771] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T17:49:41.558038] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-17T17:49:42.358081] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-17T17:49:43.158014] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-17T17:49:43.407373] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T17:49:43.415209] [INFO ] [REMOTE ] BWA: Full fetch complete (75921 records). [2025-10-17T17:49:43.415406] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-17T17:49:43.845926] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-17T17:49:43.846050] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-17T17:49:43.847158] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-17T17:49:43.847228] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-17T17:49:43.848921] [DEBUG] [LOCAL ] BWA: Trimmed 75921 records to 52901 (keeping 200 days of data) [2025-10-17T17:49:43.963139] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-17T17:49:43.989044] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T17:49:44.212947] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T17:49:44.237291] [DEBUG] [LOCAL ] BWA: Primary data saved (52901 records). [2025-10-17T17:49:44.237470] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-17T17:49:44.237577] [INFO ] [MAIN ] Update Progress: 365/2368 symbols completed. BWA took 43.4s. Estimated remaining: 4h 32m 35s. Rate: 7.3 symbols/min [2025-10-17T17:49:44.403813] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:49:44.410154] [DEBUG] [LOCAL ] BWSN: Loaded 5203 existing records from primary storage. [2025-10-17T17:49:44.410319] [INFO ] [MAIN ] BWSN: Loaded 5203 existing records. [2025-10-17T17:49:44.513183] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-17T17:49:44.590256] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:49:44.590480] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-17T17:49:44.590528] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-17T17:49:44.590762] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-17T17:49:44.590822] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-17T17:49:44.764329] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-17T17:49:44.939401] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:49:45.391572] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-17T17:49:45.558013] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-17T17:49:46.127922] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-17T17:49:46.358058] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-17T17:49:47.158240] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-17T17:49:47.204536] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T17:49:47.711814] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-17T17:49:47.958124] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-17T17:49:48.393065] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-17T17:49:48.758010] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-17T17:49:49.257471] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-17T17:49:49.558036] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-17T17:49:50.060269] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-17T17:49:50.358074] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-17T17:49:50.939132] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T17:49:51.158045] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-17T17:49:51.907009] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T17:49:51.958065] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-17T17:49:52.629924] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T17:49:52.758062] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-17T17:49:53.558080] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-17T17:49:53.571999] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T17:49:54.037490] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-17T17:49:54.358064] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-17T17:49:54.954357] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T17:49:55.158043] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-17T17:49:55.785258] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-17T17:49:55.958023] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-17T17:49:56.758012] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-17T17:49:56.975939] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-17T17:49:57.558051] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-17T17:49:58.333019] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T17:49:58.352492] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T17:49:58.359139] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-17T17:49:59.158028] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-17T17:49:59.266006] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T17:49:59.958065] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-17T17:50:00.478937] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-17T17:50:00.758063] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-17T17:50:00.793394] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T17:50:00.794913] [INFO ] [REMOTE ] BWSN: Full fetch complete (6346 records). [2025-10-17T17:50:00.795000] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-17T17:50:01.160275] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-17T17:50:01.160379] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-17T17:50:01.160624] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-17T17:50:01.160713] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-17T17:50:01.161146] [DEBUG] [LOCAL ] BWSN: Trimmed 6346 records to 5235 (keeping 200 days of data) [2025-10-17T17:50:01.194272] [DEBUG] [LOCAL ] BWSN: Primary data saved (5235 records). [2025-10-17T17:50:01.194395] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-17T17:50:01.194486] [INFO ] [MAIN ] Update Progress: 366/2368 symbols completed. BWSN took 17.0s. Estimated remaining: 4h 33m 15s. Rate: 7.3 symbols/min [2025-10-17T17:50:01.369075] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:50:01.413488] [DEBUG] [LOCAL ] BWXT: Loaded 47497 existing records from primary storage. [2025-10-17T17:50:01.413822] [INFO ] [MAIN ] BWXT: Loaded 47497 existing records. [2025-10-17T17:50:01.504322] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T17:50:01.563162] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-17T17:50:01.633470] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:50:01.633728] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-17T17:50:01.633787] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-17T17:50:01.634608] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-17T17:50:01.634695] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-17T17:50:02.019152] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:50:02.358092] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-17T17:50:03.158765] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-17T17:50:03.158676] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T17:50:03.958045] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-17T17:50:04.099627] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T17:50:04.164777] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T17:50:04.670631] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T17:50:04.758010] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-17T17:50:05.346261] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T17:50:05.557995] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-17T17:50:06.358096] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-17T17:50:06.891126] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-17T17:50:06.892280] [INFO ] [REMOTE ] BWNB: Full fetch complete (5588 records). [2025-10-17T17:50:06.892376] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-17T17:50:07.030434] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T17:50:07.163176] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-17T17:50:07.312457] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-17T17:50:07.312540] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-17T17:50:07.312725] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-17T17:50:07.312786] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-17T17:50:07.313178] [DEBUG] [LOCAL ] BWNB: Trimmed 5588 records to 4225 (keeping 200 days of data) [2025-10-17T17:50:07.338970] [DEBUG] [LOCAL ] BWNB: Primary data saved (4225 records). [2025-10-17T17:50:07.339090] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-17T17:50:07.339178] [INFO ] [MAIN ] Update Progress: 367/2368 symbols completed. BWNB took 29.2s. Estimated remaining: 4h 32m 56s. Rate: 7.3 symbols/min [2025-10-17T17:50:07.504302] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:50:07.557681] [DEBUG] [LOCAL ] BX: Loaded 53873 existing records from primary storage. [2025-10-17T17:50:07.558012] [INFO ] [MAIN ] BX: Loaded 53873 existing records. [2025-10-17T17:50:07.749356] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:50:07.749706] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-17T17:50:07.749796] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-17T17:50:07.750022] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-17T17:50:07.750092] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-17T17:50:07.964827] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-17T17:50:08.122807] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:50:08.758067] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-17T17:50:08.920415] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-17T17:50:09.001914] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T17:50:09.003538] [INFO ] [REMOTE ] BWG: Full fetch complete (17721 records). [2025-10-17T17:50:09.003608] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-17T17:50:09.004028] [FATAL] [VALIDATOR ] BWG: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:50:09.004111] [FATAL] [MAIN ] BWG: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:50:09.004154] [WARN ] [MAIN ] BWG: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:50:09.004220] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-17T17:50:09.004283] [DEBUG] [LOCAL ] BWG: No primary data file found to delete. [2025-10-17T17:50:09.004335] [INFO ] [LOCAL ] BWG: Starting deletion of derivative data. [2025-10-17T17:50:09.004491] [DEBUG] [LOCAL ] BWG: Deleted derivative data file. [2025-10-17T17:50:09.004612] [INFO ] [MAIN ] Update Progress: 368/2368 symbols completed. BWG took 40.8s. Estimated remaining: 4h 32m 12s. Rate: 7.3 symbols/min [2025-10-17T17:50:09.215492] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:50:09.232899] [DEBUG] [LOCAL ] BXC: Loaded 13714 existing records from primary storage. [2025-10-17T17:50:09.233188] [INFO ] [MAIN ] BXC: Loaded 13714 existing records. [2025-10-17T17:50:09.413950] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:50:09.414159] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-17T17:50:09.414207] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-17T17:50:09.414524] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-17T17:50:09.414581] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-17T17:50:09.562129] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-17T17:50:09.780142] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:50:10.358045] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-17T17:50:11.160938] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-17T17:50:11.164686] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T17:50:11.229107] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T17:50:11.958036] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-17T17:50:12.738737] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T17:50:12.758092] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-17T17:50:12.912720] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T17:50:13.366455] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (4.61 seconds). [2025-10-17T17:50:13.558040] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-17T17:50:14.174223] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T17:50:14.358043] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-17T17:50:15.141730] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T17:50:15.157988] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-17T17:50:15.511715] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-17T17:50:15.958071] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-17T17:50:16.010979] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T17:50:16.758084] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-17T17:50:17.558035] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-17T17:50:17.677942] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-17T17:50:18.358101] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-17T17:50:18.896457] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (2.94 seconds). [2025-10-17T17:50:18.901520] [INFO ] [REMOTE ] BWLP: Full fetch complete (47956 records). [2025-10-17T17:50:18.902354] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-17T17:50:19.166582] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-17T17:50:19.306869] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-17T17:50:19.306738] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-17T17:50:19.310505] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-17T17:50:19.311691] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-17T17:50:19.311889] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-17T17:50:19.313181] [DEBUG] [LOCAL ] BWLP: Trimmed 47956 records to 32641 (keeping 200 days of data) [2025-10-17T17:50:19.439334] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T17:50:19.543912] [DEBUG] [LOCAL ] BWLP: Primary data saved (32641 records). [2025-10-17T17:50:19.544049] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-17T17:50:19.544130] [INFO ] [MAIN ] Update Progress: 369/2368 symbols completed. BWLP took 49.7s. Estimated remaining: 4h 32m 17s. Rate: 7.3 symbols/min [2025-10-17T17:50:19.717029] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:50:19.760258] [DEBUG] [LOCAL ] BXMT: Loaded 47685 existing records from primary storage. [2025-10-17T17:50:19.760604] [INFO ] [MAIN ] BXMT: Loaded 47685 existing records. [2025-10-17T17:50:19.935754] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:50:19.935970] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-17T17:50:19.936042] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-17T17:50:19.936233] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-17T17:50:19.936286] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-17T17:50:19.966272] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-17T17:50:20.285462] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:50:20.758016] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-17T17:50:20.852577] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T17:50:21.036461] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T17:50:21.558077] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-17T17:50:22.358011] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-17T17:50:22.813860] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T17:50:23.158085] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-17T17:50:23.247257] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T17:50:23.915920] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T17:50:23.957990] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-17T17:50:24.031512] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T17:50:24.758039] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-17T17:50:24.863717] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T17:50:25.558079] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-17T17:50:26.358047] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-17T17:50:26.594201] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T17:50:27.158166] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-17T17:50:27.483443] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T17:50:27.958067] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-17T17:50:28.086143] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T17:50:28.651079] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T17:50:28.758033] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-17T17:50:29.558045] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-17T17:50:30.055573] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-17T17:50:30.358077] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-17T17:50:30.577239] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T17:50:30.991472] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T17:50:31.158057] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-17T17:50:31.174669] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T17:50:31.958085] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-17T17:50:32.758039] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-17T17:50:33.197800] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-17T17:50:33.558034] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-17T17:50:33.923749] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T17:50:34.358010] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-17T17:50:34.489272] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T17:50:34.522794] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T17:50:34.525242] [INFO ] [REMOTE ] BXC: Full fetch complete (18250 records). [2025-10-17T17:50:34.525316] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-17T17:50:34.904788] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-17T17:50:34.904875] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-17T17:50:34.905446] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-17T17:50:34.905486] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-17T17:50:34.906304] [DEBUG] [LOCAL ] BXC: Trimmed 18250 records to 13776 (keeping 200 days of data) [2025-10-17T17:50:34.985461] [DEBUG] [LOCAL ] BXC: Primary data saved (13776 records). [2025-10-17T17:50:34.985600] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-17T17:50:34.985704] [INFO ] [MAIN ] Update Progress: 370/2368 symbols completed. BXC took 26.0s. Estimated remaining: 4h 32m 48s. Rate: 7.3 symbols/min [2025-10-17T17:50:35.147834] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:50:35.158812] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-17T17:50:35.168727] [DEBUG] [LOCAL ] BXMX: Loaded 19610 existing records from primary storage. [2025-10-17T17:50:35.168948] [INFO ] [MAIN ] BXMX: Loaded 19610 existing records. [2025-10-17T17:50:35.352295] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:50:35.352532] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-17T17:50:35.352584] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-17T17:50:35.352856] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-17T17:50:35.352927] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-17T17:50:35.729411] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:50:35.958011] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-17T17:50:36.538376] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-17T17:50:36.655258] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T17:50:36.758035] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-17T17:50:37.120748] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T17:50:37.558041] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-17T17:50:38.358037] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-17T17:50:38.405511] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T17:50:39.158032] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-17T17:50:39.338739] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T17:50:39.958033] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-17T17:50:40.219959] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T17:50:40.423499] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-17T17:50:40.758105] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-17T17:50:41.558054] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-17T17:50:42.242919] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-17T17:50:42.250136] [INFO ] [REMOTE ] BWXT: Full fetch complete (67984 records). [2025-10-17T17:50:42.250300] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-17T17:50:42.359441] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-17T17:50:42.653134] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-17T17:50:42.653306] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-17T17:50:42.654151] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-17T17:50:42.654231] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-17T17:50:42.655698] [DEBUG] [LOCAL ] BWXT: Trimmed 67984 records to 47875 (keeping 200 days of data) [2025-10-17T17:50:42.902109] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-17T17:50:42.997775] [DEBUG] [LOCAL ] BWXT: Primary data saved (47875 records). [2025-10-17T17:50:42.998012] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-17T17:50:42.999000] [INFO ] [MAIN ] Update Progress: 371/2368 symbols completed. BWXT took 41.8s. Estimated remaining: 4h 32m 39s. Rate: 7.3 symbols/min [2025-10-17T17:50:43.130375] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T17:50:43.160416] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-17T17:50:43.213469] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:50:43.260669] [DEBUG] [LOCAL ] BXP: Loaded 50256 existing records from primary storage. [2025-10-17T17:50:43.261113] [INFO ] [MAIN ] BXP: Loaded 50256 existing records. [2025-10-17T17:50:43.443462] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:50:43.454450] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-17T17:50:43.455085] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-17T17:50:43.455603] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T17:50:43.459847] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-17T17:50:43.460352] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-17T17:50:43.832025] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:50:43.958036] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-17T17:50:44.758039] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-17T17:50:45.383582] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-17T17:50:45.391367] [INFO ] [REMOTE ] BX: Full fetch complete (77585 records). [2025-10-17T17:50:45.391509] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-17T17:50:45.563562] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-17T17:50:45.804547] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-17T17:50:45.805126] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-17T17:50:45.814519] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-17T17:50:45.831121] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-17T17:50:45.833691] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T17:50:45.850009] [DEBUG] [LOCAL ] BX: Trimmed 77585 records to 54263 (keeping 200 days of data) [2025-10-17T17:50:45.857459] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-17T17:50:46.198227] [DEBUG] [LOCAL ] BX: Primary data saved (54263 records). [2025-10-17T17:50:46.198409] [INFO ] [MAIN ] BX: Full history saved. [2025-10-17T17:50:46.198495] [INFO ] [MAIN ] Update Progress: 372/2368 symbols completed. BX took 38.9s. Estimated remaining: 4h 32m 4s. Rate: 7.3 symbols/min [2025-10-17T17:50:46.368112] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:50:46.364732] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-17T17:50:46.411225] [DEBUG] [LOCAL ] BXSL: Loaded 48504 existing records from primary storage. [2025-10-17T17:50:46.411526] [INFO ] [MAIN ] BXSL: Loaded 48504 existing records. [2025-10-17T17:50:46.586865] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:50:46.587089] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-17T17:50:46.587138] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-17T17:50:46.587333] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-17T17:50:46.587391] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-17T17:50:46.955970] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:50:47.158013] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-17T17:50:47.210126] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T17:50:47.629509] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T17:50:47.958068] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-17T17:50:48.758034] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-17T17:50:48.984205] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T17:50:49.491157] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T17:50:49.558021] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-17T17:50:50.341665] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T17:50:50.358011] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-17T17:50:51.158026] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-17T17:50:51.253188] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T17:50:51.352357] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-17T17:50:51.958053] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-17T17:50:52.541025] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T17:50:52.758039] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-17T17:50:53.558040] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-17T17:50:53.633606] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T17:50:54.358091] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-17T17:50:54.537927] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T17:50:54.547886] [INFO ] [REMOTE ] BXMT: Full fetch complete (69934 records). [2025-10-17T17:50:54.548040] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-17T17:50:54.937029] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-17T17:50:54.937115] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-17T17:50:54.937980] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-17T17:50:54.938047] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-17T17:50:54.939454] [DEBUG] [LOCAL ] BXMT: Trimmed 69934 records to 48048 (keeping 200 days of data) [2025-10-17T17:50:55.160224] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-17T17:50:55.246118] [DEBUG] [LOCAL ] BXMT: Primary data saved (48048 records). [2025-10-17T17:50:55.246263] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-17T17:50:55.247193] [INFO ] [MAIN ] Update Progress: 373/2368 symbols completed. BXMT took 35.7s. Estimated remaining: 4h 32m 0s. Rate: 7.3 symbols/min [2025-10-17T17:50:55.430588] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:50:55.463668] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T17:50:55.489398] [DEBUG] [LOCAL ] BY: Loaded 21987 existing records from primary storage. [2025-10-17T17:50:55.489683] [INFO ] [MAIN ] BY: Loaded 21987 existing records. [2025-10-17T17:50:55.668804] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:50:55.669170] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-17T17:50:55.669301] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-17T17:50:55.669949] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-17T17:50:55.670008] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-17T17:50:55.963107] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-17T17:50:55.965892] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T17:50:56.083870] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:50:56.085353] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T17:50:56.758027] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-17T17:50:57.558015] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-17T17:50:57.717669] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T17:50:57.746235] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T17:50:58.358055] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-17T17:50:59.158006] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-17T17:50:59.228100] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T17:50:59.393769] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T17:50:59.877492] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-17T17:50:59.958075] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-17T17:51:00.758037] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-17T17:51:01.230723] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T17:51:01.558061] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-17T17:51:02.097155] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-17T17:51:02.358070] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-17T17:51:02.456110] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-17T17:51:03.158037] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-17T17:51:03.958074] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-17T17:51:04.090615] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T17:51:04.758063] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-17T17:51:04.962485] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T17:51:05.004010] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T17:51:05.558024] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-17T17:51:05.779141] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T17:51:06.358037] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-17T17:51:07.038084] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T17:51:07.158052] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-17T17:51:07.637907] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T17:51:07.958103] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-17T17:51:08.709632] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T17:51:08.758070] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-17T17:51:08.840026] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-17T17:51:09.558044] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-17T17:51:10.358055] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-17T17:51:10.542665] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T17:51:11.158060] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-17T17:51:11.209560] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T17:51:11.540206] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T17:51:11.958109] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-17T17:51:12.532321] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T17:51:12.535774] [INFO ] [REMOTE ] BXMX: Full fetch complete (28707 records). [2025-10-17T17:51:12.535880] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-17T17:51:12.763234] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-17T17:51:12.923897] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-17T17:51:12.923981] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-17T17:51:12.924419] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-17T17:51:12.924462] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-17T17:51:12.925292] [DEBUG] [LOCAL ] BXMX: Trimmed 28707 records to 19717 (keeping 200 days of data) [2025-10-17T17:51:13.044307] [DEBUG] [LOCAL ] BXMX: Primary data saved (19717 records). [2025-10-17T17:51:13.044459] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-17T17:51:13.044544] [INFO ] [MAIN ] Update Progress: 374/2368 symbols completed. BXMX took 38.1s. Estimated remaining: 4h 32m 43s. Rate: 7.3 symbols/min [2025-10-17T17:51:13.212883] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:51:13.252444] [DEBUG] [LOCAL ] BYD: Loaded 45233 existing records from primary storage. [2025-10-17T17:51:13.252794] [INFO ] [MAIN ] BYD: Loaded 45233 existing records. [2025-10-17T17:51:13.437487] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:51:13.437770] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-17T17:51:13.437823] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-17T17:51:13.438879] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-17T17:51:13.438937] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-17T17:51:13.559200] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-17T17:51:13.822219] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:51:13.862546] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T17:51:13.918714] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-17T17:51:14.358083] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-17T17:51:15.158040] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-17T17:51:15.420671] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-17T17:51:15.421348] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T17:51:15.958044] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-17T17:51:16.578674] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T17:51:16.758031] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-17T17:51:17.033674] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T17:51:17.557997] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-17T17:51:18.358038] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-17T17:51:18.509941] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T17:51:19.158023] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-17T17:51:19.315912] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T17:51:19.325870] [INFO ] [REMOTE ] BXP: Full fetch complete (72218 records). [2025-10-17T17:51:19.326066] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-17T17:51:19.760914] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-17T17:51:19.761010] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-17T17:51:19.761872] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-17T17:51:19.761939] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-17T17:51:19.763452] [DEBUG] [LOCAL ] BXP: Trimmed 72218 records to 50594 (keeping 200 days of data) [2025-10-17T17:51:19.963134] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-17T17:51:20.120032] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T17:51:20.147449] [DEBUG] [LOCAL ] BXP: Primary data saved (50594 records). [2025-10-17T17:51:20.147664] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-17T17:51:20.147795] [INFO ] [MAIN ] Update Progress: 375/2368 symbols completed. BXP took 37.1s. Estimated remaining: 4h 32m 29s. Rate: 7.3 symbols/min [2025-10-17T17:51:20.352806] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:51:20.365728] [DEBUG] [LOCAL ] BYM: Loaded 11798 existing records from primary storage. [2025-10-17T17:51:20.365973] [INFO ] [MAIN ] BYM: Loaded 11798 existing records. [2025-10-17T17:51:20.566331] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:51:20.566557] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-17T17:51:20.566607] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-17T17:51:20.566951] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-17T17:51:20.567010] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-17T17:51:20.772431] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-17T17:51:20.991095] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:51:21.145923] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T17:51:21.149481] [INFO ] [REMOTE ] BY: Full fetch complete (29758 records). [2025-10-17T17:51:21.149605] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-17T17:51:21.316896] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-17T17:51:21.414567] [INFO ] [REMOTE ] BXSL: Full fetch complete (69985 records). [2025-10-17T17:51:21.455807] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-17T17:51:21.563050] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-17T17:51:21.734754] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-17T17:51:21.743417] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-17T17:51:21.760166] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-17T17:51:21.765091] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-17T17:51:21.877122] [DEBUG] [LOCAL ] BY: Trimmed 29758 records to 22175 (keeping 200 days of data) [2025-10-17T17:51:22.080991] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-17T17:51:22.083522] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-17T17:51:22.084710] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-17T17:51:22.085039] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-17T17:51:22.091149] [DEBUG] [LOCAL ] BXSL: Trimmed 69985 records to 48894 (keeping 200 days of data) [2025-10-17T17:51:22.209892] [DEBUG] [LOCAL ] BY: Primary data saved (22175 records). [2025-10-17T17:51:22.211458] [INFO ] [MAIN ] BY: Full history saved. [2025-10-17T17:51:22.212189] [INFO ] [MAIN ] Update Progress: 376/2368 symbols completed. BY took 27.0s. Estimated remaining: 4h 31m 48s. Rate: 7.3 symbols/min [2025-10-17T17:51:22.390833] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:51:22.424633] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T17:51:22.435916] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-17T17:51:22.536548] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-17T17:51:22.586980] [DEBUG] [LOCAL ] BZH: Loaded 32633 existing records from primary storage. [2025-10-17T17:51:22.602444] [INFO ] [MAIN ] BZH: Loaded 32633 existing records. [2025-10-17T17:51:22.793535] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:51:22.794844] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-17T17:51:22.795441] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-17T17:51:22.796384] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-17T17:51:22.796701] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-17T17:51:23.129745] [DEBUG] [LOCAL ] BXSL: Primary data saved (48894 records). [2025-10-17T17:51:23.140576] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-17T17:51:23.151303] [INFO ] [MAIN ] Update Progress: 377/2368 symbols completed. BXSL took 37.0s. Estimated remaining: 4h 31m 2s. Rate: 7.3 symbols/min [2025-10-17T17:51:23.161886] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-17T17:51:23.301535] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:51:23.416044] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:51:23.468568] [DEBUG] [LOCAL ] C: Loaded 54130 existing records from primary storage. [2025-10-17T17:51:23.468976] [INFO ] [MAIN ] C: Loaded 54130 existing records. [2025-10-17T17:51:23.659619] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:51:23.659865] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-17T17:51:23.659914] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-17T17:51:23.660856] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-17T17:51:23.660916] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-17T17:51:23.996380] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-17T17:51:24.027685] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T17:51:24.092978] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T17:51:24.096563] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:51:24.758051] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-17T17:51:25.396584] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T17:51:25.558100] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-17T17:51:26.358070] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-17T17:51:26.846737] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-17T17:51:27.158070] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-17T17:51:27.281554] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T17:51:27.412203] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-17T17:51:27.626996] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T17:51:27.958083] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-17T17:51:28.758082] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-17T17:51:29.557999] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-17T17:51:29.778825] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T17:51:30.075969] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-17T17:51:30.358095] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-17T17:51:31.158004] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-17T17:51:31.513259] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T17:51:31.796483] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T17:51:31.958112] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-17T17:51:32.241033] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-17T17:51:32.758074] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-17T17:51:33.331169] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T17:51:33.558067] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-17T17:51:34.262792] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T17:51:34.358051] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-17T17:51:35.158084] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-17T17:51:35.672301] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-17T17:51:35.890501] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T17:51:35.958039] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-17T17:51:36.744401] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T17:51:36.757994] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-17T17:51:37.558035] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-17T17:51:37.609978] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T17:51:38.102874] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T17:51:38.358006] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-17T17:51:38.463056] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T17:51:39.158042] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-17T17:51:39.958028] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-17T17:51:39.978015] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T17:51:40.560618] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-17T17:51:40.757990] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-17T17:51:41.558039] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-17T17:51:41.593034] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T17:51:41.620899] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-17T17:51:42.358032] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-17T17:51:42.812890] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T17:51:43.112258] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T17:51:43.158059] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-17T17:51:43.958003] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-17T17:51:44.092941] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T17:51:44.758127] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-17T17:51:45.353133] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T17:51:45.558008] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-17T17:51:46.333403] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T17:51:46.357998] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-17T17:51:46.397147] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T17:51:46.399129] [INFO ] [REMOTE ] BYM: Full fetch complete (17384 records). [2025-10-17T17:51:46.399209] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-17T17:51:46.780989] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-17T17:51:46.781098] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-17T17:51:46.781725] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-17T17:51:46.781789] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-17T17:51:46.782459] [DEBUG] [LOCAL ] BYM: Trimmed 17384 records to 11842 (keeping 200 days of data) [2025-10-17T17:51:46.865216] [DEBUG] [LOCAL ] BYM: Primary data saved (11842 records). [2025-10-17T17:51:46.865425] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-17T17:51:46.865536] [INFO ] [MAIN ] Update Progress: 378/2368 symbols completed. BYM took 26.7s. Estimated remaining: 4h 32m 16s. Rate: 7.3 symbols/min [2025-10-17T17:51:47.052421] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:51:47.075906] [DEBUG] [LOCAL ] CAAP: Loaded 20020 existing records from primary storage. [2025-10-17T17:51:47.076246] [INFO ] [MAIN ] CAAP: Loaded 20020 existing records. [2025-10-17T17:51:47.163290] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-17T17:51:47.268462] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:51:47.268793] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-17T17:51:47.268850] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-17T17:51:47.269350] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-17T17:51:47.269410] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-17T17:51:47.639850] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:51:47.958071] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-17T17:51:48.024391] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T17:51:48.030913] [INFO ] [REMOTE ] BYD: Full fetch complete (65357 records). [2025-10-17T17:51:48.031071] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-17T17:51:48.412098] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-17T17:51:48.412179] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-17T17:51:48.412912] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-17T17:51:48.412977] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-17T17:51:48.414277] [DEBUG] [LOCAL ] BYD: Trimmed 65357 records to 45593 (keeping 200 days of data) [2025-10-17T17:51:48.708514] [DEBUG] [LOCAL ] BYD: Primary data saved (45593 records). [2025-10-17T17:51:48.708701] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-17T17:51:48.708801] [INFO ] [MAIN ] Update Progress: 379/2368 symbols completed. BYD took 35.7s. Estimated remaining: 4h 31m 34s. Rate: 7.3 symbols/min [2025-10-17T17:51:48.771353] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-17T17:51:48.880128] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:51:48.896615] [DEBUG] [LOCAL ] CABO: Loaded 16869 existing records from primary storage. [2025-10-17T17:51:48.896924] [INFO ] [MAIN ] CABO: Loaded 16869 existing records. [2025-10-17T17:51:49.073836] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:51:49.074197] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-17T17:51:49.074278] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-17T17:51:49.075059] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-17T17:51:49.075121] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-17T17:51:49.291547] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T17:51:49.454218] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:51:49.491675] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-17T17:51:49.558011] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-17T17:51:50.298625] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T17:51:50.358041] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-17T17:51:50.480001] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-17T17:51:51.158114] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-17T17:51:51.918838] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T17:51:51.933997] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T17:51:51.958033] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-17T17:51:52.758072] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-17T17:51:53.325147] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T17:51:53.329708] [INFO ] [REMOTE ] BZH: Full fetch complete (47206 records). [2025-10-17T17:51:53.329810] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-17T17:51:53.563130] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-17T17:51:53.729177] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-17T17:51:53.729269] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-17T17:51:53.729931] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-17T17:51:53.729997] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-17T17:51:53.731187] [DEBUG] [LOCAL ] BZH: Trimmed 47206 records to 32798 (keeping 200 days of data) [2025-10-17T17:51:53.915413] [DEBUG] [LOCAL ] BZH: Primary data saved (32798 records). [2025-10-17T17:51:53.915540] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-17T17:51:53.915620] [INFO ] [MAIN ] Update Progress: 380/2368 symbols completed. BZH took 31.7s. Estimated remaining: 4h 31m 10s. Rate: 7.3 symbols/min [2025-10-17T17:51:54.085325] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:51:54.085506] [DEBUG] [LOCAL ] CACI: No existing data file found in primary storage. [2025-10-17T17:51:54.085545] [WARN ] [MAIN ] CACI: No existing data found, performing full refresh instead. [2025-10-17T17:51:54.085694] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-17T17:51:54.085749] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-17T17:51:54.085796] [DEBUG] [LOCAL ] CACI: No primary data file found to delete. [2025-10-17T17:51:54.085829] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-17T17:51:54.365874] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-17T17:51:54.457161] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:51:54.766750] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-17T17:51:54.788015] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T17:51:55.158028] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-17T17:51:55.435339] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T17:51:55.958053] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-17T17:51:56.758079] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-17T17:51:57.029425] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-17T17:51:57.143809] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-17T17:51:57.558061] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-17T17:51:58.085582] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T17:51:58.358094] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-17T17:51:58.452089] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T17:51:59.158135] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-17T17:51:59.471223] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T17:51:59.958080] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-17T17:52:00.758049] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-17T17:52:01.473933] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T17:52:01.558036] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-17T17:52:01.924620] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-17T17:52:01.951826] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-17T17:52:02.358064] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-17T17:52:02.605915] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-17T17:52:03.158030] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-17T17:52:03.627376] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T17:52:03.958081] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-17T17:52:04.565767] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T17:52:04.758123] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-17T17:52:05.014255] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T17:52:05.558041] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-17T17:52:06.358001] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-17T17:52:06.663490] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T17:52:06.898020] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-17T17:52:07.158047] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-17T17:52:07.820067] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T17:52:07.958058] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-17T17:52:08.270173] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T17:52:08.758008] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-17T17:52:08.915111] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T17:52:09.368120] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T17:52:09.558031] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-17T17:52:10.358107] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-17T17:52:10.529479] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-17T17:52:11.158020] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-17T17:52:11.958065] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-17T17:52:11.982834] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T17:52:12.655237] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-17T17:52:12.758007] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-17T17:52:12.993883] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T17:52:13.558032] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-17T17:52:13.860618] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T17:52:13.862690] [INFO ] [REMOTE ] CABO: Full fetch complete (23161 records). [2025-10-17T17:52:13.862810] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-17T17:52:14.234091] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-17T17:52:14.234197] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-17T17:52:14.234835] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-17T17:52:14.234957] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-17T17:52:14.235587] [DEBUG] [LOCAL ] CABO: Trimmed 23161 records to 16919 (keeping 200 days of data) [2025-10-17T17:52:14.336540] [DEBUG] [LOCAL ] CABO: Primary data saved (16919 records). [2025-10-17T17:52:14.336738] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-17T17:52:14.336855] [INFO ] [MAIN ] Update Progress: 381/2368 symbols completed. CABO took 25.6s. Estimated remaining: 4h 32m 6s. Rate: 7.3 symbols/min [2025-10-17T17:52:14.365560] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-17T17:52:14.506009] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:52:14.554123] [DEBUG] [LOCAL ] CADE: Loaded 49873 existing records from primary storage. [2025-10-17T17:52:14.554475] [INFO ] [MAIN ] CADE: Loaded 49873 existing records. [2025-10-17T17:52:14.748735] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:52:14.749125] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-17T17:52:14.749232] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-17T17:52:14.758089] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-17T17:52:14.772396] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-17T17:52:14.811242] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-17T17:52:15.163229] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-17T17:52:15.193795] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:52:15.958022] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-17T17:52:16.458497] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T17:52:16.462321] [INFO ] [REMOTE ] CAAP: Full fetch complete (27940 records). [2025-10-17T17:52:16.462418] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-17T17:52:16.764270] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-17T17:52:16.901722] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-17T17:52:16.901826] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-17T17:52:16.902427] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-17T17:52:16.902604] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-17T17:52:16.903500] [DEBUG] [LOCAL ] CAAP: Trimmed 27940 records to 20139 (keeping 200 days of data) [2025-10-17T17:52:17.012798] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-17T17:52:17.023301] [INFO ] [REMOTE ] C: Full fetch complete (77918 records). [2025-10-17T17:52:17.024348] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-17T17:52:17.382144] [DEBUG] [LOCAL ] CAAP: Primary data saved (20139 records). [2025-10-17T17:52:17.392673] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-17T17:52:17.397990] [INFO ] [MAIN ] Update Progress: 382/2368 symbols completed. CAAP took 30.5s. Estimated remaining: 4h 31m 31s. Rate: 7.3 symbols/min [2025-10-17T17:52:17.587452] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-17T17:52:17.604962] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-17T17:52:17.619202] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-17T17:52:17.625070] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-17T17:52:17.697312] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:52:17.697516] [DEBUG] [LOCAL ] C: Trimmed 77918 records to 54520 (keeping 200 days of data) [2025-10-17T17:52:17.841538] [DEBUG] [LOCAL ] CAE: Loaded 39534 existing records from primary storage. [2025-10-17T17:52:17.842789] [INFO ] [MAIN ] CAE: Loaded 39534 existing records. [2025-10-17T17:52:18.043574] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:52:18.059794] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-17T17:52:18.065360] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-17T17:52:18.080561] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-17T17:52:18.081281] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-17T17:52:18.135938] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-17T17:52:18.224965] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-17T17:52:18.723024] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:52:18.728973] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-17T17:52:18.733948] [DEBUG] [LOCAL ] C: Primary data saved (54520 records). [2025-10-17T17:52:18.734593] [INFO ] [MAIN ] C: Full history saved. [2025-10-17T17:52:18.734706] [INFO ] [MAIN ] Update Progress: 383/2368 symbols completed. C took 55.6s. Estimated remaining: 4h 30m 47s. Rate: 7.3 symbols/min [2025-10-17T17:52:18.911749] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:52:18.935307] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-17T17:52:18.945992] [DEBUG] [LOCAL ] CAF: Loaded 3501 existing records from primary storage. [2025-10-17T17:52:18.946458] [INFO ] [MAIN ] CAF: Loaded 3501 existing records. [2025-10-17T17:52:19.126298] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:52:19.126498] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-17T17:52:19.126547] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-17T17:52:19.126718] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-17T17:52:19.126775] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-17T17:52:19.169055] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-17T17:52:19.485685] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:52:19.958010] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-17T17:52:19.985154] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T17:52:20.082249] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T17:52:20.758009] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-17T17:52:20.773465] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-17T17:52:21.131695] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T17:52:21.558027] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-17T17:52:22.067415] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T17:52:22.357993] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-17T17:52:22.766723] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T17:52:23.006502] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T17:52:23.158088] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-17T17:52:23.535110] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-17T17:52:23.958081] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-17T17:52:24.758018] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-17T17:52:25.409395] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T17:52:25.493771] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-17T17:52:25.558019] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-17T17:52:26.358076] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-17T17:52:27.163114] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-17T17:52:27.178822] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T17:52:27.797214] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T17:52:27.812063] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-17T17:52:27.958035] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-17T17:52:28.758071] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-17T17:52:29.114101] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-17T17:52:29.558073] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-17T17:52:30.210538] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-17T17:52:30.350336] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T17:52:30.358577] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-17T17:52:31.158054] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-17T17:52:31.505533] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T17:52:31.958045] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-17T17:52:32.758032] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-17T17:52:32.935887] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T17:52:33.017106] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-17T17:52:33.558036] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-17T17:52:34.121636] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-17T17:52:34.269303] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T17:52:34.358041] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-17T17:52:34.821006] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-17T17:52:35.158031] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-17T17:52:35.615478] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-17T17:52:35.958040] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-17T17:52:36.758027] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-17T17:52:37.266971] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T17:52:37.558047] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-17T17:52:38.132307] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T17:52:38.368368] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-17T17:52:38.376406] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T17:52:38.981000] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T17:52:38.982203] [INFO ] [REMOTE ] CAF: Full fetch complete (5547 records). [2025-10-17T17:52:38.982278] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-17T17:52:39.162456] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-17T17:52:39.343592] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-17T17:52:39.343699] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-17T17:52:39.343873] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-17T17:52:39.343933] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-17T17:52:39.344300] [DEBUG] [LOCAL ] CAF: Trimmed 5547 records to 3545 (keeping 200 days of data) [2025-10-17T17:52:39.364742] [DEBUG] [LOCAL ] CAF: Primary data saved (3545 records). [2025-10-17T17:52:39.364816] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-17T17:52:39.364908] [INFO ] [MAIN ] Update Progress: 384/2368 symbols completed. CAF took 20.6s. Estimated remaining: 4h 31m 43s. Rate: 7.3 symbols/min [2025-10-17T17:52:39.529282] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:52:39.580981] [DEBUG] [LOCAL ] CAG: Loaded 54055 existing records from primary storage. [2025-10-17T17:52:39.581302] [INFO ] [MAIN ] CAG: Loaded 54055 existing records. [2025-10-17T17:52:39.758702] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:52:39.758949] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-17T17:52:39.759000] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-17T17:52:39.759188] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-17T17:52:39.759231] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-17T17:52:39.966904] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-17T17:52:40.124362] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:52:40.601125] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T17:52:40.758027] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-17T17:52:41.558037] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-17T17:52:41.559798] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T17:52:42.356916] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T17:52:42.365570] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-17T17:52:43.158110] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-17T17:52:43.539740] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-17T17:52:43.540961] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T17:52:43.560024] [INFO ] [REMOTE ] CACI: Full fetch complete (38271 records). [2025-10-17T17:52:43.560335] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-17T17:52:43.963367] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-17T17:52:44.105630] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-17T17:52:44.105783] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-17T17:52:44.106724] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-17T17:52:44.106804] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-17T17:52:44.108185] [DEBUG] [LOCAL ] CACI: Trimmed 38271 records to 23405 (keeping 200 days of data) [2025-10-17T17:52:44.275043] [DEBUG] [LOCAL ] CACI: Primary data saved (23405 records). [2025-10-17T17:52:44.275182] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-17T17:52:44.275322] [INFO ] [MAIN ] Update Progress: 385/2368 symbols completed. CACI took 50.4s. Estimated remaining: 4h 31m 18s. Rate: 7.3 symbols/min [2025-10-17T17:52:44.450254] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:52:44.505125] [DEBUG] [LOCAL ] CAH: Loaded 51839 existing records from primary storage. [2025-10-17T17:52:44.505447] [INFO ] [MAIN ] CAH: Loaded 51839 existing records. [2025-10-17T17:52:44.688890] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:52:44.689152] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-17T17:52:44.689364] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-17T17:52:44.689782] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-17T17:52:44.689887] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-17T17:52:44.758991] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-17T17:52:44.856929] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T17:52:45.149153] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:52:45.559294] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-17T17:52:45.562106] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T17:52:46.358070] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-17T17:52:46.635077] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T17:52:47.158070] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-17T17:52:47.222223] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T17:52:47.958019] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-17T17:52:48.315531] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T17:52:48.758086] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-17T17:52:48.840558] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T17:52:49.558037] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-17T17:52:49.639060] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T17:52:50.259435] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T17:52:50.357980] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-17T17:52:51.158057] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-17T17:52:51.360362] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T17:52:51.872357] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T17:52:51.879786] [INFO ] [REMOTE ] CAE: Full fetch complete (56506 records). [2025-10-17T17:52:51.879953] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-17T17:52:51.963159] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-17T17:52:52.259848] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-17T17:52:52.259927] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-17T17:52:52.260576] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-17T17:52:52.260618] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-17T17:52:52.261708] [DEBUG] [LOCAL ] CAE: Trimmed 56506 records to 39813 (keeping 200 days of data) [2025-10-17T17:52:52.493391] [DEBUG] [LOCAL ] CAE: Primary data saved (39813 records). [2025-10-17T17:52:52.493604] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-17T17:52:52.493737] [INFO ] [MAIN ] Update Progress: 386/2368 symbols completed. CAE took 35.1s. Estimated remaining: 4h 31m 10s. Rate: 7.3 symbols/min [2025-10-17T17:52:52.700290] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:52:52.741372] [DEBUG] [LOCAL ] CAL: Loaded 43267 existing records from primary storage. [2025-10-17T17:52:52.741697] [INFO ] [MAIN ] CAL: Loaded 43267 existing records. [2025-10-17T17:52:52.772301] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-17T17:52:52.919867] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:52:52.926498] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-17T17:52:52.937743] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-17T17:52:52.938343] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-17T17:52:52.938408] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-17T17:52:52.939236] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T17:52:53.019076] [INFO ] [REMOTE ] CADE: Full fetch complete (70615 records). [2025-10-17T17:52:53.035202] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-17T17:52:53.662431] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:52:53.697038] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-17T17:52:53.722604] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-17T17:52:53.722783] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-17T17:52:53.723904] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-17T17:52:53.723989] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-17T17:52:53.726023] [DEBUG] [LOCAL ] CADE: Trimmed 70615 records to 50257 (keeping 200 days of data) [2025-10-17T17:52:53.866872] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-17T17:52:54.077206] [DEBUG] [LOCAL ] CADE: Primary data saved (50257 records). [2025-10-17T17:52:54.077375] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-17T17:52:54.077493] [INFO ] [MAIN ] Update Progress: 387/2368 symbols completed. CADE took 39.7s. Estimated remaining: 4h 30m 28s. Rate: 7.3 symbols/min [2025-10-17T17:52:54.255848] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:52:54.291543] [DEBUG] [LOCAL ] CALX: Loaded 37885 existing records from primary storage. [2025-10-17T17:52:54.291897] [INFO ] [MAIN ] CALX: Loaded 37885 existing records. [2025-10-17T17:52:54.368309] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-17T17:52:54.474808] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:52:54.475233] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-17T17:52:54.475322] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-17T17:52:54.475703] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-17T17:52:54.475762] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-17T17:52:54.853473] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:52:54.927527] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-17T17:52:55.158046] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-17T17:52:55.609171] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T17:52:55.958003] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-17T17:52:56.101328] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T17:52:56.612245] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T17:52:56.758112] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-17T17:52:57.112618] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T17:52:57.558049] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-17T17:52:58.358018] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-17T17:52:58.724056] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T17:52:59.158039] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-17T17:52:59.466133] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T17:52:59.502185] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T17:52:59.958065] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-17T17:53:00.758103] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-17T17:53:01.220634] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T17:53:01.550355] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T17:53:01.558087] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-17T17:53:02.358052] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-17T17:53:02.728145] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T17:53:03.158035] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-17T17:53:03.404325] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T17:53:03.848008] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T17:53:03.958073] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-17T17:53:04.758066] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-17T17:53:05.294868] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-17T17:53:05.558115] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-17T17:53:05.760181] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T17:53:06.336880] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T17:53:06.358062] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-17T17:53:07.158039] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-17T17:53:07.563060] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-17T17:53:07.602624] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-17T17:53:07.958125] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-17T17:53:08.741095] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T17:53:08.757989] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-17T17:53:09.558046] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-17T17:53:09.614465] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T17:53:10.123980] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T17:53:10.358070] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-17T17:53:11.158023] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-17T17:53:11.226812] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T17:53:11.963531] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-17T17:53:11.978145] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T17:53:12.758069] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-17T17:53:13.018730] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T17:53:13.491298] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T17:53:13.558055] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-17T17:53:14.089358] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-17T17:53:14.358131] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-17T17:53:15.158082] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-17T17:53:15.341849] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T17:53:15.958135] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-17T17:53:16.392834] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T17:53:16.400521] [INFO ] [REMOTE ] CAG: Full fetch complete (77434 records). [2025-10-17T17:53:16.400825] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-17T17:53:16.402064] [FATAL] [VALIDATOR ] CAG: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T17:53:16.402165] [FATAL] [MAIN ] CAG: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:53:16.402217] [WARN ] [MAIN ] CAG: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:53:16.402286] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-17T17:53:16.402389] [DEBUG] [LOCAL ] CAG: No primary data file found to delete. [2025-10-17T17:53:16.402451] [INFO ] [LOCAL ] CAG: Starting deletion of derivative data. [2025-10-17T17:53:16.402714] [DEBUG] [LOCAL ] CAG: Deleted derivative data file. [2025-10-17T17:53:16.402836] [INFO ] [MAIN ] Update Progress: 388/2368 symbols completed. CAG took 37.0s. Estimated remaining: 4h 31m 32s. Rate: 7.3 symbols/min [2025-10-17T17:53:16.586027] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:53:16.617102] [DEBUG] [LOCAL ] CANG: Loaded 27143 existing records from primary storage. [2025-10-17T17:53:16.617493] [INFO ] [MAIN ] CANG: Loaded 27143 existing records. [2025-10-17T17:53:16.765964] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-17T17:53:16.811925] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:53:16.812232] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-17T17:53:16.812288] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-17T17:53:16.812627] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-17T17:53:16.812712] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-17T17:53:17.182497] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-17T17:53:17.251804] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:53:17.558055] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-17T17:53:17.836769] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T17:53:18.228890] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T17:53:18.358024] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-17T17:53:18.863960] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T17:53:19.158125] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-17T17:53:19.853856] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T17:53:19.958064] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-17T17:53:20.758074] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-17T17:53:21.073249] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T17:53:21.081014] [INFO ] [REMOTE ] CAH: Full fetch complete (74837 records). [2025-10-17T17:53:21.081269] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-17T17:53:21.286694] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T17:53:21.511421] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-17T17:53:21.511517] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-17T17:53:21.512349] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-17T17:53:21.512421] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-17T17:53:21.513930] [DEBUG] [LOCAL ] CAH: Trimmed 74837 records to 52214 (keeping 200 days of data) [2025-10-17T17:53:21.569618] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-17T17:53:21.872990] [DEBUG] [LOCAL ] CAH: Primary data saved (52214 records). [2025-10-17T17:53:21.873158] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-17T17:53:21.874090] [INFO ] [MAIN ] Update Progress: 389/2368 symbols completed. CAH took 37.6s. Estimated remaining: 4h 31m 9s. Rate: 7.3 symbols/min [2025-10-17T17:53:22.047165] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:53:22.055557] [DEBUG] [LOCAL ] CAPL: Loaded 5684 existing records from primary storage. [2025-10-17T17:53:22.055805] [INFO ] [MAIN ] CAPL: Loaded 5684 existing records. [2025-10-17T17:53:22.253037] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T17:53:22.256796] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:53:22.262522] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-17T17:53:22.262835] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-17T17:53:22.263010] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-17T17:53:22.263068] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-17T17:53:22.293940] [INFO ] [REMOTE ] CALX: Full fetch complete (54239 records). [2025-10-17T17:53:22.336586] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-17T17:53:22.360362] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-17T17:53:22.865836] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:53:23.049985] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-17T17:53:23.065162] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-17T17:53:23.065956] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-17T17:53:23.066045] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-17T17:53:23.068584] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T17:53:23.079193] [DEBUG] [LOCAL ] CALX: Trimmed 54239 records to 38084 (keeping 200 days of data) [2025-10-17T17:53:23.160695] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-17T17:53:23.305297] [DEBUG] [LOCAL ] CALX: Primary data saved (38084 records). [2025-10-17T17:53:23.305533] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-17T17:53:23.305666] [INFO ] [MAIN ] Update Progress: 390/2368 symbols completed. CALX took 29.2s. Estimated remaining: 4h 30m 27s. Rate: 7.3 symbols/min [2025-10-17T17:53:23.496387] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:53:23.556562] [DEBUG] [LOCAL ] CARR: Loaded 53992 existing records from primary storage. [2025-10-17T17:53:23.557055] [INFO ] [MAIN ] CARR: Loaded 53992 existing records. [2025-10-17T17:53:23.771340] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:53:23.772189] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-17T17:53:23.772272] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-17T17:53:23.772823] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-17T17:53:23.772886] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-17T17:53:23.959687] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-17T17:53:24.144722] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T17:53:24.258223] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T17:53:24.263528] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:53:24.758019] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-17T17:53:24.842138] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-17T17:53:25.558042] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-17T17:53:26.323179] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T17:53:26.358031] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-17T17:53:26.607503] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T17:53:27.158025] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-17T17:53:27.202528] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-17T17:53:27.958042] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-17T17:53:28.572030] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-17T17:53:28.758031] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-17T17:53:28.787191] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T17:53:29.558026] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-17T17:53:29.819229] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T17:53:30.358028] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-17T17:53:30.374076] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T17:53:31.158030] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-17T17:53:31.632198] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T17:53:31.958027] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-17T17:53:32.758013] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-17T17:53:32.929365] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T17:53:33.558026] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-17T17:53:33.648994] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T17:53:33.655870] [INFO ] [REMOTE ] CAL: Full fetch complete (61823 records). [2025-10-17T17:53:33.656024] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-17T17:53:34.097773] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-17T17:53:34.097934] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-17T17:53:34.103921] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-17T17:53:34.105320] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-17T17:53:34.105388] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-17T17:53:34.106616] [DEBUG] [LOCAL ] CAL: Trimmed 61823 records to 43547 (keeping 200 days of data) [2025-10-17T17:53:34.365706] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-17T17:53:34.379746] [DEBUG] [LOCAL ] CAL: Primary data saved (43547 records). [2025-10-17T17:53:34.379881] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-17T17:53:34.380745] [INFO ] [MAIN ] Update Progress: 391/2368 symbols completed. CAL took 41.9s. Estimated remaining: 4h 30m 33s. Rate: 7.3 symbols/min [2025-10-17T17:53:34.553130] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:53:34.592126] [DEBUG] [LOCAL ] CARS: Loaded 40101 existing records from primary storage. [2025-10-17T17:53:34.592416] [INFO ] [MAIN ] CARS: Loaded 40101 existing records. [2025-10-17T17:53:34.772635] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:53:34.773184] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-17T17:53:34.773292] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-17T17:53:34.773768] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-17T17:53:34.773827] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-17T17:53:35.134521] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:53:35.159327] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-17T17:53:35.164714] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T17:53:35.584493] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-17T17:53:35.958109] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-17T17:53:36.683217] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T17:53:36.758108] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-17T17:53:37.131958] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-17T17:53:37.558030] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-17T17:53:37.987257] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T17:53:38.358083] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-17T17:53:38.966509] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T17:53:39.155265] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-17T17:53:39.158106] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-17T17:53:39.958024] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-17T17:53:40.480251] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-17T17:53:40.758019] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-17T17:53:41.130160] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T17:53:41.558029] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-17T17:53:41.828440] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T17:53:42.358031] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-17T17:53:42.935721] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T17:53:42.940236] [INFO ] [REMOTE ] CANG: Full fetch complete (39771 records). [2025-10-17T17:53:42.940337] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-17T17:53:43.163194] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-17T17:53:43.324493] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-17T17:53:43.324576] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-17T17:53:43.325135] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-17T17:53:43.325197] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-17T17:53:43.326088] [DEBUG] [LOCAL ] CANG: Trimmed 39771 records to 27428 (keeping 200 days of data) [2025-10-17T17:53:43.481423] [DEBUG] [LOCAL ] CANG: Primary data saved (27428 records). [2025-10-17T17:53:43.481612] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-17T17:53:43.481737] [INFO ] [MAIN ] Update Progress: 392/2368 symbols completed. CANG took 27.1s. Estimated remaining: 4h 30m 29s. Rate: 7.3 symbols/min [2025-10-17T17:53:43.653597] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:53:43.702779] [DEBUG] [LOCAL ] CAT: Loaded 53348 existing records from primary storage. [2025-10-17T17:53:43.703124] [INFO ] [MAIN ] CAT: Loaded 53348 existing records. [2025-10-17T17:53:43.887307] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:53:43.887673] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-17T17:53:43.887754] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-17T17:53:43.888034] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-17T17:53:43.888118] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-17T17:53:43.963837] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-17T17:53:44.166957] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T17:53:44.298927] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:53:44.633954] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T17:53:44.758039] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-17T17:53:44.983700] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T17:53:45.354968] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-17T17:53:45.558040] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-17T17:53:46.358066] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-17T17:53:47.158090] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-17T17:53:47.298792] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T17:53:47.848071] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-17T17:53:47.958122] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-17T17:53:48.280905] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T17:53:48.563485] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-17T17:53:48.758102] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-17T17:53:49.558026] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-17T17:53:50.358106] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-17T17:53:50.364634] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T17:53:51.126403] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T17:53:51.158000] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-17T17:53:51.958090] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-17T17:53:52.357053] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-17T17:53:52.451384] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T17:53:52.758013] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-17T17:53:52.820944] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T17:53:52.822305] [INFO ] [REMOTE ] CAPL: Full fetch complete (8724 records). [2025-10-17T17:53:52.822378] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-17T17:53:53.179515] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-17T17:53:53.179862] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-17T17:53:53.180106] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-17T17:53:53.180150] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-17T17:53:53.180575] [DEBUG] [LOCAL ] CAPL: Trimmed 8724 records to 5696 (keeping 200 days of data) [2025-10-17T17:53:53.216364] [DEBUG] [LOCAL ] CAPL: Primary data saved (5696 records). [2025-10-17T17:53:53.216519] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-17T17:53:53.216610] [INFO ] [MAIN ] Update Progress: 393/2368 symbols completed. CAPL took 31.3s. Estimated remaining: 4h 30m 29s. Rate: 7.3 symbols/min [2025-10-17T17:53:53.385508] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:53:53.394232] [DEBUG] [LOCAL ] CATO: Loaded 6736 existing records from primary storage. [2025-10-17T17:53:53.394463] [INFO ] [MAIN ] CATO: Loaded 6736 existing records. [2025-10-17T17:53:53.571718] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-17T17:53:53.577327] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:53:53.579223] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-17T17:53:53.579314] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-17T17:53:53.579768] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-17T17:53:53.579844] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-17T17:53:53.979900] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:53:54.358068] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-17T17:53:54.872631] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-17T17:53:55.158019] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-17T17:53:55.457540] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T17:53:55.673838] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-17T17:53:55.958063] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-17T17:53:56.758059] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-17T17:53:57.191772] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-17T17:53:57.558105] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-17T17:53:57.839412] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-17T17:53:58.358011] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-17T17:53:58.536577] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T17:53:59.158093] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-17T17:53:59.528129] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T17:53:59.944810] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T17:53:59.958011] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-17T17:54:00.222773] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-17T17:54:00.758064] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-17T17:54:01.558063] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-17T17:54:02.140114] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-17T17:54:02.358137] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-17T17:54:02.406941] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T17:54:02.719720] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T17:54:03.158070] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-17T17:54:03.958078] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-17T17:54:04.141840] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-17T17:54:04.692514] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-17T17:54:04.758066] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-17T17:54:05.398379] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T17:54:05.558093] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-17T17:54:05.577335] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-17T17:54:06.358059] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-17T17:54:06.958207] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T17:54:07.158018] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-17T17:54:07.616765] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-17T17:54:07.630325] [INFO ] [REMOTE ] CARR: Full fetch complete (77772 records). [2025-10-17T17:54:07.630625] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-17T17:54:07.963157] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-17T17:54:08.060534] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-17T17:54:08.060694] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-17T17:54:08.062159] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-17T17:54:08.062241] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-17T17:54:08.064511] [DEBUG] [LOCAL ] CARR: Trimmed 77772 records to 54382 (keeping 200 days of data) [2025-10-17T17:54:08.426533] [DEBUG] [LOCAL ] CARR: Primary data saved (54382 records). [2025-10-17T17:54:08.426811] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-17T17:54:08.426988] [INFO ] [MAIN ] Update Progress: 394/2368 symbols completed. CARR took 45.1s. Estimated remaining: 4h 30m 55s. Rate: 7.3 symbols/min [2025-10-17T17:54:08.610019] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:54:08.673536] [DEBUG] [LOCAL ] CAVA: Loaded 53956 existing records from primary storage. [2025-10-17T17:54:08.674020] [INFO ] [MAIN ] CAVA: Loaded 53956 existing records. [2025-10-17T17:54:08.758416] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-17T17:54:08.786484] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T17:54:08.888526] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:54:08.888901] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-17T17:54:08.888957] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-17T17:54:08.889239] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-17T17:54:08.889281] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-17T17:54:09.284969] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:54:09.319352] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-17T17:54:09.558056] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-17T17:54:10.364487] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-17T17:54:10.371669] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T17:54:10.378997] [INFO ] [REMOTE ] CARS: Full fetch complete (56338 records). [2025-10-17T17:54:10.379182] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-17T17:54:10.779014] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-17T17:54:10.779143] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-17T17:54:10.780224] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-17T17:54:10.780295] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-17T17:54:10.782103] [DEBUG] [LOCAL ] CARS: Trimmed 56338 records to 40383 (keeping 200 days of data) [2025-10-17T17:54:11.044140] [DEBUG] [LOCAL ] CARS: Primary data saved (40383 records). [2025-10-17T17:54:11.044320] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-17T17:54:11.045033] [INFO ] [MAIN ] Update Progress: 395/2368 symbols completed. CARS took 36.7s. Estimated remaining: 4h 30m 19s. Rate: 7.3 symbols/min [2025-10-17T17:54:11.163211] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-17T17:54:11.240465] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:54:11.309291] [DEBUG] [LOCAL ] CB: Loaded 50327 existing records from primary storage. [2025-10-17T17:54:11.309866] [INFO ] [MAIN ] CB: Loaded 50327 existing records. [2025-10-17T17:54:11.518218] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:54:11.518785] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-17T17:54:11.518902] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-17T17:54:11.519353] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-17T17:54:11.519434] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-17T17:54:11.671317] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-17T17:54:11.898261] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T17:54:11.958739] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-17T17:54:11.988468] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:54:12.663063] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-17T17:54:12.758100] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-17T17:54:13.558056] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-17T17:54:14.209891] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-17T17:54:14.234506] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-17T17:54:14.311571] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T17:54:14.358051] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-17T17:54:15.158082] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-17T17:54:15.958044] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-17T17:54:16.087564] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T17:54:16.421236] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-17T17:54:16.758068] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-17T17:54:17.558051] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-17T17:54:17.791303] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T17:54:18.358062] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-17T17:54:18.695814] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-17T17:54:19.081752] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T17:54:19.083698] [INFO ] [REMOTE ] CATO: Full fetch complete (10862 records). [2025-10-17T17:54:19.083872] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-17T17:54:19.163167] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-17T17:54:19.486470] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-17T17:54:19.486574] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-17T17:54:19.487066] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-17T17:54:19.487131] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-17T17:54:19.487863] [DEBUG] [LOCAL ] CATO: Trimmed 10862 records to 6799 (keeping 200 days of data) [2025-10-17T17:54:19.531975] [DEBUG] [LOCAL ] CATO: Primary data saved (6799 records). [2025-10-17T17:54:19.532199] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-17T17:54:19.532332] [INFO ] [MAIN ] Update Progress: 396/2368 symbols completed. CATO took 26.3s. Estimated remaining: 4h 30m 12s. Rate: 7.3 symbols/min [2025-10-17T17:54:19.713690] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:54:19.730226] [DEBUG] [LOCAL ] CBAN: Loaded 10553 existing records from primary storage. [2025-10-17T17:54:19.730540] [INFO ] [MAIN ] CBAN: Loaded 10553 existing records. [2025-10-17T17:54:19.939960] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:54:19.940441] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-17T17:54:19.940535] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-17T17:54:19.940825] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-17T17:54:19.940912] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-17T17:54:19.964144] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-17T17:54:20.169000] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-17T17:54:20.285084] [INFO ] [REMOTE ] CAT: Full fetch complete (76882 records). [2025-10-17T17:54:20.288352] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-17T17:54:20.493545] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:54:20.763247] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-17T17:54:20.829214] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-17T17:54:20.829350] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-17T17:54:20.830804] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-17T17:54:20.830878] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-17T17:54:20.833998] [DEBUG] [LOCAL ] CAT: Trimmed 76882 records to 53736 (keeping 200 days of data) [2025-10-17T17:54:21.213952] [DEBUG] [LOCAL ] CAT: Primary data saved (53736 records). [2025-10-17T17:54:21.214243] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-17T17:54:21.214385] [INFO ] [MAIN ] Update Progress: 397/2368 symbols completed. CAT took 37.7s. Estimated remaining: 4h 29m 32s. Rate: 7.3 symbols/min [2025-10-17T17:54:21.247022] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-17T17:54:21.558083] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-17T17:54:21.654768] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T17:54:21.860483] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T17:54:22.358050] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-17T17:54:23.158064] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-17T17:54:23.195710] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T17:54:23.802861] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-17T17:54:23.958091] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-17T17:54:24.758078] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-17T17:54:25.072153] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T17:54:25.562857] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-17T17:54:25.570923] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T17:54:25.621994] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T17:54:26.358054] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-17T17:54:27.158058] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-17T17:54:27.536054] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T17:54:27.958211] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-17T17:54:28.124094] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T17:54:28.555664] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-17T17:54:28.758099] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-17T17:54:29.558161] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-17T17:54:29.736987] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T17:54:30.172064] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T17:54:30.358128] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-17T17:54:30.732561] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T17:54:31.158054] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-17T17:54:31.243777] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-17T17:54:31.958081] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-17T17:54:32.758147] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-17T17:54:33.267886] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-17T17:54:33.558061] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-17T17:54:33.719710] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T17:54:33.751481] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T17:54:34.358100] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-17T17:54:35.158121] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-17T17:54:35.245430] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-17T17:54:35.672255] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-17T17:54:35.958056] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-17T17:54:36.758068] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-17T17:54:37.196095] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T17:54:37.525307] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T17:54:37.558027] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-17T17:54:38.063261] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-17T17:54:38.334471] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-17T17:54:38.358051] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-17T17:54:39.158038] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-17T17:54:39.213107] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T17:54:39.215445] [INFO ] [REMOTE ] CBAN: Full fetch complete (16231 records). [2025-10-17T17:54:39.215538] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-17T17:54:39.645492] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-17T17:54:39.645601] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-17T17:54:39.646232] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-17T17:54:39.646334] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-17T17:54:39.647202] [DEBUG] [LOCAL ] CBAN: Trimmed 16231 records to 10619 (keeping 200 days of data) [2025-10-17T17:54:39.714550] [DEBUG] [LOCAL ] CBAN: Primary data saved (10619 records). [2025-10-17T17:54:39.714771] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-17T17:54:39.714887] [INFO ] [MAIN ] Update Progress: 398/2368 symbols completed. CBAN took 20.2s. Estimated remaining: 4h 30m 14s. Rate: 7.3 symbols/min [2025-10-17T17:54:39.958101] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-17T17:54:40.063855] [DEBUG] [REMOTE ] CAVA: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-17T17:54:40.064326] [WARN ] [REMOTE ] CAVA: No data returned for month 2025-10 [2025-10-17T17:54:40.064430] [FATAL] [REMOTE ] CAVA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:54:40.064545] [FATAL] [MAIN ] CAVA: Failed to fetch primary data. [2025-10-17T17:54:40.064629] [WARN ] [MAIN ] CAVA: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:54:40.064734] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-17T17:54:40.064812] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-10-17T17:54:40.064905] [INFO ] [LOCAL ] CAVA: Starting deletion of derivative data. [2025-10-17T17:54:40.065117] [DEBUG] [LOCAL ] CAVA: Deleted derivative data file. [2025-10-17T17:54:40.065216] [INFO ] [MAIN ] Update Progress: 399/2368 symbols completed. CAVA took 31.6s. Estimated remaining: 4h 29m 27s. Rate: 7.3 symbols/min [2025-10-17T17:54:40.854390] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T17:54:40.871103] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-17T17:54:42.566744] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T17:54:42.579231] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-17T17:54:44.373305] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T17:54:44.381134] [INFO ] [REMOTE ] CB: Full fetch complete (72839 records). [2025-10-17T17:54:44.381309] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-17T17:54:44.806534] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-17T17:54:44.806632] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-17T17:54:44.807589] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-17T17:54:44.807686] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-17T17:54:44.809257] [DEBUG] [LOCAL ] CB: Trimmed 72839 records to 50716 (keeping 200 days of data) [2025-10-17T17:54:45.160878] [DEBUG] [LOCAL ] CB: Primary data saved (50716 records). [2025-10-17T17:54:45.161121] [INFO ] [MAIN ] CB: Full history saved. [2025-10-17T17:54:45.161770] [INFO ] [MAIN ] Update Progress: 400/2368 symbols completed. CB took 34.1s. Estimated remaining: 4h 29m 4s. Rate: 7.3 symbols/min [2025-10-17T17:54:45.861809] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:54:45.849959] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:54:45.904024] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:54:45.966216] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:54:45.971244] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-17T17:54:45.971908] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-17T17:54:45.972291] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-17T17:54:45.972347] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-17T17:54:45.972445] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-17T17:54:45.972493] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-17T17:54:45.971588] [DEBUG] [LOCAL ] CBNA: Loaded 2936 existing records from primary storage. [2025-10-17T17:54:45.984789] [INFO ] [MAIN ] CBNA: Loaded 2936 existing records. [2025-10-17T17:54:46.180150] [DEBUG] [LOCAL ] CBL: Loaded 16377 existing records from primary storage. [2025-10-17T17:54:46.241378] [INFO ] [MAIN ] CBL: Loaded 16377 existing records. [2025-10-17T17:54:46.484908] [DEBUG] [LOCAL ] CBRE: Loaded 50735 existing records from primary storage. [2025-10-17T17:54:46.520870] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:54:46.553493] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-17T17:54:46.547987] [INFO ] [MAIN ] CBRE: Loaded 50735 existing records. [2025-10-17T17:54:46.646961] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-17T17:54:46.756701] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-17T17:54:46.834821] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-17T17:54:46.961972] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:54:47.014066] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-17T17:54:47.056538] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-17T17:54:47.146803] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:54:47.212230] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-17T17:54:47.212168] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:54:47.213247] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-17T17:54:47.224444] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-17T17:54:47.230083] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-17T17:54:47.229976] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-17T17:54:47.283179] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-17T17:54:47.326504] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-17T17:54:47.564371] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:54:47.654421] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-17T17:54:47.698091] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:54:47.823842] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-17T17:54:47.916384] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:54:47.933780] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:54:47.957717] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-17T17:54:47.949555] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-17T17:54:47.987594] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-17T17:54:48.059954] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-17T17:54:48.097370] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-17T17:54:48.103637] [INFO ] [MAIN ] Update Progress: 401/2368 symbols completed. CBO took 2.9s. Estimated remaining: 4h 28m 30s. Rate: 7.3 symbols/min [2025-10-17T17:54:48.397526] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:54:48.414927] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-17T17:54:48.470702] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:54:48.526384] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-17T17:54:48.533070] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:54:48.569775] [DEBUG] [LOCAL ] CBT: Loaded 31366 existing records from primary storage. [2025-10-17T17:54:48.570169] [INFO ] [MAIN ] CBT: Loaded 31366 existing records. [2025-10-17T17:54:48.788904] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:54:48.790497] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-17T17:54:48.790379] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-17T17:54:48.792932] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-17T17:54:48.790664] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-17T17:54:48.794135] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-17T17:54:48.794195] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-17T17:54:49.188553] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:54:49.189026] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-17T17:54:49.415354] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T17:54:49.417580] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-17T17:54:49.498887] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T17:54:49.504062] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-17T17:54:49.886430] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T17:54:49.888204] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-17T17:54:50.292076] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T17:54:50.304036] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-17T17:54:50.310043] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-17T17:54:50.358076] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-17T17:54:50.546375] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T17:54:50.644804] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-17T17:54:50.826212] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-17T17:54:51.158114] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-17T17:54:51.732019] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-17T17:54:51.958022] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-17T17:54:52.052034] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T17:54:52.758001] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-17T17:54:53.230556] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T17:54:53.558079] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-17T17:54:53.778885] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T17:54:54.358101] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-17T17:54:55.133216] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T17:54:55.157989] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-17T17:54:55.593482] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T17:54:55.958087] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-17T17:54:56.523282] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-17T17:54:56.758087] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-17T17:54:56.878978] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T17:54:57.215155] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-17T17:54:57.558047] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-17T17:54:58.358019] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-17T17:54:58.621579] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T17:54:58.917807] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T17:54:59.158059] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-17T17:54:59.601720] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-17T17:54:59.958044] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-17T17:55:00.458433] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-17T17:55:00.459488] [INFO ] [REMOTE ] CBNA: Full fetch complete (4351 records). [2025-10-17T17:55:00.459559] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-17T17:55:00.763054] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-17T17:55:00.847690] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-17T17:55:00.847799] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-17T17:55:00.848001] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-17T17:55:00.848043] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-17T17:55:00.848433] [DEBUG] [LOCAL ] CBNA: Trimmed 4351 records to 2942 (keeping 200 days of data) [2025-10-17T17:55:00.866980] [DEBUG] [LOCAL ] CBNA: Primary data saved (2942 records). [2025-10-17T17:55:00.867119] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-17T17:55:00.867216] [INFO ] [MAIN ] Update Progress: 402/2368 symbols completed. CBNA took 15.7s. Estimated remaining: 4h 28m 44s. Rate: 7.3 symbols/min [2025-10-17T17:55:01.116796] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:55:01.197036] [DEBUG] [LOCAL ] CBU: Loaded 22932 existing records from primary storage. [2025-10-17T17:55:01.197549] [INFO ] [MAIN ] CBU: Loaded 22932 existing records. [2025-10-17T17:55:01.402188] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:55:01.402430] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-17T17:55:01.402484] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-17T17:55:01.403216] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-17T17:55:01.403487] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-17T17:55:01.563260] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-17T17:55:01.802266] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:55:02.358134] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-17T17:55:02.660781] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-17T17:55:03.158089] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-17T17:55:03.536804] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T17:55:03.839599] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-17T17:55:03.958025] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-17T17:55:04.553876] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T17:55:04.758070] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-17T17:55:05.558041] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-17T17:55:05.697956] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T17:55:06.158327] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T17:55:06.254800] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-17T17:55:06.358057] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-17T17:55:07.158081] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-17T17:55:07.691692] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-17T17:55:07.958034] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-17T17:55:08.155037] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T17:55:08.758099] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-17T17:55:09.491354] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T17:55:09.558029] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-17T17:55:10.368700] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-17T17:55:10.393150] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T17:55:10.803233] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T17:55:11.158002] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-17T17:55:11.527681] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T17:55:11.746745] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-17T17:55:11.958000] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-17T17:55:12.758109] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-17T17:55:12.968541] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-17T17:55:13.558071] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-17T17:55:13.994998] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-17T17:55:14.358099] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-17T17:55:14.960280] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T17:55:15.158019] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-17T17:55:15.477618] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T17:55:15.958054] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-17T17:55:16.506783] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-17T17:55:16.758064] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-17T17:55:16.868090] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T17:55:17.558030] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-17T17:55:18.061399] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-17T17:55:18.358037] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-17T17:55:19.158003] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-17T17:55:19.295048] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T17:55:19.463480] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T17:55:19.958021] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-17T17:55:20.329613] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T17:55:20.334674] [INFO ] [REMOTE ] CBT: Full fetch complete (45866 records). [2025-10-17T17:55:20.334787] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-17T17:55:20.707799] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-17T17:55:20.707879] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-17T17:55:20.708489] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-17T17:55:20.708530] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-17T17:55:20.709791] [DEBUG] [LOCAL ] CBT: Trimmed 45866 records to 31588 (keeping 200 days of data) [2025-10-17T17:55:20.763594] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-17T17:55:20.903631] [DEBUG] [LOCAL ] CBT: Primary data saved (31588 records). [2025-10-17T17:55:20.903817] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-17T17:55:20.903981] [INFO ] [MAIN ] Update Progress: 403/2368 symbols completed. CBT took 32.8s. Estimated remaining: 4h 29m 33s. Rate: 7.3 symbols/min [2025-10-17T17:55:21.013945] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T17:55:21.090385] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:55:21.090578] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-17T17:55:21.090616] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-17T17:55:21.090757] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-17T17:55:21.090799] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-17T17:55:21.090840] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-17T17:55:21.090873] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-17T17:55:21.435786] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:55:21.558018] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-17T17:55:21.621695] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T17:55:21.624254] [INFO ] [REMOTE ] CBL: Full fetch complete (25070 records). [2025-10-17T17:55:21.624341] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-17T17:55:21.770339] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:55:21.801797] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-17T17:55:21.848922] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:55:21.894481] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-17T17:55:21.910608] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:55:21.921029] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-17T17:55:21.921131] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-17T17:55:21.921195] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-17T17:55:21.932051] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-17T17:55:21.942384] [INFO ] [MAIN ] Update Progress: 404/2368 symbols completed. CBX took 1.0s. Estimated remaining: 4h 28m 50s. Rate: 7.3 symbols/min [2025-10-17T17:55:22.111229] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-17T17:55:22.113738] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-17T17:55:22.114565] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-17T17:55:22.120025] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-17T17:55:22.168602] [DEBUG] [LOCAL ] CBL: Trimmed 25070 records to 16467 (keeping 200 days of data) [2025-10-17T17:55:22.186910] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:55:22.296366] [DEBUG] [LOCAL ] CBL: Primary data saved (16467 records). [2025-10-17T17:55:22.296521] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-17T17:55:22.296607] [INFO ] [MAIN ] Update Progress: 405/2368 symbols completed. CBL took 37.1s. Estimated remaining: 4h 28m 4s. Rate: 7.3 symbols/min [2025-10-17T17:55:22.362010] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-17T17:55:22.438044] [DEBUG] [LOCAL ] CBZ: Loaded 34513 existing records from primary storage. [2025-10-17T17:55:22.463528] [INFO ] [MAIN ] CBZ: Loaded 34513 existing records. [2025-10-17T17:55:22.483183] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:55:22.660858] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:55:22.661132] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-17T17:55:22.661186] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-17T17:55:22.661405] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-17T17:55:22.661462] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-17T17:55:22.856056] [DEBUG] [LOCAL ] CC: Loaded 53400 existing records from primary storage. [2025-10-17T17:55:22.874006] [INFO ] [MAIN ] CC: Loaded 53400 existing records. [2025-10-17T17:55:23.161163] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-17T17:55:23.194439] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:55:23.237906] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:55:23.238247] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-17T17:55:23.238309] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-17T17:55:23.238793] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-17T17:55:23.238894] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-17T17:55:23.591113] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:55:23.606883] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T17:55:23.958034] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-17T17:55:24.758049] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-17T17:55:24.956074] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T17:55:24.995119] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T17:55:25.558018] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-17T17:55:26.358052] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-17T17:55:26.614390] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-17T17:55:27.158039] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-17T17:55:27.224330] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T17:55:27.469267] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T17:55:27.958063] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-17T17:55:28.758085] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-17T17:55:28.811364] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T17:55:29.558035] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-17T17:55:29.943343] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-17T17:55:29.950522] [INFO ] [REMOTE ] CBRE: Full fetch complete (73806 records). [2025-10-17T17:55:29.950737] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-17T17:55:30.244797] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T17:55:30.359615] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-17T17:55:30.378474] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-17T17:55:30.378531] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-17T17:55:30.379337] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-17T17:55:30.379501] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-17T17:55:30.380935] [DEBUG] [LOCAL ] CBRE: Trimmed 73806 records to 51089 (keeping 200 days of data) [2025-10-17T17:55:30.684514] [DEBUG] [LOCAL ] CBRE: Primary data saved (51089 records). [2025-10-17T17:55:30.684660] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-17T17:55:30.685711] [INFO ] [MAIN ] Update Progress: 406/2368 symbols completed. CBRE took 45.5s. Estimated remaining: 4h 27m 57s. Rate: 7.3 symbols/min [2025-10-17T17:55:30.852502] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:55:30.906959] [DEBUG] [LOCAL ] CCI: Loaded 53506 existing records from primary storage. [2025-10-17T17:55:30.907310] [INFO ] [MAIN ] CCI: Loaded 53506 existing records. [2025-10-17T17:55:31.084312] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:55:31.084588] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-17T17:55:31.084695] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-17T17:55:31.085179] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-17T17:55:31.085230] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-17T17:55:31.159499] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-17T17:55:31.354590] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-17T17:55:31.487695] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:55:31.547066] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T17:55:31.958046] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-17T17:55:32.328453] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T17:55:32.758038] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-17T17:55:32.935543] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-17T17:55:32.939253] [INFO ] [REMOTE ] CBU: Full fetch complete (32664 records). [2025-10-17T17:55:32.939341] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-17T17:55:33.303026] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-17T17:55:33.303095] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-17T17:55:33.303619] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-17T17:55:33.303706] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-17T17:55:33.304522] [DEBUG] [LOCAL ] CBU: Trimmed 32664 records to 23143 (keeping 200 days of data) [2025-10-17T17:55:33.439354] [DEBUG] [LOCAL ] CBU: Primary data saved (23143 records). [2025-10-17T17:55:33.439484] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-17T17:55:33.439567] [INFO ] [MAIN ] Update Progress: 407/2368 symbols completed. CBU took 32.6s. Estimated remaining: 4h 27m 22s. Rate: 7.3 symbols/min [2025-10-17T17:55:33.563110] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-17T17:55:33.610565] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:55:33.610730] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-17T17:55:33.610820] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-17T17:55:33.610948] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-17T17:55:33.610999] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-17T17:55:33.611043] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-17T17:55:33.611076] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-17T17:55:33.972738] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:55:34.358104] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-17T17:55:34.619775] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T17:55:34.650601] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T17:55:35.158074] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-17T17:55:35.704200] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-17T17:55:35.958024] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-17T17:55:36.388333] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T17:55:36.758104] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-17T17:55:37.187173] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-17T17:55:37.425671] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T17:55:37.558077] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-17T17:55:38.358040] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-17T17:55:39.158035] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-17T17:55:39.410034] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T17:55:39.664190] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T17:55:39.958023] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-17T17:55:40.726314] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T17:55:40.757987] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-17T17:55:41.557992] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-17T17:55:41.748831] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T17:55:42.358211] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-17T17:55:42.532689] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T17:55:42.800296] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-17T17:55:42.824173] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T17:55:43.158096] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-17T17:55:43.958029] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-17T17:55:44.758130] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-17T17:55:44.808869] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T17:55:45.183383] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-17T17:55:45.558043] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-17T17:55:45.942447] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-17T17:55:46.118610] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T17:55:46.358090] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-17T17:55:47.158080] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-17T17:55:47.918997] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T17:55:47.958033] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-17T17:55:48.411875] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-17T17:55:48.758109] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-17T17:55:49.267720] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-17T17:55:49.558058] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-17T17:55:50.358094] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-17T17:55:50.553742] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T17:55:50.963519] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-17T17:55:51.158085] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-17T17:55:51.958062] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-17T17:55:52.271300] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T17:55:52.284905] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-17T17:55:52.577131] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T17:55:52.758094] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-17T17:55:53.110907] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-17T17:55:53.558065] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-17T17:55:54.358108] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-17T17:55:55.158044] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-17T17:55:55.318199] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T17:55:55.590423] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-17T17:55:55.780232] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T17:55:55.957987] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-17T17:55:56.758084] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-17T17:55:57.198927] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-17T17:55:57.558022] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-17T17:55:57.827945] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T17:55:58.358054] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-17T17:55:59.054051] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T17:55:59.059448] [INFO ] [REMOTE ] CBZ: Full fetch complete (46216 records). [2025-10-17T17:55:59.059581] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-17T17:55:59.158107] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-17T17:55:59.437941] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-17T17:55:59.438023] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-17T17:55:59.438671] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-17T17:55:59.438734] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-17T17:55:59.439726] [DEBUG] [LOCAL ] CBZ: Trimmed 46216 records to 34777 (keeping 200 days of data) [2025-10-17T17:55:59.637327] [DEBUG] [LOCAL ] CBZ: Primary data saved (34777 records). [2025-10-17T17:55:59.637496] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-17T17:55:59.637607] [INFO ] [MAIN ] Update Progress: 408/2368 symbols completed. CBZ took 37.7s. Estimated remaining: 4h 28m 41s. Rate: 7.3 symbols/min [2025-10-17T17:55:59.807038] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:55:59.822729] [DEBUG] [LOCAL ] CCIF: Loaded 15625 existing records from primary storage. [2025-10-17T17:55:59.823107] [INFO ] [MAIN ] CCIF: Loaded 15625 existing records. [2025-10-17T17:55:59.974827] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-17T17:56:00.005106] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:56:00.006444] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-17T17:56:00.006636] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-17T17:56:00.007111] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-17T17:56:00.007206] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-17T17:56:00.418727] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:00.420693] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-17T17:56:00.758054] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-17T17:56:00.811128] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T17:56:00.811999] [INFO ] [REMOTE ] CCIA: Full fetch complete (2156 records). [2025-10-17T17:56:00.812067] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-17T17:56:00.991439] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T17:56:00.991615] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-17T17:56:00.991703] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-17T17:56:00.991779] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-17T17:56:00.991843] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-17T17:56:00.991880] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-17T17:56:00.991919] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-17T17:56:00.991975] [INFO ] [MAIN ] Update Progress: 409/2368 symbols completed. CCIA took 27.6s. Estimated remaining: 4h 27m 59s. Rate: 7.3 symbols/min [2025-10-17T17:56:01.158931] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:56:01.213625] [DEBUG] [LOCAL ] CCJ: Loaded 54078 existing records from primary storage. [2025-10-17T17:56:01.213981] [INFO ] [MAIN ] CCJ: Loaded 54078 existing records. [2025-10-17T17:56:01.398715] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:56:01.398932] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-17T17:56:01.399009] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-17T17:56:01.410217] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-17T17:56:01.410429] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-17T17:56:01.528318] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-17T17:56:01.575089] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-17T17:56:01.615711] [INFO ] [REMOTE ] CC: Full fetch complete (76109 records). [2025-10-17T17:56:01.637690] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-17T17:56:01.782534] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-17T17:56:01.973384] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:02.211164] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-17T17:56:02.211251] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-17T17:56:02.212214] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-17T17:56:02.212278] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-17T17:56:02.213764] [DEBUG] [LOCAL ] CC: Trimmed 76109 records to 53789 (keeping 200 days of data) [2025-10-17T17:56:02.391394] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-17T17:56:02.544728] [DEBUG] [LOCAL ] CC: Primary data saved (53789 records). [2025-10-17T17:56:02.544867] [INFO ] [MAIN ] CC: Full history saved. [2025-10-17T17:56:02.544965] [INFO ] [MAIN ] Update Progress: 410/2368 symbols completed. CC took 40.2s. Estimated remaining: 4h 27m 19s. Rate: 7.3 symbols/min [2025-10-17T17:56:02.716213] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:56:02.759116] [DEBUG] [LOCAL ] CCK: Loaded 46797 existing records from primary storage. [2025-10-17T17:56:02.759458] [INFO ] [MAIN ] CCK: Loaded 46797 existing records. [2025-10-17T17:56:02.950746] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:56:02.950943] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-17T17:56:02.950990] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-17T17:56:02.951420] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-17T17:56:02.951466] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-17T17:56:03.168292] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-17T17:56:03.322356] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:03.352546] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-17T17:56:03.430687] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T17:56:03.958042] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-17T17:56:04.758004] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-17T17:56:04.798161] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-17T17:56:05.244484] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-17T17:56:05.557997] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-17T17:56:06.358069] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-17T17:56:06.731453] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T17:56:07.158105] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-17T17:56:07.401560] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T17:56:07.591412] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-17T17:56:07.958052] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-17T17:56:08.473812] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T17:56:08.758048] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-17T17:56:09.041726] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-17T17:56:09.558045] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-17T17:56:10.358019] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-17T17:56:10.771418] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-17T17:56:11.158136] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-17T17:56:11.354275] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-17T17:56:11.707989] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-17T17:56:11.715466] [INFO ] [REMOTE ] CCI: Full fetch complete (77102 records). [2025-10-17T17:56:11.715698] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-17T17:56:11.969181] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-17T17:56:12.163634] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-17T17:56:12.163746] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-17T17:56:12.164555] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-17T17:56:12.164602] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-17T17:56:12.166154] [DEBUG] [LOCAL ] CCI: Trimmed 77102 records to 53890 (keeping 200 days of data) [2025-10-17T17:56:12.498199] [DEBUG] [LOCAL ] CCI: Primary data saved (53890 records). [2025-10-17T17:56:12.498341] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-17T17:56:12.499082] [INFO ] [MAIN ] Update Progress: 411/2368 symbols completed. CCI took 41.8s. Estimated remaining: 4h 27m 20s. Rate: 7.3 symbols/min [2025-10-17T17:56:12.677275] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:56:12.732907] [DEBUG] [LOCAL ] CCL: Loaded 54190 existing records from primary storage. [2025-10-17T17:56:12.733249] [INFO ] [MAIN ] CCL: Loaded 54190 existing records. [2025-10-17T17:56:12.764256] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-17T17:56:12.916563] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:56:12.917224] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-17T17:56:12.917343] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-17T17:56:12.925895] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-17T17:56:12.926251] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-17T17:56:12.926179] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T17:56:13.305712] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:13.325890] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-17T17:56:13.557995] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-17T17:56:14.358048] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-17T17:56:14.454869] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T17:56:15.158037] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-17T17:56:15.326993] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-17T17:56:15.618038] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T17:56:15.958038] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-17T17:56:16.758035] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-17T17:56:17.006038] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T17:56:17.527624] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-17T17:56:17.557991] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-17T17:56:18.218009] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T17:56:18.358023] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-17T17:56:18.562020] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T17:56:19.158079] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-17T17:56:19.958027] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-17T17:56:20.505019] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-17T17:56:20.758071] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-17T17:56:21.268891] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T17:56:21.273000] [INFO ] [REMOTE ] CCIF: Full fetch complete (21861 records). [2025-10-17T17:56:21.273279] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-17T17:56:21.561864] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-17T17:56:21.660623] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-17T17:56:21.660735] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-17T17:56:21.661286] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-17T17:56:21.661469] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-17T17:56:21.673513] [DEBUG] [LOCAL ] CCIF: Trimmed 21861 records to 15711 (keeping 200 days of data) [2025-10-17T17:56:21.694138] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-17T17:56:21.796454] [DEBUG] [LOCAL ] CCIF: Primary data saved (15711 records). [2025-10-17T17:56:21.796588] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-17T17:56:21.796687] [INFO ] [MAIN ] Update Progress: 412/2368 symbols completed. CCIF took 22.2s. Estimated remaining: 4h 27m 17s. Rate: 7.3 symbols/min [2025-10-17T17:56:21.963936] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:56:22.005898] [DEBUG] [LOCAL ] CCO: Loaded 48741 existing records from primary storage. [2025-10-17T17:56:22.006234] [INFO ] [MAIN ] CCO: Loaded 48741 existing records. [2025-10-17T17:56:22.178275] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:56:22.178476] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-17T17:56:22.178523] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-17T17:56:22.178775] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-17T17:56:22.178831] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-17T17:56:22.361235] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-17T17:56:22.536563] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:22.564227] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T17:56:23.158108] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-17T17:56:23.838088] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-17T17:56:23.958057] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-17T17:56:24.626079] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-17T17:56:24.763173] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-17T17:56:24.782440] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T17:56:25.558061] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-17T17:56:25.978285] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T17:56:26.358092] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-17T17:56:27.158103] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-17T17:56:27.244900] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T17:56:27.311120] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-17T17:56:27.958062] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-17T17:56:28.405591] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T17:56:28.663810] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-17T17:56:28.757999] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-17T17:56:29.558107] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-17T17:56:30.329100] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-17T17:56:30.357979] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-17T17:56:30.946097] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T17:56:31.158006] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-17T17:56:31.240873] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-17T17:56:31.958044] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-17T17:56:32.627262] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T17:56:32.726008] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-17T17:56:32.758001] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-17T17:56:33.535959] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T17:56:33.557999] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-17T17:56:34.358086] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-17T17:56:34.994874] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-17T17:56:35.158088] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-17T17:56:35.194137] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T17:56:35.958047] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-17T17:56:36.691400] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-17T17:56:36.758633] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-17T17:56:36.758798] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-17T17:56:36.773269] [INFO ] [REMOTE ] CCJ: Full fetch complete (77840 records). [2025-10-17T17:56:36.773529] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-17T17:56:37.185623] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-17T17:56:37.185747] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-17T17:56:37.186624] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-17T17:56:37.186713] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-17T17:56:37.188367] [DEBUG] [LOCAL ] CCJ: Trimmed 77840 records to 54468 (keeping 200 days of data) [2025-10-17T17:56:37.514396] [DEBUG] [LOCAL ] CCJ: Primary data saved (54468 records). [2025-10-17T17:56:37.514706] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-17T17:56:37.515591] [INFO ] [MAIN ] Update Progress: 413/2368 symbols completed. CCJ took 36.5s. Estimated remaining: 4h 27m 44s. Rate: 7.3 symbols/min [2025-10-17T17:56:37.563126] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-17T17:56:37.601667] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T17:56:37.726545] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:56:37.738687] [DEBUG] [LOCAL ] CCRD: Loaded 9580 existing records from primary storage. [2025-10-17T17:56:37.738927] [INFO ] [MAIN ] CCRD: Loaded 9580 existing records. [2025-10-17T17:56:37.911519] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:56:37.911766] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-17T17:56:37.911821] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-17T17:56:37.912001] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-17T17:56:37.912039] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-17T17:56:38.265316] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:38.363126] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-17T17:56:38.381200] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T17:56:39.158043] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-17T17:56:39.958043] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-17T17:56:39.992377] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T17:56:40.116408] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-17T17:56:40.416452] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-17T17:56:40.758036] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-17T17:56:40.867004] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T17:56:41.558030] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-17T17:56:42.358040] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-17T17:56:42.968078] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-17T17:56:43.085392] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-17T17:56:43.163122] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-17T17:56:43.180306] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T17:56:43.875185] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-17T17:56:43.958028] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-17T17:56:44.758089] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-17T17:56:45.331720] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-17T17:56:45.558034] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-17T17:56:46.049582] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-17T17:56:46.358090] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-17T17:56:47.158078] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-17T17:56:47.235948] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T17:56:47.761839] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-17T17:56:47.958031] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-17T17:56:48.553226] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-17T17:56:48.561194] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-17T17:56:48.561384] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-17T17:56:48.763187] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-17T17:56:48.964594] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-17T17:56:48.964705] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-17T17:56:48.965691] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-17T17:56:48.965758] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-17T17:56:48.967242] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 54580 (keeping 200 days of data) [2025-10-17T17:56:49.235896] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T17:56:49.346336] [DEBUG] [LOCAL ] CCL: Primary data saved (54580 records). [2025-10-17T17:56:49.346548] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-17T17:56:49.347143] [INFO ] [MAIN ] Update Progress: 414/2368 symbols completed. CCL took 36.8s. Estimated remaining: 4h 27m 53s. Rate: 7.3 symbols/min [2025-10-17T17:56:49.512376] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:56:49.543631] [DEBUG] [LOCAL ] CCS: Loaded 30488 existing records from primary storage. [2025-10-17T17:56:49.543926] [INFO ] [MAIN ] CCS: Loaded 30488 existing records. [2025-10-17T17:56:49.564196] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-17T17:56:49.724285] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:56:49.724496] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-17T17:56:49.724546] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-17T17:56:49.724771] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-17T17:56:49.724830] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-17T17:56:50.077211] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:50.293660] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-17T17:56:50.358015] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-17T17:56:50.696774] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T17:56:50.703634] [INFO ] [REMOTE ] CCK: Full fetch complete (67887 records). [2025-10-17T17:56:50.703790] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-17T17:56:51.143570] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-17T17:56:51.143705] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-17T17:56:51.144665] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-17T17:56:51.144746] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-17T17:56:51.146274] [DEBUG] [LOCAL ] CCK: Trimmed 67887 records to 47154 (keeping 200 days of data) [2025-10-17T17:56:51.203589] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-17T17:56:51.391950] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T17:56:51.470899] [DEBUG] [LOCAL ] CCK: Primary data saved (47154 records). [2025-10-17T17:56:51.471043] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-17T17:56:51.471127] [INFO ] [MAIN ] Update Progress: 415/2368 symbols completed. CCK took 48.9s. Estimated remaining: 4h 27m 16s. Rate: 7.3 symbols/min [2025-10-17T17:56:51.657202] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:56:51.681407] [DEBUG] [LOCAL ] CCU: Loaded 22447 existing records from primary storage. [2025-10-17T17:56:51.681686] [INFO ] [MAIN ] CCU: Loaded 22447 existing records. [2025-10-17T17:56:51.869168] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:56:51.869414] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-17T17:56:51.869467] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-17T17:56:51.869744] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-17T17:56:51.869802] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-17T17:56:51.965367] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-17T17:56:52.230723] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:52.629689] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-17T17:56:52.758071] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-17T17:56:52.993175] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T17:56:53.558056] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-17T17:56:53.904693] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T17:56:54.358086] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-17T17:56:55.158010] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-17T17:56:55.201464] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T17:56:55.208260] [INFO ] [REMOTE ] CCO: Full fetch complete (67103 records). [2025-10-17T17:56:55.208379] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-17T17:56:55.594925] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-17T17:56:55.595062] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-17T17:56:55.595878] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-17T17:56:55.595944] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-17T17:56:55.597271] [DEBUG] [LOCAL ] CCO: Trimmed 67103 records to 49089 (keeping 200 days of data) [2025-10-17T17:56:55.825079] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T17:56:55.888500] [DEBUG] [LOCAL ] CCO: Primary data saved (49089 records). [2025-10-17T17:56:55.888668] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-17T17:56:55.888776] [INFO ] [MAIN ] Update Progress: 416/2368 symbols completed. CCO took 34.1s. Estimated remaining: 4h 26m 50s. Rate: 7.3 symbols/min [2025-10-17T17:56:55.963125] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-17T17:56:56.057703] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:56:56.057880] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-17T17:56:56.057919] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-17T17:56:56.058030] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-17T17:56:56.058071] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-17T17:56:56.058113] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-17T17:56:56.058145] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-17T17:56:56.343296] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T17:56:56.425194] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:56:56.758012] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-17T17:56:57.387731] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T17:56:57.558019] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-17T17:56:57.722453] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T17:56:58.358080] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-17T17:56:58.577868] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T17:56:59.152559] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-17T17:56:59.157971] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-17T17:56:59.400558] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-17T17:56:59.958020] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-17T17:57:00.758025] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-17T17:57:01.558039] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-17T17:57:01.688480] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T17:57:01.899043] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T17:57:02.358086] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-17T17:57:03.096842] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T17:57:03.158027] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-17T17:57:03.231714] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-17T17:57:03.958007] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-17T17:57:04.750937] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T17:57:04.757984] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-17T17:57:05.319862] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T17:57:05.558008] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-17T17:57:05.576996] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T17:57:05.578692] [INFO ] [REMOTE ] CCRD: Full fetch complete (11900 records). [2025-10-17T17:57:05.578763] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-17T17:57:05.928440] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-17T17:57:05.928519] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-17T17:57:05.928818] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-17T17:57:05.928880] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-17T17:57:05.929368] [DEBUG] [LOCAL ] CCRD: Trimmed 11900 records to 9647 (keeping 200 days of data) [2025-10-17T17:57:05.993261] [DEBUG] [LOCAL ] CCRD: Primary data saved (9647 records). [2025-10-17T17:57:05.993380] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-17T17:57:05.993461] [INFO ] [MAIN ] Update Progress: 417/2368 symbols completed. CCRD took 28.5s. Estimated remaining: 4h 26m 51s. Rate: 7.3 symbols/min [2025-10-17T17:57:06.163637] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:57:06.215751] [DEBUG] [LOCAL ] CDE: Loaded 54033 existing records from primary storage. [2025-10-17T17:57:06.216093] [INFO ] [MAIN ] CDE: Loaded 54033 existing records. [2025-10-17T17:57:06.365567] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-17T17:57:06.396624] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:57:06.397878] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-17T17:57:06.397986] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-17T17:57:06.398220] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-17T17:57:06.398277] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-17T17:57:06.734237] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-17T17:57:06.759111] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:57:07.129329] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T17:57:07.157986] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-17T17:57:07.479502] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-17T17:57:07.958026] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-17T17:57:08.243279] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-17T17:57:08.758079] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-17T17:57:09.558078] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-17T17:57:10.358018] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-17T17:57:10.639217] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T17:57:10.740988] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:57:10.741495] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-17T17:57:10.741597] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:57:10.741717] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-17T17:57:10.741791] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:57:10.741868] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-17T17:57:10.741941] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-17T17:57:10.741981] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-17T17:57:10.742022] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-17T17:57:10.742077] [INFO ] [MAIN ] Update Progress: 418/2368 symbols completed. CCZ took 14.9s. Estimated remaining: 4h 26m 26s. Rate: 7.3 symbols/min [2025-10-17T17:57:10.948936] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:57:10.947113] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-17T17:57:10.966468] [DEBUG] [LOCAL ] CDLR: Loaded 10199 existing records from primary storage. [2025-10-17T17:57:10.966726] [INFO ] [MAIN ] CDLR: Loaded 10199 existing records. [2025-10-17T17:57:11.155339] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:57:11.155616] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-17T17:57:11.155698] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-17T17:57:11.156005] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-17T17:57:11.156073] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-17T17:57:11.167233] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-17T17:57:11.541707] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:57:11.958058] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-17T17:57:12.296057] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T17:57:12.758064] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-17T17:57:13.071278] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T17:57:13.558021] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-17T17:57:14.358074] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-17T17:57:14.924500] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-17T17:57:15.046089] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T17:57:15.158012] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-17T17:57:15.252363] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-17T17:57:15.958087] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-17T17:57:16.758020] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-17T17:57:17.134937] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-17T17:57:17.365918] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T17:57:17.515475] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-17T17:57:17.557978] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-17T17:57:18.149617] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T17:57:18.358094] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-17T17:57:19.158062] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-17T17:57:19.673830] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T17:57:19.751437] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T17:57:19.958091] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-17T17:57:20.758047] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-17T17:57:20.902074] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-17T17:57:21.558098] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-17T17:57:21.665338] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T17:57:22.358097] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-17T17:57:22.854538] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-17T17:57:23.162783] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-17T17:57:23.163598] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T17:57:23.958061] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-17T17:57:24.758086] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-17T17:57:24.938084] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-17T17:57:25.119472] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-17T17:57:25.558067] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-17T17:57:25.602967] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T17:57:26.358041] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-17T17:57:27.158050] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-17T17:57:27.495494] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T17:57:27.848167] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T17:57:27.852744] [INFO ] [REMOTE ] CCS: Full fetch complete (44812 records). [2025-10-17T17:57:27.852880] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-17T17:57:27.963134] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-17T17:57:28.184418] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T17:57:28.276192] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-17T17:57:28.276298] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-17T17:57:28.277175] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-17T17:57:28.277246] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-17T17:57:28.278624] [DEBUG] [LOCAL ] CCS: Trimmed 44812 records to 30600 (keeping 200 days of data) [2025-10-17T17:57:28.485718] [DEBUG] [LOCAL ] CCS: Primary data saved (30600 records). [2025-10-17T17:57:28.485906] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-17T17:57:28.486427] [INFO ] [MAIN ] Update Progress: 419/2368 symbols completed. CCS took 39.1s. Estimated remaining: 4h 27m 3s. Rate: 7.3 symbols/min [2025-10-17T17:57:28.656525] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:57:28.697594] [DEBUG] [LOCAL ] CDP: Loaded 42851 existing records from primary storage. [2025-10-17T17:57:28.697948] [INFO ] [MAIN ] CDP: Loaded 42851 existing records. [2025-10-17T17:57:28.763311] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-17T17:57:28.882449] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:57:28.882694] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-17T17:57:28.882754] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-17T17:57:28.883021] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-17T17:57:28.883076] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-17T17:57:29.002058] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T17:57:29.053639] [INFO ] [REMOTE ] CCU: Full fetch complete (32567 records). [2025-10-17T17:57:29.078169] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-17T17:57:29.416401] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:57:29.563118] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-17T17:57:29.651530] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-17T17:57:29.651624] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-17T17:57:29.652344] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-17T17:57:29.652410] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-17T17:57:29.653255] [DEBUG] [LOCAL ] CCU: Trimmed 32567 records to 22640 (keeping 200 days of data) [2025-10-17T17:57:29.793203] [DEBUG] [LOCAL ] CCU: Primary data saved (22640 records). [2025-10-17T17:57:29.793352] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-17T17:57:29.793470] [INFO ] [MAIN ] Update Progress: 420/2368 symbols completed. CCU took 38.3s. Estimated remaining: 4h 26m 22s. Rate: 7.3 symbols/min [2025-10-17T17:57:29.985790] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:57:30.011517] [DEBUG] [LOCAL ] CDRE: Loaded 25091 existing records from primary storage. [2025-10-17T17:57:30.011836] [INFO ] [MAIN ] CDRE: Loaded 25091 existing records. [2025-10-17T17:57:30.210246] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:57:30.210442] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-17T17:57:30.210497] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-17T17:57:30.210909] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-17T17:57:30.210967] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-17T17:57:30.365394] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-17T17:57:30.602849] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:57:30.636562] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T17:57:31.158046] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-17T17:57:31.275835] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T17:57:31.328244] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T17:57:31.958075] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-17T17:57:32.461242] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T17:57:32.740016] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T17:57:32.758057] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-17T17:57:33.558077] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-17T17:57:34.358020] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-17T17:57:34.650228] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-17T17:57:35.110198] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T17:57:35.157987] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-17T17:57:35.550345] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T17:57:35.958128] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-17T17:57:36.758125] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-17T17:57:37.142354] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-17T17:57:37.487986] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T17:57:37.560099] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-17T17:57:37.564482] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T17:57:38.358089] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-17T17:57:39.139281] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T17:57:39.158021] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-17T17:57:39.958089] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-17T17:57:40.091443] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T17:57:40.407056] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-17T17:57:40.758014] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-17T17:57:41.047852] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-17T17:57:41.050396] [INFO ] [REMOTE ] CDLR: Full fetch complete (13995 records). [2025-10-17T17:57:41.050468] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-17T17:57:41.398524] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-17T17:57:41.398601] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-17T17:57:41.398943] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-17T17:57:41.399004] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-17T17:57:41.399468] [DEBUG] [LOCAL ] CDLR: Trimmed 13995 records to 10294 (keeping 200 days of data) [2025-10-17T17:57:41.457020] [DEBUG] [LOCAL ] CDLR: Primary data saved (10294 records). [2025-10-17T17:57:41.457151] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-17T17:57:41.457230] [INFO ] [MAIN ] Update Progress: 421/2368 symbols completed. CDLR took 30.7s. Estimated remaining: 4h 26m 30s. Rate: 7.3 symbols/min [2025-10-17T17:57:41.563170] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-17T17:57:41.624846] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:57:41.672187] [DEBUG] [LOCAL ] CE: Loaded 51713 existing records from primary storage. [2025-10-17T17:57:41.672566] [INFO ] [MAIN ] CE: Loaded 51713 existing records. [2025-10-17T17:57:41.872534] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:57:41.872821] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-17T17:57:41.872871] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-17T17:57:41.873220] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-17T17:57:41.873278] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-17T17:57:42.213994] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:57:42.358038] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-17T17:57:42.978512] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-17T17:57:43.158047] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-17T17:57:43.384371] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T17:57:43.958002] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-17T17:57:44.433898] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-17T17:57:44.758047] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-17T17:57:45.210211] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T17:57:45.558459] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-17T17:57:45.559521] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-17T17:57:45.569365] [INFO ] [REMOTE ] CDE: Full fetch complete (77783 records). [2025-10-17T17:57:45.569560] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-17T17:57:45.986062] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-17T17:57:45.986198] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-17T17:57:45.987296] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-17T17:57:45.987364] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-17T17:57:45.989595] [DEBUG] [LOCAL ] CDE: Trimmed 77783 records to 54423 (keeping 200 days of data) [2025-10-17T17:57:46.328089] [DEBUG] [LOCAL ] CDE: Primary data saved (54423 records). [2025-10-17T17:57:46.328293] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-17T17:57:46.328879] [INFO ] [MAIN ] Update Progress: 422/2368 symbols completed. CDE took 40.3s. Estimated remaining: 4h 26m 6s. Rate: 7.3 symbols/min [2025-10-17T17:57:46.361631] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-17T17:57:46.518043] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:57:46.550335] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T17:57:46.564398] [DEBUG] [LOCAL ] CEE: Loaded 5411 existing records from primary storage. [2025-10-17T17:57:46.565615] [INFO ] [MAIN ] CEE: Loaded 5411 existing records. [2025-10-17T17:57:46.755773] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:57:46.756079] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-17T17:57:46.756129] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-17T17:57:46.756327] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-17T17:57:46.756384] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-17T17:57:47.143616] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:57:47.158011] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-17T17:57:47.217856] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T17:57:47.535514] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T17:57:47.958048] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-17T17:57:48.758056] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-17T17:57:48.818195] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T17:57:49.447001] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T17:57:49.558077] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-17T17:57:49.965228] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T17:57:50.266519] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-17T17:57:50.358087] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-17T17:57:51.158007] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-17T17:57:51.513876] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T17:57:51.958040] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-17T17:57:52.545468] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T17:57:52.758020] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-17T17:57:52.902558] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T17:57:53.558080] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-17T17:57:53.863223] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T17:57:54.358023] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-17T17:57:55.158037] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-17T17:57:55.159541] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T17:57:55.678277] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T17:57:55.958035] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-17T17:57:56.758030] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-17T17:57:56.793161] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-17T17:57:57.083875] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T17:57:57.558098] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-17T17:57:58.204130] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T17:57:58.358029] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-17T17:57:58.981974] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T17:57:59.158043] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-17T17:57:59.867813] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T17:57:59.958075] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-17T17:58:00.153241] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-17T17:58:00.758077] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-17T17:58:01.558031] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-17T17:58:01.766818] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T17:58:01.773078] [INFO ] [REMOTE ] CDP: Full fetch complete (61989 records). [2025-10-17T17:58:01.773257] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-17T17:58:02.092317] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T17:58:02.182572] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-17T17:58:02.182693] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-17T17:58:02.183433] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-17T17:58:02.183482] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-17T17:58:02.184838] [DEBUG] [LOCAL ] CDP: Trimmed 61989 records to 43123 (keeping 200 days of data) [2025-10-17T17:58:02.360423] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-17T17:58:02.449310] [DEBUG] [LOCAL ] CDP: Primary data saved (43123 records). [2025-10-17T17:58:02.449445] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-17T17:58:02.450049] [INFO ] [MAIN ] Update Progress: 423/2368 symbols completed. CDP took 34.0s. Estimated remaining: 4h 26m 35s. Rate: 7.3 symbols/min [2025-10-17T17:58:02.620068] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:58:02.620261] [DEBUG] [LOCAL ] CEPU: No existing data file found in primary storage. [2025-10-17T17:58:02.620309] [WARN ] [MAIN ] CEPU: No existing data found, performing full refresh instead. [2025-10-17T17:58:02.620421] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-17T17:58:02.620463] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-17T17:58:02.620505] [DEBUG] [LOCAL ] CEPU: No primary data file found to delete. [2025-10-17T17:58:02.620538] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-17T17:58:02.967845] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:58:03.145093] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-17T17:58:03.157977] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-17T17:58:03.277808] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T17:58:03.837219] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-17T17:58:03.958031] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-17T17:58:04.758043] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-17T17:58:05.495516] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T17:58:05.558071] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-17T17:58:06.358066] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-17T17:58:06.446874] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T17:58:06.908066] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T17:58:07.012201] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-17T17:58:07.158043] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-17T17:58:07.741518] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-17T17:58:07.958071] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-17T17:58:08.665804] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T17:58:08.758082] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-17T17:58:09.558068] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-17T17:58:10.233754] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T17:58:10.237992] [INFO ] [REMOTE ] CDRE: Full fetch complete (35116 records). [2025-10-17T17:58:10.238110] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-17T17:58:10.327832] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T17:58:10.363120] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-17T17:58:10.640664] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-17T17:58:10.640758] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-17T17:58:10.641295] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-17T17:58:10.641339] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-17T17:58:10.642177] [DEBUG] [LOCAL ] CDRE: Trimmed 35116 records to 25250 (keeping 200 days of data) [2025-10-17T17:58:10.793168] [DEBUG] [LOCAL ] CDRE: Primary data saved (25250 records). [2025-10-17T17:58:10.793326] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-17T17:58:10.793523] [INFO ] [MAIN ] Update Progress: 424/2368 symbols completed. CDRE took 41.0s. Estimated remaining: 4h 26m 27s. Rate: 7.3 symbols/min [2025-10-17T17:58:10.958483] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:58:11.007562] [DEBUG] [LOCAL ] CF: Loaded 52532 existing records from primary storage. [2025-10-17T17:58:11.007920] [INFO ] [MAIN ] CF: Loaded 52532 existing records. [2025-10-17T17:58:11.159393] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-17T17:58:11.181771] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:58:11.182976] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-17T17:58:11.183034] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-17T17:58:11.183487] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-17T17:58:11.183601] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-17T17:58:11.554753] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:58:11.946719] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T17:58:11.948105] [INFO ] [REMOTE ] CEE: Full fetch complete (10169 records). [2025-10-17T17:58:11.948204] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-17T17:58:11.963349] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-17T17:58:12.356615] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-17T17:58:12.356827] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-17T17:58:12.357519] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-17T17:58:12.357602] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-17T17:58:12.358493] [DEBUG] [LOCAL ] CEE: Trimmed 10169 records to 5462 (keeping 200 days of data) [2025-10-17T17:58:12.424514] [DEBUG] [LOCAL ] CEE: Primary data saved (5462 records). [2025-10-17T17:58:12.428298] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-17T17:58:12.428161] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-17T17:58:12.428570] [INFO ] [MAIN ] Update Progress: 425/2368 symbols completed. CEE took 26.1s. Estimated remaining: 4h 25m 49s. Rate: 7.3 symbols/min [2025-10-17T17:58:12.679387] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:58:12.739201] [DEBUG] [LOCAL ] CFG: Loaded 54013 existing records from primary storage. [2025-10-17T17:58:12.739636] [INFO ] [MAIN ] CFG: Loaded 54013 existing records. [2025-10-17T17:58:12.763272] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-17T17:58:12.940927] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:58:12.941301] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-17T17:58:12.941365] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-17T17:58:12.941755] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-17T17:58:12.941813] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-17T17:58:13.268916] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T17:58:13.346879] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:58:13.558033] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-17T17:58:14.358085] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-17T17:58:14.609695] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T17:58:14.707674] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-17T17:58:15.158099] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-17T17:58:15.958056] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-17T17:58:16.132706] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T17:58:16.540608] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T17:58:16.758075] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-17T17:58:17.255172] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T17:58:17.558025] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-17T17:58:18.358081] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-17T17:58:18.401558] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T17:58:19.158036] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-17T17:58:19.425882] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T17:58:19.433066] [INFO ] [REMOTE ] CE: Full fetch complete (74836 records). [2025-10-17T17:58:19.433206] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-17T17:58:19.768868] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T17:58:19.852459] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-17T17:58:19.852541] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-17T17:58:19.853509] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-17T17:58:19.853577] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-17T17:58:19.855018] [DEBUG] [LOCAL ] CE: Trimmed 74836 records to 52065 (keeping 200 days of data) [2025-10-17T17:58:19.958219] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-17T17:58:20.167041] [DEBUG] [LOCAL ] CE: Primary data saved (52065 records). [2025-10-17T17:58:20.167184] [INFO ] [MAIN ] CE: Full history saved. [2025-10-17T17:58:20.167278] [INFO ] [MAIN ] Update Progress: 426/2368 symbols completed. CE took 38.7s. Estimated remaining: 4h 25m 38s. Rate: 7.3 symbols/min [2025-10-17T17:58:20.331767] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:58:20.331930] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-17T17:58:20.331968] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-17T17:58:20.332079] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-17T17:58:20.332138] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-17T17:58:20.332206] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-17T17:58:20.332253] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-17T17:58:20.682714] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:58:20.757997] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-17T17:58:20.970433] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T17:58:20.981199] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T17:58:20.981601] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-17T17:58:20.981958] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T17:58:20.982434] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-17T17:58:20.982932] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T17:58:20.983091] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-17T17:58:20.983183] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-17T17:58:20.983319] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-17T17:58:20.983397] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-17T17:58:20.995134] [INFO ] [MAIN ] Update Progress: 427/2368 symbols completed. CFND took 0.8s. Estimated remaining: 4h 24m 57s. Rate: 7.3 symbols/min [2025-10-17T17:58:20.996353] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T17:58:21.176837] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:58:21.212057] [DEBUG] [LOCAL ] CFR: Loaded 32885 existing records from primary storage. [2025-10-17T17:58:21.212338] [INFO ] [MAIN ] CFR: Loaded 32885 existing records. [2025-10-17T17:58:21.398786] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:58:21.399043] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-17T17:58:21.399092] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-17T17:58:21.399448] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-17T17:58:21.399508] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-17T17:58:21.565315] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-17T17:58:21.793325] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:58:22.358073] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-17T17:58:23.157998] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-17T17:58:23.220096] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T17:58:23.512465] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-17T17:58:23.958070] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-17T17:58:24.757995] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-17T17:58:25.056027] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T17:58:25.120396] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T17:58:25.558022] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-17T17:58:26.146693] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-17T17:58:26.358049] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-17T17:58:27.158005] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-17T17:58:27.321802] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-17T17:58:27.386134] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-17T17:58:27.958101] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-17T17:58:28.317282] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T17:58:28.758056] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-17T17:58:29.557995] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-17T17:58:29.761881] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-17T17:58:29.936998] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T17:58:30.358043] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-17T17:58:31.158077] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-17T17:58:31.292705] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T17:58:31.558323] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-17T17:58:31.958074] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-17T17:58:32.285563] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-17T17:58:32.291212] [INFO ] [REMOTE ] CEPU: Full fetch complete (39785 records). [2025-10-17T17:58:32.291411] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-17T17:58:32.719470] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-17T17:58:32.719591] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-17T17:58:32.720536] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-17T17:58:32.720606] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-17T17:58:32.722312] [DEBUG] [LOCAL ] CEPU: Trimmed 39785 records to 27225 (keeping 200 days of data) [2025-10-17T17:58:32.773725] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-17T17:58:32.895279] [DEBUG] [LOCAL ] CEPU: Primary data saved (27225 records). [2025-10-17T17:58:32.895426] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-17T17:58:32.895502] [INFO ] [MAIN ] Update Progress: 428/2368 symbols completed. CEPU took 30.4s. Estimated remaining: 4h 25m 5s. Rate: 7.3 symbols/min [2025-10-17T17:58:33.075201] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:58:33.128217] [DEBUG] [LOCAL ] CGAU: Loaded 43931 existing records from primary storage. [2025-10-17T17:58:33.128611] [INFO ] [MAIN ] CGAU: Loaded 43931 existing records. [2025-10-17T17:58:33.307273] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:58:33.307961] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-17T17:58:33.308079] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-17T17:58:33.308449] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-17T17:58:33.308519] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-17T17:58:33.567593] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-17T17:58:33.707069] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T17:58:33.712343] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:58:34.358093] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-17T17:58:34.783566] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-17T17:58:34.982411] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T17:58:35.158095] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-17T17:58:35.958099] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-17T17:58:36.231888] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T17:58:36.758166] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-17T17:58:36.887962] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T17:58:37.558078] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-17T17:58:37.775639] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T17:58:38.100926] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T17:58:38.358103] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-17T17:58:39.163151] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-17T17:58:39.177363] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T17:58:39.766296] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T17:58:39.958033] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-17T17:58:40.758068] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-17T17:58:40.992203] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T17:58:41.558021] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-17T17:58:41.731814] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T17:58:41.940929] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T17:58:42.358079] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-17T17:58:42.876942] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-17T17:58:43.158043] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-17T17:58:43.532900] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-17T17:58:43.958049] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-17T17:58:44.758148] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-17T17:58:44.862944] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T17:58:44.870413] [INFO ] [REMOTE ] CF: Full fetch complete (75600 records). [2025-10-17T17:58:44.870589] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-17T17:58:45.268341] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-17T17:58:45.268451] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-17T17:58:45.269300] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-17T17:58:45.269369] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-17T17:58:45.270963] [DEBUG] [LOCAL ] CF: Trimmed 75600 records to 52902 (keeping 200 days of data) [2025-10-17T17:58:45.566242] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-17T17:58:45.590015] [DEBUG] [LOCAL ] CF: Primary data saved (52902 records). [2025-10-17T17:58:45.590154] [INFO ] [MAIN ] CF: Full history saved. [2025-10-17T17:58:45.590236] [INFO ] [MAIN ] Update Progress: 429/2368 symbols completed. CF took 34.8s. Estimated remaining: 4h 25m 17s. Rate: 7.3 symbols/min [2025-10-17T17:58:45.758836] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:58:45.762568] [DEBUG] [LOCAL ] CGV: Loaded 1404 existing records from primary storage. [2025-10-17T17:58:45.762842] [INFO ] [MAIN ] CGV: Loaded 1404 existing records. [2025-10-17T17:58:45.915556] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-17T17:58:45.989439] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:58:45.989898] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-17T17:58:45.990513] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-17T17:58:45.990703] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-17T17:58:45.990760] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-17T17:58:46.352662] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:58:46.363117] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-17T17:58:46.378764] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T17:58:46.925937] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T17:58:46.977253] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-17T17:58:47.158027] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-17T17:58:47.958067] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-17T17:58:48.677160] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T17:58:48.758018] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-17T17:58:49.558067] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-17T17:58:49.812747] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T17:58:50.031772] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-17T17:58:50.220079] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T17:58:50.358101] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-17T17:58:51.158111] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-17T17:58:51.919572] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T17:58:51.958049] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-17T17:58:52.458434] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-17T17:58:52.528198] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T17:58:52.533038] [INFO ] [REMOTE ] CFR: Full fetch complete (48518 records). [2025-10-17T17:58:52.533187] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-17T17:58:52.763291] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-17T17:58:52.946128] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-17T17:58:52.946248] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-17T17:58:52.947132] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-17T17:58:52.947206] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-17T17:58:52.948860] [DEBUG] [LOCAL ] CFR: Trimmed 48518 records to 33178 (keeping 200 days of data) [2025-10-17T17:58:53.173440] [DEBUG] [LOCAL ] CFR: Primary data saved (33178 records). [2025-10-17T17:58:53.173700] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-17T17:58:53.173834] [INFO ] [MAIN ] Update Progress: 430/2368 symbols completed. CFR took 32.2s. Estimated remaining: 4h 25m 6s. Rate: 7.3 symbols/min [2025-10-17T17:58:53.342843] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:58:53.369370] [DEBUG] [LOCAL ] CHCT: Loaded 24391 existing records from primary storage. [2025-10-17T17:58:53.369752] [INFO ] [MAIN ] CHCT: Loaded 24391 existing records. [2025-10-17T17:58:53.555687] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:58:53.555990] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-17T17:58:53.556044] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-17T17:58:53.556310] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-17T17:58:53.556352] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-17T17:58:53.568030] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-17T17:58:53.960132] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:58:54.353121] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T17:58:54.364960] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-17T17:58:54.791458] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-17T17:58:55.158008] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-17T17:58:55.353995] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T17:58:55.958075] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-17T17:58:56.424495] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T17:58:56.758048] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-17T17:58:57.558080] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-17T17:58:57.883080] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-17T17:58:58.077785] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-17T17:58:58.110863] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-17T17:58:58.358055] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-17T17:58:59.158068] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-17T17:58:59.614272] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T17:58:59.958068] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-17T17:59:00.758061] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-17T17:59:01.169927] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-17T17:59:01.259062] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T17:59:01.476992] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-17T17:59:01.484318] [INFO ] [REMOTE ] CFG: Full fetch complete (77759 records). [2025-10-17T17:59:01.484435] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-17T17:59:01.563315] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-17T17:59:01.946388] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-17T17:59:01.946501] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-17T17:59:01.947550] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-17T17:59:01.947665] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-17T17:59:01.949723] [DEBUG] [LOCAL ] CFG: Trimmed 77759 records to 54403 (keeping 200 days of data) [2025-10-17T17:59:02.308917] [DEBUG] [LOCAL ] CFG: Primary data saved (54403 records). [2025-10-17T17:59:02.309113] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-17T17:59:02.309696] [INFO ] [MAIN ] Update Progress: 431/2368 symbols completed. CFG took 49.9s. Estimated remaining: 4h 25m 2s. Rate: 7.3 symbols/min [2025-10-17T17:59:02.363244] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-17T17:59:02.493141] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:59:02.552857] [DEBUG] [LOCAL ] CHD: Loaded 52698 existing records from primary storage. [2025-10-17T17:59:02.553280] [INFO ] [MAIN ] CHD: Loaded 52698 existing records. [2025-10-17T17:59:02.753721] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:59:02.770332] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-17T17:59:02.771141] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-17T17:59:02.771731] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T17:59:02.778379] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-17T17:59:02.778543] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-17T17:59:03.169291] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-17T17:59:03.177098] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:59:03.616919] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-17T17:59:03.950169] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T17:59:03.960171] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-17T17:59:04.418812] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-17T17:59:04.758034] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-17T17:59:05.558033] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-17T17:59:05.851835] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T17:59:05.967541] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-17T17:59:06.358018] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-17T17:59:07.158023] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-17T17:59:07.958033] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-17T17:59:08.136452] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T17:59:08.484044] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-17T17:59:08.758053] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-17T17:59:09.060108] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T17:59:09.067605] [INFO ] [REMOTE ] CGAU: Full fetch complete (61787 records). [2025-10-17T17:59:09.067833] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-17T17:59:09.247960] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-17T17:59:09.299734] [INFO ] [REMOTE ] CGV: Full fetch complete (2275 records). [2025-10-17T17:59:09.344419] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-17T17:59:09.559687] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-17T17:59:09.686794] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-17T17:59:09.744930] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-17T17:59:09.756813] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-17T17:59:09.772541] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-17T17:59:09.844162] [DEBUG] [LOCAL ] CGAU: Trimmed 61787 records to 44311 (keeping 200 days of data) [2025-10-17T17:59:09.867058] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-17T17:59:09.867130] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-17T17:59:09.867202] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-17T17:59:09.867241] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-17T17:59:09.867688] [DEBUG] [LOCAL ] CGV: Trimmed 2275 records to 1418 (keeping 200 days of data) [2025-10-17T17:59:09.877502] [DEBUG] [LOCAL ] CGV: Primary data saved (1418 records). [2025-10-17T17:59:09.877602] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-17T17:59:09.877712] [INFO ] [MAIN ] Update Progress: 432/2368 symbols completed. CGV took 24.3s. Estimated remaining: 4h 24m 51s. Rate: 7.3 symbols/min [2025-10-17T17:59:10.146162] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:59:10.176574] [DEBUG] [LOCAL ] CHE: Loaded 15454 existing records from primary storage. [2025-10-17T17:59:10.182630] [INFO ] [MAIN ] CHE: Loaded 15454 existing records. [2025-10-17T17:59:10.368151] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-17T17:59:10.460221] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:59:10.464682] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-17T17:59:10.464978] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-17T17:59:10.465856] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-17T17:59:10.465928] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-17T17:59:10.661908] [DEBUG] [LOCAL ] CGAU: Primary data saved (44311 records). [2025-10-17T17:59:10.723310] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-17T17:59:10.747949] [INFO ] [MAIN ] Update Progress: 433/2368 symbols completed. CGAU took 37.9s. Estimated remaining: 4h 24m 10s. Rate: 7.3 symbols/min [2025-10-17T17:59:11.006586] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:59:11.050566] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:59:11.067166] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T17:59:11.112162] [DEBUG] [LOCAL ] CHGG: Loaded 48094 existing records from primary storage. [2025-10-17T17:59:11.112470] [INFO ] [MAIN ] CHGG: Loaded 48094 existing records. [2025-10-17T17:59:11.165597] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-17T17:59:11.287921] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:59:11.288130] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-17T17:59:11.288202] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-17T17:59:11.288962] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-17T17:59:11.289019] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-17T17:59:11.675202] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:59:11.831145] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T17:59:11.958026] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-17T17:59:12.137212] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-17T17:59:12.758077] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-17T17:59:13.539195] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T17:59:13.558003] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-17T17:59:13.919452] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T17:59:14.358040] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-17T17:59:14.423245] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T17:59:15.158071] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-17T17:59:15.958005] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-17T17:59:15.996254] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-17T17:59:16.393087] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-17T17:59:16.758078] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-17T17:59:17.030189] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T17:59:17.558023] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-17T17:59:18.357990] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-17T17:59:18.559335] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T17:59:18.594714] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T17:59:19.158067] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-17T17:59:19.958016] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-17T17:59:20.041354] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T17:59:20.057763] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T17:59:20.758073] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-17T17:59:21.532707] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T17:59:21.557978] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-17T17:59:22.358532] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-17T17:59:22.374717] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T17:59:22.460674] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T17:59:23.158107] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-17T17:59:23.419959] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T17:59:23.958098] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-17T17:59:24.008543] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T17:59:24.758044] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-17T17:59:25.558019] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-17T17:59:25.594923] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T17:59:25.630949] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T17:59:25.634847] [INFO ] [REMOTE ] CHCT: Full fetch complete (34725 records). [2025-10-17T17:59:25.634950] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-17T17:59:26.042805] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-17T17:59:26.042914] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-17T17:59:26.043800] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-17T17:59:26.043868] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-17T17:59:26.044861] [DEBUG] [LOCAL ] CHCT: Trimmed 34725 records to 24518 (keeping 200 days of data) [2025-10-17T17:59:26.198060] [DEBUG] [LOCAL ] CHCT: Primary data saved (24518 records). [2025-10-17T17:59:26.198270] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-17T17:59:26.198376] [INFO ] [MAIN ] Update Progress: 434/2368 symbols completed. CHCT took 33.0s. Estimated remaining: 4h 24m 34s. Rate: 7.3 symbols/min [2025-10-17T17:59:26.361996] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-17T17:59:26.386506] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:59:26.426814] [DEBUG] [LOCAL ] CHH: Loaded 32689 existing records from primary storage. [2025-10-17T17:59:26.427188] [INFO ] [MAIN ] CHH: Loaded 32689 existing records. [2025-10-17T17:59:26.627249] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:59:26.627577] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-17T17:59:26.627667] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-17T17:59:26.628486] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-17T17:59:26.628614] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-17T17:59:27.014620] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:59:27.158018] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-17T17:59:27.424699] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T17:59:27.785589] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T17:59:27.958034] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-17T17:59:28.114924] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T17:59:28.758086] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-17T17:59:29.552484] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T17:59:29.557974] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-17T17:59:29.810861] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T17:59:30.358074] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-17T17:59:30.517337] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T17:59:31.158085] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-17T17:59:31.958097] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-17T17:59:32.058007] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T17:59:32.508141] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T17:59:32.758105] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-17T17:59:33.558078] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-17T17:59:33.731678] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T17:59:34.156976] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T17:59:34.358133] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-17T17:59:34.996237] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T17:59:35.158058] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-17T17:59:35.522553] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T17:59:35.958047] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-17T17:59:36.758045] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-17T17:59:36.795674] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T17:59:37.390372] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T17:59:37.558048] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-17T17:59:38.358031] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-17T17:59:38.838779] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-17T17:59:38.949809] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-17T17:59:39.158032] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-17T17:59:39.824832] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T17:59:39.957992] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-17T17:59:40.758040] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-17T17:59:41.001028] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T17:59:41.115563] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T17:59:41.118310] [INFO ] [REMOTE ] CHE: Full fetch complete (20399 records). [2025-10-17T17:59:41.118384] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-17T17:59:41.502035] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-17T17:59:41.502135] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-17T17:59:41.502770] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-17T17:59:41.502836] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-17T17:59:41.503634] [DEBUG] [LOCAL ] CHE: Trimmed 20399 records to 15548 (keeping 200 days of data) [2025-10-17T17:59:41.576704] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-17T17:59:41.613268] [DEBUG] [LOCAL ] CHE: Primary data saved (15548 records). [2025-10-17T17:59:41.613487] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-17T17:59:41.613597] [INFO ] [MAIN ] Update Progress: 435/2368 symbols completed. CHE took 31.7s. Estimated remaining: 4h 24m 58s. Rate: 7.3 symbols/min [2025-10-17T17:59:41.786886] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:59:41.787167] [DEBUG] [LOCAL ] CHMI: No existing data file found in primary storage. [2025-10-17T17:59:41.787208] [WARN ] [MAIN ] CHMI: No existing data found, performing full refresh instead. [2025-10-17T17:59:41.787343] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-17T17:59:41.787387] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-17T17:59:41.787463] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-10-17T17:59:41.787516] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-17T17:59:42.167212] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:59:42.358084] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-17T17:59:42.546885] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T17:59:42.554729] [INFO ] [REMOTE ] CHD: Full fetch complete (74884 records). [2025-10-17T17:59:42.554906] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-17T17:59:42.997320] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-17T17:59:42.997501] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-17T17:59:42.998908] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-17T17:59:42.999004] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-17T17:59:43.001162] [DEBUG] [LOCAL ] CHD: Trimmed 74884 records to 53066 (keeping 200 days of data) [2025-10-17T17:59:43.163338] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-17T17:59:43.221028] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T17:59:43.385070] [DEBUG] [LOCAL ] CHD: Primary data saved (53066 records). [2025-10-17T17:59:43.385247] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-17T17:59:43.385778] [INFO ] [MAIN ] Update Progress: 436/2368 symbols completed. CHD took 41.1s. Estimated remaining: 4h 24m 21s. Rate: 7.3 symbols/min [2025-10-17T17:59:43.597203] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T17:59:43.602862] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T17:59:43.616991] [DEBUG] [LOCAL ] CHN: Loaded 5044 existing records from primary storage. [2025-10-17T17:59:43.617262] [INFO ] [MAIN ] CHN: Loaded 5044 existing records. [2025-10-17T17:59:43.806703] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T17:59:43.806976] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-17T17:59:43.807026] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-17T17:59:43.807288] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-17T17:59:43.807345] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-17T17:59:43.963340] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-17T17:59:44.198416] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T17:59:44.758132] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-17T17:59:44.997000] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T17:59:45.474386] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-17T17:59:45.525897] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T17:59:45.558042] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-17T17:59:46.358022] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-17T17:59:46.631684] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T17:59:47.089660] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T17:59:47.158086] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-17T17:59:47.844083] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-17T17:59:47.958083] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-17T17:59:48.758068] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-17T17:59:49.558041] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-17T17:59:49.828604] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T17:59:49.894368] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T17:59:50.358017] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-17T17:59:50.659111] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T17:59:51.158035] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-17T17:59:51.363142] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-17T17:59:51.958052] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-17T17:59:52.327616] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-17T17:59:52.758027] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-17T17:59:53.558008] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-17T17:59:53.829937] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T17:59:53.836627] [INFO ] [REMOTE ] CHGG: Full fetch complete (70248 records). [2025-10-17T17:59:53.836776] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-17T17:59:54.238189] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-17T17:59:54.238431] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-17T17:59:54.239306] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-17T17:59:54.239382] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-17T17:59:54.258272] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T17:59:54.265161] [DEBUG] [LOCAL ] CHGG: Trimmed 70248 records to 48419 (keeping 200 days of data) [2025-10-17T17:59:54.359530] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-17T17:59:54.564430] [DEBUG] [LOCAL ] CHGG: Primary data saved (48419 records). [2025-10-17T17:59:54.564596] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-17T17:59:54.564714] [INFO ] [MAIN ] Update Progress: 437/2368 symbols completed. CHGG took 43.8s. Estimated remaining: 4h 24m 26s. Rate: 7.3 symbols/min [2025-10-17T17:59:54.688866] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T17:59:54.946169] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T17:59:55.158001] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-17T17:59:55.958031] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-17T17:59:56.470510] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T17:59:56.470859] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T17:59:56.758034] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-17T17:59:57.558037] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-17T17:59:58.099436] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T17:59:58.105104] [INFO ] [REMOTE ] CHH: Full fetch complete (47528 records). [2025-10-17T17:59:58.105259] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-17T17:59:58.222790] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-17T17:59:58.365321] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-17T17:59:58.500842] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-17T17:59:58.500940] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-17T17:59:58.501619] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-17T17:59:58.501705] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-17T17:59:58.502889] [DEBUG] [LOCAL ] CHH: Trimmed 47528 records to 32905 (keeping 200 days of data) [2025-10-17T17:59:58.706153] [DEBUG] [LOCAL ] CHH: Primary data saved (32905 records). [2025-10-17T17:59:58.706306] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-17T17:59:58.706406] [INFO ] [MAIN ] Update Progress: 438/2368 symbols completed. CHH took 32.5s. Estimated remaining: 4h 24m 0s. Rate: 7.3 symbols/min [2025-10-17T17:59:59.018754] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-17T17:59:59.157983] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-17T17:59:59.726447] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T17:59:59.958027] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-17T18:00:00.685367] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-17T18:00:00.757998] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-17T18:00:01.558022] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-17T18:00:02.067413] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T18:00:02.358034] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-17T18:00:02.580897] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T18:00:03.158090] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-17T18:00:03.871284] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T18:00:03.958079] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-17T18:00:04.445329] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T18:00:04.446705] [INFO ] [REMOTE ] CHN: Full fetch complete (7543 records). [2025-10-17T18:00:04.446777] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-17T18:00:04.817011] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-17T18:00:04.817176] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-17T18:00:04.817399] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-17T18:00:04.817475] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-17T18:00:04.817913] [DEBUG] [LOCAL ] CHN: Trimmed 7543 records to 5065 (keeping 200 days of data) [2025-10-17T18:00:04.847944] [DEBUG] [LOCAL ] CHN: Primary data saved (5065 records). [2025-10-17T18:00:04.848066] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-17T18:00:04.848151] [INFO ] [MAIN ] Update Progress: 439/2368 symbols completed. CHN took 21.5s. Estimated remaining: 4h 23m 43s. Rate: 7.3 symbols/min [2025-10-17T18:00:05.286737] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-17T18:00:05.293582] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-17T18:00:06.548084] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T18:00:06.555181] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-17T18:00:07.718856] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T18:00:07.724270] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-17T18:00:09.191688] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T18:00:09.195023] [INFO ] [REMOTE ] CHMI: Full fetch complete (31705 records). [2025-10-17T18:00:09.195115] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-17T18:00:09.581139] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-17T18:00:09.581219] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-17T18:00:09.581774] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-17T18:00:09.581838] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-17T18:00:09.582692] [DEBUG] [LOCAL ] CHMI: Trimmed 31705 records to 21855 (keeping 200 days of data) [2025-10-17T18:00:09.707166] [DEBUG] [LOCAL ] CHMI: Primary data saved (21855 records). [2025-10-17T18:00:09.707299] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-17T18:00:09.707370] [INFO ] [MAIN ] Update Progress: 440/2368 symbols completed. CHMI took 28.1s. Estimated remaining: 4h 23m 20s. Rate: 7.3 symbols/min [2025-10-17T18:00:10.382607] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:10.339442] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:10.414930] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:10.415431] [DEBUG] [LOCAL ] CHPT: No existing data file found in primary storage. [2025-10-17T18:00:10.418287] [WARN ] [MAIN ] CHPT: No existing data found, performing full refresh instead. [2025-10-17T18:00:10.418956] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-17T18:00:10.419013] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-17T18:00:10.439332] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-17T18:00:10.443472] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:10.443866] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-17T18:00:10.586861] [DEBUG] [LOCAL ] CHT: Loaded 19654 existing records from primary storage. [2025-10-17T18:00:10.620743] [INFO ] [MAIN ] CHT: Loaded 19654 existing records. [2025-10-17T18:00:10.899696] [DEBUG] [LOCAL ] CHWY: Loaded 54045 existing records from primary storage. [2025-10-17T18:00:10.963378] [INFO ] [MAIN ] CHWY: Loaded 54045 existing records. [2025-10-17T18:00:10.994905] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:11.000680] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-17T18:00:11.067820] [DEBUG] [LOCAL ] CI: Loaded 50066 existing records from primary storage. [2025-10-17T18:00:11.097331] [INFO ] [MAIN ] CI: Loaded 50066 existing records. [2025-10-17T18:00:11.312253] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:00:11.371117] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-17T18:00:11.376485] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-17T18:00:11.419209] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-17T18:00:11.430497] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-17T18:00:11.425194] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:00:11.459171] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-17T18:00:11.504225] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-17T18:00:11.533792] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:00:11.569734] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-17T18:00:11.569992] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-17T18:00:11.569801] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-17T18:00:11.581008] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-17T18:00:11.597170] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-17T18:00:11.604610] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-17T18:00:12.534623] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:12.573834] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-17T18:00:12.608533] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:12.619024] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-17T18:00:12.709150] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:12.710206] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-17T18:00:13.838960] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T18:00:13.843075] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-17T18:00:14.842507] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (3.84 seconds). [2025-10-17T18:00:14.856087] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-17T18:00:14.906610] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-17T18:00:14.918063] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-17T18:00:14.929900] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T18:00:14.934706] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-17T18:00:15.090395] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-17T18:00:15.107758] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-17T18:00:15.764453] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-17T18:00:15.770889] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-17T18:00:16.767817] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T18:00:16.779233] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-17T18:00:16.884060] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T18:00:16.894890] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-17T18:00:16.930108] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T18:00:16.935468] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-17T18:00:17.149035] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-17T18:00:17.558023] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-17T18:00:18.495308] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T18:00:18.500820] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-17T18:00:18.702554] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-17T18:00:18.898417] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-17T18:00:19.158076] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-17T18:00:19.457636] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-17T18:00:19.845272] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-17T18:00:19.958036] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-17T18:00:20.758011] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-17T18:00:21.089174] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T18:00:21.558048] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-17T18:00:22.204822] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-17T18:00:22.358001] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-17T18:00:22.461701] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T18:00:22.797689] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-17T18:00:23.158066] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-17T18:00:23.842414] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T18:00:23.958062] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-17T18:00:24.758107] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-17T18:00:25.162210] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-17T18:00:25.558125] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-17T18:00:25.813739] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T18:00:25.892821] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T18:00:26.358036] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-17T18:00:27.158088] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-17T18:00:27.203638] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T18:00:27.958046] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-17T18:00:28.644359] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-17T18:00:28.758083] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-17T18:00:29.022099] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T18:00:29.550861] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-17T18:00:29.561094] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-17T18:00:30.358259] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-17T18:00:30.665188] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T18:00:30.862094] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-17T18:00:31.158043] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-17T18:00:31.958052] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-17T18:00:32.367128] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-17T18:00:32.758094] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-17T18:00:33.163012] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T18:00:33.166081] [INFO ] [REMOTE ] CHT: Full fetch complete (27646 records). [2025-10-17T18:00:33.166224] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-17T18:00:33.558467] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-17T18:00:33.569597] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-17T18:00:33.569711] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-17T18:00:33.570213] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-17T18:00:33.570366] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-17T18:00:33.604024] [DEBUG] [LOCAL ] CHT: Trimmed 27646 records to 19756 (keeping 200 days of data) [2025-10-17T18:00:33.606533] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-17T18:00:33.733469] [DEBUG] [LOCAL ] CHT: Primary data saved (19756 records). [2025-10-17T18:00:33.733630] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-17T18:00:33.733755] [INFO ] [MAIN ] Update Progress: 441/2368 symbols completed. CHT took 24.0s. Estimated remaining: 4h 24m 21s. Rate: 7.3 symbols/min [2025-10-17T18:00:33.921965] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:33.941511] [DEBUG] [LOCAL ] CIA: Loaded 16720 existing records from primary storage. [2025-10-17T18:00:33.941786] [INFO ] [MAIN ] CIA: Loaded 16720 existing records. [2025-10-17T18:00:34.136927] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:00:34.137986] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-17T18:00:34.138178] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-17T18:00:34.138483] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-17T18:00:34.138596] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-17T18:00:34.362353] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-17T18:00:34.511576] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:34.541382] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T18:00:35.158054] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-17T18:00:35.365735] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T18:00:35.958003] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-17T18:00:36.185965] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-17T18:00:36.303163] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T18:00:36.758112] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-17T18:00:37.558046] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-17T18:00:37.934797] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-17T18:00:38.114960] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T18:00:38.358087] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-17T18:00:39.158037] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-17T18:00:39.236255] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T18:00:39.958087] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-17T18:00:40.079782] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-17T18:00:40.511752] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-17T18:00:40.758043] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-17T18:00:41.558047] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-17T18:00:41.766215] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-17T18:00:41.859190] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T18:00:41.865069] [INFO ] [REMOTE ] CHPT: Full fetch complete (71556 records). [2025-10-17T18:00:41.865222] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-17T18:00:42.243286] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-17T18:00:42.243374] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-17T18:00:42.244314] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-17T18:00:42.244378] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-17T18:00:42.245764] [DEBUG] [LOCAL ] CHPT: Trimmed 71556 records to 48210 (keeping 200 days of data) [2025-10-17T18:00:42.361104] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-17T18:00:42.524987] [DEBUG] [LOCAL ] CHPT: Primary data saved (48210 records). [2025-10-17T18:00:42.525125] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-17T18:00:42.525213] [INFO ] [MAIN ] Update Progress: 442/2368 symbols completed. CHPT took 32.8s. Estimated remaining: 4h 24m 15s. Rate: 7.3 symbols/min [2025-10-17T18:00:42.692438] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:42.720322] [DEBUG] [LOCAL ] CIB: Loaded 30684 existing records from primary storage. [2025-10-17T18:00:42.720608] [INFO ] [MAIN ] CIB: Loaded 30684 existing records. [2025-10-17T18:00:42.896155] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:00:42.896395] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-17T18:00:42.896442] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-17T18:00:42.896988] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-17T18:00:42.897046] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-17T18:00:43.167514] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-17T18:00:43.258925] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:43.407204] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T18:00:43.686465] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-17T18:00:43.694119] [INFO ] [REMOTE ] CHWY: Full fetch complete (77780 records). [2025-10-17T18:00:43.694265] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-17T18:00:43.963601] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-17T18:00:44.102313] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-17T18:00:44.102409] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-17T18:00:44.103386] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-17T18:00:44.103455] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-17T18:00:44.105038] [DEBUG] [LOCAL ] CHWY: Trimmed 77780 records to 54435 (keeping 200 days of data) [2025-10-17T18:00:44.425474] [DEBUG] [LOCAL ] CHWY: Primary data saved (54435 records). [2025-10-17T18:00:44.425611] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-17T18:00:44.425718] [INFO ] [MAIN ] Update Progress: 443/2368 symbols completed. CHWY took 34.7s. Estimated remaining: 4h 23m 39s. Rate: 7.3 symbols/min [2025-10-17T18:00:44.596421] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:44.596632] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-17T18:00:44.596711] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-17T18:00:44.596837] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-17T18:00:44.596881] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-17T18:00:44.596924] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-17T18:00:44.596958] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-17T18:00:44.763694] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-17T18:00:44.973037] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:45.005852] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T18:00:45.231253] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T18:00:45.558001] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-17T18:00:45.889451] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T18:00:46.358032] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-17T18:00:47.158049] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-17T18:00:47.279248] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T18:00:47.381577] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T18:00:47.958062] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-17T18:00:48.383525] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T18:00:48.720830] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-17T18:00:48.757988] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-17T18:00:49.558011] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-17T18:00:50.103220] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T18:00:50.358041] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-17T18:00:50.611082] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T18:00:50.807774] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-17T18:00:51.158040] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-17T18:00:51.958051] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-17T18:00:52.758006] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-17T18:00:52.909390] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T18:00:52.965233] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T18:00:52.971824] [INFO ] [REMOTE ] CI: Full fetch complete (72106 records). [2025-10-17T18:00:52.971943] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-17T18:00:53.247939] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T18:00:53.366402] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-17T18:00:53.366538] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-17T18:00:53.367426] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-17T18:00:53.367491] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-17T18:00:53.369079] [DEBUG] [LOCAL ] CI: Trimmed 72106 records to 50399 (keeping 200 days of data) [2025-10-17T18:00:53.582755] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-17T18:00:53.685567] [DEBUG] [LOCAL ] CI: Primary data saved (50399 records). [2025-10-17T18:00:53.685791] [INFO ] [MAIN ] CI: Full history saved. [2025-10-17T18:00:53.685907] [INFO ] [MAIN ] Update Progress: 444/2368 symbols completed. CI took 43.9s. Estimated remaining: 4h 23m 36s. Rate: 7.3 symbols/min [2025-10-17T18:00:53.856776] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:53.906295] [DEBUG] [LOCAL ] CIEN: Loaded 52535 existing records from primary storage. [2025-10-17T18:00:53.906636] [INFO ] [MAIN ] CIEN: Loaded 52535 existing records. [2025-10-17T18:00:54.088212] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:00:54.082354] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-17T18:00:54.088466] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-17T18:00:54.089599] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-17T18:00:54.089934] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-17T18:00:54.089988] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-17T18:00:54.363197] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-17T18:00:54.444086] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:55.158032] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-17T18:00:55.918957] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T18:00:55.958033] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-17T18:00:56.135745] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-17T18:00:56.758023] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-17T18:00:57.409478] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T18:00:57.558040] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-17T18:00:58.357993] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-17T18:00:58.626609] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T18:00:58.628736] [INFO ] [REMOTE ] CIA: Full fetch complete (23374 records). [2025-10-17T18:00:58.628808] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-17T18:00:58.987669] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-17T18:00:59.031903] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-17T18:00:59.031974] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-17T18:00:59.032399] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-17T18:00:59.032438] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-17T18:00:59.033064] [DEBUG] [LOCAL ] CIA: Trimmed 23374 records to 16820 (keeping 200 days of data) [2025-10-17T18:00:59.122458] [DEBUG] [LOCAL ] CIA: Primary data saved (16820 records). [2025-10-17T18:00:59.122600] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-17T18:00:59.122704] [INFO ] [MAIN ] Update Progress: 445/2368 symbols completed. CIA took 25.4s. Estimated remaining: 4h 23m 15s. Rate: 7.3 symbols/min [2025-10-17T18:00:59.165288] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-17T18:00:59.294116] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:00:59.299917] [DEBUG] [LOCAL ] CIF: Loaded 4057 existing records from primary storage. [2025-10-17T18:00:59.300112] [INFO ] [MAIN ] CIF: Loaded 4057 existing records. [2025-10-17T18:00:59.479839] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:00:59.480177] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-17T18:00:59.480264] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-17T18:00:59.480577] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-17T18:00:59.480788] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-17T18:00:59.617874] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-17T18:00:59.860705] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:00:59.958051] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-17T18:01:00.758040] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-17T18:01:01.393427] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-17T18:01:01.407570] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-17T18:01:01.450748] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T18:01:01.558045] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-17T18:01:02.358040] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-17T18:01:02.532753] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T18:01:03.158057] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-17T18:01:03.510923] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-17T18:01:03.580227] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-17T18:01:03.958082] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-17T18:01:04.758022] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-17T18:01:04.825983] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T18:01:05.174921] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T18:01:05.558029] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-17T18:01:06.358013] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-17T18:01:06.798278] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-17T18:01:07.159309] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T18:01:07.158389] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-17T18:01:07.878045] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T18:01:07.958138] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-17T18:01:08.758099] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-17T18:01:09.107283] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-17T18:01:09.359716] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T18:01:09.558062] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-17T18:01:09.930577] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-17T18:01:10.358065] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-17T18:01:10.799595] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-17T18:01:10.800367] [INFO ] [REMOTE ] CICB: Full fetch complete (1982 records). [2025-10-17T18:01:10.800437] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-17T18:01:10.985945] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-17T18:01:10.986148] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:01:10.986227] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:01:10.986280] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-17T18:01:10.986339] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-17T18:01:10.986419] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-17T18:01:10.986472] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-17T18:01:10.986530] [INFO ] [MAIN ] Update Progress: 446/2368 symbols completed. CICB took 26.6s. Estimated remaining: 4h 23m 23s. Rate: 7.3 symbols/min [2025-10-17T18:01:11.161249] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-17T18:01:11.161146] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:01:11.161896] [DEBUG] [LOCAL ] CIG: No existing data file found in primary storage. [2025-10-17T18:01:11.162613] [WARN ] [MAIN ] CIG: No existing data found, performing full refresh instead. [2025-10-17T18:01:11.162767] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-17T18:01:11.162810] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-17T18:01:11.162854] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-17T18:01:11.162889] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-17T18:01:11.525856] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:01:11.958031] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-17T18:01:12.590380] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T18:01:12.758019] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-17T18:01:13.558023] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-17T18:01:13.849810] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T18:01:14.358055] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-17T18:01:14.427533] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T18:01:15.011474] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T18:01:15.016000] [INFO ] [REMOTE ] CIB: Full fetch complete (45236 records). [2025-10-17T18:01:15.016109] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-17T18:01:15.168563] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-17T18:01:15.410671] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-17T18:01:15.410790] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-17T18:01:15.411463] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-17T18:01:15.411546] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-17T18:01:15.412680] [DEBUG] [LOCAL ] CIB: Trimmed 45236 records to 30952 (keeping 200 days of data) [2025-10-17T18:01:15.601617] [DEBUG] [LOCAL ] CIB: Primary data saved (30952 records). [2025-10-17T18:01:15.601804] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-17T18:01:15.602370] [INFO ] [MAIN ] Update Progress: 447/2368 symbols completed. CIB took 33.1s. Estimated remaining: 4h 22m 59s. Rate: 7.3 symbols/min [2025-10-17T18:01:15.784304] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:01:15.801126] [DEBUG] [LOCAL ] CII: Loaded 15443 existing records from primary storage. [2025-10-17T18:01:15.801447] [INFO ] [MAIN ] CII: Loaded 15443 existing records. [2025-10-17T18:01:15.972405] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-17T18:01:15.979932] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:01:15.981203] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-17T18:01:15.981289] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-17T18:01:15.981718] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-17T18:01:15.981797] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-17T18:01:16.274745] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T18:01:16.354455] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:01:16.384155] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-17T18:01:16.758006] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-17T18:01:17.443440] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-17T18:01:17.558060] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-17T18:01:17.559264] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T18:01:18.358028] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-17T18:01:18.986600] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-17T18:01:19.158012] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-17T18:01:19.235632] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T18:01:19.958007] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-17T18:01:20.283493] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T18:01:20.758044] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-17T18:01:21.384700] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T18:01:21.558008] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-17T18:01:21.742565] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T18:01:22.060306] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-17T18:01:22.358041] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-17T18:01:23.158046] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-17T18:01:23.294262] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T18:01:23.958010] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-17T18:01:24.696438] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T18:01:24.757996] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-17T18:01:24.922955] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T18:01:25.558030] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-17T18:01:26.356085] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T18:01:26.364587] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-17T18:01:26.630801] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-17T18:01:27.158078] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-17T18:01:27.905226] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T18:01:27.958039] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-17T18:01:28.326522] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-17T18:01:28.757994] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-17T18:01:29.165975] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-17T18:01:29.558049] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-17T18:01:30.278482] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T18:01:30.323863] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-17T18:01:30.358018] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-17T18:01:30.952778] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-17T18:01:31.158027] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-17T18:01:31.958051] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-17T18:01:32.758017] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-17T18:01:32.938903] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T18:01:33.497828] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T18:01:33.558030] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-17T18:01:33.667781] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-17T18:01:34.358142] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-17T18:01:35.158019] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-17T18:01:35.310296] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-17T18:01:35.505803] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T18:01:35.781733] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-17T18:01:35.958030] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-17T18:01:36.758019] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-17T18:01:36.771637] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T18:01:36.772604] [INFO ] [REMOTE ] CIF: Full fetch complete (6572 records). [2025-10-17T18:01:36.772705] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-17T18:01:37.124822] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-17T18:01:37.124903] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-17T18:01:37.125080] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-17T18:01:37.125122] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-17T18:01:37.125538] [DEBUG] [LOCAL ] CIF: Trimmed 6572 records to 4087 (keeping 200 days of data) [2025-10-17T18:01:37.149063] [DEBUG] [LOCAL ] CIF: Primary data saved (4087 records). [2025-10-17T18:01:37.149187] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-17T18:01:37.149271] [INFO ] [MAIN ] Update Progress: 448/2368 symbols completed. CIF took 38.0s. Estimated remaining: 4h 23m 48s. Rate: 7.3 symbols/min [2025-10-17T18:01:37.316538] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:01:37.354008] [DEBUG] [LOCAL ] CIM: Loaded 37990 existing records from primary storage. [2025-10-17T18:01:37.354295] [INFO ] [MAIN ] CIM: Loaded 37990 existing records. [2025-10-17T18:01:37.526476] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:01:37.526715] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-17T18:01:37.526774] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-17T18:01:37.530528] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-17T18:01:37.531034] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-17T18:01:37.563134] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-17T18:01:37.879060] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:01:38.358037] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-17T18:01:38.459078] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T18:01:38.521310] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T18:01:39.158040] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-17T18:01:39.958043] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-17T18:01:40.563834] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-17T18:01:40.571908] [INFO ] [REMOTE ] CIEN: Full fetch complete (75830 records). [2025-10-17T18:01:40.572043] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-17T18:01:40.803522] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-17T18:01:40.894423] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T18:01:41.060759] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-17T18:01:41.060873] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-17T18:01:41.061787] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-17T18:01:41.061863] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-17T18:01:41.063613] [DEBUG] [LOCAL ] CIEN: Trimmed 75830 records to 52910 (keeping 200 days of data) [2025-10-17T18:01:41.182165] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T18:01:41.403660] [DEBUG] [LOCAL ] CIEN: Primary data saved (52910 records). [2025-10-17T18:01:41.403808] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-17T18:01:41.403887] [INFO ] [MAIN ] Update Progress: 449/2368 symbols completed. CIEN took 47.7s. Estimated remaining: 4h 23m 23s. Rate: 7.3 symbols/min [2025-10-17T18:01:41.570931] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-17T18:01:41.574380] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:01:41.579375] [DEBUG] [LOCAL ] CIMN: Loaded 2780 existing records from primary storage. [2025-10-17T18:01:41.579727] [INFO ] [MAIN ] CIMN: Loaded 2780 existing records. [2025-10-17T18:01:41.762137] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:01:41.762374] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-17T18:01:41.762427] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-17T18:01:41.762634] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-17T18:01:41.762730] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-17T18:01:42.090189] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T18:01:42.155597] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:01:42.357994] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-17T18:01:42.995478] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-17T18:01:43.157993] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-17T18:01:43.257564] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T18:01:43.647975] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T18:01:43.958071] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-17T18:01:44.470594] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-17T18:01:44.758036] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-17T18:01:45.558072] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-17T18:01:46.358042] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-17T18:01:46.386008] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T18:01:46.614519] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-17T18:01:46.618740] [INFO ] [REMOTE ] CII: Full fetch complete (22903 records). [2025-10-17T18:01:46.618863] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-17T18:01:46.923041] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-17T18:01:47.011022] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-17T18:01:47.011101] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-17T18:01:47.011566] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-17T18:01:47.011612] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-17T18:01:47.012277] [DEBUG] [LOCAL ] CII: Trimmed 22903 records to 15546 (keeping 200 days of data) [2025-10-17T18:01:47.107153] [DEBUG] [LOCAL ] CII: Primary data saved (15546 records). [2025-10-17T18:01:47.107293] [INFO ] [MAIN ] CII: Full history saved. [2025-10-17T18:01:47.107373] [INFO ] [MAIN ] Update Progress: 450/2368 symbols completed. CII took 31.5s. Estimated remaining: 4h 23m 4s. Rate: 7.3 symbols/min [2025-10-17T18:01:47.163151] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-17T18:01:47.289158] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:01:47.289330] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-17T18:01:47.289370] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-17T18:01:47.289489] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-17T18:01:47.289532] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-17T18:01:47.289576] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-17T18:01:47.289618] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-17T18:01:47.659228] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:01:47.958043] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-17T18:01:48.718321] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T18:01:48.758005] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-17T18:01:48.831160] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T18:01:49.320999] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T18:01:49.558034] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-17T18:01:50.109092] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-17T18:01:50.358045] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-17T18:01:51.158044] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-17T18:01:51.601686] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T18:01:51.958068] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-17T18:01:52.495608] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-17T18:01:52.758027] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-17T18:01:52.820186] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-17T18:01:52.826917] [INFO ] [REMOTE ] CIG: Full fetch complete (62316 records). [2025-10-17T18:01:52.827040] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-17T18:01:53.215922] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-17T18:01:53.216003] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-17T18:01:53.216801] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-17T18:01:53.216866] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-17T18:01:53.218144] [DEBUG] [LOCAL ] CIG: Trimmed 62316 records to 45005 (keeping 200 days of data) [2025-10-17T18:01:53.323824] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T18:01:53.496896] [DEBUG] [LOCAL ] CIG: Primary data saved (45005 records). [2025-10-17T18:01:53.497173] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-17T18:01:53.497283] [INFO ] [MAIN ] Update Progress: 451/2368 symbols completed. CIG took 42.5s. Estimated remaining: 4h 22m 48s. Rate: 7.3 symbols/min [2025-10-17T18:01:53.563106] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-17T18:01:53.678675] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:01:53.678823] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-17T18:01:53.678860] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-17T18:01:53.679011] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-17T18:01:53.679052] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-17T18:01:53.679093] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-17T18:01:53.679126] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-17T18:01:54.027951] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:01:54.358284] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-17T18:01:54.562738] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:01:54.563093] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-17T18:01:54.563199] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:01:54.563289] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-17T18:01:54.563369] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:01:54.563459] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-17T18:01:54.563541] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-17T18:01:54.563584] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-17T18:01:54.563628] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-17T18:01:54.563720] [INFO ] [MAIN ] Update Progress: 452/2368 symbols completed. CIMP took 1.1s. Estimated remaining: 4h 22m 9s. Rate: 7.3 symbols/min [2025-10-17T18:01:54.739784] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:01:54.757961] [DEBUG] [LOCAL ] CINT: Loaded 20157 existing records from primary storage. [2025-10-17T18:01:54.758222] [INFO ] [MAIN ] CINT: Loaded 20157 existing records. [2025-10-17T18:01:54.937092] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:01:54.937406] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-17T18:01:54.937508] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-17T18:01:54.938024] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-17T18:01:54.938087] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-17T18:01:55.160302] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-17T18:01:55.304571] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T18:01:55.325967] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:01:55.756213] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-17T18:01:55.958053] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-17T18:01:56.416898] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-17T18:01:56.758055] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-17T18:01:57.508178] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-17T18:01:57.557988] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-17T18:01:57.983703] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-17T18:01:58.358037] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-17T18:01:58.802267] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T18:01:59.158055] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-17T18:01:59.608512] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T18:01:59.958038] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-17T18:02:00.409486] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-17T18:02:00.758046] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-17T18:02:01.558060] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-17T18:02:02.091821] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-17T18:02:02.358092] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-17T18:02:02.628940] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T18:02:02.920846] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T18:02:03.158084] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-17T18:02:03.958058] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-17T18:02:04.164688] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T18:02:04.338869] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-17T18:02:04.758059] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-17T18:02:05.558031] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-17T18:02:06.172442] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T18:02:06.173507] [INFO ] [REMOTE ] CIMO: Full fetch complete (4801 records). [2025-10-17T18:02:06.173578] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-17T18:02:06.365818] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-17T18:02:06.373396] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T18:02:06.374372] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:02:06.374463] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:02:06.374563] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-17T18:02:06.374637] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-17T18:02:06.374737] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-17T18:02:06.374805] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-17T18:02:06.374872] [INFO ] [MAIN ] Update Progress: 453/2368 symbols completed. CIMO took 19.3s. Estimated remaining: 4h 22m 16s. Rate: 7.3 symbols/min [2025-10-17T18:02:06.560199] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:02:06.560518] [DEBUG] [LOCAL ] CIO: No existing data file found in primary storage. [2025-10-17T18:02:06.560690] [WARN ] [MAIN ] CIO: No existing data found, performing full refresh instead. [2025-10-17T18:02:06.560980] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-17T18:02:06.561066] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-17T18:02:06.561162] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-10-17T18:02:06.561363] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-17T18:02:06.845736] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-17T18:02:07.005997] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:02:07.017160] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T18:02:07.158043] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-17T18:02:07.958088] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-17T18:02:08.704041] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T18:02:08.758063] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-17T18:02:09.021822] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T18:02:09.558030] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-17T18:02:10.191796] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T18:02:10.358088] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-17T18:02:11.158008] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-17T18:02:11.215753] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T18:02:11.559410] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-17T18:02:11.958070] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-17T18:02:12.758108] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-17T18:02:13.019040] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T18:02:13.348168] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T18:02:13.558043] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-17T18:02:13.749471] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-17T18:02:14.194082] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-17T18:02:14.358034] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-17T18:02:15.066774] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T18:02:15.067922] [INFO ] [REMOTE ] CIMN: Full fetch complete (3926 records). [2025-10-17T18:02:15.068015] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-17T18:02:15.068412] [FATAL] [VALIDATOR ] CIMN: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:02:15.068501] [FATAL] [MAIN ] CIMN: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:02:15.068544] [WARN ] [MAIN ] CIMN: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:02:15.068609] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-17T18:02:15.068714] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-10-17T18:02:15.068765] [INFO ] [LOCAL ] CIMN: Starting deletion of derivative data. [2025-10-17T18:02:15.068960] [DEBUG] [LOCAL ] CIMN: Deleted derivative data file. [2025-10-17T18:02:15.069059] [INFO ] [MAIN ] Update Progress: 454/2368 symbols completed. CIMN took 33.7s. Estimated remaining: 4h 22m 10s. Rate: 7.3 symbols/min [2025-10-17T18:02:15.163158] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-17T18:02:15.264403] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:02:15.264627] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-10-17T18:02:15.264711] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-10-17T18:02:15.264869] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-17T18:02:15.264932] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-17T18:02:15.265043] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-17T18:02:15.265099] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-17T18:02:15.633136] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:02:15.958068] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-17T18:02:16.487264] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-17T18:02:16.758042] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-17T18:02:17.377076] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T18:02:17.558021] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-17T18:02:18.364036] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-17T18:02:18.378195] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T18:02:19.158000] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-17T18:02:19.530955] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T18:02:19.885165] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T18:02:19.958008] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-17T18:02:20.724334] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T18:02:20.758108] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-17T18:02:21.076462] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T18:02:21.558059] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-17T18:02:21.854000] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-17T18:02:22.358033] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-17T18:02:23.141785] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-17T18:02:23.148406] [INFO ] [REMOTE ] CIM: Full fetch complete (54965 records). [2025-10-17T18:02:23.148591] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-17T18:02:23.164187] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-17T18:02:23.326969] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T18:02:23.591768] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-17T18:02:23.591896] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-17T18:02:23.592829] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-17T18:02:23.592909] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-17T18:02:23.594528] [DEBUG] [LOCAL ] CIM: Trimmed 54965 records to 38246 (keeping 200 days of data) [2025-10-17T18:02:23.908707] [DEBUG] [LOCAL ] CIM: Primary data saved (38246 records). [2025-10-17T18:02:23.909181] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-17T18:02:23.909301] [INFO ] [MAIN ] Update Progress: 455/2368 symbols completed. CIM took 46.8s. Estimated remaining: 4h 22m 4s. Rate: 7.3 symbols/min [2025-10-17T18:02:23.966636] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-17T18:02:24.107867] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:02:24.157666] [DEBUG] [LOCAL ] CIVI: Loaded 53088 existing records from primary storage. [2025-10-17T18:02:24.158050] [INFO ] [MAIN ] CIVI: Loaded 53088 existing records. [2025-10-17T18:02:24.313530] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T18:02:24.400662] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:02:24.400890] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-17T18:02:24.400938] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-17T18:02:24.402185] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-17T18:02:24.402245] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-17T18:02:24.781586] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-17T18:02:24.787888] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:02:25.206719] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T18:02:25.558011] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-17T18:02:25.576589] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T18:02:26.358035] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-17T18:02:26.692068] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T18:02:27.158062] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-17T18:02:27.958042] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-17T18:02:28.254730] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T18:02:28.312827] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-17T18:02:28.758083] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-17T18:02:29.099564] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T18:02:29.558062] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-17T18:02:29.854922] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T18:02:30.358006] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-17T18:02:30.605192] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T18:02:31.158056] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-17T18:02:31.647560] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T18:02:31.652200] [INFO ] [REMOTE ] CIO: Full fetch complete (29707 records). [2025-10-17T18:02:31.652345] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-17T18:02:31.963214] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-17T18:02:32.031126] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-17T18:02:32.031220] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-17T18:02:32.031762] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-17T18:02:32.031825] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-17T18:02:32.032535] [DEBUG] [LOCAL ] CIO: Trimmed 29707 records to 21338 (keeping 200 days of data) [2025-10-17T18:02:32.148510] [DEBUG] [LOCAL ] CIO: Primary data saved (21338 records). [2025-10-17T18:02:32.148669] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-17T18:02:32.148763] [INFO ] [MAIN ] Update Progress: 456/2368 symbols completed. CIO took 25.8s. Estimated remaining: 4h 21m 56s. Rate: 7.3 symbols/min [2025-10-17T18:02:32.319388] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:02:32.368450] [DEBUG] [LOCAL ] CL: Loaded 54039 existing records from primary storage. [2025-10-17T18:02:32.368826] [INFO ] [MAIN ] CL: Loaded 54039 existing records. [2025-10-17T18:02:32.557454] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:02:32.557742] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-17T18:02:32.557802] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-17T18:02:32.558607] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-17T18:02:32.558703] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-17T18:02:32.763157] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-17T18:02:32.883486] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T18:02:32.974698] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:02:33.557991] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-17T18:02:33.855664] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-17T18:02:33.922206] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T18:02:34.358071] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-17T18:02:34.396385] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T18:02:35.158057] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-17T18:02:35.958042] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-17T18:02:36.758081] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-17T18:02:36.789265] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-17T18:02:37.558039] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-17T18:02:37.792479] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-17T18:02:38.184560] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-17T18:02:38.358035] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-17T18:02:38.980013] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-17T18:02:38.984787] [INFO ] [REMOTE ] CINT: Full fetch complete (28211 records). [2025-10-17T18:02:38.984915] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-17T18:02:39.163170] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-17T18:02:39.371912] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-17T18:02:39.372022] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-17T18:02:39.372508] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-17T18:02:39.372584] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-17T18:02:39.373553] [DEBUG] [LOCAL ] CINT: Trimmed 28211 records to 20304 (keeping 200 days of data) [2025-10-17T18:02:39.495558] [DEBUG] [LOCAL ] CINT: Primary data saved (20304 records). [2025-10-17T18:02:39.495778] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-17T18:02:39.496080] [INFO ] [MAIN ] Update Progress: 457/2368 symbols completed. CINT took 44.9s. Estimated remaining: 4h 21m 44s. Rate: 7.3 symbols/min [2025-10-17T18:02:39.657659] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-17T18:02:39.714551] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:02:39.747935] [DEBUG] [LOCAL ] CLB: Loaded 33709 existing records from primary storage. [2025-10-17T18:02:39.748207] [INFO ] [MAIN ] CLB: Loaded 33709 existing records. [2025-10-17T18:02:39.925607] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:02:39.926125] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-17T18:02:39.926272] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-17T18:02:39.926879] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-17T18:02:39.926952] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-17T18:02:39.969435] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-17T18:02:40.286327] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T18:02:40.372916] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:02:40.405620] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-17T18:02:40.758092] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-17T18:02:41.558009] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-17T18:02:41.855051] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T18:02:42.028831] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T18:02:42.358052] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-17T18:02:43.165262] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-17T18:02:43.187401] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T18:02:43.958020] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-17T18:02:44.186822] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T18:02:44.431957] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T18:02:44.758026] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-17T18:02:44.955263] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T18:02:45.558016] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-17T18:02:46.046146] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T18:02:46.358010] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-17T18:02:47.158005] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-17T18:02:47.338704] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T18:02:47.958044] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-17T18:02:48.208211] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T18:02:48.462698] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T18:02:48.466938] [INFO ] [REMOTE ] CION: Full fetch complete (40666 records). [2025-10-17T18:02:48.467068] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-17T18:02:48.760914] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-17T18:02:48.848683] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-17T18:02:48.848769] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-17T18:02:48.849345] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-17T18:02:48.849398] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-17T18:02:48.850301] [DEBUG] [LOCAL ] CION: Trimmed 40666 records to 28822 (keeping 200 days of data) [2025-10-17T18:02:49.018133] [DEBUG] [LOCAL ] CION: Primary data saved (28822 records). [2025-10-17T18:02:49.018304] [INFO ] [MAIN ] CION: Full history saved. [2025-10-17T18:02:49.018413] [INFO ] [MAIN ] Update Progress: 458/2368 symbols completed. CION took 33.9s. Estimated remaining: 4h 21m 42s. Rate: 7.3 symbols/min [2025-10-17T18:02:49.183226] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:02:49.183398] [DEBUG] [LOCAL ] CLCO: No existing data file found in primary storage. [2025-10-17T18:02:49.183436] [WARN ] [MAIN ] CLCO: No existing data found, performing full refresh instead. [2025-10-17T18:02:49.183547] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-17T18:02:49.183596] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-17T18:02:49.183688] [DEBUG] [LOCAL ] CLCO: No primary data file found to delete. [2025-10-17T18:02:49.183748] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-17T18:02:49.550591] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:02:49.557994] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-17T18:02:49.597731] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T18:02:49.921477] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T18:02:50.358008] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-17T18:02:50.766005] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-17T18:02:51.158043] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-17T18:02:51.958022] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-17T18:02:52.333341] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-17T18:02:52.597011] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-17T18:02:52.757972] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-17T18:02:52.955074] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T18:02:53.558051] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-17T18:02:53.816114] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T18:02:54.358083] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-17T18:02:55.158066] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-17T18:02:55.543886] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T18:02:55.958054] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-17T18:02:56.529186] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-17T18:02:56.758043] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-17T18:02:56.985025] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T18:02:57.558046] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-17T18:02:58.051104] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-17T18:02:58.243306] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T18:02:58.253354] [INFO ] [REMOTE ] CIVI: Full fetch complete (76010 records). [2025-10-17T18:02:58.253566] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-17T18:02:58.363168] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-17T18:02:58.686807] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-17T18:02:58.692596] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-17T18:02:58.703486] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-17T18:02:58.702759] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-17T18:02:58.709564] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-17T18:02:58.711806] [DEBUG] [LOCAL ] CIVI: Trimmed 76010 records to 53478 (keeping 200 days of data) [2025-10-17T18:02:59.034509] [DEBUG] [LOCAL ] CIVI: Primary data saved (53478 records). [2025-10-17T18:02:59.034702] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-17T18:02:59.034821] [INFO ] [MAIN ] Update Progress: 459/2368 symbols completed. CIVI took 35.1s. Estimated remaining: 4h 21m 41s. Rate: 7.3 symbols/min [2025-10-17T18:02:59.163267] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-17T18:02:59.212282] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:02:59.236727] [DEBUG] [LOCAL ] CLDT: Loaded 25627 existing records from primary storage. [2025-10-17T18:02:59.237015] [INFO ] [MAIN ] CLDT: Loaded 25627 existing records. [2025-10-17T18:02:59.413820] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:02:59.414096] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-17T18:02:59.414154] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-17T18:02:59.414725] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-17T18:02:59.414782] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-17T18:02:59.758545] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:02:59.958059] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-17T18:03:00.605812] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-17T18:03:00.744097] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T18:03:00.757993] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-17T18:03:01.463325] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T18:03:01.558036] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-17T18:03:02.358030] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-17T18:03:02.425370] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-17T18:03:02.746336] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-17T18:03:03.157999] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-17T18:03:03.482435] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T18:03:03.958051] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-17T18:03:04.758048] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-17T18:03:05.134858] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T18:03:05.330993] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-17T18:03:05.558006] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-17T18:03:05.658050] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-17T18:03:06.358099] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-17T18:03:06.865509] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T18:03:07.158039] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-17T18:03:07.958146] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-17T18:03:08.269056] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T18:03:08.411929] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-17T18:03:08.420296] [INFO ] [REMOTE ] CL: Full fetch complete (77811 records). [2025-10-17T18:03:08.420943] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-17T18:03:08.763229] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-17T18:03:08.864380] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-17T18:03:08.864677] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-17T18:03:08.866639] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-17T18:03:08.867379] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-17T18:03:08.867688] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-17T18:03:08.873447] [DEBUG] [LOCAL ] CL: Trimmed 77811 records to 54429 (keeping 200 days of data) [2025-10-17T18:03:09.259867] [DEBUG] [LOCAL ] CL: Primary data saved (54429 records). [2025-10-17T18:03:09.260070] [INFO ] [MAIN ] CL: Full history saved. [2025-10-17T18:03:09.260601] [INFO ] [MAIN ] Update Progress: 460/2368 symbols completed. CL took 37.1s. Estimated remaining: 4h 21m 41s. Rate: 7.3 symbols/min [2025-10-17T18:03:09.459938] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:03:09.516331] [DEBUG] [LOCAL ] CLF: Loaded 54131 existing records from primary storage. [2025-10-17T18:03:09.516898] [INFO ] [MAIN ] CLF: Loaded 54131 existing records. [2025-10-17T18:03:09.563183] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-17T18:03:09.775238] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:03:09.775565] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-17T18:03:09.775672] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-17T18:03:09.776424] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-17T18:03:09.776502] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-17T18:03:10.285122] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:03:10.309049] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T18:03:10.358089] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-17T18:03:10.390552] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T18:03:11.158081] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-17T18:03:11.651274] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T18:03:11.958131] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-17T18:03:12.481110] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T18:03:12.758019] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-17T18:03:13.558055] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-17T18:03:14.110052] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-17T18:03:14.141486] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-17T18:03:14.358062] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-17T18:03:14.653170] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T18:03:15.158063] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-17T18:03:15.917693] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T18:03:15.958044] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-17T18:03:16.275033] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T18:03:16.758084] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-17T18:03:17.558069] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-17T18:03:17.782754] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T18:03:17.963063] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-17T18:03:18.358012] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-17T18:03:18.548132] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-17T18:03:19.158097] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-17T18:03:19.958001] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-17T18:03:20.272503] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T18:03:20.434098] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-17T18:03:20.758012] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-17T18:03:20.857724] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T18:03:21.558032] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-17T18:03:22.206070] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T18:03:22.210550] [INFO ] [REMOTE ] CLDT: Full fetch complete (37484 records). [2025-10-17T18:03:22.210691] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-17T18:03:22.363126] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-17T18:03:22.612091] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-17T18:03:22.612169] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-17T18:03:22.612745] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-17T18:03:22.612806] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-17T18:03:22.613665] [DEBUG] [LOCAL ] CLDT: Trimmed 37484 records to 25824 (keeping 200 days of data) [2025-10-17T18:03:22.758569] [DEBUG] [LOCAL ] CLDT: Primary data saved (25824 records). [2025-10-17T18:03:22.758764] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-17T18:03:22.758867] [INFO ] [MAIN ] Update Progress: 461/2368 symbols completed. CLDT took 23.7s. Estimated remaining: 4h 21m 55s. Rate: 7.3 symbols/min [2025-10-17T18:03:22.926845] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:03:22.954522] [DEBUG] [LOCAL ] CLH: Loaded 28054 existing records from primary storage. [2025-10-17T18:03:22.954833] [INFO ] [MAIN ] CLH: Loaded 28054 existing records. [2025-10-17T18:03:23.132141] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:03:23.132396] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-17T18:03:23.132456] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-17T18:03:23.132820] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-17T18:03:23.132879] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-17T18:03:23.163321] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-17T18:03:23.493214] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:03:23.716082] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-17T18:03:23.757041] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T18:03:23.761782] [INFO ] [REMOTE ] CLCO: Full fetch complete (22951 records). [2025-10-17T18:03:23.761919] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-17T18:03:23.963121] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-17T18:03:24.198248] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-17T18:03:24.198370] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-17T18:03:24.199162] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-17T18:03:24.199250] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-17T18:03:24.200143] [DEBUG] [LOCAL ] CLCO: Trimmed 22951 records to 13484 (keeping 200 days of data) [2025-10-17T18:03:24.295393] [DEBUG] [LOCAL ] CLCO: Primary data saved (13484 records). [2025-10-17T18:03:24.295578] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-17T18:03:24.295719] [INFO ] [MAIN ] Update Progress: 462/2368 symbols completed. CLCO took 35.3s. Estimated remaining: 4h 21m 19s. Rate: 7.3 symbols/min [2025-10-17T18:03:24.477734] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:03:24.478167] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-10-17T18:03:24.478272] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-10-17T18:03:24.478485] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-17T18:03:24.478635] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-17T18:03:24.478850] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-17T18:03:24.478971] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-17T18:03:24.604678] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T18:03:24.764779] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-17T18:03:24.874068] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:03:25.405104] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T18:03:25.558000] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-17T18:03:26.358032] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-17T18:03:26.853691] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T18:03:27.094877] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-17T18:03:27.157997] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-17T18:03:27.765395] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T18:03:27.770777] [INFO ] [REMOTE ] CLB: Full fetch complete (47223 records). [2025-10-17T18:03:27.770959] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-17T18:03:27.964454] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-17T18:03:28.165462] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-17T18:03:28.165543] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-17T18:03:28.166253] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-17T18:03:28.166320] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-17T18:03:28.167442] [DEBUG] [LOCAL ] CLB: Trimmed 47223 records to 33985 (keeping 200 days of data) [2025-10-17T18:03:28.373712] [DEBUG] [LOCAL ] CLB: Primary data saved (33985 records). [2025-10-17T18:03:28.373943] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-17T18:03:28.374067] [INFO ] [MAIN ] Update Progress: 463/2368 symbols completed. CLB took 48.9s. Estimated remaining: 4h 20m 53s. Rate: 7.3 symbols/min [2025-10-17T18:03:28.549523] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:03:28.603101] [DEBUG] [LOCAL ] CLS: Loaded 53972 existing records from primary storage. [2025-10-17T18:03:28.603469] [INFO ] [MAIN ] CLS: Loaded 53972 existing records. [2025-10-17T18:03:28.783239] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-17T18:03:28.789596] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:03:28.790876] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-17T18:03:28.790940] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-17T18:03:28.791369] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-17T18:03:28.791411] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-17T18:03:29.175188] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:03:29.368600] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T18:03:29.408225] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-17T18:03:29.558044] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-17T18:03:29.704054] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-17T18:03:30.358054] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-17T18:03:31.158007] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-17T18:03:31.624202] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-17T18:03:31.675576] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-17T18:03:31.958081] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-17T18:03:32.757999] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-17T18:03:33.232375] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-17T18:03:33.435136] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T18:03:33.558024] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-17T18:03:34.364962] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-17T18:03:34.365933] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T18:03:35.073948] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-17T18:03:35.158007] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-17T18:03:35.674487] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T18:03:35.958035] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-17T18:03:36.758030] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-17T18:03:37.378675] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-17T18:03:37.558008] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-17T18:03:37.849884] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T18:03:38.015563] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-17T18:03:38.344750] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T18:03:38.357987] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-17T18:03:39.158092] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-17T18:03:39.575463] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-17T18:03:39.958027] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-17T18:03:40.758033] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-17T18:03:41.208749] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-17T18:03:41.511567] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-17T18:03:41.557982] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-17T18:03:41.825517] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T18:03:42.358027] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-17T18:03:43.130369] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-17T18:03:43.157982] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-17T18:03:43.615695] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T18:03:43.920142] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-17T18:03:43.957994] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-17T18:03:44.758054] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-17T18:03:44.786057] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T18:03:45.558052] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-17T18:03:46.207477] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T18:03:46.358042] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-17T18:03:47.158039] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-17T18:03:47.498210] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T18:03:47.676203] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-17T18:03:47.927754] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T18:03:47.958028] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-17T18:03:48.758032] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-17T18:03:49.558033] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-17T18:03:50.046755] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-17T18:03:50.054974] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-17T18:03:50.055269] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-17T18:03:50.141403] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T18:03:50.186111] [INFO ] [REMOTE ] CLH: Full fetch complete (42169 records). [2025-10-17T18:03:50.186358] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-17T18:03:50.370582] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-17T18:03:50.812103] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-17T18:03:50.817323] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-17T18:03:50.828624] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-17T18:03:50.828741] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-17T18:03:50.890246] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 54521 (keeping 200 days of data) [2025-10-17T18:03:51.015365] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-17T18:03:51.019756] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-17T18:03:51.024566] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-17T18:03:51.028602] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-17T18:03:51.039738] [DEBUG] [LOCAL ] CLH: Trimmed 42169 records to 28288 (keeping 200 days of data) [2025-10-17T18:03:51.275811] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T18:03:51.284906] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-17T18:03:51.358441] [DEBUG] [LOCAL ] CLH: Primary data saved (28288 records). [2025-10-17T18:03:51.363073] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-17T18:03:51.363207] [INFO ] [MAIN ] Update Progress: 464/2368 symbols completed. CLH took 28.6s. Estimated remaining: 4h 21m 46s. Rate: 7.3 symbols/min [2025-10-17T18:03:51.635791] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:03:51.656852] [DEBUG] [LOCAL ] CLF: Primary data saved (54521 records). [2025-10-17T18:03:51.656981] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-17T18:03:51.657638] [INFO ] [MAIN ] Update Progress: 465/2368 symbols completed. CLF took 42.4s. Estimated remaining: 4h 21m 5s. Rate: 7.3 symbols/min [2025-10-17T18:03:51.830421] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:03:51.878451] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-17T18:03:51.904995] [DEBUG] [LOCAL ] CLVT: Loaded 52319 existing records from primary storage. [2025-10-17T18:03:51.909771] [INFO ] [MAIN ] CLVT: Loaded 52319 existing records. [2025-10-17T18:03:51.964455] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-17T18:03:52.023345] [DEBUG] [LOCAL ] CLW: Loaded 21658 existing records from primary storage. [2025-10-17T18:03:52.044743] [INFO ] [MAIN ] CLW: Loaded 21658 existing records. [2025-10-17T18:03:52.166234] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:03:52.210057] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-17T18:03:52.210283] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-17T18:03:52.211417] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T18:03:52.211893] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-17T18:03:52.234499] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-17T18:03:52.274461] [INFO ] [REMOTE ] CLPR: Full fetch complete (16053 records). [2025-10-17T18:03:52.349209] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-17T18:03:52.337149] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:03:52.369830] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-17T18:03:52.380832] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-17T18:03:52.370437] [FATAL] [VALIDATOR ] CLPR: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:03:52.393715] [FATAL] [MAIN ] CLPR: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:03:52.396894] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:03:52.397004] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-17T18:03:52.397079] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-17T18:03:52.397196] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-17T18:03:52.397275] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-17T18:03:52.428430] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-10-17T18:03:52.473843] [DEBUG] [LOCAL ] CLPR: No derivative data file found to delete. [2025-10-17T18:03:52.504476] [INFO ] [MAIN ] Update Progress: 466/2368 symbols completed. CLPR took 28.2s. Estimated remaining: 4h 20m 27s. Rate: 7.3 symbols/min [2025-10-17T18:03:53.044813] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:03:53.051012] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:03:53.079891] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-17T18:03:53.080038] [DEBUG] [LOCAL ] CLX: No existing data file found in primary storage. [2025-10-17T18:03:53.086284] [WARN ] [MAIN ] CLX: No existing data found, performing full refresh instead. [2025-10-17T18:03:53.092870] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-17T18:03:53.092964] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-17T18:03:53.098294] [DEBUG] [LOCAL ] CLX: No primary data file found to delete. [2025-10-17T18:03:53.098363] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-17T18:03:53.337950] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:03:53.548721] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:03:53.557979] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-17T18:03:54.358021] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-17T18:03:54.393040] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-17T18:03:54.902334] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T18:03:55.158113] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-17T18:03:55.216312] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T18:03:55.579455] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T18:03:55.958022] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-17T18:03:56.763519] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-17T18:03:56.781549] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T18:03:57.557994] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-17T18:03:57.740132] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T18:03:57.995142] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T18:03:58.358033] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-17T18:03:59.160782] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-17T18:03:59.167404] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T18:03:59.234663] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T18:03:59.958009] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-17T18:04:00.758035] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-17T18:04:01.323237] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-17T18:04:01.441926] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T18:04:01.558041] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-17T18:04:02.358142] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-17T18:04:02.523430] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T18:04:03.158055] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-17T18:04:03.717677] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-17T18:04:03.958023] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-17T18:04:04.186897] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T18:04:04.352820] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-17T18:04:04.758048] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-17T18:04:05.558006] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-17T18:04:05.859775] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T18:04:06.277513] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T18:04:06.358054] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-17T18:04:07.127062] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-17T18:04:07.157983] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-17T18:04:07.958020] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-17T18:04:08.248700] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T18:04:08.758030] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-17T18:04:09.538386] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-17T18:04:09.557986] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-17T18:04:09.830527] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T18:04:09.947282] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T18:04:10.358136] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-17T18:04:11.158061] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-17T18:04:11.602904] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-17T18:04:11.657984] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T18:04:11.958070] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-17T18:04:12.248142] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T18:04:12.758105] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-17T18:04:13.558052] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-17T18:04:14.269038] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-17T18:04:14.276015] [INFO ] [REMOTE ] CLS: Full fetch complete (77311 records). [2025-10-17T18:04:14.276158] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-17T18:04:14.276874] [FATAL] [VALIDATOR ] CLS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:04:14.276971] [FATAL] [MAIN ] CLS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:04:14.277045] [WARN ] [MAIN ] CLS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:04:14.277132] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-17T18:04:14.277235] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-10-17T18:04:14.277292] [INFO ] [LOCAL ] CLS: Starting deletion of derivative data. [2025-10-17T18:04:14.277456] [DEBUG] [LOCAL ] CLS: Deleted derivative data file. [2025-10-17T18:04:14.278026] [INFO ] [MAIN ] Update Progress: 467/2368 symbols completed. CLS took 45.9s. Estimated remaining: 4h 21m 14s. Rate: 7.3 symbols/min [2025-10-17T18:04:14.359112] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-17T18:04:14.455438] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:04:14.527640] [DEBUG] [LOCAL ] CM: Loaded 49077 existing records from primary storage. [2025-10-17T18:04:14.526451] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T18:04:14.541609] [INFO ] [MAIN ] CM: Loaded 49077 existing records. [2025-10-17T18:04:14.720549] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:04:14.720899] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-17T18:04:14.720981] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-17T18:04:14.721481] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-17T18:04:14.721538] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-17T18:04:14.919528] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T18:04:15.104757] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:04:15.158042] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-17T18:04:15.958045] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-17T18:04:16.398463] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-17T18:04:16.422263] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T18:04:16.758030] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-17T18:04:17.374168] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T18:04:17.558032] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-17T18:04:17.914077] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T18:04:17.917468] [INFO ] [REMOTE ] CLW: Full fetch complete (33827 records). [2025-10-17T18:04:17.917554] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-17T18:04:18.292484] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-17T18:04:18.292561] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-17T18:04:18.293112] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-17T18:04:18.293174] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-17T18:04:18.293943] [DEBUG] [LOCAL ] CLW: Trimmed 33827 records to 21809 (keeping 200 days of data) [2025-10-17T18:04:18.374081] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-17T18:04:18.422208] [DEBUG] [LOCAL ] CLW: Primary data saved (21809 records). [2025-10-17T18:04:18.422348] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-17T18:04:18.422432] [INFO ] [MAIN ] Update Progress: 468/2368 symbols completed. CLW took 26.8s. Estimated remaining: 4h 20m 49s. Rate: 7.3 symbols/min [2025-10-17T18:04:18.591025] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:04:18.641241] [DEBUG] [LOCAL ] CMA: Loaded 50512 existing records from primary storage. [2025-10-17T18:04:18.641606] [INFO ] [MAIN ] CMA: Loaded 50512 existing records. [2025-10-17T18:04:18.821478] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:04:18.821743] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-17T18:04:18.821799] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-17T18:04:18.822194] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-17T18:04:18.822251] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-17T18:04:19.168003] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-17T18:04:19.173896] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:04:19.275199] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T18:04:19.958003] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-17T18:04:20.010753] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T18:04:20.446427] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T18:04:20.758055] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-17T18:04:21.558043] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-17T18:04:21.807238] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T18:04:21.965930] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T18:04:22.358033] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-17T18:04:23.158044] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-17T18:04:23.439221] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T18:04:23.958140] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-17T18:04:24.031853] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T18:04:24.763119] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-17T18:04:24.776536] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T18:04:25.558009] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-17T18:04:25.587544] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T18:04:25.594192] [INFO ] [REMOTE ] CLVT: Full fetch complete (75034 records). [2025-10-17T18:04:25.594331] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-17T18:04:25.595146] [FATAL] [VALIDATOR ] CLVT: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:04:25.595234] [FATAL] [MAIN ] CLVT: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:04:25.595277] [WARN ] [MAIN ] CLVT: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:04:25.595329] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-17T18:04:25.595412] [DEBUG] [LOCAL ] CLVT: No primary data file found to delete. [2025-10-17T18:04:25.595462] [INFO ] [LOCAL ] CLVT: Starting deletion of derivative data. [2025-10-17T18:04:25.595693] [DEBUG] [LOCAL ] CLVT: Deleted derivative data file. [2025-10-17T18:04:25.595816] [INFO ] [MAIN ] Update Progress: 469/2368 symbols completed. CLVT took 34.2s. Estimated remaining: 4h 20m 36s. Rate: 7.3 symbols/min [2025-10-17T18:04:25.765639] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:04:25.790972] [DEBUG] [LOCAL ] CMBT: Loaded 26529 existing records from primary storage. [2025-10-17T18:04:25.791214] [INFO ] [MAIN ] CMBT: Loaded 26529 existing records. [2025-10-17T18:04:25.967719] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:04:25.967950] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-17T18:04:25.968021] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-17T18:04:25.968253] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-17T18:04:25.968312] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-17T18:04:26.322987] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:04:26.357989] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-17T18:04:26.715957] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-17T18:04:27.158052] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-17T18:04:27.297596] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T18:04:27.543611] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T18:04:27.958100] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-17T18:04:28.624768] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T18:04:28.758027] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-17T18:04:29.558077] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-17T18:04:29.620806] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T18:04:29.944429] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T18:04:30.358104] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-17T18:04:30.557295] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-17T18:04:31.158079] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-17T18:04:31.958080] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-17T18:04:32.177528] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T18:04:32.758093] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-17T18:04:32.901700] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T18:04:33.260837] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T18:04:33.558020] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-17T18:04:33.710009] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T18:04:34.358089] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-17T18:04:35.158087] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-17T18:04:35.448940] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T18:04:35.505768] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-17T18:04:35.514216] [INFO ] [REMOTE ] CLX: Full fetch complete (73651 records). [2025-10-17T18:04:35.514476] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-17T18:04:35.922158] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-17T18:04:35.922253] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-17T18:04:35.923154] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-17T18:04:35.923221] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-17T18:04:35.924711] [DEBUG] [LOCAL ] CLX: Trimmed 73651 records to 52408 (keeping 200 days of data) [2025-10-17T18:04:35.979988] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-17T18:04:36.262201] [DEBUG] [LOCAL ] CLX: Primary data saved (52408 records). [2025-10-17T18:04:36.262348] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-17T18:04:36.262424] [INFO ] [MAIN ] Update Progress: 470/2368 symbols completed. CLX took 43.7s. Estimated remaining: 4h 20m 38s. Rate: 7.3 symbols/min [2025-10-17T18:04:36.432036] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:04:36.478090] [DEBUG] [LOCAL ] CMC: Loaded 45871 existing records from primary storage. [2025-10-17T18:04:36.478637] [INFO ] [MAIN ] CMC: Loaded 45871 existing records. [2025-10-17T18:04:36.665556] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:04:36.666001] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-17T18:04:36.666159] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-17T18:04:36.666771] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-17T18:04:36.666883] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-17T18:04:36.758512] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-17T18:04:36.948027] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T18:04:37.122062] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:04:37.123286] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T18:04:37.558036] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-17T18:04:38.358093] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-17T18:04:38.704080] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T18:04:38.775507] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-17T18:04:39.158026] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-17T18:04:39.745577] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T18:04:39.958002] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-17T18:04:40.115816] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T18:04:40.758025] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-17T18:04:41.558022] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-17T18:04:41.630735] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T18:04:41.676955] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-17T18:04:42.358017] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-17T18:04:43.158026] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-17T18:04:43.226358] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T18:04:43.815379] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T18:04:43.958023] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-17T18:04:44.758002] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-17T18:04:45.100825] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-17T18:04:45.522015] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T18:04:45.558002] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-17T18:04:46.358006] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-17T18:04:46.418615] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T18:04:46.945233] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T18:04:47.158022] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-17T18:04:47.958028] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-17T18:04:48.046685] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T18:04:48.738361] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T18:04:48.757990] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-17T18:04:49.558026] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-17T18:04:49.943333] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-17T18:04:49.950201] [INFO ] [REMOTE ] CMBT: Full fetch complete (33107 records). [2025-10-17T18:04:49.950307] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-17T18:04:50.347445] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-17T18:04:50.347621] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-17T18:04:50.348345] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-17T18:04:50.348423] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-17T18:04:50.349540] [DEBUG] [LOCAL ] CMBT: Trimmed 33107 records to 26862 (keeping 200 days of data) [2025-10-17T18:04:50.402803] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-17T18:04:50.488913] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T18:04:50.559070] [DEBUG] [LOCAL ] CMBT: Primary data saved (26862 records). [2025-10-17T18:04:50.559232] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-17T18:04:50.559375] [INFO ] [MAIN ] Update Progress: 471/2368 symbols completed. CMBT took 25.0s. Estimated remaining: 4h 20m 54s. Rate: 7.3 symbols/min [2025-10-17T18:04:50.733005] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:04:50.733172] [DEBUG] [LOCAL ] CMCM: No existing data file found in primary storage. [2025-10-17T18:04:50.733209] [WARN ] [MAIN ] CMCM: No existing data found, performing full refresh instead. [2025-10-17T18:04:50.733321] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-17T18:04:50.733362] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-17T18:04:50.733402] [DEBUG] [LOCAL ] CMCM: No primary data file found to delete. [2025-10-17T18:04:50.733434] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-17T18:04:51.107989] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:04:51.158002] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-17T18:04:51.302737] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T18:04:51.958042] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-17T18:04:52.029395] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T18:04:52.431065] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T18:04:52.438604] [INFO ] [REMOTE ] CM: Full fetch complete (69877 records). [2025-10-17T18:04:52.438943] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-17T18:04:52.763324] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-17T18:04:52.854752] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-17T18:04:52.855166] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-17T18:04:52.856413] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-17T18:04:52.856489] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-17T18:04:52.858684] [DEBUG] [LOCAL ] CM: Trimmed 69877 records to 49434 (keeping 200 days of data) [2025-10-17T18:04:53.184899] [DEBUG] [LOCAL ] CM: Primary data saved (49434 records). [2025-10-17T18:04:53.185208] [INFO ] [MAIN ] CM: Full history saved. [2025-10-17T18:04:53.186053] [INFO ] [MAIN ] Update Progress: 472/2368 symbols completed. CM took 38.9s. Estimated remaining: 4h 20m 23s. Rate: 7.3 symbols/min [2025-10-17T18:04:53.362833] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:04:53.363220] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-17T18:04:53.363364] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-17T18:04:53.363639] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-17T18:04:53.363811] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-17T18:04:53.363902] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-17T18:04:53.364033] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-17T18:04:53.501320] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T18:04:53.563131] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-17T18:04:53.853371] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:04:54.358065] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-17T18:04:54.435053] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T18:04:54.847563] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T18:04:55.158100] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-17T18:04:55.317609] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T18:04:55.371512] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:04:55.372189] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-17T18:04:55.372318] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:04:55.372397] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-17T18:04:55.372459] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:04:55.372551] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-17T18:04:55.372686] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-17T18:04:55.372765] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-17T18:04:55.372837] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-17T18:04:55.372920] [INFO ] [MAIN ] Update Progress: 473/2368 symbols completed. CMDB took 2.2s. Estimated remaining: 4h 19m 50s. Rate: 7.3 symbols/min [2025-10-17T18:04:55.539761] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:04:55.592159] [DEBUG] [LOCAL ] CMG: Loaded 54111 existing records from primary storage. [2025-10-17T18:04:55.592484] [INFO ] [MAIN ] CMG: Loaded 54111 existing records. [2025-10-17T18:04:55.768440] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:04:55.768708] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-17T18:04:55.768766] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-17T18:04:55.769290] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-17T18:04:55.769348] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-17T18:04:55.966480] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-17T18:04:56.126134] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:04:56.758038] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-17T18:04:57.558017] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-17T18:04:57.786467] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T18:04:57.796721] [INFO ] [REMOTE ] CMA: Full fetch complete (73462 records). [2025-10-17T18:04:57.796847] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-17T18:04:58.222884] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-17T18:04:58.223063] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-17T18:04:58.224133] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-17T18:04:58.224341] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-17T18:04:58.226002] [DEBUG] [LOCAL ] CMA: Trimmed 73462 records to 50902 (keeping 200 days of data) [2025-10-17T18:04:58.356119] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T18:04:58.369459] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-17T18:04:58.588306] [DEBUG] [LOCAL ] CMA: Primary data saved (50902 records). [2025-10-17T18:04:58.588460] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-17T18:04:58.589001] [INFO ] [MAIN ] Update Progress: 474/2368 symbols completed. CMA took 40.2s. Estimated remaining: 4h 19m 22s. Rate: 7.3 symbols/min [2025-10-17T18:04:58.774100] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:04:58.820258] [DEBUG] [LOCAL ] CMI: Loaded 42011 existing records from primary storage. [2025-10-17T18:04:58.820605] [INFO ] [MAIN ] CMI: Loaded 42011 existing records. [2025-10-17T18:04:59.006547] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:04:59.006782] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-17T18:04:59.006871] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-17T18:04:59.007301] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-17T18:04:59.007358] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-17T18:04:59.128147] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T18:04:59.163102] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-17T18:04:59.397854] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:04:59.737734] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-17T18:04:59.816629] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-17T18:04:59.958047] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-17T18:05:00.477453] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-17T18:05:00.758040] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-17T18:05:01.558049] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-17T18:05:02.358061] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-17T18:05:02.391427] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-17T18:05:02.854176] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-17T18:05:03.158081] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-17T18:05:03.958066] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-17T18:05:04.051670] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T18:05:04.630184] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T18:05:04.692100] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-17T18:05:04.757985] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-17T18:05:05.558027] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-17T18:05:06.172327] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-17T18:05:06.282769] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T18:05:06.357997] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-17T18:05:06.847373] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-17T18:05:07.158015] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-17T18:05:07.958030] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-17T18:05:08.758096] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-17T18:05:09.301718] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-17T18:05:09.558031] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-17T18:05:09.761035] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T18:05:10.358039] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-17T18:05:10.476457] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T18:05:11.158037] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-17T18:05:11.794062] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-17T18:05:11.958019] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-17T18:05:11.982349] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T18:05:12.190328] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T18:05:12.758040] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-17T18:05:13.558014] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-17T18:05:13.608598] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T18:05:13.609988] [INFO ] [REMOTE ] CMCM: Full fetch complete (7009 records). [2025-10-17T18:05:13.610117] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-17T18:05:13.970988] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-17T18:05:13.971136] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-17T18:05:13.971347] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-17T18:05:13.971389] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-17T18:05:13.971843] [DEBUG] [LOCAL ] CMCM: Trimmed 7009 records to 4894 (keeping 200 days of data) [2025-10-17T18:05:13.998529] [DEBUG] [LOCAL ] CMCM: Primary data saved (4894 records). [2025-10-17T18:05:13.998608] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-17T18:05:13.998705] [INFO ] [MAIN ] Update Progress: 475/2368 symbols completed. CMCM took 23.4s. Estimated remaining: 4h 19m 43s. Rate: 7.3 symbols/min [2025-10-17T18:05:14.177183] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:05:14.211730] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-17T18:05:14.250842] [DEBUG] [LOCAL ] CMP: Loaded 36020 existing records from primary storage. [2025-10-17T18:05:14.251118] [INFO ] [MAIN ] CMP: Loaded 36020 existing records. [2025-10-17T18:05:14.363189] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-17T18:05:14.431556] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:05:14.431787] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-17T18:05:14.431844] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-17T18:05:14.432110] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-17T18:05:14.432179] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-17T18:05:14.787086] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:05:15.126869] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T18:05:15.158011] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-17T18:05:15.958015] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-17T18:05:16.198867] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T18:05:16.758015] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-17T18:05:17.047364] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T18:05:17.055182] [INFO ] [REMOTE ] CMC: Full fetch complete (67206 records). [2025-10-17T18:05:17.055360] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-17T18:05:17.444385] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-17T18:05:17.444506] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-17T18:05:17.445340] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-17T18:05:17.445423] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-17T18:05:17.446910] [DEBUG] [LOCAL ] CMC: Trimmed 67206 records to 46259 (keeping 200 days of data) [2025-10-17T18:05:17.558516] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-17T18:05:17.723563] [DEBUG] [LOCAL ] CMC: Primary data saved (46259 records). [2025-10-17T18:05:17.723716] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-17T18:05:17.723814] [INFO ] [MAIN ] Update Progress: 476/2368 symbols completed. CMC took 41.5s. Estimated remaining: 4h 19m 17s. Rate: 7.3 symbols/min [2025-10-17T18:05:17.895047] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:05:17.939618] [DEBUG] [LOCAL ] CMPO: Loaded 39076 existing records from primary storage. [2025-10-17T18:05:17.940031] [INFO ] [MAIN ] CMPO: Loaded 39076 existing records. [2025-10-17T18:05:18.129605] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:05:18.129946] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-17T18:05:18.130035] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-17T18:05:18.130431] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-17T18:05:18.130548] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-17T18:05:18.420768] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-17T18:05:18.459195] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-17T18:05:18.533342] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:05:18.558456] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T18:05:19.058265] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T18:05:19.158033] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-17T18:05:19.958045] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-17T18:05:20.531317] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-17T18:05:20.605539] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T18:05:20.758046] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-17T18:05:21.504222] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T18:05:21.558006] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-17T18:05:22.358082] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-17T18:05:22.841036] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-17T18:05:22.984603] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T18:05:23.158040] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-17T18:05:23.732458] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T18:05:23.958046] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-17T18:05:24.758065] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-17T18:05:25.357568] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T18:05:25.435903] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-17T18:05:25.557999] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-17T18:05:26.358012] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-17T18:05:26.541706] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T18:05:27.158060] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-17T18:05:27.711271] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T18:05:27.831502] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-17T18:05:27.958038] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-17T18:05:28.413151] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T18:05:28.758044] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-17T18:05:29.558030] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-17T18:05:30.079911] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-17T18:05:30.224052] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T18:05:30.358036] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-17T18:05:30.939350] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T18:05:30.945454] [INFO ] [REMOTE ] CMI: Full fetch complete (60910 records). [2025-10-17T18:05:30.945619] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-17T18:05:31.163232] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-17T18:05:31.322095] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-17T18:05:31.322182] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-17T18:05:31.322926] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-17T18:05:31.322989] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-17T18:05:31.324226] [DEBUG] [LOCAL ] CMI: Trimmed 60910 records to 42340 (keeping 200 days of data) [2025-10-17T18:05:31.589052] [DEBUG] [LOCAL ] CMI: Primary data saved (42340 records). [2025-10-17T18:05:31.589232] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-17T18:05:31.589879] [INFO ] [MAIN ] Update Progress: 477/2368 symbols completed. CMI took 33.0s. Estimated remaining: 4h 19m 31s. Rate: 7.3 symbols/min [2025-10-17T18:05:31.958117] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-17T18:05:32.787523] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-17T18:05:32.797312] [INFO ] [REMOTE ] CMG: Full fetch complete (77893 records). [2025-10-17T18:05:32.797501] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-17T18:05:33.067034] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T18:05:33.135389] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-17T18:05:33.233437] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-17T18:05:33.233637] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-17T18:05:33.234677] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-17T18:05:33.234757] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-17T18:05:33.257858] [DEBUG] [LOCAL ] CMG: Trimmed 77893 records to 54501 (keeping 200 days of data) [2025-10-17T18:05:33.259033] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T18:05:33.562940] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-17T18:05:33.586684] [DEBUG] [LOCAL ] CMG: Primary data saved (54501 records). [2025-10-17T18:05:33.586834] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-17T18:05:33.587385] [INFO ] [MAIN ] Update Progress: 478/2368 symbols completed. CMG took 38.2s. Estimated remaining: 4h 18m 58s. Rate: 7.3 symbols/min [2025-10-17T18:05:34.302872] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T18:05:34.357986] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-17T18:05:34.669770] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T18:05:35.158074] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-17T18:05:36.084941] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T18:05:36.098004] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-17T18:05:36.647884] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T18:05:36.758027] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-17T18:05:37.517961] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T18:05:37.558002] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-17T18:05:38.240253] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T18:05:38.358026] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-17T18:05:38.961567] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T18:05:39.158048] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-17T18:05:39.646091] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T18:05:39.958050] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-17T18:05:40.241517] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T18:05:40.758027] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-17T18:05:40.902185] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T18:05:41.558036] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-17T18:05:42.168197] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T18:05:42.358028] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-17T18:05:42.879203] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T18:05:42.883428] [INFO ] [REMOTE ] CMP: Full fetch complete (51676 records). [2025-10-17T18:05:42.883520] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-17T18:05:43.255663] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-17T18:05:43.255749] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-17T18:05:43.256423] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-17T18:05:43.256465] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-17T18:05:43.257486] [DEBUG] [LOCAL ] CMP: Trimmed 51676 records to 36229 (keeping 200 days of data) [2025-10-17T18:05:43.458603] [DEBUG] [LOCAL ] CMP: Primary data saved (36229 records). [2025-10-17T18:05:43.458761] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-17T18:05:43.458846] [INFO ] [MAIN ] Update Progress: 479/2368 symbols completed. CMP took 29.5s. Estimated remaining: 4h 18m 56s. Rate: 7.3 symbols/min [2025-10-17T18:05:43.693201] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T18:05:43.697991] [INFO ] [REMOTE ] CMPO: Full fetch complete (58206 records). [2025-10-17T18:05:43.698111] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-17T18:05:43.698831] [FATAL] [VALIDATOR ] CMPO: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:05:43.698932] [FATAL] [MAIN ] CMPO: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:05:43.699006] [WARN ] [MAIN ] CMPO: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:05:43.699097] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-17T18:05:43.699176] [DEBUG] [LOCAL ] CMPO: No primary data file found to delete. [2025-10-17T18:05:43.699216] [INFO ] [LOCAL ] CMPO: Starting deletion of derivative data. [2025-10-17T18:05:43.699393] [DEBUG] [LOCAL ] CMPO: Deleted derivative data file. [2025-10-17T18:05:43.699482] [INFO ] [MAIN ] Update Progress: 480/2368 symbols completed. CMPO took 26.0s. Estimated remaining: 4h 18m 16s. Rate: 7.3 symbols/min [2025-10-17T18:05:44.279871] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:05:44.459346] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:05:44.485839] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:05:44.506059] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:05:44.513589] [DEBUG] [LOCAL ] CMSA: Loaded 3562 existing records from primary storage. [2025-10-17T18:05:44.514007] [INFO ] [MAIN ] CMSA: Loaded 3562 existing records. [2025-10-17T18:05:44.623157] [DEBUG] [LOCAL ] CMSC: Loaded 4906 existing records from primary storage. [2025-10-17T18:05:44.631211] [INFO ] [MAIN ] CMSC: Loaded 4906 existing records. [2025-10-17T18:05:44.720691] [DEBUG] [LOCAL ] CMRE: Loaded 36175 existing records from primary storage. [2025-10-17T18:05:44.746795] [INFO ] [MAIN ] CMRE: Loaded 36175 existing records. [2025-10-17T18:05:44.983874] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:05:45.009184] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-17T18:05:45.043455] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-17T18:05:45.029626] [DEBUG] [LOCAL ] CMS: Loaded 52994 existing records from primary storage. [2025-10-17T18:05:45.098220] [INFO ] [MAIN ] CMS: Loaded 52994 existing records. [2025-10-17T18:05:45.102216] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:05:45.110279] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-17T18:05:45.127709] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-17T18:05:45.152075] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-17T18:05:45.151968] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:05:45.112950] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-17T18:05:45.187932] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-17T18:05:45.206506] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-17T18:05:45.235090] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-17T18:05:45.288283] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-17T18:05:45.414031] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-17T18:05:45.424671] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-17T18:05:45.762384] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:05:45.831227] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-17T18:05:45.858262] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-17T18:05:45.907352] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-17T18:05:45.929548] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-17T18:05:46.277629] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:05:46.317813] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-17T18:05:46.535020] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:05:46.566626] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-17T18:05:46.760481] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:05:46.773897] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-17T18:05:46.853808] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:05:46.854112] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-17T18:05:47.096637] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-17T18:05:47.098485] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-17T18:05:47.378604] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T18:05:47.380370] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-17T18:05:47.706792] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-17T18:05:47.959758] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-17T18:05:47.958363] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-17T18:05:48.049332] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T18:05:48.507337] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-17T18:05:48.509416] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T18:05:48.758002] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-17T18:05:49.558098] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-17T18:05:50.075886] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-17T18:05:50.165560] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-17T18:05:50.358045] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-17T18:05:50.812516] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-17T18:05:51.158085] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-17T18:05:51.958112] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-17T18:05:52.444310] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-17T18:05:52.758068] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-17T18:05:52.791342] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T18:05:53.558045] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-17T18:05:54.041834] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-17T18:05:54.121610] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T18:05:54.358110] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-17T18:05:54.956921] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T18:05:55.158055] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-17T18:05:55.495374] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-17T18:05:55.958094] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-17T18:05:56.758036] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-17T18:05:57.332559] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-17T18:05:57.558061] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-17T18:05:57.695174] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T18:05:58.280853] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T18:05:58.358091] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-17T18:05:58.934696] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T18:05:59.158135] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-17T18:05:59.722559] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-17T18:05:59.958092] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-17T18:06:00.665448] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T18:06:00.758068] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-17T18:06:01.558044] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-17T18:06:02.358088] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-17T18:06:02.937843] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-17T18:06:02.938073] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-17T18:06:03.158061] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-17T18:06:03.419520] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T18:06:03.958047] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-17T18:06:04.563773] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T18:06:04.669550] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-17T18:06:04.758078] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-17T18:06:05.370400] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T18:06:05.371405] [INFO ] [REMOTE ] CMSA: Full fetch complete (4961 records). [2025-10-17T18:06:05.371473] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-17T18:06:05.565212] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-17T18:06:05.733262] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-17T18:06:05.733338] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-17T18:06:05.733500] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-17T18:06:05.733540] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-17T18:06:05.733947] [DEBUG] [LOCAL ] CMSA: Trimmed 4961 records to 3570 (keeping 200 days of data) [2025-10-17T18:06:05.756947] [DEBUG] [LOCAL ] CMSA: Primary data saved (3570 records). [2025-10-17T18:06:05.757055] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-17T18:06:05.757141] [INFO ] [MAIN ] Update Progress: 481/2368 symbols completed. CMSA took 22.0s. Estimated remaining: 4h 19m 3s. Rate: 7.3 symbols/min [2025-10-17T18:06:05.923665] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:06:05.933362] [DEBUG] [LOCAL ] CMSD: Loaded 7871 existing records from primary storage. [2025-10-17T18:06:05.933549] [INFO ] [MAIN ] CMSD: Loaded 7871 existing records. [2025-10-17T18:06:06.107110] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:06:06.107398] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-17T18:06:06.107494] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-17T18:06:06.107760] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-17T18:06:06.107847] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-17T18:06:06.363119] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-17T18:06:06.465142] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:06:07.000491] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T18:06:07.122918] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T18:06:07.157993] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-17T18:06:07.725484] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T18:06:07.957999] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-17T18:06:08.658579] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T18:06:08.659843] [INFO ] [REMOTE ] CMSC: Full fetch complete (7038 records). [2025-10-17T18:06:08.659918] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-17T18:06:08.763140] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-17T18:06:09.025620] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-17T18:06:09.025728] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-17T18:06:09.025926] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-17T18:06:09.025972] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-17T18:06:09.026397] [DEBUG] [LOCAL ] CMSC: Trimmed 7038 records to 4946 (keeping 200 days of data) [2025-10-17T18:06:09.056389] [DEBUG] [LOCAL ] CMSC: Primary data saved (4946 records). [2025-10-17T18:06:09.056480] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-17T18:06:09.056564] [INFO ] [MAIN ] Update Progress: 482/2368 symbols completed. CMSC took 25.4s. Estimated remaining: 4h 18m 35s. Rate: 7.3 symbols/min [2025-10-17T18:06:09.235301] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:06:09.269002] [DEBUG] [LOCAL ] CMTG: Loaded 36073 existing records from primary storage. [2025-10-17T18:06:09.269282] [INFO ] [MAIN ] CMTG: Loaded 36073 existing records. [2025-10-17T18:06:09.454956] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:06:09.455199] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-17T18:06:09.455255] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-17T18:06:09.455636] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-17T18:06:09.455734] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-17T18:06:09.561834] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-17T18:06:09.815734] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:06:10.161715] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T18:06:10.358006] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-17T18:06:10.599341] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T18:06:11.158088] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-17T18:06:11.958079] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-17T18:06:12.156852] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T18:06:12.193087] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T18:06:12.445255] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T18:06:12.758005] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-17T18:06:13.433621] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T18:06:13.558003] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-17T18:06:14.308153] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-17T18:06:14.357998] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-17T18:06:15.158019] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-17T18:06:15.212305] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T18:06:15.958018] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-17T18:06:16.696241] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T18:06:16.757983] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-17T18:06:16.917720] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T18:06:17.481313] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T18:06:17.558027] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-17T18:06:18.299683] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T18:06:18.358063] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-17T18:06:19.158075] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-17T18:06:19.760002] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T18:06:19.958109] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-17T18:06:20.533626] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T18:06:20.758032] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-17T18:06:20.814312] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-17T18:06:21.558031] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-17T18:06:21.800698] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T18:06:22.338929] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-17T18:06:22.358000] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-17T18:06:23.057797] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T18:06:23.059356] [INFO ] [REMOTE ] CMSD: Full fetch complete (11679 records). [2025-10-17T18:06:23.059439] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-17T18:06:23.163292] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-17T18:06:23.426156] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-17T18:06:23.426242] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-17T18:06:23.426547] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-17T18:06:23.426588] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-17T18:06:23.427181] [DEBUG] [LOCAL ] CMSD: Trimmed 11679 records to 7921 (keeping 200 days of data) [2025-10-17T18:06:23.478261] [DEBUG] [LOCAL ] CMSD: Primary data saved (7921 records). [2025-10-17T18:06:23.478407] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-17T18:06:23.478503] [INFO ] [MAIN ] Update Progress: 483/2368 symbols completed. CMSD took 17.7s. Estimated remaining: 4h 18m 51s. Rate: 7.3 symbols/min [2025-10-17T18:06:23.644562] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:06:23.652833] [DEBUG] [LOCAL ] CMU: Loaded 6366 existing records from primary storage. [2025-10-17T18:06:23.653023] [INFO ] [MAIN ] CMU: Loaded 6366 existing records. [2025-10-17T18:06:23.827142] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:06:23.827379] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-17T18:06:23.827474] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-17T18:06:23.827729] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-17T18:06:23.827807] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-17T18:06:23.966228] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-17T18:06:24.185019] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:06:24.758089] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-17T18:06:24.791052] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T18:06:25.558005] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-17T18:06:26.078156] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-17T18:06:26.141782] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-17T18:06:26.358052] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-17T18:06:27.067629] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T18:06:27.157987] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-17T18:06:27.871630] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T18:06:27.957983] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-17T18:06:28.633555] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T18:06:28.757994] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-17T18:06:29.557995] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-17T18:06:29.754197] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T18:06:30.073437] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T18:06:30.218737] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-17T18:06:30.358072] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-17T18:06:31.047528] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-17T18:06:31.158020] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-17T18:06:31.662801] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-17T18:06:31.958063] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-17T18:06:32.758059] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-17T18:06:33.323109] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T18:06:33.558056] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-17T18:06:34.163149] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T18:06:34.352261] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T18:06:34.357985] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-17T18:06:35.154665] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-17T18:06:35.158192] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-17T18:06:35.958066] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-17T18:06:36.556550] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T18:06:36.758088] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-17T18:06:37.032225] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T18:06:37.039944] [INFO ] [REMOTE ] CMS: Full fetch complete (75844 records). [2025-10-17T18:06:37.040146] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-17T18:06:37.041267] [FATAL] [VALIDATOR ] CMS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:06:37.041371] [FATAL] [MAIN ] CMS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:06:37.041418] [WARN ] [MAIN ] CMS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:06:37.041463] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-17T18:06:37.041536] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-17T18:06:37.041590] [INFO ] [LOCAL ] CMS: Starting deletion of derivative data. [2025-10-17T18:06:37.041987] [DEBUG] [LOCAL ] CMS: Deleted derivative data file. [2025-10-17T18:06:37.042392] [INFO ] [MAIN ] Update Progress: 484/2368 symbols completed. CMS took 53.3s. Estimated remaining: 4h 19m 3s. Rate: 7.3 symbols/min [2025-10-17T18:06:37.218888] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:06:37.251347] [DEBUG] [LOCAL ] CNA: Loaded 33156 existing records from primary storage. [2025-10-17T18:06:37.251636] [INFO ] [MAIN ] CNA: Loaded 33156 existing records. [2025-10-17T18:06:37.426311] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:06:37.426536] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-17T18:06:37.426583] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-17T18:06:37.427154] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-17T18:06:37.427212] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-17T18:06:37.568317] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-17T18:06:37.784163] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:06:38.345721] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T18:06:38.357982] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-17T18:06:39.155486] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T18:06:39.160482] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-17T18:06:39.162235] [INFO ] [REMOTE ] CMRE: Full fetch complete (51280 records). [2025-10-17T18:06:39.162355] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-17T18:06:39.541108] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-17T18:06:39.541265] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-17T18:06:39.542064] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-17T18:06:39.542141] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-17T18:06:39.558386] [DEBUG] [LOCAL ] CMRE: Trimmed 51280 records to 36418 (keeping 200 days of data) [2025-10-17T18:06:39.559628] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-17T18:06:39.779576] [DEBUG] [LOCAL ] CMRE: Primary data saved (36418 records). [2025-10-17T18:06:39.779757] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-17T18:06:39.779850] [INFO ] [MAIN ] Update Progress: 485/2368 symbols completed. CMRE took 56.1s. Estimated remaining: 4h 18m 34s. Rate: 7.3 symbols/min [2025-10-17T18:06:39.884977] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T18:06:39.956804] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:06:39.957992] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-17T18:06:40.006836] [DEBUG] [LOCAL ] CNC: Loaded 54160 existing records from primary storage. [2025-10-17T18:06:40.007159] [INFO ] [MAIN ] CNC: Loaded 54160 existing records. [2025-10-17T18:06:40.179857] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:06:40.180095] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-17T18:06:40.180145] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-17T18:06:40.180638] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-17T18:06:40.180730] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-17T18:06:40.531847] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:06:40.757997] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-17T18:06:41.230683] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T18:06:41.558042] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-17T18:06:42.357980] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-17T18:06:42.550901] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T18:06:42.648801] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T18:06:43.158018] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-17T18:06:43.294803] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-17T18:06:43.958022] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-17T18:06:44.226132] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T18:06:44.758051] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-17T18:06:45.558066] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-17T18:06:45.632708] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T18:06:46.161414] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T18:06:46.234669] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T18:06:46.358020] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-17T18:06:47.158086] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-17T18:06:47.727326] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T18:06:47.958026] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-17T18:06:48.552399] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T18:06:48.758079] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-17T18:06:48.795381] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T18:06:49.558039] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-17T18:06:49.878832] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T18:06:49.883782] [INFO ] [REMOTE ] CMTG: Full fetch complete (53357 records). [2025-10-17T18:06:49.883969] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-17T18:06:50.024765] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-17T18:06:50.059590] [INFO ] [REMOTE ] CMU: Full fetch complete (9468 records). [2025-10-17T18:06:50.083224] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-17T18:06:50.361014] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-17T18:06:50.527618] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-17T18:06:50.532929] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-17T18:06:50.546413] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-17T18:06:50.546514] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-17T18:06:50.610303] [DEBUG] [LOCAL ] CMTG: Trimmed 53357 records to 36246 (keeping 200 days of data) [2025-10-17T18:06:50.800815] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-17T18:06:50.800903] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-17T18:06:50.801049] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-17T18:06:50.801091] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-17T18:06:50.842913] [DEBUG] [LOCAL ] CMU: Trimmed 9468 records to 6381 (keeping 200 days of data) [2025-10-17T18:06:50.925958] [DEBUG] [LOCAL ] CMTG: Primary data saved (36246 records). [2025-10-17T18:06:50.930082] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-17T18:06:50.930214] [INFO ] [MAIN ] Update Progress: 486/2368 symbols completed. CMTG took 41.9s. Estimated remaining: 4h 18m 37s. Rate: 7.3 symbols/min [2025-10-17T18:06:50.934368] [DEBUG] [LOCAL ] CMU: Primary data saved (6381 records). [2025-10-17T18:06:50.939797] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-17T18:06:50.993562] [INFO ] [MAIN ] Update Progress: 487/2368 symbols completed. CMU took 27.5s. Estimated remaining: 4h 17m 57s. Rate: 7.3 symbols/min [2025-10-17T18:06:51.168333] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-17T18:06:51.247071] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:06:51.293251] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:06:51.293499] [DEBUG] [LOCAL ] CNH: No existing data file found in primary storage. [2025-10-17T18:06:51.293560] [WARN ] [MAIN ] CNH: No existing data found, performing full refresh instead. [2025-10-17T18:06:51.293737] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-17T18:06:51.293786] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-17T18:06:51.293830] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-17T18:06:51.293863] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-17T18:06:51.401961] [DEBUG] [LOCAL ] CNF: Loaded 10646 existing records from primary storage. [2025-10-17T18:06:51.408074] [INFO ] [MAIN ] CNF: Loaded 10646 existing records. [2025-10-17T18:06:51.817851] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:06:51.834241] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-17T18:06:51.834767] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-17T18:06:51.851623] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-17T18:06:51.851794] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-17T18:06:51.886683] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:06:51.963132] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-17T18:06:52.210465] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:06:52.425071] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T18:06:52.467776] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T18:06:52.758076] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-17T18:06:53.558023] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-17T18:06:53.704061] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T18:06:54.010292] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-17T18:06:54.358062] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-17T18:06:55.158038] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-17T18:06:55.237534] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T18:06:55.763400] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T18:06:55.958117] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-17T18:06:56.064022] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T18:06:56.758067] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-17T18:06:57.557990] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-17T18:06:57.640007] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T18:06:58.361079] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-17T18:06:58.366737] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T18:06:58.977311] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T18:06:59.163103] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-17T18:06:59.179056] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T18:06:59.958036] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-17T18:07:00.553323] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T18:07:00.758036] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-17T18:07:01.450242] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T18:07:01.558026] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-17T18:07:02.160126] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T18:07:02.357996] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-17T18:07:03.158011] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-17T18:07:03.252477] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T18:07:03.958032] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-17T18:07:04.406602] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-17T18:07:04.425216] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T18:07:04.429593] [INFO ] [REMOTE ] CNA: Full fetch complete (46103 records). [2025-10-17T18:07:04.429700] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-17T18:07:04.763213] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-17T18:07:04.829572] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-17T18:07:04.829723] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-17T18:07:04.830349] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-17T18:07:04.830420] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-17T18:07:04.831483] [DEBUG] [LOCAL ] CNA: Trimmed 46103 records to 33357 (keeping 200 days of data) [2025-10-17T18:07:05.065830] [DEBUG] [LOCAL ] CNA: Primary data saved (33357 records). [2025-10-17T18:07:05.066535] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-17T18:07:05.067710] [INFO ] [MAIN ] Update Progress: 488/2368 symbols completed. CNA took 28.0s. Estimated remaining: 4h 18m 11s. Rate: 7.3 symbols/min [2025-10-17T18:07:05.067553] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-17T18:07:05.247462] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:07:05.298961] [DEBUG] [LOCAL ] CNI: Loaded 52078 existing records from primary storage. [2025-10-17T18:07:05.299301] [INFO ] [MAIN ] CNI: Loaded 52078 existing records. [2025-10-17T18:07:05.480270] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:07:05.481384] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-17T18:07:05.481445] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-17T18:07:05.482344] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-17T18:07:05.482404] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-17T18:07:05.563363] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-17T18:07:05.841073] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:07:06.358015] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-17T18:07:06.539771] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-17T18:07:06.690876] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T18:07:07.158029] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-17T18:07:07.958079] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-17T18:07:08.346691] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-17T18:07:08.598240] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T18:07:08.758084] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-17T18:07:08.986095] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-17T18:07:09.506166] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T18:07:09.558040] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-17T18:07:10.358013] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-17T18:07:10.510811] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T18:07:11.158172] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-17T18:07:11.958112] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-17T18:07:12.236937] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T18:07:12.726049] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-17T18:07:12.758065] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-17T18:07:13.249825] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-17T18:07:13.558030] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-17T18:07:13.756196] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-17T18:07:14.358090] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-17T18:07:15.158071] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-17T18:07:15.345431] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-17T18:07:15.753537] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T18:07:15.761359] [INFO ] [REMOTE ] CNC: Full fetch complete (77849 records). [2025-10-17T18:07:15.761530] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-17T18:07:15.964950] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-17T18:07:16.164624] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-17T18:07:16.164794] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-17T18:07:16.165747] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-17T18:07:16.165835] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-17T18:07:16.167475] [DEBUG] [LOCAL ] CNC: Trimmed 77849 records to 54550 (keeping 200 days of data) [2025-10-17T18:07:16.281460] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-17T18:07:16.529417] [DEBUG] [LOCAL ] CNC: Primary data saved (54550 records). [2025-10-17T18:07:16.529612] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-17T18:07:16.530240] [INFO ] [MAIN ] Update Progress: 489/2368 symbols completed. CNC took 36.8s. Estimated remaining: 4h 18m 15s. Rate: 7.3 symbols/min [2025-10-17T18:07:16.694664] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:07:16.745295] [DEBUG] [LOCAL ] CNK: Loaded 53289 existing records from primary storage. [2025-10-17T18:07:16.745598] [INFO ] [MAIN ] CNK: Loaded 53289 existing records. [2025-10-17T18:07:16.765676] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-17T18:07:16.925176] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:07:16.925364] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-17T18:07:16.925410] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-17T18:07:16.925812] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-17T18:07:16.925870] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-17T18:07:17.063992] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T18:07:17.337943] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:07:17.558073] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-17T18:07:18.358119] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-17T18:07:18.593289] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T18:07:19.158135] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-17T18:07:19.341234] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T18:07:19.958048] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-17T18:07:20.186409] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T18:07:20.758144] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-17T18:07:20.996174] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T18:07:21.558060] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-17T18:07:21.634413] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T18:07:22.225613] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T18:07:22.358153] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-17T18:07:22.358990] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T18:07:22.361404] [INFO ] [REMOTE ] CNF: Full fetch complete (13048 records). [2025-10-17T18:07:22.361480] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-17T18:07:22.715096] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-17T18:07:22.715171] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-17T18:07:22.715470] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-17T18:07:22.715509] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-17T18:07:22.716087] [DEBUG] [LOCAL ] CNF: Trimmed 13048 records to 10666 (keeping 200 days of data) [2025-10-17T18:07:22.771743] [DEBUG] [LOCAL ] CNF: Primary data saved (10666 records). [2025-10-17T18:07:22.771870] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-17T18:07:22.771951] [INFO ] [MAIN ] Update Progress: 490/2368 symbols completed. CNF took 31.8s. Estimated remaining: 4h 17m 60s. Rate: 7.3 symbols/min [2025-10-17T18:07:22.936625] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:07:22.982316] [DEBUG] [LOCAL ] CNM: Loaded 51414 existing records from primary storage. [2025-10-17T18:07:22.982619] [INFO ] [MAIN ] CNM: Loaded 51414 existing records. [2025-10-17T18:07:23.161031] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:07:23.161170] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-17T18:07:23.161704] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-17T18:07:23.162743] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-17T18:07:23.162947] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-17T18:07:23.162993] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-17T18:07:23.509002] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:07:23.958086] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-17T18:07:24.069952] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T18:07:24.758061] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-17T18:07:25.059472] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T18:07:25.558027] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-17T18:07:25.695528] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T18:07:26.203726] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T18:07:26.358029] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-17T18:07:27.158062] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-17T18:07:27.320069] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T18:07:27.718945] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T18:07:27.958068] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-17T18:07:28.758085] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-17T18:07:29.266466] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-17T18:07:29.459073] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T18:07:29.558001] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-17T18:07:30.358086] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-17T18:07:30.620765] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T18:07:31.158029] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-17T18:07:31.300862] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T18:07:31.958007] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-17T18:07:32.179043] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T18:07:32.744831] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T18:07:32.757981] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-17T18:07:33.557997] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-17T18:07:34.021942] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-17T18:07:34.358041] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-17T18:07:34.524881] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T18:07:35.014513] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T18:07:35.158028] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-17T18:07:35.958070] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-17T18:07:36.489879] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-17T18:07:36.758015] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-17T18:07:37.019535] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T18:07:37.454879] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T18:07:37.558020] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-17T18:07:38.358013] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-17T18:07:38.456205] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T18:07:39.158002] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-17T18:07:39.314509] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T18:07:39.957997] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-17T18:07:40.263369] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-17T18:07:40.270821] [INFO ] [REMOTE ] CNH: Full fetch complete (77706 records). [2025-10-17T18:07:40.270985] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-17T18:07:40.664152] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-17T18:07:40.664252] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-17T18:07:40.665215] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-17T18:07:40.665291] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-17T18:07:40.666749] [DEBUG] [LOCAL ] CNH: Trimmed 77706 records to 54332 (keeping 200 days of data) [2025-10-17T18:07:40.760223] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-17T18:07:40.918097] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T18:07:41.029378] [DEBUG] [LOCAL ] CNH: Primary data saved (54332 records). [2025-10-17T18:07:41.029512] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-17T18:07:41.029583] [INFO ] [MAIN ] Update Progress: 491/2368 symbols completed. CNH took 50.0s. Estimated remaining: 4h 18m 30s. Rate: 7.3 symbols/min [2025-10-17T18:07:41.196673] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:07:41.227551] [DEBUG] [LOCAL ] CNMD: Loaded 32319 existing records from primary storage. [2025-10-17T18:07:41.227985] [INFO ] [MAIN ] CNMD: Loaded 32319 existing records. [2025-10-17T18:07:41.408276] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:07:41.408510] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-17T18:07:41.408582] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-17T18:07:41.408854] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-17T18:07:41.408931] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-17T18:07:41.565290] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-17T18:07:41.771400] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:07:41.804418] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T18:07:42.358055] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-17T18:07:42.747224] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T18:07:43.158008] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-17T18:07:43.297491] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T18:07:43.958009] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-17T18:07:44.197628] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T18:07:44.204954] [INFO ] [REMOTE ] CNK: Full fetch complete (76183 records). [2025-10-17T18:07:44.205068] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-17T18:07:44.618194] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-17T18:07:44.618271] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-17T18:07:44.619104] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-17T18:07:44.619168] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-17T18:07:44.620535] [DEBUG] [LOCAL ] CNK: Trimmed 76183 records to 53677 (keeping 200 days of data) [2025-10-17T18:07:44.793891] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-17T18:07:44.943070] [DEBUG] [LOCAL ] CNK: Primary data saved (53677 records). [2025-10-17T18:07:44.943200] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-17T18:07:44.943730] [INFO ] [MAIN ] Update Progress: 492/2368 symbols completed. CNK took 28.4s. Estimated remaining: 4h 18m 5s. Rate: 7.3 symbols/min [2025-10-17T18:07:45.117303] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:07:45.138521] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-17T18:07:45.146585] [INFO ] [REMOTE ] CNI: Full fetch complete (74866 records). [2025-10-17T18:07:45.146917] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-17T18:07:45.307476] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T18:07:45.427323] [DEBUG] [LOCAL ] CNNE: Loaded 36234 existing records from primary storage. [2025-10-17T18:07:45.472488] [INFO ] [MAIN ] CNNE: Loaded 36234 existing records. [2025-10-17T18:07:45.562248] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-17T18:07:45.780591] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-17T18:07:45.780355] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:07:45.780823] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-17T18:07:45.781910] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-17T18:07:45.782060] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-17T18:07:45.781993] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-17T18:07:45.782357] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-17T18:07:45.782568] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-17T18:07:45.782623] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-17T18:07:45.873179] [DEBUG] [LOCAL ] CNI: Trimmed 74866 records to 52456 (keeping 200 days of data) [2025-10-17T18:07:46.247869] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:07:46.358282] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-17T18:07:46.465607] [DEBUG] [LOCAL ] CNI: Primary data saved (52456 records). [2025-10-17T18:07:46.465775] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-17T18:07:46.466632] [INFO ] [MAIN ] Update Progress: 493/2368 symbols completed. CNI took 41.4s. Estimated remaining: 4h 17m 31s. Rate: 7.3 symbols/min [2025-10-17T18:07:46.645381] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:07:46.695628] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T18:07:46.719498] [DEBUG] [LOCAL ] CNO: Loaded 40958 existing records from primary storage. [2025-10-17T18:07:46.719936] [INFO ] [MAIN ] CNO: Loaded 40958 existing records. [2025-10-17T18:07:46.902894] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:07:46.903217] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-17T18:07:46.903303] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-17T18:07:46.903750] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-17T18:07:46.903810] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-17T18:07:47.172255] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-17T18:07:47.201224] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T18:07:47.286595] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:07:47.550257] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T18:07:47.958053] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-17T18:07:48.758136] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-17T18:07:49.013833] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T18:07:49.084003] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T18:07:49.558025] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-17T18:07:49.967555] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T18:07:50.358020] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-17T18:07:51.158007] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-17T18:07:51.496550] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T18:07:51.504285] [INFO ] [REMOTE ] CNM: Full fetch complete (73760 records). [2025-10-17T18:07:51.504603] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-17T18:07:51.824436] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T18:07:51.958690] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-17T18:07:51.959933] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-17T18:07:51.960029] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-17T18:07:51.961033] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-17T18:07:51.961203] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-17T18:07:51.963256] [DEBUG] [LOCAL ] CNM: Trimmed 73760 records to 51797 (keeping 200 days of data) [2025-10-17T18:07:52.103669] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T18:07:52.299600] [DEBUG] [LOCAL ] CNM: Primary data saved (51797 records). [2025-10-17T18:07:52.299791] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-17T18:07:52.299929] [INFO ] [MAIN ] Update Progress: 494/2368 symbols completed. CNM took 29.5s. Estimated remaining: 4h 17m 13s. Rate: 7.3 symbols/min [2025-10-17T18:07:52.477201] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:07:52.529158] [DEBUG] [LOCAL ] CNP: Loaded 53869 existing records from primary storage. [2025-10-17T18:07:52.529484] [INFO ] [MAIN ] CNP: Loaded 53869 existing records. [2025-10-17T18:07:52.716126] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:07:52.716333] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-17T18:07:52.716380] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-17T18:07:52.716795] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-17T18:07:52.716851] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-17T18:07:52.769573] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-17T18:07:53.077200] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:07:53.563175] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-17T18:07:53.581103] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:07:54.285485] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T18:07:54.357984] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-17T18:07:55.112786] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T18:07:55.157981] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-17T18:07:55.822300] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T18:07:55.958042] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-17T18:07:56.672024] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T18:07:56.758006] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-17T18:07:57.558049] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-17T18:07:57.747561] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T18:07:58.275123] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T18:07:58.358028] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-17T18:07:59.163377] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-17T18:07:59.165790] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T18:07:59.637192] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-17T18:07:59.958080] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-17T18:08:00.758091] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-17T18:08:00.997550] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T18:08:01.565187] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-17T18:08:01.587583] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T18:08:02.000777] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T18:08:02.358032] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-17T18:08:03.158056] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-17T18:08:03.432447] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-17T18:08:03.958075] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-17T18:08:04.001040] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T18:08:04.680033] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-17T18:08:04.758007] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-17T18:08:05.130187] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T18:08:05.558062] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-17T18:08:06.148812] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T18:08:06.358064] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-17T18:08:07.105957] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T18:08:07.158006] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-17T18:08:07.737305] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T18:08:07.958034] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-17T18:08:08.023131] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-17T18:08:08.758027] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-17T18:08:09.558007] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-17T18:08:09.851708] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T18:08:09.856429] [INFO ] [REMOTE ] CNNE: Full fetch complete (50317 records). [2025-10-17T18:08:09.856548] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-17T18:08:09.857374] [FATAL] [VALIDATOR ] CNNE: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:08:09.857484] [FATAL] [MAIN ] CNNE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:08:09.857548] [WARN ] [MAIN ] CNNE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:08:09.857622] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-17T18:08:09.857732] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-17T18:08:09.857781] [INFO ] [LOCAL ] CNNE: Starting deletion of derivative data. [2025-10-17T18:08:09.857914] [DEBUG] [LOCAL ] CNNE: Deleted derivative data file. [2025-10-17T18:08:09.858259] [INFO ] [MAIN ] Update Progress: 495/2368 symbols completed. CNNE took 24.9s. Estimated remaining: 4h 17m 41s. Rate: 7.3 symbols/min [2025-10-17T18:08:10.025701] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:08:10.075962] [DEBUG] [LOCAL ] CNQ: Loaded 53972 existing records from primary storage. [2025-10-17T18:08:10.076305] [INFO ] [MAIN ] CNQ: Loaded 53972 existing records. [2025-10-17T18:08:10.252449] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:08:10.252662] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-17T18:08:10.252722] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-17T18:08:10.253058] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-17T18:08:10.253097] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-17T18:08:10.361306] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-17T18:08:10.651131] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:08:10.692058] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T18:08:10.947179] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-17T18:08:11.158039] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-17T18:08:11.341995] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-17T18:08:11.346603] [INFO ] [REMOTE ] CNMD: Full fetch complete (47197 records). [2025-10-17T18:08:11.346727] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-17T18:08:11.755838] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-17T18:08:11.755923] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-17T18:08:11.756663] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-17T18:08:11.756748] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-17T18:08:11.757862] [DEBUG] [LOCAL ] CNMD: Trimmed 47197 records to 32497 (keeping 200 days of data) [2025-10-17T18:08:11.958518] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-17T18:08:11.969427] [DEBUG] [LOCAL ] CNMD: Primary data saved (32497 records). [2025-10-17T18:08:11.969584] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-17T18:08:11.969801] [INFO ] [MAIN ] Update Progress: 496/2368 symbols completed. CNMD took 30.9s. Estimated remaining: 4h 17m 9s. Rate: 7.3 symbols/min [2025-10-17T18:08:12.140414] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:08:12.140586] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-17T18:08:12.140625] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-17T18:08:12.140775] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-17T18:08:12.140845] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-17T18:08:12.140905] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-17T18:08:12.140950] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-17T18:08:12.508033] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:08:12.758014] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-17T18:08:12.939145] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T18:08:13.502606] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T18:08:13.558076] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-17T18:08:13.763575] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:08:13.764118] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-17T18:08:13.764221] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:08:13.764324] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-17T18:08:13.764393] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:08:13.764473] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-17T18:08:13.764549] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-17T18:08:13.764590] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-17T18:08:13.764629] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-17T18:08:13.764725] [INFO ] [MAIN ] Update Progress: 497/2368 symbols completed. CNR took 1.8s. Estimated remaining: 4h 16m 37s. Rate: 7.3 symbols/min [2025-10-17T18:08:13.959470] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:08:13.983160] [DEBUG] [LOCAL ] CNS: Loaded 21369 existing records from primary storage. [2025-10-17T18:08:13.983572] [INFO ] [MAIN ] CNS: Loaded 21369 existing records. [2025-10-17T18:08:14.178670] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:08:14.179012] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-17T18:08:14.179066] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-17T18:08:14.179294] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-17T18:08:14.179352] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-17T18:08:14.358481] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-17T18:08:14.581145] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:08:14.608484] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T18:08:15.158085] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-17T18:08:15.955669] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:08:15.965417] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-17T18:08:16.021443] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-17T18:08:16.758074] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-17T18:08:17.558048] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-17T18:08:17.843403] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-17T18:08:18.358092] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-17T18:08:18.490266] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T18:08:18.627168] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T18:08:19.158156] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-17T18:08:19.958003] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-17T18:08:20.081471] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T18:08:20.758011] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-17T18:08:21.036407] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T18:08:21.078618] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-17T18:08:21.558044] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-17T18:08:22.358102] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-17T18:08:22.774982] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T18:08:22.802502] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T18:08:23.158079] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-17T18:08:23.518156] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T18:08:23.958010] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-17T18:08:24.758041] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-17T18:08:24.985825] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T18:08:25.557999] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-17T18:08:25.658719] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T18:08:25.726889] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T18:08:26.358057] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-17T18:08:27.019852] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T18:08:27.158032] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-17T18:08:27.831216] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T18:08:27.958037] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-17T18:08:28.758005] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-17T18:08:28.929331] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T18:08:28.936921] [INFO ] [REMOTE ] CNP: Full fetch complete (77551 records). [2025-10-17T18:08:28.937102] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-17T18:08:29.327782] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-17T18:08:29.327861] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-17T18:08:29.328765] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-17T18:08:29.328829] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-17T18:08:29.330234] [DEBUG] [LOCAL ] CNP: Trimmed 77551 records to 54258 (keeping 200 days of data) [2025-10-17T18:08:29.558813] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-17T18:08:29.652717] [DEBUG] [LOCAL ] CNP: Primary data saved (54258 records). [2025-10-17T18:08:29.652856] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-17T18:08:29.652939] [INFO ] [MAIN ] Update Progress: 498/2368 symbols completed. CNP took 37.4s. Estimated remaining: 4h 16m 57s. Rate: 7.3 symbols/min [2025-10-17T18:08:29.821880] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:08:29.874598] [DEBUG] [LOCAL ] CNX: Loaded 51742 existing records from primary storage. [2025-10-17T18:08:29.875222] [INFO ] [MAIN ] CNX: Loaded 51742 existing records. [2025-10-17T18:08:30.056687] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:08:30.057277] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-17T18:08:30.057386] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-17T18:08:30.058118] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-17T18:08:30.058231] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-17T18:08:30.292936] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T18:08:30.297861] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-17T18:08:30.369810] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-17T18:08:30.500911] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:08:30.693067] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T18:08:31.158036] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-17T18:08:31.958023] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-17T18:08:32.058618] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T18:08:32.065275] [INFO ] [REMOTE ] CNO: Full fetch complete (60863 records). [2025-10-17T18:08:32.065481] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-17T18:08:32.362305] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T18:08:32.518857] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-17T18:08:32.518989] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-17T18:08:32.520104] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-17T18:08:32.520172] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-17T18:08:32.522030] [DEBUG] [LOCAL ] CNO: Trimmed 60863 records to 41237 (keeping 200 days of data) [2025-10-17T18:08:32.759904] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-17T18:08:32.799340] [DEBUG] [LOCAL ] CNO: Primary data saved (41237 records). [2025-10-17T18:08:32.799539] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-17T18:08:32.800529] [INFO ] [MAIN ] Update Progress: 499/2368 symbols completed. CNO took 46.3s. Estimated remaining: 4h 16m 30s. Rate: 7.3 symbols/min [2025-10-17T18:08:32.977773] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:08:33.023792] [DEBUG] [LOCAL ] CODI: Loaded 41807 existing records from primary storage. [2025-10-17T18:08:33.024048] [INFO ] [MAIN ] CODI: Loaded 41807 existing records. [2025-10-17T18:08:33.200660] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:08:33.200862] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-17T18:08:33.200909] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-17T18:08:33.201282] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-17T18:08:33.201338] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-17T18:08:33.556861] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:08:33.557978] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-17T18:08:33.632717] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T18:08:33.846058] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T18:08:34.358060] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-17T18:08:34.605039] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T18:08:35.158059] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-17T18:08:35.957998] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-17T18:08:36.325478] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T18:08:36.758086] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-17T18:08:37.030033] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T18:08:37.055899] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T18:08:37.558071] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-17T18:08:38.357989] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-17T18:08:38.642057] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T18:08:38.814491] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-17T18:08:39.158015] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-17T18:08:39.957998] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-17T18:08:40.199368] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-17T18:08:40.234054] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T18:08:40.758066] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-17T18:08:41.558078] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-17T18:08:41.755530] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-17T18:08:41.865553] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T18:08:42.358101] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-17T18:08:42.894771] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T18:08:43.158059] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-17T18:08:43.360077] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T18:08:43.958074] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-17T18:08:44.377879] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T18:08:44.758078] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-17T18:08:45.558017] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-17T18:08:45.622536] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T18:08:46.064490] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T18:08:46.068338] [INFO ] [REMOTE ] CNS: Full fetch complete (30777 records). [2025-10-17T18:08:46.068431] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-17T18:08:46.068999] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:08:46.069098] [FATAL] [MAIN ] CNS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:08:46.069187] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:08:46.069281] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-17T18:08:46.069369] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-17T18:08:46.069411] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-10-17T18:08:46.069592] [DEBUG] [LOCAL ] CNS: Deleted derivative data file. [2025-10-17T18:08:46.069712] [INFO ] [MAIN ] Update Progress: 500/2368 symbols completed. CNS took 32.3s. Estimated remaining: 4h 16m 40s. Rate: 7.3 symbols/min [2025-10-17T18:08:46.239196] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:08:46.288488] [DEBUG] [LOCAL ] COF: Loaded 54012 existing records from primary storage. [2025-10-17T18:08:46.288831] [INFO ] [MAIN ] COF: Loaded 54012 existing records. [2025-10-17T18:08:46.363146] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-17T18:08:46.465467] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:08:46.465712] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-17T18:08:46.465771] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-17T18:08:46.465959] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-17T18:08:46.466006] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-17T18:08:46.809262] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:08:47.104150] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T18:08:47.157990] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-17T18:08:47.921093] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T18:08:47.957995] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-17T18:08:48.758020] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-17T18:08:49.229543] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-17T18:08:49.558013] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-17T18:08:49.929579] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-17T18:08:49.936950] [INFO ] [REMOTE ] CNQ: Full fetch complete (77740 records). [2025-10-17T18:08:49.937078] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-17T18:08:50.342277] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-17T18:08:50.342432] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-17T18:08:50.343383] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-17T18:08:50.343501] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-17T18:08:50.345173] [DEBUG] [LOCAL ] CNQ: Trimmed 77740 records to 54362 (keeping 200 days of data) [2025-10-17T18:08:50.398835] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-17T18:08:50.484129] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T18:08:50.721788] [DEBUG] [LOCAL ] CNQ: Primary data saved (54362 records). [2025-10-17T18:08:50.721941] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-17T18:08:50.722525] [INFO ] [MAIN ] Update Progress: 501/2368 symbols completed. CNQ took 40.9s. Estimated remaining: 4h 16m 19s. Rate: 7.3 symbols/min [2025-10-17T18:08:50.919324] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:08:50.919532] [DEBUG] [LOCAL ] COHR: No existing data file found in primary storage. [2025-10-17T18:08:50.919570] [WARN ] [MAIN ] COHR: No existing data found, performing full refresh instead. [2025-10-17T18:08:50.919717] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-17T18:08:50.919766] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-17T18:08:50.919808] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-17T18:08:50.919839] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-17T18:08:51.163431] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-17T18:08:51.277875] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:08:51.855632] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-17T18:08:51.958045] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-17T18:08:52.511990] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-17T18:08:52.758053] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-17T18:08:52.931237] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T18:08:53.558048] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-17T18:08:53.983964] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-17T18:08:54.358085] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-17T18:08:54.783822] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T18:08:54.845061] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T18:08:55.158100] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-17T18:08:55.958098] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-17T18:08:56.162767] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T18:08:56.758087] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-17T18:08:56.877389] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T18:08:57.557999] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-17T18:08:57.657911] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T18:08:58.358036] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-17T18:08:58.783966] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-17T18:08:59.158007] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-17T18:08:59.562849] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-17T18:08:59.958050] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-17T18:09:00.168273] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T18:09:00.174818] [INFO ] [REMOTE ] CODI: Full fetch complete (53111 records). [2025-10-17T18:09:00.174972] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-17T18:09:00.559403] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-17T18:09:00.559530] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-17T18:09:00.560284] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-17T18:09:00.560349] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-17T18:09:00.561565] [DEBUG] [LOCAL ] CODI: Trimmed 53111 records to 42174 (keeping 200 days of data) [2025-10-17T18:09:00.758909] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-17T18:09:00.796017] [DEBUG] [LOCAL ] CODI: Primary data saved (42174 records). [2025-10-17T18:09:00.796152] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-17T18:09:00.796616] [INFO ] [MAIN ] Update Progress: 502/2368 symbols completed. CODI took 28.0s. Estimated remaining: 4h 16m 17s. Rate: 7.3 symbols/min [2025-10-17T18:09:00.973789] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:09:01.025937] [DEBUG] [LOCAL ] COLD: Loaded 52781 existing records from primary storage. [2025-10-17T18:09:01.026241] [INFO ] [MAIN ] COLD: Loaded 52781 existing records. [2025-10-17T18:09:01.230944] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:09:01.231392] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-17T18:09:01.231452] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-17T18:09:01.231803] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-17T18:09:01.231863] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-17T18:09:01.610331] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:09:01.610890] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-17T18:09:01.646754] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-17T18:09:02.270319] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-17T18:09:02.358057] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-17T18:09:03.158062] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-17T18:09:03.360263] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-17T18:09:03.958022] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-17T18:09:04.421030] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (2.81 seconds). [2025-10-17T18:09:04.628742] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-17T18:09:04.758118] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-17T18:09:05.131308] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T18:09:05.558042] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-17T18:09:05.742903] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T18:09:06.358022] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-17T18:09:06.864677] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-17T18:09:07.158015] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-17T18:09:07.694222] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-17T18:09:07.922915] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T18:09:07.957993] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-17T18:09:08.758025] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-17T18:09:09.209397] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-17T18:09:09.558062] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-17T18:09:09.645798] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T18:09:10.358096] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-17T18:09:10.648006] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T18:09:11.158071] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-17T18:09:11.311777] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T18:09:11.958047] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-17T18:09:12.123668] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T18:09:12.758006] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-17T18:09:12.906359] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T18:09:12.916318] [INFO ] [REMOTE ] CNX: Full fetch complete (74923 records). [2025-10-17T18:09:12.916487] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-17T18:09:13.319399] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-17T18:09:13.319733] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-17T18:09:13.320580] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-17T18:09:13.320627] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-17T18:09:13.322071] [DEBUG] [LOCAL ] CNX: Trimmed 74923 records to 52093 (keeping 200 days of data) [2025-10-17T18:09:13.577730] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-17T18:09:13.620827] [DEBUG] [LOCAL ] CNX: Primary data saved (52093 records). [2025-10-17T18:09:13.620934] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-17T18:09:13.621010] [INFO ] [MAIN ] Update Progress: 503/2368 symbols completed. CNX took 44.0s. Estimated remaining: 4h 16m 26s. Rate: 7.3 symbols/min [2025-10-17T18:09:13.793357] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:09:13.843230] [DEBUG] [LOCAL ] COMP: Loaded 53796 existing records from primary storage. [2025-10-17T18:09:13.843566] [INFO ] [MAIN ] COMP: Loaded 53796 existing records. [2025-10-17T18:09:14.026602] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:09:14.026920] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-17T18:09:14.027056] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-17T18:09:14.027964] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-17T18:09:14.028028] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-17T18:09:14.432601] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-17T18:09:14.431008] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:09:14.443320] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-17T18:09:14.471615] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T18:09:15.158023] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-17T18:09:15.808673] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-17T18:09:15.957999] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-17T18:09:16.083222] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T18:09:16.758084] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-17T18:09:17.490204] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-17T18:09:17.497925] [INFO ] [REMOTE ] COF: Full fetch complete (77661 records). [2025-10-17T18:09:17.498099] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-17T18:09:17.565157] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-17T18:09:17.909892] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-17T18:09:17.910035] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-17T18:09:17.911031] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-17T18:09:17.911151] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-17T18:09:17.912740] [DEBUG] [LOCAL ] COF: Trimmed 77661 records to 54402 (keeping 200 days of data) [2025-10-17T18:09:18.060995] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-17T18:09:18.308172] [DEBUG] [LOCAL ] COF: Primary data saved (54402 records). [2025-10-17T18:09:18.308390] [INFO ] [MAIN ] COF: Full history saved. [2025-10-17T18:09:18.309553] [INFO ] [MAIN ] Update Progress: 504/2368 symbols completed. COF took 32.2s. Estimated remaining: 4h 16m 5s. Rate: 7.3 symbols/min [2025-10-17T18:09:18.363775] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-17T18:09:18.502557] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:09:18.536736] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T18:09:18.578485] [DEBUG] [LOCAL ] CON: Loaded 39243 existing records from primary storage. [2025-10-17T18:09:18.578835] [INFO ] [MAIN ] CON: Loaded 39243 existing records. [2025-10-17T18:09:18.776743] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:09:18.776973] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-17T18:09:18.777021] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-17T18:09:18.777233] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-17T18:09:18.777289] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-17T18:09:19.128967] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:09:19.157988] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-17T18:09:19.353669] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T18:09:19.958071] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-17T18:09:20.625323] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-17T18:09:20.758001] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-17T18:09:20.800076] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T18:09:21.547595] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T18:09:21.557994] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-17T18:09:22.358054] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-17T18:09:22.910134] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-17T18:09:22.918041] [INFO ] [REMOTE ] COHR: Full fetch complete (77056 records). [2025-10-17T18:09:22.918148] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-17T18:09:22.919043] [FATAL] [VALIDATOR ] COHR: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:09:22.919131] [FATAL] [MAIN ] COHR: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:09:22.919174] [WARN ] [MAIN ] COHR: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:09:22.919240] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-17T18:09:22.919305] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-17T18:09:22.919341] [INFO ] [LOCAL ] COHR: Starting deletion of derivative data. [2025-10-17T18:09:22.919380] [DEBUG] [LOCAL ] COHR: No derivative data file found to delete. [2025-10-17T18:09:22.919438] [INFO ] [MAIN ] Update Progress: 505/2368 symbols completed. COHR took 32.2s. Estimated remaining: 4h 15m 43s. Rate: 7.3 symbols/min [2025-10-17T18:09:23.100206] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:09:23.130809] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T18:09:23.159479] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-17T18:09:23.160135] [DEBUG] [LOCAL ] COOK: Loaded 25126 existing records from primary storage. [2025-10-17T18:09:23.161434] [INFO ] [MAIN ] COOK: Loaded 25126 existing records. [2025-10-17T18:09:23.336472] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:09:23.336791] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-17T18:09:23.336841] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-17T18:09:23.337013] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-17T18:09:23.337066] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-17T18:09:23.692151] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:09:23.958088] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-17T18:09:24.350396] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T18:09:24.758002] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-17T18:09:25.032076] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T18:09:25.194838] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T18:09:25.558057] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-17T18:09:26.265323] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T18:09:26.358101] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-17T18:09:26.907703] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-17T18:09:27.093005] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T18:09:27.158040] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-17T18:09:27.958046] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-17T18:09:28.026411] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-17T18:09:28.758034] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-17T18:09:29.413140] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T18:09:29.558035] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-17T18:09:29.825754] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-17T18:09:30.358087] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-17T18:09:31.042662] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T18:09:31.158050] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-17T18:09:31.958041] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-17T18:09:32.071618] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T18:09:32.245090] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T18:09:32.758047] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-17T18:09:33.558096] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-17T18:09:33.809510] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T18:09:33.994058] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-17T18:09:34.358040] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-17T18:09:35.158008] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-17T18:09:35.449604] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T18:09:35.772769] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T18:09:35.958034] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-17T18:09:36.280458] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T18:09:36.758022] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-17T18:09:37.051408] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T18:09:37.558024] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-17T18:09:38.357999] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-17T18:09:38.439581] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T18:09:38.702839] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-17T18:09:39.158033] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-17T18:09:39.958035] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-17T18:09:40.539970] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T18:09:40.629282] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-17T18:09:40.636153] [INFO ] [REMOTE ] COLD: Full fetch complete (74371 records). [2025-10-17T18:09:40.636311] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-17T18:09:40.637080] [FATAL] [VALIDATOR ] COLD: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:09:40.637170] [FATAL] [MAIN ] COLD: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:09:40.637214] [WARN ] [MAIN ] COLD: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:09:40.637253] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-17T18:09:40.637310] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-17T18:09:40.637345] [INFO ] [LOCAL ] COLD: Starting deletion of derivative data. [2025-10-17T18:09:40.637498] [DEBUG] [LOCAL ] COLD: Deleted derivative data file. [2025-10-17T18:09:40.637959] [INFO ] [MAIN ] Update Progress: 506/2368 symbols completed. COLD took 39.8s. Estimated remaining: 4h 16m 10s. Rate: 7.3 symbols/min [2025-10-17T18:09:40.763113] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-17T18:09:40.807006] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:09:40.864804] [DEBUG] [LOCAL ] COP: Loaded 54117 existing records from primary storage. [2025-10-17T18:09:40.865194] [INFO ] [MAIN ] COP: Loaded 54117 existing records. [2025-10-17T18:09:41.041043] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:09:41.041288] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-17T18:09:41.041346] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-17T18:09:41.041706] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-17T18:09:41.041767] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-17T18:09:41.403222] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:09:41.426803] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T18:09:41.558038] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-17T18:09:42.364790] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-17T18:09:42.371095] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T18:09:42.798344] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T18:09:42.802416] [INFO ] [REMOTE ] COOK: Full fetch complete (33135 records). [2025-10-17T18:09:42.802496] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-17T18:09:43.167786] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-17T18:09:43.182584] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-17T18:09:43.182685] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-17T18:09:43.183278] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-17T18:09:43.183339] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-17T18:09:43.184205] [DEBUG] [LOCAL ] COOK: Trimmed 33135 records to 25238 (keeping 200 days of data) [2025-10-17T18:09:43.318887] [DEBUG] [LOCAL ] COOK: Primary data saved (25238 records). [2025-10-17T18:09:43.319022] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-17T18:09:43.319118] [INFO ] [MAIN ] Update Progress: 507/2368 symbols completed. COOK took 20.4s. Estimated remaining: 4h 15m 41s. Rate: 7.3 symbols/min [2025-10-17T18:09:43.515596] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:09:43.559283] [DEBUG] [LOCAL ] COR: Loaded 46937 existing records from primary storage. [2025-10-17T18:09:43.559576] [INFO ] [MAIN ] COR: Loaded 46937 existing records. [2025-10-17T18:09:43.737232] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:09:43.737500] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-17T18:09:43.737676] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-17T18:09:43.737945] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-17T18:09:43.738099] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-17T18:09:43.961531] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-17T18:09:44.059812] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T18:09:44.128831] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:09:44.758122] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-17T18:09:45.049596] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T18:09:45.558029] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-17T18:09:45.921248] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T18:09:46.104839] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T18:09:46.358040] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-17T18:09:47.157987] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-17T18:09:47.518108] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T18:09:47.777311] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T18:09:47.958073] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-17T18:09:48.575678] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T18:09:48.758064] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-17T18:09:49.558017] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-17T18:09:49.768923] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T18:09:50.358008] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-17T18:09:50.455412] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T18:09:50.463092] [INFO ] [REMOTE ] COMP: Full fetch complete (77399 records). [2025-10-17T18:09:50.463269] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-17T18:09:50.866091] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-17T18:09:50.866239] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-17T18:09:50.867115] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-17T18:09:50.867178] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-17T18:09:50.889068] [DEBUG] [LOCAL ] COMP: Trimmed 77399 records to 54186 (keeping 200 days of data) [2025-10-17T18:09:50.890397] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-17T18:09:51.158056] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-17T18:09:51.209533] [DEBUG] [LOCAL ] COMP: Primary data saved (54186 records). [2025-10-17T18:09:51.209698] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-17T18:09:51.209796] [INFO ] [MAIN ] Update Progress: 508/2368 symbols completed. COMP took 37.6s. Estimated remaining: 4h 15m 31s. Rate: 7.3 symbols/min [2025-10-17T18:09:51.381888] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:09:51.433204] [DEBUG] [LOCAL ] COTY: Loaded 53658 existing records from primary storage. [2025-10-17T18:09:51.433607] [INFO ] [MAIN ] COTY: Loaded 53658 existing records. [2025-10-17T18:09:51.622917] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:09:51.623181] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-17T18:09:51.623364] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-17T18:09:51.623712] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-17T18:09:51.623784] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-17T18:09:51.960082] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-17T18:09:51.961500] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:09:52.030907] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:09:52.758053] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-17T18:09:53.136189] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-17T18:09:53.201163] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T18:09:53.558002] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-17T18:09:54.358032] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-17T18:09:54.662553] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T18:09:55.158044] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-17T18:09:55.210429] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T18:09:55.958060] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-17T18:09:56.449471] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-17T18:09:56.758007] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-17T18:09:56.873702] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T18:09:57.558059] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-17T18:09:57.736201] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T18:09:57.950205] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-17T18:09:57.955914] [INFO ] [REMOTE ] CON: Full fetch complete (56897 records). [2025-10-17T18:09:57.956044] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-17T18:09:58.344177] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-17T18:09:58.344272] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-17T18:09:58.345079] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-17T18:09:58.345145] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-17T18:09:58.346538] [DEBUG] [LOCAL ] CON: Trimmed 56897 records to 39523 (keeping 200 days of data) [2025-10-17T18:09:58.398334] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-17T18:09:58.581842] [DEBUG] [LOCAL ] CON: Primary data saved (39523 records). [2025-10-17T18:09:58.582001] [INFO ] [MAIN ] CON: Full history saved. [2025-10-17T18:09:58.582110] [INFO ] [MAIN ] Update Progress: 509/2368 symbols completed. CON took 40.3s. Estimated remaining: 4h 15m 20s. Rate: 7.3 symbols/min [2025-10-17T18:09:58.750197] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:09:58.796679] [DEBUG] [LOCAL ] COUR: Loaded 49681 existing records from primary storage. [2025-10-17T18:09:58.796996] [INFO ] [MAIN ] COUR: Loaded 49681 existing records. [2025-10-17T18:09:58.977276] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:09:58.977737] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-17T18:09:58.977813] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-17T18:09:58.978126] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-17T18:09:58.978289] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-17T18:09:59.155696] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T18:09:59.158094] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-17T18:09:59.372839] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:09:59.958043] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-17T18:10:00.265273] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T18:10:00.758059] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-17T18:10:01.558018] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-17T18:10:01.645793] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-17T18:10:01.910173] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-17T18:10:02.358050] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-17T18:10:03.158048] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-17T18:10:03.247034] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-17T18:10:03.683059] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-17T18:10:03.958060] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-17T18:10:04.461579] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-17T18:10:04.758025] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-17T18:10:05.242584] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-17T18:10:05.558002] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-17T18:10:05.597967] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T18:10:06.358032] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-17T18:10:06.683676] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T18:10:07.158027] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-17T18:10:07.875677] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-17T18:10:07.963124] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-17T18:10:07.982801] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:10:08.758001] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-17T18:10:09.016591] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-17T18:10:09.557996] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-17T18:10:09.899363] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-17T18:10:10.358027] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-17T18:10:10.598596] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T18:10:11.122866] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T18:10:11.158070] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-17T18:10:11.958029] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-17T18:10:12.261318] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T18:10:12.758049] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-17T18:10:12.818133] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T18:10:13.550291] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T18:10:13.560853] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-17T18:10:14.358067] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-17T18:10:14.743883] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-17T18:10:15.158064] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-17T18:10:15.405359] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-17T18:10:15.958093] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-17T18:10:16.004881] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T18:10:16.758059] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-17T18:10:16.803841] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T18:10:17.558087] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-17T18:10:17.620419] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T18:10:18.055512] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-17T18:10:18.063070] [INFO ] [REMOTE ] COP: Full fetch complete (77906 records). [2025-10-17T18:10:18.063236] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-17T18:10:18.363265] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-17T18:10:18.452176] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-17T18:10:18.452256] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-17T18:10:18.453129] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-17T18:10:18.453192] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-17T18:10:18.454801] [DEBUG] [LOCAL ] COP: Trimmed 77906 records to 54507 (keeping 200 days of data) [2025-10-17T18:10:18.696452] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-17T18:10:18.816537] [DEBUG] [LOCAL ] COP: Primary data saved (54507 records). [2025-10-17T18:10:18.816750] [INFO ] [MAIN ] COP: Full history saved. [2025-10-17T18:10:18.817265] [INFO ] [MAIN ] Update Progress: 510/2368 symbols completed. COP took 38.2s. Estimated remaining: 4h 15m 55s. Rate: 7.3 symbols/min [2025-10-17T18:10:18.980618] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:10:19.030735] [DEBUG] [LOCAL ] CP: Loaded 53628 existing records from primary storage. [2025-10-17T18:10:19.031063] [INFO ] [MAIN ] CP: Loaded 53628 existing records. [2025-10-17T18:10:19.166837] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-17T18:10:19.206629] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:10:19.206863] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-17T18:10:19.206908] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-17T18:10:19.207348] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-17T18:10:19.207404] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-17T18:10:19.551466] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:10:19.888862] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T18:10:19.958016] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-17T18:10:20.763136] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-17T18:10:20.782607] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T18:10:21.558104] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-17T18:10:21.597805] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T18:10:22.358002] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-17T18:10:22.707742] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T18:10:23.157997] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-17T18:10:23.382564] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T18:10:23.957992] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-17T18:10:24.060296] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T18:10:24.066429] [INFO ] [REMOTE ] COR: Full fetch complete (68573 records). [2025-10-17T18:10:24.066577] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-17T18:10:24.447281] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-17T18:10:24.447377] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-17T18:10:24.448343] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-17T18:10:24.448407] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-17T18:10:24.449783] [DEBUG] [LOCAL ] COR: Trimmed 68573 records to 47244 (keeping 200 days of data) [2025-10-17T18:10:24.737806] [DEBUG] [LOCAL ] COR: Primary data saved (47244 records). [2025-10-17T18:10:24.737934] [INFO ] [MAIN ] COR: Full history saved. [2025-10-17T18:10:24.738465] [INFO ] [MAIN ] Update Progress: 511/2368 symbols completed. COR took 41.4s. Estimated remaining: 4h 15m 39s. Rate: 7.3 symbols/min [2025-10-17T18:10:24.792930] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-17T18:10:24.910912] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T18:10:24.927341] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:10:24.934405] [INFO ] [REMOTE ] COTY: Full fetch complete (76911 records). [2025-10-17T18:10:24.934497] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-17T18:10:24.935205] [FATAL] [VALIDATOR ] COTY: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:10:24.935394] [FATAL] [MAIN ] COTY: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:10:24.935463] [WARN ] [MAIN ] COTY: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:10:24.935536] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-17T18:10:24.935601] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-17T18:10:24.935666] [INFO ] [LOCAL ] COTY: Starting deletion of derivative data. [2025-10-17T18:10:24.935853] [DEBUG] [LOCAL ] COTY: Deleted derivative data file. [2025-10-17T18:10:24.935969] [INFO ] [MAIN ] Update Progress: 512/2368 symbols completed. COTY took 33.7s. Estimated remaining: 4h 15m 1s. Rate: 7.3 symbols/min [2025-10-17T18:10:25.118865] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:10:25.119030] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-17T18:10:25.119072] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-17T18:10:25.119182] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-17T18:10:25.119247] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-17T18:10:25.119335] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-17T18:10:25.119393] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-17T18:10:25.202504] [DEBUG] [LOCAL ] CPA: Loaded 28578 existing records from primary storage. [2025-10-17T18:10:25.229971] [INFO ] [MAIN ] CPA: Loaded 28578 existing records. [2025-10-17T18:10:25.576902] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:10:25.577298] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-17T18:10:25.577356] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-17T18:10:25.590575] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-17T18:10:25.617046] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-17T18:10:25.689546] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:10:25.716250] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-17T18:10:25.980039] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-17T18:10:26.122354] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:10:26.357991] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-17T18:10:26.453402] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-17T18:10:26.456380] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T18:10:27.158100] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-17T18:10:27.532745] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-17T18:10:27.958058] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-17T18:10:28.022114] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T18:10:28.758041] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-17T18:10:29.479790] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T18:10:29.558019] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-17T18:10:30.200197] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T18:10:30.358028] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-17T18:10:30.805271] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T18:10:31.158035] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-17T18:10:31.958028] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-17T18:10:32.174700] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T18:10:32.758019] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-17T18:10:32.851201] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T18:10:32.925542] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T18:10:33.558033] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-17T18:10:34.357994] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-17T18:10:34.647089] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-17T18:10:34.683881] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T18:10:34.714880] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T18:10:35.158017] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-17T18:10:35.958045] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-17T18:10:36.321063] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-17T18:10:36.758009] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-17T18:10:37.167111] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-17T18:10:37.174099] [INFO ] [REMOTE ] COUR: Full fetch complete (71079 records). [2025-10-17T18:10:37.174222] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-17T18:10:37.551159] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-17T18:10:37.551240] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-17T18:10:37.552055] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-17T18:10:37.552120] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-17T18:10:37.553441] [DEBUG] [LOCAL ] COUR: Trimmed 71079 records to 50057 (keeping 200 days of data) [2025-10-17T18:10:37.602813] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-17T18:10:37.847685] [DEBUG] [LOCAL ] COUR: Primary data saved (50057 records). [2025-10-17T18:10:37.847823] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-17T18:10:37.847903] [INFO ] [MAIN ] Update Progress: 513/2368 symbols completed. COUR took 39.3s. Estimated remaining: 4h 15m 10s. Rate: 7.3 symbols/min [2025-10-17T18:10:38.020689] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:10:38.041056] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T18:10:38.074287] [DEBUG] [LOCAL ] CPAY: Loaded 30724 existing records from primary storage. [2025-10-17T18:10:38.074546] [INFO ] [MAIN ] CPAY: Loaded 30724 existing records. [2025-10-17T18:10:38.249555] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:10:38.249799] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-17T18:10:38.249849] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-17T18:10:38.250130] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-17T18:10:38.250188] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-17T18:10:38.363143] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-17T18:10:38.602601] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:10:39.001672] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-17T18:10:39.112291] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T18:10:39.157994] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-17T18:10:39.958097] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-17T18:10:40.632392] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T18:10:40.757991] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-17T18:10:41.435959] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T18:10:41.557989] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-17T18:10:41.762621] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T18:10:42.358049] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-17T18:10:42.697257] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-17T18:10:43.158030] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-17T18:10:43.330782] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T18:10:43.536511] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-17T18:10:43.958078] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-17T18:10:44.758087] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-17T18:10:45.216707] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T18:10:45.558059] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-17T18:10:46.298095] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T18:10:46.358059] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-17T18:10:46.914471] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T18:10:47.158062] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-17T18:10:47.958010] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-17T18:10:48.309356] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T18:10:48.311773] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-17T18:10:48.572350] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T18:10:48.758090] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-17T18:10:49.558020] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-17T18:10:50.358013] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-17T18:10:50.582487] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T18:10:50.590192] [INFO ] [REMOTE ] CP: Full fetch complete (77303 records). [2025-10-17T18:10:50.590321] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-17T18:10:50.780612] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T18:10:51.006944] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-17T18:10:51.007018] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-17T18:10:51.007880] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-17T18:10:51.007945] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-17T18:10:51.009354] [DEBUG] [LOCAL ] CP: Trimmed 77303 records to 54017 (keeping 200 days of data) [2025-10-17T18:10:51.200184] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-17T18:10:51.287581] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T18:10:51.396367] [DEBUG] [LOCAL ] CP: Primary data saved (54017 records). [2025-10-17T18:10:51.396511] [INFO ] [MAIN ] CP: Full history saved. [2025-10-17T18:10:51.397026] [INFO ] [MAIN ] Update Progress: 514/2368 symbols completed. CP took 32.6s. Estimated remaining: 4h 15m 21s. Rate: 7.3 symbols/min [2025-10-17T18:10:51.563588] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:10:51.580419] [DEBUG] [LOCAL ] CPF: Loaded 15396 existing records from primary storage. [2025-10-17T18:10:51.580681] [INFO ] [MAIN ] CPF: Loaded 15396 existing records. [2025-10-17T18:10:51.784484] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:10:51.784728] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-17T18:10:51.784783] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-17T18:10:51.785015] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-17T18:10:51.785074] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-17T18:10:51.963696] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-17T18:10:52.139862] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:10:52.452146] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-17T18:10:52.626816] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T18:10:52.630712] [INFO ] [REMOTE ] CPA: Full fetch complete (41374 records). [2025-10-17T18:10:52.630797] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-17T18:10:52.771045] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-17T18:10:53.012811] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-17T18:10:53.012908] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-17T18:10:53.013570] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-17T18:10:53.013632] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-17T18:10:53.014570] [DEBUG] [LOCAL ] CPA: Trimmed 41374 records to 28704 (keeping 200 days of data) [2025-10-17T18:10:53.191769] [DEBUG] [LOCAL ] CPA: Primary data saved (28704 records). [2025-10-17T18:10:53.191904] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-17T18:10:53.191983] [INFO ] [MAIN ] Update Progress: 515/2368 symbols completed. CPA took 28.5s. Estimated remaining: 4h 14m 49s. Rate: 7.3 symbols/min [2025-10-17T18:10:53.356688] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:10:53.368343] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-17T18:10:53.376214] [DEBUG] [LOCAL ] CPK: Loaded 14061 existing records from primary storage. [2025-10-17T18:10:53.376439] [INFO ] [MAIN ] CPK: Loaded 14061 existing records. [2025-10-17T18:10:53.550176] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:10:53.550402] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-17T18:10:53.550470] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-17T18:10:53.550739] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-17T18:10:53.550796] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-17T18:10:53.563150] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-17T18:10:53.903438] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:10:54.358035] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-17T18:10:55.079048] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T18:10:55.157999] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-17T18:10:55.958034] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-17T18:10:56.441144] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-17T18:10:56.441984] [INFO ] [REMOTE ] CPAC: Full fetch complete (1791 records). [2025-10-17T18:10:56.442053] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-17T18:10:56.558968] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-17T18:10:56.629601] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T18:10:56.629894] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:10:56.630145] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:10:56.630234] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-17T18:10:56.630331] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-17T18:10:56.630396] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-17T18:10:56.630467] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-17T18:10:56.630564] [INFO ] [MAIN ] Update Progress: 516/2368 symbols completed. CPAC took 31.7s. Estimated remaining: 4h 14m 24s. Rate: 7.3 symbols/min [2025-10-17T18:10:56.771309] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-17T18:10:56.803815] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:10:56.825221] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T18:10:56.879241] [DEBUG] [LOCAL ] CPNG: Loaded 54069 existing records from primary storage. [2025-10-17T18:10:56.879581] [INFO ] [MAIN ] CPNG: Loaded 54069 existing records. [2025-10-17T18:10:57.055534] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:10:57.055794] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-17T18:10:57.055842] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-17T18:10:57.056228] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-17T18:10:57.056283] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-17T18:10:57.409139] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:10:57.558006] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-17T18:10:57.943223] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T18:10:58.358024] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-17T18:10:59.158059] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-17T18:10:59.706818] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T18:10:59.845869] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-17T18:10:59.958013] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-17T18:10:59.996978] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T18:11:00.758077] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-17T18:11:01.558078] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-17T18:11:02.358009] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-17T18:11:02.405881] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-17T18:11:02.430852] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-17T18:11:02.451413] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T18:11:03.158052] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-17T18:11:03.492260] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T18:11:03.958026] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-17T18:11:04.758008] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-17T18:11:05.105065] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T18:11:05.305556] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-17T18:11:05.558045] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-17T18:11:06.116477] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T18:11:06.358039] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-17T18:11:06.542948] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-17T18:11:07.158040] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-17T18:11:07.178225] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T18:11:07.958005] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-17T18:11:08.010670] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T18:11:08.758037] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-17T18:11:09.135101] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T18:11:09.419289] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-17T18:11:09.558028] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-17T18:11:10.358069] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-17T18:11:10.555221] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T18:11:11.158018] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-17T18:11:11.742049] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T18:11:11.958026] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-17T18:11:12.758042] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-17T18:11:12.913579] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-17T18:11:13.419196] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-17T18:11:13.558001] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-17T18:11:13.685875] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T18:11:14.358069] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-17T18:11:14.537543] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-17T18:11:15.158023] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-17T18:11:15.657780] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-17T18:11:15.958010] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-17T18:11:16.055997] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T18:11:16.758048] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-17T18:11:16.909950] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-17T18:11:17.558039] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-17T18:11:17.832413] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T18:11:18.358033] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-17T18:11:18.683637] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-17T18:11:18.686336] [INFO ] [REMOTE ] CPF: Full fetch complete (23622 records). [2025-10-17T18:11:18.686407] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-17T18:11:19.058176] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-17T18:11:19.058251] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-17T18:11:19.058701] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-17T18:11:19.058763] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-17T18:11:19.059339] [DEBUG] [LOCAL ] CPF: Trimmed 23622 records to 15519 (keeping 200 days of data) [2025-10-17T18:11:19.148898] [DEBUG] [LOCAL ] CPF: Primary data saved (15519 records). [2025-10-17T18:11:19.149076] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-17T18:11:19.149214] [INFO ] [MAIN ] Update Progress: 517/2368 symbols completed. CPF took 27.8s. Estimated remaining: 4h 15m 6s. Rate: 7.3 symbols/min [2025-10-17T18:11:19.158022] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-17T18:11:19.964063] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-17T18:11:19.966965] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-17T18:11:20.620700] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-17T18:11:20.758019] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-17T18:11:21.363946] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T18:11:21.368378] [INFO ] [REMOTE ] CPAY: Full fetch complete (44969 records). [2025-10-17T18:11:21.368530] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-17T18:11:21.563129] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-17T18:11:21.744836] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T18:11:21.762499] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-17T18:11:21.762737] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-17T18:11:21.763508] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-17T18:11:21.763590] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-17T18:11:21.765244] [DEBUG] [LOCAL ] CPAY: Trimmed 44969 records to 30966 (keeping 200 days of data) [2025-10-17T18:11:21.953187] [DEBUG] [LOCAL ] CPAY: Primary data saved (30966 records). [2025-10-17T18:11:21.953328] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-17T18:11:21.953529] [INFO ] [MAIN ] Update Progress: 518/2368 symbols completed. CPAY took 44.1s. Estimated remaining: 4h 14m 39s. Rate: 7.3 symbols/min [2025-10-17T18:11:22.358064] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-17T18:11:23.501244] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T18:11:23.504029] [INFO ] [REMOTE ] CPK: Full fetch complete (18595 records). [2025-10-17T18:11:23.504100] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-17T18:11:23.864306] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-17T18:11:23.864380] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-17T18:11:23.864821] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-17T18:11:23.864882] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-17T18:11:23.865462] [DEBUG] [LOCAL ] CPK: Trimmed 18595 records to 14207 (keeping 200 days of data) [2025-10-17T18:11:23.953957] [DEBUG] [LOCAL ] CPK: Primary data saved (14207 records). [2025-10-17T18:11:23.954088] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-17T18:11:23.954170] [INFO ] [MAIN ] Update Progress: 519/2368 symbols completed. CPK took 30.8s. Estimated remaining: 4h 14m 8s. Rate: 7.3 symbols/min [2025-10-17T18:11:24.136305] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-17T18:11:24.147880] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-17T18:11:26.510189] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-17T18:11:26.521180] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-17T18:11:28.999506] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-17T18:11:29.011577] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-17T18:11:30.941519] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-17T18:11:30.952873] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-17T18:11:33.301758] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-17T18:11:33.314002] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-17T18:11:35.748434] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-17T18:11:35.757292] [INFO ] [REMOTE ] CPNG: Full fetch complete (77782 records). [2025-10-17T18:11:35.757902] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-17T18:11:36.293599] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-17T18:11:36.293927] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-17T18:11:36.294833] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-17T18:11:36.294896] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-17T18:11:36.296395] [DEBUG] [LOCAL ] CPNG: Trimmed 77782 records to 54459 (keeping 200 days of data) [2025-10-17T18:11:36.611575] [DEBUG] [LOCAL ] CPNG: Primary data saved (54459 records). [2025-10-17T18:11:36.611738] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-17T18:11:36.611826] [INFO ] [MAIN ] Update Progress: 520/2368 symbols completed. CPNG took 40.0s. Estimated remaining: 4h 14m 16s. Rate: 7.3 symbols/min [2025-10-17T18:11:37.237097] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:11:37.238453] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:11:37.307574] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:11:37.314451] [DEBUG] [LOCAL ] CPS: No existing data file found in primary storage. [2025-10-17T18:11:37.320403] [WARN ] [MAIN ] CPS: No existing data found, performing full refresh instead. [2025-10-17T18:11:37.338946] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-17T18:11:37.339258] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-17T18:11:37.343631] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-10-17T18:11:37.343783] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-17T18:11:37.343434] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:11:37.355269] [DEBUG] [LOCAL ] CQP: No existing data file found in primary storage. [2025-10-17T18:11:37.355530] [WARN ] [MAIN ] CQP: No existing data found, performing full refresh instead. [2025-10-17T18:11:37.397236] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-17T18:11:37.405955] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-17T18:11:37.416613] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-17T18:11:37.429335] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-17T18:11:37.807614] [DEBUG] [LOCAL ] CPT: Loaded 44888 existing records from primary storage. [2025-10-17T18:11:37.866154] [DEBUG] [LOCAL ] CPRI: Loaded 52846 existing records from primary storage. [2025-10-17T18:11:37.893385] [INFO ] [MAIN ] CPRI: Loaded 52846 existing records. [2025-10-17T18:11:37.863358] [INFO ] [MAIN ] CPT: Loaded 44888 existing records. [2025-10-17T18:11:38.110086] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:11:38.172197] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-17T18:11:38.522439] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:11:38.518316] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:11:38.532317] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-17T18:11:38.545518] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-17T18:11:38.546400] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-17T18:11:38.545422] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:11:38.546600] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-17T18:11:38.546726] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-17T18:11:38.547096] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-17T18:11:38.547169] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-17T18:11:38.552362] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-17T18:11:38.588612] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-17T18:11:39.262460] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:11:39.263089] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-17T18:11:39.294734] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:11:39.295136] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-17T18:11:39.342214] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T18:11:39.346671] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-17T18:11:39.423596] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-17T18:11:39.428141] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-17T18:11:40.404624] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T18:11:40.409536] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-17T18:11:40.564293] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T18:11:40.570224] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-17T18:11:40.883348] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T18:11:40.891895] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-17T18:11:41.175831] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T18:11:41.186669] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-17T18:11:41.372124] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T18:11:41.377512] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-17T18:11:41.560094] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T18:11:41.565494] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-17T18:11:42.172013] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T18:11:42.181180] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-17T18:11:42.491934] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T18:11:42.497458] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-17T18:11:42.585434] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T18:11:42.592471] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-17T18:11:42.873726] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T18:11:42.884361] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-17T18:11:43.309211] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T18:11:43.313525] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-17T18:11:43.692624] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T18:11:43.701886] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-17T18:11:44.150496] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T18:11:44.157618] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-17T18:11:44.210867] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T18:11:44.221532] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-17T18:11:44.392374] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T18:11:44.397628] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-17T18:11:45.385104] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T18:11:45.394717] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-17T18:11:45.493881] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T18:11:45.501019] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-17T18:11:45.614272] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T18:11:45.620703] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-17T18:11:45.733711] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T18:11:46.358002] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-17T18:11:46.605080] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T18:11:46.684390] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T18:11:46.853602] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T18:11:47.158034] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-17T18:11:47.958054] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-17T18:11:48.151633] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T18:11:48.428717] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T18:11:48.765078] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-17T18:11:48.766234] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T18:11:49.558026] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-17T18:11:50.363901] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-17T18:11:50.374798] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T18:11:51.158006] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-17T18:11:51.359135] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-17T18:11:51.591876] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T18:11:51.958106] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-17T18:11:52.758025] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-17T18:11:53.052137] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T18:11:53.084106] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-17T18:11:53.397356] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-17T18:11:53.558032] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-17T18:11:54.358050] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-17T18:11:54.672860] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T18:11:55.158026] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-17T18:11:55.958024] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-17T18:11:56.023514] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T18:11:56.226339] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T18:11:56.228976] [INFO ] [REMOTE ] CQP: Full fetch complete (29962 records). [2025-10-17T18:11:56.229066] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-17T18:11:56.593937] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-17T18:11:56.594037] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-17T18:11:56.594583] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-17T18:11:56.594664] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-17T18:11:56.595436] [DEBUG] [LOCAL ] CQP: Trimmed 29962 records to 19156 (keeping 200 days of data) [2025-10-17T18:11:56.718136] [DEBUG] [LOCAL ] CQP: Primary data saved (19156 records). [2025-10-17T18:11:56.718301] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-17T18:11:56.718426] [INFO ] [MAIN ] Update Progress: 521/2368 symbols completed. CQP took 20.1s. Estimated remaining: 4h 14m 49s. Rate: 7.2 symbols/min [2025-10-17T18:11:56.761312] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-17T18:11:56.893120] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:11:56.918604] [DEBUG] [LOCAL ] CR: Loaded 24311 existing records from primary storage. [2025-10-17T18:11:56.918898] [INFO ] [MAIN ] CR: Loaded 24311 existing records. [2025-10-17T18:11:57.043773] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-17T18:11:57.091423] [INFO ] [REMOTE ] CPS: Full fetch complete (36354 records). [2025-10-17T18:11:57.111925] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:11:57.112138] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-17T18:11:57.112876] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-17T18:11:57.113084] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-17T18:11:57.113388] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-17T18:11:57.113446] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-17T18:11:57.568460] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-17T18:11:57.914062] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:11:57.932377] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-17T18:11:57.932465] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-17T18:11:57.933114] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-17T18:11:57.933231] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-17T18:11:57.934177] [DEBUG] [LOCAL ] CPS: Trimmed 36354 records to 25505 (keeping 200 days of data) [2025-10-17T18:11:58.084414] [DEBUG] [LOCAL ] CPS: Primary data saved (25505 records). [2025-10-17T18:11:58.084554] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-17T18:11:58.084629] [INFO ] [MAIN ] Update Progress: 522/2368 symbols completed. CPS took 21.4s. Estimated remaining: 4h 14m 17s. Rate: 7.3 symbols/min [2025-10-17T18:11:58.261506] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:11:58.272359] [DEBUG] [LOCAL ] CRBD: Loaded 8956 existing records from primary storage. [2025-10-17T18:11:58.272601] [INFO ] [MAIN ] CRBD: Loaded 8956 existing records. [2025-10-17T18:11:58.360361] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-17T18:11:58.455287] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:11:58.455502] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-17T18:11:58.455575] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-17T18:11:58.455760] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-17T18:11:58.455833] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-17T18:11:58.797211] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T18:11:58.879821] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:11:59.158035] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-17T18:11:59.191125] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T18:11:59.451940] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T18:11:59.958038] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-17T18:12:00.758043] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-17T18:12:01.497150] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T18:12:01.558037] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-17T18:12:01.673344] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-17T18:12:02.358004] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-17T18:12:02.713822] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-17T18:12:03.123605] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T18:12:03.157984] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-17T18:12:03.958073] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-17T18:12:04.264851] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T18:12:04.300129] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T18:12:04.758048] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-17T18:12:05.558007] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-17T18:12:05.687030] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T18:12:05.693367] [INFO ] [REMOTE ] CPT: Full fetch complete (64574 records). [2025-10-17T18:12:05.693512] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-17T18:12:06.072976] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T18:12:06.117145] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-17T18:12:06.117256] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-17T18:12:06.118421] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-17T18:12:06.118549] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-17T18:12:06.120225] [DEBUG] [LOCAL ] CPT: Trimmed 64574 records to 45243 (keeping 200 days of data) [2025-10-17T18:12:06.358005] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-17T18:12:06.426768] [DEBUG] [LOCAL ] CPT: Primary data saved (45243 records). [2025-10-17T18:12:06.426903] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-17T18:12:06.427878] [INFO ] [MAIN ] Update Progress: 523/2368 symbols completed. CPT took 29.8s. Estimated remaining: 4h 14m 9s. Rate: 7.3 symbols/min [2025-10-17T18:12:06.604227] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:12:06.655726] [DEBUG] [LOCAL ] CRBG: Loaded 52976 existing records from primary storage. [2025-10-17T18:12:06.656103] [INFO ] [MAIN ] CRBG: Loaded 52976 existing records. [2025-10-17T18:12:06.836728] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:12:06.836975] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-17T18:12:06.837023] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-17T18:12:06.837403] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-17T18:12:06.837484] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-17T18:12:07.086170] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T18:12:07.161733] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-17T18:12:07.216617] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:12:07.389941] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-17T18:12:07.397242] [INFO ] [REMOTE ] CPRI: Full fetch complete (76205 records). [2025-10-17T18:12:07.397364] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-17T18:12:07.778568] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-17T18:12:07.778675] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-17T18:12:07.779563] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-17T18:12:07.779609] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-17T18:12:07.781030] [DEBUG] [LOCAL ] CPRI: Trimmed 76205 records to 53228 (keeping 200 days of data) [2025-10-17T18:12:07.961289] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-17T18:12:08.094909] [DEBUG] [LOCAL ] CPRI: Primary data saved (53228 records). [2025-10-17T18:12:08.095048] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-17T18:12:08.095165] [INFO ] [MAIN ] Update Progress: 524/2368 symbols completed. CPRI took 31.5s. Estimated remaining: 4h 13m 37s. Rate: 7.3 symbols/min [2025-10-17T18:12:08.265569] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:12:08.306536] [DEBUG] [LOCAL ] CRC: Loaded 44395 existing records from primary storage. [2025-10-17T18:12:08.306865] [INFO ] [MAIN ] CRC: Loaded 44395 existing records. [2025-10-17T18:12:08.487617] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:12:08.487988] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-17T18:12:08.488062] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-17T18:12:08.488573] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-17T18:12:08.488631] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-17T18:12:08.759102] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T18:12:08.758518] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-17T18:12:08.805794] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T18:12:08.890585] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:12:09.558078] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-17T18:12:10.312571] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-17T18:12:10.358011] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-17T18:12:10.670784] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T18:12:10.985962] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-17T18:12:11.158023] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-17T18:12:11.900836] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T18:12:11.958107] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-17T18:12:12.758034] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-17T18:12:12.790485] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T18:12:13.558002] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-17T18:12:14.031280] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T18:12:14.358060] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-17T18:12:15.119698] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T18:12:15.147993] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T18:12:15.157994] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-17T18:12:15.958059] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-17T18:12:16.731165] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T18:12:16.758011] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-17T18:12:17.082009] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T18:12:17.558044] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-17T18:12:18.153212] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T18:12:18.358028] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-17T18:12:19.158009] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-17T18:12:19.256004] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T18:12:19.958019] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-17T18:12:20.065530] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T18:12:20.090896] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T18:12:20.516776] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T18:12:20.758023] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-17T18:12:21.557999] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-17T18:12:21.927035] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-17T18:12:22.358093] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-17T18:12:23.047390] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T18:12:23.158015] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-17T18:12:23.789964] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T18:12:23.958066] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-17T18:12:24.763701] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-17T18:12:24.782392] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T18:12:25.299531] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T18:12:25.558026] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-17T18:12:26.141906] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T18:12:26.145409] [INFO ] [REMOTE ] CR: Full fetch complete (34783 records). [2025-10-17T18:12:26.145509] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-17T18:12:26.364607] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-17T18:12:26.531932] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-17T18:12:26.532032] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-17T18:12:26.532658] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-17T18:12:26.532723] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-17T18:12:26.533612] [DEBUG] [LOCAL ] CR: Trimmed 34783 records to 24488 (keeping 200 days of data) [2025-10-17T18:12:26.683344] [DEBUG] [LOCAL ] CR: Primary data saved (24488 records). [2025-10-17T18:12:26.683472] [INFO ] [MAIN ] CR: Full history saved. [2025-10-17T18:12:26.683582] [INFO ] [MAIN ] Update Progress: 525/2368 symbols completed. CR took 30.0s. Estimated remaining: 4h 14m 5s. Rate: 7.3 symbols/min [2025-10-17T18:12:26.861790] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:12:26.861937] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-17T18:12:26.861974] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-17T18:12:26.862114] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-17T18:12:26.862174] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-17T18:12:26.862220] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-17T18:12:26.862254] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-17T18:12:27.159538] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-17T18:12:27.219033] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:12:27.226513] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-17T18:12:27.274108] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T18:12:27.958116] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-17T18:12:28.758031] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-17T18:12:28.963779] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T18:12:29.383996] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T18:12:29.461173] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T18:12:29.463575] [INFO ] [REMOTE ] CRBD: Full fetch complete (13265 records). [2025-10-17T18:12:29.463827] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-17T18:12:29.563525] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-17T18:12:29.818548] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-17T18:12:29.818662] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-17T18:12:29.818987] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-17T18:12:29.819028] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-17T18:12:29.819473] [DEBUG] [LOCAL ] CRBD: Trimmed 13265 records to 9015 (keeping 200 days of data) [2025-10-17T18:12:29.871360] [DEBUG] [LOCAL ] CRBD: Primary data saved (9015 records). [2025-10-17T18:12:29.871469] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-17T18:12:29.871550] [INFO ] [MAIN ] Update Progress: 526/2368 symbols completed. CRBD took 31.8s. Estimated remaining: 4h 13m 39s. Rate: 7.3 symbols/min [2025-10-17T18:12:30.044236] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:12:30.098501] [DEBUG] [LOCAL ] CRGY: Loaded 52897 existing records from primary storage. [2025-10-17T18:12:30.098958] [INFO ] [MAIN ] CRGY: Loaded 52897 existing records. [2025-10-17T18:12:30.278636] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:12:30.278857] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-17T18:12:30.278907] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-17T18:12:30.279277] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-17T18:12:30.279315] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-17T18:12:30.363232] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-17T18:12:30.605017] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:12:30.628112] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:12:30.628231] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-17T18:12:30.628690] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:12:30.628766] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-17T18:12:30.628832] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:12:30.628905] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-17T18:12:30.628977] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-17T18:12:30.629016] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-17T18:12:30.629057] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-17T18:12:30.629106] [INFO ] [MAIN ] Update Progress: 527/2368 symbols completed. CRCL took 3.9s. Estimated remaining: 4h 13m 5s. Rate: 7.3 symbols/min [2025-10-17T18:12:30.820808] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:12:30.871360] [DEBUG] [LOCAL ] CRH: Loaded 53831 existing records from primary storage. [2025-10-17T18:12:30.871765] [INFO ] [MAIN ] CRH: Loaded 53831 existing records. [2025-10-17T18:12:31.048304] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:12:31.048523] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-17T18:12:31.048570] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-17T18:12:31.049070] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-17T18:12:31.049126] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-17T18:12:31.163125] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-17T18:12:31.421788] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:12:31.458418] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T18:12:31.958039] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-17T18:12:32.758058] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-17T18:12:33.080753] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T18:12:33.175048] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-17T18:12:33.558035] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-17T18:12:34.358127] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-17T18:12:34.405144] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T18:12:35.158037] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-17T18:12:35.604583] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T18:12:35.963179] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-17T18:12:35.986928] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T18:12:36.758008] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-17T18:12:36.937155] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T18:12:37.061717] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T18:12:37.558035] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-17T18:12:38.358036] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-17T18:12:38.623741] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T18:12:39.158034] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-17T18:12:39.213524] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T18:12:39.963366] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-17T18:12:39.977001] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:12:40.742406] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T18:12:40.757989] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-17T18:12:41.558041] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-17T18:12:41.768677] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T18:12:42.358065] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-17T18:12:42.647061] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T18:12:43.095230] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T18:12:43.101870] [INFO ] [REMOTE ] CRC: Full fetch complete (62962 records). [2025-10-17T18:12:43.102016] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-17T18:12:43.163142] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-17T18:12:43.476456] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-17T18:12:43.476535] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-17T18:12:43.477325] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-17T18:12:43.477389] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-17T18:12:43.478639] [DEBUG] [LOCAL ] CRC: Trimmed 62962 records to 44717 (keeping 200 days of data) [2025-10-17T18:12:43.753951] [DEBUG] [LOCAL ] CRC: Primary data saved (44717 records). [2025-10-17T18:12:43.754134] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-17T18:12:43.754265] [INFO ] [MAIN ] Update Progress: 528/2368 symbols completed. CRC took 35.7s. Estimated remaining: 4h 13m 13s. Rate: 7.3 symbols/min [2025-10-17T18:12:43.924041] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:12:43.966619] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-17T18:12:43.969441] [DEBUG] [LOCAL ] CRI: Loaded 50021 existing records from primary storage. [2025-10-17T18:12:43.969859] [INFO ] [MAIN ] CRI: Loaded 50021 existing records. [2025-10-17T18:12:44.151492] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:12:44.151717] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-17T18:12:44.151794] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-17T18:12:44.152162] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-17T18:12:44.152201] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-17T18:12:44.490613] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-17T18:12:44.567775] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:12:44.758000] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-17T18:12:44.939178] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T18:12:45.558028] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-17T18:12:46.035240] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-17T18:12:46.358030] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-17T18:12:46.443405] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T18:12:47.158007] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-17T18:12:47.450019] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T18:12:47.457232] [INFO ] [REMOTE ] CRBG: Full fetch complete (75644 records). [2025-10-17T18:12:47.457382] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-17T18:12:47.458280] [FATAL] [VALIDATOR ] CRBG: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:12:47.458374] [FATAL] [MAIN ] CRBG: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:12:47.458420] [WARN ] [MAIN ] CRBG: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:12:47.458490] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-17T18:12:47.458590] [DEBUG] [LOCAL ] CRBG: No primary data file found to delete. [2025-10-17T18:12:47.458677] [INFO ] [LOCAL ] CRBG: Starting deletion of derivative data. [2025-10-17T18:12:47.458928] [DEBUG] [LOCAL ] CRBG: Deleted derivative data file. [2025-10-17T18:12:47.459331] [INFO ] [MAIN ] Update Progress: 529/2368 symbols completed. CRBG took 41.0s. Estimated remaining: 4h 12m 49s. Rate: 7.3 symbols/min [2025-10-17T18:12:47.630875] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:12:47.685759] [DEBUG] [LOCAL ] CRK: Loaded 52635 existing records from primary storage. [2025-10-17T18:12:47.686110] [INFO ] [MAIN ] CRK: Loaded 52635 existing records. [2025-10-17T18:12:47.859602] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:12:47.859840] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-17T18:12:47.859888] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-17T18:12:47.860192] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-17T18:12:47.860232] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-17T18:12:47.959839] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-17T18:12:48.224821] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:12:48.254880] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T18:12:48.698422] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T18:12:48.758001] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-17T18:12:49.557999] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-17T18:12:49.820513] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T18:12:50.311813] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T18:12:50.358015] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-17T18:12:51.158005] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-17T18:12:51.269831] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T18:12:51.958042] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-17T18:12:52.117972] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T18:12:52.757998] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-17T18:12:53.030629] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-17T18:12:53.393823] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T18:12:53.558021] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-17T18:12:54.239415] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T18:12:54.358007] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-17T18:12:55.123452] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T18:12:55.158024] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-17T18:12:55.958036] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-17T18:12:56.223900] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:12:56.758005] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-17T18:12:56.865174] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T18:12:57.558078] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-17T18:12:58.165485] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-17T18:12:58.358018] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-17T18:12:58.500000] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T18:12:59.101244] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T18:12:59.158037] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-17T18:12:59.958012] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-17T18:13:00.139836] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T18:13:00.758043] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-17T18:13:01.195854] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-17T18:13:01.558064] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-17T18:13:02.179392] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-17T18:13:02.358065] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-17T18:13:02.404978] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T18:13:03.065686] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T18:13:03.158035] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-17T18:13:03.914264] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T18:13:03.958004] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-17T18:13:04.758003] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-17T18:13:04.948521] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T18:13:05.558044] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-17T18:13:05.841900] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T18:13:06.358038] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-17T18:13:06.679557] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T18:13:07.158027] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-17T18:13:07.285299] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T18:13:07.958004] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-17T18:13:08.227918] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T18:13:08.235222] [INFO ] [REMOTE ] CRGY: Full fetch complete (76142 records). [2025-10-17T18:13:08.235346] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-17T18:13:08.636601] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-17T18:13:08.636727] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-17T18:13:08.637755] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-17T18:13:08.637865] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-17T18:13:08.639339] [DEBUG] [LOCAL ] CRGY: Trimmed 76142 records to 53283 (keeping 200 days of data) [2025-10-17T18:13:08.766189] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-17T18:13:08.874452] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T18:13:08.994366] [DEBUG] [LOCAL ] CRGY: Primary data saved (53283 records). [2025-10-17T18:13:08.994507] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-17T18:13:08.994600] [INFO ] [MAIN ] Update Progress: 530/2368 symbols completed. CRGY took 39.1s. Estimated remaining: 4h 13m 27s. Rate: 7.3 symbols/min [2025-10-17T18:13:09.159112] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:13:09.159292] [DEBUG] [LOCAL ] CRL: No existing data file found in primary storage. [2025-10-17T18:13:09.159329] [WARN ] [MAIN ] CRL: No existing data found, performing full refresh instead. [2025-10-17T18:13:09.159468] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-17T18:13:09.159535] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-17T18:13:09.159587] [DEBUG] [LOCAL ] CRL: No primary data file found to delete. [2025-10-17T18:13:09.159622] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-17T18:13:09.525936] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:13:09.557986] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-17T18:13:09.692106] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T18:13:09.700886] [INFO ] [REMOTE ] CRH: Full fetch complete (77540 records). [2025-10-17T18:13:09.701118] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-17T18:13:10.115984] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-17T18:13:10.116082] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-17T18:13:10.117008] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-17T18:13:10.117073] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-17T18:13:10.118672] [DEBUG] [LOCAL ] CRH: Trimmed 77540 records to 54220 (keeping 200 days of data) [2025-10-17T18:13:10.359685] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-17T18:13:10.462211] [DEBUG] [LOCAL ] CRH: Primary data saved (54220 records). [2025-10-17T18:13:10.462446] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-17T18:13:10.462620] [INFO ] [MAIN ] Update Progress: 531/2368 symbols completed. CRH took 39.8s. Estimated remaining: 4h 12m 55s. Rate: 7.3 symbols/min [2025-10-17T18:13:10.646586] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:13:10.682423] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T18:13:10.736883] [DEBUG] [LOCAL ] CRM: Loaded 54160 existing records from primary storage. [2025-10-17T18:13:10.737217] [INFO ] [MAIN ] CRM: Loaded 54160 existing records. [2025-10-17T18:13:10.925760] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:13:10.926090] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-17T18:13:10.926201] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-17T18:13:10.926725] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-17T18:13:10.926817] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-17T18:13:11.072628] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T18:13:11.169358] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-17T18:13:11.321774] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:13:11.958010] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-17T18:13:12.164804] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T18:13:12.758103] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-17T18:13:12.948920] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T18:13:13.558071] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-17T18:13:14.196449] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-17T18:13:14.358052] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-17T18:13:14.427485] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-17T18:13:14.772983] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T18:13:15.158007] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-17T18:13:15.802531] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T18:13:15.957998] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-17T18:13:16.758019] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-17T18:13:17.558008] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-17T18:13:17.973692] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.82 seconds). [2025-10-17T18:13:18.147403] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-17T18:13:18.155507] [INFO ] [REMOTE ] CRK: Full fetch complete (75834 records). [2025-10-17T18:13:18.155714] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-17T18:13:18.364016] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-17T18:13:18.521948] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T18:13:18.591998] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-17T18:13:18.592076] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-17T18:13:18.592962] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-17T18:13:18.593051] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-17T18:13:18.594424] [DEBUG] [LOCAL ] CRK: Trimmed 75834 records to 53025 (keeping 200 days of data) [2025-10-17T18:13:18.897750] [DEBUG] [LOCAL ] CRK: Primary data saved (53025 records). [2025-10-17T18:13:18.897883] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-17T18:13:18.898377] [INFO ] [MAIN ] Update Progress: 532/2368 symbols completed. CRK took 31.4s. Estimated remaining: 4h 12m 48s. Rate: 7.3 symbols/min [2025-10-17T18:13:19.079953] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:13:19.080179] [DEBUG] [LOCAL ] CRS: No existing data file found in primary storage. [2025-10-17T18:13:19.080323] [WARN ] [MAIN ] CRS: No existing data found, performing full refresh instead. [2025-10-17T18:13:19.080459] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-17T18:13:19.080513] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-17T18:13:19.080559] [DEBUG] [LOCAL ] CRS: No primary data file found to delete. [2025-10-17T18:13:19.080595] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-17T18:13:19.160481] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-17T18:13:19.274559] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T18:13:19.369191] [INFO ] [REMOTE ] CRI: Full fetch complete (70655 records). [2025-10-17T18:13:19.387528] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-17T18:13:19.390619] [FATAL] [VALIDATOR ] CRI: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:13:19.411484] [FATAL] [MAIN ] CRI: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:13:19.439420] [WARN ] [MAIN ] CRI: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:13:19.448145] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-17T18:13:19.469258] [DEBUG] [LOCAL ] CRI: No primary data file found to delete. [2025-10-17T18:13:19.469343] [INFO ] [LOCAL ] CRI: Starting deletion of derivative data. [2025-10-17T18:13:19.469205] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:13:19.469701] [DEBUG] [LOCAL ] CRI: Deleted derivative data file. [2025-10-17T18:13:19.470544] [INFO ] [MAIN ] Update Progress: 533/2368 symbols completed. CRI took 35.7s. Estimated remaining: 4h 12m 13s. Rate: 7.3 symbols/min [2025-10-17T18:13:19.635183] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:13:19.635369] [DEBUG] [LOCAL ] CRT: No existing data file found in primary storage. [2025-10-17T18:13:19.635406] [WARN ] [MAIN ] CRT: No existing data found, performing full refresh instead. [2025-10-17T18:13:19.635515] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-17T18:13:19.635555] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-17T18:13:19.635595] [DEBUG] [LOCAL ] CRT: No primary data file found to delete. [2025-10-17T18:13:19.635628] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-17T18:13:19.963158] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-17T18:13:20.057979] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:13:20.706230] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-17T18:13:20.763216] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-17T18:13:20.782433] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T18:13:21.558035] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-17T18:13:21.663617] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T18:13:22.358056] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-17T18:13:23.158005] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-17T18:13:23.214676] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T18:13:23.290238] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-17T18:13:23.830110] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-17T18:13:23.958040] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-17T18:13:24.163731] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T18:13:24.758033] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-17T18:13:25.401269] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-17T18:13:25.558034] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-17T18:13:26.358006] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-17T18:13:26.545677] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-17T18:13:27.145448] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T18:13:27.157980] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-17T18:13:27.959139] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-17T18:13:27.961528] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T18:13:28.718384] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T18:13:28.757994] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-17T18:13:29.459975] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-17T18:13:29.563122] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-17T18:13:29.584483] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-17T18:13:30.358024] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-17T18:13:31.105926] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T18:13:31.158007] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-17T18:13:31.958053] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-17T18:13:32.665637] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T18:13:32.757990] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-17T18:13:32.868351] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-17T18:13:33.335046] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-17T18:13:33.558003] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-17T18:13:34.364489] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-17T18:13:34.380744] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T18:13:35.033911] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-17T18:13:35.158017] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-17T18:13:35.529284] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T18:13:35.957995] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-17T18:13:36.758021] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-17T18:13:36.826122] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T18:13:36.832348] [INFO ] [REMOTE ] CRL: Full fetch complete (63494 records). [2025-10-17T18:13:36.832468] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-17T18:13:37.219392] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-17T18:13:37.219481] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-17T18:13:37.220348] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-17T18:13:37.220414] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-17T18:13:37.221792] [DEBUG] [LOCAL ] CRL: Trimmed 63494 records to 43452 (keeping 200 days of data) [2025-10-17T18:13:37.350304] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-17T18:13:37.489158] [DEBUG] [LOCAL ] CRL: Primary data saved (43452 records). [2025-10-17T18:13:37.489305] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-17T18:13:37.489387] [INFO ] [MAIN ] Update Progress: 534/2368 symbols completed. CRL took 28.5s. Estimated remaining: 4h 12m 38s. Rate: 7.3 symbols/min [2025-10-17T18:13:37.558159] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-17T18:13:37.661596] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:13:37.692482] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T18:13:37.735726] [DEBUG] [LOCAL ] CSAN: Loaded 42492 existing records from primary storage. [2025-10-17T18:13:37.736074] [INFO ] [MAIN ] CSAN: Loaded 42492 existing records. [2025-10-17T18:13:37.910379] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:13:37.910686] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-17T18:13:37.910747] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-17T18:13:37.911024] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-17T18:13:37.911082] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-17T18:13:38.254985] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:13:38.358026] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-17T18:13:39.158021] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-17T18:13:39.958004] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-17T18:13:40.046851] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T18:13:40.241088] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-17T18:13:40.612328] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T18:13:40.675221] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T18:13:40.758027] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-17T18:13:41.558030] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-17T18:13:42.358028] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-17T18:13:43.156565] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:13:43.164507] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-17T18:13:43.322779] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-17T18:13:43.620460] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T18:13:43.789122] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-17T18:13:43.958048] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-17T18:13:44.559558] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T18:13:44.758041] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-17T18:13:45.473538] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-17T18:13:45.558032] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-17T18:13:46.358036] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-17T18:13:47.158034] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-17T18:13:47.807321] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-17T18:13:47.808562] [INFO ] [REMOTE ] CRT: Full fetch complete (7380 records). [2025-10-17T18:13:47.808631] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-17T18:13:47.960366] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-17T18:13:48.184183] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-17T18:13:48.184393] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-17T18:13:48.184735] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-17T18:13:48.184930] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-17T18:13:48.195242] [DEBUG] [LOCAL ] CRT: Trimmed 7380 records to 4975 (keeping 200 days of data) [2025-10-17T18:13:48.214474] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T18:13:48.253532] [DEBUG] [LOCAL ] CRT: Primary data saved (4975 records). [2025-10-17T18:13:48.253799] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-17T18:13:48.253911] [INFO ] [MAIN ] Update Progress: 535/2368 symbols completed. CRT took 28.8s. Estimated remaining: 4h 12m 39s. Rate: 7.3 symbols/min [2025-10-17T18:13:48.387302] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-17T18:13:48.468741] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:13:48.501152] [DEBUG] [LOCAL ] CSL: Loaded 31764 existing records from primary storage. [2025-10-17T18:13:48.501429] [INFO ] [MAIN ] CSL: Loaded 31764 existing records. [2025-10-17T18:13:48.678967] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:13:48.679200] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-17T18:13:48.679249] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-17T18:13:48.679587] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-17T18:13:48.679672] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-17T18:13:48.763279] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-17T18:13:49.035918] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:13:49.526432] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T18:13:49.557990] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-17T18:13:50.358047] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-17T18:13:50.386605] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T18:13:50.975400] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T18:13:51.158026] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-17T18:13:51.727703] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T18:13:51.958086] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-17T18:13:52.758031] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-17T18:13:52.861740] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T18:13:52.867790] [INFO ] [REMOTE ] CRS: Full fetch complete (62527 records). [2025-10-17T18:13:52.868069] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-17T18:13:53.041934] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T18:13:53.137189] [INFO ] [REMOTE ] CRM: Full fetch complete (77945 records). [2025-10-17T18:13:53.161852] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-17T18:13:53.503720] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-17T18:13:53.512028] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-17T18:13:53.527852] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-17T18:13:53.561268] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-17T18:13:53.572718] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-17T18:13:53.638001] [DEBUG] [LOCAL ] CRS: Trimmed 62527 records to 43714 (keeping 200 days of data) [2025-10-17T18:13:53.826093] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-17T18:13:53.826428] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-17T18:13:53.829608] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-17T18:13:53.830457] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-17T18:13:53.838546] [DEBUG] [LOCAL ] CRM: Trimmed 77945 records to 54550 (keeping 200 days of data) [2025-10-17T18:13:54.283093] [DEBUG] [LOCAL ] CRS: Primary data saved (43714 records). [2025-10-17T18:13:54.283952] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-17T18:13:54.284275] [INFO ] [MAIN ] Update Progress: 536/2368 symbols completed. CRS took 35.4s. Estimated remaining: 4h 12m 23s. Rate: 7.3 symbols/min [2025-10-17T18:13:54.486215] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T18:13:54.503470] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:13:54.515336] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-17T18:13:54.574036] [DEBUG] [LOCAL ] CSR: Loaded 13529 existing records from primary storage. [2025-10-17T18:13:54.581905] [INFO ] [MAIN ] CSR: Loaded 13529 existing records. [2025-10-17T18:13:54.798268] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:13:54.803963] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-17T18:13:54.805735] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-17T18:13:54.806372] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-17T18:13:54.807168] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-17T18:13:54.904261] [DEBUG] [LOCAL ] CRM: Primary data saved (54550 records). [2025-10-17T18:13:54.904426] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-17T18:13:54.910893] [INFO ] [MAIN ] Update Progress: 537/2368 symbols completed. CRM took 44.4s. Estimated remaining: 4h 11m 48s. Rate: 7.3 symbols/min [2025-10-17T18:13:55.220250] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T18:13:55.319047] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-17T18:13:55.322755] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:13:55.413723] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:13:55.453155] [DEBUG] [LOCAL ] CSTM: Loaded 47940 existing records from primary storage. [2025-10-17T18:13:55.453492] [INFO ] [MAIN ] CSTM: Loaded 47940 existing records. [2025-10-17T18:13:55.626932] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:13:55.627153] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-17T18:13:55.627200] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-17T18:13:55.627600] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-17T18:13:55.627696] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-17T18:13:55.981162] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:13:55.976276] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-17T18:13:56.006735] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-17T18:13:56.453043] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T18:13:56.758066] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-17T18:13:57.037277] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-17T18:13:57.558086] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-17T18:13:58.169511] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T18:13:58.188918] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-17T18:13:58.358033] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-17T18:13:59.158035] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-17T18:13:59.897396] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T18:13:59.957983] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-17T18:13:59.977811] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-17T18:14:00.758031] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-17T18:14:01.558052] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-17T18:14:01.597094] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T18:14:02.358040] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-17T18:14:02.421869] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T18:14:03.069283] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T18:14:03.158021] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-17T18:14:03.700945] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-17T18:14:03.821089] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T18:14:03.958002] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-17T18:14:04.758026] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-17T18:14:05.550269] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T18:14:05.559838] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-17T18:14:06.363139] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-17T18:14:06.377301] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T18:14:06.464267] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T18:14:07.158085] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-17T18:14:07.958023] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-17T18:14:07.991474] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T18:14:08.744805] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T18:14:08.750517] [INFO ] [REMOTE ] CSAN: Full fetch complete (60374 records). [2025-10-17T18:14:08.750693] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-17T18:14:08.763226] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-17T18:14:09.085044] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T18:14:09.166492] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-17T18:14:09.166581] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-17T18:14:09.167329] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-17T18:14:09.167392] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-17T18:14:09.168632] [DEBUG] [LOCAL ] CSAN: Trimmed 60374 records to 42773 (keeping 200 days of data) [2025-10-17T18:14:09.399391] [DEBUG] [LOCAL ] CSAN: Primary data saved (42773 records). [2025-10-17T18:14:09.399520] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-17T18:14:09.399598] [INFO ] [MAIN ] Update Progress: 538/2368 symbols completed. CSAN took 31.9s. Estimated remaining: 4h 12m 1s. Rate: 7.3 symbols/min [2025-10-17T18:14:09.562767] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-17T18:14:09.564217] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:09.586540] [DEBUG] [LOCAL ] CSV: Loaded 12746 existing records from primary storage. [2025-10-17T18:14:09.586820] [INFO ] [MAIN ] CSV: Loaded 12746 existing records. [2025-10-17T18:14:09.762937] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:14:09.763169] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-17T18:14:09.763239] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-17T18:14:09.763400] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-17T18:14:09.763449] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-17T18:14:10.123888] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:14:10.358579] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-17T18:14:10.362793] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-17T18:14:10.536608] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T18:14:11.158070] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-17T18:14:11.267530] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T18:14:11.958132] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-17T18:14:12.563930] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T18:14:12.758063] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-17T18:14:13.245898] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T18:14:13.558044] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-17T18:14:14.183943] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T18:14:14.358016] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-17T18:14:14.724225] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T18:14:15.158031] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-17T18:14:15.958049] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-17T18:14:16.114399] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T18:14:16.195296] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T18:14:16.758022] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-17T18:14:16.792944] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T18:14:17.558061] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-17T18:14:18.088033] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-17T18:14:18.124579] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-17T18:14:18.358026] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-17T18:14:19.158040] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-17T18:14:19.500621] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T18:14:19.958032] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-17T18:14:20.232408] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T18:14:20.758085] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-17T18:14:21.412021] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T18:14:21.558021] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-17T18:14:22.280318] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T18:14:22.358017] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-17T18:14:22.800246] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T18:14:23.157992] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-17T18:14:23.471503] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-17T18:14:23.958042] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-17T18:14:24.758001] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-17T18:14:24.783132] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T18:14:24.787937] [INFO ] [REMOTE ] CSL: Full fetch complete (45646 records). [2025-10-17T18:14:24.788075] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-17T18:14:25.089541] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-17T18:14:25.130626] [INFO ] [REMOTE ] CSR: Full fetch complete (18007 records). [2025-10-17T18:14:25.148126] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-17T18:14:25.297574] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-17T18:14:25.319363] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-17T18:14:25.320137] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-17T18:14:25.320502] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-17T18:14:25.460602] [DEBUG] [LOCAL ] CSL: Trimmed 45646 records to 31991 (keeping 200 days of data) [2025-10-17T18:14:25.568561] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-17T18:14:25.597710] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T18:14:25.699624] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-17T18:14:25.700042] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-17T18:14:25.701896] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-17T18:14:25.701981] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-17T18:14:25.704951] [DEBUG] [LOCAL ] CSR: Trimmed 18007 records to 13649 (keeping 200 days of data) [2025-10-17T18:14:25.813018] [DEBUG] [LOCAL ] CSR: Primary data saved (13649 records). [2025-10-17T18:14:25.819333] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-17T18:14:25.819761] [INFO ] [MAIN ] Update Progress: 539/2368 symbols completed. CSR took 31.5s. Estimated remaining: 4h 12m 21s. Rate: 7.2 symbols/min [2025-10-17T18:14:26.065484] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:26.066095] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-17T18:14:26.067220] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-17T18:14:26.069828] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-17T18:14:26.070144] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-17T18:14:26.070779] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-17T18:14:26.071151] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-17T18:14:26.279263] [DEBUG] [LOCAL ] CSL: Primary data saved (31991 records). [2025-10-17T18:14:26.337506] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-17T18:14:26.348908] [INFO ] [MAIN ] Update Progress: 540/2368 symbols completed. CSL took 38.1s. Estimated remaining: 4h 11m 46s. Rate: 7.3 symbols/min [2025-10-17T18:14:26.364682] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-17T18:14:26.574194] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:14:26.639823] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:26.648838] [DEBUG] [LOCAL ] CTBB: Loaded 6801 existing records from primary storage. [2025-10-17T18:14:26.649051] [INFO ] [MAIN ] CTBB: Loaded 6801 existing records. [2025-10-17T18:14:26.836481] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:14:26.836736] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-17T18:14:26.836789] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-17T18:14:26.836956] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-17T18:14:26.837011] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-17T18:14:27.163177] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-17T18:14:27.200690] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:14:27.363545] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T18:14:27.404295] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:14:27.404541] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-17T18:14:27.404629] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:14:27.404722] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-17T18:14:27.404786] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:14:27.404857] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-17T18:14:27.404922] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-17T18:14:27.404957] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-17T18:14:27.404995] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-17T18:14:27.405062] [INFO ] [MAIN ] Update Progress: 541/2368 symbols completed. CSW took 1.6s. Estimated remaining: 4h 11m 14s. Rate: 7.3 symbols/min [2025-10-17T18:14:27.583308] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:27.616364] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-17T18:14:27.629793] [DEBUG] [LOCAL ] CTDD: Loaded 5483 existing records from primary storage. [2025-10-17T18:14:27.630023] [INFO ] [MAIN ] CTDD: Loaded 5483 existing records. [2025-10-17T18:14:27.812696] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:14:27.812925] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-17T18:14:27.812971] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-17T18:14:27.813128] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-17T18:14:27.813185] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-17T18:14:27.963225] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-17T18:14:28.204919] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:14:28.758096] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-17T18:14:29.057798] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T18:14:29.402399] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-17T18:14:29.558040] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-17T18:14:30.267238] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-17T18:14:30.357995] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-17T18:14:31.014240] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-17T18:14:31.158023] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-17T18:14:31.958024] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-17T18:14:32.562605] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-17T18:14:32.759798] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-17T18:14:32.762581] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T18:14:33.558047] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-17T18:14:33.588192] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-17T18:14:34.358047] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-17T18:14:34.530581] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-17T18:14:34.932962] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-17T18:14:35.158021] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-17T18:14:35.958053] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-17T18:14:36.758019] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-17T18:14:36.824783] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T18:14:36.926613] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T18:14:37.482102] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-17T18:14:37.558012] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-17T18:14:38.358055] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-17T18:14:39.158006] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-17T18:14:39.269104] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T18:14:39.305497] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T18:14:39.312522] [INFO ] [REMOTE ] CSTM: Full fetch complete (69526 records). [2025-10-17T18:14:39.312711] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-17T18:14:39.735897] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-17T18:14:39.735985] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-17T18:14:39.737016] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-17T18:14:39.737083] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-17T18:14:39.738445] [DEBUG] [LOCAL ] CSTM: Trimmed 69526 records to 48273 (keeping 200 days of data) [2025-10-17T18:14:39.841306] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-17T18:14:39.958097] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-17T18:14:40.038717] [DEBUG] [LOCAL ] CSTM: Primary data saved (48273 records). [2025-10-17T18:14:40.038883] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-17T18:14:40.038998] [INFO ] [MAIN ] Update Progress: 542/2368 symbols completed. CSTM took 45.1s. Estimated remaining: 4h 11m 20s. Rate: 7.3 symbols/min [2025-10-17T18:14:40.202151] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:40.202315] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-17T18:14:40.202352] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-17T18:14:40.202464] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-17T18:14:40.202504] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-17T18:14:40.202544] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-17T18:14:40.202575] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-17T18:14:40.541927] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:14:40.758004] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-17T18:14:40.887445] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T18:14:40.889367] [INFO ] [REMOTE ] CSV: Full fetch complete (19157 records). [2025-10-17T18:14:40.889441] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-17T18:14:41.007117] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:14:41.036424] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-17T18:14:41.045444] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:14:41.047857] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-17T18:14:41.064519] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:14:41.115596] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-17T18:14:41.163402] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-17T18:14:41.173938] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-17T18:14:41.174121] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-17T18:14:41.174198] [INFO ] [MAIN ] Update Progress: 543/2368 symbols completed. CTEV took 1.1s. Estimated remaining: 4h 10m 48s. Rate: 7.3 symbols/min [2025-10-17T18:14:41.414441] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-17T18:14:41.440806] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:41.436805] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-17T18:14:41.441426] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-17T18:14:41.441956] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-17T18:14:41.442731] [DEBUG] [LOCAL ] CSV: Trimmed 19157 records to 12794 (keeping 200 days of data) [2025-10-17T18:14:41.540072] [DEBUG] [LOCAL ] CTO: Loaded 27883 existing records from primary storage. [2025-10-17T18:14:41.541187] [INFO ] [MAIN ] CTO: Loaded 27883 existing records. [2025-10-17T18:14:41.563097] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-17T18:14:41.669680] [DEBUG] [LOCAL ] CSV: Primary data saved (12794 records). [2025-10-17T18:14:41.680849] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-17T18:14:41.696357] [INFO ] [MAIN ] Update Progress: 544/2368 symbols completed. CSV took 32.3s. Estimated remaining: 4h 10m 14s. Rate: 7.3 symbols/min [2025-10-17T18:14:41.837083] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:14:41.866824] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-17T18:14:41.869045] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-17T18:14:41.869330] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-17T18:14:41.879865] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-17T18:14:42.041823] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:42.052363] [DEBUG] [LOCAL ] CTOS: No existing data file found in primary storage. [2025-10-17T18:14:42.052427] [WARN ] [MAIN ] CTOS: No existing data found, performing full refresh instead. [2025-10-17T18:14:42.063495] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-17T18:14:42.078921] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-17T18:14:42.105801] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-17T18:14:42.129593] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-17T18:14:42.284826] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T18:14:42.358711] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-17T18:14:42.536018] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:14:42.704111] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:14:43.121716] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-17T18:14:43.158002] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-17T18:14:43.861805] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-17T18:14:43.958081] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-17T18:14:44.758022] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-17T18:14:45.467945] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T18:14:45.558034] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-17T18:14:46.289483] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T18:14:46.357997] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-17T18:14:46.942180] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T18:14:47.158057] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-17T18:14:47.459433] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T18:14:47.650806] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-17T18:14:47.958046] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-17T18:14:48.758120] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-17T18:14:49.022692] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T18:14:49.391153] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T18:14:49.558044] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-17T18:14:50.358059] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-17T18:14:50.472347] [DEBUG] [REMOTE ] CTBB: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-17T18:14:50.472673] [WARN ] [REMOTE ] CTBB: No data returned for month 2025-08 [2025-10-17T18:14:50.472764] [FATAL] [REMOTE ] CTBB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:14:50.472866] [FATAL] [MAIN ] CTBB: Failed to fetch primary data. [2025-10-17T18:14:50.472933] [WARN ] [MAIN ] CTBB: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:14:50.472987] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-17T18:14:50.473048] [DEBUG] [LOCAL ] CTBB: No primary data file found to delete. [2025-10-17T18:14:50.473083] [INFO ] [LOCAL ] CTBB: Starting deletion of derivative data. [2025-10-17T18:14:50.473223] [DEBUG] [LOCAL ] CTBB: Deleted derivative data file. [2025-10-17T18:14:50.473314] [INFO ] [MAIN ] Update Progress: 545/2368 symbols completed. CTBB took 24.1s. Estimated remaining: 4h 10m 7s. Rate: 7.3 symbols/min [2025-10-17T18:14:50.640261] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:50.692073] [DEBUG] [LOCAL ] CTRA: Loaded 54038 existing records from primary storage. [2025-10-17T18:14:50.692392] [INFO ] [MAIN ] CTRA: Loaded 54038 existing records. [2025-10-17T18:14:50.874417] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:14:50.874698] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-17T18:14:50.874775] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-17T18:14:50.875097] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-17T18:14:50.875152] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-17T18:14:51.158433] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-17T18:14:51.239395] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:14:51.290878] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T18:14:51.763196] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T18:14:51.958069] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-17T18:14:52.561353] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-17T18:14:52.758008] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-17T18:14:53.558038] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-17T18:14:54.358064] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-17T18:14:54.807262] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T18:14:54.859882] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T18:14:54.871277] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-17T18:14:55.158038] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-17T18:14:55.764551] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-17T18:14:55.958019] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-17T18:14:56.758047] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-17T18:14:57.349501] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T18:14:57.558043] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-17T18:14:58.358059] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-17T18:14:58.584872] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T18:14:58.650150] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T18:14:59.080983] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T18:14:59.082136] [INFO ] [REMOTE ] CTDD: Full fetch complete (8022 records). [2025-10-17T18:14:59.082206] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-17T18:14:59.163236] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-17T18:14:59.436301] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-17T18:14:59.436396] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-17T18:14:59.436605] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-17T18:14:59.436663] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-17T18:14:59.437105] [DEBUG] [LOCAL ] CTDD: Trimmed 8022 records to 5501 (keeping 200 days of data) [2025-10-17T18:14:59.469995] [DEBUG] [LOCAL ] CTDD: Primary data saved (5501 records). [2025-10-17T18:14:59.470104] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-17T18:14:59.470191] [INFO ] [MAIN ] Update Progress: 546/2368 symbols completed. CTDD took 32.1s. Estimated remaining: 4h 10m 2s. Rate: 7.3 symbols/min [2025-10-17T18:14:59.634170] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:14:59.634362] [DEBUG] [LOCAL ] CTRE: No existing data file found in primary storage. [2025-10-17T18:14:59.634400] [WARN ] [MAIN ] CTRE: No existing data found, performing full refresh instead. [2025-10-17T18:14:59.634515] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-17T18:14:59.634593] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-17T18:14:59.634681] [DEBUG] [LOCAL ] CTRE: No primary data file found to delete. [2025-10-17T18:14:59.634732] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-17T18:14:59.960203] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-17T18:14:59.989696] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:15:00.769294] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-17T18:15:00.771567] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T18:15:01.558036] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-17T18:15:01.883197] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-17T18:15:01.990211] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-17T18:15:02.358034] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-17T18:15:03.158034] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-17T18:15:03.805632] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-17T18:15:03.957987] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-17T18:15:04.117821] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T18:15:04.449441] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-17T18:15:04.758087] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-17T18:15:05.558053] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-17T18:15:05.692196] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T18:15:06.161463] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T18:15:06.358033] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-17T18:15:07.158042] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-17T18:15:07.513986] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T18:15:07.860707] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-17T18:15:07.958023] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-17T18:15:08.490307] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T18:15:08.758111] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-17T18:15:09.558033] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-17T18:15:10.000564] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-17T18:15:10.077457] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-17T18:15:10.358070] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-17T18:15:11.158021] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-17T18:15:11.216679] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T18:15:11.957998] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-17T18:15:12.241898] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T18:15:12.655274] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T18:15:12.758063] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-17T18:15:13.400161] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T18:15:13.404696] [INFO ] [REMOTE ] CTO: Full fetch complete (41514 records). [2025-10-17T18:15:13.404778] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-17T18:15:13.563166] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-17T18:15:13.831539] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-17T18:15:13.833686] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-17T18:15:13.835406] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-17T18:15:13.834795] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-17T18:15:13.842032] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-17T18:15:13.843350] [DEBUG] [LOCAL ] CTO: Trimmed 41514 records to 28050 (keeping 200 days of data) [2025-10-17T18:15:14.021078] [DEBUG] [LOCAL ] CTO: Primary data saved (28050 records). [2025-10-17T18:15:14.021217] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-17T18:15:14.021297] [INFO ] [MAIN ] Update Progress: 547/2368 symbols completed. CTO took 32.8s. Estimated remaining: 4h 10m 14s. Rate: 7.3 symbols/min [2025-10-17T18:15:14.187868] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:15:14.188057] [DEBUG] [LOCAL ] CTRI: No existing data file found in primary storage. [2025-10-17T18:15:14.188094] [WARN ] [MAIN ] CTRI: No existing data found, performing full refresh instead. [2025-10-17T18:15:14.188233] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-17T18:15:14.188298] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-17T18:15:14.188347] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-17T18:15:14.188379] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-17T18:15:14.367832] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-17T18:15:14.541966] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:15:15.158023] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-17T18:15:15.531105] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-17T18:15:15.899979] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T18:15:15.958019] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-17T18:15:16.758017] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-17T18:15:16.941114] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T18:15:17.320986] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T18:15:17.558059] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-17T18:15:18.358038] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-17T18:15:18.415720] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T18:15:19.158060] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-17T18:15:19.352392] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-17T18:15:19.480623] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T18:15:19.958010] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-17T18:15:20.758179] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-17T18:15:21.211488] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T18:15:21.212956] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T18:15:21.558101] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-17T18:15:22.198430] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T18:15:22.358024] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-17T18:15:22.797198] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-17T18:15:23.158026] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-17T18:15:23.958012] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-17T18:15:24.007049] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T18:15:24.652277] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T18:15:24.757986] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-17T18:15:25.272478] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T18:15:25.558026] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-17T18:15:26.130937] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T18:15:26.139765] [INFO ] [REMOTE ] CTOS: Full fetch complete (54020 records). [2025-10-17T18:15:26.139888] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-17T18:15:26.364346] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-17T18:15:26.538626] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-17T18:15:26.538730] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-17T18:15:26.539414] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-17T18:15:26.539454] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-17T18:15:26.540545] [DEBUG] [LOCAL ] CTOS: Trimmed 54020 records to 37827 (keeping 200 days of data) [2025-10-17T18:15:26.742584] [DEBUG] [LOCAL ] CTOS: Primary data saved (37827 records). [2025-10-17T18:15:26.742760] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-17T18:15:26.742853] [INFO ] [MAIN ] Update Progress: 548/2368 symbols completed. CTOS took 45.0s. Estimated remaining: 4h 10m 21s. Rate: 7.3 symbols/min [2025-10-17T18:15:26.908913] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:15:26.928274] [DEBUG] [LOCAL ] CTS: Loaded 19832 existing records from primary storage. [2025-10-17T18:15:26.928487] [INFO ] [MAIN ] CTS: Loaded 19832 existing records. [2025-10-17T18:15:27.103231] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:15:27.103472] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-17T18:15:27.103546] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-17T18:15:27.103914] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-17T18:15:27.103971] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-17T18:15:27.164664] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-17T18:15:27.463214] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T18:15:27.492776] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:15:27.958032] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-17T18:15:28.520713] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-17T18:15:28.528016] [INFO ] [REMOTE ] CTRA: Full fetch complete (77820 records). [2025-10-17T18:15:28.528137] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-17T18:15:28.642948] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T18:15:28.763108] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-17T18:15:28.933728] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-17T18:15:28.933809] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-17T18:15:28.934673] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-17T18:15:28.934735] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-17T18:15:28.936147] [DEBUG] [LOCAL ] CTRA: Trimmed 77820 records to 54427 (keeping 200 days of data) [2025-10-17T18:15:29.264796] [DEBUG] [LOCAL ] CTRA: Primary data saved (54427 records). [2025-10-17T18:15:29.264938] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-17T18:15:29.265567] [INFO ] [MAIN ] Update Progress: 549/2368 symbols completed. CTRA took 38.8s. Estimated remaining: 4h 9m 54s. Rate: 7.3 symbols/min [2025-10-17T18:15:29.431238] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:15:29.431469] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-10-17T18:15:29.431513] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-10-17T18:15:29.431630] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-17T18:15:29.431707] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-17T18:15:29.431757] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-17T18:15:29.431790] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-17T18:15:29.569813] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-17T18:15:29.796199] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:15:29.824590] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T18:15:29.881520] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T18:15:30.358022] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-17T18:15:31.121120] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T18:15:31.158011] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-17T18:15:31.644917] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T18:15:31.651935] [INFO ] [REMOTE ] CTRE: Full fetch complete (71038 records). [2025-10-17T18:15:31.652068] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-17T18:15:31.652864] [FATAL] [VALIDATOR ] CTRE: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:15:31.652974] [FATAL] [MAIN ] CTRE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:15:31.653052] [WARN ] [MAIN ] CTRE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:15:31.653152] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-17T18:15:31.653233] [DEBUG] [LOCAL ] CTRE: No primary data file found to delete. [2025-10-17T18:15:31.653272] [INFO ] [LOCAL ] CTRE: Starting deletion of derivative data. [2025-10-17T18:15:31.653314] [DEBUG] [LOCAL ] CTRE: No derivative data file found to delete. [2025-10-17T18:15:31.653374] [INFO ] [MAIN ] Update Progress: 550/2368 symbols completed. CTRE took 32.2s. Estimated remaining: 4h 9m 26s. Rate: 7.3 symbols/min [2025-10-17T18:15:31.830458] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:15:31.830691] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-17T18:15:31.830748] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-17T18:15:31.830869] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-17T18:15:31.830911] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-17T18:15:31.830953] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-17T18:15:31.830986] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-17T18:15:31.963106] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-17T18:15:32.233848] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:15:32.314284] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T18:15:32.706750] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-17T18:15:32.757987] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-17T18:15:33.558027] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-17T18:15:34.040041] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-17T18:15:34.358036] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-17T18:15:34.670024] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T18:15:35.158005] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-17T18:15:35.329961] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T18:15:35.958004] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-17T18:15:36.759055] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:15:36.758144] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-17T18:15:37.393273] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T18:15:37.558020] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-17T18:15:37.853838] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-17T18:15:38.358152] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-17T18:15:38.676859] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-17T18:15:39.158092] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-17T18:15:39.310238] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T18:15:39.958071] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-17T18:15:40.445380] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-17T18:15:40.758095] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-17T18:15:41.087851] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-17T18:15:41.558042] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-17T18:15:41.804529] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-17T18:15:42.358018] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-17T18:15:43.141717] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T18:15:43.157976] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-17T18:15:43.963227] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-17T18:15:43.978956] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (4.02 seconds). [2025-10-17T18:15:44.117079] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T18:15:44.433282] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-17T18:15:44.758084] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-17T18:15:45.558037] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-17T18:15:46.358025] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-17T18:15:46.555482] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T18:15:47.158050] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-17T18:15:47.427359] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:15:47.498358] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T18:15:47.958052] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-17T18:15:48.616693] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T18:15:48.758037] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-17T18:15:49.470136] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T18:15:49.558033] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-17T18:15:50.358001] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-17T18:15:50.477548] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T18:15:50.484474] [INFO ] [REMOTE ] CTRI: Full fetch complete (53836 records). [2025-10-17T18:15:50.484591] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-17T18:15:50.859368] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-17T18:15:50.859461] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-17T18:15:50.860174] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-17T18:15:50.860236] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-17T18:15:50.861785] [DEBUG] [LOCAL ] CTRI: Trimmed 53836 records to 40805 (keeping 200 days of data) [2025-10-17T18:15:51.098147] [DEBUG] [LOCAL ] CTRI: Primary data saved (40805 records). [2025-10-17T18:15:51.098267] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-17T18:15:51.098339] [INFO ] [MAIN ] Update Progress: 551/2368 symbols completed. CTRI took 37.1s. Estimated remaining: 4h 9m 55s. Rate: 7.3 symbols/min [2025-10-17T18:15:51.161290] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-17T18:15:51.276051] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:15:51.308596] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T18:15:51.364912] [DEBUG] [LOCAL ] CUBE: Loaded 51290 existing records from primary storage. [2025-10-17T18:15:51.365247] [INFO ] [MAIN ] CUBE: Loaded 51290 existing records. [2025-10-17T18:15:51.594986] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-17T18:15:51.594707] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:15:51.596511] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-17T18:15:51.596996] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-17T18:15:51.598463] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-17T18:15:51.598420] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T18:15:51.598578] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-17T18:15:51.963150] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-17T18:15:51.967165] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:15:52.758030] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-17T18:15:53.558029] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-17T18:15:53.809280] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T18:15:53.836391] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T18:15:54.358111] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-17T18:15:54.704490] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-17T18:15:55.158030] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-17T18:15:55.330500] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T18:15:55.958055] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-17T18:15:56.296499] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-17T18:15:56.758012] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-17T18:15:56.903869] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T18:15:57.558036] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-17T18:15:58.250068] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T18:15:58.357989] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-17T18:15:59.158076] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-17T18:15:59.450595] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T18:15:59.497521] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T18:15:59.958116] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-17T18:16:00.009625] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T18:16:00.013163] [INFO ] [REMOTE ] CTS: Full fetch complete (27234 records). [2025-10-17T18:16:00.013270] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-17T18:16:00.389710] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-17T18:16:00.389857] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-17T18:16:00.390382] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-17T18:16:00.390426] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-17T18:16:00.391382] [DEBUG] [LOCAL ] CTS: Trimmed 27234 records to 20047 (keeping 200 days of data) [2025-10-17T18:16:00.510787] [DEBUG] [LOCAL ] CTS: Primary data saved (20047 records). [2025-10-17T18:16:00.510914] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-17T18:16:00.510994] [INFO ] [MAIN ] Update Progress: 552/2368 symbols completed. CTS took 33.8s. Estimated remaining: 4h 9m 51s. Rate: 7.3 symbols/min [2025-10-17T18:16:00.673986] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:00.700032] [DEBUG] [LOCAL ] CUBI: Loaded 27422 existing records from primary storage. [2025-10-17T18:16:00.700305] [INFO ] [MAIN ] CUBI: Loaded 27422 existing records. [2025-10-17T18:16:00.763132] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-17T18:16:00.898560] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:16:00.898819] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-17T18:16:00.898870] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-17T18:16:00.899072] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-17T18:16:00.899127] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-17T18:16:01.245205] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:01.558048] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-17T18:16:02.340999] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-17T18:16:02.349243] [INFO ] [REMOTE ] CTVA: Full fetch complete (77211 records). [2025-10-17T18:16:02.349376] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-17T18:16:02.363125] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-17T18:16:02.678842] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-17T18:16:02.763913] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-17T18:16:02.764158] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-17T18:16:02.765158] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-17T18:16:02.765402] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-17T18:16:02.803474] [DEBUG] [LOCAL ] CTVA: Trimmed 77211 records to 54075 (keeping 200 days of data) [2025-10-17T18:16:02.803219] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-17T18:16:02.930500] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T18:16:03.167236] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-17T18:16:03.196310] [DEBUG] [LOCAL ] CTVA: Primary data saved (54075 records). [2025-10-17T18:16:03.196466] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-17T18:16:03.196541] [INFO ] [MAIN ] Update Progress: 553/2368 symbols completed. CTVA took 33.9s. Estimated remaining: 4h 9m 24s. Rate: 7.3 symbols/min [2025-10-17T18:16:03.376880] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:03.429929] [DEBUG] [LOCAL ] CUK: Loaded 51433 existing records from primary storage. [2025-10-17T18:16:03.430269] [INFO ] [MAIN ] CUK: Loaded 51433 existing records. [2025-10-17T18:16:03.627907] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:16:03.628140] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-17T18:16:03.628190] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-17T18:16:03.628639] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-17T18:16:03.628736] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-17T18:16:03.972784] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-17T18:16:04.021911] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:04.135328] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T18:16:04.758064] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-17T18:16:05.558007] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-17T18:16:06.017118] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T18:16:06.196953] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T18:16:06.358034] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-17T18:16:06.765811] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T18:16:07.158034] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-17T18:16:07.958024] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-17T18:16:08.213134] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T18:16:08.355008] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-17T18:16:08.758008] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-17T18:16:08.799116] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T18:16:09.184546] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-17T18:16:09.185469] [INFO ] [REMOTE ] CUBB: Full fetch complete (956 records). [2025-10-17T18:16:09.185544] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-17T18:16:09.409013] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-17T18:16:09.409217] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:16:09.409264] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:16:09.409330] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-17T18:16:09.409398] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-17T18:16:09.409435] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-17T18:16:09.409475] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-17T18:16:09.409550] [INFO ] [MAIN ] Update Progress: 554/2368 symbols completed. CUBB took 37.8s. Estimated remaining: 4h 9m 9s. Rate: 7.3 symbols/min [2025-10-17T18:16:09.567302] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-17T18:16:09.594985] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:09.600284] [DEBUG] [LOCAL ] CULP: Loaded 2930 existing records from primary storage. [2025-10-17T18:16:09.600450] [INFO ] [MAIN ] CULP: Loaded 2930 existing records. [2025-10-17T18:16:09.776620] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:16:09.776872] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-17T18:16:09.776946] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-17T18:16:09.777109] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-17T18:16:09.777165] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-17T18:16:10.127378] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:10.358039] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-17T18:16:11.084916] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T18:16:11.158027] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-17T18:16:11.463423] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-17T18:16:11.958048] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-17T18:16:12.317788] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T18:16:12.758050] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-17T18:16:13.303265] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-17T18:16:13.558058] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-17T18:16:13.944005] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T18:16:14.358059] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-17T18:16:15.158088] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-17T18:16:15.437160] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T18:16:15.854980] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T18:16:15.958043] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-17T18:16:16.758050] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-17T18:16:17.003680] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T18:16:17.229933] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-17T18:16:17.243577] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T18:16:17.558026] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-17T18:16:18.358042] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-17T18:16:19.158018] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-17T18:16:19.330603] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T18:16:19.504950] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T18:16:19.958043] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-17T18:16:20.758064] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-17T18:16:21.044769] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T18:16:21.278417] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-17T18:16:21.304391] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T18:16:21.558037] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-17T18:16:22.358081] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-17T18:16:23.158061] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-17T18:16:23.344913] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T18:16:23.459076] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T18:16:23.958048] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-17T18:16:24.620549] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-17T18:16:24.758030] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-17T18:16:25.047739] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-17T18:16:25.245813] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-17T18:16:25.558041] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-17T18:16:26.358094] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-17T18:16:26.993696] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T18:16:27.158035] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-17T18:16:27.675019] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-17T18:16:27.766626] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T18:16:27.958026] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-17T18:16:28.758028] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-17T18:16:29.558010] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-17T18:16:29.828796] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T18:16:29.835940] [INFO ] [REMOTE ] CUBE: Full fetch complete (73287 records). [2025-10-17T18:16:29.836089] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-17T18:16:29.942259] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-17T18:16:30.229157] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-17T18:16:30.229253] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-17T18:16:30.230179] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-17T18:16:30.230246] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-17T18:16:30.232459] [DEBUG] [LOCAL ] CUBE: Trimmed 73287 records to 51666 (keeping 200 days of data) [2025-10-17T18:16:30.359225] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-17T18:16:30.566879] [DEBUG] [LOCAL ] CUBE: Primary data saved (51666 records). [2025-10-17T18:16:30.567041] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-17T18:16:30.567169] [INFO ] [MAIN ] Update Progress: 555/2368 symbols completed. CUBE took 39.5s. Estimated remaining: 4h 9m 43s. Rate: 7.3 symbols/min [2025-10-17T18:16:30.776578] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:30.778798] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T18:16:30.825279] [DEBUG] [LOCAL ] CURB: Loaded 33087 existing records from primary storage. [2025-10-17T18:16:30.825570] [INFO ] [MAIN ] CURB: Loaded 33087 existing records. [2025-10-17T18:16:31.006229] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:16:31.006521] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-17T18:16:31.006584] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-17T18:16:31.006957] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-17T18:16:31.007026] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-17T18:16:31.163138] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-17T18:16:31.372083] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:31.756056] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T18:16:31.759943] [INFO ] [REMOTE ] CUBI: Full fetch complete (38995 records). [2025-10-17T18:16:31.760044] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-17T18:16:31.760684] [FATAL] [VALIDATOR ] CUBI: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:16:31.760775] [FATAL] [MAIN ] CUBI: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:16:31.760819] [WARN ] [MAIN ] CUBI: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:16:31.760867] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-17T18:16:31.760960] [DEBUG] [LOCAL ] CUBI: No primary data file found to delete. [2025-10-17T18:16:31.761023] [INFO ] [LOCAL ] CUBI: Starting deletion of derivative data. [2025-10-17T18:16:31.761258] [DEBUG] [LOCAL ] CUBI: Deleted derivative data file. [2025-10-17T18:16:31.761384] [INFO ] [MAIN ] Update Progress: 556/2368 symbols completed. CUBI took 31.3s. Estimated remaining: 4h 9m 12s. Rate: 7.3 symbols/min [2025-10-17T18:16:31.933455] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:31.933713] [DEBUG] [LOCAL ] CURV: No existing data file found in primary storage. [2025-10-17T18:16:31.933768] [WARN ] [MAIN ] CURV: No existing data found, performing full refresh instead. [2025-10-17T18:16:31.933902] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-17T18:16:31.933983] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-17T18:16:31.934072] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-10-17T18:16:31.934142] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-17T18:16:31.963974] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-17T18:16:32.289744] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:32.747540] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T18:16:32.757987] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-17T18:16:33.042470] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-17T18:16:33.136448] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-17T18:16:33.558025] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-17T18:16:34.284562] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T18:16:34.285498] [INFO ] [REMOTE ] CULP: Full fetch complete (4558 records). [2025-10-17T18:16:34.285587] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-17T18:16:34.363216] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-17T18:16:34.639584] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-17T18:16:34.639684] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-17T18:16:34.639837] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-17T18:16:34.639877] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-17T18:16:34.640218] [DEBUG] [LOCAL ] CULP: Trimmed 4558 records to 2947 (keeping 200 days of data) [2025-10-17T18:16:34.656689] [DEBUG] [LOCAL ] CULP: Primary data saved (2947 records). [2025-10-17T18:16:34.656841] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-17T18:16:34.656948] [INFO ] [MAIN ] Update Progress: 557/2368 symbols completed. CULP took 25.2s. Estimated remaining: 4h 8m 46s. Rate: 7.3 symbols/min [2025-10-17T18:16:35.158034] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-17T18:16:35.806173] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T18:16:35.958070] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-17T18:16:36.758088] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-17T18:16:36.948513] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T18:16:37.258166] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T18:16:37.558061] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-17T18:16:38.358042] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-17T18:16:38.545759] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T18:16:38.858479] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T18:16:39.158007] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-17T18:16:39.562259] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-17T18:16:39.958029] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-17T18:16:40.758041] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-17T18:16:41.100928] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T18:16:41.185084] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T18:16:41.192739] [INFO ] [REMOTE ] CUK: Full fetch complete (74333 records). [2025-10-17T18:16:41.192885] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-17T18:16:41.565600] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-17T18:16:41.589487] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-17T18:16:41.589575] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-17T18:16:41.590463] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-17T18:16:41.590709] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-17T18:16:41.594228] [DEBUG] [LOCAL ] CUK: Trimmed 74333 records to 51814 (keeping 200 days of data) [2025-10-17T18:16:41.904496] [DEBUG] [LOCAL ] CUK: Primary data saved (51814 records). [2025-10-17T18:16:41.904668] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-17T18:16:41.905430] [INFO ] [MAIN ] Update Progress: 558/2368 symbols completed. CUK took 38.7s. Estimated remaining: 4h 8m 35s. Rate: 7.3 symbols/min [2025-10-17T18:16:42.180816] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T18:16:42.358057] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-17T18:16:42.462493] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-17T18:16:43.158098] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-17T18:16:43.905145] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T18:16:43.957988] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-17T18:16:44.256971] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T18:16:44.758032] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-17T18:16:45.231410] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T18:16:45.442356] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-17T18:16:45.558047] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-17T18:16:46.358123] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-17T18:16:47.040193] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T18:16:47.157985] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-17T18:16:47.546436] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T18:16:47.958089] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-17T18:16:48.500974] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T18:16:48.758099] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-17T18:16:49.011827] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T18:16:49.558068] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-17T18:16:49.812704] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T18:16:50.358096] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-17T18:16:50.806226] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T18:16:51.158084] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-17T18:16:51.407195] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T18:16:51.958037] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-17T18:16:52.630028] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-17T18:16:52.757988] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-17T18:16:53.318395] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T18:16:53.323500] [INFO ] [REMOTE ] CURB: Full fetch complete (47450 records). [2025-10-17T18:16:53.323634] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-17T18:16:53.705515] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-17T18:16:53.705608] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-17T18:16:53.706405] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-17T18:16:53.706472] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-17T18:16:53.707891] [DEBUG] [LOCAL ] CURB: Trimmed 47450 records to 33392 (keeping 200 days of data) [2025-10-17T18:16:53.907109] [DEBUG] [LOCAL ] CURB: Primary data saved (33392 records). [2025-10-17T18:16:53.907243] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-17T18:16:53.907338] [INFO ] [MAIN ] Update Progress: 559/2368 symbols completed. CURB took 23.3s. Estimated remaining: 4h 8m 39s. Rate: 7.3 symbols/min [2025-10-17T18:16:54.160746] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T18:16:54.165478] [INFO ] [REMOTE ] CURV: Full fetch complete (38996 records). [2025-10-17T18:16:54.165563] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-17T18:16:54.531357] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-17T18:16:54.531427] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-17T18:16:54.532064] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-17T18:16:54.532136] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-17T18:16:54.533222] [DEBUG] [LOCAL ] CURV: Trimmed 38996 records to 27541 (keeping 200 days of data) [2025-10-17T18:16:54.685304] [DEBUG] [LOCAL ] CURV: Primary data saved (27541 records). [2025-10-17T18:16:54.685486] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-17T18:16:54.685597] [INFO ] [MAIN ] Update Progress: 560/2368 symbols completed. CURV took 22.9s. Estimated remaining: 4h 8m 6s. Rate: 7.3 symbols/min [2025-10-17T18:16:55.157391] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:55.219707] [DEBUG] [LOCAL ] CVEO: No existing data file found in primary storage. [2025-10-17T18:16:55.244026] [WARN ] [MAIN ] CVEO: No existing data found, performing full refresh instead. [2025-10-17T18:16:55.316681] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:55.328173] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:55.317017] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-17T18:16:55.328377] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-17T18:16:55.347887] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-17T18:16:55.348246] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-17T18:16:55.376600] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:16:55.721392] [DEBUG] [LOCAL ] CUZ: Loaded 50005 existing records from primary storage. [2025-10-17T18:16:55.737790] [DEBUG] [LOCAL ] CVE: Loaded 53952 existing records from primary storage. [2025-10-17T18:16:55.738166] [INFO ] [MAIN ] CUZ: Loaded 50005 existing records. [2025-10-17T18:16:55.748775] [INFO ] [MAIN ] CVE: Loaded 53952 existing records. [2025-10-17T18:16:55.966960] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:56.007981] [DEBUG] [LOCAL ] CVI: Loaded 47001 existing records from primary storage. [2025-10-17T18:16:56.017730] [INFO ] [MAIN ] CVI: Loaded 47001 existing records. [2025-10-17T18:16:56.013611] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-17T18:16:56.294625] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:16:56.307246] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:16:56.307550] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-17T18:16:56.307691] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-17T18:16:56.318151] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-17T18:16:56.323374] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-17T18:16:56.381531] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-17T18:16:56.386226] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-17T18:16:56.386183] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:16:56.386454] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-17T18:16:56.386707] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-17T18:16:56.386611] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-17T18:16:56.446934] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-17T18:16:56.550707] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-17T18:16:56.581808] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-17T18:16:57.301831] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-17T18:16:57.328543] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:57.375053] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-17T18:16:57.374807] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-17T18:16:57.427194] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:57.427635] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-17T18:16:57.521585] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:16:57.522000] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-17T18:16:58.182374] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T18:16:58.184789] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-17T18:16:59.100617] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-17T18:16:59.103803] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-17T18:16:59.155455] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T18:16:59.165696] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-17T18:16:59.368275] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T18:16:59.444685] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-17T18:16:59.812305] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-17T18:16:59.958032] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-17T18:17:00.767824] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-17T18:17:00.772937] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T18:17:01.558035] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-17T18:17:01.734511] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T18:17:01.801370] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-17T18:17:02.358056] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-17T18:17:03.117231] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T18:17:03.158001] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-17T18:17:03.408959] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T18:17:03.958030] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-17T18:17:04.645191] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T18:17:04.758005] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-17T18:17:04.908904] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T18:17:05.558067] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-17T18:17:06.257544] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T18:17:06.358067] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-17T18:17:07.158039] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-17T18:17:07.239478] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T18:17:07.294971] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-17T18:17:07.958090] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-17T18:17:08.512578] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-17T18:17:08.758035] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-17T18:17:08.853557] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T18:17:09.558011] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-17T18:17:09.605864] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T18:17:10.358080] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-17T18:17:11.158019] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-17T18:17:11.441244] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T18:17:11.958053] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-17T18:17:12.388560] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T18:17:12.758023] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-17T18:17:12.914373] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T18:17:13.558065] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-17T18:17:13.670197] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T18:17:14.358004] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-17T18:17:14.511104] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T18:17:14.513978] [INFO ] [REMOTE ] CVEO: Full fetch complete (20833 records). [2025-10-17T18:17:14.514063] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-17T18:17:14.852985] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-17T18:17:14.941966] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-17T18:17:14.942046] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-17T18:17:14.942510] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-17T18:17:14.942552] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-17T18:17:14.943167] [DEBUG] [LOCAL ] CVEO: Trimmed 20833 records to 15568 (keeping 200 days of data) [2025-10-17T18:17:15.031087] [DEBUG] [LOCAL ] CVEO: Primary data saved (15568 records). [2025-10-17T18:17:15.031227] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-17T18:17:15.031298] [INFO ] [MAIN ] Update Progress: 561/2368 symbols completed. CVEO took 20.3s. Estimated remaining: 4h 8m 37s. Rate: 7.3 symbols/min [2025-10-17T18:17:15.172758] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-17T18:17:15.206332] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:17:15.223196] [DEBUG] [LOCAL ] CVLG: Loaded 15699 existing records from primary storage. [2025-10-17T18:17:15.223474] [INFO ] [MAIN ] CVLG: Loaded 15699 existing records. [2025-10-17T18:17:15.404081] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:17:15.404326] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-17T18:17:15.404385] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-17T18:17:15.404560] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-17T18:17:15.404600] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-17T18:17:15.782336] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:17:15.958026] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-17T18:17:16.247499] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T18:17:16.758041] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-17T18:17:16.950117] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T18:17:17.133702] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T18:17:17.558041] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-17T18:17:18.305834] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T18:17:18.352327] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T18:17:18.357977] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-17T18:17:19.158023] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-17T18:17:19.305003] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T18:17:19.958094] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-17T18:17:20.758096] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-17T18:17:20.980702] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-17T18:17:21.558048] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-17T18:17:21.865955] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T18:17:22.358085] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-17T18:17:22.458222] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-17T18:17:22.593987] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T18:17:23.158068] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-17T18:17:23.958025] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-17T18:17:24.259503] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T18:17:24.428326] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-17T18:17:24.758002] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-17T18:17:25.558018] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-17T18:17:25.627776] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-17T18:17:25.629335] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T18:17:26.358107] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-17T18:17:27.158026] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-17T18:17:27.207341] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T18:17:27.600751] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T18:17:27.958035] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-17T18:17:28.758043] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-17T18:17:29.059933] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T18:17:29.558027] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-17T18:17:29.640279] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T18:17:29.816626] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T18:17:30.358046] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-17T18:17:30.937044] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T18:17:31.158024] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-17T18:17:31.958026] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-17T18:17:32.252670] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T18:17:32.758060] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-17T18:17:32.888483] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T18:17:33.558000] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-17T18:17:33.797183] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T18:17:33.803998] [INFO ] [REMOTE ] CUZ: Full fetch complete (70957 records). [2025-10-17T18:17:33.804118] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-17T18:17:34.188595] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-17T18:17:34.188760] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-17T18:17:34.189587] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-17T18:17:34.189632] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-17T18:17:34.191029] [DEBUG] [LOCAL ] CUZ: Trimmed 70957 records to 50363 (keeping 200 days of data) [2025-10-17T18:17:34.381017] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-17T18:17:34.434827] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T18:17:34.459736] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T18:17:34.474448] [INFO ] [REMOTE ] CVE: Full fetch complete (77716 records). [2025-10-17T18:17:34.475312] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-17T18:17:34.891578] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-17T18:17:34.892215] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-17T18:17:34.893141] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-17T18:17:34.893224] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-17T18:17:34.901294] [DEBUG] [LOCAL ] CVE: Trimmed 77716 records to 54342 (keeping 200 days of data) [2025-10-17T18:17:35.173147] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-17T18:17:35.187462] [DEBUG] [LOCAL ] CUZ: Primary data saved (50363 records). [2025-10-17T18:17:35.188420] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-17T18:17:35.189595] [INFO ] [MAIN ] Update Progress: 562/2368 symbols completed. CUZ took 40.5s. Estimated remaining: 4h 9m 7s. Rate: 7.2 symbols/min [2025-10-17T18:17:35.454160] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:17:35.459181] [DEBUG] [LOCAL ] CVNA: No existing data file found in primary storage. [2025-10-17T18:17:35.467775] [WARN ] [MAIN ] CVNA: No existing data found, performing full refresh instead. [2025-10-17T18:17:35.472906] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-17T18:17:35.473003] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-17T18:17:35.479683] [DEBUG] [LOCAL ] CVE: Primary data saved (54342 records). [2025-10-17T18:17:35.479623] [DEBUG] [LOCAL ] CVNA: No primary data file found to delete. [2025-10-17T18:17:35.479818] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-17T18:17:35.479887] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-17T18:17:35.480005] [INFO ] [MAIN ] Update Progress: 563/2368 symbols completed. CVE took 40.8s. Estimated remaining: 4h 8m 33s. Rate: 7.3 symbols/min [2025-10-17T18:17:35.849352] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:17:36.028424] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:17:36.028845] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-17T18:17:36.067385] [DEBUG] [LOCAL ] CVS: Loaded 54084 existing records from primary storage. [2025-10-17T18:17:36.075599] [INFO ] [MAIN ] CVS: Loaded 54084 existing records. [2025-10-17T18:17:36.076441] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T18:17:36.258056] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:17:36.258266] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-17T18:17:36.258313] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-17T18:17:36.258632] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-17T18:17:36.258774] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-17T18:17:36.428678] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T18:17:36.645789] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:17:36.757998] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-17T18:17:37.558017] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-17T18:17:38.062762] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T18:17:38.357997] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-17T18:17:38.592995] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T18:17:38.596429] [INFO ] [REMOTE ] CVLG: Full fetch complete (21375 records). [2025-10-17T18:17:38.596593] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-17T18:17:38.968728] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-17T18:17:38.968894] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-17T18:17:38.969434] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-17T18:17:38.969514] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-17T18:17:38.980977] [DEBUG] [LOCAL ] CVLG: Trimmed 21375 records to 15760 (keeping 200 days of data) [2025-10-17T18:17:39.007890] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-17T18:17:39.111197] [DEBUG] [LOCAL ] CVLG: Primary data saved (15760 records). [2025-10-17T18:17:39.111334] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-17T18:17:39.111414] [INFO ] [MAIN ] Update Progress: 564/2368 symbols completed. CVLG took 24.1s. Estimated remaining: 4h 8m 10s. Rate: 7.3 symbols/min [2025-10-17T18:17:39.166127] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-17T18:17:39.280781] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:17:39.332793] [DEBUG] [LOCAL ] CVX: Loaded 54150 existing records from primary storage. [2025-10-17T18:17:39.333162] [INFO ] [MAIN ] CVX: Loaded 54150 existing records. [2025-10-17T18:17:39.505987] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:17:39.506181] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-17T18:17:39.506228] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-17T18:17:39.506516] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-17T18:17:39.506555] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-17T18:17:39.857193] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:17:39.958015] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-17T18:17:40.579326] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-17T18:17:40.758022] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-17T18:17:40.891436] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T18:17:40.898084] [INFO ] [REMOTE ] CVI: Full fetch complete (67244 records). [2025-10-17T18:17:40.898185] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-17T18:17:41.280238] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-17T18:17:41.280316] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-17T18:17:41.281218] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-17T18:17:41.281282] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-17T18:17:41.282592] [DEBUG] [LOCAL ] CVI: Trimmed 67244 records to 47330 (keeping 200 days of data) [2025-10-17T18:17:41.554915] [DEBUG] [LOCAL ] CVI: Primary data saved (47330 records). [2025-10-17T18:17:41.555049] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-17T18:17:41.555132] [INFO ] [MAIN ] Update Progress: 565/2368 symbols completed. CVI took 46.9s. Estimated remaining: 4h 7m 43s. Rate: 7.3 symbols/min [2025-10-17T18:17:41.566545] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-17T18:17:41.724146] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:17:41.724342] [DEBUG] [LOCAL ] CW: No existing data file found in primary storage. [2025-10-17T18:17:41.724419] [WARN ] [MAIN ] CW: No existing data found, performing full refresh instead. [2025-10-17T18:17:41.724535] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-17T18:17:41.724575] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-17T18:17:41.724616] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-10-17T18:17:41.724674] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-17T18:17:42.078018] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:17:42.245333] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-17T18:17:42.358036] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-17T18:17:42.973540] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-17T18:17:43.158010] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-17T18:17:43.608760] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-17T18:17:43.958068] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-17T18:17:44.647862] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-17T18:17:44.751045] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T18:17:44.761430] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-17T18:17:45.558037] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-17T18:17:46.075379] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T18:17:46.188148] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-17T18:17:46.358042] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-17T18:17:47.158048] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-17T18:17:47.265755] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T18:17:47.958004] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-17T18:17:48.505375] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-17T18:17:48.758126] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-17T18:17:49.558048] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-17T18:17:49.630044] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-17T18:17:49.950083] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T18:17:50.126158] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-17T18:17:50.358026] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-17T18:17:51.158035] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-17T18:17:51.857466] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-17T18:17:51.958014] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-17T18:17:52.403128] [DEBUG] [REMOTE ] CVX: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-17T18:17:52.403439] [WARN ] [REMOTE ] CVX: No data returned for month 2025-04 [2025-10-17T18:17:52.403532] [FATAL] [REMOTE ] CVX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:17:52.403634] [FATAL] [MAIN ] CVX: Failed to fetch primary data. [2025-10-17T18:17:52.403737] [WARN ] [MAIN ] CVX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:17:52.403811] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-17T18:17:52.403877] [DEBUG] [LOCAL ] CVX: No primary data file found to delete. [2025-10-17T18:17:52.403914] [INFO ] [LOCAL ] CVX: Starting deletion of derivative data. [2025-10-17T18:17:52.404131] [DEBUG] [LOCAL ] CVX: Deleted derivative data file. [2025-10-17T18:17:52.404217] [INFO ] [MAIN ] Update Progress: 566/2368 symbols completed. CVX took 13.3s. Estimated remaining: 4h 7m 43s. Rate: 7.3 symbols/min [2025-10-17T18:17:52.579014] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-17T18:17:52.624296] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:17:52.678016] [DEBUG] [LOCAL ] CWAN: Loaded 53002 existing records from primary storage. [2025-10-17T18:17:52.678342] [INFO ] [MAIN ] CWAN: Loaded 53002 existing records. [2025-10-17T18:17:52.763237] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-17T18:17:52.864728] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:17:52.864919] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-17T18:17:52.864967] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-17T18:17:52.865289] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-17T18:17:52.865329] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-17T18:17:53.223750] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:17:53.480120] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-17T18:17:53.558010] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-17T18:17:54.358100] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-17T18:17:54.860458] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-17T18:17:55.158009] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-17T18:17:55.645497] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-17T18:17:55.691521] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T18:17:55.958046] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-17T18:17:56.758031] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-17T18:17:57.262418] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-17T18:17:57.558017] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-17T18:17:58.094159] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T18:17:58.339988] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-17T18:17:58.358002] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-17T18:17:59.158042] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-17T18:17:59.359629] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T18:17:59.958042] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-17T18:18:00.449088] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-17T18:18:00.758033] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-17T18:18:01.092755] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-17T18:18:01.520197] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T18:18:01.558065] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-17T18:18:02.358005] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-17T18:18:02.635335] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T18:18:03.158020] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-17T18:18:03.434033] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T18:18:03.879547] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-17T18:18:03.958082] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-17T18:18:04.758005] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-17T18:18:04.821840] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T18:18:05.558059] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-17T18:18:06.254555] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-17T18:18:06.265133] [INFO ] [REMOTE ] CVNA: Full fetch complete (76760 records). [2025-10-17T18:18:06.265302] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-17T18:18:06.359460] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-17T18:18:06.677138] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-17T18:18:06.677354] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-17T18:18:06.678381] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-17T18:18:06.678474] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-17T18:18:06.680250] [DEBUG] [LOCAL ] CVNA: Trimmed 76760 records to 53628 (keeping 200 days of data) [2025-10-17T18:18:06.801015] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-17T18:18:07.048319] [DEBUG] [LOCAL ] CVNA: Primary data saved (53628 records). [2025-10-17T18:18:07.048431] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-17T18:18:07.048504] [INFO ] [MAIN ] Update Progress: 567/2368 symbols completed. CVNA took 31.9s. Estimated remaining: 4h 7m 55s. Rate: 7.3 symbols/min [2025-10-17T18:18:07.159725] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-17T18:18:07.226673] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:18:07.264563] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T18:18:07.303458] [DEBUG] [LOCAL ] CWEN: Loaded 45638 existing records from primary storage. [2025-10-17T18:18:07.303812] [INFO ] [MAIN ] CWEN: Loaded 45638 existing records. [2025-10-17T18:18:07.491275] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:18:07.491555] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-17T18:18:07.491718] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-17T18:18:07.492148] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-17T18:18:07.492208] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-17T18:18:07.657925] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T18:18:07.888860] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:18:07.957986] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-17T18:18:08.036438] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-17T18:18:08.044038] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-17T18:18:08.044167] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-17T18:18:08.454028] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-17T18:18:08.454113] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-17T18:18:08.455001] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-17T18:18:08.455065] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-17T18:18:08.456491] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 54474 (keeping 200 days of data) [2025-10-17T18:18:08.759360] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-17T18:18:08.786213] [DEBUG] [LOCAL ] CVS: Primary data saved (54474 records). [2025-10-17T18:18:08.786323] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-17T18:18:08.786400] [INFO ] [MAIN ] Update Progress: 568/2368 symbols completed. CVS took 33.3s. Estimated remaining: 4h 7m 26s. Rate: 7.3 symbols/min [2025-10-17T18:18:08.962744] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:18:09.014000] [DEBUG] [LOCAL ] CWH: Loaded 51694 existing records from primary storage. [2025-10-17T18:18:09.014315] [INFO ] [MAIN ] CWH: Loaded 51694 existing records. [2025-10-17T18:18:09.197280] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:18:09.197536] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-17T18:18:09.197602] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-17T18:18:09.198193] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-17T18:18:09.198255] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-17T18:18:09.556409] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:18:09.565912] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-17T18:18:09.581855] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T18:18:10.358020] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-17T18:18:10.392231] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T18:18:11.158013] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-17T18:18:11.348714] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T18:18:11.623979] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T18:18:11.958028] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-17T18:18:12.758102] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-17T18:18:12.806709] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T18:18:13.111544] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T18:18:13.558028] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-17T18:18:14.320798] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T18:18:14.358087] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-17T18:18:15.158086] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-17T18:18:15.302708] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T18:18:15.423127] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T18:18:15.958035] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-17T18:18:16.503350] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T18:18:16.758055] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-17T18:18:17.089421] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-17T18:18:17.093028] [INFO ] [REMOTE ] CW: Full fetch complete (33159 records). [2025-10-17T18:18:17.093161] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-17T18:18:17.469843] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-17T18:18:17.469919] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-17T18:18:17.470448] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-17T18:18:17.470487] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-17T18:18:17.471268] [DEBUG] [LOCAL ] CW: Trimmed 33159 records to 22372 (keeping 200 days of data) [2025-10-17T18:18:17.559584] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-17T18:18:17.614968] [DEBUG] [LOCAL ] CW: Primary data saved (22372 records). [2025-10-17T18:18:17.615146] [INFO ] [MAIN ] CW: Full history saved. [2025-10-17T18:18:17.615249] [INFO ] [MAIN ] Update Progress: 569/2368 symbols completed. CW took 36.1s. Estimated remaining: 4h 7m 20s. Rate: 7.3 symbols/min [2025-10-17T18:18:17.810022] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:18:17.857776] [DEBUG] [LOCAL ] CWK: Loaded 49995 existing records from primary storage. [2025-10-17T18:18:17.858106] [INFO ] [MAIN ] CWK: Loaded 49995 existing records. [2025-10-17T18:18:18.055811] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:18:18.056185] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-17T18:18:18.056325] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-17T18:18:18.056768] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-17T18:18:18.056837] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-17T18:18:18.370300] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-17T18:18:18.466031] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:18:18.491452] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T18:18:18.745852] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T18:18:19.158040] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-17T18:18:19.958063] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-17T18:18:20.138735] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T18:18:20.758007] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-17T18:18:21.095427] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-17T18:18:21.558009] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-17T18:18:21.743366] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T18:18:22.358018] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-17T18:18:22.631486] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T18:18:23.158052] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-17T18:18:23.500785] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T18:18:23.566807] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-17T18:18:23.958031] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-17T18:18:24.649109] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T18:18:24.757995] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-17T18:18:25.558008] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-17T18:18:25.616558] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T18:18:26.308243] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T18:18:26.358034] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-17T18:18:27.158071] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-17T18:18:27.234396] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T18:18:27.958071] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-17T18:18:28.107948] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T18:18:28.758038] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-17T18:18:28.852298] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T18:18:28.859850] [INFO ] [REMOTE ] CWAN: Full fetch complete (75555 records). [2025-10-17T18:18:28.859986] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-17T18:18:29.261889] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-17T18:18:29.262003] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-17T18:18:29.262969] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-17T18:18:29.263037] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-17T18:18:29.264588] [DEBUG] [LOCAL ] CWAN: Trimmed 75555 records to 53387 (keeping 200 days of data) [2025-10-17T18:18:29.560572] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-17T18:18:29.589621] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T18:18:29.618165] [DEBUG] [LOCAL ] CWAN: Primary data saved (53387 records). [2025-10-17T18:18:29.618310] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-17T18:18:29.618392] [INFO ] [MAIN ] Update Progress: 570/2368 symbols completed. CWAN took 37.2s. Estimated remaining: 4h 7m 24s. Rate: 7.3 symbols/min [2025-10-17T18:18:29.781086] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:18:29.808827] [DEBUG] [LOCAL ] CWT: Loaded 28331 existing records from primary storage. [2025-10-17T18:18:29.809097] [INFO ] [MAIN ] CWT: Loaded 28331 existing records. [2025-10-17T18:18:29.981431] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:18:29.981634] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-17T18:18:29.981716] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-17T18:18:29.981910] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-17T18:18:29.981967] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-17T18:18:30.344478] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:18:30.357989] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-17T18:18:30.421575] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T18:18:31.157989] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-17T18:18:31.436286] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T18:18:31.958069] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-17T18:18:32.244967] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T18:18:32.758010] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-17T18:18:32.791770] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T18:18:33.546682] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T18:18:33.558021] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-17T18:18:33.994187] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T18:18:34.358060] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-17T18:18:35.161402] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-17T18:18:35.166769] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T18:18:35.668284] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-17T18:18:35.958036] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-17T18:18:36.651909] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T18:18:36.758012] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-17T18:18:37.558029] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-17T18:18:37.609932] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T18:18:38.358042] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-17T18:18:38.417152] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T18:18:38.712669] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T18:18:39.158085] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-17T18:18:39.958038] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-17T18:18:40.074188] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T18:18:40.421063] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-17T18:18:40.758037] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-17T18:18:41.456203] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T18:18:41.466714] [INFO ] [REMOTE ] CWEN: Full fetch complete (65531 records). [2025-10-17T18:18:41.466925] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-17T18:18:41.563209] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-17T18:18:41.892541] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-17T18:18:41.892666] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-17T18:18:41.893564] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-17T18:18:41.893697] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-17T18:18:41.912766] [DEBUG] [LOCAL ] CWEN: Trimmed 65531 records to 45984 (keeping 200 days of data) [2025-10-17T18:18:41.914319] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-17T18:18:42.221058] [DEBUG] [LOCAL ] CWEN: Primary data saved (45984 records). [2025-10-17T18:18:42.221200] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-17T18:18:42.221901] [INFO ] [MAIN ] Update Progress: 571/2368 symbols completed. CWEN took 35.2s. Estimated remaining: 4h 7m 29s. Rate: 7.3 symbols/min [2025-10-17T18:18:42.363176] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-17T18:18:42.394931] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:18:42.395057] [DEBUG] [LOCAL ] CX: No existing data file found in primary storage. [2025-10-17T18:18:42.395094] [WARN ] [MAIN ] CX: No existing data found, performing full refresh instead. [2025-10-17T18:18:42.395209] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-17T18:18:42.395249] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-17T18:18:42.395290] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-10-17T18:18:42.395323] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-17T18:18:42.760517] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:18:43.158019] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-17T18:18:43.416695] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T18:18:43.702992] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T18:18:43.958020] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-17T18:18:44.758055] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-17T18:18:44.908587] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T18:18:45.293301] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-17T18:18:45.558027] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-17T18:18:46.370624] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-17T18:18:46.373394] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T18:18:46.818892] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T18:18:47.158035] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-17T18:18:47.958003] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-17T18:18:48.145241] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T18:18:48.758038] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-17T18:18:48.891714] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T18:18:49.562119] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-17T18:18:49.635027] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T18:18:49.952037] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-17T18:18:50.358037] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-17T18:18:51.158019] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-17T18:18:51.359499] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T18:18:51.366551] [INFO ] [REMOTE ] CWK: Full fetch complete (71323 records). [2025-10-17T18:18:51.366707] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-17T18:18:51.769139] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-17T18:18:51.769288] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-17T18:18:51.770273] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-17T18:18:51.770355] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-17T18:18:51.772536] [DEBUG] [LOCAL ] CWK: Trimmed 71323 records to 50364 (keeping 200 days of data) [2025-10-17T18:18:51.891730] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T18:18:51.903022] [INFO ] [REMOTE ] CWH: Full fetch complete (73217 records). [2025-10-17T18:18:51.909506] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-17T18:18:51.968455] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-17T18:18:52.455970] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-17T18:18:52.456347] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-17T18:18:52.470151] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-17T18:18:52.469260] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T18:18:52.477447] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-17T18:18:52.506846] [DEBUG] [LOCAL ] CWH: Trimmed 73217 records to 52055 (keeping 200 days of data) [2025-10-17T18:18:52.654502] [DEBUG] [LOCAL ] CWK: Primary data saved (50364 records). [2025-10-17T18:18:52.654983] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-17T18:18:52.655366] [INFO ] [MAIN ] Update Progress: 572/2368 symbols completed. CWK took 35.0s. Estimated remaining: 4h 7m 28s. Rate: 7.3 symbols/min [2025-10-17T18:18:52.760782] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-17T18:18:52.843245] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:18:52.858013] [DEBUG] [LOCAL ] CXE: Loaded 6167 existing records from primary storage. [2025-10-17T18:18:52.859205] [INFO ] [MAIN ] CXE: Loaded 6167 existing records. [2025-10-17T18:18:53.138765] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:18:53.145067] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-17T18:18:53.145684] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-17T18:18:53.146247] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-17T18:18:53.146620] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-17T18:18:53.526473] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:18:53.565208] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-17T18:18:53.609946] [DEBUG] [LOCAL ] CWH: Primary data saved (52055 records). [2025-10-17T18:18:53.610221] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-17T18:18:53.610958] [INFO ] [MAIN ] Update Progress: 573/2368 symbols completed. CWH took 44.8s. Estimated remaining: 4h 6m 56s. Rate: 7.3 symbols/min [2025-10-17T18:18:53.789779] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:18:53.790000] [DEBUG] [LOCAL ] CXH: No existing data file found in primary storage. [2025-10-17T18:18:53.790189] [WARN ] [MAIN ] CXH: No existing data found, performing full refresh instead. [2025-10-17T18:18:53.790406] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-17T18:18:53.790602] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-17T18:18:53.790732] [DEBUG] [LOCAL ] CXH: No primary data file found to delete. [2025-10-17T18:18:53.790832] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-17T18:18:53.928046] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T18:18:54.185410] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-17T18:18:54.231953] [INFO ] [REMOTE ] CWT: Full fetch complete (41108 records). [2025-10-17T18:18:54.231848] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:18:54.232334] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-17T18:18:54.370061] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-17T18:18:54.505805] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-17T18:18:54.618580] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-17T18:18:54.618687] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-17T18:18:54.619336] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-17T18:18:54.619396] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-17T18:18:54.620395] [DEBUG] [LOCAL ] CWT: Trimmed 41108 records to 28510 (keeping 200 days of data) [2025-10-17T18:18:54.783247] [DEBUG] [LOCAL ] CWT: Primary data saved (28510 records). [2025-10-17T18:18:54.783381] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-17T18:18:54.783483] [INFO ] [MAIN ] Update Progress: 574/2368 symbols completed. CWT took 25.2s. Estimated remaining: 4h 6m 26s. Rate: 7.3 symbols/min [2025-10-17T18:18:54.949163] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:18:54.993754] [DEBUG] [LOCAL ] CXM: Loaded 47906 existing records from primary storage. [2025-10-17T18:18:54.994072] [INFO ] [MAIN ] CXM: Loaded 47906 existing records. [2025-10-17T18:18:55.168216] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-17T18:18:55.209779] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:18:55.210697] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-17T18:18:55.210758] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-17T18:18:55.210954] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-17T18:18:55.210996] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-17T18:18:55.583719] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:18:55.839551] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-17T18:18:55.958055] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-17T18:18:56.203379] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T18:18:56.404960] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-17T18:18:56.758056] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-17T18:18:57.558020] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-17T18:18:58.050070] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T18:18:58.358004] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-17T18:18:58.653718] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T18:18:59.158031] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-17T18:18:59.958048] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-17T18:19:00.102529] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T18:19:00.396293] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-17T18:19:00.758004] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-17T18:19:01.054138] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T18:19:01.558024] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-17T18:19:02.358057] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-17T18:19:02.482678] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T18:19:02.854042] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-17T18:19:02.972983] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T18:19:03.158046] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-17T18:19:03.808447] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-17T18:19:03.958035] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-17T18:19:04.758024] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-17T18:19:04.947390] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T18:19:05.558020] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-17T18:19:06.358028] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-17T18:19:06.443439] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T18:19:06.599850] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-17T18:19:07.097844] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-17T18:19:07.158103] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-17T18:19:07.958072] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-17T18:19:08.707477] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T18:19:08.758466] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-17T18:19:08.760390] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-17T18:19:09.558013] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-17T18:19:10.358059] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-17T18:19:10.366713] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-17T18:19:10.412920] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T18:19:11.158061] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-17T18:19:11.174195] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T18:19:11.760533] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-17T18:19:11.958045] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-17T18:19:12.564580] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T18:19:12.758070] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-17T18:19:13.558016] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-17T18:19:14.358003] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-17T18:19:14.397485] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T18:19:14.398346] [INFO ] [REMOTE ] CXH: Full fetch complete (5321 records). [2025-10-17T18:19:14.398414] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-17T18:19:14.556518] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T18:19:14.795612] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-17T18:19:14.795723] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-17T18:19:14.795901] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-17T18:19:14.795952] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-17T18:19:14.796381] [DEBUG] [LOCAL ] CXH: Trimmed 5321 records to 4462 (keeping 200 days of data) [2025-10-17T18:19:14.822757] [DEBUG] [LOCAL ] CXH: Primary data saved (4462 records). [2025-10-17T18:19:14.822908] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-17T18:19:14.822986] [INFO ] [MAIN ] Update Progress: 575/2368 symbols completed. CXH took 21.2s. Estimated remaining: 4h 6m 55s. Rate: 7.3 symbols/min [2025-10-17T18:19:14.995214] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:19:15.028423] [DEBUG] [LOCAL ] CXT: Loaded 31299 existing records from primary storage. [2025-10-17T18:19:15.028750] [INFO ] [MAIN ] CXT: Loaded 31299 existing records. [2025-10-17T18:19:15.168333] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-17T18:19:15.210368] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:19:15.216977] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-17T18:19:15.218922] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-17T18:19:15.219751] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-17T18:19:15.220046] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-17T18:19:15.220090] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-17T18:19:15.587202] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:19:15.958097] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-17T18:19:16.758061] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-17T18:19:16.898590] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T18:19:17.284163] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T18:19:17.433487] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-17T18:19:17.557996] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-17T18:19:18.174082] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-17T18:19:18.358026] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-17T18:19:18.969365] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T18:19:19.158014] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-17T18:19:19.958092] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-17T18:19:20.758057] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-17T18:19:20.765754] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T18:19:20.942097] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T18:19:21.558031] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-17T18:19:22.160617] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T18:19:22.358064] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-17T18:19:23.062680] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T18:19:23.158054] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-17T18:19:23.958015] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-17T18:19:24.060571] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T18:19:24.758013] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-17T18:19:24.876625] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-17T18:19:24.997940] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T18:19:25.558026] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-17T18:19:25.660572] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-17T18:19:25.662344] [INFO ] [REMOTE ] CXE: Full fetch complete (11432 records). [2025-10-17T18:19:25.662462] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-17T18:19:26.024395] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-17T18:19:26.024479] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-17T18:19:26.024793] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-17T18:19:26.024877] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-17T18:19:26.025308] [DEBUG] [LOCAL ] CXE: Trimmed 11432 records to 6233 (keeping 200 days of data) [2025-10-17T18:19:26.064586] [DEBUG] [LOCAL ] CXE: Primary data saved (6233 records). [2025-10-17T18:19:26.064787] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-17T18:19:26.064911] [INFO ] [MAIN ] Update Progress: 576/2368 symbols completed. CXE took 33.4s. Estimated remaining: 4h 6m 56s. Rate: 7.3 symbols/min [2025-10-17T18:19:26.228993] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:19:26.269580] [DEBUG] [LOCAL ] CXW: Loaded 44193 existing records from primary storage. [2025-10-17T18:19:26.269898] [INFO ] [MAIN ] CXW: Loaded 44193 existing records. [2025-10-17T18:19:26.366754] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-17T18:19:26.462776] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:19:26.462997] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-17T18:19:26.463048] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-17T18:19:26.463444] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-17T18:19:26.463501] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-17T18:19:26.846919] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:19:26.983986] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T18:19:27.158012] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-17T18:19:27.958089] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-17T18:19:28.187219] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T18:19:28.194576] [INFO ] [REMOTE ] CX: Full fetch complete (76581 records). [2025-10-17T18:19:28.194737] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-17T18:19:28.589689] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-17T18:19:28.589841] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-17T18:19:28.590881] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-17T18:19:28.591000] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-17T18:19:28.592733] [DEBUG] [LOCAL ] CX: Trimmed 76581 records to 53605 (keeping 200 days of data) [2025-10-17T18:19:28.699302] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T18:19:28.787094] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-17T18:19:28.939597] [DEBUG] [LOCAL ] CX: Primary data saved (53605 records). [2025-10-17T18:19:28.939831] [INFO ] [MAIN ] CX: Full history saved. [2025-10-17T18:19:28.939930] [INFO ] [MAIN ] Update Progress: 577/2368 symbols completed. CX took 46.7s. Estimated remaining: 4h 6m 31s. Rate: 7.3 symbols/min [2025-10-17T18:19:29.108540] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:19:29.108793] [DEBUG] [LOCAL ] CYD: No existing data file found in primary storage. [2025-10-17T18:19:29.108848] [WARN ] [MAIN ] CYD: No existing data found, performing full refresh instead. [2025-10-17T18:19:29.108959] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-17T18:19:29.109002] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-17T18:19:29.109049] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-17T18:19:29.109083] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-17T18:19:29.468854] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:19:29.548199] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T18:19:29.557981] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-17T18:19:30.149031] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T18:19:30.330467] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T18:19:30.357977] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-17T18:19:30.978562] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T18:19:31.158036] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-17T18:19:31.958070] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-17T18:19:32.725706] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T18:19:32.757985] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-17T18:19:33.140437] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T18:19:33.558029] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-17T18:19:34.351443] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T18:19:34.360980] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-17T18:19:34.989743] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T18:19:35.158071] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-17T18:19:35.624843] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T18:19:35.958041] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-17T18:19:36.513060] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-17T18:19:36.758028] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-17T18:19:37.384363] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T18:19:37.558015] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-17T18:19:37.856080] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-17T18:19:38.358031] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-17T18:19:39.158046] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-17T18:19:39.223057] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T18:19:39.958060] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-17T18:19:40.165805] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T18:19:40.172252] [INFO ] [REMOTE ] CXM: Full fetch complete (68681 records). [2025-10-17T18:19:40.172389] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-17T18:19:40.540443] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T18:19:40.582749] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-17T18:19:40.582819] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-17T18:19:40.583715] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-17T18:19:40.583785] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-17T18:19:40.585097] [DEBUG] [LOCAL ] CXM: Trimmed 68681 records to 48245 (keeping 200 days of data) [2025-10-17T18:19:40.771850] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-17T18:19:40.846902] [DEBUG] [LOCAL ] CXM: Primary data saved (48245 records). [2025-10-17T18:19:40.847034] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-17T18:19:40.847113] [INFO ] [MAIN ] Update Progress: 578/2368 symbols completed. CXM took 46.1s. Estimated remaining: 4h 6m 34s. Rate: 7.3 symbols/min [2025-10-17T18:19:41.011732] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:19:41.053033] [DEBUG] [LOCAL ] CYH: Loaded 48083 existing records from primary storage. [2025-10-17T18:19:41.053342] [INFO ] [MAIN ] CYH: Loaded 48083 existing records. [2025-10-17T18:19:41.232394] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:19:41.232673] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-17T18:19:41.232734] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-17T18:19:41.232918] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-17T18:19:41.232956] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-17T18:19:41.583314] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:19:41.577889] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-17T18:19:41.610726] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T18:19:42.080292] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T18:19:42.357993] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-17T18:19:43.005819] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T18:19:43.157992] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-17T18:19:43.958012] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-17T18:19:44.048112] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T18:19:44.516969] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T18:19:44.758004] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-17T18:19:45.174903] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T18:19:45.558042] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-17T18:19:45.812870] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T18:19:46.358015] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-17T18:19:47.158026] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-17T18:19:47.195160] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T18:19:47.672974] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T18:19:47.958074] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-17T18:19:48.758000] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-17T18:19:49.079777] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-17T18:19:49.333091] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T18:19:49.338136] [INFO ] [REMOTE ] CXT: Full fetch complete (45732 records). [2025-10-17T18:19:49.338296] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-17T18:19:49.563725] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-17T18:19:49.719839] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-17T18:19:49.719959] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-17T18:19:49.720675] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-17T18:19:49.720740] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-17T18:19:49.721889] [DEBUG] [LOCAL ] CXT: Trimmed 45732 records to 31488 (keeping 200 days of data) [2025-10-17T18:19:49.907020] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T18:19:49.914342] [INFO ] [REMOTE ] CYD: Full fetch complete (35318 records). [2025-10-17T18:19:49.914725] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-17T18:19:50.256191] [DEBUG] [LOCAL ] CXT: Primary data saved (31488 records). [2025-10-17T18:19:50.279837] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-17T18:19:50.289905] [INFO ] [MAIN ] Update Progress: 579/2368 symbols completed. CXT took 35.5s. Estimated remaining: 4h 6m 29s. Rate: 7.3 symbols/min [2025-10-17T18:19:50.365165] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-17T18:19:50.388036] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-17T18:19:50.363113] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-17T18:19:50.393971] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-17T18:19:50.429892] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-17T18:19:50.498431] [DEBUG] [LOCAL ] CYD: Trimmed 35318 records to 27356 (keeping 200 days of data) [2025-10-17T18:19:50.501671] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:19:50.692682] [DEBUG] [LOCAL ] CYD: Primary data saved (27356 records). [2025-10-17T18:19:50.687815] [DEBUG] [LOCAL ] D: Loaded 54036 existing records from primary storage. [2025-10-17T18:19:50.692936] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-17T18:19:50.693085] [INFO ] [MAIN ] D: Loaded 54036 existing records. [2025-10-17T18:19:50.693186] [INFO ] [MAIN ] Update Progress: 580/2368 symbols completed. CYD took 21.8s. Estimated remaining: 4h 5m 56s. Rate: 7.3 symbols/min [2025-10-17T18:19:51.041781] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:19:51.019971] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:19:51.042116] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-17T18:19:51.042439] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-17T18:19:51.042858] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-17T18:19:51.042914] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-17T18:19:51.174261] [DEBUG] [LOCAL ] DAC: Loaded 12709 existing records from primary storage. [2025-10-17T18:19:51.196271] [INFO ] [MAIN ] DAC: Loaded 12709 existing records. [2025-10-17T18:19:51.607045] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:19:51.591752] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:19:51.621701] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-17T18:19:51.624188] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-17T18:19:51.621517] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-17T18:19:51.625302] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-17T18:19:51.625717] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-17T18:19:51.626967] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-17T18:19:51.961800] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-17T18:19:52.003692] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:19:52.032506] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T18:19:52.758038] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-17T18:19:53.558864] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-17T18:19:53.561939] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-17T18:19:53.677768] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T18:19:53.699593] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-17T18:19:54.358047] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-17T18:19:55.140307] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T18:19:55.157998] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-17T18:19:55.958005] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-17T18:19:56.191676] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T18:19:56.352107] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T18:19:56.758049] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-17T18:19:56.930087] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T18:19:57.558070] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-17T18:19:58.225612] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T18:19:58.358089] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-17T18:19:59.166844] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-17T18:19:59.186423] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T18:19:59.958101] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-17T18:20:00.153060] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T18:20:00.294962] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T18:20:00.758100] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-17T18:20:01.558022] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-17T18:20:01.831061] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-17T18:20:02.358050] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-17T18:20:02.691885] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T18:20:02.694030] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T18:20:03.158089] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-17T18:20:03.958145] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-17T18:20:04.750362] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T18:20:04.759795] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-17T18:20:04.848319] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-17T18:20:05.557992] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-17T18:20:05.859365] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T18:20:05.929766] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T18:20:06.358015] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-17T18:20:07.158026] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-17T18:20:07.252741] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-17T18:20:07.456092] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T18:20:07.958043] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-17T18:20:08.758010] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-17T18:20:08.913377] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T18:20:09.040103] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T18:20:09.558027] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-17T18:20:10.358071] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-17T18:20:10.540199] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T18:20:10.546491] [INFO ] [REMOTE ] CXW: Full fetch complete (64935 records). [2025-10-17T18:20:10.546681] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-17T18:20:10.937814] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-17T18:20:10.937930] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-17T18:20:10.938960] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-17T18:20:10.939140] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-17T18:20:10.941047] [DEBUG] [LOCAL ] CXW: Trimmed 64935 records to 44487 (keeping 200 days of data) [2025-10-17T18:20:11.161281] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-17T18:20:11.168993] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T18:20:11.224825] [DEBUG] [LOCAL ] CXW: Primary data saved (44487 records). [2025-10-17T18:20:11.225025] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-17T18:20:11.226096] [INFO ] [MAIN ] Update Progress: 581/2368 symbols completed. CXW took 45.2s. Estimated remaining: 4h 6m 26s. Rate: 7.3 symbols/min [2025-10-17T18:20:11.430476] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:20:11.432891] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T18:20:11.497629] [DEBUG] [LOCAL ] DAL: Loaded 54143 existing records from primary storage. [2025-10-17T18:20:11.497989] [INFO ] [MAIN ] DAL: Loaded 54143 existing records. [2025-10-17T18:20:11.671973] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:20:11.672191] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-17T18:20:11.672237] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-17T18:20:11.672580] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-17T18:20:11.672637] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-17T18:20:11.963217] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-17T18:20:12.031409] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:20:12.758014] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-17T18:20:12.833271] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T18:20:13.387510] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-17T18:20:13.558089] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-17T18:20:14.358008] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-17T18:20:14.837172] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-17T18:20:15.142492] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-17T18:20:15.157983] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-17T18:20:15.458457] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T18:20:15.958042] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-17T18:20:16.196746] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T18:20:16.199020] [INFO ] [REMOTE ] DAC: Full fetch complete (19307 records). [2025-10-17T18:20:16.199092] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-17T18:20:16.573207] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-17T18:20:16.573314] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-17T18:20:16.573796] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-17T18:20:16.573859] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-17T18:20:16.574447] [DEBUG] [LOCAL ] DAC: Trimmed 19307 records to 12751 (keeping 200 days of data) [2025-10-17T18:20:16.649489] [DEBUG] [LOCAL ] DAC: Primary data saved (12751 records). [2025-10-17T18:20:16.649622] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-17T18:20:16.649738] [INFO ] [MAIN ] Update Progress: 582/2368 symbols completed. DAC took 26.0s. Estimated remaining: 4h 6m 9s. Rate: 7.3 symbols/min [2025-10-17T18:20:16.763155] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-17T18:20:16.821517] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:20:16.821710] [DEBUG] [LOCAL ] DAN: No existing data file found in primary storage. [2025-10-17T18:20:16.821761] [WARN ] [MAIN ] DAN: No existing data found, performing full refresh instead. [2025-10-17T18:20:16.821868] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-17T18:20:16.821909] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-17T18:20:16.821950] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-17T18:20:16.821982] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-17T18:20:17.178255] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:20:17.558037] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-17T18:20:17.955804] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-17T18:20:18.318371] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T18:20:18.357990] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-17T18:20:19.158037] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-17T18:20:19.307818] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T18:20:19.747925] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T18:20:19.754358] [INFO ] [REMOTE ] CYH: Full fetch complete (69920 records). [2025-10-17T18:20:19.754464] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-17T18:20:19.963124] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-17T18:20:20.141569] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-17T18:20:20.141680] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-17T18:20:20.142599] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-17T18:20:20.142688] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-17T18:20:20.144018] [DEBUG] [LOCAL ] CYH: Trimmed 69920 records to 48440 (keeping 200 days of data) [2025-10-17T18:20:20.414980] [DEBUG] [LOCAL ] CYH: Primary data saved (48440 records). [2025-10-17T18:20:20.415125] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-17T18:20:20.415207] [INFO ] [MAIN ] Update Progress: 583/2368 symbols completed. CYH took 39.6s. Estimated remaining: 4h 5m 47s. Rate: 7.3 symbols/min [2025-10-17T18:20:20.585195] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:20:20.585388] [DEBUG] [LOCAL ] DAO: No existing data file found in primary storage. [2025-10-17T18:20:20.585426] [WARN ] [MAIN ] DAO: No existing data found, performing full refresh instead. [2025-10-17T18:20:20.585571] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-17T18:20:20.585665] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-17T18:20:20.585734] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-17T18:20:20.585771] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-17T18:20:20.758782] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-17T18:20:20.948476] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:20:21.307325] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-17T18:20:21.558045] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-17T18:20:21.790113] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T18:20:22.357996] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-17T18:20:22.610392] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T18:20:22.810112] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-17T18:20:23.158023] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-17T18:20:23.958005] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-17T18:20:24.281082] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T18:20:24.324580] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T18:20:24.758030] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-17T18:20:25.557997] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-17T18:20:25.586894] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T18:20:25.964373] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T18:20:26.358048] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-17T18:20:27.158025] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-17T18:20:27.754176] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-17T18:20:27.838765] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T18:20:27.958028] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-17T18:20:28.630317] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T18:20:28.758036] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-17T18:20:29.299523] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T18:20:29.563558] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-17T18:20:29.576291] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T18:20:29.584058] [INFO ] [REMOTE ] D: Full fetch complete (77423 records). [2025-10-17T18:20:29.584219] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-17T18:20:29.585095] [FATAL] [VALIDATOR ] D: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:20:29.585394] [FATAL] [MAIN ] D: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:20:29.585465] [WARN ] [MAIN ] D: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:20:29.585536] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-17T18:20:29.585603] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-17T18:20:29.585639] [INFO ] [LOCAL ] D: Starting deletion of derivative data. [2025-10-17T18:20:29.585878] [DEBUG] [LOCAL ] D: Deleted derivative data file. [2025-10-17T18:20:29.585973] [INFO ] [MAIN ] Update Progress: 584/2368 symbols completed. D took 39.3s. Estimated remaining: 4h 5m 41s. Rate: 7.3 symbols/min [2025-10-17T18:20:29.761986] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:20:29.812566] [DEBUG] [LOCAL ] DAR: Loaded 52380 existing records from primary storage. [2025-10-17T18:20:29.812953] [INFO ] [MAIN ] DAR: Loaded 52380 existing records. [2025-10-17T18:20:30.000271] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:20:30.000690] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-17T18:20:30.000750] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-17T18:20:30.001129] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-17T18:20:30.001188] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-17T18:20:30.347838] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:20:30.358000] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-17T18:20:31.158027] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-17T18:20:31.195130] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T18:20:31.958009] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-17T18:20:32.073972] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-17T18:20:32.758060] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-17T18:20:33.464610] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-17T18:20:33.567101] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-17T18:20:33.573024] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T18:20:34.358036] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-17T18:20:34.548395] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T18:20:35.158069] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-17T18:20:35.697904] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T18:20:35.958000] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-17T18:20:36.431343] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-10-17T18:20:36.758050] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-17T18:20:36.819145] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T18:20:37.030281] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-17T18:20:37.558085] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-17T18:20:38.358036] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-17T18:20:38.469175] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-17T18:20:38.501075] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T18:20:39.158044] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-17T18:20:39.958090] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-17T18:20:40.122535] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T18:20:40.758050] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-17T18:20:40.911073] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T18:20:41.558029] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-17T18:20:41.820616] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T18:20:42.286016] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-17T18:20:42.357990] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-17T18:20:43.163197] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-17T18:20:43.180046] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T18:20:43.958050] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-17T18:20:44.480353] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-17T18:20:44.758032] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-17T18:20:45.023633] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T18:20:45.558013] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-17T18:20:45.810767] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T18:20:45.817938] [INFO ] [REMOTE ] DAN: Full fetch complete (71277 records). [2025-10-17T18:20:45.818047] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-17T18:20:46.198748] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-17T18:20:46.198830] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-17T18:20:46.199681] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-17T18:20:46.199747] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-17T18:20:46.201062] [DEBUG] [LOCAL ] DAN: Trimmed 71277 records to 50069 (keeping 200 days of data) [2025-10-17T18:20:46.371227] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-17T18:20:46.499273] [DEBUG] [LOCAL ] DAN: Primary data saved (50069 records). [2025-10-17T18:20:46.499416] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-17T18:20:46.499493] [INFO ] [MAIN ] Update Progress: 585/2368 symbols completed. DAN took 29.8s. Estimated remaining: 4h 5m 60s. Rate: 7.2 symbols/min [2025-10-17T18:20:46.673137] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:20:46.673360] [DEBUG] [LOCAL ] DAVA: No existing data file found in primary storage. [2025-10-17T18:20:46.673406] [WARN ] [MAIN ] DAVA: No existing data found, performing full refresh instead. [2025-10-17T18:20:46.673517] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-17T18:20:46.673560] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-17T18:20:46.673602] [DEBUG] [LOCAL ] DAVA: No primary data file found to delete. [2025-10-17T18:20:46.673635] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-17T18:20:47.040858] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:20:47.158596] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-17T18:20:47.164993] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-17T18:20:47.273216] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T18:20:47.599082] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-17T18:20:47.958107] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-17T18:20:48.431071] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T18:20:48.758040] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-17T18:20:49.558021] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-17T18:20:49.690880] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T18:20:49.787264] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-17T18:20:50.358067] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-17T18:20:50.841600] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T18:20:51.158076] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-17T18:20:51.958031] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-17T18:20:52.103164] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T18:20:52.758034] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-17T18:20:53.042434] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T18:20:53.045380] [INFO ] [REMOTE ] DAO: Full fetch complete (32412 records). [2025-10-17T18:20:53.045457] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-17T18:20:53.422020] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-17T18:20:53.422203] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-17T18:20:53.422816] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-17T18:20:53.422897] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-17T18:20:53.423787] [DEBUG] [LOCAL ] DAO: Trimmed 32412 records to 20206 (keeping 200 days of data) [2025-10-17T18:20:53.534265] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-17T18:20:53.558044] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-17T18:20:53.575914] [DEBUG] [LOCAL ] DAO: Primary data saved (20206 records). [2025-10-17T18:20:53.576046] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-17T18:20:53.576118] [INFO ] [MAIN ] Update Progress: 586/2368 symbols completed. DAO took 33.2s. Estimated remaining: 4h 5m 48s. Rate: 7.2 symbols/min [2025-10-17T18:20:53.744596] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:20:53.744784] [DEBUG] [LOCAL ] DAY: No existing data file found in primary storage. [2025-10-17T18:20:53.744826] [WARN ] [MAIN ] DAY: No existing data found, performing full refresh instead. [2025-10-17T18:20:53.744935] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-17T18:20:53.744975] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-17T18:20:53.745016] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-17T18:20:53.745049] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-17T18:20:54.105410] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:20:54.124129] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T18:20:54.358037] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-17T18:20:54.467619] [DEBUG] [REMOTE ] DAY: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-17T18:20:54.467921] [WARN ] [REMOTE ] DAY: No data returned for month 2024-12 [2025-10-17T18:20:54.468010] [FATAL] [REMOTE ] DAY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:20:54.468074] [FATAL] [MAIN ] DAY: Failed to fetch primary data. [2025-10-17T18:20:54.468137] [WARN ] [MAIN ] DAY: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:20:54.468213] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-17T18:20:54.468276] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-17T18:20:54.468313] [INFO ] [LOCAL ] DAY: Starting deletion of derivative data. [2025-10-17T18:20:54.468352] [DEBUG] [LOCAL ] DAY: No derivative data file found to delete. [2025-10-17T18:20:54.468398] [INFO ] [MAIN ] Update Progress: 587/2368 symbols completed. DAY took 0.9s. Estimated remaining: 4h 5m 17s. Rate: 7.3 symbols/min [2025-10-17T18:20:54.643970] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:20:54.699393] [DEBUG] [LOCAL ] DB: Loaded 52892 existing records from primary storage. [2025-10-17T18:20:54.699777] [INFO ] [MAIN ] DB: Loaded 52892 existing records. [2025-10-17T18:20:54.909759] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:20:54.909989] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-17T18:20:54.910040] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-17T18:20:54.910323] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-17T18:20:54.910383] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-17T18:20:55.166547] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-17T18:20:55.438879] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:20:55.691580] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-17T18:20:55.958069] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-17T18:20:56.663153] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T18:20:56.758046] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-17T18:20:57.558045] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-17T18:20:58.317915] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-17T18:20:58.325452] [INFO ] [REMOTE ] DAL: Full fetch complete (77931 records). [2025-10-17T18:20:58.325598] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-17T18:20:58.371334] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-17T18:20:58.758477] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-17T18:20:58.758675] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-17T18:20:58.760214] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-17T18:20:58.760614] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-17T18:20:58.762846] [DEBUG] [LOCAL ] DAL: Trimmed 77931 records to 54533 (keeping 200 days of data) [2025-10-17T18:20:58.895405] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T18:20:58.944567] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-17T18:20:59.175618] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-17T18:20:59.203562] [DEBUG] [LOCAL ] DAL: Primary data saved (54533 records). [2025-10-17T18:20:59.203716] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-17T18:20:59.203807] [INFO ] [MAIN ] Update Progress: 588/2368 symbols completed. DAL took 48.0s. Estimated remaining: 4h 4m 58s. Rate: 7.3 symbols/min [2025-10-17T18:20:59.372304] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:20:59.372479] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-17T18:20:59.372541] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-17T18:20:59.372693] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-17T18:20:59.372747] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-17T18:20:59.372794] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-17T18:20:59.372905] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-17T18:20:59.756320] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:20:59.880719] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T18:20:59.958068] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-17T18:21:00.758027] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-17T18:21:00.866756] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T18:21:01.558068] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-17T18:21:01.996611] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-17T18:21:02.358075] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-17T18:21:02.515744] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T18:21:03.158067] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-17T18:21:03.402573] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T18:21:03.506173] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-17T18:21:03.514265] [INFO ] [REMOTE ] DAR: Full fetch complete (74965 records). [2025-10-17T18:21:03.514445] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-17T18:21:03.918546] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-17T18:21:03.918635] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-17T18:21:03.919578] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-17T18:21:03.919627] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-17T18:21:03.921157] [DEBUG] [LOCAL ] DAR: Trimmed 74965 records to 52762 (keeping 200 days of data) [2025-10-17T18:21:03.971490] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-17T18:21:04.255341] [DEBUG] [LOCAL ] DAR: Primary data saved (52762 records). [2025-10-17T18:21:04.255487] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-17T18:21:04.255607] [INFO ] [MAIN ] Update Progress: 589/2368 symbols completed. DAR took 34.7s. Estimated remaining: 4h 4m 40s. Rate: 7.3 symbols/min [2025-10-17T18:21:04.423703] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:21:04.471517] [DEBUG] [LOCAL ] DBI: Loaded 44191 existing records from primary storage. [2025-10-17T18:21:04.471833] [INFO ] [MAIN ] DBI: Loaded 44191 existing records. [2025-10-17T18:21:04.684107] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:21:04.684505] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-17T18:21:04.684601] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-17T18:21:04.685150] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-17T18:21:04.685227] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-17T18:21:04.764271] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-17T18:21:04.823956] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T18:21:05.016090] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T18:21:05.095079] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:21:05.558055] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-17T18:21:06.358000] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-17T18:21:06.515978] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T18:21:07.005913] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-17T18:21:07.098102] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T18:21:07.157987] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-17T18:21:07.958030] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-17T18:21:08.758007] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-17T18:21:08.925089] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T18:21:09.558023] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-17T18:21:09.733777] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-17T18:21:09.781985] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T18:21:10.358040] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-17T18:21:11.157997] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-17T18:21:11.478011] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T18:21:11.501760] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T18:21:11.958035] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-17T18:21:12.758033] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-17T18:21:13.113826] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T18:21:13.558004] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-17T18:21:13.828445] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-17T18:21:13.920552] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-17T18:21:14.358040] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-17T18:21:15.158007] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-17T18:21:15.431266] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T18:21:15.951798] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T18:21:15.962965] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-17T18:21:16.757992] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-17T18:21:17.017389] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-17T18:21:17.024334] [INFO ] [REMOTE ] DAVA: Full fetch complete (57037 records). [2025-10-17T18:21:17.024459] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-17T18:21:17.231704] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T18:21:17.434937] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-17T18:21:17.435015] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-17T18:21:17.435802] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-17T18:21:17.435865] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-17T18:21:17.437165] [DEBUG] [LOCAL ] DAVA: Trimmed 57037 records to 42431 (keeping 200 days of data) [2025-10-17T18:21:17.598552] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-17T18:21:17.680453] [DEBUG] [LOCAL ] DAVA: Primary data saved (42431 records). [2025-10-17T18:21:17.680572] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-17T18:21:17.680661] [INFO ] [MAIN ] Update Progress: 590/2368 symbols completed. DAVA took 31.2s. Estimated remaining: 4h 4m 47s. Rate: 7.3 symbols/min [2025-10-17T18:21:17.847585] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:21:17.859218] [DEBUG] [LOCAL ] DBL: Loaded 9490 existing records from primary storage. [2025-10-17T18:21:17.859425] [INFO ] [MAIN ] DBL: Loaded 9490 existing records. [2025-10-17T18:21:18.042457] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:21:18.042809] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-17T18:21:18.042864] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-17T18:21:18.043004] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-17T18:21:18.043041] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-17T18:21:18.359573] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-17T18:21:18.368483] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T18:21:18.462168] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:21:19.158055] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-17T18:21:19.319584] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-17T18:21:19.493698] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T18:21:19.958025] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-17T18:21:19.977607] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-17T18:21:20.758067] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-17T18:21:21.558006] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-17T18:21:21.920256] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T18:21:22.036762] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-17T18:21:22.177306] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T18:21:22.358042] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-17T18:21:23.096945] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-17T18:21:23.158020] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-17T18:21:23.792889] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-17T18:21:23.958036] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-17T18:21:24.699450] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-17T18:21:24.758043] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-17T18:21:25.475460] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T18:21:25.558023] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-17T18:21:26.311972] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-17T18:21:26.358023] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-17T18:21:27.158030] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-17T18:21:27.256461] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-17T18:21:27.958036] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-17T18:21:28.758072] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-17T18:21:28.922112] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T18:21:29.500676] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T18:21:29.558041] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-17T18:21:29.600055] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-17T18:21:30.358039] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-17T18:21:31.158049] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-17T18:21:31.349901] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T18:21:31.473488] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T18:21:31.958005] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-17T18:21:32.177308] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T18:21:32.758116] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-17T18:21:33.558004] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-17T18:21:33.922339] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-17T18:21:33.929734] [INFO ] [REMOTE ] DB: Full fetch complete (75485 records). [2025-10-17T18:21:33.929864] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-17T18:21:34.331220] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-17T18:21:34.331318] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-17T18:21:34.332210] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-17T18:21:34.332276] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-17T18:21:34.333794] [DEBUG] [LOCAL ] DB: Trimmed 75485 records to 53281 (keeping 200 days of data) [2025-10-17T18:21:34.389426] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-17T18:21:34.577779] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T18:21:34.703075] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T18:21:34.711583] [INFO ] [REMOTE ] DBD: Full fetch complete (31597 records). [2025-10-17T18:21:34.711809] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-17T18:21:34.713510] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:21:34.717669] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:21:34.717747] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:21:34.717793] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-17T18:21:34.717851] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-17T18:21:34.717888] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-17T18:21:34.717926] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-17T18:21:34.718008] [INFO ] [MAIN ] Update Progress: 591/2368 symbols completed. DBD took 35.5s. Estimated remaining: 4h 5m 5s. Rate: 7.3 symbols/min [2025-10-17T18:21:34.723415] [DEBUG] [LOCAL ] DB: Primary data saved (53281 records). [2025-10-17T18:21:34.729989] [INFO ] [MAIN ] DB: Full history saved. [2025-10-17T18:21:34.739623] [INFO ] [MAIN ] Update Progress: 592/2368 symbols completed. DB took 40.3s. Estimated remaining: 4h 4m 32s. Rate: 7.3 symbols/min [2025-10-17T18:21:35.055155] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:21:35.074176] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:21:35.074499] [DEBUG] [LOCAL ] DBRG: No existing data file found in primary storage. [2025-10-17T18:21:35.074636] [WARN ] [MAIN ] DBRG: No existing data found, performing full refresh instead. [2025-10-17T18:21:35.074773] [DEBUG] [LOCAL ] DCI: No existing data file found in primary storage. [2025-10-17T18:21:35.075013] [WARN ] [MAIN ] DCI: No existing data found, performing full refresh instead. [2025-10-17T18:21:35.074944] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-17T18:21:35.075214] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-17T18:21:35.075303] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-17T18:21:35.075492] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-17T18:21:35.075422] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-17T18:21:35.075708] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-10-17T18:21:35.075612] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-17T18:21:35.107210] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-17T18:21:35.161727] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-17T18:21:35.295972] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-17T18:21:35.368918] [INFO ] [REMOTE ] DBL: Full fetch complete (12655 records). [2025-10-17T18:21:35.382986] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-17T18:21:35.450541] [FATAL] [VALIDATOR ] DBL: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:21:35.492387] [FATAL] [MAIN ] DBL: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:21:35.512740] [WARN ] [MAIN ] DBL: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:21:35.548521] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-17T18:21:35.580263] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-17T18:21:35.586822] [INFO ] [LOCAL ] DBL: Starting deletion of derivative data. [2025-10-17T18:21:35.669349] [DEBUG] [LOCAL ] DBL: Deleted derivative data file. [2025-10-17T18:21:35.669612] [INFO ] [MAIN ] Update Progress: 593/2368 symbols completed. DBL took 18.0s. Estimated remaining: 4h 4m 2s. Rate: 7.3 symbols/min [2025-10-17T18:21:35.873579] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:21:35.926554] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:21:35.963097] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-17T18:21:36.028138] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:21:36.028284] [DEBUG] [LOCAL ] DCO: No existing data file found in primary storage. [2025-10-17T18:21:36.028323] [WARN ] [MAIN ] DCO: No existing data found, performing full refresh instead. [2025-10-17T18:21:36.028435] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-17T18:21:36.028477] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-17T18:21:36.028519] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-17T18:21:36.028553] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-17T18:21:36.380178] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:21:36.758004] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-17T18:21:37.053625] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T18:21:37.558004] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-17T18:21:37.852800] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T18:21:37.901097] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T18:21:38.358086] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-17T18:21:39.158034] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-17T18:21:39.226775] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T18:21:39.229432] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T18:21:39.958090] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-17T18:21:40.739566] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T18:21:40.761150] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-17T18:21:41.546283] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T18:21:41.557999] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-17T18:21:42.180490] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T18:21:42.358015] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-17T18:21:42.446920] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T18:21:43.158101] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-17T18:21:43.923215] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-17T18:21:43.955881] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:21:43.965299] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-17T18:21:44.758044] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-17T18:21:45.455724] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T18:21:45.558015] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-17T18:21:46.306882] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T18:21:46.357990] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-17T18:21:47.160304] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-17T18:21:47.163090] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T18:21:47.957998] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-17T18:21:48.075447] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T18:21:48.092916] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-17T18:21:48.758072] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-17T18:21:49.440566] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T18:21:49.446004] [INFO ] [REMOTE ] DBI: Full fetch complete (65041 records). [2025-10-17T18:21:49.446112] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-17T18:21:49.563184] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-17T18:21:49.836520] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-17T18:21:49.836593] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-17T18:21:49.837534] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-17T18:21:49.837600] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-17T18:21:49.838997] [DEBUG] [LOCAL ] DBI: Trimmed 65041 records to 44390 (keeping 200 days of data) [2025-10-17T18:21:50.092302] [DEBUG] [LOCAL ] DBI: Primary data saved (44390 records). [2025-10-17T18:21:50.092429] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-17T18:21:50.092506] [INFO ] [MAIN ] Update Progress: 594/2368 symbols completed. DBI took 45.8s. Estimated remaining: 4h 4m 12s. Rate: 7.3 symbols/min [2025-10-17T18:21:50.270422] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:21:50.323136] [DEBUG] [LOCAL ] DD: Loaded 53314 existing records from primary storage. [2025-10-17T18:21:50.323445] [INFO ] [MAIN ] DD: Loaded 53314 existing records. [2025-10-17T18:21:50.359534] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-17T18:21:50.525369] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:21:50.545555] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-17T18:21:50.545800] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-17T18:21:50.546521] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-17T18:21:50.549980] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-17T18:21:50.552620] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-17T18:21:50.552548] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T18:21:50.913566] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:21:51.158021] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-17T18:21:51.891140] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T18:21:51.958069] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-17T18:21:52.758031] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-17T18:21:52.955988] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T18:21:53.558037] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-17T18:21:53.653197] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T18:21:53.689436] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T18:21:54.358031] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-17T18:21:54.714078] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T18:21:55.158014] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-17T18:21:55.397312] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T18:21:55.958033] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-17T18:21:56.758017] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-17T18:21:56.898187] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T18:21:56.930378] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T18:21:57.558033] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-17T18:21:58.358084] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-17T18:21:58.601378] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-17T18:21:58.638662] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T18:21:59.158055] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-17T18:21:59.858862] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T18:21:59.958033] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-17T18:22:00.758083] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-17T18:22:00.916396] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T18:22:01.558024] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-17T18:22:01.686812] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T18:22:02.186931] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T18:22:02.358026] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-17T18:22:03.158053] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-17T18:22:03.295856] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T18:22:03.828613] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T18:22:03.958107] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-17T18:22:04.178944] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T18:22:04.183428] [INFO ] [REMOTE ] DCO: Full fetch complete (19641 records). [2025-10-17T18:22:04.183566] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-17T18:22:04.623884] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-17T18:22:04.623974] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-17T18:22:04.624465] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-17T18:22:04.624515] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-17T18:22:04.625370] [DEBUG] [LOCAL ] DCO: Trimmed 19641 records to 14832 (keeping 200 days of data) [2025-10-17T18:22:04.716670] [DEBUG] [LOCAL ] DCO: Primary data saved (14832 records). [2025-10-17T18:22:04.716827] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-17T18:22:04.716905] [INFO ] [MAIN ] Update Progress: 595/2368 symbols completed. DCO took 29.0s. Estimated remaining: 4h 4m 23s. Rate: 7.3 symbols/min [2025-10-17T18:22:04.764219] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-17T18:22:04.916865] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:22:04.917036] [DEBUG] [LOCAL ] DDD: No existing data file found in primary storage. [2025-10-17T18:22:04.917097] [WARN ] [MAIN ] DDD: No existing data found, performing full refresh instead. [2025-10-17T18:22:04.917249] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-17T18:22:04.917316] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-17T18:22:04.917382] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-10-17T18:22:04.917477] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-17T18:22:05.262403] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:22:05.558013] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-17T18:22:05.914870] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-17T18:22:06.358027] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-17T18:22:06.509456] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T18:22:07.158051] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-17T18:22:07.440431] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T18:22:07.958017] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-17T18:22:08.141384] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T18:22:08.757997] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-17T18:22:09.022923] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-17T18:22:09.032173] [INFO ] [REMOTE ] DBRG: Full fetch complete (72498 records). [2025-10-17T18:22:09.032335] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-17T18:22:09.417690] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-17T18:22:09.417783] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-17T18:22:09.418682] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-17T18:22:09.418750] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-17T18:22:09.420201] [DEBUG] [LOCAL ] DBRG: Trimmed 72498 records to 50682 (keeping 200 days of data) [2025-10-17T18:22:09.594724] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-17T18:22:09.757621] [DEBUG] [LOCAL ] DBRG: Primary data saved (50682 records). [2025-10-17T18:22:09.757937] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-17T18:22:09.758608] [INFO ] [MAIN ] Update Progress: 596/2368 symbols completed. DBRG took 35.0s. Estimated remaining: 4h 4m 5s. Rate: 7.3 symbols/min [2025-10-17T18:22:09.759677] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T18:22:09.952205] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:22:09.988980] [DEBUG] [LOCAL ] DDL: Loaded 37285 existing records from primary storage. [2025-10-17T18:22:09.989286] [INFO ] [MAIN ] DDL: Loaded 37285 existing records. [2025-10-17T18:22:10.174033] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:22:10.174299] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-17T18:22:10.174347] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-17T18:22:10.174675] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-17T18:22:10.174741] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-17T18:22:10.374318] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-17T18:22:10.535747] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:22:10.733501] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-17T18:22:11.158046] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-17T18:22:11.312206] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T18:22:11.957999] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-17T18:22:12.226754] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T18:22:12.758046] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-17T18:22:13.107205] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T18:22:13.558043] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-17T18:22:13.685860] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T18:22:14.358101] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-17T18:22:14.566959] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T18:22:14.703193] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T18:22:15.158075] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-17T18:22:15.894355] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T18:22:15.958049] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-17T18:22:16.585478] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T18:22:16.590460] [INFO ] [REMOTE ] DCI: Full fetch complete (53643 records). [2025-10-17T18:22:16.590588] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-17T18:22:16.763678] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-17T18:22:16.971278] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-17T18:22:16.971360] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-17T18:22:16.972126] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-17T18:22:16.972191] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-17T18:22:16.973378] [DEBUG] [LOCAL ] DCI: Trimmed 53643 records to 37560 (keeping 200 days of data) [2025-10-17T18:22:17.194297] [DEBUG] [LOCAL ] DCI: Primary data saved (37560 records). [2025-10-17T18:22:17.194437] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-17T18:22:17.194519] [INFO ] [MAIN ] Update Progress: 597/2368 symbols completed. DCI took 42.4s. Estimated remaining: 4h 3m 55s. Rate: 7.3 symbols/min [2025-10-17T18:22:17.558067] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-17T18:22:17.825251] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:22:17.899550] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T18:22:18.358068] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-17T18:22:19.158057] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-17T18:22:19.340503] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T18:22:19.529375] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T18:22:19.958061] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-17T18:22:20.767686] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-17T18:22:20.773543] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T18:22:20.976779] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T18:22:21.558039] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-17T18:22:22.358087] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-17T18:22:22.624695] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T18:22:23.158054] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-17T18:22:23.194064] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T18:22:23.965031] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-17T18:22:23.985795] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T18:22:24.758026] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-17T18:22:25.048460] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T18:22:25.528295] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T18:22:25.558000] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-17T18:22:26.358075] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-17T18:22:26.559876] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T18:22:26.764438] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T18:22:27.158063] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-17T18:22:27.958033] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-17T18:22:28.278889] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T18:22:28.286838] [INFO ] [REMOTE ] DD: Full fetch complete (76598 records). [2025-10-17T18:22:28.287011] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-17T18:22:28.685982] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-17T18:22:28.686081] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-17T18:22:28.687106] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-17T18:22:28.687177] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-17T18:22:28.688744] [DEBUG] [LOCAL ] DD: Trimmed 76598 records to 53704 (keeping 200 days of data) [2025-10-17T18:22:29.024685] [DEBUG] [LOCAL ] DD: Primary data saved (53704 records). [2025-10-17T18:22:29.024832] [INFO ] [MAIN ] DD: Full history saved. [2025-10-17T18:22:29.025554] [INFO ] [MAIN ] Update Progress: 598/2368 symbols completed. DD took 38.9s. Estimated remaining: 4h 3m 57s. Rate: 7.3 symbols/min [2025-10-17T18:22:29.164554] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-17T18:22:29.176051] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-17T18:22:29.265171] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T18:22:29.558035] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-17T18:22:30.835685] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T18:22:30.842174] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-17T18:22:31.097596] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T18:22:31.157980] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-17T18:22:32.389777] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T18:22:32.403369] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-17T18:22:33.255730] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-17T18:22:33.263777] [INFO ] [REMOTE ] DDD: Full fetch complete (73941 records). [2025-10-17T18:22:33.263998] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-17T18:22:33.675219] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-17T18:22:33.675375] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-17T18:22:33.676766] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-17T18:22:33.676834] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-17T18:22:33.678966] [DEBUG] [LOCAL ] DDD: Trimmed 73941 records to 51691 (keeping 200 days of data) [2025-10-17T18:22:33.984140] [DEBUG] [LOCAL ] DDD: Primary data saved (51691 records). [2025-10-17T18:22:33.984399] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-17T18:22:33.984513] [INFO ] [MAIN ] Update Progress: 599/2368 symbols completed. DDD took 29.3s. Estimated remaining: 4h 3m 39s. Rate: 7.3 symbols/min [2025-10-17T18:22:34.057461] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T18:22:34.063857] [INFO ] [REMOTE ] DDL: Full fetch complete (53596 records). [2025-10-17T18:22:34.063975] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-17T18:22:34.454777] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-17T18:22:34.454855] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-17T18:22:34.455542] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-17T18:22:34.455599] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-17T18:22:34.456812] [DEBUG] [LOCAL ] DDL: Trimmed 53596 records to 37618 (keeping 200 days of data) [2025-10-17T18:22:34.664394] [DEBUG] [LOCAL ] DDL: Primary data saved (37618 records). [2025-10-17T18:22:34.664553] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-17T18:22:34.664666] [INFO ] [MAIN ] Update Progress: 600/2368 symbols completed. DDL took 24.9s. Estimated remaining: 4h 3m 8s. Rate: 7.3 symbols/min [2025-10-17T18:22:35.348765] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:22:35.355740] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:22:35.342888] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:22:35.355933] [DEBUG] [LOCAL ] DEA: No existing data file found in primary storage. [2025-10-17T18:22:35.376483] [WARN ] [MAIN ] DEA: No existing data found, performing full refresh instead. [2025-10-17T18:22:35.376883] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-17T18:22:35.376944] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-17T18:22:35.377022] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-17T18:22:35.378258] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:22:35.378424] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-17T18:22:35.437807] [DEBUG] [LOCAL ] DDT: Loaded 2095 existing records from primary storage. [2025-10-17T18:22:35.444319] [INFO ] [MAIN ] DDT: Loaded 2095 existing records. [2025-10-17T18:22:35.530993] [DEBUG] [LOCAL ] DDS: Loaded 12801 existing records from primary storage. [2025-10-17T18:22:35.560222] [INFO ] [MAIN ] DDS: Loaded 12801 existing records. [2025-10-17T18:22:35.957394] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:22:35.998192] [DEBUG] [LOCAL ] DE: Loaded 48037 existing records from primary storage. [2025-10-17T18:22:36.008714] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-17T18:22:36.008849] [INFO ] [MAIN ] DE: Loaded 48037 existing records. [2025-10-17T18:22:36.042637] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-17T18:22:36.089115] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-17T18:22:36.094494] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:22:36.125841] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-17T18:22:36.125774] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-17T18:22:36.255515] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-17T18:22:36.375073] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-17T18:22:36.385672] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-17T18:22:36.457830] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:22:36.486595] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-17T18:22:36.560054] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:22:36.643511] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-17T18:22:36.708839] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-17T18:22:36.915216] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-17T18:22:36.952338] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-17T18:22:37.261216] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:22:37.286155] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:22:37.292574] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-17T18:22:37.298227] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-17T18:22:37.548925] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:22:37.549243] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-17T18:22:37.984895] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-17T18:22:37.986082] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-17T18:22:38.244875] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T18:22:38.248315] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-17T18:22:38.496410] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-17T18:22:38.497662] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-17T18:22:38.539280] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T18:22:38.549894] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-17T18:22:38.941230] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-17T18:22:39.058432] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T18:22:39.158047] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-17T18:22:39.559376] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T18:22:39.600308] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-17T18:22:39.911863] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T18:22:39.958051] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-17T18:22:40.672962] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-17T18:22:40.758101] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-17T18:22:41.558058] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-17T18:22:42.369157] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-17T18:22:42.374040] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:22:42.422348] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T18:22:42.662563] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-17T18:22:43.158028] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-17T18:22:43.958074] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-17T18:22:44.219372] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T18:22:44.430011] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-17T18:22:44.758111] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-17T18:22:45.558036] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-17T18:22:46.358079] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-17T18:22:46.408140] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T18:22:46.721996] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-17T18:22:46.994235] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T18:22:47.158095] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-17T18:22:47.958050] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-17T18:22:48.758038] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-17T18:22:48.985334] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T18:22:49.292735] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-17T18:22:49.558060] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-17T18:22:49.709385] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T18:22:50.358055] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-17T18:22:51.013631] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T18:22:51.157996] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-17T18:22:51.515239] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-17T18:22:51.958026] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-17T18:22:52.758058] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-17T18:22:53.558075] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-17T18:23:05.158249] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (12.40 seconds). [2025-10-17T18:23:05.162315] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-17T18:23:05.962773] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (14.80 seconds). [2025-10-17T18:23:05.963890] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-17T18:23:06.405852] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T18:23:06.409012] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-17T18:23:06.969034] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (15.01 seconds). [2025-10-17T18:23:06.977123] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-17T18:23:08.458819] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (14.90 seconds). [2025-10-17T18:23:08.469274] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-17T18:23:08.520803] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-17T18:23:08.521612] [INFO ] [REMOTE ] DDT: Full fetch complete (2821 records). [2025-10-17T18:23:08.521705] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-17T18:23:08.863708] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-17T18:23:08.908385] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-17T18:23:08.909345] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-17T18:23:08.909406] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-17T18:23:08.909512] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-17T18:23:08.909551] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-17T18:23:08.909931] [DEBUG] [LOCAL ] DDT: Trimmed 2821 records to 2106 (keeping 200 days of data) [2025-10-17T18:23:08.923464] [DEBUG] [LOCAL ] DDT: Primary data saved (2106 records). [2025-10-17T18:23:08.923541] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-17T18:23:08.923613] [INFO ] [MAIN ] Update Progress: 601/2368 symbols completed. DDT took 34.3s. Estimated remaining: 4h 4m 16s. Rate: 7.2 symbols/min [2025-10-17T18:23:09.099074] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:23:09.133933] [DEBUG] [LOCAL ] DEC: Loaded 30584 existing records from primary storage. [2025-10-17T18:23:09.134213] [INFO ] [MAIN ] DEC: Loaded 30584 existing records. [2025-10-17T18:23:09.328495] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:23:09.328757] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-17T18:23:09.328808] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-17T18:23:09.329111] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-17T18:23:09.329168] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-17T18:23:09.694073] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:23:09.694528] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-17T18:23:09.859861] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T18:23:09.863443] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-17T18:23:09.900288] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-17T18:23:09.909569] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-17T18:23:10.024089] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T18:23:10.034531] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-17T18:23:10.746384] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-17T18:23:10.749872] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-17T18:23:11.002674] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T18:23:11.011148] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-17T18:23:11.223270] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T18:23:11.228804] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-17T18:23:11.519523] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-17T18:23:11.521263] [INFO ] [REMOTE ] DDS: Full fetch complete (18621 records). [2025-10-17T18:23:11.521397] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-17T18:23:11.893204] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-17T18:23:11.893328] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-17T18:23:11.893820] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-17T18:23:11.893963] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-17T18:23:11.894550] [DEBUG] [LOCAL ] DDS: Trimmed 18621 records to 12846 (keeping 200 days of data) [2025-10-17T18:23:12.006495] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T18:23:12.008585] [DEBUG] [LOCAL ] DDS: Primary data saved (12846 records). [2025-10-17T18:23:12.008773] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-17T18:23:12.018381] [INFO ] [MAIN ] Update Progress: 602/2368 symbols completed. DDS took 37.4s. Estimated remaining: 4h 3m 53s. Rate: 7.2 symbols/min [2025-10-17T18:23:12.081205] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-17T18:23:12.187389] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:23:12.238999] [DEBUG] [LOCAL ] DECK: Loaded 53687 existing records from primary storage. [2025-10-17T18:23:12.239358] [INFO ] [MAIN ] DECK: Loaded 53687 existing records. [2025-10-17T18:23:12.424597] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:23:12.433544] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-17T18:23:12.434917] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-17T18:23:12.434836] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T18:23:12.440614] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-17T18:23:12.440714] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-17T18:23:12.441512] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-17T18:23:12.608629] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T18:23:12.693979] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-17T18:23:12.833849] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:23:12.834192] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-17T18:23:13.695140] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T18:23:13.704613] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-17T18:23:13.821893] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T18:23:13.828013] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-17T18:23:14.387485] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T18:23:14.393875] [INFO ] [REMOTE ] DEA: Full fetch complete (61959 records). [2025-10-17T18:23:14.394134] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-17T18:23:14.810947] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-17T18:23:14.811130] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-17T18:23:14.811928] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-17T18:23:14.821265] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-17T18:23:14.839386] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T18:23:14.850050] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-17T18:23:14.851254] [DEBUG] [LOCAL ] DEA: Trimmed 61959 records to 41023 (keeping 200 days of data) [2025-10-17T18:23:15.095400] [DEBUG] [LOCAL ] DEA: Primary data saved (41023 records). [2025-10-17T18:23:15.095808] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-17T18:23:15.095891] [INFO ] [MAIN ] Update Progress: 603/2368 symbols completed. DEA took 40.4s. Estimated remaining: 4h 3m 29s. Rate: 7.2 symbols/min [2025-10-17T18:23:15.274872] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:23:15.320161] [DEBUG] [LOCAL ] DEI: Loaded 48658 existing records from primary storage. [2025-10-17T18:23:15.320464] [INFO ] [MAIN ] DEI: Loaded 48658 existing records. [2025-10-17T18:23:15.506419] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:23:15.506869] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-17T18:23:15.507239] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-17T18:23:15.507935] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-17T18:23:15.507997] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-17T18:23:15.862842] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T18:23:15.919046] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:23:15.919902] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-17T18:23:15.920377] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-17T18:23:15.950821] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-17T18:23:15.962525] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-17T18:23:16.936172] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-17T18:23:16.947233] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-17T18:23:17.426770] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T18:23:17.433993] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-17T18:23:17.803873] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T18:23:17.813274] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-17T18:23:17.907563] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-17T18:23:17.921088] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-17T18:23:18.734870] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T18:23:18.748342] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T18:23:18.758920] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-17T18:23:18.760266] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-17T18:23:19.061144] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T18:23:19.070682] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-17T18:23:19.948822] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-17T18:23:19.960087] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-17T18:23:19.979389] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T18:23:19.987077] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-17T18:23:20.168470] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T18:23:20.177442] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-17T18:23:20.372864] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T18:23:20.758076] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-17T18:23:21.585244] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T18:23:21.592064] [INFO ] [REMOTE ] DE: Full fetch complete (69523 records). [2025-10-17T18:23:21.592191] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-17T18:23:21.593191] [FATAL] [VALIDATOR ] DE: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:23:21.593286] [FATAL] [MAIN ] DE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:23:21.593330] [WARN ] [MAIN ] DE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:23:21.593371] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-17T18:23:21.593461] [DEBUG] [LOCAL ] DE: No primary data file found to delete. [2025-10-17T18:23:21.593527] [INFO ] [LOCAL ] DE: Starting deletion of derivative data. [2025-10-17T18:23:21.593736] [DEBUG] [LOCAL ] DE: Deleted derivative data file. [2025-10-17T18:23:21.594531] [INFO ] [MAIN ] Update Progress: 604/2368 symbols completed. DE took 46.9s. Estimated remaining: 4h 3m 16s. Rate: 7.3 symbols/min [2025-10-17T18:23:21.721799] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T18:23:21.785336] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-17T18:23:21.835072] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:23:21.835352] [DEBUG] [LOCAL ] DELL: No existing data file found in primary storage. [2025-10-17T18:23:21.835420] [WARN ] [MAIN ] DELL: No existing data found, performing full refresh instead. [2025-10-17T18:23:21.835600] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-17T18:23:21.835709] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-17T18:23:21.835901] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-10-17T18:23:21.835953] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-17T18:23:22.052708] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T18:23:22.257877] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:23:22.358104] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-17T18:23:22.408361] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T18:23:23.070356] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T18:23:23.157992] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-17T18:23:23.958042] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-17T18:23:24.465241] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T18:23:24.732199] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-17T18:23:24.757981] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-17T18:23:25.558026] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-17T18:23:26.275560] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-17T18:23:26.358061] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-17T18:23:27.158005] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-17T18:23:27.211709] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-17T18:23:27.335596] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T18:23:27.958045] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-17T18:23:28.407521] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-17T18:23:28.692742] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T18:23:28.698011] [INFO ] [REMOTE ] DEC: Full fetch complete (44345 records). [2025-10-17T18:23:28.698146] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-17T18:23:28.763239] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-17T18:23:29.112733] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-17T18:23:29.112830] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-17T18:23:29.113541] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-17T18:23:29.113609] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-17T18:23:29.114992] [DEBUG] [LOCAL ] DEC: Trimmed 44345 records to 30778 (keeping 200 days of data) [2025-10-17T18:23:29.309404] [DEBUG] [LOCAL ] DEC: Primary data saved (30778 records). [2025-10-17T18:23:29.309542] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-17T18:23:29.309626] [INFO ] [MAIN ] Update Progress: 605/2368 symbols completed. DEC took 20.4s. Estimated remaining: 4h 3m 6s. Rate: 7.3 symbols/min [2025-10-17T18:23:29.485989] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:23:29.538875] [DEBUG] [LOCAL ] DEO: Loaded 49588 existing records from primary storage. [2025-10-17T18:23:29.539195] [INFO ] [MAIN ] DEO: Loaded 49588 existing records. [2025-10-17T18:23:29.571200] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-17T18:23:29.761136] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:23:29.774345] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-17T18:23:29.774411] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-17T18:23:29.774739] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-17T18:23:29.779238] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-17T18:23:29.850491] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T18:23:30.172708] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:23:30.358035] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-17T18:23:31.023199] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-17T18:23:31.158028] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-17T18:23:31.543306] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-17T18:23:31.958116] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-17T18:23:32.181738] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-17T18:23:32.758038] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-17T18:23:33.077815] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T18:23:33.558090] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-17T18:23:33.969885] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T18:23:34.358077] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-17T18:23:35.158051] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-17T18:23:35.346718] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-17T18:23:35.529465] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T18:23:35.963104] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-17T18:23:35.983334] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T18:23:36.758042] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-17T18:23:37.009175] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T18:23:37.558029] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-17T18:23:38.358102] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-17T18:23:38.899623] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-10-17T18:23:39.168746] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-17T18:23:39.172096] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-17T18:23:39.181166] [INFO ] [REMOTE ] DECK: Full fetch complete (77097 records). [2025-10-17T18:23:39.181408] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-17T18:23:39.609424] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-17T18:23:39.624954] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-17T18:23:39.636871] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-17T18:23:39.638032] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-17T18:23:39.638165] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-17T18:23:39.650408] [DEBUG] [LOCAL ] DECK: Trimmed 77097 records to 54077 (keeping 200 days of data) [2025-10-17T18:23:39.924554] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T18:23:39.967737] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-17T18:23:40.061888] [DEBUG] [LOCAL ] DECK: Primary data saved (54077 records). [2025-10-17T18:23:40.062049] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-17T18:23:40.062151] [INFO ] [MAIN ] Update Progress: 606/2368 symbols completed. DECK took 28.0s. Estimated remaining: 4h 3m 5s. Rate: 7.2 symbols/min [2025-10-17T18:23:40.229229] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:23:40.229399] [DEBUG] [LOCAL ] DFH: No existing data file found in primary storage. [2025-10-17T18:23:40.229435] [WARN ] [MAIN ] DFH: No existing data found, performing full refresh instead. [2025-10-17T18:23:40.229546] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-17T18:23:40.229586] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-17T18:23:40.229635] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-10-17T18:23:40.229738] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-17T18:23:40.592793] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:23:40.758040] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-17T18:23:41.226283] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-17T18:23:41.558042] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-17T18:23:41.796713] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T18:23:42.274592] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T18:23:42.358047] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-17T18:23:43.092349] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T18:23:43.158003] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-17T18:23:43.711618] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T18:23:43.958029] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-17T18:23:44.758010] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-17T18:23:44.902268] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T18:23:44.909834] [INFO ] [REMOTE ] DEI: Full fetch complete (69923 records). [2025-10-17T18:23:44.909991] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-17T18:23:45.330868] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-17T18:23:45.330950] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-17T18:23:45.331792] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-17T18:23:45.331853] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-17T18:23:45.333224] [DEBUG] [LOCAL ] DEI: Trimmed 69923 records to 49027 (keeping 200 days of data) [2025-10-17T18:23:45.562676] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-17T18:23:45.630401] [DEBUG] [LOCAL ] DEI: Primary data saved (49027 records). [2025-10-17T18:23:45.630536] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-17T18:23:45.630686] [INFO ] [MAIN ] Update Progress: 607/2368 symbols completed. DEI took 30.5s. Estimated remaining: 4h 2m 49s. Rate: 7.3 symbols/min [2025-10-17T18:23:45.803133] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:23:45.824915] [DEBUG] [LOCAL ] DFIN: Loaded 22789 existing records from primary storage. [2025-10-17T18:23:45.825240] [INFO ] [MAIN ] DFIN: Loaded 22789 existing records. [2025-10-17T18:23:46.005151] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:23:46.005408] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-17T18:23:46.005582] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-17T18:23:46.005876] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-17T18:23:46.005946] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-17T18:23:46.133795] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-17T18:23:46.365315] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-17T18:23:46.396363] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:23:46.976685] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T18:23:47.038718] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-17T18:23:47.157991] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-17T18:23:47.958010] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-17T18:23:48.185124] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T18:23:48.391252] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-17T18:23:48.758117] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-17T18:23:49.558036] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-17T18:23:50.355058] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-17T18:23:50.366719] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-17T18:23:50.413020] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T18:23:50.618771] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T18:23:51.158038] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-17T18:23:51.824574] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T18:23:51.958003] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-17T18:23:52.758054] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-17T18:23:53.371049] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-17T18:23:53.525324] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T18:23:53.557984] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-17T18:23:53.825865] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T18:23:54.358034] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-17T18:23:54.894404] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T18:23:55.158049] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-17T18:23:55.958079] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-17T18:23:56.484560] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T18:23:56.605315] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-17T18:23:56.758062] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-17T18:23:57.558088] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-17T18:23:58.039088] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-17T18:23:58.083529] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-17T18:23:58.358036] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-17T18:23:59.158025] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-17T18:23:59.868086] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-17T18:23:59.957997] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-17T18:24:00.143407] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.59 seconds). [2025-10-17T18:24:00.151010] [INFO ] [REMOTE ] DELL: Full fetch complete (77915 records). [2025-10-17T18:24:00.151200] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-17T18:24:00.536474] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-17T18:24:00.536555] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-17T18:24:00.537574] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-17T18:24:00.537663] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-17T18:24:00.539231] [DEBUG] [LOCAL ] DELL: Trimmed 77915 records to 54516 (keeping 200 days of data) [2025-10-17T18:24:00.758003] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-17T18:24:00.887378] [DEBUG] [LOCAL ] DELL: Primary data saved (54516 records). [2025-10-17T18:24:00.887536] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-17T18:24:00.887612] [INFO ] [MAIN ] Update Progress: 608/2368 symbols completed. DELL took 39.3s. Estimated remaining: 4h 3m 1s. Rate: 7.2 symbols/min [2025-10-17T18:24:01.059995] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:24:01.093831] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T18:24:01.113052] [DEBUG] [LOCAL ] DFP: Loaded 11238 existing records from primary storage. [2025-10-17T18:24:01.113329] [INFO ] [MAIN ] DFP: Loaded 11238 existing records. [2025-10-17T18:24:01.296838] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:24:01.297234] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-17T18:24:01.297298] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-17T18:24:01.303487] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-17T18:24:01.303594] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-17T18:24:01.392694] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T18:24:01.566387] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-17T18:24:01.689119] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:24:02.102549] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T18:24:02.358053] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-17T18:24:03.141470] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-17T18:24:03.157999] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-17T18:24:03.542719] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T18:24:03.911434] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T18:24:03.957996] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-17T18:24:04.721585] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T18:24:04.758023] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-17T18:24:05.558009] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-17T18:24:05.642058] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-17T18:24:06.358019] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-17T18:24:06.596316] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T18:24:07.158093] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-17T18:24:07.958029] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-17T18:24:08.185383] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T18:24:08.468775] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-17T18:24:08.475812] [INFO ] [REMOTE ] DEO: Full fetch complete (71731 records). [2025-10-17T18:24:08.475929] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-17T18:24:08.763123] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-17T18:24:08.871193] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-17T18:24:08.871296] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-17T18:24:08.872192] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-17T18:24:08.872259] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-17T18:24:08.873710] [DEBUG] [LOCAL ] DEO: Trimmed 71731 records to 49969 (keeping 200 days of data) [2025-10-17T18:24:09.179338] [DEBUG] [LOCAL ] DEO: Primary data saved (49969 records). [2025-10-17T18:24:09.179476] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-17T18:24:09.180284] [INFO ] [MAIN ] Update Progress: 609/2368 symbols completed. DEO took 39.9s. Estimated remaining: 4h 2m 52s. Rate: 7.2 symbols/min [2025-10-17T18:24:09.378539] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:24:09.380183] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T18:24:09.444669] [DEBUG] [LOCAL ] DG: Loaded 53667 existing records from primary storage. [2025-10-17T18:24:09.445022] [INFO ] [MAIN ] DG: Loaded 53667 existing records. [2025-10-17T18:24:09.563135] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-17T18:24:09.630772] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:24:09.631209] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-17T18:24:09.631267] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-17T18:24:09.631766] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-17T18:24:09.631826] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-17T18:24:10.010615] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:24:10.013065] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T18:24:10.358096] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-17T18:24:10.812066] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T18:24:10.816447] [INFO ] [REMOTE ] DFH: Full fetch complete (47828 records). [2025-10-17T18:24:10.816542] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-17T18:24:11.158054] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-17T18:24:11.192311] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-17T18:24:11.192438] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-17T18:24:11.193222] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-17T18:24:11.193469] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-17T18:24:11.200394] [DEBUG] [LOCAL ] DFH: Trimmed 47828 records to 32567 (keeping 200 days of data) [2025-10-17T18:24:11.208070] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-17T18:24:11.400582] [DEBUG] [LOCAL ] DFH: Primary data saved (32567 records). [2025-10-17T18:24:11.400805] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-17T18:24:11.400892] [INFO ] [MAIN ] Update Progress: 610/2368 symbols completed. DFH took 31.3s. Estimated remaining: 4h 2m 27s. Rate: 7.3 symbols/min [2025-10-17T18:24:11.573238] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:24:11.616243] [DEBUG] [LOCAL ] DGX: Loaded 44978 existing records from primary storage. [2025-10-17T18:24:11.616562] [INFO ] [MAIN ] DGX: Loaded 44978 existing records. [2025-10-17T18:24:11.792816] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:24:11.793017] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-17T18:24:11.793063] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-17T18:24:11.793392] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-17T18:24:11.793430] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-17T18:24:11.963311] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-17T18:24:12.146262] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:24:12.758039] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-17T18:24:12.965787] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-17T18:24:13.209735] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T18:24:13.558054] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-17T18:24:13.815582] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T18:24:14.358045] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-17T18:24:15.158051] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-17T18:24:15.167112] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T18:24:15.522415] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T18:24:15.958043] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-17T18:24:16.758067] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-17T18:24:17.130274] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T18:24:17.543685] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T18:24:17.557992] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-17T18:24:17.944584] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-17T18:24:18.358087] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-17T18:24:19.146586] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T18:24:19.157991] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-17T18:24:19.186227] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T18:24:19.958060] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-17T18:24:20.759734] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-17T18:24:20.763966] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T18:24:20.805812] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T18:24:21.558030] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-17T18:24:22.358031] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-17T18:24:22.823079] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T18:24:22.850826] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T18:24:22.854096] [INFO ] [REMOTE ] DFIN: Full fetch complete (33342 records). [2025-10-17T18:24:22.854197] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-17T18:24:23.163131] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-17T18:24:23.230984] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-17T18:24:23.231067] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-17T18:24:23.231626] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-17T18:24:23.231704] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-17T18:24:23.232467] [DEBUG] [LOCAL ] DFIN: Trimmed 33342 records to 22974 (keeping 200 days of data) [2025-10-17T18:24:23.326629] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-17T18:24:23.380496] [DEBUG] [LOCAL ] DFIN: Primary data saved (22974 records). [2025-10-17T18:24:23.380633] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-17T18:24:23.380765] [INFO ] [MAIN ] Update Progress: 611/2368 symbols completed. DFIN took 37.7s. Estimated remaining: 4h 2m 29s. Rate: 7.2 symbols/min [2025-10-17T18:24:23.552478] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:24:23.573130] [DEBUG] [LOCAL ] DHF: Loaded 21169 existing records from primary storage. [2025-10-17T18:24:23.573469] [INFO ] [MAIN ] DHF: Loaded 21169 existing records. [2025-10-17T18:24:23.750662] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:24:23.751075] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-17T18:24:23.751135] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-17T18:24:23.751411] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-17T18:24:23.751467] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-17T18:24:23.967814] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-17T18:24:24.104997] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:24:24.758003] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-17T18:24:25.474930] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T18:24:25.476502] [INFO ] [REMOTE ] DFP: Full fetch complete (15743 records). [2025-10-17T18:24:25.476580] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-17T18:24:25.477020] [FATAL] [VALIDATOR ] DFP: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:24:25.477105] [FATAL] [MAIN ] DFP: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:24:25.477158] [WARN ] [MAIN ] DFP: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:24:25.477242] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-17T18:24:25.477321] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-10-17T18:24:25.477370] [INFO ] [LOCAL ] DFP: Starting deletion of derivative data. [2025-10-17T18:24:25.477611] [DEBUG] [LOCAL ] DFP: Deleted derivative data file. [2025-10-17T18:24:25.477770] [INFO ] [MAIN ] Update Progress: 612/2368 symbols completed. DFP took 24.6s. Estimated remaining: 4h 2m 3s. Rate: 7.3 symbols/min [2025-10-17T18:24:25.559510] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-17T18:24:25.659938] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:24:25.715719] [DEBUG] [LOCAL ] DHI: Loaded 53756 existing records from primary storage. [2025-10-17T18:24:25.716068] [INFO ] [MAIN ] DHI: Loaded 53756 existing records. [2025-10-17T18:24:25.906898] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:24:25.907697] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-17T18:24:25.927709] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-17T18:24:25.947775] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-17T18:24:25.948044] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-17T18:24:25.984140] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T18:24:26.273353] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (3.11 seconds). [2025-10-17T18:24:26.360792] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-17T18:24:26.369089] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:24:26.671565] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T18:24:27.158037] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-17T18:24:27.958082] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-17T18:24:28.524004] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-17T18:24:28.758106] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-17T18:24:29.084022] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-17T18:24:29.558035] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-17T18:24:29.911900] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T18:24:30.358005] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-17T18:24:30.773427] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-17T18:24:31.158057] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-17T18:24:31.434773] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T18:24:31.502229] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-17T18:24:31.958088] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-17T18:24:32.758033] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-17T18:24:33.034773] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T18:24:33.557999] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-17T18:24:33.821266] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-17T18:24:34.358004] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-17T18:24:34.450945] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T18:24:35.158081] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-17T18:24:35.451498] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T18:24:35.473361] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T18:24:35.958009] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-17T18:24:36.338634] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T18:24:36.758063] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-17T18:24:37.558233] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-17T18:24:37.822927] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T18:24:38.358033] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-17T18:24:38.623040] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T18:24:38.807267] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T18:24:39.158094] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-17T18:24:39.958019] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-17T18:24:40.263572] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T18:24:40.666509] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-17T18:24:40.758003] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-17T18:24:40.862739] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T18:24:41.558066] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-17T18:24:41.998587] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-17T18:24:42.358065] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-17T18:24:43.158052] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-17T18:24:43.556341] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T18:24:43.591466] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T18:24:43.598863] [INFO ] [REMOTE ] DG: Full fetch complete (77344 records). [2025-10-17T18:24:43.598987] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-17T18:24:43.976574] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-17T18:24:43.972807] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-17T18:24:43.977527] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-17T18:24:43.978484] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-17T18:24:43.978671] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-17T18:24:43.980114] [DEBUG] [LOCAL ] DG: Trimmed 77344 records to 54049 (keeping 200 days of data) [2025-10-17T18:24:44.314999] [DEBUG] [LOCAL ] DG: Primary data saved (54049 records). [2025-10-17T18:24:44.315147] [INFO ] [MAIN ] DG: Full history saved. [2025-10-17T18:24:44.315799] [INFO ] [MAIN ] Update Progress: 613/2368 symbols completed. DG took 35.1s. Estimated remaining: 4h 2m 25s. Rate: 7.2 symbols/min [2025-10-17T18:24:44.522202] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:24:44.576952] [DEBUG] [LOCAL ] DHR: Loaded 53768 existing records from primary storage. [2025-10-17T18:24:44.577311] [INFO ] [MAIN ] DHR: Loaded 53768 existing records. [2025-10-17T18:24:44.750751] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:24:44.750963] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-17T18:24:44.751012] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-17T18:24:44.751461] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-17T18:24:44.751518] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-17T18:24:44.764127] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-17T18:24:45.127884] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:24:45.141946] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T18:24:45.177860] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-17T18:24:45.558046] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-17T18:24:46.358033] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-17T18:24:46.405628] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T18:24:47.158023] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-17T18:24:47.331023] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T18:24:47.958060] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-17T18:24:48.330352] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T18:24:48.636154] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T18:24:48.642585] [INFO ] [REMOTE ] DGX: Full fetch complete (65325 records). [2025-10-17T18:24:48.642751] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-17T18:24:48.763122] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-17T18:24:49.083225] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-17T18:24:49.083315] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-17T18:24:49.084160] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-17T18:24:49.084228] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-17T18:24:49.085570] [DEBUG] [LOCAL ] DGX: Trimmed 65325 records to 45306 (keeping 200 days of data) [2025-10-17T18:24:49.365471] [DEBUG] [LOCAL ] DGX: Primary data saved (45306 records). [2025-10-17T18:24:49.365603] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-17T18:24:49.365705] [INFO ] [MAIN ] Update Progress: 614/2368 symbols completed. DGX took 38.0s. Estimated remaining: 4h 2m 7s. Rate: 7.2 symbols/min [2025-10-17T18:24:49.531258] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:24:49.531412] [DEBUG] [LOCAL ] DHT: No existing data file found in primary storage. [2025-10-17T18:24:49.531450] [WARN ] [MAIN ] DHT: No existing data found, performing full refresh instead. [2025-10-17T18:24:49.531594] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-17T18:24:49.531686] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-17T18:24:49.531758] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-10-17T18:24:49.531794] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-17T18:24:49.563142] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-17T18:24:49.889311] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:24:49.917845] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T18:24:50.358038] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-17T18:24:50.445982] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T18:24:50.597753] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T18:24:51.158027] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-17T18:24:51.958009] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-17T18:24:52.163183] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-17T18:24:52.200298] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-17T18:24:52.758083] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-17T18:24:53.558004] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-17T18:24:54.071305] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-17T18:24:54.363132] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-17T18:24:54.382011] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T18:24:55.157997] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-17T18:24:55.384967] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T18:24:55.388631] [INFO ] [REMOTE ] DHF: Full fetch complete (30003 records). [2025-10-17T18:24:55.388843] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-17T18:24:55.792131] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-17T18:24:55.792409] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-17T18:24:55.792999] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-17T18:24:55.793461] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-17T18:24:55.794789] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-17T18:24:55.806683] [DEBUG] [LOCAL ] DHF: Trimmed 30003 records to 21251 (keeping 200 days of data) [2025-10-17T18:24:55.936262] [DEBUG] [LOCAL ] DHF: Primary data saved (21251 records). [2025-10-17T18:24:55.936412] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-17T18:24:55.936531] [INFO ] [MAIN ] Update Progress: 615/2368 symbols completed. DHF took 32.6s. Estimated remaining: 4h 1m 54s. Rate: 7.2 symbols/min [2025-10-17T18:24:55.970100] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-17T18:24:56.130743] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:24:56.146584] [DEBUG] [LOCAL ] DHX: Loaded 13573 existing records from primary storage. [2025-10-17T18:24:56.146829] [INFO ] [MAIN ] DHX: Loaded 13573 existing records. [2025-10-17T18:24:56.342744] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:24:56.342959] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-17T18:24:56.343025] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-17T18:24:56.343179] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-17T18:24:56.343239] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-17T18:24:56.739925] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:24:56.762252] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-17T18:24:56.767670] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T18:24:57.558065] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-17T18:24:57.745040] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T18:24:58.290919] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-17T18:24:58.357996] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-17T18:24:59.158041] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-17T18:24:59.715892] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-17T18:24:59.795391] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T18:24:59.958010] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-17T18:25:00.200127] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T18:25:00.758027] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-17T18:25:01.558028] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-17T18:25:01.984010] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-17T18:25:02.358030] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-17T18:25:02.978203] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-17T18:25:03.158031] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-17T18:25:03.762195] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-17T18:25:03.906307] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T18:25:03.957983] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-17T18:25:04.067880] [DEBUG] [REMOTE ] DHX: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-17T18:25:04.068176] [WARN ] [REMOTE ] DHX: No data returned for month 2025-03 [2025-10-17T18:25:04.068263] [FATAL] [REMOTE ] DHX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:25:04.068369] [FATAL] [MAIN ] DHX: Failed to fetch primary data. [2025-10-17T18:25:04.068447] [WARN ] [MAIN ] DHX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:25:04.068530] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-17T18:25:04.068610] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-10-17T18:25:04.068695] [INFO ] [LOCAL ] DHX: Starting deletion of derivative data. [2025-10-17T18:25:04.068896] [DEBUG] [LOCAL ] DHX: Deleted derivative data file. [2025-10-17T18:25:04.069006] [INFO ] [MAIN ] Update Progress: 616/2368 symbols completed. DHX took 8.1s. Estimated remaining: 4h 1m 46s. Rate: 7.2 symbols/min [2025-10-17T18:25:04.246874] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:25:04.261912] [DEBUG] [LOCAL ] DIAX: Loaded 13091 existing records from primary storage. [2025-10-17T18:25:04.262154] [INFO ] [MAIN ] DIAX: Loaded 13091 existing records. [2025-10-17T18:25:04.457768] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:25:04.458008] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-17T18:25:04.458148] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-17T18:25:04.458408] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-17T18:25:04.458495] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-17T18:25:04.758996] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-17T18:25:04.788742] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-17T18:25:04.880072] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:25:05.558084] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-17T18:25:06.358077] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-17T18:25:06.567606] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T18:25:06.644365] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T18:25:07.158043] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-17T18:25:07.936829] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T18:25:07.957988] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-17T18:25:08.447370] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-17T18:25:08.758043] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-17T18:25:09.554233] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T18:25:09.557973] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-17T18:25:10.153046] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-17T18:25:10.167235] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-17T18:25:10.166947] [INFO ] [REMOTE ] DHI: Full fetch complete (77009 records). [2025-10-17T18:25:10.170324] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-17T18:25:10.171522] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:25:10.171628] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:25:10.171738] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:25:10.171830] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-17T18:25:10.171912] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-17T18:25:10.171951] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-10-17T18:25:10.172091] [DEBUG] [LOCAL ] DHI: Deleted derivative data file. [2025-10-17T18:25:10.172999] [INFO ] [MAIN ] Update Progress: 617/2368 symbols completed. DHI took 44.7s. Estimated remaining: 4h 1m 31s. Rate: 7.2 symbols/min [2025-10-17T18:25:10.344163] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:25:10.366579] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-17T18:25:10.384633] [DEBUG] [LOCAL ] DIN: Loaded 37519 existing records from primary storage. [2025-10-17T18:25:10.384972] [INFO ] [MAIN ] DIN: Loaded 37519 existing records. [2025-10-17T18:25:10.560268] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:25:10.560489] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-17T18:25:10.560540] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-17T18:25:10.560894] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-17T18:25:10.560950] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-17T18:25:10.915903] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:25:11.158077] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-17T18:25:11.958010] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-17T18:25:12.285448] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T18:25:12.725240] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T18:25:12.757983] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-17T18:25:13.558007] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-17T18:25:13.611012] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T18:25:14.320858] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T18:25:14.357990] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-17T18:25:14.375442] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-17T18:25:15.158021] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-17T18:25:15.872972] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T18:25:15.957986] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-17T18:25:16.757999] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-17T18:25:17.153077] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T18:25:17.226221] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-17T18:25:17.233120] [INFO ] [REMOTE ] DHR: Full fetch complete (77050 records). [2025-10-17T18:25:17.233266] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-17T18:25:17.234111] [FATAL] [VALIDATOR ] DHR: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:25:17.234250] [FATAL] [MAIN ] DHR: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:25:17.234305] [WARN ] [MAIN ] DHR: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:25:17.234373] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-17T18:25:17.234438] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-10-17T18:25:17.234473] [INFO ] [LOCAL ] DHR: Starting deletion of derivative data. [2025-10-17T18:25:17.234634] [DEBUG] [LOCAL ] DHR: Deleted derivative data file. [2025-10-17T18:25:17.235185] [INFO ] [MAIN ] Update Progress: 618/2368 symbols completed. DHR took 32.9s. Estimated remaining: 4h 1m 19s. Rate: 7.3 symbols/min [2025-10-17T18:25:17.404965] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:25:17.459424] [DEBUG] [LOCAL ] DINO: Loaded 53216 existing records from primary storage. [2025-10-17T18:25:17.459757] [INFO ] [MAIN ] DINO: Loaded 53216 existing records. [2025-10-17T18:25:17.559671] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-17T18:25:17.642031] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:25:17.642264] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-17T18:25:17.642359] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-17T18:25:17.650336] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-17T18:25:17.664351] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-17T18:25:17.709240] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T18:25:18.038395] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:25:18.358037] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-17T18:25:19.158053] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-17T18:25:19.759699] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-17T18:25:19.962730] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-17T18:25:19.964437] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T18:25:20.102975] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-17T18:25:20.758045] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-17T18:25:21.550815] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-17T18:25:21.557977] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-17T18:25:21.928114] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T18:25:22.358001] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-17T18:25:22.472851] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T18:25:23.158028] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-17T18:25:23.958026] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-17T18:25:24.179043] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-17T18:25:24.758020] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-17T18:25:24.783585] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T18:25:25.558026] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-17T18:25:25.608302] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T18:25:25.649787] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T18:25:26.358036] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-17T18:25:26.644925] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T18:25:27.158122] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-17T18:25:27.908631] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T18:25:27.958034] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-17T18:25:28.758055] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-17T18:25:28.921608] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T18:25:29.558023] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-17T18:25:29.736889] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T18:25:30.210538] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T18:25:30.358016] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-17T18:25:31.157997] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-17T18:25:31.278475] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T18:25:31.441056] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T18:25:31.958034] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-17T18:25:32.467887] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T18:25:32.758009] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-17T18:25:32.876371] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-17T18:25:32.878605] [INFO ] [REMOTE ] DIAX: Full fetch complete (17696 records). [2025-10-17T18:25:32.878712] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-17T18:25:33.236838] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-17T18:25:33.237152] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-17T18:25:33.237562] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-17T18:25:33.237629] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-17T18:25:33.238202] [DEBUG] [LOCAL ] DIAX: Trimmed 17696 records to 13192 (keeping 200 days of data) [2025-10-17T18:25:33.318296] [DEBUG] [LOCAL ] DIAX: Primary data saved (13192 records). [2025-10-17T18:25:33.318403] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-17T18:25:33.318482] [INFO ] [MAIN ] Update Progress: 619/2368 symbols completed. DIAX took 29.2s. Estimated remaining: 4h 1m 33s. Rate: 7.2 symbols/min [2025-10-17T18:25:33.483896] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:25:33.538489] [DEBUG] [LOCAL ] DIS: Loaded 54178 existing records from primary storage. [2025-10-17T18:25:33.538828] [INFO ] [MAIN ] DIS: Loaded 54178 existing records. [2025-10-17T18:25:33.568583] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-17T18:25:33.715162] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:25:33.715389] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-17T18:25:33.715456] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-17T18:25:33.716049] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-17T18:25:33.716108] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-17T18:25:34.071263] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:25:34.265058] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T18:25:34.358000] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-17T18:25:35.158096] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-17T18:25:35.384123] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T18:25:35.391108] [INFO ] [REMOTE ] DHT: Full fetch complete (70160 records). [2025-10-17T18:25:35.391265] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-17T18:25:35.791605] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-17T18:25:35.791733] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-17T18:25:35.792563] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-17T18:25:35.792610] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-17T18:25:35.794043] [DEBUG] [LOCAL ] DHT: Trimmed 70160 records to 48665 (keeping 200 days of data) [2025-10-17T18:25:35.964515] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-17T18:25:36.090301] [DEBUG] [LOCAL ] DHT: Primary data saved (48665 records). [2025-10-17T18:25:36.090450] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-17T18:25:36.090545] [INFO ] [MAIN ] Update Progress: 620/2368 symbols completed. DHT took 46.7s. Estimated remaining: 4h 1m 9s. Rate: 7.2 symbols/min [2025-10-17T18:25:36.256707] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:25:36.256869] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-17T18:25:36.256906] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-17T18:25:36.257019] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-17T18:25:36.257080] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-17T18:25:36.257154] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-17T18:25:36.257199] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-17T18:25:36.617778] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:25:36.758006] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-17T18:25:37.002472] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-17T18:25:37.265905] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T18:25:37.271185] [INFO ] [REMOTE ] DIN: Full fetch complete (54978 records). [2025-10-17T18:25:37.271276] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-17T18:25:37.328190] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-17T18:25:37.429839] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-17T18:25:37.563122] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-17T18:25:37.699311] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-17T18:25:37.699387] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-17T18:25:37.700104] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-17T18:25:37.700166] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-17T18:25:37.701235] [DEBUG] [LOCAL ] DIN: Trimmed 54978 records to 37698 (keeping 200 days of data) [2025-10-17T18:25:37.926876] [DEBUG] [LOCAL ] DIN: Primary data saved (37698 records). [2025-10-17T18:25:37.927011] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-17T18:25:37.927588] [INFO ] [MAIN ] Update Progress: 621/2368 symbols completed. DIN took 27.8s. Estimated remaining: 4h 0m 43s. Rate: 7.3 symbols/min [2025-10-17T18:25:38.093373] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:25:38.142977] [DEBUG] [LOCAL ] DK: Loaded 49758 existing records from primary storage. [2025-10-17T18:25:38.143332] [INFO ] [MAIN ] DK: Loaded 49758 existing records. [2025-10-17T18:25:38.316683] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:25:38.316902] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-17T18:25:38.316949] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-17T18:25:38.317277] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-17T18:25:38.317316] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-17T18:25:38.370100] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-17T18:25:38.673719] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:25:38.846134] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-17T18:25:39.158011] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-17T18:25:39.433323] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T18:25:39.664167] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-17T18:25:39.958026] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-17T18:25:40.758036] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-17T18:25:41.558102] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-17T18:25:41.725956] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T18:25:42.361668] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-17T18:25:42.871951] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-17T18:25:43.061857] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-17T18:25:43.158019] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-17T18:25:43.249443] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T18:25:43.958074] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-17T18:25:44.723412] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T18:25:44.757984] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-17T18:25:45.558026] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-17T18:25:46.287474] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-17T18:25:46.321926] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T18:25:46.357997] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-17T18:25:47.158121] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-17T18:25:47.415542] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T18:25:47.958101] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-17T18:25:48.030142] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T18:25:48.426229] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-17T18:25:48.758089] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-17T18:25:49.111832] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-17T18:25:49.558085] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-17T18:25:49.849175] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-17T18:25:49.908761] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-17T18:25:50.358111] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-17T18:25:51.158040] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-17T18:25:51.958049] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-17T18:25:52.176472] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T18:25:52.307102] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-17T18:25:52.446785] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-17T18:25:52.758047] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-17T18:25:53.558077] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-17T18:25:54.358020] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-17T18:25:54.473229] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T18:25:55.158059] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-17T18:25:55.247186] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T18:25:55.501471] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-17T18:25:55.958084] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-17T18:25:56.758009] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-17T18:25:56.909138] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-17T18:25:57.558025] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-17T18:25:57.596016] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T18:25:57.931121] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-17T18:25:58.359415] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-17T18:25:58.362271] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-17T18:25:58.369868] [INFO ] [REMOTE ] DINO: Full fetch complete (76721 records). [2025-10-17T18:25:58.370029] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-17T18:25:58.762701] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-17T18:25:58.762801] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-17T18:25:58.763695] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-17T18:25:58.763759] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-17T18:25:58.765221] [DEBUG] [LOCAL ] DINO: Trimmed 76721 records to 53587 (keeping 200 days of data) [2025-10-17T18:25:59.088957] [DEBUG] [LOCAL ] DINO: Primary data saved (53587 records). [2025-10-17T18:25:59.089136] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-17T18:25:59.090101] [INFO ] [MAIN ] Update Progress: 622/2368 symbols completed. DINO took 41.9s. Estimated remaining: 4h 1m 11s. Rate: 7.2 symbols/min [2025-10-17T18:25:59.164352] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-17T18:25:59.259259] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:25:59.259453] [DEBUG] [LOCAL ] DKL: No existing data file found in primary storage. [2025-10-17T18:25:59.259499] [WARN ] [MAIN ] DKL: No existing data found, performing full refresh instead. [2025-10-17T18:25:59.259610] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-17T18:25:59.259678] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-17T18:25:59.259740] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-10-17T18:25:59.259785] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-17T18:25:59.609948] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:25:59.765244] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T18:25:59.766206] [INFO ] [REMOTE ] DIVY: Full fetch complete (1702 records). [2025-10-17T18:25:59.766279] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-17T18:25:59.958304] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T18:25:59.958817] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:25:59.958891] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:25:59.958986] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-17T18:25:59.959068] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-17T18:25:59.958424] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-17T18:25:59.960207] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-17T18:25:59.960288] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-17T18:25:59.960365] [INFO ] [MAIN ] Update Progress: 623/2368 symbols completed. DIVY took 23.9s. Estimated remaining: 4h 0m 42s. Rate: 7.2 symbols/min [2025-10-17T18:26:00.135930] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:26:00.184138] [DEBUG] [LOCAL ] DKS: Loaded 50058 existing records from primary storage. [2025-10-17T18:26:00.184469] [INFO ] [MAIN ] DKS: Loaded 50058 existing records. [2025-10-17T18:26:00.380976] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:26:00.381210] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-17T18:26:00.381261] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-17T18:26:00.381696] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-17T18:26:00.381767] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-17T18:26:00.740128] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:26:00.758037] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-17T18:26:00.914444] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-17T18:26:01.558004] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-17T18:26:01.722482] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T18:26:01.914697] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T18:26:02.358045] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-17T18:26:03.160015] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-17T18:26:03.162853] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T18:26:03.958034] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-17T18:26:04.295979] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T18:26:04.758039] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-17T18:26:05.400869] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-17T18:26:05.557999] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-17T18:26:05.637891] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T18:26:05.840461] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T18:26:06.358020] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-17T18:26:07.157992] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-17T18:26:07.521889] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T18:26:07.898884] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-17T18:26:07.958036] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-17T18:26:08.758005] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-17T18:26:09.053558] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T18:26:09.558005] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-17T18:26:09.966834] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T18:26:10.300202] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-17T18:26:10.357995] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-17T18:26:11.158093] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-17T18:26:11.158969] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T18:26:11.670076] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T18:26:11.958026] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-17T18:26:12.758045] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-17T18:26:13.535887] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-17T18:26:13.557994] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-17T18:26:13.957459] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-17T18:26:14.025505] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T18:26:14.358031] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-17T18:26:14.411550] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T18:26:14.419040] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-17T18:26:14.419228] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-17T18:26:14.812109] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-17T18:26:14.812203] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-17T18:26:14.813104] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-17T18:26:14.813173] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-17T18:26:14.814904] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 54568 (keeping 200 days of data) [2025-10-17T18:26:15.159184] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-17T18:26:15.169130] [DEBUG] [LOCAL ] DIS: Primary data saved (54568 records). [2025-10-17T18:26:15.169339] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-17T18:26:15.170349] [INFO ] [MAIN ] Update Progress: 624/2368 symbols completed. DIS took 41.9s. Estimated remaining: 4h 0m 53s. Rate: 7.2 symbols/min [2025-10-17T18:26:15.374370] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:26:15.374847] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-17T18:26:15.419921] [DEBUG] [LOCAL ] DLB: Loaded 32489 existing records from primary storage. [2025-10-17T18:26:15.420275] [INFO ] [MAIN ] DLB: Loaded 32489 existing records. [2025-10-17T18:26:15.646822] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:26:15.647047] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-17T18:26:15.647097] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-17T18:26:15.647854] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-17T18:26:15.647913] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-17T18:26:15.963228] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-17T18:26:16.023144] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:26:16.758059] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-17T18:26:16.838421] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T18:26:16.845050] [INFO ] [REMOTE ] DK: Full fetch complete (70618 records). [2025-10-17T18:26:16.845251] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-17T18:26:16.846093] [FATAL] [VALIDATOR ] DK: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:26:16.846181] [FATAL] [MAIN ] DK: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:26:16.846227] [WARN ] [MAIN ] DK: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:26:16.846297] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-17T18:26:16.846365] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-10-17T18:26:16.846401] [INFO ] [LOCAL ] DK: Starting deletion of derivative data. [2025-10-17T18:26:16.846568] [DEBUG] [LOCAL ] DK: Deleted derivative data file. [2025-10-17T18:26:16.846934] [INFO ] [MAIN ] Update Progress: 625/2368 symbols completed. DK took 38.9s. Estimated remaining: 4h 0m 26s. Rate: 7.2 symbols/min [2025-10-17T18:26:17.026161] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:26:17.035944] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T18:26:17.050122] [DEBUG] [LOCAL ] DLNG: Loaded 6230 existing records from primary storage. [2025-10-17T18:26:17.050348] [INFO ] [MAIN ] DLNG: Loaded 6230 existing records. [2025-10-17T18:26:17.221445] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:26:17.221683] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-17T18:26:17.221744] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-17T18:26:17.221911] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-17T18:26:17.221966] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-17T18:26:17.563513] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-17T18:26:17.588155] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:26:18.304320] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T18:26:18.358010] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-17T18:26:19.158059] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-17T18:26:19.387693] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T18:26:19.451613] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T18:26:19.958002] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-17T18:26:20.005936] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T18:26:20.758038] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-17T18:26:21.558070] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-17T18:26:21.818964] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T18:26:22.203463] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T18:26:22.358005] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-17T18:26:22.532028] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T18:26:23.158031] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-17T18:26:23.722477] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-17T18:26:23.738837] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-17T18:26:23.958034] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-17T18:26:24.758101] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-17T18:26:25.038303] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T18:26:25.558009] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-17T18:26:26.358025] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-17T18:26:26.471947] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T18:26:26.592324] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T18:26:27.084572] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-17T18:26:27.157999] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-17T18:26:27.933817] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-17T18:26:27.957987] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-17T18:26:28.758006] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-17T18:26:28.782666] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T18:26:29.558045] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-17T18:26:30.257477] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T18:26:30.259766] [INFO ] [REMOTE ] DKL: Full fetch complete (27856 records). [2025-10-17T18:26:30.259995] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-17T18:26:30.365244] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-17T18:26:30.481879] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T18:26:30.677035] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-17T18:26:30.677110] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-17T18:26:30.677693] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-17T18:26:30.677763] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-17T18:26:30.678603] [DEBUG] [LOCAL ] DKL: Trimmed 27856 records to 17652 (keeping 200 days of data) [2025-10-17T18:26:30.781154] [DEBUG] [LOCAL ] DKL: Primary data saved (17652 records). [2025-10-17T18:26:30.781292] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-17T18:26:30.781368] [INFO ] [MAIN ] Update Progress: 626/2368 symbols completed. DKL took 31.7s. Estimated remaining: 4h 0m 34s. Rate: 7.2 symbols/min [2025-10-17T18:26:30.946826] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:26:31.002118] [DEBUG] [LOCAL ] DLR: Loaded 51052 existing records from primary storage. [2025-10-17T18:26:31.002438] [INFO ] [MAIN ] DLR: Loaded 51052 existing records. [2025-10-17T18:26:31.170871] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-17T18:26:31.175572] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:26:31.176104] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-17T18:26:31.176929] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-17T18:26:31.177304] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-17T18:26:31.177346] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-17T18:26:31.530736] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:26:31.958049] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-17T18:26:32.150884] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T18:26:32.654831] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-17T18:26:32.678827] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T18:26:32.757986] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-17T18:26:33.558414] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-17T18:26:34.036246] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T18:26:34.358022] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-17T18:26:35.158009] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-17T18:26:35.347501] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T18:26:35.708407] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T18:26:35.958044] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-17T18:26:36.651844] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-17T18:26:36.653436] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T18:26:36.758015] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-17T18:26:37.558086] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-17T18:26:38.358051] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-17T18:26:38.671322] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-17T18:26:39.158045] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-17T18:26:39.689299] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-17T18:26:39.722106] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T18:26:39.958057] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-17T18:26:40.758004] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-17T18:26:40.832519] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T18:26:41.558039] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-17T18:26:41.620203] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T18:26:41.627801] [INFO ] [REMOTE ] DKS: Full fetch complete (71775 records). [2025-10-17T18:26:41.627971] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-17T18:26:42.016917] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-17T18:26:42.017003] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-17T18:26:42.018009] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-17T18:26:42.018077] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-17T18:26:42.019572] [DEBUG] [LOCAL ] DKS: Trimmed 71775 records to 50372 (keeping 200 days of data) [2025-10-17T18:26:42.276854] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T18:26:42.358129] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-17T18:26:42.372208] [DEBUG] [LOCAL ] DKS: Primary data saved (50372 records). [2025-10-17T18:26:42.372814] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-17T18:26:42.373118] [INFO ] [MAIN ] Update Progress: 627/2368 symbols completed. DKS took 42.4s. Estimated remaining: 4h 0m 35s. Rate: 7.2 symbols/min [2025-10-17T18:26:42.562568] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:26:42.599551] [DEBUG] [LOCAL ] DLX: Loaded 28520 existing records from primary storage. [2025-10-17T18:26:42.599925] [INFO ] [MAIN ] DLX: Loaded 28520 existing records. [2025-10-17T18:26:42.869021] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:26:42.869344] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-17T18:26:42.869415] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-17T18:26:42.869895] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-17T18:26:42.869971] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-17T18:26:43.167833] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-17T18:26:43.309208] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:26:43.479004] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-17T18:26:43.731721] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T18:26:43.736516] [INFO ] [REMOTE ] DLB: Full fetch complete (47349 records). [2025-10-17T18:26:43.736601] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-17T18:26:43.916097] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T18:26:43.958969] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-17T18:26:44.119260] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-17T18:26:44.119327] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-17T18:26:44.119978] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-17T18:26:44.120039] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-17T18:26:44.120958] [DEBUG] [LOCAL ] DLB: Trimmed 47349 records to 32746 (keeping 200 days of data) [2025-10-17T18:26:44.317196] [DEBUG] [LOCAL ] DLB: Primary data saved (32746 records). [2025-10-17T18:26:44.317439] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-17T18:26:44.317555] [INFO ] [MAIN ] Update Progress: 628/2368 symbols completed. DLB took 29.1s. Estimated remaining: 4h 0m 9s. Rate: 7.2 symbols/min [2025-10-17T18:26:44.483697] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:26:44.503704] [DEBUG] [LOCAL ] DLY: Loaded 20735 existing records from primary storage. [2025-10-17T18:26:44.503961] [INFO ] [MAIN ] DLY: Loaded 20735 existing records. [2025-10-17T18:26:44.677156] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:26:44.677377] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-17T18:26:44.677450] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-17T18:26:44.677745] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-17T18:26:44.677837] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-17T18:26:44.767700] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-17T18:26:45.031689] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:26:45.273232] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T18:26:45.558091] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-17T18:26:46.358005] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-17T18:26:46.666865] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T18:26:47.002435] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T18:26:47.089902] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T18:26:47.157991] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-17T18:26:47.958041] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-17T18:26:48.613304] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T18:26:48.758051] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-17T18:26:49.558027] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-17T18:26:49.709374] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T18:26:49.708915] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T18:26:50.004788] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-17T18:26:50.358056] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-17T18:26:51.158041] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-17T18:26:51.958003] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-17T18:26:52.071562] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T18:26:52.126545] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T18:26:52.758010] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-17T18:26:53.326770] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T18:26:53.558000] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-17T18:26:54.358037] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-17T18:26:54.747111] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-17T18:26:54.898616] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T18:26:55.018838] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-17T18:26:55.158097] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-17T18:26:55.958101] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-17T18:26:56.684691] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T18:26:56.757987] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-17T18:26:57.155280] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T18:26:57.558059] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-17T18:26:58.041458] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T18:26:58.330881] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-17T18:26:58.332315] [INFO ] [REMOTE ] DLNG: Full fetch complete (11656 records). [2025-10-17T18:26:58.332420] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-17T18:26:58.363201] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-17T18:26:58.688331] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-17T18:26:58.688404] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-17T18:26:58.688706] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-17T18:26:58.688766] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-17T18:26:58.689246] [DEBUG] [LOCAL ] DLNG: Trimmed 11656 records to 6256 (keeping 200 days of data) [2025-10-17T18:26:58.724161] [DEBUG] [LOCAL ] DLNG: Primary data saved (6256 records). [2025-10-17T18:26:58.724254] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-17T18:26:58.724327] [INFO ] [MAIN ] Update Progress: 629/2368 symbols completed. DLNG took 41.9s. Estimated remaining: 4h 0m 17s. Rate: 7.2 symbols/min [2025-10-17T18:26:58.899588] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:26:58.906204] [DEBUG] [LOCAL ] DMA: Loaded 4772 existing records from primary storage. [2025-10-17T18:26:58.906362] [INFO ] [MAIN ] DMA: Loaded 4772 existing records. [2025-10-17T18:26:59.082315] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:26:59.082533] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-17T18:26:59.082581] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-17T18:26:59.082766] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-17T18:26:59.082824] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-17T18:26:59.163174] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-17T18:26:59.433997] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:26:59.958035] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-17T18:27:00.231556] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-17T18:27:00.231205] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T18:27:00.758040] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-17T18:27:00.802204] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-17T18:27:01.558026] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-17T18:27:02.160428] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T18:27:02.358092] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-17T18:27:02.643358] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T18:27:03.158032] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-17T18:27:03.624218] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T18:27:03.958021] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-17T18:27:04.297060] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T18:27:04.758001] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-17T18:27:05.121568] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T18:27:05.353379] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T18:27:05.558041] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-17T18:27:06.358077] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-17T18:27:07.067193] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T18:27:07.075098] [INFO ] [REMOTE ] DLX: Full fetch complete (41318 records). [2025-10-17T18:27:07.075290] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-17T18:27:07.076896] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-17T18:27:07.163191] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-17T18:27:07.450012] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-17T18:27:07.450086] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-17T18:27:07.450705] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-17T18:27:07.450767] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-17T18:27:07.451616] [DEBUG] [LOCAL ] DLX: Trimmed 41318 records to 28685 (keeping 200 days of data) [2025-10-17T18:27:07.622542] [DEBUG] [LOCAL ] DLX: Primary data saved (28685 records). [2025-10-17T18:27:07.622715] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-17T18:27:07.622814] [INFO ] [MAIN ] Update Progress: 630/2368 symbols completed. DLX took 25.2s. Estimated remaining: 4h 0m 11s. Rate: 7.2 symbols/min [2025-10-17T18:27:07.793241] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:27:07.793446] [DEBUG] [LOCAL ] DMB: No existing data file found in primary storage. [2025-10-17T18:27:07.793500] [WARN ] [MAIN ] DMB: No existing data found, performing full refresh instead. [2025-10-17T18:27:07.793610] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-17T18:27:07.793678] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-17T18:27:07.793743] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-17T18:27:07.793777] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-17T18:27:07.963101] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-17T18:27:08.147794] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:27:08.439387] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T18:27:08.652624] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-17T18:27:08.758054] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-17T18:27:09.313381] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T18:27:09.558025] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-17T18:27:10.358085] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-17T18:27:10.453439] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-17T18:27:11.158031] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-17T18:27:11.922385] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T18:27:11.958082] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-17T18:27:12.223804] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T18:27:12.520480] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T18:27:12.758060] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-17T18:27:13.210411] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-17T18:27:13.557996] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-17T18:27:14.358027] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-17T18:27:15.154192] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T18:27:15.157977] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-17T18:27:15.355332] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T18:27:15.362367] [INFO ] [REMOTE ] DLR: Full fetch complete (74163 records). [2025-10-17T18:27:15.362521] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-17T18:27:15.757911] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-17T18:27:15.757994] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-17T18:27:15.758967] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-17T18:27:15.759033] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-17T18:27:15.760468] [DEBUG] [LOCAL ] DLR: Trimmed 74163 records to 51423 (keeping 200 days of data) [2025-10-17T18:27:15.890817] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-17T18:27:15.962976] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-17T18:27:16.103420] [DEBUG] [LOCAL ] DLR: Primary data saved (51423 records). [2025-10-17T18:27:16.103557] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-17T18:27:16.104093] [INFO ] [MAIN ] Update Progress: 631/2368 symbols completed. DLR took 45.3s. Estimated remaining: 4h 0m 3s. Rate: 7.2 symbols/min [2025-10-17T18:27:16.272764] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:27:16.286193] [DEBUG] [LOCAL ] DMO: Loaded 9999 existing records from primary storage. [2025-10-17T18:27:16.286421] [INFO ] [MAIN ] DMO: Loaded 9999 existing records. [2025-10-17T18:27:16.468775] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:27:16.468980] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-17T18:27:16.469027] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-17T18:27:16.469188] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-17T18:27:16.469225] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-17T18:27:16.763107] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-17T18:27:16.816332] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:27:17.065821] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T18:27:17.398902] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-17T18:27:17.558043] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-17T18:27:18.358005] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-17T18:27:18.420683] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-17T18:27:19.158070] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-17T18:27:19.783867] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T18:27:19.788177] [INFO ] [REMOTE ] DLY: Full fetch complete (28504 records). [2025-10-17T18:27:19.788250] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-17T18:27:19.969807] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-17T18:27:20.052938] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-17T18:27:20.162625] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-17T18:27:20.162723] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-17T18:27:20.163222] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-17T18:27:20.163262] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-17T18:27:20.163962] [DEBUG] [LOCAL ] DLY: Trimmed 28504 records to 20947 (keeping 200 days of data) [2025-10-17T18:27:20.288891] [DEBUG] [LOCAL ] DLY: Primary data saved (20947 records). [2025-10-17T18:27:20.289016] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-17T18:27:20.289096] [INFO ] [MAIN ] Update Progress: 632/2368 symbols completed. DLY took 36.0s. Estimated remaining: 3h 59m 43s. Rate: 7.2 symbols/min [2025-10-17T18:27:20.454575] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:27:20.498931] [DEBUG] [LOCAL ] DNA: Loaded 48954 existing records from primary storage. [2025-10-17T18:27:20.499250] [INFO ] [MAIN ] DNA: Loaded 48954 existing records. [2025-10-17T18:27:20.678373] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:27:20.683306] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T18:27:20.683387] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-17T18:27:20.685475] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-17T18:27:20.685904] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-17T18:27:20.685960] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-17T18:27:20.763094] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-17T18:27:21.031526] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:27:21.407942] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-17T18:27:21.557988] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-17T18:27:22.358031] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-17T18:27:22.446585] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-17T18:27:23.158063] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-17T18:27:23.847774] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-17T18:27:23.849008] [INFO ] [REMOTE ] DMA: Full fetch complete (6639 records). [2025-10-17T18:27:23.849077] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-17T18:27:23.849432] [FATAL] [VALIDATOR ] DMA: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:27:23.849532] [FATAL] [MAIN ] DMA: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:27:23.849600] [WARN ] [MAIN ] DMA: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:27:23.849707] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-17T18:27:23.849785] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-10-17T18:27:23.849823] [INFO ] [LOCAL ] DMA: Starting deletion of derivative data. [2025-10-17T18:27:23.849975] [DEBUG] [LOCAL ] DMA: Deleted derivative data file. [2025-10-17T18:27:23.850062] [INFO ] [MAIN ] Update Progress: 633/2368 symbols completed. DMA took 25.1s. Estimated remaining: 3h 59m 22s. Rate: 7.2 symbols/min [2025-10-17T18:27:23.963133] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-17T18:27:24.024183] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:27:24.065638] [DEBUG] [LOCAL ] DNOW: Loaded 44124 existing records from primary storage. [2025-10-17T18:27:24.065952] [INFO ] [MAIN ] DNOW: Loaded 44124 existing records. [2025-10-17T18:27:24.251366] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:27:24.251760] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-17T18:27:24.251830] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-17T18:27:24.252264] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-17T18:27:24.252322] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-17T18:27:24.438506] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-17T18:27:24.677615] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:27:24.758005] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-17T18:27:24.947014] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-17T18:27:25.558026] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-17T18:27:26.324282] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-17T18:27:26.357984] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-17T18:27:26.522522] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-17T18:27:27.158043] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-17T18:27:27.209548] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T18:27:27.958083] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-17T18:27:27.969928] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T18:27:28.758041] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-17T18:27:29.477692] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T18:27:29.557994] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-17T18:27:29.565346] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T18:27:30.358019] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-17T18:27:30.817170] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T18:27:31.158002] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-17T18:27:31.187330] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-17T18:27:31.958029] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-17T18:27:32.648011] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T18:27:32.758000] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-17T18:27:33.558044] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-17T18:27:34.082725] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-17T18:27:34.356748] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T18:27:34.360072] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-17T18:27:34.545097] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-17T18:27:35.158082] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-17T18:27:35.254317] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T18:27:35.958058] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-17T18:27:36.733890] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T18:27:36.763177] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-17T18:27:36.775037] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T18:27:37.558026] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-17T18:27:38.346847] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-17T18:27:38.357969] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-17T18:27:38.763125] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-17T18:27:39.114354] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T18:27:39.157997] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-17T18:27:39.958007] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-17T18:27:40.013054] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-17T18:27:40.758076] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-17T18:27:41.558062] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-17T18:27:41.614696] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-17T18:27:42.144116] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-17T18:27:42.358090] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-17T18:27:43.158004] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-17T18:27:43.220522] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T18:27:43.958006] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-17T18:27:44.028669] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T18:27:44.030321] [INFO ] [REMOTE ] DMO: Full fetch complete (14483 records). [2025-10-17T18:27:44.030391] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-17T18:27:44.030843] [FATAL] [VALIDATOR ] DMO: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:27:44.030926] [FATAL] [MAIN ] DMO: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:27:44.030969] [WARN ] [MAIN ] DMO: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:27:44.031009] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-17T18:27:44.031065] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-10-17T18:27:44.031106] [INFO ] [LOCAL ] DMO: Starting deletion of derivative data. [2025-10-17T18:27:44.031353] [DEBUG] [LOCAL ] DMO: Deleted derivative data file. [2025-10-17T18:27:44.031441] [INFO ] [MAIN ] Update Progress: 634/2368 symbols completed. DMO took 27.9s. Estimated remaining: 3h 59m 46s. Rate: 7.2 symbols/min [2025-10-17T18:27:44.214346] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:27:44.246290] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T18:27:44.283185] [DEBUG] [LOCAL ] DNP: Loaded 33479 existing records from primary storage. [2025-10-17T18:27:44.283462] [INFO ] [MAIN ] DNP: Loaded 33479 existing records. [2025-10-17T18:27:44.458789] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:27:44.459004] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-17T18:27:44.459051] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-17T18:27:44.459278] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-17T18:27:44.459317] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-17T18:27:44.763125] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-17T18:27:44.807794] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T18:27:44.821775] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:27:44.822891] [INFO ] [REMOTE ] DMB: Full fetch complete (14661 records). [2025-10-17T18:27:44.822983] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-17T18:27:44.823455] [FATAL] [VALIDATOR ] DMB: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:27:44.823537] [FATAL] [MAIN ] DMB: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:27:44.823584] [WARN ] [MAIN ] DMB: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:27:44.823670] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-17T18:27:44.823746] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-17T18:27:44.823789] [INFO ] [LOCAL ] DMB: Starting deletion of derivative data. [2025-10-17T18:27:44.823831] [DEBUG] [LOCAL ] DMB: No derivative data file found to delete. [2025-10-17T18:27:44.823887] [INFO ] [MAIN ] Update Progress: 635/2368 symbols completed. DMB took 37.2s. Estimated remaining: 3h 59m 18s. Rate: 7.2 symbols/min [2025-10-17T18:27:44.988783] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:27:45.040044] [DEBUG] [LOCAL ] DOC: Loaded 53944 existing records from primary storage. [2025-10-17T18:27:45.040384] [INFO ] [MAIN ] DOC: Loaded 53944 existing records. [2025-10-17T18:27:45.213846] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:27:45.214070] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-17T18:27:45.214118] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-17T18:27:45.214436] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-17T18:27:45.214476] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-17T18:27:45.556884] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:27:45.557997] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-17T18:27:46.357991] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-17T18:27:46.840530] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-17T18:27:47.158002] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-17T18:27:47.402214] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T18:27:47.813365] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T18:27:47.958005] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-17T18:27:48.408187] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T18:27:48.758043] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-17T18:27:49.557998] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-17T18:27:49.843714] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-17T18:27:50.193538] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T18:27:50.358023] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-17T18:27:51.158012] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-17T18:27:51.206138] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T18:27:51.958031] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-17T18:27:52.542459] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-17T18:27:52.626425] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T18:27:52.758031] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-17T18:27:53.558021] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-17T18:27:53.643335] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T18:27:54.358019] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-17T18:27:54.621363] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T18:27:54.877289] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T18:27:55.158030] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-17T18:27:55.963843] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-17T18:27:55.975797] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T18:27:56.758010] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-17T18:27:57.117123] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T18:27:57.558059] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-17T18:27:57.891802] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T18:27:58.005838] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T18:27:58.012222] [INFO ] [REMOTE ] DNOW: Full fetch complete (63426 records). [2025-10-17T18:27:58.012328] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-17T18:27:58.367494] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-17T18:27:58.404074] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-17T18:27:58.404156] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-17T18:27:58.405856] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-17T18:27:58.406011] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-17T18:27:58.407354] [DEBUG] [LOCAL ] DNOW: Trimmed 63426 records to 44485 (keeping 200 days of data) [2025-10-17T18:27:58.647020] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T18:27:58.700099] [DEBUG] [LOCAL ] DNOW: Primary data saved (44485 records). [2025-10-17T18:27:58.700229] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-17T18:27:58.700803] [INFO ] [MAIN ] Update Progress: 636/2368 symbols completed. DNOW took 34.9s. Estimated remaining: 3h 59m 25s. Rate: 7.2 symbols/min [2025-10-17T18:27:58.881026] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:27:58.932000] [DEBUG] [LOCAL ] DOCN: Loaded 51421 existing records from primary storage. [2025-10-17T18:27:58.932315] [INFO ] [MAIN ] DOCN: Loaded 51421 existing records. [2025-10-17T18:27:59.105007] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:27:59.105206] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-17T18:27:59.105252] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-17T18:27:59.105610] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-17T18:27:59.105695] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-17T18:27:59.159323] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-17T18:27:59.454628] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:27:59.958048] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-17T18:28:00.460516] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-17T18:28:00.758083] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-17T18:28:01.501119] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-17T18:28:01.536810] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T18:28:01.557979] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-17T18:28:02.358035] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-17T18:28:02.512814] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T18:28:03.158084] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-17T18:28:03.519053] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T18:28:03.958037] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-17T18:28:04.324369] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T18:28:04.758070] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-17T18:28:05.531172] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-17T18:28:05.538430] [INFO ] [REMOTE ] DNA: Full fetch complete (71311 records). [2025-10-17T18:28:05.538608] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-17T18:28:05.569849] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-17T18:28:05.961993] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-17T18:28:05.962236] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-17T18:28:05.963903] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-17T18:28:05.964995] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-17T18:28:05.974159] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-17T18:28:05.975488] [DEBUG] [LOCAL ] DNA: Trimmed 71311 records to 49343 (keeping 200 days of data) [2025-10-17T18:28:06.188634] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T18:28:06.284726] [DEBUG] [LOCAL ] DNA: Primary data saved (49343 records). [2025-10-17T18:28:06.284855] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-17T18:28:06.284957] [INFO ] [MAIN ] Update Progress: 637/2368 symbols completed. DNA took 46.0s. Estimated remaining: 3h 59m 14s. Rate: 7.2 symbols/min [2025-10-17T18:28:06.357987] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-17T18:28:07.158058] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-17T18:28:07.640933] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-17T18:28:07.927602] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T18:28:07.958033] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-17T18:28:08.586859] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T18:28:08.758018] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-17T18:28:09.558079] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-17T18:28:09.967556] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-17T18:28:10.358158] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-17T18:28:10.494050] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T18:28:11.158127] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-17T18:28:11.332016] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T18:28:11.761348] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T18:28:11.957994] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-17T18:28:12.524830] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T18:28:12.758027] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-17T18:28:13.558006] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-17T18:28:13.956360] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-17T18:28:13.963986] [INFO ] [REMOTE ] DOC: Full fetch complete (77570 records). [2025-10-17T18:28:13.964120] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-17T18:28:14.128290] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T18:28:14.162741] [INFO ] [REMOTE ] DNP: Full fetch complete (48583 records). [2025-10-17T18:28:14.183526] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-17T18:28:14.193974] [FATAL] [VALIDATOR ] DNP: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:28:14.249542] [FATAL] [MAIN ] DNP: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:28:14.266021] [WARN ] [MAIN ] DNP: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:28:14.289293] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-17T18:28:14.291921] [DEBUG] [LOCAL ] DNP: No primary data file found to delete. [2025-10-17T18:28:14.297684] [INFO ] [LOCAL ] DNP: Starting deletion of derivative data. [2025-10-17T18:28:14.313243] [DEBUG] [LOCAL ] DNP: Deleted derivative data file. [2025-10-17T18:28:14.318498] [INFO ] [MAIN ] Update Progress: 638/2368 symbols completed. DNP took 30.3s. Estimated remaining: 3h 59m 5s. Rate: 7.2 symbols/min [2025-10-17T18:28:14.387183] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-17T18:28:14.387285] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-17T18:28:14.388301] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-17T18:28:14.388366] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-17T18:28:14.389796] [DEBUG] [LOCAL ] DOC: Trimmed 77570 records to 54334 (keeping 200 days of data) [2025-10-17T18:28:14.725395] [DEBUG] [LOCAL ] DOC: Primary data saved (54334 records). [2025-10-17T18:28:14.725528] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-17T18:28:14.725612] [INFO ] [MAIN ] Update Progress: 639/2368 symbols completed. DOC took 29.9s. Estimated remaining: 3h 58m 36s. Rate: 7.2 symbols/min [2025-10-17T18:28:15.316735] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T18:28:15.327135] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-17T18:28:17.108172] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T18:28:17.118892] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-17T18:28:18.845439] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T18:28:18.856029] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-17T18:28:20.736609] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T18:28:20.747737] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-17T18:28:22.750054] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-17T18:28:22.761371] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-17T18:28:24.566421] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T18:28:24.577725] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-17T18:28:26.886767] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-17T18:28:26.893944] [INFO ] [REMOTE ] DOCN: Full fetch complete (72725 records). [2025-10-17T18:28:26.894099] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-17T18:28:27.287798] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-17T18:28:27.287891] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-17T18:28:27.288769] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-17T18:28:27.288834] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-17T18:28:27.290321] [DEBUG] [LOCAL ] DOCN: Trimmed 72725 records to 51798 (keeping 200 days of data) [2025-10-17T18:28:27.727822] [DEBUG] [LOCAL ] DOCN: Primary data saved (51798 records). [2025-10-17T18:28:27.728085] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-17T18:28:27.728898] [INFO ] [MAIN ] Update Progress: 640/2368 symbols completed. DOCN took 29.0s. Estimated remaining: 3h 58m 40s. Rate: 7.2 symbols/min [2025-10-17T18:28:28.560121] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:28:28.556574] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:28:28.569923] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:28:28.599261] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:28:28.674312] [DEBUG] [LOCAL ] DOUG: Loaded 34428 existing records from primary storage. [2025-10-17T18:28:28.685352] [INFO ] [MAIN ] DOUG: Loaded 34428 existing records. [2025-10-17T18:28:28.719200] [DEBUG] [LOCAL ] DOLE: Loaded 39478 existing records from primary storage. [2025-10-17T18:28:28.745611] [INFO ] [MAIN ] DOLE: Loaded 39478 existing records. [2025-10-17T18:28:28.747201] [DEBUG] [LOCAL ] DOCS: Loaded 51081 existing records from primary storage. [2025-10-17T18:28:28.777767] [INFO ] [MAIN ] DOCS: Loaded 51081 existing records. [2025-10-17T18:28:28.914415] [DEBUG] [LOCAL ] DOV: Loaded 45966 existing records from primary storage. [2025-10-17T18:28:28.994717] [INFO ] [MAIN ] DOV: Loaded 45966 existing records. [2025-10-17T18:28:29.381908] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:28:29.401030] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-17T18:28:29.401149] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-17T18:28:29.438393] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:28:29.462173] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-17T18:28:29.410603] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:28:29.499118] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-17T18:28:29.504450] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:28:29.504851] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-17T18:28:29.505128] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-17T18:28:29.505298] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-17T18:28:29.505427] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-17T18:28:29.505020] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-17T18:28:29.518264] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-17T18:28:29.543332] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-17T18:28:29.510698] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-17T18:28:29.607117] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-17T18:28:29.646761] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-17T18:28:29.633032] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-17T18:28:29.666013] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-17T18:28:30.744998] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:28:30.832060] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-17T18:28:30.920259] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:28:30.927188] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-17T18:28:30.961428] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:28:31.002381] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-17T18:28:31.042953] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:28:31.043261] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-17T18:28:32.422824] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T18:28:32.430330] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-17T18:28:32.684857] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T18:28:32.693725] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-17T18:28:32.787252] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T18:28:32.795196] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-17T18:28:32.855694] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-17T18:28:32.866233] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-17T18:28:33.372134] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T18:28:33.379722] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-17T18:28:34.032404] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T18:28:34.041142] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-17T18:28:34.212963] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-17T18:28:34.222787] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-17T18:28:34.392596] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:28:34.401460] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-17T18:28:34.723290] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T18:28:34.733139] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-17T18:28:34.988769] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T18:28:34.995973] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-17T18:28:35.798053] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T18:28:35.805689] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-17T18:28:36.281881] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T18:28:36.290408] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-17T18:28:36.406946] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T18:28:36.417281] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-17T18:28:36.483863] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T18:28:36.491687] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-17T18:28:37.291448] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T18:28:37.300142] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-17T18:28:37.719338] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T18:28:37.730384] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-17T18:28:37.797766] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T18:28:37.805770] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-17T18:28:38.289682] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T18:28:38.300717] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-17T18:28:38.351462] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T18:28:38.360179] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-17T18:28:39.312560] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T18:28:39.321610] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-17T18:28:39.388356] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T18:28:39.396138] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-17T18:28:39.674448] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T18:28:39.685048] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-17T18:28:40.170382] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:28:40.181484] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-17T18:28:40.627136] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T18:28:40.757988] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-17T18:28:40.788961] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T18:28:41.330267] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T18:28:41.558009] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-17T18:28:42.150252] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T18:28:42.164587] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T18:28:42.357997] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-17T18:28:43.138573] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T18:28:43.157991] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-17T18:28:43.797246] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-17T18:28:43.958012] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-17T18:28:44.758044] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-17T18:28:45.063705] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-17T18:28:45.364554] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T18:28:45.558079] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-17T18:28:46.235817] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T18:28:46.357992] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-17T18:28:47.122313] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T18:28:47.157984] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-17T18:28:47.958026] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-17T18:28:48.038444] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T18:28:48.758029] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-17T18:28:48.936221] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T18:28:49.421140] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T18:28:49.425469] [INFO ] [REMOTE ] DOUG: Full fetch complete (50340 records). [2025-10-17T18:28:49.425564] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-17T18:28:49.567319] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-17T18:28:49.814823] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-17T18:28:49.814974] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-17T18:28:49.815781] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-17T18:28:49.815845] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-17T18:28:49.817245] [DEBUG] [LOCAL ] DOUG: Trimmed 50340 records to 34582 (keeping 200 days of data) [2025-10-17T18:28:50.011003] [DEBUG] [LOCAL ] DOUG: Primary data saved (34582 records). [2025-10-17T18:28:50.011141] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-17T18:28:50.011224] [INFO ] [MAIN ] Update Progress: 641/2368 symbols completed. DOUG took 22.2s. Estimated remaining: 3h 59m 10s. Rate: 7.2 symbols/min [2025-10-17T18:28:50.177732] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:28:50.226357] [DEBUG] [LOCAL ] DOW: Loaded 54123 existing records from primary storage. [2025-10-17T18:28:50.226735] [INFO ] [MAIN ] DOW: Loaded 54123 existing records. [2025-10-17T18:28:50.364133] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-17T18:28:50.406117] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:28:50.406586] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-17T18:28:50.406761] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-17T18:28:50.407289] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-17T18:28:50.407349] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-17T18:28:50.721263] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-17T18:28:50.808756] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:28:51.158095] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-17T18:28:51.388211] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T18:28:51.966442] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-17T18:28:51.970590] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T18:28:51.977013] [INFO ] [REMOTE ] DOLE: Full fetch complete (54603 records). [2025-10-17T18:28:51.977135] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-17T18:28:52.356518] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-17T18:28:52.356600] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-17T18:28:52.357351] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-17T18:28:52.357434] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-17T18:28:52.358575] [DEBUG] [LOCAL ] DOLE: Trimmed 54603 records to 39732 (keeping 200 days of data) [2025-10-17T18:28:52.597942] [DEBUG] [LOCAL ] DOLE: Primary data saved (39732 records). [2025-10-17T18:28:52.598090] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-17T18:28:52.598174] [INFO ] [MAIN ] Update Progress: 642/2368 symbols completed. DOLE took 24.9s. Estimated remaining: 3h 58m 46s. Rate: 7.2 symbols/min [2025-10-17T18:28:52.766510] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-17T18:28:52.770256] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:28:52.785801] [DEBUG] [LOCAL ] DPG: Loaded 13660 existing records from primary storage. [2025-10-17T18:28:52.786033] [INFO ] [MAIN ] DPG: Loaded 13660 existing records. [2025-10-17T18:28:52.904137] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T18:28:52.934114] [INFO ] [REMOTE ] DOV: Full fetch complete (65876 records). [2025-10-17T18:28:52.962317] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-17T18:28:52.998571] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:28:53.062493] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-17T18:28:53.079187] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-17T18:28:53.100291] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-17T18:28:53.110832] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-17T18:28:53.693396] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-17T18:28:53.709116] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-17T18:28:53.727015] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-17T18:28:53.737630] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-17T18:28:53.768811] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:28:53.769298] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-17T18:28:53.770553] [DEBUG] [LOCAL ] DOV: Trimmed 65876 records to 46315 (keeping 200 days of data) [2025-10-17T18:28:54.060411] [DEBUG] [LOCAL ] DOV: Primary data saved (46315 records). [2025-10-17T18:28:54.060543] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-17T18:28:54.061111] [INFO ] [MAIN ] Update Progress: 643/2368 symbols completed. DOV took 26.3s. Estimated remaining: 3h 58m 19s. Rate: 7.2 symbols/min [2025-10-17T18:28:54.232779] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:28:54.269270] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-17T18:28:54.318533] [DEBUG] [LOCAL ] DQ: Loaded 44086 existing records from primary storage. [2025-10-17T18:28:54.318873] [INFO ] [MAIN ] DQ: Loaded 44086 existing records. [2025-10-17T18:28:54.372123] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-17T18:28:54.515638] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:28:54.516517] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-17T18:28:54.516762] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-17T18:28:54.517324] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-17T18:28:54.517433] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-17T18:28:54.854983] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-17T18:28:54.856499] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T18:28:54.947305] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:28:55.158029] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-17T18:28:55.958012] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-17T18:28:56.019927] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-17T18:28:56.448261] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-17T18:28:56.758015] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-17T18:28:57.558010] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-17T18:28:57.724569] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T18:28:58.340833] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T18:28:58.358005] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-17T18:28:58.656034] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T18:28:59.158042] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-17T18:28:59.877249] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T18:28:59.957999] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-17T18:29:00.725153] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T18:29:00.731815] [INFO ] [REMOTE ] DOCS: Full fetch complete (73646 records). [2025-10-17T18:29:00.731994] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-17T18:29:00.732870] [FATAL] [VALIDATOR ] DOCS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:29:00.732962] [FATAL] [MAIN ] DOCS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:29:00.733006] [WARN ] [MAIN ] DOCS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:29:00.733085] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-17T18:29:00.733183] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-17T18:29:00.733262] [INFO ] [LOCAL ] DOCS: Starting deletion of derivative data. [2025-10-17T18:29:00.733439] [DEBUG] [LOCAL ] DOCS: Deleted derivative data file. [2025-10-17T18:29:00.733532] [INFO ] [MAIN ] Update Progress: 644/2368 symbols completed. DOCS took 33.0s. Estimated remaining: 3h 58m 7s. Rate: 7.2 symbols/min [2025-10-17T18:29:00.766544] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-17T18:29:00.925680] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:29:00.925842] [DEBUG] [LOCAL ] DRD: No existing data file found in primary storage. [2025-10-17T18:29:00.925880] [WARN ] [MAIN ] DRD: No existing data found, performing full refresh instead. [2025-10-17T18:29:00.925994] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-17T18:29:00.926035] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-17T18:29:00.926077] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-10-17T18:29:00.926110] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-17T18:29:01.300855] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:29:01.558069] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-17T18:29:01.710021] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T18:29:02.358042] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-17T18:29:02.871578] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-17T18:29:02.912200] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T18:29:03.158055] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-17T18:29:03.679604] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-17T18:29:03.958038] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-17T18:29:04.414473] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T18:29:04.758038] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-17T18:29:05.558004] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-17T18:29:05.816981] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T18:29:05.957680] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-17T18:29:06.358030] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-17T18:29:07.158065] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-17T18:29:07.261286] [DEBUG] [REMOTE ] DPG: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-17T18:29:07.261569] [WARN ] [REMOTE ] DPG: No data returned for month 2025-04 [2025-10-17T18:29:07.261702] [FATAL] [REMOTE ] DPG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:29:07.261823] [FATAL] [MAIN ] DPG: Failed to fetch primary data. [2025-10-17T18:29:07.261907] [WARN ] [MAIN ] DPG: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:29:07.262002] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-17T18:29:07.262084] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-10-17T18:29:07.262122] [INFO ] [LOCAL ] DPG: Starting deletion of derivative data. [2025-10-17T18:29:07.262267] [DEBUG] [LOCAL ] DPG: Deleted derivative data file. [2025-10-17T18:29:07.262351] [INFO ] [MAIN ] Update Progress: 645/2368 symbols completed. DPG took 14.7s. Estimated remaining: 3h 57m 54s. Rate: 7.2 symbols/min [2025-10-17T18:29:07.435465] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:29:07.450854] [DEBUG] [LOCAL ] DRH: No existing data file found in primary storage. [2025-10-17T18:29:07.450952] [WARN ] [MAIN ] DRH: No existing data found, performing full refresh instead. [2025-10-17T18:29:07.461080] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-17T18:29:07.461761] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-17T18:29:07.462868] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-17T18:29:07.462735] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T18:29:07.463154] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-17T18:29:07.755014] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T18:29:07.859613] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:29:07.958033] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-17T18:29:08.758017] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-17T18:29:09.558019] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-17T18:29:09.970747] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T18:29:10.331925] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T18:29:10.357989] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-17T18:29:11.040439] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T18:29:11.157993] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-17T18:29:11.782547] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T18:29:11.958012] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-17T18:29:12.758023] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-17T18:29:12.784141] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T18:29:13.558045] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-17T18:29:13.895159] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-17T18:29:14.358081] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-17T18:29:14.388836] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T18:29:15.158022] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-17T18:29:15.215156] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T18:29:15.958025] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-17T18:29:16.283508] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T18:29:16.710677] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T18:29:16.758010] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-17T18:29:17.515447] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T18:29:17.558013] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-17T18:29:18.358007] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-17T18:29:18.408969] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T18:29:18.895571] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T18:29:19.158065] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-17T18:29:19.958076] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-17T18:29:20.104682] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T18:29:20.758047] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-17T18:29:21.002696] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T18:29:21.558040] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-17T18:29:22.065061] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-17T18:29:22.358021] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-17T18:29:22.531238] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T18:29:23.046603] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T18:29:23.157986] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-17T18:29:23.958018] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-17T18:29:24.406899] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-17T18:29:24.505371] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T18:29:24.758054] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-17T18:29:25.399884] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T18:29:25.558024] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-17T18:29:26.358035] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-17T18:29:26.400225] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T18:29:26.406407] [INFO ] [REMOTE ] DRD: Full fetch complete (51642 records). [2025-10-17T18:29:26.406510] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-17T18:29:26.783011] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-17T18:29:26.783095] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-17T18:29:26.783803] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-17T18:29:26.783867] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-17T18:29:26.785041] [DEBUG] [LOCAL ] DRD: Trimmed 51642 records to 38427 (keeping 200 days of data) [2025-10-17T18:29:27.016718] [DEBUG] [LOCAL ] DRD: Primary data saved (38427 records). [2025-10-17T18:29:27.016876] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-17T18:29:27.016953] [INFO ] [MAIN ] Update Progress: 646/2368 symbols completed. DRD took 26.3s. Estimated remaining: 3h 58m 16s. Rate: 7.2 symbols/min [2025-10-17T18:29:27.165252] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-17T18:29:27.185541] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:29:27.185777] [DEBUG] [LOCAL ] DRI: No existing data file found in primary storage. [2025-10-17T18:29:27.185825] [WARN ] [MAIN ] DRI: No existing data found, performing full refresh instead. [2025-10-17T18:29:27.185938] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-17T18:29:27.185979] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-17T18:29:27.186020] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-17T18:29:27.186053] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-17T18:29:27.576541] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:29:27.847923] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-17T18:29:27.957994] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-17T18:29:28.046584] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T18:29:28.053142] [INFO ] [REMOTE ] DQ: Full fetch complete (63581 records). [2025-10-17T18:29:28.053246] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-17T18:29:28.433251] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-17T18:29:28.433327] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-17T18:29:28.434121] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-17T18:29:28.434184] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-17T18:29:28.435370] [DEBUG] [LOCAL ] DQ: Trimmed 63581 records to 44434 (keeping 200 days of data) [2025-10-17T18:29:28.685719] [DEBUG] [LOCAL ] DQ: Primary data saved (44434 records). [2025-10-17T18:29:28.685983] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-17T18:29:28.686693] [INFO ] [MAIN ] Update Progress: 647/2368 symbols completed. DQ took 34.6s. Estimated remaining: 3h 57m 50s. Rate: 7.2 symbols/min [2025-10-17T18:29:28.760998] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-17T18:29:28.888812] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:29:28.889053] [DEBUG] [LOCAL ] DRLL: No existing data file found in primary storage. [2025-10-17T18:29:28.889115] [WARN ] [MAIN ] DRLL: No existing data found, performing full refresh instead. [2025-10-17T18:29:28.889378] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-17T18:29:28.889445] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-17T18:29:28.889528] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-17T18:29:28.889583] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-17T18:29:29.025970] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-17T18:29:29.277112] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:29:29.558054] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-17T18:29:29.848544] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T18:29:30.358068] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-17T18:29:30.589810] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T18:29:31.158021] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-17T18:29:31.348760] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T18:29:31.957996] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-17T18:29:32.361581] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-17T18:29:32.520726] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-17T18:29:32.758022] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-17T18:29:33.553640] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-17T18:29:33.557971] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-17T18:29:33.623526] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T18:29:34.352304] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T18:29:34.357977] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-17T18:29:35.158056] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-17T18:29:35.958009] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-17T18:29:36.360952] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-17T18:29:36.758010] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-17T18:29:36.881434] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T18:29:36.924319] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T18:29:37.558064] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-17T18:29:38.358077] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-17T18:29:38.410722] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T18:29:39.158056] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-17T18:29:39.286396] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-17T18:29:39.699324] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-17T18:29:39.706820] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-17T18:29:39.706938] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-17T18:29:39.963175] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-17T18:29:40.088131] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-17T18:29:40.088208] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-17T18:29:40.089048] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-17T18:29:40.089112] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-17T18:29:40.090478] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 54513 (keeping 200 days of data) [2025-10-17T18:29:40.417136] [DEBUG] [LOCAL ] DOW: Primary data saved (54513 records). [2025-10-17T18:29:40.417280] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-17T18:29:40.417395] [INFO ] [MAIN ] Update Progress: 648/2368 symbols completed. DOW took 50.4s. Estimated remaining: 3h 57m 51s. Rate: 7.2 symbols/min [2025-10-17T18:29:40.585125] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:29:40.585415] [DEBUG] [LOCAL ] DSL: No existing data file found in primary storage. [2025-10-17T18:29:40.585518] [WARN ] [MAIN ] DSL: No existing data found, performing full refresh instead. [2025-10-17T18:29:40.585721] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-17T18:29:40.585811] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-17T18:29:40.585877] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-10-17T18:29:40.585915] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-17T18:29:40.758128] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-17T18:29:40.958305] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:29:40.960409] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T18:29:40.967613] [INFO ] [REMOTE ] DRH: Full fetch complete (72086 records). [2025-10-17T18:29:40.967783] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-17T18:29:41.338975] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-17T18:29:41.363547] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-17T18:29:41.364001] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-17T18:29:41.364887] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-17T18:29:41.364966] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-17T18:29:41.366244] [DEBUG] [LOCAL ] DRH: Trimmed 72086 records to 51122 (keeping 200 days of data) [2025-10-17T18:29:41.563287] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-17T18:29:41.662744] [DEBUG] [LOCAL ] DRH: Primary data saved (51122 records). [2025-10-17T18:29:41.662968] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-17T18:29:41.663061] [INFO ] [MAIN ] Update Progress: 649/2368 symbols completed. DRH took 34.4s. Estimated remaining: 3h 57m 24s. Rate: 7.2 symbols/min [2025-10-17T18:29:41.835992] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:29:41.850856] [DEBUG] [LOCAL ] DSM: Loaded 14194 existing records from primary storage. [2025-10-17T18:29:41.851092] [INFO ] [MAIN ] DSM: Loaded 14194 existing records. [2025-10-17T18:29:42.033209] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:29:42.033786] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-17T18:29:42.033840] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-17T18:29:42.034172] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-17T18:29:42.034232] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-17T18:29:42.176672] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-17T18:29:42.363189] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-17T18:29:42.427849] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:29:43.044113] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T18:29:43.158045] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-17T18:29:43.247345] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-17T18:29:43.958017] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-17T18:29:44.344821] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T18:29:44.758033] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-17T18:29:45.273304] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-17T18:29:45.558013] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-17T18:29:45.732738] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T18:29:46.358031] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-17T18:29:47.150716] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T18:29:47.157975] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-17T18:29:47.196857] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T18:29:47.875745] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-17T18:29:47.958036] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-17T18:29:48.673930] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-17T18:29:48.758039] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-17T18:29:49.558018] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-17T18:29:50.358042] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-17T18:29:50.566882] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T18:29:50.599008] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T18:29:51.158009] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-17T18:29:51.487885] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T18:29:51.958022] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-17T18:29:52.758038] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-17T18:29:52.812899] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T18:29:52.814455] [INFO ] [REMOTE ] DRLL: Full fetch complete (14666 records). [2025-10-17T18:29:52.814523] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-17T18:29:53.189307] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-17T18:29:53.189411] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-17T18:29:53.189911] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-17T18:29:53.189983] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-17T18:29:53.217847] [DEBUG] [LOCAL ] DRLL: Trimmed 14666 records to 9219 (keeping 200 days of data) [2025-10-17T18:29:53.221108] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-17T18:29:53.286855] [DEBUG] [LOCAL ] DRLL: Primary data saved (9219 records). [2025-10-17T18:29:53.286994] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-17T18:29:53.287071] [INFO ] [MAIN ] Update Progress: 650/2368 symbols completed. DRLL took 24.6s. Estimated remaining: 3h 57m 25s. Rate: 7.2 symbols/min [2025-10-17T18:29:53.455094] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:29:53.455257] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-10-17T18:29:53.455294] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-10-17T18:29:53.455409] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-17T18:29:53.455449] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-17T18:29:53.455488] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-17T18:29:53.455519] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-17T18:29:53.563176] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-17T18:29:53.812375] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:29:53.826691] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-17T18:29:54.358057] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-17T18:29:54.930442] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T18:29:55.158037] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-17T18:29:55.524255] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T18:29:55.958073] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-17T18:29:56.493221] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T18:29:56.758041] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-17T18:29:57.318302] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T18:29:57.478408] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T18:29:57.558042] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-17T18:29:58.359209] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-17T18:29:58.362175] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-17T18:29:58.895763] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-17T18:29:59.158033] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-17T18:29:59.958055] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-17T18:30:00.758007] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-17T18:30:00.862247] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T18:30:00.905846] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T18:30:01.438178] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T18:30:01.558048] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-17T18:30:02.358037] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-17T18:30:02.846296] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T18:30:03.158092] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-17T18:30:03.651303] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-17T18:30:03.957992] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-17T18:30:04.035877] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-17T18:30:04.758034] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-17T18:30:05.550469] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T18:30:05.557995] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-17T18:30:05.852401] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-17T18:30:05.859158] [INFO ] [REMOTE ] DRI: Full fetch complete (69520 records). [2025-10-17T18:30:05.859282] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-17T18:30:06.243391] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-17T18:30:06.243472] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-17T18:30:06.244324] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-17T18:30:06.244388] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-17T18:30:06.245769] [DEBUG] [LOCAL ] DRI: Trimmed 69520 records to 48386 (keeping 200 days of data) [2025-10-17T18:30:06.358698] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-17T18:30:06.553669] [DEBUG] [LOCAL ] DRI: Primary data saved (48386 records). [2025-10-17T18:30:06.553820] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-17T18:30:06.553897] [INFO ] [MAIN ] Update Progress: 651/2368 symbols completed. DRI took 39.5s. Estimated remaining: 3h 57m 29s. Rate: 7.2 symbols/min [2025-10-17T18:30:06.681196] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T18:30:06.743407] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:30:06.749114] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-17T18:30:06.772498] [DEBUG] [LOCAL ] DSU: Loaded 23202 existing records from primary storage. [2025-10-17T18:30:06.772885] [INFO ] [MAIN ] DSU: Loaded 23202 existing records. [2025-10-17T18:30:06.951791] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:30:06.952048] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-17T18:30:06.952097] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-17T18:30:06.952370] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-17T18:30:06.952427] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-17T18:30:07.163219] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-17T18:30:07.299811] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:30:07.732272] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-17T18:30:07.958040] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-17T18:30:08.758030] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-17T18:30:09.096231] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T18:30:09.558021] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-17T18:30:10.305557] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T18:30:10.357994] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-17T18:30:10.395250] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-17T18:30:11.158017] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-17T18:30:11.608423] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-17T18:30:11.782244] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T18:30:11.958012] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-17T18:30:12.758003] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-17T18:30:13.056591] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T18:30:13.558029] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-17T18:30:13.700264] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T18:30:14.358021] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-17T18:30:14.645670] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T18:30:14.808523] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T18:30:15.158025] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-17T18:30:15.958001] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-17T18:30:16.320417] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T18:30:16.758046] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-17T18:30:17.280710] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T18:30:17.558030] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-17T18:30:18.358040] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-17T18:30:18.700228] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T18:30:19.158046] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-17T18:30:19.368458] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-17T18:30:19.370517] [INFO ] [REMOTE ] DSM: Full fetch complete (23807 records). [2025-10-17T18:30:19.370602] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-17T18:30:19.371327] [FATAL] [VALIDATOR ] DSM: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:30:19.371447] [FATAL] [MAIN ] DSM: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:30:19.371491] [WARN ] [MAIN ] DSM: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:30:19.371533] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-17T18:30:19.371593] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-10-17T18:30:19.371630] [INFO ] [LOCAL ] DSM: Starting deletion of derivative data. [2025-10-17T18:30:19.371838] [DEBUG] [LOCAL ] DSM: Deleted derivative data file. [2025-10-17T18:30:19.371937] [INFO ] [MAIN ] Update Progress: 652/2368 symbols completed. DSM took 37.7s. Estimated remaining: 3h 57m 33s. Rate: 7.2 symbols/min [2025-10-17T18:30:19.560373] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:30:19.584329] [DEBUG] [LOCAL ] DSX: Loaded 24160 existing records from primary storage. [2025-10-17T18:30:19.584603] [INFO ] [MAIN ] DSX: Loaded 24160 existing records. [2025-10-17T18:30:19.704598] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T18:30:19.799820] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:30:19.800074] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-17T18:30:19.800128] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-17T18:30:19.800393] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-17T18:30:19.800451] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-17T18:30:19.963270] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-17T18:30:20.202240] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:30:20.202810] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T18:30:20.736213] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T18:30:20.758030] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-17T18:30:21.558041] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-17T18:30:21.884480] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-17T18:30:21.889453] [INFO ] [REMOTE ] DSL: Full fetch complete (41776 records). [2025-10-17T18:30:21.889540] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-17T18:30:22.260256] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-17T18:30:22.260344] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-17T18:30:22.260982] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-17T18:30:22.261043] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-17T18:30:22.261965] [DEBUG] [LOCAL ] DSL: Trimmed 41776 records to 29410 (keeping 200 days of data) [2025-10-17T18:30:22.367855] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-17T18:30:22.449072] [DEBUG] [LOCAL ] DSL: Primary data saved (29410 records). [2025-10-17T18:30:22.449230] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-17T18:30:22.449352] [INFO ] [MAIN ] Update Progress: 653/2368 symbols completed. DSL took 42.0s. Estimated remaining: 3h 57m 11s. Rate: 7.2 symbols/min [2025-10-17T18:30:22.619368] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:30:22.668784] [DEBUG] [LOCAL ] DT: Loaded 53331 existing records from primary storage. [2025-10-17T18:30:22.669127] [INFO ] [MAIN ] DT: Loaded 53331 existing records. [2025-10-17T18:30:22.787799] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-17T18:30:22.869083] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:30:22.871997] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-17T18:30:22.871889] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-17T18:30:22.872950] [INFO ] [REMOTE ] DSMC: Full fetch complete (2859 records). [2025-10-17T18:30:22.873075] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-17T18:30:22.873157] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-17T18:30:22.952218] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-17T18:30:22.975050] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-17T18:30:23.159233] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-17T18:30:23.648944] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-17T18:30:23.669342] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-17T18:30:23.691631] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-17T18:30:23.691770] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-17T18:30:23.692854] [DEBUG] [LOCAL ] DSMC: Trimmed 2859 records to 1866 (keeping 200 days of data) [2025-10-17T18:30:23.691290] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:30:23.705808] [DEBUG] [LOCAL ] DSMC: Primary data saved (1866 records). [2025-10-17T18:30:23.705893] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-17T18:30:23.705984] [INFO ] [MAIN ] Update Progress: 654/2368 symbols completed. DSMC took 30.4s. Estimated remaining: 3h 56m 44s. Rate: 7.2 symbols/min [2025-10-17T18:30:23.871953] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:30:23.883237] [DEBUG] [LOCAL ] DTB: Loaded 5017 existing records from primary storage. [2025-10-17T18:30:23.883448] [INFO ] [MAIN ] DTB: Loaded 5017 existing records. [2025-10-17T18:30:23.963256] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-17T18:30:24.059257] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:30:24.059471] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-17T18:30:24.059521] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-17T18:30:24.059705] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-17T18:30:24.059762] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-17T18:30:24.413078] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:30:24.707686] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-17T18:30:24.758117] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-17T18:30:25.558045] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-17T18:30:25.990593] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T18:30:26.023513] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T18:30:26.357989] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-17T18:30:26.719004] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T18:30:27.158047] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-17T18:30:27.578104] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T18:30:27.958033] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-17T18:30:28.050774] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-17T18:30:28.758048] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-17T18:30:29.558028] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-17T18:30:29.736884] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T18:30:29.976286] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T18:30:30.358083] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-17T18:30:31.019092] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-17T18:30:31.047246] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T18:30:31.158067] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-17T18:30:31.958036] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-17T18:30:32.443279] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T18:30:32.756452] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T18:30:32.765632] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-17T18:30:33.558055] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-17T18:30:34.063148] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T18:30:34.358042] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-17T18:30:34.919455] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T18:30:34.923760] [INFO ] [REMOTE ] DSU: Full fetch complete (33165 records). [2025-10-17T18:30:34.923909] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-17T18:30:35.030951] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-17T18:30:35.163174] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-17T18:30:35.313825] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-17T18:30:35.313903] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-17T18:30:35.314455] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-17T18:30:35.314495] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-17T18:30:35.315360] [DEBUG] [LOCAL ] DSU: Trimmed 33165 records to 23392 (keeping 200 days of data) [2025-10-17T18:30:35.451082] [DEBUG] [LOCAL ] DSU: Primary data saved (23392 records). [2025-10-17T18:30:35.451206] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-17T18:30:35.451283] [INFO ] [MAIN ] Update Progress: 655/2368 symbols completed. DSU took 28.9s. Estimated remaining: 3h 56m 45s. Rate: 7.2 symbols/min [2025-10-17T18:30:35.618793] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:30:35.665163] [DEBUG] [LOCAL ] DTE: Loaded 47720 existing records from primary storage. [2025-10-17T18:30:35.665480] [INFO ] [MAIN ] DTE: Loaded 47720 existing records. [2025-10-17T18:30:35.841052] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:30:35.841316] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-17T18:30:35.841376] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-17T18:30:35.841734] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-17T18:30:35.841802] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-17T18:30:35.945078] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-17T18:30:35.960726] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-17T18:30:36.197212] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:30:36.758062] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-17T18:30:37.392256] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T18:30:37.558026] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-17T18:30:38.358030] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-17T18:30:38.637848] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T18:30:38.738253] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T18:30:38.987169] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T18:30:39.158054] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-17T18:30:39.958039] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-17T18:30:40.758098] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-17T18:30:41.052110] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T18:30:41.402056] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-17T18:30:41.558003] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-17T18:30:42.046763] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-17T18:30:42.358020] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-17T18:30:42.700087] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T18:30:43.158116] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-17T18:30:43.958017] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-17T18:30:44.285811] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T18:30:44.339367] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-17T18:30:44.439896] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-17T18:30:44.758078] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-17T18:30:45.558045] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-17T18:30:46.364279] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-17T18:30:46.382944] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T18:30:46.653354] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T18:30:47.158020] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-17T18:30:47.958012] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-17T18:30:48.104597] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T18:30:48.333094] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T18:30:48.552981] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-17T18:30:48.758047] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-17T18:30:49.545509] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T18:30:49.558023] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-17T18:30:50.358042] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-17T18:30:50.808425] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T18:30:50.813522] [INFO ] [REMOTE ] DSX: Full fetch complete (35826 records). [2025-10-17T18:30:50.813741] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-17T18:30:51.159117] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-17T18:30:51.203671] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-17T18:30:51.203769] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-17T18:30:51.204362] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-17T18:30:51.204406] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-17T18:30:51.205379] [DEBUG] [LOCAL ] DSX: Trimmed 35826 records to 24294 (keeping 200 days of data) [2025-10-17T18:30:51.343291] [DEBUG] [LOCAL ] DSX: Primary data saved (24294 records). [2025-10-17T18:30:51.343432] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-17T18:30:51.343572] [INFO ] [MAIN ] Update Progress: 656/2368 symbols completed. DSX took 32.0s. Estimated remaining: 3h 56m 56s. Rate: 7.2 symbols/min [2025-10-17T18:30:51.511351] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:30:51.511544] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-17T18:30:51.511582] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-17T18:30:51.511722] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-17T18:30:51.511771] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-17T18:30:51.511812] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-17T18:30:51.511900] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-17T18:30:51.907868] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:30:51.957996] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-17T18:30:52.113542] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T18:30:52.705747] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T18:30:52.758019] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-17T18:30:52.952809] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T18:30:53.558070] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-17T18:30:53.917936] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-17T18:30:54.358039] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-17T18:30:54.404844] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T18:30:54.712139] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-17T18:30:55.158034] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-17T18:30:55.958058] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-17T18:30:56.405942] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-17T18:30:56.758034] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-17T18:30:57.014020] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T18:30:57.558060] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-17T18:30:58.358034] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-17T18:30:58.562955] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T18:30:58.797181] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-17T18:30:59.158087] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-17T18:30:59.380980] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T18:30:59.958092] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-17T18:31:00.504708] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-17T18:31:00.758004] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-17T18:31:01.179992] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T18:31:01.249258] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-17T18:31:01.256180] [INFO ] [REMOTE ] DT: Full fetch complete (76503 records). [2025-10-17T18:31:01.256307] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-17T18:31:01.257165] [FATAL] [VALIDATOR ] DT: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:31:01.257259] [FATAL] [MAIN ] DT: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:31:01.257301] [WARN ] [MAIN ] DT: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:31:01.257392] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-17T18:31:01.257476] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-10-17T18:31:01.257514] [INFO ] [LOCAL ] DT: Starting deletion of derivative data. [2025-10-17T18:31:01.257675] [DEBUG] [LOCAL ] DT: Deleted derivative data file. [2025-10-17T18:31:01.257787] [INFO ] [MAIN ] Update Progress: 657/2368 symbols completed. DT took 38.8s. Estimated remaining: 3h 56m 52s. Rate: 7.2 symbols/min [2025-10-17T18:31:01.435803] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:01.436002] [DEBUG] [LOCAL ] DTG: No existing data file found in primary storage. [2025-10-17T18:31:01.436063] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-10-17T18:31:01.436191] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-17T18:31:01.436234] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-17T18:31:01.436278] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-17T18:31:01.436313] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-17T18:31:01.563196] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-17T18:31:01.827272] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:02.195274] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-17T18:31:02.358063] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-17T18:31:03.158101] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-17T18:31:03.180902] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-17T18:31:03.708368] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-17T18:31:03.958083] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-17T18:31:04.676060] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T18:31:04.758048] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-17T18:31:05.487356] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T18:31:05.488472] [INFO ] [REMOTE ] DTB: Full fetch complete (6628 records). [2025-10-17T18:31:05.488541] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-17T18:31:05.563098] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-17T18:31:05.846461] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-17T18:31:05.846556] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-17T18:31:05.846778] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-17T18:31:05.846839] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-17T18:31:05.847252] [DEBUG] [LOCAL ] DTB: Trimmed 6628 records to 5028 (keeping 200 days of data) [2025-10-17T18:31:05.877710] [DEBUG] [LOCAL ] DTB: Primary data saved (5028 records). [2025-10-17T18:31:05.877798] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-17T18:31:05.877874] [INFO ] [MAIN ] Update Progress: 658/2368 symbols completed. DTB took 42.2s. Estimated remaining: 3h 56m 34s. Rate: 7.2 symbols/min [2025-10-17T18:31:06.042818] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:06.042966] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-17T18:31:06.043037] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-17T18:31:06.043153] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-17T18:31:06.043194] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-17T18:31:06.043235] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-17T18:31:06.043267] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-17T18:31:06.304414] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-17T18:31:06.365320] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-17T18:31:06.406720] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:06.850998] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-17T18:31:07.158027] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-17T18:31:07.666218] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-17T18:31:07.666964] [INFO ] [REMOTE ] DTF: Full fetch complete (1746 records). [2025-10-17T18:31:07.667031] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-17T18:31:07.667413] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:31:07.667513] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:31:07.667605] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:31:07.667718] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-17T18:31:07.667789] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-17T18:31:07.667825] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-17T18:31:07.667864] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-17T18:31:07.667915] [INFO ] [MAIN ] Update Progress: 659/2368 symbols completed. DTF took 16.3s. Estimated remaining: 3h 56m 9s. Rate: 7.2 symbols/min [2025-10-17T18:31:07.844429] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:07.887150] [DEBUG] [LOCAL ] DTM: Loaded 44243 existing records from primary storage. [2025-10-17T18:31:07.887467] [INFO ] [MAIN ] DTM: Loaded 44243 existing records. [2025-10-17T18:31:07.963170] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-17T18:31:08.069893] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:31:08.070083] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-17T18:31:08.070129] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-17T18:31:08.070371] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-17T18:31:08.070428] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-17T18:31:08.424985] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:08.758030] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-17T18:31:09.558010] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-17T18:31:09.697943] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T18:31:09.792280] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:31:09.792596] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-17T18:31:09.792727] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:31:09.792840] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-17T18:31:09.792907] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:31:09.792980] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-17T18:31:09.793044] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-17T18:31:09.793081] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-17T18:31:09.793118] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-17T18:31:09.793164] [INFO ] [MAIN ] Update Progress: 660/2368 symbols completed. DTK took 3.9s. Estimated remaining: 3h 55m 45s. Rate: 7.2 symbols/min [2025-10-17T18:31:09.965983] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:09.974834] [DEBUG] [LOCAL ] DTW: Loaded 4840 existing records from primary storage. [2025-10-17T18:31:09.975054] [INFO ] [MAIN ] DTW: Loaded 4840 existing records. [2025-10-17T18:31:10.152435] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:31:10.152732] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-17T18:31:10.152790] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-17T18:31:10.152940] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-17T18:31:10.152996] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-17T18:31:10.363364] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-17T18:31:10.518859] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:10.713074] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T18:31:11.140099] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-17T18:31:11.157984] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-17T18:31:11.882357] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T18:31:11.958035] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-17T18:31:12.758036] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-17T18:31:12.872397] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T18:31:13.558036] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-17T18:31:14.265546] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-17T18:31:14.358027] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-17T18:31:14.438808] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T18:31:14.981349] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T18:31:15.158059] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-17T18:31:15.958060] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-17T18:31:16.758009] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-17T18:31:17.023296] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-17T18:31:17.145763] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-17T18:31:17.565160] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-17T18:31:17.583719] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T18:31:18.358015] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-17T18:31:19.158023] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-17T18:31:19.329459] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T18:31:19.738068] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-17T18:31:19.922321] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T18:31:19.957991] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-17T18:31:20.545249] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T18:31:20.758009] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-17T18:31:21.558037] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-17T18:31:22.164524] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-17T18:31:22.358085] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-17T18:31:22.670672] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T18:31:23.125547] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-17T18:31:23.158078] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-17T18:31:23.539530] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-17T18:31:23.958032] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-17T18:31:24.536267] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T18:31:24.758061] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-17T18:31:25.558012] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-17T18:31:25.630358] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T18:31:26.358027] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-17T18:31:27.023754] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-17T18:31:27.158082] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-17T18:31:27.356043] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T18:31:27.958370] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-17T18:31:27.961493] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T18:31:27.963123] [INFO ] [REMOTE ] DTG: Full fetch complete (8648 records). [2025-10-17T18:31:27.963228] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-17T18:31:28.312779] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-17T18:31:28.312858] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-17T18:31:28.313095] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-17T18:31:28.313134] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-17T18:31:28.313607] [DEBUG] [LOCAL ] DTG: Trimmed 8648 records to 5859 (keeping 200 days of data) [2025-10-17T18:31:28.349329] [DEBUG] [LOCAL ] DTG: Primary data saved (5859 records). [2025-10-17T18:31:28.349456] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-17T18:31:28.349530] [INFO ] [MAIN ] Update Progress: 661/2368 symbols completed. DTG took 27.1s. Estimated remaining: 3h 56m 3s. Rate: 7.2 symbols/min [2025-10-17T18:31:28.517611] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:28.570330] [DEBUG] [LOCAL ] DUK: Loaded 53827 existing records from primary storage. [2025-10-17T18:31:28.570682] [INFO ] [MAIN ] DUK: Loaded 53827 existing records. [2025-10-17T18:31:28.750217] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:31:28.750522] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-17T18:31:28.750587] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-17T18:31:28.750888] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-17T18:31:28.750948] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-17T18:31:28.763682] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-17T18:31:28.886480] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T18:31:28.947498] [INFO ] [REMOTE ] DTE: Full fetch complete (68961 records). [2025-10-17T18:31:28.978426] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-17T18:31:29.313579] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:29.535221] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-17T18:31:29.535302] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-17T18:31:29.536100] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-17T18:31:29.536163] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-17T18:31:29.537522] [DEBUG] [LOCAL ] DTE: Trimmed 68961 records to 48020 (keeping 200 days of data) [2025-10-17T18:31:29.595300] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-17T18:31:29.837772] [DEBUG] [LOCAL ] DTE: Primary data saved (48020 records). [2025-10-17T18:31:29.837900] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-17T18:31:29.839093] [INFO ] [MAIN ] Update Progress: 662/2368 symbols completed. DTE took 54.4s. Estimated remaining: 3h 55m 37s. Rate: 7.2 symbols/min [2025-10-17T18:31:30.003448] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:30.012826] [DEBUG] [LOCAL ] DUKB: Loaded 6305 existing records from primary storage. [2025-10-17T18:31:30.013048] [INFO ] [MAIN ] DUKB: Loaded 6305 existing records. [2025-10-17T18:31:30.195620] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:31:30.195973] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-17T18:31:30.196042] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-17T18:31:30.196223] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-17T18:31:30.196280] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-17T18:31:30.311393] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-17T18:31:30.360394] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-17T18:31:30.575068] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:30.665690] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T18:31:31.121956] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-17T18:31:31.158004] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-17T18:31:31.758752] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-17T18:31:31.958030] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-17T18:31:32.557548] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T18:31:32.558684] [INFO ] [REMOTE ] DTW: Full fetch complete (7132 records). [2025-10-17T18:31:32.558756] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-17T18:31:32.763125] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-17T18:31:32.922250] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-17T18:31:32.922330] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-17T18:31:32.922525] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-17T18:31:32.922565] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-17T18:31:32.922979] [DEBUG] [LOCAL ] DTW: Trimmed 7132 records to 4872 (keeping 200 days of data) [2025-10-17T18:31:32.951785] [DEBUG] [LOCAL ] DTW: Primary data saved (4872 records). [2025-10-17T18:31:32.951903] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-17T18:31:32.951987] [INFO ] [MAIN ] Update Progress: 663/2368 symbols completed. DTW took 23.2s. Estimated remaining: 3h 55m 16s. Rate: 7.2 symbols/min [2025-10-17T18:31:33.122691] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:33.178230] [DEBUG] [LOCAL ] DV: Loaded 51681 existing records from primary storage. [2025-10-17T18:31:33.178670] [INFO ] [MAIN ] DV: Loaded 51681 existing records. [2025-10-17T18:31:33.356003] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:31:33.356206] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-17T18:31:33.356255] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-17T18:31:33.356450] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-17T18:31:33.356519] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-17T18:31:33.563104] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-17T18:31:33.710031] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:34.357990] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-17T18:31:34.515962] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T18:31:34.813846] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T18:31:35.158057] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-17T18:31:35.963202] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-17T18:31:35.977390] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T18:31:36.682598] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T18:31:36.758003] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-17T18:31:36.826817] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T18:31:37.558024] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-17T18:31:38.279192] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T18:31:38.357995] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-17T18:31:39.158036] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-17T18:31:39.447570] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-17T18:31:39.830071] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T18:31:39.950695] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T18:31:39.959796] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-17T18:31:40.648226] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-17T18:31:40.758014] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-17T18:31:41.558036] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-17T18:31:42.349954] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T18:31:42.359167] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-17T18:31:43.110009] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-17T18:31:43.157984] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-17T18:31:43.221058] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T18:31:43.832610] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-17T18:31:43.957994] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-17T18:31:44.758001] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-17T18:31:44.775849] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T18:31:45.558129] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-17T18:31:46.358113] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-17T18:31:46.667694] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-17T18:31:47.158008] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-17T18:31:47.269882] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T18:31:47.958047] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-17T18:31:48.410133] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-17T18:31:48.757996] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-17T18:31:49.295989] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-17T18:31:49.558004] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-17T18:31:49.699499] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T18:31:49.705771] [INFO ] [REMOTE ] DTM: Full fetch complete (65068 records). [2025-10-17T18:31:49.705881] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-17T18:31:50.100564] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-17T18:31:50.100664] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-17T18:31:50.101457] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-17T18:31:50.101500] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-17T18:31:50.102713] [DEBUG] [LOCAL ] DTM: Trimmed 65068 records to 44538 (keeping 200 days of data) [2025-10-17T18:31:50.365366] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-17T18:31:50.381429] [DEBUG] [LOCAL ] DTM: Primary data saved (44538 records). [2025-10-17T18:31:50.382686] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-17T18:31:50.383255] [INFO ] [MAIN ] Update Progress: 664/2368 symbols completed. DTM took 42.7s. Estimated remaining: 3h 55m 31s. Rate: 7.2 symbols/min [2025-10-17T18:31:50.554939] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:50.586194] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T18:31:50.635761] [DEBUG] [LOCAL ] DVA: Loaded 41337 existing records from primary storage. [2025-10-17T18:31:50.636079] [INFO ] [MAIN ] DVA: Loaded 41337 existing records. [2025-10-17T18:31:50.812758] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:31:50.812994] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-17T18:31:50.813045] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-17T18:31:50.813319] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-17T18:31:50.813359] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-17T18:31:51.180835] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:51.171286] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-17T18:31:51.183792] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-17T18:31:51.583623] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-17T18:31:51.958046] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-17T18:31:52.758318] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-17T18:31:52.758245] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T18:31:53.355840] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T18:31:53.558051] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-17T18:31:53.944165] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T18:31:54.358011] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-17T18:31:55.111886] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-17T18:31:55.158030] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-17T18:31:55.263433] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T18:31:55.958030] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-17T18:31:56.758030] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-17T18:31:56.826355] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T18:31:57.426786] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-17T18:31:57.428045] [INFO ] [REMOTE ] DUKB: Full fetch complete (9161 records). [2025-10-17T18:31:57.428121] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-17T18:31:57.565529] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-17T18:31:57.796173] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-17T18:31:57.796321] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-17T18:31:57.796701] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-17T18:31:57.796783] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-17T18:31:57.797471] [DEBUG] [LOCAL ] DUKB: Trimmed 9161 records to 6333 (keeping 200 days of data) [2025-10-17T18:31:57.835061] [DEBUG] [LOCAL ] DUKB: Primary data saved (6333 records). [2025-10-17T18:31:57.835145] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-17T18:31:57.835218] [INFO ] [MAIN ] Update Progress: 665/2368 symbols completed. DUKB took 28.0s. Estimated remaining: 3h 55m 21s. Rate: 7.2 symbols/min [2025-10-17T18:31:58.005377] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:31:58.035918] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-17T18:31:58.093344] [DEBUG] [LOCAL ] DVN: Loaded 54089 existing records from primary storage. [2025-10-17T18:31:58.093677] [INFO ] [MAIN ] DVN: Loaded 54089 existing records. [2025-10-17T18:31:58.266831] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:31:58.267020] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-17T18:31:58.267068] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-17T18:31:58.267581] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-17T18:31:58.267636] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-17T18:31:58.363200] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-17T18:31:58.620082] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:31:59.166874] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-17T18:31:59.169506] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:31:59.958025] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-17T18:32:00.088898] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T18:32:00.758091] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-17T18:32:01.318726] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-17T18:32:01.558039] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-17T18:32:02.343014] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-17T18:32:02.357994] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-17T18:32:02.894185] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-17T18:32:03.158027] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-17T18:32:03.450270] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T18:32:03.958062] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-17T18:32:04.072479] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T18:32:04.758077] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-17T18:32:05.150850] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T18:32:05.558039] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-17T18:32:05.707954] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T18:32:06.357979] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-17T18:32:06.419915] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T18:32:06.427544] [INFO ] [REMOTE ] DUK: Full fetch complete (77568 records). [2025-10-17T18:32:06.427744] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-17T18:32:06.561041] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T18:32:06.861503] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-17T18:32:06.861631] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-17T18:32:06.862560] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-17T18:32:06.862610] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-17T18:32:06.864188] [DEBUG] [LOCAL ] DUK: Trimmed 77568 records to 54217 (keeping 200 days of data) [2025-10-17T18:32:07.175073] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-17T18:32:07.212570] [DEBUG] [LOCAL ] DUK: Primary data saved (54217 records). [2025-10-17T18:32:07.212743] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-17T18:32:07.212846] [INFO ] [MAIN ] Update Progress: 666/2368 symbols completed. DUK took 38.9s. Estimated remaining: 3h 55m 15s. Rate: 7.2 symbols/min [2025-10-17T18:32:07.400621] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:32:07.400801] [DEBUG] [LOCAL ] DX: No existing data file found in primary storage. [2025-10-17T18:32:07.400842] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-10-17T18:32:07.400964] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-17T18:32:07.401005] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-17T18:32:07.401046] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-17T18:32:07.401078] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-17T18:32:07.748002] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:32:07.958012] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-17T18:32:08.180222] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-17T18:32:08.756904] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T18:32:08.765472] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-17T18:32:09.558003] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-17T18:32:09.855439] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T18:32:10.358041] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-17T18:32:10.439070] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T18:32:11.125873] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T18:32:11.157984] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-17T18:32:11.958014] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-17T18:32:12.558944] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-17T18:32:12.635802] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T18:32:12.758025] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-17T18:32:13.471615] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T18:32:13.558013] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-17T18:32:14.237869] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T18:32:14.358031] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-17T18:32:15.158091] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-17T18:32:15.457510] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-17T18:32:15.958036] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-17T18:32:16.189426] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T18:32:16.758004] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-17T18:32:17.173441] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-17T18:32:17.558060] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-17T18:32:18.034570] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-17T18:32:18.358017] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-17T18:32:18.653467] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T18:32:19.158002] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-17T18:32:19.422516] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-17T18:32:19.429919] [INFO ] [REMOTE ] DV: Full fetch complete (73864 records). [2025-10-17T18:32:19.430043] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-17T18:32:19.827864] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-17T18:32:19.827945] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-17T18:32:19.828911] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-17T18:32:19.828975] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-17T18:32:19.830439] [DEBUG] [LOCAL ] DV: Trimmed 73864 records to 52038 (keeping 200 days of data) [2025-10-17T18:32:19.996936] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-17T18:32:20.144475] [DEBUG] [LOCAL ] DV: Primary data saved (52038 records). [2025-10-17T18:32:20.144624] [INFO ] [MAIN ] DV: Full history saved. [2025-10-17T18:32:20.144749] [INFO ] [MAIN ] Update Progress: 667/2368 symbols completed. DV took 47.2s. Estimated remaining: 3h 55m 19s. Rate: 7.2 symbols/min [2025-10-17T18:32:20.319735] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:32:20.374636] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-17T18:32:20.401018] [DEBUG] [LOCAL ] DXC: Loaded 50260 existing records from primary storage. [2025-10-17T18:32:20.401322] [INFO ] [MAIN ] DXC: Loaded 50260 existing records. [2025-10-17T18:32:20.582363] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:32:20.582599] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-17T18:32:20.582686] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-17T18:32:20.583018] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-17T18:32:20.583088] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-17T18:32:20.773240] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-17T18:32:20.987328] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:32:20.989421] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T18:32:21.558085] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-17T18:32:22.118499] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-17T18:32:22.358037] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-17T18:32:23.095080] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-17T18:32:23.158067] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-17T18:32:23.192799] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T18:32:23.860068] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T18:32:23.958141] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-17T18:32:24.758044] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-17T18:32:25.398243] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T18:32:25.403837] [INFO ] [REMOTE ] DVA: Full fetch complete (59722 records). [2025-10-17T18:32:25.403951] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-17T18:32:25.564765] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-17T18:32:25.781300] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-17T18:32:25.781386] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-17T18:32:25.782148] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-17T18:32:25.782212] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-17T18:32:25.783378] [DEBUG] [LOCAL ] DVA: Trimmed 59722 records to 41554 (keeping 200 days of data) [2025-10-17T18:32:26.032023] [DEBUG] [LOCAL ] DVA: Primary data saved (41554 records). [2025-10-17T18:32:26.032208] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-17T18:32:26.033055] [INFO ] [MAIN ] Update Progress: 668/2368 symbols completed. DVA took 35.6s. Estimated remaining: 3h 55m 4s. Rate: 7.2 symbols/min [2025-10-17T18:32:26.225525] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:32:26.268817] [DEBUG] [LOCAL ] DXYZ: Loaded 37483 existing records from primary storage. [2025-10-17T18:32:26.269385] [INFO ] [MAIN ] DXYZ: Loaded 37483 existing records. [2025-10-17T18:32:26.379428] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T18:32:26.420809] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-17T18:32:26.508320] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:32:26.508544] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-17T18:32:26.508593] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-17T18:32:26.508969] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-17T18:32:26.509038] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-17T18:32:26.863858] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:32:27.158052] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-17T18:32:27.518805] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-17T18:32:27.922986] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T18:32:27.958023] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-17T18:32:28.712270] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (5.55 seconds). [2025-10-17T18:32:28.757997] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-17T18:32:29.511052] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T18:32:29.571630] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-17T18:32:29.576851] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-17T18:32:30.358009] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-17T18:32:30.670436] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T18:32:30.738940] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T18:32:31.158036] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-17T18:32:31.958060] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-17T18:32:32.625752] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-17T18:32:32.758010] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-17T18:32:33.295226] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-17T18:32:33.558052] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-17T18:32:34.193457] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-17T18:32:34.358032] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-17T18:32:34.569193] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T18:32:35.158006] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-17T18:32:35.296676] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T18:32:35.303806] [INFO ] [REMOTE ] DVN: Full fetch complete (77489 records). [2025-10-17T18:32:35.304014] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-17T18:32:35.305012] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:32:35.305100] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:32:35.305144] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:32:35.305185] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-17T18:32:35.305243] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-17T18:32:35.305282] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-10-17T18:32:35.305426] [DEBUG] [LOCAL ] DVN: Deleted derivative data file. [2025-10-17T18:32:35.305979] [INFO ] [MAIN ] Update Progress: 669/2368 symbols completed. DVN took 37.5s. Estimated remaining: 3h 54m 58s. Rate: 7.2 symbols/min [2025-10-17T18:32:35.481696] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:32:35.514814] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T18:32:35.549048] [DEBUG] [LOCAL ] DY: Loaded 28641 existing records from primary storage. [2025-10-17T18:32:35.549302] [INFO ] [MAIN ] DY: Loaded 28641 existing records. [2025-10-17T18:32:35.721635] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:32:35.721868] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-17T18:32:35.721923] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-17T18:32:35.722248] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-17T18:32:35.722286] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-17T18:32:35.966848] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-17T18:32:36.069141] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:32:36.758041] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-17T18:32:37.085668] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-17T18:32:37.558038] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-17T18:32:38.061358] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-17T18:32:38.358071] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-17T18:32:38.521720] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T18:32:39.157997] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-17T18:32:39.253668] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T18:32:39.958015] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-17T18:32:40.252950] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T18:32:40.507167] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T18:32:40.758044] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-17T18:32:41.557998] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-17T18:32:41.970587] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-17T18:32:42.358051] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-17T18:32:42.462077] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T18:32:42.527266] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T18:32:43.158018] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-17T18:32:43.958034] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-17T18:32:44.344748] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T18:32:44.758063] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-17T18:32:45.054979] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T18:32:45.558035] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-17T18:32:46.367076] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-17T18:32:46.370076] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-17T18:32:46.380367] [INFO ] [REMOTE ] DX: Full fetch complete (75837 records). [2025-10-17T18:32:46.380542] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-17T18:32:46.771131] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-17T18:32:46.771211] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-17T18:32:46.772091] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-17T18:32:46.772156] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-17T18:32:46.773550] [DEBUG] [LOCAL ] DX: Trimmed 75837 records to 53271 (keeping 200 days of data) [2025-10-17T18:32:47.101940] [DEBUG] [LOCAL ] DX: Primary data saved (53271 records). [2025-10-17T18:32:47.102133] [INFO ] [MAIN ] DX: Full history saved. [2025-10-17T18:32:47.102237] [INFO ] [MAIN ] Update Progress: 670/2368 symbols completed. DX took 39.9s. Estimated remaining: 3h 54m 59s. Rate: 7.2 symbols/min [2025-10-17T18:32:47.271150] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:32:47.303166] [DEBUG] [LOCAL ] E: Loaded 33514 existing records from primary storage. [2025-10-17T18:32:47.303443] [INFO ] [MAIN ] E: Loaded 33514 existing records. [2025-10-17T18:32:47.478062] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:32:47.478394] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-17T18:32:47.478567] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-17T18:32:47.478896] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-17T18:32:47.478969] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-17T18:32:47.624445] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-17T18:32:47.688804] [INFO ] [REMOTE ] DXC: Full fetch complete (70142 records). [2025-10-17T18:32:47.739993] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-17T18:32:48.010446] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:32:48.016675] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-17T18:32:48.348551] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-17T18:32:48.348694] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-17T18:32:48.349898] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-17T18:32:48.349983] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-17T18:32:48.352439] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (3.59 seconds). [2025-10-17T18:32:48.360831] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-17T18:32:48.362914] [DEBUG] [LOCAL ] DXC: Trimmed 70142 records to 50621 (keeping 200 days of data) [2025-10-17T18:32:48.655762] [DEBUG] [LOCAL ] DXC: Primary data saved (50621 records). [2025-10-17T18:32:48.655893] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-17T18:32:48.655996] [INFO ] [MAIN ] Update Progress: 671/2368 symbols completed. DXC took 28.5s. Estimated remaining: 3h 54m 34s. Rate: 7.2 symbols/min [2025-10-17T18:32:48.821196] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:32:48.860680] [DEBUG] [LOCAL ] EAF: Loaded 41935 existing records from primary storage. [2025-10-17T18:32:48.860986] [INFO ] [MAIN ] EAF: Loaded 41935 existing records. [2025-10-17T18:32:49.035618] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:32:49.035840] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-17T18:32:49.035889] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-17T18:32:49.036087] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-17T18:32:49.036151] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-17T18:32:49.389158] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:32:49.389567] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-17T18:32:49.546218] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T18:32:49.557972] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-17T18:32:50.517979] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (4.15 seconds). [2025-10-17T18:32:50.526277] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-17T18:32:51.239502] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T18:32:51.254448] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-17T18:32:51.517043] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (3.16 seconds). [2025-10-17T18:32:51.958052] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-17T18:32:52.463177] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (2.91 seconds). [2025-10-17T18:32:52.501091] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T18:32:52.758069] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-17T18:32:53.402387] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T18:32:53.514406] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-17T18:32:53.558007] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-17T18:32:53.783008] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T18:32:54.358102] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-17T18:32:55.128120] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T18:32:55.157983] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-17T18:32:55.805205] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T18:32:55.958060] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-17T18:32:56.752298] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T18:32:56.762001] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-17T18:32:57.082992] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T18:32:57.558028] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-17T18:32:58.358047] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-17T18:32:58.731083] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T18:32:58.819056] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-17T18:32:59.158027] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-17T18:32:59.925315] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T18:32:59.958075] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-17T18:33:00.563312] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-17T18:33:00.758057] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-17T18:33:01.558041] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-17T18:33:01.827149] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:33:02.358066] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-17T18:33:02.978185] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-17T18:33:03.158040] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-17T18:33:03.192082] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T18:33:03.785505] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T18:33:03.958065] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-17T18:33:04.758062] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-17T18:33:05.130475] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T18:33:05.385678] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T18:33:05.558023] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-17T18:33:06.173772] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T18:33:06.358004] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-17T18:33:06.921241] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T18:33:06.924913] [INFO ] [REMOTE ] DY: Full fetch complete (43488 records). [2025-10-17T18:33:06.925003] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-17T18:33:07.168273] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-17T18:33:07.312688] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-17T18:33:07.312804] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-17T18:33:07.313471] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-17T18:33:07.313533] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-17T18:33:07.314507] [DEBUG] [LOCAL ] DY: Trimmed 43488 records to 28800 (keeping 200 days of data) [2025-10-17T18:33:07.493700] [DEBUG] [LOCAL ] DY: Primary data saved (28800 records). [2025-10-17T18:33:07.493862] [INFO ] [MAIN ] DY: Full history saved. [2025-10-17T18:33:07.493952] [INFO ] [MAIN ] Update Progress: 672/2368 symbols completed. DY took 32.2s. Estimated remaining: 3h 54m 52s. Rate: 7.2 symbols/min [2025-10-17T18:33:07.668758] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:33:07.675128] [DEBUG] [LOCAL ] EAI: Loaded 3998 existing records from primary storage. [2025-10-17T18:33:07.675312] [INFO ] [MAIN ] EAI: Loaded 3998 existing records. [2025-10-17T18:33:07.853208] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:33:07.853559] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-17T18:33:07.853672] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-17T18:33:07.853876] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-17T18:33:07.853999] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-17T18:33:07.959108] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-17T18:33:08.169001] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T18:33:08.265270] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:33:08.758033] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-17T18:33:09.515889] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T18:33:09.560333] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-17T18:33:09.564177] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T18:33:09.586124] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-17T18:33:09.592561] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57163 records). [2025-10-17T18:33:09.592824] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-17T18:33:10.000455] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-17T18:33:10.000576] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-17T18:33:10.001479] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-17T18:33:10.001546] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-17T18:33:10.002909] [DEBUG] [LOCAL ] DXYZ: Trimmed 57163 records to 37760 (keeping 200 days of data) [2025-10-17T18:33:10.237110] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37760 records). [2025-10-17T18:33:10.237252] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-17T18:33:10.237340] [INFO ] [MAIN ] Update Progress: 673/2368 symbols completed. DXYZ took 44.2s. Estimated remaining: 3h 54m 30s. Rate: 7.2 symbols/min [2025-10-17T18:33:10.399532] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-17T18:33:10.481579] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:33:10.511633] [DEBUG] [LOCAL ] EARN: Loaded 28794 existing records from primary storage. [2025-10-17T18:33:10.511967] [INFO ] [MAIN ] EARN: Loaded 28794 existing records. [2025-10-17T18:33:10.712450] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:33:10.712721] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-17T18:33:10.712784] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-17T18:33:10.713084] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-17T18:33:10.713155] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-17T18:33:11.096226] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:33:11.157997] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-17T18:33:11.912621] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T18:33:11.957984] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-17T18:33:12.094432] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-17T18:33:12.147941] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T18:33:12.758041] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-17T18:33:13.318181] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T18:33:13.558026] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-17T18:33:14.327295] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T18:33:14.357996] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-17T18:33:15.015028] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T18:33:15.019934] [INFO ] [REMOTE ] E: Full fetch complete (47814 records). [2025-10-17T18:33:15.020053] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-17T18:33:15.164584] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-17T18:33:15.402817] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-17T18:33:15.402913] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-17T18:33:15.403699] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-17T18:33:15.403884] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-17T18:33:15.423745] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T18:33:15.431363] [DEBUG] [LOCAL ] E: Trimmed 47814 records to 33728 (keeping 200 days of data) [2025-10-17T18:33:15.640972] [DEBUG] [LOCAL ] E: Primary data saved (33728 records). [2025-10-17T18:33:15.641123] [INFO ] [MAIN ] E: Full history saved. [2025-10-17T18:33:15.641214] [INFO ] [MAIN ] Update Progress: 674/2368 symbols completed. E took 28.5s. Estimated remaining: 3h 54m 14s. Rate: 7.2 symbols/min [2025-10-17T18:33:15.804354] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:33:15.849582] [DEBUG] [LOCAL ] EAT: Loaded 50215 existing records from primary storage. [2025-10-17T18:33:15.849946] [INFO ] [MAIN ] EAT: Loaded 50215 existing records. [2025-10-17T18:33:15.963123] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-17T18:33:16.027154] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:33:16.027328] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-17T18:33:16.027401] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-17T18:33:16.027590] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-17T18:33:16.027629] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-17T18:33:16.373207] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:33:16.468562] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T18:33:16.758021] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-17T18:33:17.182203] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T18:33:17.310592] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-17T18:33:17.558016] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-17T18:33:18.358092] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-17T18:33:19.134033] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-17T18:33:19.157998] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-17T18:33:19.160304] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T18:33:19.853423] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-17T18:33:19.958078] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-17T18:33:20.431407] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T18:33:20.758055] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-17T18:33:21.558029] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-17T18:33:22.219115] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-17T18:33:22.358049] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-17T18:33:22.596391] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T18:33:23.158004] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-17T18:33:23.644279] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T18:33:23.794909] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-17T18:33:23.958099] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-17T18:33:24.758038] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-17T18:33:25.557993] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-17T18:33:25.721142] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T18:33:25.725351] [INFO ] [REMOTE ] EAF: Full fetch complete (62295 records). [2025-10-17T18:33:25.725447] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-17T18:33:25.726176] [FATAL] [VALIDATOR ] EAF: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:33:25.726261] [FATAL] [MAIN ] EAF: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:33:25.726305] [WARN ] [MAIN ] EAF: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:33:25.726375] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-17T18:33:25.726455] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-10-17T18:33:25.726521] [INFO ] [LOCAL ] EAF: Starting deletion of derivative data. [2025-10-17T18:33:25.726711] [DEBUG] [LOCAL ] EAF: Deleted derivative data file. [2025-10-17T18:33:25.726801] [INFO ] [MAIN ] Update Progress: 675/2368 symbols completed. EAF took 37.1s. Estimated remaining: 3h 54m 10s. Rate: 7.2 symbols/min [2025-10-17T18:33:25.894279] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:33:25.894447] [DEBUG] [LOCAL ] EB: No existing data file found in primary storage. [2025-10-17T18:33:25.894488] [WARN ] [MAIN ] EB: No existing data found, performing full refresh instead. [2025-10-17T18:33:25.894605] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-17T18:33:25.894680] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-17T18:33:25.894747] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-17T18:33:25.894784] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-17T18:33:26.244992] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:33:26.358018] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-17T18:33:26.419132] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T18:33:27.163153] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-17T18:33:27.176360] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T18:33:27.745301] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T18:33:27.963196] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-17T18:33:27.980372] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T18:33:28.758028] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-17T18:33:29.023066] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T18:33:29.337551] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-17T18:33:29.558029] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-17T18:33:30.358063] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-17T18:33:31.078241] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T18:33:31.158008] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-17T18:33:31.567711] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T18:33:31.958092] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-17T18:33:32.758011] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-17T18:33:33.117459] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-17T18:33:33.178405] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T18:33:33.558063] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-17T18:33:33.968630] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T18:33:34.358051] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-17T18:33:34.614522] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T18:33:35.158080] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-17T18:33:35.171925] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T18:33:35.173133] [INFO ] [REMOTE ] EAI: Full fetch complete (5981 records). [2025-10-17T18:33:35.173202] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-17T18:33:35.517009] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-17T18:33:35.517088] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-17T18:33:35.517233] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-17T18:33:35.517270] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-17T18:33:35.517677] [DEBUG] [LOCAL ] EAI: Trimmed 5981 records to 4014 (keeping 200 days of data) [2025-10-17T18:33:35.541403] [DEBUG] [LOCAL ] EAI: Primary data saved (4014 records). [2025-10-17T18:33:35.541470] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-17T18:33:35.541541] [INFO ] [MAIN ] Update Progress: 676/2368 symbols completed. EAI took 28.0s. Estimated remaining: 3h 54m 6s. Rate: 7.2 symbols/min [2025-10-17T18:33:35.703742] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:33:35.703873] [DEBUG] [LOCAL ] EBF: No existing data file found in primary storage. [2025-10-17T18:33:35.703910] [WARN ] [MAIN ] EBF: No existing data found, performing full refresh instead. [2025-10-17T18:33:35.704014] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-17T18:33:35.704055] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-17T18:33:35.704094] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-17T18:33:35.704126] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-17T18:33:35.964133] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-17T18:33:36.054813] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:33:36.758010] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-17T18:33:37.028282] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:33:37.368269] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T18:33:37.558000] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-17T18:33:38.006478] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-17T18:33:38.358045] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-17T18:33:38.650187] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T18:33:39.158125] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-17T18:33:39.590540] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-17T18:33:39.596679] [INFO ] [REMOTE ] EARN: Full fetch complete (45452 records). [2025-10-17T18:33:39.596803] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-17T18:33:39.972051] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-17T18:33:39.974738] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-17T18:33:39.975496] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-17T18:33:39.976195] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-17T18:33:39.976349] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-17T18:33:39.977396] [DEBUG] [LOCAL ] EARN: Trimmed 45452 records to 28956 (keeping 200 days of data) [2025-10-17T18:33:40.138580] [DEBUG] [LOCAL ] EARN: Primary data saved (28956 records). [2025-10-17T18:33:40.138734] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-17T18:33:40.138821] [INFO ] [MAIN ] Update Progress: 677/2368 symbols completed. EARN took 29.9s. Estimated remaining: 3h 53m 48s. Rate: 7.2 symbols/min [2025-10-17T18:33:40.246823] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T18:33:40.758064] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-17T18:33:41.558048] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-17T18:33:41.700001] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T18:33:42.358041] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-17T18:33:42.564607] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T18:33:42.610895] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T18:33:43.158023] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-17T18:33:43.507059] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T18:33:43.958010] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-17T18:33:44.264607] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T18:33:44.758032] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-17T18:33:45.558101] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-17T18:33:45.972527] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-17T18:33:46.300055] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T18:33:46.357988] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-17T18:33:47.158015] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-17T18:33:47.194165] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T18:33:47.472689] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T18:33:47.958100] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-17T18:33:48.757996] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-17T18:33:49.050347] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T18:33:49.108935] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T18:33:49.546825] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-17T18:33:49.557975] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-17T18:33:50.357998] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-17T18:33:50.649030] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T18:33:51.158030] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-17T18:33:51.653878] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-17T18:33:51.958024] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-17T18:33:52.758016] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-17T18:33:52.966196] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T18:33:53.056489] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T18:33:53.558044] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-17T18:33:54.131675] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T18:33:54.358035] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-17T18:33:54.564631] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T18:33:55.158032] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-17T18:33:55.728132] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T18:33:55.957997] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-17T18:33:56.210511] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T18:33:56.213903] [INFO ] [REMOTE ] EBF: Full fetch complete (27964 records). [2025-10-17T18:33:56.213979] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-17T18:33:56.582460] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-17T18:33:56.582541] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-17T18:33:56.583063] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-17T18:33:56.583124] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-17T18:33:56.583820] [DEBUG] [LOCAL ] EBF: Trimmed 27964 records to 19324 (keeping 200 days of data) [2025-10-17T18:33:56.699490] [DEBUG] [LOCAL ] EBF: Primary data saved (19324 records). [2025-10-17T18:33:56.699628] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-17T18:33:56.699741] [INFO ] [MAIN ] Update Progress: 678/2368 symbols completed. EBF took 21.2s. Estimated remaining: 3h 54m 0s. Rate: 7.2 symbols/min [2025-10-17T18:33:56.758050] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-17T18:33:57.223011] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T18:33:57.227723] [INFO ] [REMOTE ] EB: Full fetch complete (55189 records). [2025-10-17T18:33:57.227836] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-17T18:33:57.622412] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-17T18:33:57.622495] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-17T18:33:57.623383] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-17T18:33:57.623450] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-17T18:33:57.624633] [DEBUG] [LOCAL ] EB: Trimmed 55189 records to 36946 (keeping 200 days of data) [2025-10-17T18:33:57.833263] [DEBUG] [LOCAL ] EB: Primary data saved (36946 records). [2025-10-17T18:33:57.833427] [INFO ] [MAIN ] EB: Full history saved. [2025-10-17T18:33:57.833508] [INFO ] [MAIN ] Update Progress: 679/2368 symbols completed. EB took 32.1s. Estimated remaining: 3h 53m 34s. Rate: 7.2 symbols/min [2025-10-17T18:33:59.091584] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-17T18:33:59.103373] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-17T18:34:01.484294] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-17T18:34:01.492230] [INFO ] [REMOTE ] EAT: Full fetch complete (72367 records). [2025-10-17T18:34:01.492465] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-17T18:34:01.924775] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-17T18:34:01.924922] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-17T18:34:01.926190] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-17T18:34:01.926270] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-17T18:34:01.928458] [DEBUG] [LOCAL ] EAT: Trimmed 72367 records to 50582 (keeping 200 days of data) [2025-10-17T18:34:02.253440] [DEBUG] [LOCAL ] EAT: Primary data saved (50582 records). [2025-10-17T18:34:02.253679] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-17T18:34:02.253833] [INFO ] [MAIN ] Update Progress: 680/2368 symbols completed. EAT took 46.6s. Estimated remaining: 3h 53m 16s. Rate: 7.2 symbols/min [2025-10-17T18:34:02.866594] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:02.966873] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:02.999137] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:03.029043] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:03.029594] [DEBUG] [LOCAL ] ECAT: No existing data file found in primary storage. [2025-10-17T18:34:03.029770] [WARN ] [MAIN ] ECAT: No existing data found, performing full refresh instead. [2025-10-17T18:34:03.029910] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-17T18:34:03.029958] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-17T18:34:03.030009] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-10-17T18:34:03.030048] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-17T18:34:03.319344] [DEBUG] [LOCAL ] EC: Loaded 49335 existing records from primary storage. [2025-10-17T18:34:03.318702] [DEBUG] [LOCAL ] EBR: Loaded 43627 existing records from primary storage. [2025-10-17T18:34:03.337809] [INFO ] [MAIN ] EC: Loaded 49335 existing records. [2025-10-17T18:34:03.346016] [INFO ] [MAIN ] EBR: Loaded 43627 existing records. [2025-10-17T18:34:03.569589] [DEBUG] [LOCAL ] EBS: Loaded 47095 existing records from primary storage. [2025-10-17T18:34:03.629525] [INFO ] [MAIN ] EBS: Loaded 47095 existing records. [2025-10-17T18:34:03.933334] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:34:03.941519] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:03.957986] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-17T18:34:03.963352] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-17T18:34:03.985859] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-17T18:34:03.995214] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:34:03.995573] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-17T18:34:04.007303] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-17T18:34:04.001568] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-17T18:34:04.018045] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-17T18:34:04.058946] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-17T18:34:04.064158] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-17T18:34:04.106412] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:34:04.182334] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-17T18:34:04.246435] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-17T18:34:04.289703] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-17T18:34:04.334947] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-17T18:34:05.141281] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:05.211170] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-17T18:34:05.259204] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:05.272812] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-17T18:34:05.373667] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:05.374219] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-17T18:34:05.515210] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T18:34:05.520878] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-17T18:34:06.728150] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T18:34:06.734215] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-17T18:34:06.883544] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T18:34:06.893549] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-17T18:34:07.458231] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-17T18:34:07.467852] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-17T18:34:07.470123] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-17T18:34:07.480401] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-17T18:34:07.601495] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-17T18:34:07.607493] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-17T18:34:08.794191] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-17T18:34:08.803429] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-17T18:34:08.871304] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T18:34:08.885119] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-17T18:34:08.983869] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-17T18:34:08.991362] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-17T18:34:09.086197] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T18:34:09.096273] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-17T18:34:09.873866] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-17T18:34:09.879982] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-17T18:34:10.183877] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T18:34:10.357989] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-17T18:34:10.632995] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T18:34:10.788163] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T18:34:11.158056] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-17T18:34:11.217453] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T18:34:11.958013] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-17T18:34:12.037535] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T18:34:12.763175] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-17T18:34:12.781247] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T18:34:13.558056] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-17T18:34:13.648969] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T18:34:14.358040] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-17T18:34:14.560787] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T18:34:14.836871] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T18:34:15.158043] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-17T18:34:15.958018] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-17T18:34:16.403513] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-17T18:34:16.758058] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-17T18:34:16.864366] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T18:34:17.253693] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T18:34:17.558036] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-17T18:34:18.358139] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-17T18:34:18.780607] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-17T18:34:19.158026] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-17T18:34:19.553583] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T18:34:19.814540] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T18:34:19.958008] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-17T18:34:20.599985] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T18:34:20.757992] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-17T18:34:20.869729] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T18:34:21.558046] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-17T18:34:22.358070] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-17T18:34:22.552152] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T18:34:22.762860] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-17T18:34:23.158077] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-17T18:34:23.958021] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-17T18:34:24.018404] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T18:34:24.431898] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T18:34:24.435981] [INFO ] [REMOTE ] ECAT: Full fetch complete (42984 records). [2025-10-17T18:34:24.436066] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-17T18:34:24.763226] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-17T18:34:24.810261] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-17T18:34:24.810421] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-17T18:34:24.811095] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-17T18:34:24.811156] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-17T18:34:24.812127] [DEBUG] [LOCAL ] ECAT: Trimmed 42984 records to 29841 (keeping 200 days of data) [2025-10-17T18:34:24.994997] [DEBUG] [LOCAL ] ECAT: Primary data saved (29841 records). [2025-10-17T18:34:24.995134] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-17T18:34:24.995206] [INFO ] [MAIN ] Update Progress: 681/2368 symbols completed. ECAT took 22.7s. Estimated remaining: 3h 53m 44s. Rate: 7.2 symbols/min [2025-10-17T18:34:25.164685] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:25.207367] [DEBUG] [LOCAL ] ECC: Loaded 43644 existing records from primary storage. [2025-10-17T18:34:25.207726] [INFO ] [MAIN ] ECC: Loaded 43644 existing records. [2025-10-17T18:34:25.384929] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:34:25.385265] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-17T18:34:25.385339] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-17T18:34:25.385736] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-17T18:34:25.385805] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-17T18:34:25.527673] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T18:34:25.569877] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-17T18:34:25.778000] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:26.358028] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-17T18:34:26.590296] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T18:34:26.764345] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T18:34:27.158085] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-17T18:34:27.958036] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-17T18:34:28.344926] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T18:34:28.758103] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-17T18:34:29.050126] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T18:34:29.558015] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-17T18:34:29.866223] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T18:34:30.340506] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T18:34:30.357986] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-17T18:34:31.158010] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-17T18:34:31.335557] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T18:34:31.958005] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-17T18:34:32.230934] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T18:34:32.748741] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T18:34:32.755480] [INFO ] [REMOTE ] EC: Full fetch complete (71899 records). [2025-10-17T18:34:32.755601] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-17T18:34:32.767689] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-17T18:34:33.150145] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-17T18:34:33.150226] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-17T18:34:33.151121] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-17T18:34:33.151185] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-17T18:34:33.155331] [DEBUG] [LOCAL ] EC: Trimmed 71899 records to 49674 (keeping 200 days of data) [2025-10-17T18:34:33.455298] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T18:34:33.476966] [DEBUG] [LOCAL ] EC: Primary data saved (49674 records). [2025-10-17T18:34:33.477075] [INFO ] [MAIN ] EC: Full history saved. [2025-10-17T18:34:33.477153] [INFO ] [MAIN ] Update Progress: 682/2368 symbols completed. EC took 31.2s. Estimated remaining: 3h 53m 36s. Rate: 7.2 symbols/min [2025-10-17T18:34:33.563219] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-17T18:34:33.659285] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:33.659502] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-17T18:34:33.659580] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-17T18:34:33.659767] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-17T18:34:33.659846] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-17T18:34:33.659945] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-17T18:34:33.660022] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-17T18:34:34.047319] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:34.358079] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-17T18:34:34.492366] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T18:34:34.887032] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-17T18:34:35.158097] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-17T18:34:35.283186] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T18:34:35.290023] [INFO ] [REMOTE ] EBS: Full fetch complete (67425 records). [2025-10-17T18:34:35.290183] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-17T18:34:35.666948] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-17T18:34:35.667026] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-17T18:34:35.667864] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-17T18:34:35.667928] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-17T18:34:35.669164] [DEBUG] [LOCAL ] EBS: Trimmed 67425 records to 47428 (keeping 200 days of data) [2025-10-17T18:34:35.932997] [DEBUG] [LOCAL ] EBS: Primary data saved (47428 records). [2025-10-17T18:34:35.933125] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-17T18:34:35.933251] [INFO ] [MAIN ] Update Progress: 683/2368 symbols completed. EBS took 33.7s. Estimated remaining: 3h 53m 13s. Rate: 7.2 symbols/min [2025-10-17T18:34:35.963316] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-17T18:34:36.102838] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:36.103007] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-10-17T18:34:36.103045] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-10-17T18:34:36.103157] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-17T18:34:36.103197] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-17T18:34:36.103237] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-17T18:34:36.103269] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-17T18:34:36.449241] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:36.758031] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-17T18:34:37.070279] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T18:34:37.243634] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-17T18:34:37.558006] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-17T18:34:37.766868] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T18:34:38.358034] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-17T18:34:39.158013] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-17T18:34:39.489566] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T18:34:39.724791] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-17T18:34:39.958004] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-17T18:34:39.980997] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T18:34:39.988029] [INFO ] [REMOTE ] EBR: Full fetch complete (62557 records). [2025-10-17T18:34:39.988184] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-17T18:34:40.377695] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-17T18:34:40.377789] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-17T18:34:40.378693] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-17T18:34:40.378758] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-17T18:34:40.380230] [DEBUG] [LOCAL ] EBR: Trimmed 62557 records to 43964 (keeping 200 days of data) [2025-10-17T18:34:40.633907] [DEBUG] [LOCAL ] EBR: Primary data saved (43964 records). [2025-10-17T18:34:40.634040] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-17T18:34:40.634124] [INFO ] [MAIN ] Update Progress: 684/2368 symbols completed. EBR took 38.4s. Estimated remaining: 3h 52m 56s. Rate: 7.2 symbols/min [2025-10-17T18:34:40.769955] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-17T18:34:40.804489] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:40.804713] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-17T18:34:40.804765] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-17T18:34:40.804881] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-17T18:34:40.804929] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-17T18:34:40.804971] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-17T18:34:40.805027] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-17T18:34:41.173843] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:41.224272] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-17T18:34:41.543764] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T18:34:41.558003] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-17T18:34:42.358047] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-17T18:34:42.926474] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-17T18:34:43.112224] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T18:34:43.157990] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-17T18:34:43.768178] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-17T18:34:43.958019] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-17T18:34:44.758092] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-17T18:34:44.863835] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T18:34:45.558040] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-17T18:34:45.884169] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-17T18:34:46.358042] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-17T18:34:46.484308] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T18:34:46.827448] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T18:34:47.158051] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-17T18:34:47.468023] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-17T18:34:47.958020] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-17T18:34:48.758025] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-17T18:34:49.088998] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-17T18:34:49.558045] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-17T18:34:49.717572] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T18:34:49.976440] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-17T18:34:50.358060] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-17T18:34:50.705054] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-17T18:34:51.158065] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-17T18:34:51.609308] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-17T18:34:51.958082] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-17T18:34:52.440589] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-17T18:34:52.758150] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-17T18:34:53.275843] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-17T18:34:53.558035] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-17T18:34:54.015338] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-17T18:34:54.358036] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-17T18:34:54.780072] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T18:34:55.158032] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-17T18:34:55.623751] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-17T18:34:55.958028] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-17T18:34:56.407380] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T18:34:56.758032] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-17T18:34:57.185940] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-17T18:34:57.558038] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-17T18:34:58.094134] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-17T18:34:58.358015] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-17T18:34:58.856170] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-17T18:34:58.856964] [INFO ] [REMOTE ] ECCU: Full fetch complete (4333 records). [2025-10-17T18:34:58.857081] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-17T18:34:59.169843] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-17T18:34:59.211150] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-17T18:34:59.211231] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-17T18:34:59.211432] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-17T18:34:59.211514] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-17T18:34:59.211936] [DEBUG] [LOCAL ] ECCU: Trimmed 4333 records to 2234 (keeping 200 days of data) [2025-10-17T18:34:59.226511] [DEBUG] [LOCAL ] ECCU: Primary data saved (2234 records). [2025-10-17T18:34:59.226590] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-17T18:34:59.226712] [INFO ] [MAIN ] Update Progress: 685/2368 symbols completed. ECCU took 23.3s. Estimated remaining: 3h 53m 13s. Rate: 7.2 symbols/min [2025-10-17T18:34:59.390924] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:34:59.391090] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-17T18:34:59.391126] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-17T18:34:59.391235] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-17T18:34:59.391289] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-17T18:34:59.391356] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-17T18:34:59.391401] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-17T18:34:59.650775] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-17T18:34:59.745029] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:34:59.958037] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-17T18:35:00.436239] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-17T18:35:00.758057] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-17T18:35:01.400222] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-17T18:35:01.558030] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-17T18:35:01.971396] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-17T18:35:02.358027] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-17T18:35:03.069954] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T18:35:03.158053] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-17T18:35:03.494362] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-17T18:35:03.958089] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-17T18:35:04.758071] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-17T18:35:05.109504] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-17T18:35:05.558057] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-17T18:35:05.824402] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T18:35:05.977791] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-17T18:35:06.358062] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-17T18:35:07.048308] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-17T18:35:07.158030] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-17T18:35:07.510682] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-17T18:35:07.958069] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-17T18:35:08.421847] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-17T18:35:08.422879] [INFO ] [REMOTE ] ECCC: Full fetch complete (1292 records). [2025-10-17T18:35:08.422973] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-17T18:35:08.423539] [FATAL] [VALIDATOR ] ECCC: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:35:08.423712] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:35:08.423803] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:35:08.423899] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-17T18:35:08.423983] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-17T18:35:08.424023] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-17T18:35:08.424063] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-17T18:35:08.424119] [INFO ] [MAIN ] Update Progress: 686/2368 symbols completed. ECCC took 34.9s. Estimated remaining: 3h 53m 7s. Rate: 7.2 symbols/min [2025-10-17T18:35:08.627370] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:35:08.671187] [DEBUG] [LOCAL ] ECG: Loaded 33440 existing records from primary storage. [2025-10-17T18:35:08.671604] [INFO ] [MAIN ] ECG: Loaded 33440 existing records. [2025-10-17T18:35:08.768689] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-17T18:35:08.929395] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:35:08.929717] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-17T18:35:08.929790] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-17T18:35:08.930034] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-17T18:35:08.930100] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-17T18:35:09.411236] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:35:09.558045] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-17T18:35:10.358030] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-17T18:35:10.638861] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T18:35:10.648195] [INFO ] [REMOTE ] ECC: Full fetch complete (61451 records). [2025-10-17T18:35:10.648373] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-17T18:35:10.941778] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-17T18:35:10.946775] [INFO ] [REMOTE ] ECCW: Full fetch complete (1421 records). [2025-10-17T18:35:10.952731] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-17T18:35:11.117252] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-17T18:35:11.129861] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-17T18:35:11.148096] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-17T18:35:11.157072] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-17T18:35:11.161114] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-17T18:35:11.228948] [DEBUG] [LOCAL ] ECC: Trimmed 61451 records to 43973 (keeping 200 days of data) [2025-10-17T18:35:11.236861] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T18:35:11.333050] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-17T18:35:11.341817] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:35:11.367557] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:35:11.375186] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-17T18:35:11.375520] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-17T18:35:11.381697] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-17T18:35:11.384186] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-17T18:35:11.384279] [INFO ] [MAIN ] Update Progress: 687/2368 symbols completed. ECCW took 30.8s. Estimated remaining: 3h 52m 45s. Rate: 7.2 symbols/min [2025-10-17T18:35:11.570833] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:35:11.712859] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-17T18:35:11.719030] [DEBUG] [LOCAL ] ECL: Loaded 47037 existing records from primary storage. [2025-10-17T18:35:11.723164] [INFO ] [MAIN ] ECL: Loaded 47037 existing records. [2025-10-17T18:35:11.956613] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:35:11.958707] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-17T18:35:11.960051] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-17T18:35:11.961507] [DEBUG] [LOCAL ] ECC: Primary data saved (43973 records). [2025-10-17T18:35:11.961697] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-17T18:35:11.961615] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-17T18:35:11.962968] [INFO ] [MAIN ] Update Progress: 688/2368 symbols completed. ECC took 47.0s. Estimated remaining: 3h 52m 18s. Rate: 7.2 symbols/min [2025-10-17T18:35:11.974636] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-17T18:35:11.999338] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-17T18:35:12.326419] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:35:12.534027] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:35:12.534943] [DEBUG] [LOCAL ] ECO: Loaded 18306 existing records from primary storage. [2025-10-17T18:35:12.535346] [INFO ] [MAIN ] ECO: Loaded 18306 existing records. [2025-10-17T18:35:12.707639] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:35:12.707828] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-17T18:35:12.707873] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-17T18:35:12.708059] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-17T18:35:12.708114] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-17T18:35:12.768336] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-17T18:35:13.088099] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:35:13.534287] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T18:35:13.557989] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-17T18:35:14.358035] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-17T18:35:14.495994] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T18:35:14.891255] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-17T18:35:15.049181] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T18:35:15.157997] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-17T18:35:15.958037] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-17T18:35:16.758010] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-17T18:35:16.914715] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T18:35:17.253204] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-17T18:35:17.558025] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-17T18:35:17.605081] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T18:35:18.358038] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-17T18:35:18.707848] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-17T18:35:19.020013] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T18:35:19.158042] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-17T18:35:19.481803] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-17T18:35:19.958030] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-17T18:35:20.377389] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-17T18:35:20.758052] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-17T18:35:21.558034] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-17T18:35:22.179812] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-17T18:35:22.195344] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T18:35:22.358023] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-17T18:35:23.158046] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-17T18:35:23.572138] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T18:35:23.958041] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-17T18:35:24.299149] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-17T18:35:24.758063] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-17T18:35:24.784039] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T18:35:25.558022] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-17T18:35:26.357994] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-17T18:35:26.657350] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-17T18:35:26.759349] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-17T18:35:26.865208] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-17T18:35:26.865984] [INFO ] [REMOTE ] ECCX: Full fetch complete (1446 records). [2025-10-17T18:35:26.866061] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-17T18:35:26.866414] [FATAL] [VALIDATOR ] ECCX: Data is stale - most recent date (2025-10-15) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:35:26.866501] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:35:26.866546] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:35:26.866615] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-17T18:35:26.866726] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-17T18:35:26.866780] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-17T18:35:26.866826] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-17T18:35:26.866883] [INFO ] [MAIN ] Update Progress: 689/2368 symbols completed. ECCX took 27.6s. Estimated remaining: 3h 52m 26s. Rate: 7.2 symbols/min [2025-10-17T18:35:27.036855] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:35:27.078663] [DEBUG] [LOCAL ] ECVT: Loaded 43630 existing records from primary storage. [2025-10-17T18:35:27.078977] [INFO ] [MAIN ] ECVT: Loaded 43630 existing records. [2025-10-17T18:35:27.163213] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-17T18:35:27.260914] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:35:27.261161] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-17T18:35:27.261210] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-17T18:35:27.261485] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-17T18:35:27.261544] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-17T18:35:27.606695] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:35:27.958081] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-17T18:35:28.469910] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T18:35:28.758033] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-17T18:35:29.561403] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-17T18:35:29.566203] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T18:35:30.358053] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-17T18:35:30.523618] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T18:35:30.643023] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T18:35:31.158059] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-17T18:35:31.958018] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-17T18:35:32.425524] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-17T18:35:32.525205] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T18:35:32.757996] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-17T18:35:33.152038] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T18:35:33.558040] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-17T18:35:33.943441] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T18:35:34.358046] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-17T18:35:34.979600] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T18:35:35.158035] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-17T18:35:35.423953] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T18:35:35.958030] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-17T18:35:36.758025] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-17T18:35:36.944206] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T18:35:37.558055] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-17T18:35:37.956566] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-17T18:35:38.275087] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T18:35:38.357996] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-17T18:35:39.095515] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T18:35:39.158017] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-17T18:35:39.651429] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T18:35:39.958036] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-17T18:35:40.758016] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-17T18:35:40.787959] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T18:35:41.558036] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-17T18:35:41.707711] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T18:35:41.750047] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T18:35:42.358032] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-17T18:35:42.629833] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T18:35:43.158056] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-17T18:35:43.957998] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-17T18:35:44.114927] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T18:35:44.758046] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-17T18:35:44.813546] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T18:35:44.872018] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T18:35:45.558071] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-17T18:35:46.268838] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T18:35:46.273357] [INFO ] [REMOTE ] ECG: Full fetch complete (50985 records). [2025-10-17T18:35:46.273466] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-17T18:35:46.363147] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-17T18:35:46.652546] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-17T18:35:46.652637] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-17T18:35:46.653432] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-17T18:35:46.653479] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-17T18:35:46.654598] [DEBUG] [LOCAL ] ECG: Trimmed 50985 records to 33657 (keeping 200 days of data) [2025-10-17T18:35:46.859411] [DEBUG] [LOCAL ] ECG: Primary data saved (33657 records). [2025-10-17T18:35:46.859564] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-17T18:35:46.860283] [INFO ] [MAIN ] Update Progress: 690/2368 symbols completed. ECG took 38.4s. Estimated remaining: 3h 52m 46s. Rate: 7.2 symbols/min [2025-10-17T18:35:47.036213] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:35:47.064333] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T18:35:47.121175] [DEBUG] [LOCAL ] ED: Loaded 53052 existing records from primary storage. [2025-10-17T18:35:47.121541] [INFO ] [MAIN ] ED: Loaded 53052 existing records. [2025-10-17T18:35:47.163283] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-17T18:35:47.300154] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:35:47.300360] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-17T18:35:47.300408] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-17T18:35:47.300622] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-17T18:35:47.300715] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-17T18:35:47.656449] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:35:47.668065] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-17T18:35:47.958030] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-17T18:35:48.758079] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-17T18:35:49.169299] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-17T18:35:49.557988] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-17T18:35:49.755405] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T18:35:49.787390] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T18:35:49.790169] [INFO ] [REMOTE ] ECO: Full fetch complete (28343 records). [2025-10-17T18:35:49.790244] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-17T18:35:50.151461] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-17T18:35:50.151540] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-17T18:35:50.152083] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-17T18:35:50.152145] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-17T18:35:50.152857] [DEBUG] [LOCAL ] ECO: Trimmed 28343 records to 18402 (keeping 200 days of data) [2025-10-17T18:35:50.262093] [DEBUG] [LOCAL ] ECO: Primary data saved (18402 records). [2025-10-17T18:35:50.262225] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-17T18:35:50.262302] [INFO ] [MAIN ] Update Progress: 691/2368 symbols completed. ECO took 38.3s. Estimated remaining: 3h 52m 26s. Rate: 7.2 symbols/min [2025-10-17T18:35:50.360360] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-17T18:35:50.430466] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:35:50.455807] [DEBUG] [LOCAL ] EDD: Loaded 27000 existing records from primary storage. [2025-10-17T18:35:50.456059] [INFO ] [MAIN ] EDD: Loaded 27000 existing records. [2025-10-17T18:35:50.627261] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:35:50.627494] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-17T18:35:50.627543] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-17T18:35:50.627801] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-17T18:35:50.627856] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-17T18:35:50.981615] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:35:51.158053] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-17T18:35:51.201016] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T18:35:51.207476] [INFO ] [REMOTE ] ECVT: Full fetch complete (60377 records). [2025-10-17T18:35:51.207634] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-17T18:35:51.586255] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-17T18:35:51.586332] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-17T18:35:51.587102] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-17T18:35:51.587165] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-17T18:35:51.588460] [DEBUG] [LOCAL ] ECVT: Trimmed 60377 records to 43948 (keeping 200 days of data) [2025-10-17T18:35:51.834774] [DEBUG] [LOCAL ] ECVT: Primary data saved (43948 records). [2025-10-17T18:35:51.834906] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-17T18:35:51.835861] [INFO ] [MAIN ] Update Progress: 692/2368 symbols completed. ECVT took 25.0s. Estimated remaining: 3h 52m 1s. Rate: 7.2 symbols/min [2025-10-17T18:35:51.970843] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-17T18:35:52.003365] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:35:52.019531] [DEBUG] [LOCAL ] EDF: Loaded 13171 existing records from primary storage. [2025-10-17T18:35:52.019796] [INFO ] [MAIN ] EDF: Loaded 13171 existing records. [2025-10-17T18:35:52.198635] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:35:52.198974] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-17T18:35:52.199033] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-17T18:35:52.199234] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-17T18:35:52.199291] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-17T18:35:52.588928] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:35:52.623147] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-17T18:35:52.725129] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T18:35:52.758047] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-17T18:35:53.558017] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-17T18:35:53.681068] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T18:35:54.358000] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-17T18:35:54.469251] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T18:35:55.158066] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-17T18:35:55.286250] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T18:35:55.645610] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-17T18:35:55.958053] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-17T18:35:56.758014] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-17T18:35:56.892371] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T18:35:57.384482] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-17T18:35:57.558029] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-17T18:35:57.764498] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T18:35:57.771224] [INFO ] [REMOTE ] ECL: Full fetch complete (68342 records). [2025-10-17T18:35:57.771419] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-17T18:35:58.181972] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-17T18:35:58.182061] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-17T18:35:58.182896] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-17T18:35:58.182961] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-17T18:35:58.184273] [DEBUG] [LOCAL ] ECL: Trimmed 68342 records to 47419 (keeping 200 days of data) [2025-10-17T18:35:58.366004] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-17T18:35:58.497974] [DEBUG] [LOCAL ] ECL: Primary data saved (47419 records). [2025-10-17T18:35:58.498101] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-17T18:35:58.498611] [INFO ] [MAIN ] Update Progress: 693/2368 symbols completed. ECL took 47.1s. Estimated remaining: 3h 51m 49s. Rate: 7.2 symbols/min [2025-10-17T18:35:58.659044] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T18:35:58.688851] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:35:58.707755] [DEBUG] [LOCAL ] EDN: Loaded 19176 existing records from primary storage. [2025-10-17T18:35:58.708014] [INFO ] [MAIN ] EDN: Loaded 19176 existing records. [2025-10-17T18:35:58.882140] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:35:58.882353] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-17T18:35:58.882400] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-17T18:35:58.882557] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-17T18:35:58.882596] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-17T18:35:59.163202] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-17T18:35:59.239463] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:35:59.958016] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-17T18:36:00.003873] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T18:36:00.167234] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T18:36:00.758051] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-17T18:36:01.558144] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-17T18:36:02.011769] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T18:36:02.358059] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-17T18:36:02.430598] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T18:36:03.158003] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-17T18:36:03.249345] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T18:36:03.818100] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T18:36:03.958026] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-17T18:36:04.758025] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-17T18:36:05.113544] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T18:36:05.194732] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T18:36:05.558038] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-17T18:36:05.713375] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T18:36:06.358009] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-17T18:36:06.612427] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T18:36:07.158017] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-17T18:36:07.473243] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T18:36:07.958022] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-17T18:36:08.374056] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T18:36:08.758016] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-17T18:36:08.994994] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T18:36:09.558028] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-17T18:36:10.357992] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-17T18:36:10.771992] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T18:36:10.773596] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-17T18:36:11.158021] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-17T18:36:11.263961] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T18:36:11.958037] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-17T18:36:12.342501] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T18:36:12.457426] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-17T18:36:12.758061] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-17T18:36:13.558041] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-17T18:36:13.751285] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T18:36:14.358041] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-17T18:36:14.856094] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T18:36:15.158035] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-17T18:36:15.188627] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T18:36:15.958030] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-17T18:36:16.578986] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T18:36:16.757866] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-17T18:36:16.758555] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-17T18:36:17.557981] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-17T18:36:17.965942] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-17T18:36:18.358005] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-17T18:36:18.583264] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T18:36:19.158031] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-17T18:36:19.564959] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-17T18:36:19.958029] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-17T18:36:20.016412] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-17T18:36:20.758037] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-17T18:36:21.557996] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-17T18:36:21.694583] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T18:36:21.824715] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T18:36:21.826744] [INFO ] [REMOTE ] EDF: Full fetch complete (20441 records). [2025-10-17T18:36:21.826817] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-17T18:36:22.181620] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-17T18:36:22.181726] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-17T18:36:22.182156] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-17T18:36:22.182216] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-17T18:36:22.182806] [DEBUG] [LOCAL ] EDF: Trimmed 20441 records to 13279 (keeping 200 days of data) [2025-10-17T18:36:22.257776] [DEBUG] [LOCAL ] EDF: Primary data saved (13279 records). [2025-10-17T18:36:22.257911] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-17T18:36:22.257994] [INFO ] [MAIN ] Update Progress: 694/2368 symbols completed. EDF took 30.4s. Estimated remaining: 3h 52m 18s. Rate: 7.2 symbols/min [2025-10-17T18:36:22.359485] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-17T18:36:22.433940] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:36:22.473994] [DEBUG] [LOCAL ] EDU: Loaded 45172 existing records from primary storage. [2025-10-17T18:36:22.474339] [INFO ] [MAIN ] EDU: Loaded 45172 existing records. [2025-10-17T18:36:22.653598] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:36:22.653975] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-17T18:36:22.654070] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-17T18:36:22.654368] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-17T18:36:22.654422] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-17T18:36:22.766449] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T18:36:22.814672] [INFO ] [REMOTE ] EDD: Full fetch complete (38458 records). [2025-10-17T18:36:22.825376] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-17T18:36:22.892482] [FATAL] [VALIDATOR ] EDD: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:36:22.931891] [FATAL] [MAIN ] EDD: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:36:22.954722] [WARN ] [MAIN ] EDD: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:36:22.954856] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-17T18:36:22.954934] [DEBUG] [LOCAL ] EDD: No primary data file found to delete. [2025-10-17T18:36:22.954974] [INFO ] [LOCAL ] EDD: Starting deletion of derivative data. [2025-10-17T18:36:22.965876] [DEBUG] [LOCAL ] EDD: Deleted derivative data file. [2025-10-17T18:36:22.976292] [INFO ] [MAIN ] Update Progress: 695/2368 symbols completed. EDD took 32.7s. Estimated remaining: 3h 51m 51s. Rate: 7.2 symbols/min [2025-10-17T18:36:23.094217] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:36:23.166282] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-17T18:36:23.236116] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:36:23.236537] [DEBUG] [LOCAL ] EE: No existing data file found in primary storage. [2025-10-17T18:36:23.236584] [WARN ] [MAIN ] EE: No existing data found, performing full refresh instead. [2025-10-17T18:36:23.236717] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-17T18:36:23.236764] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-17T18:36:23.236809] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-10-17T18:36:23.236840] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-17T18:36:23.506869] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T18:36:23.607070] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:36:23.958024] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-17T18:36:24.758016] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-17T18:36:25.075745] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T18:36:25.118801] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-17T18:36:25.558030] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-17T18:36:26.358087] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-17T18:36:26.647599] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T18:36:27.081531] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T18:36:27.157994] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-17T18:36:27.673474] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T18:36:27.677276] [INFO ] [REMOTE ] EDN: Full fetch complete (30059 records). [2025-10-17T18:36:27.677371] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-17T18:36:27.963133] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-17T18:36:28.040512] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-17T18:36:28.040598] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-17T18:36:28.041152] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-17T18:36:28.041216] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-17T18:36:28.041955] [DEBUG] [LOCAL ] EDN: Trimmed 30059 records to 19338 (keeping 200 days of data) [2025-10-17T18:36:28.153185] [DEBUG] [LOCAL ] EDN: Primary data saved (19338 records). [2025-10-17T18:36:28.153334] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-17T18:36:28.153422] [INFO ] [MAIN ] Update Progress: 696/2368 symbols completed. EDN took 29.7s. Estimated remaining: 3h 51m 35s. Rate: 7.2 symbols/min [2025-10-17T18:36:28.323947] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:36:28.324232] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-17T18:36:28.324338] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-17T18:36:28.324544] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-17T18:36:28.324758] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-17T18:36:28.338133] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T18:36:28.337721] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-17T18:36:28.342878] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-17T18:36:28.735967] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:36:28.757988] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-17T18:36:29.465287] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-17T18:36:29.558025] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-17T18:36:29.729862] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T18:36:30.358046] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-17T18:36:30.654553] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T18:36:31.158026] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-17T18:36:31.958031] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-17T18:36:32.034823] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T18:36:32.415029] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-17T18:36:32.758038] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-17T18:36:33.555416] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T18:36:33.559312] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-17T18:36:34.118343] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-17T18:36:34.147465] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T18:36:34.358048] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-17T18:36:35.158040] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-17T18:36:35.958000] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-17T18:36:36.268681] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T18:36:36.647398] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T18:36:36.758014] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-17T18:36:37.286975] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-17T18:36:37.558006] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-17T18:36:37.798150] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T18:36:37.805412] [INFO ] [REMOTE ] ED: Full fetch complete (76414 records). [2025-10-17T18:36:37.805559] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-17T18:36:38.194214] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-17T18:36:38.194299] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-17T18:36:38.195303] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-17T18:36:38.195368] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-17T18:36:38.196846] [DEBUG] [LOCAL ] ED: Trimmed 76414 records to 53411 (keeping 200 days of data) [2025-10-17T18:36:38.378501] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-17T18:36:38.537783] [DEBUG] [LOCAL ] ED: Primary data saved (53411 records). [2025-10-17T18:36:38.537925] [INFO ] [MAIN ] ED: Full history saved. [2025-10-17T18:36:38.538525] [INFO ] [MAIN ] Update Progress: 697/2368 symbols completed. ED took 51.7s. Estimated remaining: 3h 51m 32s. Rate: 7.2 symbols/min [2025-10-17T18:36:38.708410] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:36:38.721560] [DEBUG] [LOCAL ] EEX: Loaded 10294 existing records from primary storage. [2025-10-17T18:36:38.721818] [INFO ] [MAIN ] EEX: Loaded 10294 existing records. [2025-10-17T18:36:38.903031] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:36:38.903280] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-17T18:36:38.903334] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-17T18:36:38.903504] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-17T18:36:38.903560] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-17T18:36:39.084389] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-17T18:36:39.168348] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-17T18:36:39.284276] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:36:39.316008] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T18:36:39.763788] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-17T18:36:39.958061] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-17T18:36:40.479796] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-17T18:36:40.758057] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-17T18:36:41.558038] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-17T18:36:42.181078] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T18:36:42.358022] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-17T18:36:42.677972] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T18:36:42.847913] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-17T18:36:43.158014] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-17T18:36:43.720946] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-17T18:36:43.958010] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-17T18:36:44.758038] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-17T18:36:45.246632] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-17T18:36:45.491578] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T18:36:45.558001] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-17T18:36:46.358066] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-17T18:36:47.158036] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-17T18:36:47.213708] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T18:36:47.639284] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T18:36:47.958012] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-17T18:36:48.120474] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-17T18:36:48.758046] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-17T18:36:49.456294] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T18:36:49.558016] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-17T18:36:50.358019] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-17T18:36:50.464252] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T18:36:50.958153] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T18:36:51.158085] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-17T18:36:51.362164] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T18:36:51.721539] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-17T18:36:51.958034] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-17T18:36:52.409308] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-17T18:36:52.410127] [INFO ] [REMOTE ] EEA: Full fetch complete (3778 records). [2025-10-17T18:36:52.410195] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-17T18:36:52.588295] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T18:36:52.588512] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:36:52.588581] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:36:52.588671] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-17T18:36:52.588779] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-17T18:36:52.588835] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-17T18:36:52.588879] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-17T18:36:52.588935] [INFO ] [MAIN ] Update Progress: 698/2368 symbols completed. EEA took 24.4s. Estimated remaining: 3h 51m 38s. Rate: 7.2 symbols/min [2025-10-17T18:36:52.758053] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-17T18:36:52.759555] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:36:52.805793] [DEBUG] [LOCAL ] EFC: Loaded 46757 existing records from primary storage. [2025-10-17T18:36:52.806116] [INFO ] [MAIN ] EFC: Loaded 46757 existing records. [2025-10-17T18:36:53.003076] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:36:53.003258] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-17T18:36:53.003306] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-17T18:36:53.003683] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-17T18:36:53.003741] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-17T18:36:53.347928] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:36:53.558031] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-17T18:36:54.142592] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T18:36:54.358026] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-17T18:36:55.158035] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-17T18:36:55.192095] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T18:36:55.958001] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-17T18:36:56.405254] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T18:36:56.533930] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-17T18:36:56.758072] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-17T18:36:57.558001] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-17T18:36:57.732298] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T18:36:57.773241] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-17T18:36:58.358083] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-17T18:36:59.153292] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-17T18:36:59.157975] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-17T18:36:59.181902] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T18:36:59.958016] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-17T18:37:00.758041] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-17T18:37:01.075260] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T18:37:01.081836] [INFO ] [REMOTE ] EDU: Full fetch complete (67040 records). [2025-10-17T18:37:01.081953] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-17T18:37:01.291314] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T18:37:01.499758] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-17T18:37:01.499865] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-17T18:37:01.500721] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-17T18:37:01.500791] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-17T18:37:01.502269] [DEBUG] [LOCAL ] EDU: Trimmed 67040 records to 45507 (keeping 200 days of data) [2025-10-17T18:37:01.564009] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-17T18:37:01.776117] [DEBUG] [LOCAL ] EDU: Primary data saved (45507 records). [2025-10-17T18:37:01.776265] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-17T18:37:01.777171] [INFO ] [MAIN ] Update Progress: 699/2368 symbols completed. EDU took 39.5s. Estimated remaining: 3h 51m 31s. Rate: 7.2 symbols/min [2025-10-17T18:37:01.950051] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:37:01.969223] [DEBUG] [LOCAL ] EFR: Loaded 15165 existing records from primary storage. [2025-10-17T18:37:01.969474] [INFO ] [MAIN ] EFR: Loaded 15165 existing records. [2025-10-17T18:37:02.158883] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:37:02.159109] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-17T18:37:02.159192] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-17T18:37:02.159358] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-17T18:37:02.159397] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-17T18:37:02.364527] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-17T18:37:02.464552] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-17T18:37:02.524097] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:37:02.639593] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T18:37:03.158004] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-17T18:37:03.928717] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T18:37:03.933672] [INFO ] [REMOTE ] EE: Full fetch complete (44224 records). [2025-10-17T18:37:03.933767] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-17T18:37:03.964206] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-17T18:37:04.315557] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-17T18:37:04.315684] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-17T18:37:04.316417] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-17T18:37:04.316506] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-17T18:37:04.317939] [DEBUG] [LOCAL ] EE: Trimmed 44224 records to 33450 (keeping 200 days of data) [2025-10-17T18:37:04.503140] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T18:37:04.528730] [DEBUG] [LOCAL ] EE: Primary data saved (33450 records). [2025-10-17T18:37:04.528827] [INFO ] [MAIN ] EE: Full history saved. [2025-10-17T18:37:04.528892] [INFO ] [MAIN ] Update Progress: 700/2368 symbols completed. EE took 41.5s. Estimated remaining: 3h 51m 10s. Rate: 7.2 symbols/min [2025-10-17T18:37:04.692869] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:37:04.708238] [DEBUG] [LOCAL ] EFT: Loaded 13160 existing records from primary storage. [2025-10-17T18:37:04.708452] [INFO ] [MAIN ] EFT: Loaded 13160 existing records. [2025-10-17T18:37:04.768690] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-17T18:37:04.883303] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:37:04.883519] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-17T18:37:04.883573] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-17T18:37:04.883837] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-17T18:37:04.883892] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-17T18:37:05.241196] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:37:05.558038] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-17T18:37:05.657624] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-17T18:37:05.716072] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T18:37:06.267380] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T18:37:06.357994] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-17T18:37:06.880323] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-17T18:37:07.158025] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-17T18:37:07.958089] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-17T18:37:08.720482] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T18:37:08.757993] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-17T18:37:08.860501] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T18:37:09.558043] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-17T18:37:09.601341] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T18:37:10.343374] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T18:37:10.345815] [INFO ] [REMOTE ] EEX: Full fetch complete (18546 records). [2025-10-17T18:37:10.345954] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-17T18:37:10.363352] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-17T18:37:10.739465] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-17T18:37:10.739544] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-17T18:37:10.739954] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-17T18:37:10.740014] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-17T18:37:10.740598] [DEBUG] [LOCAL ] EEX: Trimmed 18546 records to 10348 (keeping 200 days of data) [2025-10-17T18:37:10.800738] [DEBUG] [LOCAL ] EEX: Primary data saved (10348 records). [2025-10-17T18:37:10.800896] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-17T18:37:10.800982] [INFO ] [MAIN ] Update Progress: 701/2368 symbols completed. EEX took 32.3s. Estimated remaining: 3h 50m 57s. Rate: 7.2 symbols/min [2025-10-17T18:37:10.968406] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:37:11.013734] [DEBUG] [LOCAL ] EFX: Loaded 45004 existing records from primary storage. [2025-10-17T18:37:11.014047] [INFO ] [MAIN ] EFX: Loaded 45004 existing records. [2025-10-17T18:37:11.165310] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-17T18:37:11.189258] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:37:11.189635] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-17T18:37:11.189719] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-17T18:37:11.190018] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-17T18:37:11.190077] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-17T18:37:11.540101] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:37:11.958023] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-17T18:37:12.053502] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-17T18:37:12.444683] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-17T18:37:12.758033] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-17T18:37:13.557997] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-17T18:37:14.110922] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-17T18:37:14.316391] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T18:37:14.358001] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-17T18:37:14.439303] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T18:37:15.158026] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-17T18:37:15.959844] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-17T18:37:15.965147] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T18:37:16.115709] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T18:37:16.758038] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-17T18:37:17.112624] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T18:37:17.558013] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-17T18:37:17.788837] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T18:37:18.358064] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-17T18:37:19.091549] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T18:37:19.158044] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-17T18:37:19.957997] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-17T18:37:20.023046] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T18:37:20.758095] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-17T18:37:20.955848] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T18:37:20.991332] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T18:37:21.546614] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-17T18:37:21.557980] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-17T18:37:22.358010] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-17T18:37:22.457373] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T18:37:22.982291] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T18:37:23.158005] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-17T18:37:23.958010] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-17T18:37:24.010147] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-17T18:37:24.758007] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-17T18:37:24.816579] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-17T18:37:25.558042] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-17T18:37:25.611483] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T18:37:26.358011] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-17T18:37:26.578570] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T18:37:27.158042] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-17T18:37:27.204519] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T18:37:27.958009] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-17T18:37:28.264765] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T18:37:28.737666] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T18:37:28.740158] [INFO ] [REMOTE ] EFT: Full fetch complete (17955 records). [2025-10-17T18:37:28.740265] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-17T18:37:28.763214] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-17T18:37:29.111804] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-17T18:37:29.111889] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-17T18:37:29.112343] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-17T18:37:29.112386] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-17T18:37:29.112998] [DEBUG] [LOCAL ] EFT: Trimmed 17955 records to 13215 (keeping 200 days of data) [2025-10-17T18:37:29.197597] [DEBUG] [LOCAL ] EFT: Primary data saved (13215 records). [2025-10-17T18:37:29.197766] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-17T18:37:29.197857] [INFO ] [MAIN ] Update Progress: 702/2368 symbols completed. EFT took 24.7s. Estimated remaining: 3h 51m 12s. Rate: 7.2 symbols/min [2025-10-17T18:37:29.372741] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:37:29.402098] [DEBUG] [LOCAL ] EFXT: Loaded 29940 existing records from primary storage. [2025-10-17T18:37:29.402340] [INFO ] [MAIN ] EFXT: Loaded 29940 existing records. [2025-10-17T18:37:29.572549] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-17T18:37:29.577929] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:37:29.579199] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-17T18:37:29.579267] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-17T18:37:29.579461] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-17T18:37:29.579514] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-17T18:37:29.940916] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:37:30.358070] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-17T18:37:30.814460] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-17T18:37:31.158007] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-17T18:37:31.526375] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T18:37:31.873318] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T18:37:31.957991] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-17T18:37:32.327615] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T18:37:32.758032] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-17T18:37:33.331333] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T18:37:33.558057] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-17T18:37:33.841361] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-17T18:37:34.358017] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-17T18:37:34.540377] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-17T18:37:34.543727] [INFO ] [REMOTE ] EFR: Full fetch complete (19505 records). [2025-10-17T18:37:34.543806] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-17T18:37:34.909339] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-17T18:37:34.909414] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-17T18:37:34.909849] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-17T18:37:34.909910] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-17T18:37:34.910455] [DEBUG] [LOCAL ] EFR: Trimmed 19505 records to 15309 (keeping 200 days of data) [2025-10-17T18:37:35.009132] [DEBUG] [LOCAL ] EFR: Primary data saved (15309 records). [2025-10-17T18:37:35.009302] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-17T18:37:35.009432] [INFO ] [MAIN ] Update Progress: 703/2368 symbols completed. EFR took 33.2s. Estimated remaining: 3h 50m 58s. Rate: 7.2 symbols/min [2025-10-17T18:37:35.170892] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-17T18:37:35.173959] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:37:35.201129] [DEBUG] [LOCAL ] EG: Loaded 27993 existing records from primary storage. [2025-10-17T18:37:35.201393] [INFO ] [MAIN ] EG: Loaded 27993 existing records. [2025-10-17T18:37:35.374274] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:37:35.374455] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-17T18:37:35.374502] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-17T18:37:35.374767] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-17T18:37:35.374836] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-17T18:37:35.759481] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:37:35.957984] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-17T18:37:36.285360] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-17T18:37:36.758009] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-17T18:37:37.011107] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T18:37:37.558073] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-17T18:37:37.736376] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T18:37:37.967254] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T18:37:38.358083] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-17T18:37:39.022199] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T18:37:39.158065] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-17T18:37:39.670961] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T18:37:39.958064] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-17T18:37:40.758042] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-17T18:37:40.936175] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T18:37:41.282860] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-17T18:37:41.558010] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-17T18:37:42.028199] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T18:37:42.358034] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-17T18:37:43.114616] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T18:37:43.121342] [INFO ] [REMOTE ] EFX: Full fetch complete (64957 records). [2025-10-17T18:37:43.121492] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-17T18:37:43.167551] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-17T18:37:43.521097] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-17T18:37:43.521190] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-17T18:37:43.522053] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-17T18:37:43.522117] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-17T18:37:43.523425] [DEBUG] [LOCAL ] EFX: Trimmed 64957 records to 45309 (keeping 200 days of data) [2025-10-17T18:37:43.811551] [DEBUG] [LOCAL ] EFX: Primary data saved (45309 records). [2025-10-17T18:37:43.811720] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-17T18:37:43.812267] [INFO ] [MAIN ] Update Progress: 704/2368 symbols completed. EFX took 33.0s. Estimated remaining: 3h 50m 51s. Rate: 7.2 symbols/min [2025-10-17T18:37:43.974245] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-17T18:37:43.976906] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:37:44.028681] [DEBUG] [LOCAL ] EGO: Loaded 52116 existing records from primary storage. [2025-10-17T18:37:44.029003] [INFO ] [MAIN ] EGO: Loaded 52116 existing records. [2025-10-17T18:37:44.210466] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:37:44.210786] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-17T18:37:44.210887] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-17T18:37:44.211338] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-17T18:37:44.211397] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-17T18:37:44.455273] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-17T18:37:44.565459] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T18:37:44.633633] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:37:44.757990] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-17T18:37:45.492357] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T18:37:45.558009] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-17T18:37:46.358160] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-17T18:37:46.721258] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T18:37:47.028509] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T18:37:47.158039] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-17T18:37:47.957997] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-17T18:37:48.202449] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T18:37:48.209149] [INFO ] [REMOTE ] EFC: Full fetch complete (66754 records). [2025-10-17T18:37:48.209261] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-17T18:37:48.594886] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-17T18:37:48.594961] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-17T18:37:48.595788] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-17T18:37:48.595854] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-17T18:37:48.597073] [DEBUG] [LOCAL ] EFC: Trimmed 66754 records to 47042 (keeping 200 days of data) [2025-10-17T18:37:48.775127] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-17T18:37:48.887845] [DEBUG] [LOCAL ] EFC: Primary data saved (47042 records). [2025-10-17T18:37:48.887983] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-17T18:37:48.888982] [INFO ] [MAIN ] Update Progress: 705/2368 symbols completed. EFC took 56.3s. Estimated remaining: 3h 50m 35s. Rate: 7.2 symbols/min [2025-10-17T18:37:49.059740] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-17T18:37:49.084706] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:37:49.127938] [DEBUG] [LOCAL ] EGP: Loaded 30655 existing records from primary storage. [2025-10-17T18:37:49.128202] [INFO ] [MAIN ] EGP: Loaded 30655 existing records. [2025-10-17T18:37:49.304515] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:37:49.304864] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-17T18:37:49.304962] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-17T18:37:49.305536] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-17T18:37:49.305593] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-17T18:37:49.567563] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-17T18:37:49.610526] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T18:37:49.695997] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:37:49.916126] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T18:37:50.358092] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-17T18:37:51.158010] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-17T18:37:51.390143] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-17T18:37:51.958076] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-17T18:37:52.072976] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T18:37:52.608805] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T18:37:52.758029] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-17T18:37:53.558008] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-17T18:37:53.689364] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T18:37:54.044563] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T18:37:54.358028] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-17T18:37:54.845999] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T18:37:55.158044] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-17T18:37:55.757517] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T18:37:55.958040] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-17T18:37:56.558429] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T18:37:56.758049] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-17T18:37:57.378607] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T18:37:57.558093] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-17T18:37:58.156498] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T18:37:58.358086] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-17T18:37:59.158036] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-17T18:37:59.546924] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T18:37:59.618912] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-17T18:37:59.958041] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-17T18:38:00.451697] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T18:38:00.758057] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-17T18:38:01.283867] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T18:38:01.558025] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-17T18:38:02.358084] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-17T18:38:02.690176] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T18:38:03.158026] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-17T18:38:03.183518] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T18:38:03.252620] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T18:38:03.958040] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-17T18:38:04.758049] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-17T18:38:04.832583] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T18:38:05.204134] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-17T18:38:05.558021] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-17T18:38:06.257033] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T18:38:06.261981] [INFO ] [REMOTE ] EFXT: Full fetch complete (44350 records). [2025-10-17T18:38:06.262072] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-17T18:38:06.361865] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-17T18:38:06.648199] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-17T18:38:06.648297] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-17T18:38:06.649101] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-17T18:38:06.649167] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-17T18:38:06.650138] [DEBUG] [LOCAL ] EFXT: Trimmed 44350 records to 30200 (keeping 200 days of data) [2025-10-17T18:38:06.821184] [DEBUG] [LOCAL ] EFXT: Primary data saved (30200 records). [2025-10-17T18:38:06.821315] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-17T18:38:06.821400] [INFO ] [MAIN ] Update Progress: 706/2368 symbols completed. EFXT took 37.6s. Estimated remaining: 3h 50m 49s. Rate: 7.2 symbols/min [2025-10-17T18:38:06.995528] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:38:07.033717] [DEBUG] [LOCAL ] EGY: Loaded 41864 existing records from primary storage. [2025-10-17T18:38:07.034200] [INFO ] [MAIN ] EGY: Loaded 41864 existing records. [2025-10-17T18:38:07.162662] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-17T18:38:07.218780] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:38:07.230540] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-17T18:38:07.235995] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-17T18:38:07.249509] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-17T18:38:07.249622] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-17T18:38:07.322441] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T18:38:07.572138] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T18:38:07.660515] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:38:07.958043] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-17T18:38:08.495985] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T18:38:08.500283] [INFO ] [REMOTE ] EG: Full fetch complete (43197 records). [2025-10-17T18:38:08.500439] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-17T18:38:08.765033] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-17T18:38:08.890315] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-17T18:38:08.890395] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-17T18:38:08.891109] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-17T18:38:08.891214] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-17T18:38:08.892203] [DEBUG] [LOCAL ] EG: Trimmed 43197 records to 28182 (keeping 200 days of data) [2025-10-17T18:38:09.070694] [DEBUG] [LOCAL ] EG: Primary data saved (28182 records). [2025-10-17T18:38:09.070830] [INFO ] [MAIN ] EG: Full history saved. [2025-10-17T18:38:09.070910] [INFO ] [MAIN ] Update Progress: 707/2368 symbols completed. EG took 34.1s. Estimated remaining: 3h 50m 26s. Rate: 7.2 symbols/min [2025-10-17T18:38:09.250568] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:38:09.278517] [DEBUG] [LOCAL ] EHAB: Loaded 29476 existing records from primary storage. [2025-10-17T18:38:09.278831] [INFO ] [MAIN ] EHAB: Loaded 29476 existing records. [2025-10-17T18:38:09.461430] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:38:09.461821] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-17T18:38:09.461928] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-17T18:38:09.462221] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-17T18:38:09.462328] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-17T18:38:09.562252] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-17T18:38:09.597986] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T18:38:09.854779] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:38:10.358017] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-17T18:38:10.873612] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-17T18:38:11.158037] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-17T18:38:11.678550] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T18:38:11.851559] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-17T18:38:11.958025] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-17T18:38:12.758029] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-17T18:38:12.918625] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T18:38:13.569452] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-17T18:38:13.571971] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T18:38:13.934243] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T18:38:14.358039] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-17T18:38:15.158022] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-17T18:38:15.526533] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-17T18:38:15.534095] [INFO ] [REMOTE ] EGO: Full fetch complete (74423 records). [2025-10-17T18:38:15.534213] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-17T18:38:15.861175] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T18:38:15.950343] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-17T18:38:15.950419] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-17T18:38:15.951294] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-17T18:38:15.951357] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-17T18:38:15.952794] [DEBUG] [LOCAL ] EGO: Trimmed 74423 records to 52505 (keeping 200 days of data) [2025-10-17T18:38:16.001482] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-17T18:38:16.262349] [DEBUG] [LOCAL ] EGO: Primary data saved (52505 records). [2025-10-17T18:38:16.262490] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-17T18:38:16.263039] [INFO ] [MAIN ] Update Progress: 708/2368 symbols completed. EGO took 32.5s. Estimated remaining: 3h 50m 15s. Rate: 7.2 symbols/min [2025-10-17T18:38:16.380727] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T18:38:16.455899] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:38:16.498106] [DEBUG] [LOCAL ] EHC: Loaded 41314 existing records from primary storage. [2025-10-17T18:38:16.498404] [INFO ] [MAIN ] EHC: Loaded 41314 existing records. [2025-10-17T18:38:16.673017] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:38:16.673238] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-17T18:38:16.673316] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-17T18:38:16.673857] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-17T18:38:16.673926] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-17T18:38:16.763188] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-17T18:38:17.025201] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:38:17.557987] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-17T18:38:17.686623] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T18:38:17.732509] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T18:38:18.358083] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-17T18:38:18.931398] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T18:38:18.937723] [INFO ] [REMOTE ] EGP: Full fetch complete (45628 records). [2025-10-17T18:38:18.937872] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-17T18:38:19.163125] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-17T18:38:19.319275] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-17T18:38:19.319352] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-17T18:38:19.320075] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-17T18:38:19.320138] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-17T18:38:19.321126] [DEBUG] [LOCAL ] EGP: Trimmed 45628 records to 30899 (keeping 200 days of data) [2025-10-17T18:38:19.518994] [DEBUG] [LOCAL ] EGP: Primary data saved (30899 records). [2025-10-17T18:38:19.519136] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-17T18:38:19.519227] [INFO ] [MAIN ] Update Progress: 709/2368 symbols completed. EGP took 30.6s. Estimated remaining: 3h 49m 55s. Rate: 7.2 symbols/min [2025-10-17T18:38:19.696993] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:38:19.709228] [DEBUG] [LOCAL ] EHI: Loaded 10710 existing records from primary storage. [2025-10-17T18:38:19.709476] [INFO ] [MAIN ] EHI: Loaded 10710 existing records. [2025-10-17T18:38:19.902955] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:38:19.903214] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-17T18:38:19.903450] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-17T18:38:19.903787] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-17T18:38:19.903889] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-17T18:38:19.961293] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-17T18:38:20.119864] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T18:38:20.305451] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:38:20.757998] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-17T18:38:20.925859] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T18:38:21.074613] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T18:38:21.558019] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-17T18:38:22.358078] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-17T18:38:22.455448] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T18:38:22.572676] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T18:38:23.158042] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-17T18:38:23.792069] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T18:38:23.958066] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-17T18:38:24.206592] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T18:38:24.758034] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-17T18:38:25.453876] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T18:38:25.558020] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-17T18:38:25.622376] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-17T18:38:26.358068] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-17T18:38:26.957060] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T18:38:27.158030] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-17T18:38:27.958010] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-17T18:38:28.006479] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T18:38:28.426383] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T18:38:28.758029] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-17T18:38:29.327214] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T18:38:29.558065] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-17T18:38:29.742190] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-17T18:38:30.328291] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-17T18:38:30.357989] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-17T18:38:31.074517] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T18:38:31.157997] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-17T18:38:31.958065] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-17T18:38:32.758007] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-17T18:38:32.767253] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T18:38:32.911620] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T18:38:33.558030] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-17T18:38:33.889525] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T18:38:34.358058] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-17T18:38:35.158031] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-17T18:38:35.271536] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T18:38:35.813215] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T18:38:35.957998] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-17T18:38:36.043669] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T18:38:36.758025] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-17T18:38:37.563288] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-17T18:38:37.566319] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T18:38:37.639587] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T18:38:38.358059] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-17T18:38:39.105310] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T18:38:39.158017] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-17T18:38:39.966992] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-17T18:38:39.972140] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T18:38:40.500567] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-17T18:38:40.758041] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-17T18:38:41.547809] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T18:38:41.557981] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-17T18:38:41.636700] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T18:38:42.358005] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-17T18:38:42.655004] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T18:38:43.158085] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-17T18:38:43.870391] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T18:38:43.958053] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-17T18:38:44.758066] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-17T18:38:44.810371] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T18:38:45.267936] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T18:38:45.276944] [INFO ] [REMOTE ] EGY: Full fetch complete (60962 records). [2025-10-17T18:38:45.277057] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-17T18:38:45.563286] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-17T18:38:45.618981] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-17T18:38:45.711487] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-17T18:38:45.711568] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-17T18:38:45.712385] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-17T18:38:45.712449] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-17T18:38:45.713629] [DEBUG] [LOCAL ] EGY: Trimmed 60962 records to 42160 (keeping 200 days of data) [2025-10-17T18:38:45.948808] [DEBUG] [LOCAL ] EGY: Primary data saved (42160 records). [2025-10-17T18:38:45.948934] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-17T18:38:45.949011] [INFO ] [MAIN ] Update Progress: 710/2368 symbols completed. EGY took 39.1s. Estimated remaining: 3h 50m 29s. Rate: 7.2 symbols/min [2025-10-17T18:38:46.113101] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:38:46.136186] [DEBUG] [LOCAL ] EIC: Loaded 23019 existing records from primary storage. [2025-10-17T18:38:46.136427] [INFO ] [MAIN ] EIC: Loaded 23019 existing records. [2025-10-17T18:38:46.321017] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:38:46.321255] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-17T18:38:46.321302] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-17T18:38:46.321571] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-17T18:38:46.321630] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-17T18:38:46.366204] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-17T18:38:46.685236] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:38:47.016573] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T18:38:47.158028] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-17T18:38:47.416441] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T18:38:47.418577] [INFO ] [REMOTE ] EHI: Full fetch complete (16002 records). [2025-10-17T18:38:47.418670] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-17T18:38:47.780343] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-17T18:38:47.780440] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-17T18:38:47.780848] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-17T18:38:47.780910] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-17T18:38:47.781455] [DEBUG] [LOCAL ] EHI: Trimmed 16002 records to 10782 (keeping 200 days of data) [2025-10-17T18:38:47.841679] [DEBUG] [LOCAL ] EHI: Primary data saved (10782 records). [2025-10-17T18:38:47.841808] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-17T18:38:47.841888] [INFO ] [MAIN ] Update Progress: 711/2368 symbols completed. EHI took 28.3s. Estimated remaining: 3h 50m 6s. Rate: 7.2 symbols/min [2025-10-17T18:38:47.963182] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-17T18:38:48.015083] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:38:48.015448] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-17T18:38:48.015501] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-17T18:38:48.015617] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-17T18:38:48.015690] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-17T18:38:48.015750] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-17T18:38:48.015785] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-17T18:38:48.372029] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:38:48.581417] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T18:38:48.758033] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-17T18:38:49.310419] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-17T18:38:49.313970] [INFO ] [REMOTE ] EHAB: Full fetch complete (40921 records). [2025-10-17T18:38:49.314055] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-17T18:38:49.394805] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-17T18:38:49.567452] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-17T18:38:49.710137] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-17T18:38:49.710215] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-17T18:38:49.710848] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-17T18:38:49.710912] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-17T18:38:49.711961] [DEBUG] [LOCAL ] EHAB: Trimmed 40921 records to 29656 (keeping 200 days of data) [2025-10-17T18:38:49.874371] [DEBUG] [LOCAL ] EHAB: Primary data saved (29656 records). [2025-10-17T18:38:49.874503] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-17T18:38:49.874583] [INFO ] [MAIN ] Update Progress: 712/2368 symbols completed. EHAB took 40.8s. Estimated remaining: 3h 49m 43s. Rate: 7.2 symbols/min [2025-10-17T18:38:50.040224] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:38:50.040389] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-17T18:38:50.040426] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-17T18:38:50.040536] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-17T18:38:50.040577] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-17T18:38:50.040625] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-17T18:38:50.040692] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-17T18:38:50.118064] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-17T18:38:50.363191] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-17T18:38:50.406168] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:38:51.158052] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-17T18:38:51.484389] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T18:38:51.704111] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-17T18:38:51.958030] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-17T18:38:52.758048] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-17T18:38:53.272723] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-17T18:38:53.557999] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-17T18:38:53.633056] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T18:38:54.358039] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-17T18:38:54.727121] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-17T18:38:55.148364] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T18:38:55.156474] [INFO ] [REMOTE ] EHC: Full fetch complete (58817 records). [2025-10-17T18:38:55.156779] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-17T18:38:55.163186] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-17T18:38:55.718949] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T18:38:55.721849] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-17T18:38:55.721982] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-17T18:38:55.723715] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-17T18:38:55.723802] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-17T18:38:55.725781] [DEBUG] [LOCAL ] EHC: Trimmed 58817 records to 41587 (keeping 200 days of data) [2025-10-17T18:38:55.970290] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-17T18:38:56.060536] [DEBUG] [LOCAL ] EHC: Primary data saved (41587 records). [2025-10-17T18:38:56.060720] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-17T18:38:56.060821] [INFO ] [MAIN ] Update Progress: 713/2368 symbols completed. EHC took 39.8s. Estimated remaining: 3h 49m 30s. Rate: 7.2 symbols/min [2025-10-17T18:38:56.250550] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:38:56.250782] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-17T18:38:56.250828] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-17T18:38:56.250945] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-17T18:38:56.250988] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-17T18:38:56.251029] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-17T18:38:56.251062] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-17T18:38:56.539496] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-17T18:38:56.657225] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:38:56.758019] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-17T18:38:57.558078] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-17T18:38:57.595329] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-17T18:38:57.936363] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-17T18:38:58.358055] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-17T18:38:59.158053] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-17T18:38:59.714884] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T18:38:59.740493] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-17T18:38:59.957987] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-17T18:39:00.573435] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-17T18:39:00.758058] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-17T18:39:01.558070] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-17T18:39:01.646272] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T18:39:02.358102] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-17T18:39:02.845889] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T18:39:02.866111] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T18:39:03.158035] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-17T18:39:03.506380] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-17T18:39:03.958035] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-17T18:39:04.556568] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-17T18:39:04.758024] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-17T18:39:05.395663] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-17T18:39:05.558028] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-17T18:39:05.926515] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-17T18:39:06.358023] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-17T18:39:07.158014] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-17T18:39:07.494382] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T18:39:07.571686] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-17T18:39:07.958028] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-17T18:39:08.758048] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-17T18:39:09.075943] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T18:39:09.558027] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-17T18:39:09.881813] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-17T18:39:10.112329] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-17T18:39:10.358082] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-17T18:39:10.950506] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-17T18:39:11.158073] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-17T18:39:11.877423] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-17T18:39:11.958055] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-17T18:39:12.743690] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-17T18:39:12.757988] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-17T18:39:13.479202] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-17T18:39:13.558027] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-17T18:39:14.358068] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-17T18:39:14.864465] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T18:39:14.914364] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T18:39:15.158017] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-17T18:39:15.957995] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-17T18:39:16.275015] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T18:39:16.610079] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-17T18:39:16.611534] [INFO ] [REMOTE ] EICC: Full fetch complete (8454 records). [2025-10-17T18:39:16.611603] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-17T18:39:16.612037] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:39:16.612122] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:39:16.612163] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:39:16.612206] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-17T18:39:16.612261] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-17T18:39:16.612295] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-17T18:39:16.612332] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-17T18:39:16.612381] [INFO ] [MAIN ] Update Progress: 714/2368 symbols completed. EICC took 20.6s. Estimated remaining: 3h 49m 50s. Rate: 7.2 symbols/min [2025-10-17T18:39:16.759404] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-17T18:39:16.777706] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:39:16.798235] [DEBUG] [LOCAL ] EIG: Loaded 20357 existing records from primary storage. [2025-10-17T18:39:16.798466] [INFO ] [MAIN ] EIG: Loaded 20357 existing records. [2025-10-17T18:39:16.969251] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:39:16.969446] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-17T18:39:16.969493] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-17T18:39:16.969890] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-17T18:39:16.969947] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-17T18:39:17.313926] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:39:17.365853] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T18:39:17.366477] [INFO ] [REMOTE ] EICA: Full fetch complete (1275 records). [2025-10-17T18:39:17.366543] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-17T18:39:17.537085] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-17T18:39:17.537265] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:39:17.537349] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:39:17.537400] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-17T18:39:17.537459] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-17T18:39:17.537493] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-17T18:39:17.537530] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-17T18:39:17.537584] [INFO ] [MAIN ] Update Progress: 715/2368 symbols completed. EICA took 29.7s. Estimated remaining: 3h 49m 24s. Rate: 7.2 symbols/min [2025-10-17T18:39:17.565152] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-17T18:39:17.706468] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:39:17.768579] [DEBUG] [LOCAL ] EIX: Loaded 53763 existing records from primary storage. [2025-10-17T18:39:17.769062] [INFO ] [MAIN ] EIX: Loaded 53763 existing records. [2025-10-17T18:39:17.947636] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:39:17.947851] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-17T18:39:17.947898] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-17T18:39:17.948185] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-17T18:39:17.948239] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-17T18:39:18.056946] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-17T18:39:18.300574] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:39:18.357981] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-17T18:39:19.158061] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-17T18:39:19.958020] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-17T18:39:20.220609] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-17T18:39:20.373623] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T18:39:20.446601] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-17T18:39:20.758042] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-17T18:39:21.195690] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-17T18:39:21.558030] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-17T18:39:22.358003] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-17T18:39:22.538674] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-17T18:39:22.809374] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T18:39:23.158047] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-17T18:39:23.603709] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-17T18:39:23.958053] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-17T18:39:24.758050] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-17T18:39:25.558059] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-17T18:39:25.751435] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T18:39:25.935382] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-17T18:39:26.358031] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-17T18:39:26.658403] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T18:39:26.661408] [INFO ] [REMOTE ] EIC: Full fetch complete (34347 records). [2025-10-17T18:39:26.661502] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-17T18:39:27.019366] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-17T18:39:27.019440] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-17T18:39:27.019973] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-17T18:39:27.020035] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-17T18:39:27.020778] [DEBUG] [LOCAL ] EIC: Trimmed 34347 records to 23126 (keeping 200 days of data) [2025-10-17T18:39:27.158121] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-17T18:39:27.162958] [DEBUG] [LOCAL ] EIC: Primary data saved (23126 records). [2025-10-17T18:39:27.163049] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-17T18:39:27.163176] [INFO ] [MAIN ] Update Progress: 716/2368 symbols completed. EIC took 41.2s. Estimated remaining: 3h 49m 19s. Rate: 7.2 symbols/min [2025-10-17T18:39:27.331059] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:39:27.380464] [DEBUG] [LOCAL ] EL: Loaded 53766 existing records from primary storage. [2025-10-17T18:39:27.380837] [INFO ] [MAIN ] EL: Loaded 53766 existing records. [2025-10-17T18:39:27.557605] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:39:27.557961] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-17T18:39:27.558016] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-17T18:39:27.558426] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-17T18:39:27.558483] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-17T18:39:27.913723] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:39:27.957990] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-17T18:39:28.099378] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T18:39:28.197169] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-17T18:39:28.758053] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-17T18:39:29.558027] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-17T18:39:29.869694] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T18:39:30.153069] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-17T18:39:30.236967] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T18:39:30.237891] [INFO ] [REMOTE ] EICB: Full fetch complete (2720 records). [2025-10-17T18:39:30.237984] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-17T18:39:30.363126] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-17T18:39:30.420801] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T18:39:30.421008] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:39:30.421054] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:39:30.421120] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-17T18:39:30.421183] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-17T18:39:30.421233] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-17T18:39:30.421338] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-17T18:39:30.421404] [INFO ] [MAIN ] Update Progress: 717/2368 symbols completed. EICB took 40.5s. Estimated remaining: 3h 48m 59s. Rate: 7.2 symbols/min [2025-10-17T18:39:31.158045] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-17T18:39:31.553253] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-17T18:39:31.957998] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-17T18:39:32.758086] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-17T18:39:33.082231] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T18:39:33.134305] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-17T18:39:33.558017] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-17T18:39:34.358078] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-17T18:39:34.683711] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T18:39:35.158032] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-17T18:39:35.330965] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T18:39:35.706432] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-17T18:39:35.958040] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-17T18:39:36.758002] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-17T18:39:37.030522] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:39:37.066743] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T18:39:37.558035] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-17T18:39:38.358040] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-17T18:39:38.839877] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T18:39:39.012812] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-17T18:39:39.157993] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-17T18:39:39.958010] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-17T18:39:40.167249] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T18:39:40.758078] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-17T18:39:40.956889] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T18:39:41.316012] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-17T18:39:41.558028] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-17T18:39:42.358016] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-17T18:39:42.635073] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T18:39:43.158044] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-17T18:39:43.557855] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T18:39:43.560741] [INFO ] [REMOTE ] EIG: Full fetch complete (27214 records). [2025-10-17T18:39:43.560841] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-17T18:39:43.940051] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-17T18:39:43.940158] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-17T18:39:43.940812] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-17T18:39:43.940918] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-17T18:39:43.942189] [DEBUG] [LOCAL ] EIG: Trimmed 27214 records to 20485 (keeping 200 days of data) [2025-10-17T18:39:44.029409] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-17T18:39:44.073256] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-17T18:39:44.103233] [DEBUG] [LOCAL ] EIG: Primary data saved (20485 records). [2025-10-17T18:39:44.103358] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-17T18:39:44.103464] [INFO ] [MAIN ] Update Progress: 718/2368 symbols completed. EIG took 27.5s. Estimated remaining: 3h 49m 3s. Rate: 7.2 symbols/min [2025-10-17T18:39:44.953588] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T18:39:44.965400] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-17T18:39:45.887222] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T18:39:45.898152] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-17T18:39:46.774425] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T18:39:46.785944] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-17T18:39:48.042102] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-17T18:39:48.055734] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-17T18:39:48.189815] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T18:39:48.205784] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-17T18:39:48.917073] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T18:39:48.923981] [INFO ] [REMOTE ] EIX: Full fetch complete (77050 records). [2025-10-17T18:39:48.924104] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-17T18:39:48.924823] [FATAL] [VALIDATOR ] EIX: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:39:48.924908] [FATAL] [MAIN ] EIX: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:39:48.924972] [WARN ] [MAIN ] EIX: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:39:48.925057] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-17T18:39:48.925140] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-10-17T18:39:48.925191] [INFO ] [LOCAL ] EIX: Starting deletion of derivative data. [2025-10-17T18:39:48.925380] [DEBUG] [LOCAL ] EIX: Deleted derivative data file. [2025-10-17T18:39:48.926049] [INFO ] [MAIN ] Update Progress: 719/2368 symbols completed. EIX took 31.4s. Estimated remaining: 3h 48m 46s. Rate: 7.2 symbols/min [2025-10-17T18:39:49.899635] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T18:39:49.910936] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-17T18:39:51.907438] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-17T18:39:51.918761] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-17T18:39:52.812770] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T18:39:52.820101] [INFO ] [REMOTE ] EL: Full fetch complete (77435 records). [2025-10-17T18:39:52.820215] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-17T18:39:53.199104] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-17T18:39:53.199196] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-17T18:39:53.200112] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-17T18:39:53.200184] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-17T18:39:53.201721] [DEBUG] [LOCAL ] EL: Trimmed 77435 records to 54155 (keeping 200 days of data) [2025-10-17T18:39:53.531682] [DEBUG] [LOCAL ] EL: Primary data saved (54155 records). [2025-10-17T18:39:53.531896] [INFO ] [MAIN ] EL: Full history saved. [2025-10-17T18:39:53.532021] [INFO ] [MAIN ] Update Progress: 720/2368 symbols completed. EL took 26.4s. Estimated remaining: 3h 48m 30s. Rate: 7.2 symbols/min [2025-10-17T18:39:54.314032] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:39:54.316122] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:39:54.310178] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:39:54.290478] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:39:54.317436] [DEBUG] [LOCAL ] ELME: No existing data file found in primary storage. [2025-10-17T18:39:54.317984] [WARN ] [MAIN ] ELME: No existing data found, performing full refresh instead. [2025-10-17T18:39:54.318202] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-17T18:39:54.318287] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-17T18:39:54.318435] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-17T18:39:54.321054] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-17T18:39:54.369883] [DEBUG] [LOCAL ] ELC: Loaded 3525 existing records from primary storage. [2025-10-17T18:39:54.377287] [INFO ] [MAIN ] ELC: Loaded 3525 existing records. [2025-10-17T18:39:54.731685] [DEBUG] [LOCAL ] ELAN: Loaded 53690 existing records from primary storage. [2025-10-17T18:39:54.873963] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:39:54.847869] [INFO ] [MAIN ] ELAN: Loaded 53690 existing records. [2025-10-17T18:39:54.904007] [DEBUG] [LOCAL ] ELF: Loaded 52376 existing records from primary storage. [2025-10-17T18:39:54.890456] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-17T18:39:54.968996] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-17T18:39:54.999475] [INFO ] [MAIN ] ELF: Loaded 52376 existing records. [2025-10-17T18:39:55.024633] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-17T18:39:55.033935] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:39:55.044501] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-17T18:39:55.089012] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-17T18:39:55.339694] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:39:55.448272] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-17T18:39:55.498851] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-17T18:39:55.501951] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:39:55.544490] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-17T18:39:55.544575] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-17T18:39:55.586884] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-17T18:39:55.611878] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-17T18:39:55.734209] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-17T18:39:55.780360] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-17T18:39:56.164371] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:39:56.211442] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-17T18:39:56.454212] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:39:56.459254] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-17T18:39:56.541088] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:39:56.541387] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-17T18:39:56.717125] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T18:39:56.725317] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-17T18:39:57.116819] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T18:39:57.118515] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-17T18:39:57.756754] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-17T18:39:57.758291] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-17T18:39:58.058403] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T18:39:58.065817] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-17T18:39:58.162433] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T18:39:58.173207] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-17T18:39:58.279211] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-17T18:39:58.280539] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-17T18:39:58.504841] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T18:39:58.516146] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-17T18:39:58.703427] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-17T18:39:59.158057] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-17T18:39:59.212989] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T18:39:59.502813] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-17T18:39:59.815474] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T18:39:59.957997] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-17T18:40:00.473930] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T18:40:00.758028] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-17T18:40:01.558016] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-17T18:40:01.594094] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T18:40:02.358030] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-17T18:40:02.583304] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T18:40:02.584772] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T18:40:03.158028] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-17T18:40:03.957999] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-17T18:40:04.411154] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-17T18:40:04.694299] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T18:40:04.757994] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-17T18:40:05.558059] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-17T18:40:06.101912] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-17T18:40:06.215673] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-17T18:40:06.358029] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-17T18:40:06.502512] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T18:40:07.158041] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-17T18:40:07.958036] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-17T18:40:08.127067] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-17T18:40:08.491882] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-17T18:40:08.758039] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-17T18:40:08.993109] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T18:40:09.104911] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-17T18:40:09.558034] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-17T18:40:10.358020] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-17T18:40:10.958267] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-17T18:40:11.158034] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-17T18:40:11.219451] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T18:40:11.958025] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-17T18:40:12.578850] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-17T18:40:12.579830] [INFO ] [REMOTE ] ELC: Full fetch complete (4998 records). [2025-10-17T18:40:12.579898] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-17T18:40:12.760734] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-17T18:40:12.956823] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-17T18:40:12.956906] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-17T18:40:12.957328] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-17T18:40:12.957392] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-17T18:40:12.957855] [DEBUG] [LOCAL ] ELC: Trimmed 4998 records to 3542 (keeping 200 days of data) [2025-10-17T18:40:12.979757] [DEBUG] [LOCAL ] ELC: Primary data saved (3542 records). [2025-10-17T18:40:12.979835] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-17T18:40:12.979922] [INFO ] [MAIN ] Update Progress: 721/2368 symbols completed. ELC took 19.4s. Estimated remaining: 3h 48m 47s. Rate: 7.2 symbols/min [2025-10-17T18:40:13.147627] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:40:13.181320] [DEBUG] [LOCAL ] ELP: Loaded 25881 existing records from primary storage. [2025-10-17T18:40:13.181568] [INFO ] [MAIN ] ELP: Loaded 25881 existing records. [2025-10-17T18:40:13.363384] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:40:13.363951] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-17T18:40:13.364111] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-17T18:40:13.364410] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-17T18:40:13.364475] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-17T18:40:13.529699] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-17T18:40:13.561053] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-17T18:40:13.793787] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:40:14.358257] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-17T18:40:15.158028] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-17T18:40:15.406215] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-17T18:40:15.582423] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T18:40:15.958042] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-17T18:40:16.228897] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-10-17T18:40:16.466569] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T18:40:16.758069] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-17T18:40:17.104016] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T18:40:17.558040] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-17T18:40:18.358004] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-17T18:40:18.852423] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-17T18:40:18.922837] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T18:40:19.158030] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-17T18:40:19.459975] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T18:40:19.958040] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-17T18:40:20.758001] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-17T18:40:20.980538] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-17T18:40:21.556180] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T18:40:21.561041] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-17T18:40:21.694025] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T18:40:22.358029] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-17T18:40:23.158073] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-17T18:40:23.224290] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T18:40:23.230405] [INFO ] [REMOTE ] ELME: Full fetch complete (56076 records). [2025-10-17T18:40:23.230531] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-17T18:40:23.614405] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-17T18:40:23.614501] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-17T18:40:23.615349] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-17T18:40:23.615417] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-17T18:40:23.616949] [DEBUG] [LOCAL ] ELME: Trimmed 56076 records to 39953 (keeping 200 days of data) [2025-10-17T18:40:23.860048] [DEBUG] [LOCAL ] ELME: Primary data saved (39953 records). [2025-10-17T18:40:23.860194] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-17T18:40:23.860268] [INFO ] [MAIN ] Update Progress: 722/2368 symbols completed. ELME took 30.3s. Estimated remaining: 3h 48m 44s. Rate: 7.2 symbols/min [2025-10-17T18:40:23.960625] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-17T18:40:24.038222] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:40:24.038586] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-17T18:40:24.038669] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-17T18:40:24.038788] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-17T18:40:24.038832] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-17T18:40:24.038874] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-17T18:40:24.038948] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-17T18:40:24.357021] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-17T18:40:24.420217] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:40:24.451503] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-17T18:40:24.758027] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-17T18:40:25.558036] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-17T18:40:26.171801] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-17T18:40:26.358012] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-17T18:40:26.701746] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T18:40:26.838742] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T18:40:27.158032] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-17T18:40:27.958036] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-17T18:40:28.529181] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-17T18:40:28.530896] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-17T18:40:28.758000] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-17T18:40:29.076954] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T18:40:29.084315] [INFO ] [REMOTE ] ELAN: Full fetch complete (77081 records). [2025-10-17T18:40:29.084454] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-17T18:40:29.464809] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-17T18:40:29.464894] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-17T18:40:29.465822] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-17T18:40:29.465884] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-17T18:40:29.467344] [DEBUG] [LOCAL ] ELAN: Trimmed 77081 records to 54080 (keeping 200 days of data) [2025-10-17T18:40:29.559850] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-17T18:40:29.780243] [DEBUG] [LOCAL ] ELAN: Primary data saved (54080 records). [2025-10-17T18:40:29.780383] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-17T18:40:29.781196] [INFO ] [MAIN ] Update Progress: 723/2368 symbols completed. ELAN took 36.2s. Estimated remaining: 3h 48m 30s. Rate: 7.2 symbols/min [2025-10-17T18:40:29.943736] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:40:29.991055] [DEBUG] [LOCAL ] ELS: Loaded 50226 existing records from primary storage. [2025-10-17T18:40:29.991380] [INFO ] [MAIN ] ELS: Loaded 50226 existing records. [2025-10-17T18:40:30.166790] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:40:30.167059] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-17T18:40:30.167132] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-17T18:40:30.167610] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-17T18:40:30.167697] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-17T18:40:30.367004] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-17T18:40:30.515471] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:40:30.710332] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T18:40:30.952266] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T18:40:30.968836] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T18:40:31.158082] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-17T18:40:31.958002] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-17T18:40:32.223543] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-17T18:40:32.378965] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T18:40:32.758062] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-17T18:40:33.558031] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-17T18:40:33.922843] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-17T18:40:34.018107] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T18:40:34.358031] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-17T18:40:35.157990] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-17T18:40:35.554860] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-17T18:40:35.958064] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-17T18:40:36.454790] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-17T18:40:36.757993] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-17T18:40:36.817960] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T18:40:37.115151] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-17T18:40:37.558034] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-17T18:40:37.896432] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-17T18:40:38.358053] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-17T18:40:38.808722] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-17T18:40:39.158057] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-17T18:40:39.481242] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-17T18:40:39.958024] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-17T18:40:40.269909] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-17T18:40:40.758049] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-17T18:40:41.558054] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-17T18:40:42.358041] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-17T18:40:42.811276] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-17T18:40:42.918154] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-17T18:40:42.925165] [INFO ] [REMOTE ] ELF: Full fetch complete (75477 records). [2025-10-17T18:40:42.925334] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-17T18:40:43.163272] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-17T18:40:43.310845] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-17T18:40:43.310947] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-17T18:40:43.311888] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-17T18:40:43.311954] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-17T18:40:43.313805] [DEBUG] [LOCAL ] ELF: Trimmed 75477 records to 52711 (keeping 200 days of data) [2025-10-17T18:40:43.636035] [DEBUG] [LOCAL ] ELF: Primary data saved (52711 records). [2025-10-17T18:40:43.636206] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-17T18:40:43.636309] [INFO ] [MAIN ] Update Progress: 724/2368 symbols completed. ELF took 50.1s. Estimated remaining: 3h 48m 34s. Rate: 7.2 symbols/min [2025-10-17T18:40:43.805586] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:40:43.851846] [DEBUG] [LOCAL ] ELV: Loaded 51042 existing records from primary storage. [2025-10-17T18:40:43.852235] [INFO ] [MAIN ] ELV: Loaded 51042 existing records. [2025-10-17T18:40:43.936451] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-17T18:40:43.950019] [INFO ] [REMOTE ] ELPC: Full fetch complete (1396 records). [2025-10-17T18:40:43.971532] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-17T18:40:43.968231] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-17T18:40:44.158886] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:40:44.159327] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-17T18:40:44.159508] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-17T18:40:44.189847] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-17T18:40:44.213581] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-17T18:40:44.334580] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-17T18:40:44.346558] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:40:44.366269] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:40:44.371441] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-17T18:40:44.369878] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-17T18:40:44.401542] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-17T18:40:44.420958] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-17T18:40:44.426165] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-17T18:40:44.426370] [INFO ] [MAIN ] Update Progress: 725/2368 symbols completed. ELPC took 20.6s. Estimated remaining: 3h 48m 9s. Rate: 7.2 symbols/min [2025-10-17T18:40:44.758867] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-17T18:40:44.793004] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:40:44.815839] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-17T18:40:44.815960] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-17T18:40:44.815736] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:40:44.816859] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-17T18:40:44.817139] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-17T18:40:44.817206] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-17T18:40:44.817242] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-17T18:40:45.170417] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:40:45.223318] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T18:40:45.226890] [INFO ] [REMOTE ] ELP: Full fetch complete (36864 records). [2025-10-17T18:40:45.226972] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-17T18:40:45.564099] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-17T18:40:45.586388] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-17T18:40:45.586589] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-17T18:40:45.587205] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-17T18:40:45.587267] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-17T18:40:45.588192] [DEBUG] [LOCAL ] ELP: Trimmed 36864 records to 26040 (keeping 200 days of data) [2025-10-17T18:40:45.728928] [DEBUG] [LOCAL ] ELP: Primary data saved (26040 records). [2025-10-17T18:40:45.729059] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-17T18:40:45.729139] [INFO ] [MAIN ] Update Progress: 726/2368 symbols completed. ELP took 32.7s. Estimated remaining: 3h 47m 45s. Rate: 7.2 symbols/min [2025-10-17T18:40:45.894281] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:40:45.914171] [DEBUG] [LOCAL ] EMD: Loaded 21065 existing records from primary storage. [2025-10-17T18:40:45.914398] [INFO ] [MAIN ] EMD: Loaded 21065 existing records. [2025-10-17T18:40:46.089267] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:40:46.089517] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-17T18:40:46.089564] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-17T18:40:46.089765] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-17T18:40:46.089822] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-17T18:40:46.364045] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-17T18:40:46.447863] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:40:46.473934] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-17T18:40:46.633540] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:40:46.633838] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-17T18:40:46.633923] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:40:46.633996] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-17T18:40:46.634061] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:40:46.634133] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-17T18:40:46.634198] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-17T18:40:46.634234] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-17T18:40:46.634273] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-17T18:40:46.634318] [INFO ] [MAIN ] Update Progress: 727/2368 symbols completed. EMA took 2.2s. Estimated remaining: 3h 47m 20s. Rate: 7.2 symbols/min [2025-10-17T18:40:46.798675] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:40:46.830508] [DEBUG] [LOCAL ] EME: Loaded 31206 existing records from primary storage. [2025-10-17T18:40:46.830812] [INFO ] [MAIN ] EME: Loaded 31206 existing records. [2025-10-17T18:40:47.001089] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:40:47.001360] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-17T18:40:47.001409] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-17T18:40:47.001730] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-17T18:40:47.001791] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-17T18:40:47.169407] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-17T18:40:47.352389] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:40:47.628943] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-17T18:40:47.958077] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-17T18:40:48.341943] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T18:40:48.758083] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-17T18:40:49.386398] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T18:40:49.558068] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-17T18:40:50.358073] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-17T18:40:50.460029] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T18:40:51.158045] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-17T18:40:51.334964] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T18:40:51.877397] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T18:40:51.957998] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-17T18:40:52.204310] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-17T18:40:52.758062] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-17T18:40:53.182765] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T18:40:53.558001] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-17T18:40:53.624172] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-17T18:40:54.358032] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-17T18:40:55.158004] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-17T18:40:55.214392] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T18:40:55.958006] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-17T18:40:56.041469] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T18:40:56.272912] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T18:40:56.758115] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-17T18:40:57.514024] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T18:40:57.558021] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-17T18:40:58.358050] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-17T18:40:58.418212] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T18:40:59.094843] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T18:40:59.157990] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-17T18:40:59.510821] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T18:40:59.958141] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-17T18:41:00.392372] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-17T18:41:00.758065] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-17T18:41:01.429615] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T18:41:01.558042] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-17T18:41:02.358054] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-17T18:41:02.929566] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T18:41:03.059688] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-17T18:41:03.158036] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-17T18:41:03.958001] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-17T18:41:04.225541] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T18:41:04.301218] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T18:41:04.757993] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-17T18:41:04.914087] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T18:41:05.558023] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-17T18:41:05.675502] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T18:41:06.358060] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-17T18:41:07.158001] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-17T18:41:07.358410] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T18:41:07.958002] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-17T18:41:08.087556] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T18:41:08.277793] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T18:41:08.758046] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-17T18:41:09.558016] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-17T18:41:09.870573] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T18:41:10.358032] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-17T18:41:10.419501] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T18:41:11.129447] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T18:41:11.158046] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-17T18:41:11.958027] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-17T18:41:12.097783] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T18:41:12.758018] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-17T18:41:12.949850] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T18:41:13.421618] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T18:41:13.425062] [INFO ] [REMOTE ] EMD: Full fetch complete (32112 records). [2025-10-17T18:41:13.425161] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-17T18:41:13.563166] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-17T18:41:13.825912] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-17T18:41:13.826005] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-17T18:41:13.826634] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-17T18:41:13.826717] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-17T18:41:13.827558] [DEBUG] [LOCAL ] EMD: Trimmed 32112 records to 21209 (keeping 200 days of data) [2025-10-17T18:41:13.958670] [DEBUG] [LOCAL ] EMD: Primary data saved (21209 records). [2025-10-17T18:41:13.958812] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-17T18:41:13.958892] [INFO ] [MAIN ] Update Progress: 728/2368 symbols completed. EMD took 28.2s. Estimated remaining: 3h 47m 54s. Rate: 7.2 symbols/min [2025-10-17T18:41:14.148999] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:41:14.155146] [DEBUG] [LOCAL ] EMF: Loaded 3235 existing records from primary storage. [2025-10-17T18:41:14.155367] [INFO ] [MAIN ] EMF: Loaded 3235 existing records. [2025-10-17T18:41:14.355826] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:41:14.361209] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-17T18:41:14.370772] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T18:41:14.369108] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-17T18:41:14.375627] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-17T18:41:14.376001] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-17T18:41:14.376070] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-17T18:41:14.390017] [INFO ] [REMOTE ] EME: Full fetch complete (46906 records). [2025-10-17T18:41:14.410560] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-17T18:41:14.438150] [FATAL] [VALIDATOR ] EME: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:41:14.454522] [FATAL] [MAIN ] EME: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:41:14.479535] [WARN ] [MAIN ] EME: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:41:14.491913] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-17T18:41:14.492067] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-10-17T18:41:14.492133] [INFO ] [LOCAL ] EME: Starting deletion of derivative data. [2025-10-17T18:41:14.497888] [DEBUG] [LOCAL ] EME: Deleted derivative data file. [2025-10-17T18:41:14.508285] [INFO ] [MAIN ] Update Progress: 729/2368 symbols completed. EME took 27.9s. Estimated remaining: 3h 47m 28s. Rate: 7.2 symbols/min [2025-10-17T18:41:14.884828] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:41:14.975222] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:41:15.014796] [DEBUG] [LOCAL ] EMN: Loaded 51134 existing records from primary storage. [2025-10-17T18:41:15.015136] [INFO ] [MAIN ] EMN: Loaded 51134 existing records. [2025-10-17T18:41:15.158151] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-17T18:41:15.194979] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:41:15.195379] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-17T18:41:15.195439] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-17T18:41:15.195807] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-17T18:41:15.195864] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-17T18:41:15.548863] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:41:15.672029] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-17T18:41:15.969944] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-17T18:41:15.978255] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T18:41:16.271856] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T18:41:16.758120] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-17T18:41:17.558059] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-17T18:41:17.809441] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T18:41:18.358049] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-17T18:41:18.632250] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T18:41:19.159716] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-17T18:41:19.166056] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T18:41:19.958052] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-17T18:41:20.198917] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T18:41:20.557676] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-17T18:41:20.758066] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-17T18:41:21.558047] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-17T18:41:21.798921] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T18:41:21.806099] [INFO ] [REMOTE ] ELS: Full fetch complete (71245 records). [2025-10-17T18:41:21.806250] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-17T18:41:22.202268] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-17T18:41:22.202356] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-17T18:41:22.203227] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-17T18:41:22.203293] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-17T18:41:22.204746] [DEBUG] [LOCAL ] ELS: Trimmed 71245 records to 50599 (keeping 200 days of data) [2025-10-17T18:41:22.381421] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-17T18:41:22.532784] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T18:41:22.553323] [DEBUG] [LOCAL ] ELS: Primary data saved (50599 records). [2025-10-17T18:41:22.553442] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-17T18:41:22.554313] [INFO ] [MAIN ] Update Progress: 730/2368 symbols completed. ELS took 52.8s. Estimated remaining: 3h 47m 19s. Rate: 7.2 symbols/min [2025-10-17T18:41:22.719977] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:41:22.735630] [DEBUG] [LOCAL ] EMO: Loaded 13368 existing records from primary storage. [2025-10-17T18:41:22.735894] [INFO ] [MAIN ] EMO: Loaded 13368 existing records. [2025-10-17T18:41:22.920488] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:41:22.920716] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-17T18:41:22.920772] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-17T18:41:22.920925] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-17T18:41:22.920964] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-17T18:41:23.099396] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-17T18:41:23.168365] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-17T18:41:23.317361] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:41:23.429224] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T18:41:23.436296] [INFO ] [REMOTE ] ELV: Full fetch complete (73267 records). [2025-10-17T18:41:23.436428] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-17T18:41:23.826165] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-17T18:41:23.826264] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-17T18:41:23.827138] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-17T18:41:23.827202] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-17T18:41:23.828741] [DEBUG] [LOCAL ] ELV: Trimmed 73267 records to 51393 (keeping 200 days of data) [2025-10-17T18:41:23.958058] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-17T18:41:24.062301] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-17T18:41:24.170977] [DEBUG] [LOCAL ] ELV: Primary data saved (51393 records). [2025-10-17T18:41:24.171127] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-17T18:41:24.171748] [INFO ] [MAIN ] Update Progress: 731/2368 symbols completed. ELV took 40.5s. Estimated remaining: 3h 46m 56s. Rate: 7.2 symbols/min [2025-10-17T18:41:24.345600] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:41:24.352360] [DEBUG] [LOCAL ] EMP: Loaded 3045 existing records from primary storage. [2025-10-17T18:41:24.352732] [INFO ] [MAIN ] EMP: Loaded 3045 existing records. [2025-10-17T18:41:24.539433] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:41:24.539694] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-17T18:41:24.539754] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-17T18:41:24.539963] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-17T18:41:24.540021] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-17T18:41:24.766330] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-17T18:41:24.929819] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:41:25.449574] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-17T18:41:25.557982] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-17T18:41:25.648149] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T18:41:26.026475] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T18:41:26.358002] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-17T18:41:26.940500] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T18:41:27.158038] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-17T18:41:27.911327] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T18:41:27.958008] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-17T18:41:28.426752] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-17T18:41:28.758052] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-17T18:41:29.558038] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-17T18:41:30.075681] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-17T18:41:30.332179] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T18:41:30.357993] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-17T18:41:31.158060] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-17T18:41:31.640746] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-17T18:41:31.958036] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-17T18:41:32.209662] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T18:41:32.596206] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-17T18:41:32.758047] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-17T18:41:33.187789] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-17T18:41:33.558014] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-17T18:41:34.358035] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-17T18:41:34.827463] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-17T18:41:35.158026] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-17T18:41:35.279187] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T18:41:35.843794] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-17T18:41:35.958000] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-17T18:41:36.757997] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-17T18:41:36.850473] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-17T18:41:37.558022] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-17T18:41:38.184781] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-17T18:41:38.358007] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-17T18:41:38.443510] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T18:41:39.044456] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T18:41:39.158001] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-17T18:41:39.920051] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T18:41:39.958023] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-17T18:41:40.723751] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-17T18:41:40.758058] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-17T18:41:41.328508] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-17T18:41:41.329502] [INFO ] [REMOTE ] EMF: Full fetch complete (6274 records). [2025-10-17T18:41:41.329570] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-17T18:41:41.565578] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-17T18:41:41.687799] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-17T18:41:41.687875] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-17T18:41:41.688055] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-17T18:41:41.688095] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-17T18:41:41.688471] [DEBUG] [LOCAL ] EMF: Trimmed 6274 records to 3246 (keeping 200 days of data) [2025-10-17T18:41:41.709341] [DEBUG] [LOCAL ] EMF: Primary data saved (3246 records). [2025-10-17T18:41:41.709459] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-17T18:41:41.709541] [INFO ] [MAIN ] Update Progress: 732/2368 symbols completed. EMF took 27.8s. Estimated remaining: 3h 47m 8s. Rate: 7.2 symbols/min [2025-10-17T18:41:41.880198] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:41:41.932681] [DEBUG] [LOCAL ] EMR: Loaded 53592 existing records from primary storage. [2025-10-17T18:41:41.932984] [INFO ] [MAIN ] EMR: Loaded 53592 existing records. [2025-10-17T18:41:42.112123] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:41:42.112324] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-17T18:41:42.112371] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-17T18:41:42.112735] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-17T18:41:42.112792] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-17T18:41:42.363893] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-17T18:41:42.466211] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:41:43.157993] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-17T18:41:43.394360] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T18:41:43.416402] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-17T18:41:43.679931] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-17T18:41:43.958001] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-17T18:41:44.758029] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-17T18:41:44.856458] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-17T18:41:45.558030] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-17T18:41:46.357997] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-17T18:41:46.389403] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T18:41:46.546005] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T18:41:46.835250] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-17T18:41:47.158012] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-17T18:41:47.958084] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-17T18:41:48.758018] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-17T18:41:48.917839] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-17T18:41:49.143745] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T18:41:49.353292] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T18:41:49.558071] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-17T18:41:50.119819] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-17T18:41:50.358039] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-17T18:41:51.158050] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-17T18:41:51.939294] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T18:41:51.958030] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-17T18:41:52.152502] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T18:41:52.758054] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-17T18:41:52.907988] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-17T18:41:53.558068] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-17T18:41:54.358045] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-17T18:41:54.595668] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T18:41:54.598581] [INFO ] [REMOTE ] EMO: Full fetch complete (17703 records). [2025-10-17T18:41:54.598687] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-17T18:41:54.888501] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-17T18:41:54.916491] [INFO ] [REMOTE ] EMP: Full fetch complete (4182 records). [2025-10-17T18:41:54.919250] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-17T18:41:54.917507] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-17T18:41:55.115848] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-17T18:41:55.121607] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-17T18:41:55.122114] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-17T18:41:55.132446] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-17T18:41:55.161031] [DEBUG] [LOCAL ] EMO: Trimmed 17703 records to 13445 (keeping 200 days of data) [2025-10-17T18:41:55.160661] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-17T18:41:55.458756] [DEBUG] [LOCAL ] EMO: Primary data saved (13445 records). [2025-10-17T18:41:55.464877] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-17T18:41:55.464979] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-17T18:41:55.465031] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-17T18:41:55.465216] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-17T18:41:55.465335] [INFO ] [MAIN ] Update Progress: 733/2368 symbols completed. EMO took 32.9s. Estimated remaining: 3h 47m 12s. Rate: 7.2 symbols/min [2025-10-17T18:41:55.465420] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-17T18:41:55.528593] [DEBUG] [LOCAL ] EMP: Trimmed 4182 records to 3057 (keeping 200 days of data) [2025-10-17T18:41:55.601597] [DEBUG] [LOCAL ] EMP: Primary data saved (3057 records). [2025-10-17T18:41:55.611959] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-17T18:41:55.625825] [INFO ] [MAIN ] Update Progress: 734/2368 symbols completed. EMP took 31.5s. Estimated remaining: 3h 46m 46s. Rate: 7.2 symbols/min [2025-10-17T18:41:55.732426] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:41:55.830258] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:41:55.881457] [DEBUG] [LOCAL ] ENB: Loaded 53902 existing records from primary storage. [2025-10-17T18:41:55.881924] [INFO ] [MAIN ] ENB: Loaded 53902 existing records. [2025-10-17T18:41:55.961726] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-17T18:41:56.005459] [DEBUG] [LOCAL ] ENIC: Loaded 36937 existing records from primary storage. [2025-10-17T18:41:56.078717] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:41:56.078966] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-17T18:41:56.079049] [INFO ] [MAIN ] ENIC: Loaded 36937 existing records. [2025-10-17T18:41:56.079152] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-17T18:41:56.109812] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-17T18:41:56.147066] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-17T18:41:56.427355] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:41:56.489688] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-17T18:41:56.515485] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-17T18:41:56.546402] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-17T18:41:56.546543] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-17T18:41:56.731702] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:41:56.765595] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-17T18:41:56.990728] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:41:57.035672] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T18:41:57.042935] [INFO ] [REMOTE ] EMN: Full fetch complete (72367 records). [2025-10-17T18:41:57.043056] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-17T18:41:57.433227] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-17T18:41:57.433326] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-17T18:41:57.434203] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-17T18:41:57.434267] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-17T18:41:57.435683] [DEBUG] [LOCAL ] EMN: Trimmed 72367 records to 51488 (keeping 200 days of data) [2025-10-17T18:41:57.557995] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-17T18:41:57.746447] [DEBUG] [LOCAL ] EMN: Primary data saved (51488 records). [2025-10-17T18:41:57.746750] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-17T18:41:57.746890] [INFO ] [MAIN ] Update Progress: 735/2368 symbols completed. EMN took 43.2s. Estimated remaining: 3h 46m 24s. Rate: 7.2 symbols/min [2025-10-17T18:41:57.939970] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-17T18:41:57.942234] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:41:57.955836] [DEBUG] [LOCAL ] ENO: Loaded 1865 existing records from primary storage. [2025-10-17T18:41:57.955971] [INFO ] [MAIN ] ENO: Loaded 1865 existing records. [2025-10-17T18:41:58.132983] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:41:58.133182] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-17T18:41:58.133227] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-17T18:41:58.133387] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-17T18:41:58.133437] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-17T18:41:58.373890] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-17T18:41:58.487802] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:41:58.588023] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T18:41:58.767810] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-17T18:41:59.158034] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-17T18:41:59.958034] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-17T18:42:00.013226] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T18:42:00.070382] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T18:42:00.758037] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-17T18:42:01.558036] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-17T18:42:01.936806] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T18:42:02.105467] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-17T18:42:02.358041] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-17T18:42:03.158027] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-17T18:42:03.958015] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-17T18:42:04.138230] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-17T18:42:04.215871] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-17T18:42:04.345052] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T18:42:04.435036] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-17T18:42:04.758079] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-17T18:42:05.558069] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-17T18:42:06.358057] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-17T18:42:06.601567] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T18:42:06.830530] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T18:42:07.158034] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-17T18:42:07.473389] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T18:42:07.958054] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-17T18:42:08.757996] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-17T18:42:09.085122] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T18:42:09.557957] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-17T18:42:09.666172] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T18:42:09.820993] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T18:42:09.922269] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-17T18:42:10.358011] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-17T18:42:10.912712] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-17T18:42:11.158046] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-17T18:42:11.958039] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-17T18:42:12.758071] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-17T18:42:13.495091] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T18:42:13.557997] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-17T18:42:13.566329] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T18:42:14.036170] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-10-17T18:42:14.051039] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-17T18:42:14.358036] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-17T18:42:15.158035] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-17T18:42:15.958045] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-17T18:42:16.042367] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T18:42:16.758011] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-17T18:42:16.942845] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T18:42:17.266140] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-17T18:42:17.466085] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T18:42:17.558065] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-17T18:42:18.358044] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-17T18:42:19.158057] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-17T18:42:19.453574] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T18:42:19.842606] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T18:42:19.957990] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-17T18:42:20.758048] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-17T18:42:21.330020] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-17T18:42:21.512543] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-17T18:42:21.558003] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-17T18:42:22.358094] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-17T18:42:22.628566] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T18:42:22.870895] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-17T18:42:22.892491] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-17T18:42:23.158040] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-17T18:42:23.958045] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-17T18:42:24.758003] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-17T18:42:24.917440] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T18:42:25.153305] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-17T18:42:25.557998] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-17T18:42:25.873179] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T18:42:25.880543] [INFO ] [REMOTE ] EMR: Full fetch complete (77233 records). [2025-10-17T18:42:25.880751] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-17T18:42:26.273582] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-17T18:42:26.273709] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-17T18:42:26.274749] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-17T18:42:26.274817] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-17T18:42:26.276445] [DEBUG] [LOCAL ] EMR: Trimmed 77233 records to 53972 (keeping 200 days of data) [2025-10-17T18:42:26.367181] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-17T18:42:26.615088] [DEBUG] [LOCAL ] EMR: Primary data saved (53972 records). [2025-10-17T18:42:26.615216] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-17T18:42:26.615296] [INFO ] [MAIN ] Update Progress: 736/2368 symbols completed. EMR took 44.9s. Estimated remaining: 3h 47m 1s. Rate: 7.2 symbols/min [2025-10-17T18:42:26.786537] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:42:26.829109] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-17T18:42:26.829814] [DEBUG] [LOCAL ] ENOV: Loaded 45134 existing records from primary storage. [2025-10-17T18:42:26.830848] [INFO ] [REMOTE ] ENO: Full fetch complete (3016 records). [2025-10-17T18:42:26.830944] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-17T18:42:26.862127] [INFO ] [MAIN ] ENOV: Loaded 45134 existing records. [2025-10-17T18:42:27.167496] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-17T18:42:27.119178] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T18:42:27.273885] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:42:27.290282] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-17T18:42:27.290405] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-17T18:42:27.325015] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-17T18:42:27.328554] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-17T18:42:27.510314] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-17T18:42:27.515861] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-17T18:42:27.526350] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-17T18:42:27.526448] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-17T18:42:27.549778] [DEBUG] [LOCAL ] ENO: Trimmed 3016 records to 1872 (keeping 200 days of data) [2025-10-17T18:42:27.645852] [DEBUG] [LOCAL ] ENO: Primary data saved (1872 records). [2025-10-17T18:42:27.677499] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-17T18:42:27.682808] [INFO ] [MAIN ] Update Progress: 737/2368 symbols completed. ENO took 29.9s. Estimated remaining: 3h 46m 36s. Rate: 7.2 symbols/min [2025-10-17T18:42:27.919416] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:42:27.948342] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:42:27.958011] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-17T18:42:27.988240] [DEBUG] [LOCAL ] ENR: Loaded 44023 existing records from primary storage. [2025-10-17T18:42:27.988556] [INFO ] [MAIN ] ENR: Loaded 44023 existing records. [2025-10-17T18:42:28.161117] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:42:28.161314] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-17T18:42:28.161361] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-17T18:42:28.161537] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-17T18:42:28.161573] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-17T18:42:28.506204] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:42:28.758039] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-17T18:42:29.198446] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-17T18:42:29.558032] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-17T18:42:29.753165] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T18:42:30.063628] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T18:42:30.068390] [INFO ] [REMOTE ] ENIC: Full fetch complete (51524 records). [2025-10-17T18:42:30.068476] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-17T18:42:30.363154] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-17T18:42:30.443828] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-17T18:42:30.443905] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-17T18:42:30.444600] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-17T18:42:30.444669] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-17T18:42:30.445803] [DEBUG] [LOCAL ] ENIC: Trimmed 51524 records to 37209 (keeping 200 days of data) [2025-10-17T18:42:30.649243] [DEBUG] [LOCAL ] ENIC: Primary data saved (37209 records). [2025-10-17T18:42:30.649364] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-17T18:42:30.649448] [INFO ] [MAIN ] Update Progress: 738/2368 symbols completed. ENIC took 35.0s. Estimated remaining: 3h 46m 16s. Rate: 7.2 symbols/min [2025-10-17T18:42:30.846753] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:42:30.876114] [DEBUG] [LOCAL ] ENS: Loaded 29991 existing records from primary storage. [2025-10-17T18:42:30.876368] [INFO ] [MAIN ] ENS: Loaded 29991 existing records. [2025-10-17T18:42:31.051795] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:42:31.052013] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-17T18:42:31.052070] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-17T18:42:31.052327] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-17T18:42:31.052383] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-17T18:42:31.163180] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-17T18:42:31.400791] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:42:31.878633] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-17T18:42:31.886464] [INFO ] [REMOTE ] ENB: Full fetch complete (77658 records). [2025-10-17T18:42:31.886626] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-17T18:42:31.961682] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-17T18:42:32.062858] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T18:42:32.316428] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-17T18:42:32.316676] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-17T18:42:32.318928] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-17T18:42:32.319066] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-17T18:42:32.339019] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T18:42:32.346501] [DEBUG] [LOCAL ] ENB: Trimmed 77658 records to 54292 (keeping 200 days of data) [2025-10-17T18:42:32.674496] [DEBUG] [LOCAL ] ENB: Primary data saved (54292 records). [2025-10-17T18:42:32.674697] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-17T18:42:32.675589] [INFO ] [MAIN ] Update Progress: 739/2368 symbols completed. ENB took 37.2s. Estimated remaining: 3h 45m 54s. Rate: 7.2 symbols/min [2025-10-17T18:42:32.764363] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-17T18:42:32.848716] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:42:32.879546] [DEBUG] [LOCAL ] ENVA: Loaded 25627 existing records from primary storage. [2025-10-17T18:42:32.879847] [INFO ] [MAIN ] ENVA: Loaded 25627 existing records. [2025-10-17T18:42:33.057768] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:42:33.057967] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-17T18:42:33.058013] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-17T18:42:33.058264] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-17T18:42:33.058306] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-17T18:42:33.428622] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:42:33.444354] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T18:42:33.558070] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-17T18:42:34.107826] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T18:42:34.358054] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-17T18:42:34.908691] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T18:42:35.158033] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-17T18:42:35.612508] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T18:42:35.958033] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-17T18:42:36.646153] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T18:42:36.758029] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-17T18:42:37.317510] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-17T18:42:37.558025] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-17T18:42:38.184904] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T18:42:38.290194] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T18:42:38.357994] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-17T18:42:39.158063] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-17T18:42:39.616076] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T18:42:39.958038] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-17T18:42:40.758047] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-17T18:42:40.834945] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T18:42:41.450599] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T18:42:41.558093] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-17T18:42:42.157745] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T18:42:42.358032] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-17T18:42:42.688803] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-17T18:42:43.158053] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-17T18:42:43.744360] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-17T18:42:43.958029] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-17T18:42:44.758078] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-17T18:42:44.875258] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T18:42:45.351096] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-17T18:42:45.558062] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-17T18:42:46.156349] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-17T18:42:46.358066] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-17T18:42:47.160471] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-17T18:42:47.161844] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T18:42:47.908989] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T18:42:47.957994] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-17T18:42:48.350003] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-17T18:42:48.758091] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-17T18:42:49.304574] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T18:42:49.558060] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-17T18:42:50.358014] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-17T18:42:50.428343] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T18:42:50.707831] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T18:42:51.158077] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-17T18:42:51.670564] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T18:42:51.958069] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-17T18:42:52.758018] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-17T18:42:52.824137] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T18:42:53.202485] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T18:42:53.558054] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-17T18:42:53.941034] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-17T18:42:54.358045] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-17T18:42:54.722941] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T18:42:55.158028] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-17T18:42:55.963561] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-17T18:42:55.981604] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T18:42:56.385997] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-17T18:42:56.758029] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-17T18:42:57.557999] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-17T18:42:57.655637] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T18:42:57.729580] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T18:42:58.358038] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-17T18:42:58.720591] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T18:42:58.724137] [INFO ] [REMOTE ] ENVA: Full fetch complete (36649 records). [2025-10-17T18:42:58.724214] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-17T18:42:59.099049] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-17T18:42:59.099121] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-17T18:42:59.099703] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-17T18:42:59.099764] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-17T18:42:59.100529] [DEBUG] [LOCAL ] ENVA: Trimmed 36649 records to 25790 (keeping 200 days of data) [2025-10-17T18:42:59.182291] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-17T18:42:59.249243] [DEBUG] [LOCAL ] ENVA: Primary data saved (25790 records). [2025-10-17T18:42:59.249365] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-17T18:42:59.249441] [INFO ] [MAIN ] Update Progress: 740/2368 symbols completed. ENVA took 26.6s. Estimated remaining: 3h 46m 26s. Rate: 7.2 symbols/min [2025-10-17T18:42:59.413276] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:42:59.413448] [DEBUG] [LOCAL ] EOD: No existing data file found in primary storage. [2025-10-17T18:42:59.413485] [WARN ] [MAIN ] EOD: No existing data found, performing full refresh instead. [2025-10-17T18:42:59.413596] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-17T18:42:59.413636] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-17T18:42:59.413722] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-17T18:42:59.413760] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-17T18:42:59.762659] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:42:59.930289] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T18:42:59.936103] [INFO ] [REMOTE ] ENR: Full fetch complete (59483 records). [2025-10-17T18:42:59.936198] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-17T18:42:59.966216] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-17T18:43:00.311335] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-17T18:43:00.311477] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-17T18:43:00.312269] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-17T18:43:00.312330] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-17T18:43:00.313780] [DEBUG] [LOCAL ] ENR: Trimmed 59483 records to 44323 (keeping 200 days of data) [2025-10-17T18:43:00.569505] [DEBUG] [LOCAL ] ENR: Primary data saved (44323 records). [2025-10-17T18:43:00.569629] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-17T18:43:00.569758] [INFO ] [MAIN ] Update Progress: 741/2368 symbols completed. ENR took 32.9s. Estimated remaining: 3h 46m 2s. Rate: 7.2 symbols/min [2025-10-17T18:43:00.735613] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:43:00.772197] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-17T18:43:00.806431] [DEBUG] [LOCAL ] EOG: Loaded 53763 existing records from primary storage. [2025-10-17T18:43:00.806955] [INFO ] [MAIN ] EOG: Loaded 53763 existing records. [2025-10-17T18:43:01.004173] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:43:01.004392] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-17T18:43:01.004483] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-17T18:43:01.005040] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-17T18:43:01.005099] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-17T18:43:01.386313] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:43:01.414385] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-17T18:43:01.558013] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-17T18:43:01.787085] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T18:43:02.358064] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-17T18:43:02.645407] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T18:43:03.158034] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-17T18:43:03.620013] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T18:43:03.624856] [INFO ] [REMOTE ] ENS: Full fetch complete (42465 records). [2025-10-17T18:43:03.625000] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-17T18:43:03.625623] [FATAL] [VALIDATOR ] ENS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:43:03.625735] [FATAL] [MAIN ] ENS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:43:03.625779] [WARN ] [MAIN ] ENS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:43:03.625819] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-17T18:43:03.625876] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-10-17T18:43:03.625911] [INFO ] [LOCAL ] ENS: Starting deletion of derivative data. [2025-10-17T18:43:03.626096] [DEBUG] [LOCAL ] ENS: Deleted derivative data file. [2025-10-17T18:43:03.626186] [INFO ] [MAIN ] Update Progress: 742/2368 symbols completed. ENS took 33.0s. Estimated remaining: 3h 45m 42s. Rate: 7.2 symbols/min [2025-10-17T18:43:03.795920] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:43:03.808122] [DEBUG] [LOCAL ] EOI: Loaded 10738 existing records from primary storage. [2025-10-17T18:43:03.808325] [INFO ] [MAIN ] EOI: Loaded 10738 existing records. [2025-10-17T18:43:03.966184] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-17T18:43:03.986078] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:43:03.987765] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-17T18:43:03.987871] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-17T18:43:03.988134] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-17T18:43:03.988314] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-17T18:43:04.194748] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-17T18:43:04.401755] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:43:04.758002] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-17T18:43:04.964759] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-17T18:43:05.146284] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T18:43:05.558008] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-17T18:43:05.979600] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T18:43:06.358034] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-17T18:43:07.048221] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-17T18:43:07.158013] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-17T18:43:07.371284] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T18:43:07.958004] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-17T18:43:08.120247] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T18:43:08.758023] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-17T18:43:09.557997] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-17T18:43:09.650978] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T18:43:09.655448] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T18:43:10.358027] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-17T18:43:11.070739] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T18:43:11.158008] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-17T18:43:11.958071] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-17T18:43:12.332390] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T18:43:12.758125] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-17T18:43:12.840988] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T18:43:12.860283] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T18:43:13.558027] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-17T18:43:14.358016] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-17T18:43:14.659570] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T18:43:14.750709] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-17T18:43:14.756283] [INFO ] [REMOTE ] ENOV: Full fetch complete (63403 records). [2025-10-17T18:43:14.756394] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-17T18:43:14.936823] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-17T18:43:15.146369] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-17T18:43:15.146451] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-17T18:43:15.147295] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-17T18:43:15.147359] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-17T18:43:15.148633] [DEBUG] [LOCAL ] ENOV: Trimmed 63403 records to 45385 (keeping 200 days of data) [2025-10-17T18:43:15.196119] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-17T18:43:15.406534] [DEBUG] [LOCAL ] ENOV: Primary data saved (45385 records). [2025-10-17T18:43:15.406686] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-17T18:43:15.406782] [INFO ] [MAIN ] Update Progress: 743/2368 symbols completed. ENOV took 48.8s. Estimated remaining: 3h 45m 41s. Rate: 7.2 symbols/min [2025-10-17T18:43:15.574951] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:43:15.590983] [DEBUG] [LOCAL ] EOS: Loaded 15236 existing records from primary storage. [2025-10-17T18:43:15.591204] [INFO ] [MAIN ] EOS: Loaded 15236 existing records. [2025-10-17T18:43:15.771189] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:43:15.771398] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-17T18:43:15.771446] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-17T18:43:15.771684] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-17T18:43:15.771767] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-17T18:43:15.963202] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-17T18:43:16.134675] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:43:16.758036] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-17T18:43:16.975146] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T18:43:17.186819] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T18:43:17.558048] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-17T18:43:18.165915] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T18:43:18.358000] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-17T18:43:18.438577] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T18:43:19.158132] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-17T18:43:19.292941] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T18:43:19.958034] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-17T18:43:20.747992] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T18:43:20.757979] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-17T18:43:20.914445] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T18:43:21.558008] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-17T18:43:21.738960] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T18:43:22.358002] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-17T18:43:22.397096] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-17T18:43:23.158071] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-17T18:43:23.460606] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-17T18:43:23.958100] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-17T18:43:24.137104] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-17T18:43:24.722553] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T18:43:24.758025] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-17T18:43:25.558008] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-17T18:43:25.596108] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T18:43:26.358026] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-17T18:43:26.565423] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T18:43:27.158032] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-17T18:43:27.957944] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-17T18:43:27.957997] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-17T18:43:28.613959] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-17T18:43:28.758007] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-17T18:43:28.809482] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-17T18:43:29.558010] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-17T18:43:30.358083] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-17T18:43:31.011279] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T18:43:31.017537] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-17T18:43:31.035696] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-17T18:43:31.158028] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-17T18:43:31.910928] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T18:43:31.958015] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-17T18:43:32.758025] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-17T18:43:33.558071] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-17T18:43:33.746351] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T18:43:33.749505] [INFO ] [REMOTE ] EOD: Full fetch complete (21065 records). [2025-10-17T18:43:33.749586] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-17T18:43:34.123598] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-17T18:43:34.161768] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-17T18:43:34.162009] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-17T18:43:34.162627] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-17T18:43:34.162942] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-17T18:43:34.164484] [DEBUG] [LOCAL ] EOD: Trimmed 21065 records to 15256 (keeping 200 days of data) [2025-10-17T18:43:34.219502] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-17T18:43:34.269557] [DEBUG] [LOCAL ] EOD: Primary data saved (15256 records). [2025-10-17T18:43:34.269729] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-17T18:43:34.269815] [INFO ] [MAIN ] Update Progress: 744/2368 symbols completed. EOD took 35.0s. Estimated remaining: 3h 45m 56s. Rate: 7.2 symbols/min [2025-10-17T18:43:34.364459] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-17T18:43:34.439851] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:43:34.449203] [DEBUG] [LOCAL ] EOT: Loaded 7040 existing records from primary storage. [2025-10-17T18:43:34.449388] [INFO ] [MAIN ] EOT: Loaded 7040 existing records. [2025-10-17T18:43:34.624013] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:43:34.624221] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-17T18:43:34.624268] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-17T18:43:34.624488] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-17T18:43:34.624553] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-17T18:43:35.005542] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:43:35.158099] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-17T18:43:35.958061] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-17T18:43:36.064200] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T18:43:36.241929] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T18:43:36.249460] [INFO ] [REMOTE ] EOG: Full fetch complete (77462 records). [2025-10-17T18:43:36.249577] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-17T18:43:36.654300] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-17T18:43:36.654375] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-17T18:43:36.655278] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-17T18:43:36.655342] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-17T18:43:36.656764] [DEBUG] [LOCAL ] EOG: Trimmed 77462 records to 54152 (keeping 200 days of data) [2025-10-17T18:43:36.761699] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-17T18:43:36.993966] [DEBUG] [LOCAL ] EOG: Primary data saved (54152 records). [2025-10-17T18:43:36.994194] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-17T18:43:36.994287] [INFO ] [MAIN ] Update Progress: 745/2368 symbols completed. EOG took 36.4s. Estimated remaining: 3h 45m 35s. Rate: 7.2 symbols/min [2025-10-17T18:43:37.081533] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T18:43:37.172738] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:43:37.197950] [DEBUG] [LOCAL ] EPAC: Loaded 26765 existing records from primary storage. [2025-10-17T18:43:37.198197] [INFO ] [MAIN ] EPAC: Loaded 26765 existing records. [2025-10-17T18:43:37.372811] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:43:37.373022] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-17T18:43:37.373072] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-17T18:43:37.373266] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-17T18:43:37.373322] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-17T18:43:37.566071] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-17T18:43:37.666505] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T18:43:37.742624] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:43:38.358002] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-17T18:43:38.529254] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-17T18:43:39.090090] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T18:43:39.158042] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-17T18:43:39.957999] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-17T18:43:40.266608] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T18:43:40.269342] [INFO ] [REMOTE ] EOS: Full fetch complete (22950 records). [2025-10-17T18:43:40.269429] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-17T18:43:40.629036] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-17T18:43:40.629112] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-17T18:43:40.629564] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-17T18:43:40.629612] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-17T18:43:40.630246] [DEBUG] [LOCAL ] EOS: Trimmed 22950 records to 15294 (keeping 200 days of data) [2025-10-17T18:43:40.723233] [DEBUG] [LOCAL ] EOS: Primary data saved (15294 records). [2025-10-17T18:43:40.723376] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-17T18:43:40.723459] [INFO ] [MAIN ] Update Progress: 746/2368 symbols completed. EOS took 25.3s. Estimated remaining: 3h 45m 17s. Rate: 7.2 symbols/min [2025-10-17T18:43:40.766759] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-17T18:43:40.899740] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:43:40.937965] [DEBUG] [LOCAL ] EPAM: Loaded 39697 existing records from primary storage. [2025-10-17T18:43:40.938260] [INFO ] [MAIN ] EPAM: Loaded 39697 existing records. [2025-10-17T18:43:41.124314] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:43:41.124530] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-17T18:43:41.124603] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-17T18:43:41.124921] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-17T18:43:41.124994] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-17T18:43:41.485200] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:43:41.495680] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T18:43:41.557974] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-17T18:43:41.798386] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-17T18:43:42.358065] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-17T18:43:42.493427] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T18:43:43.158052] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-17T18:43:43.958022] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-17T18:43:44.027790] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T18:43:44.089395] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T18:43:44.091569] [INFO ] [REMOTE ] EOI: Full fetch complete (16205 records). [2025-10-17T18:43:44.091639] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-17T18:43:44.456454] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-17T18:43:44.456569] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-17T18:43:44.457118] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-17T18:43:44.457181] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-17T18:43:44.457848] [DEBUG] [LOCAL ] EOI: Trimmed 16205 records to 10809 (keeping 200 days of data) [2025-10-17T18:43:44.524727] [DEBUG] [LOCAL ] EOI: Primary data saved (10809 records). [2025-10-17T18:43:44.524873] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-17T18:43:44.524956] [INFO ] [MAIN ] Update Progress: 747/2368 symbols completed. EOI took 40.9s. Estimated remaining: 3h 44m 59s. Rate: 7.2 symbols/min [2025-10-17T18:43:44.698326] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:43:44.736736] [DEBUG] [LOCAL ] EPC: Loaded 40042 existing records from primary storage. [2025-10-17T18:43:44.737056] [INFO ] [MAIN ] EPC: Loaded 40042 existing records. [2025-10-17T18:43:44.760684] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-17T18:43:44.852779] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T18:43:44.936156] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:43:44.936389] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-17T18:43:44.936462] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-17T18:43:44.936943] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-17T18:43:44.937013] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-17T18:43:45.286697] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:43:45.558016] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-17T18:43:46.172489] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-17T18:43:46.315512] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T18:43:46.357991] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-17T18:43:47.158056] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-17T18:43:47.177108] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-17T18:43:47.958018] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-17T18:43:48.285912] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T18:43:48.758036] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-17T18:43:49.418373] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T18:43:49.558027] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-17T18:43:49.907624] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T18:43:50.358041] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-17T18:43:50.955008] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T18:43:51.158035] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-17T18:43:51.898001] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T18:43:51.957989] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-17T18:43:52.455768] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T18:43:52.757990] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-17T18:43:53.222499] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-17T18:43:53.351113] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-17T18:43:53.558013] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-17T18:43:54.225439] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T18:43:54.358051] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-17T18:43:55.158033] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-17T18:43:55.448243] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T18:43:55.882105] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-17T18:43:55.958007] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-17T18:43:56.739002] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T18:43:56.758019] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-17T18:43:57.558036] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-17T18:43:58.358017] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-17T18:43:58.366788] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T18:43:58.476775] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T18:43:59.158022] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-17T18:43:59.504052] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T18:43:59.958053] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-17T18:44:00.629449] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T18:44:00.758022] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-17T18:44:01.558004] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-17T18:44:01.886195] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-17T18:44:02.358014] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-17T18:44:02.407090] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T18:44:02.409261] [INFO ] [REMOTE ] EOT: Full fetch complete (10780 records). [2025-10-17T18:44:02.409361] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-17T18:44:02.818403] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-17T18:44:02.818562] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-17T18:44:02.818918] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-17T18:44:02.818982] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-17T18:44:02.819678] [DEBUG] [LOCAL ] EOT: Trimmed 10780 records to 7100 (keeping 200 days of data) [2025-10-17T18:44:02.866027] [DEBUG] [LOCAL ] EOT: Primary data saved (7100 records). [2025-10-17T18:44:02.866171] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-17T18:44:02.866267] [INFO ] [MAIN ] Update Progress: 748/2368 symbols completed. EOT took 28.6s. Estimated remaining: 3h 45m 12s. Rate: 7.2 symbols/min [2025-10-17T18:44:03.058380] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:44:03.111028] [DEBUG] [LOCAL ] EPD: Loaded 54001 existing records from primary storage. [2025-10-17T18:44:03.111343] [INFO ] [MAIN ] EPD: Loaded 54001 existing records. [2025-10-17T18:44:03.171715] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-17T18:44:03.317126] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:44:03.317348] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-17T18:44:03.317402] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-17T18:44:03.317801] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-17T18:44:03.317860] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-17T18:44:03.713008] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:44:03.957998] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-17T18:44:04.155931] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-17T18:44:04.399867] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T18:44:04.758010] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-17T18:44:04.793151] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:44:05.558005] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-17T18:44:05.787555] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T18:44:06.349615] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T18:44:06.358064] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-17T18:44:07.004096] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T18:44:07.157990] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-17T18:44:07.483727] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T18:44:07.958043] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-17T18:44:08.631594] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T18:44:08.758045] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-17T18:44:09.557994] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-17T18:44:09.921530] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T18:44:09.996205] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-17T18:44:10.358059] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-17T18:44:11.058526] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T18:44:11.157993] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-17T18:44:11.805603] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T18:44:11.958030] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-17T18:44:12.698677] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T18:44:12.702670] [INFO ] [REMOTE ] EPAC: Full fetch complete (38842 records). [2025-10-17T18:44:12.702785] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-17T18:44:12.764084] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-17T18:44:13.069459] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-17T18:44:13.069536] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-17T18:44:13.070158] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-17T18:44:13.070219] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-17T18:44:13.071078] [DEBUG] [LOCAL ] EPAC: Trimmed 38842 records to 27001 (keeping 200 days of data) [2025-10-17T18:44:13.239667] [DEBUG] [LOCAL ] EPAC: Primary data saved (27001 records). [2025-10-17T18:44:13.239816] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-17T18:44:13.239904] [INFO ] [MAIN ] Update Progress: 749/2368 symbols completed. EPAC took 36.2s. Estimated remaining: 3h 45m 8s. Rate: 7.2 symbols/min [2025-10-17T18:44:13.413348] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:44:13.453996] [DEBUG] [LOCAL ] EPR: Loaded 44181 existing records from primary storage. [2025-10-17T18:44:13.454381] [INFO ] [MAIN ] EPR: Loaded 44181 existing records. [2025-10-17T18:44:13.563147] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-17T18:44:13.635438] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:44:13.635724] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-17T18:44:13.635779] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-17T18:44:13.635955] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-17T18:44:13.635993] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-17T18:44:13.889847] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T18:44:13.929594] [INFO ] [REMOTE ] EPAM: Full fetch complete (56389 records). [2025-10-17T18:44:13.931962] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-17T18:44:14.117188] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:44:14.363107] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-17T18:44:14.421103] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-17T18:44:14.421205] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-17T18:44:14.422025] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-17T18:44:14.422125] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-17T18:44:14.426819] [DEBUG] [LOCAL ] EPAM: Trimmed 56389 records to 39978 (keeping 200 days of data) [2025-10-17T18:44:14.672614] [DEBUG] [LOCAL ] EPAM: Primary data saved (39978 records). [2025-10-17T18:44:14.672775] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-17T18:44:14.672862] [INFO ] [MAIN ] Update Progress: 750/2368 symbols completed. EPAM took 33.9s. Estimated remaining: 3h 44m 45s. Rate: 7.2 symbols/min [2025-10-17T18:44:14.876531] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:44:14.882220] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-17T18:44:14.935763] [DEBUG] [LOCAL ] EPRT: Loaded 48889 existing records from primary storage. [2025-10-17T18:44:14.936144] [INFO ] [MAIN ] EPRT: Loaded 48889 existing records. [2025-10-17T18:44:15.140612] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:44:15.140953] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-17T18:44:15.141070] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-17T18:44:15.141494] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-17T18:44:15.141564] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-17T18:44:15.165998] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-17T18:44:15.327698] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T18:44:15.548190] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:44:15.958008] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-17T18:44:16.074066] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T18:44:16.728824] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T18:44:16.757984] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-17T18:44:17.453734] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T18:44:17.558042] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-17T18:44:18.358045] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-17T18:44:19.158052] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-17T18:44:19.271497] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T18:44:19.320876] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-17T18:44:19.604593] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T18:44:19.958056] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-17T18:44:20.753889] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:44:20.762539] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-17T18:44:21.558082] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-17T18:44:21.654664] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T18:44:22.358067] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-17T18:44:22.627414] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T18:44:23.010614] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T18:44:23.158059] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-17T18:44:23.895194] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T18:44:23.958031] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-17T18:44:24.758011] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-17T18:44:25.189579] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-17T18:44:25.557999] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-17T18:44:25.776839] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T18:44:25.906183] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T18:44:26.358018] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-17T18:44:27.062796] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T18:44:27.068456] [INFO ] [REMOTE ] EPC: Full fetch complete (57250 records). [2025-10-17T18:44:27.068660] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-17T18:44:27.163151] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-17T18:44:27.464428] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-17T18:44:27.464512] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-17T18:44:27.465274] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-17T18:44:27.465360] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-17T18:44:27.466557] [DEBUG] [LOCAL ] EPC: Trimmed 57250 records to 40316 (keeping 200 days of data) [2025-10-17T18:44:27.712898] [DEBUG] [LOCAL ] EPC: Primary data saved (40316 records). [2025-10-17T18:44:27.713062] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-17T18:44:27.713907] [INFO ] [MAIN ] Update Progress: 751/2368 symbols completed. EPC took 43.2s. Estimated remaining: 3h 44m 47s. Rate: 7.2 symbols/min [2025-10-17T18:44:27.882859] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:44:27.896528] [DEBUG] [LOCAL ] EQBK: Loaded 11396 existing records from primary storage. [2025-10-17T18:44:27.896821] [INFO ] [MAIN ] EQBK: Loaded 11396 existing records. [2025-10-17T18:44:27.960071] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-17T18:44:28.078812] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:44:28.079013] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-17T18:44:28.079072] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-17T18:44:28.079303] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-17T18:44:28.079369] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-17T18:44:28.438166] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:44:28.470360] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-17T18:44:28.758003] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-17T18:44:28.846441] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T18:44:29.452540] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T18:44:29.557992] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-17T18:44:30.358062] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-17T18:44:30.530239] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T18:44:30.952565] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-17T18:44:31.158086] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-17T18:44:31.862240] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T18:44:31.958044] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-17T18:44:32.399391] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T18:44:32.758075] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-17T18:44:33.558005] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-17T18:44:33.589892] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T18:44:33.629792] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T18:44:34.358070] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-17T18:44:35.158083] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-17T18:44:35.683563] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-17T18:44:35.958001] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-17T18:44:35.991003] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T18:44:36.280911] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-17T18:44:36.758039] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-17T18:44:37.500480] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T18:44:37.536787] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T18:44:37.557975] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-17T18:44:38.319403] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-17T18:44:38.357991] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-17T18:44:39.158006] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-17T18:44:39.534613] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T18:44:39.958055] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-17T18:44:40.678607] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T18:44:40.758081] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-17T18:44:40.911492] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T18:44:41.558032] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-17T18:44:42.358058] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-17T18:44:42.666864] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-17T18:44:42.675051] [INFO ] [REMOTE ] EPD: Full fetch complete (77780 records). [2025-10-17T18:44:42.675287] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-17T18:44:43.063480] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-17T18:44:43.063766] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-17T18:44:43.064784] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-17T18:44:43.064935] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-17T18:44:43.066514] [DEBUG] [LOCAL ] EPD: Trimmed 77780 records to 54391 (keeping 200 days of data) [2025-10-17T18:44:43.153117] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-17T18:44:43.181006] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-17T18:44:43.377588] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T18:44:43.548037] [DEBUG] [LOCAL ] EPD: Primary data saved (54391 records). [2025-10-17T18:44:43.548261] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-17T18:44:43.549413] [INFO ] [MAIN ] Update Progress: 752/2368 symbols completed. EPD took 40.7s. Estimated remaining: 3h 44m 55s. Rate: 7.2 symbols/min [2025-10-17T18:44:43.809152] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:44:43.873164] [DEBUG] [LOCAL ] EQH: Loaded 53088 existing records from primary storage. [2025-10-17T18:44:43.873533] [INFO ] [MAIN ] EQH: Loaded 53088 existing records. [2025-10-17T18:44:43.963399] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-17T18:44:44.088698] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:44:44.088924] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-17T18:44:44.088972] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-17T18:44:44.089251] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-17T18:44:44.089307] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-17T18:44:44.464809] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:44:44.758014] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-17T18:44:45.014894] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T18:44:45.558000] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-17T18:44:45.657127] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T18:44:46.358035] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-17T18:44:46.541852] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T18:44:46.582870] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-17T18:44:47.158036] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-17T18:44:47.926513] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T18:44:47.932589] [INFO ] [REMOTE ] EPR: Full fetch complete (63233 records). [2025-10-17T18:44:47.932761] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-17T18:44:47.964930] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-17T18:44:48.325087] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-17T18:44:48.325177] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-17T18:44:48.326008] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-17T18:44:48.326079] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-17T18:44:48.327491] [DEBUG] [LOCAL ] EPR: Trimmed 63233 records to 44473 (keeping 200 days of data) [2025-10-17T18:44:48.594191] [DEBUG] [LOCAL ] EPR: Primary data saved (44473 records). [2025-10-17T18:44:48.594328] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-17T18:44:48.594418] [INFO ] [MAIN ] Update Progress: 753/2368 symbols completed. EPR took 35.4s. Estimated remaining: 3h 44m 39s. Rate: 7.2 symbols/min [2025-10-17T18:44:48.763583] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-17T18:44:48.763453] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:44:48.813848] [DEBUG] [LOCAL ] EQNR: Loaded 53437 existing records from primary storage. [2025-10-17T18:44:48.814189] [INFO ] [MAIN ] EQNR: Loaded 53437 existing records. [2025-10-17T18:44:48.995963] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:44:48.996221] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-17T18:44:48.996296] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-17T18:44:48.996798] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-17T18:44:48.996896] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-17T18:44:49.129454] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-17T18:44:49.396671] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:44:49.424916] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T18:44:49.558030] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-17T18:44:49.577296] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-17T18:44:50.358051] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-17T18:44:51.117712] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T18:44:51.157122] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T18:44:51.166372] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-17T18:44:51.958057] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-17T18:44:52.758016] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-17T18:44:52.879302] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-17T18:44:52.881677] [INFO ] [REMOTE ] EQBK: Full fetch complete (15690 records). [2025-10-17T18:44:52.881746] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-17T18:44:53.313474] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-17T18:44:53.313663] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-17T18:44:53.314049] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-17T18:44:53.314214] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-17T18:44:53.316050] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-17T18:44:53.327159] [DEBUG] [LOCAL ] EQBK: Trimmed 15690 records to 11534 (keeping 200 days of data) [2025-10-17T18:44:53.395224] [DEBUG] [LOCAL ] EQBK: Primary data saved (11534 records). [2025-10-17T18:44:53.395357] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-17T18:44:53.395437] [INFO ] [MAIN ] Update Progress: 754/2368 symbols completed. EQBK took 25.7s. Estimated remaining: 3h 44m 23s. Rate: 7.2 symbols/min [2025-10-17T18:44:53.560925] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-17T18:44:53.562617] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:44:53.614863] [DEBUG] [LOCAL ] EQR: Loaded 52109 existing records from primary storage. [2025-10-17T18:44:53.615212] [INFO ] [MAIN ] EQR: Loaded 52109 existing records. [2025-10-17T18:44:53.793291] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:44:53.793615] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-17T18:44:53.793702] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-17T18:44:53.793988] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-17T18:44:53.794052] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-17T18:44:54.133530] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:44:54.357993] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-17T18:44:54.559093] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T18:44:54.566111] [INFO ] [REMOTE ] EPRT: Full fetch complete (69375 records). [2025-10-17T18:44:54.566221] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-17T18:44:54.950603] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-17T18:44:54.950715] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-17T18:44:54.951546] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-17T18:44:54.951608] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-17T18:44:54.953112] [DEBUG] [LOCAL ] EPRT: Trimmed 69375 records to 49233 (keeping 200 days of data) [2025-10-17T18:44:55.164354] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-17T18:44:55.256220] [DEBUG] [LOCAL ] EPRT: Primary data saved (49233 records). [2025-10-17T18:44:55.256348] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-17T18:44:55.256432] [INFO ] [MAIN ] Update Progress: 755/2368 symbols completed. EPRT took 40.6s. Estimated remaining: 3h 44m 1s. Rate: 7.2 symbols/min [2025-10-17T18:44:55.427732] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:44:55.427909] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-17T18:44:55.428020] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-17T18:44:55.428211] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-17T18:44:55.428271] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-17T18:44:55.428339] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-17T18:44:55.428410] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-17T18:44:55.617053] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T18:44:55.840224] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:44:55.869696] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T18:44:55.957984] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-17T18:44:56.565604] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-17T18:44:56.758039] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-17T18:44:57.042373] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T18:44:57.558065] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-17T18:44:57.934636] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-17T18:44:58.229408] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T18:44:58.358055] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-17T18:44:59.158051] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-17T18:44:59.489629] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-17T18:44:59.958042] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-17T18:45:00.271328] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T18:45:00.758025] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-17T18:45:01.558027] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-17T18:45:01.797636] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-17T18:45:02.358100] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-17T18:45:03.100252] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-17T18:45:03.158039] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-17T18:45:03.813245] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-17T18:45:03.968043] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-17T18:45:03.987681] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (3.23 seconds). [2025-10-17T18:45:04.329423] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-17T18:45:04.758014] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-17T18:45:05.010219] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T18:45:05.104063] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-17T18:45:05.558027] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-17T18:45:05.946398] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-17T18:45:06.358022] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-17T18:45:07.158021] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-17T18:45:07.734476] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-17T18:45:07.957994] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-17T18:45:08.289730] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T18:45:08.599336] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T18:45:08.758018] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-17T18:45:09.347105] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T18:45:09.557997] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-17T18:45:10.358081] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-17T18:45:11.158037] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-17T18:45:11.451665] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T18:45:11.665529] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T18:45:11.794349] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-17T18:45:11.795260] [INFO ] [REMOTE ] EQS: Full fetch complete (2396 records). [2025-10-17T18:45:11.795329] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-17T18:45:11.965207] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-17T18:45:11.971352] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-17T18:45:11.971667] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:45:11.972279] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:45:11.972352] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-17T18:45:11.972425] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-17T18:45:11.972488] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-17T18:45:11.972531] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-17T18:45:11.972584] [INFO ] [MAIN ] Update Progress: 756/2368 symbols completed. EQS took 16.7s. Estimated remaining: 3h 44m 11s. Rate: 7.2 symbols/min [2025-10-17T18:45:12.139933] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:45:12.187927] [DEBUG] [LOCAL ] EQT: Loaded 54075 existing records from primary storage. [2025-10-17T18:45:12.188227] [INFO ] [MAIN ] EQT: Loaded 54075 existing records. [2025-10-17T18:45:12.361219] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:45:12.361421] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-17T18:45:12.361472] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-17T18:45:12.361696] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-17T18:45:12.361754] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-17T18:45:12.709364] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:45:12.757982] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-17T18:45:13.558030] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-17T18:45:13.917041] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-17T18:45:14.358040] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-17T18:45:14.867810] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-17T18:45:14.991819] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T18:45:15.157993] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-17T18:45:15.958001] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-17T18:45:16.379989] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T18:45:16.611890] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T18:45:16.758056] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-17T18:45:17.558040] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-17T18:45:17.728965] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T18:45:18.358013] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-17T18:45:18.639584] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T18:45:19.158007] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-17T18:45:19.367163] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T18:45:19.958015] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-17T18:45:20.199537] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T18:45:20.758007] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-17T18:45:20.885378] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T18:45:21.558006] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-17T18:45:21.974682] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T18:45:22.149309] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T18:45:22.358047] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-17T18:45:23.158012] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-17T18:45:23.534724] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T18:45:23.958048] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-17T18:45:24.136115] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T18:45:24.757998] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-17T18:45:25.254281] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-17T18:45:25.558015] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-17T18:45:26.087719] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-17T18:45:26.094988] [INFO ] [REMOTE ] EQNR: Full fetch complete (77006 records). [2025-10-17T18:45:26.095115] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-17T18:45:26.365617] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-17T18:45:26.496779] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-17T18:45:26.496965] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-17T18:45:26.498047] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-17T18:45:26.498135] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-17T18:45:26.528505] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T18:45:26.527026] [DEBUG] [LOCAL ] EQNR: Trimmed 77006 records to 53821 (keeping 200 days of data) [2025-10-17T18:45:26.861497] [DEBUG] [LOCAL ] EQNR: Primary data saved (53821 records). [2025-10-17T18:45:26.861636] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-17T18:45:26.861762] [INFO ] [MAIN ] Update Progress: 757/2368 symbols completed. EQNR took 38.3s. Estimated remaining: 3h 44m 16s. Rate: 7.2 symbols/min [2025-10-17T18:45:27.158073] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-17T18:45:27.522801] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T18:45:27.958033] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-17T18:45:28.195832] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T18:45:28.686220] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T18:45:28.693892] [INFO ] [REMOTE ] EQH: Full fetch complete (76633 records). [2025-10-17T18:45:28.694060] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-17T18:45:28.768117] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-17T18:45:29.079872] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-17T18:45:29.079955] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-17T18:45:29.080875] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-17T18:45:29.080941] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-17T18:45:29.082427] [DEBUG] [LOCAL ] EQH: Trimmed 76633 records to 53475 (keeping 200 days of data) [2025-10-17T18:45:29.403826] [DEBUG] [LOCAL ] EQH: Primary data saved (53475 records). [2025-10-17T18:45:29.403972] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-17T18:45:29.404816] [INFO ] [MAIN ] Update Progress: 758/2368 symbols completed. EQH took 45.9s. Estimated remaining: 3h 43m 55s. Rate: 7.2 symbols/min [2025-10-17T18:45:29.763776] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T18:45:29.776254] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-17T18:45:30.719705] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T18:45:30.733086] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-17T18:45:31.544418] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T18:45:31.555470] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-17T18:45:32.668062] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T18:45:32.676457] [INFO ] [REMOTE ] EQR: Full fetch complete (74507 records). [2025-10-17T18:45:32.676684] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-17T18:45:33.060971] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-17T18:45:33.061065] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-17T18:45:33.062069] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-17T18:45:33.062136] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-17T18:45:33.063626] [DEBUG] [LOCAL ] EQR: Trimmed 74507 records to 52498 (keeping 200 days of data) [2025-10-17T18:45:33.388919] [DEBUG] [LOCAL ] EQR: Primary data saved (52498 records). [2025-10-17T18:45:33.389054] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-17T18:45:33.389714] [INFO ] [MAIN ] Update Progress: 759/2368 symbols completed. EQR took 40.0s. Estimated remaining: 3h 43m 38s. Rate: 7.2 symbols/min [2025-10-17T18:45:33.715119] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-17T18:45:33.727013] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-17T18:45:35.689170] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T18:45:35.701827] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-17T18:45:37.696554] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T18:45:37.708011] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-17T18:45:39.873117] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-17T18:45:39.880443] [INFO ] [REMOTE ] EQT: Full fetch complete (77860 records). [2025-10-17T18:45:39.880562] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-17T18:45:40.274145] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-17T18:45:40.274225] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-17T18:45:40.275133] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-17T18:45:40.275197] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-17T18:45:40.276635] [DEBUG] [LOCAL ] EQT: Trimmed 77860 records to 54465 (keeping 200 days of data) [2025-10-17T18:45:40.603631] [DEBUG] [LOCAL ] EQT: Primary data saved (54465 records). [2025-10-17T18:45:40.603806] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-17T18:45:40.603891] [INFO ] [MAIN ] Update Progress: 760/2368 symbols completed. EQT took 28.6s. Estimated remaining: 3h 43m 27s. Rate: 7.2 symbols/min [2025-10-17T18:45:41.181291] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:45:41.303475] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:45:41.279484] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:45:41.326085] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:45:41.330740] [DEBUG] [LOCAL ] EQV: Loaded 2745 existing records from primary storage. [2025-10-17T18:45:41.331277] [INFO ] [MAIN ] EQV: Loaded 2745 existing records. [2025-10-17T18:45:41.557098] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:45:41.569419] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-17T18:45:41.570488] [DEBUG] [LOCAL ] ERO: Loaded 42256 existing records from primary storage. [2025-10-17T18:45:41.570703] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-17T18:45:41.571099] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-17T18:45:41.571061] [INFO ] [MAIN ] ERO: Loaded 42256 existing records. [2025-10-17T18:45:41.576732] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-17T18:45:41.789336] [DEBUG] [LOCAL ] ERJ: Loaded 50694 existing records from primary storage. [2025-10-17T18:45:41.830553] [INFO ] [MAIN ] ERJ: Loaded 50694 existing records. [2025-10-17T18:45:41.997433] [DEBUG] [LOCAL ] ES: Loaded 53077 existing records from primary storage. [2025-10-17T18:45:42.025059] [INFO ] [MAIN ] ES: Loaded 53077 existing records. [2025-10-17T18:45:42.169321] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:45:42.381100] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-17T18:45:42.396622] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:45:42.409079] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-17T18:45:42.409869] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-17T18:45:42.418747] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-17T18:45:42.453325] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-17T18:45:42.463669] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-17T18:45:42.496118] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:45:42.489367] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-17T18:45:42.507080] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-17T18:45:42.496297] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-17T18:45:42.701765] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:45:42.736735] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-17T18:45:42.788854] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-17T18:45:42.805561] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-17T18:45:42.815996] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-17T18:45:43.616586] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:45:43.583504] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T18:45:43.637690] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-17T18:45:43.640830] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:45:43.653246] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-17T18:45:43.653533] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-17T18:45:43.736811] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:45:43.737089] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-17T18:45:44.468020] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T18:45:44.470684] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-17T18:45:45.231096] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T18:45:45.233067] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-17T18:45:45.261065] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T18:45:45.269968] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-17T18:45:45.453022] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-17T18:45:45.464074] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-17T18:45:45.571891] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T18:45:45.580958] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-17T18:45:45.607126] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-17T18:45:45.608452] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-17T18:45:46.086012] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-17T18:45:46.087370] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-17T18:45:46.660234] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-17T18:45:46.662897] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-17T18:45:46.662620] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T18:45:46.671394] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-17T18:45:47.207166] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T18:45:47.217100] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-17T18:45:47.246107] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T18:45:47.257199] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-17T18:45:47.320065] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-17T18:45:47.321627] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-17T18:45:47.799462] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-17T18:45:47.893967] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T18:45:47.958070] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-17T18:45:48.528887] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T18:45:48.757992] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-17T18:45:48.902447] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T18:45:49.037470] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T18:45:49.558079] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-17T18:45:50.358010] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-17T18:45:50.617859] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T18:45:51.017454] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T18:45:51.158031] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-17T18:45:51.345878] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T18:45:51.958047] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-17T18:45:52.461286] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-17T18:45:52.721079] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T18:45:52.757991] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-17T18:45:53.558023] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-17T18:45:54.085044] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-17T18:45:54.086219] [INFO ] [REMOTE ] EQV: Full fetch complete (5135 records). [2025-10-17T18:45:54.086303] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-17T18:45:54.086818] [FATAL] [VALIDATOR ] EQV: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T18:45:54.086929] [FATAL] [MAIN ] EQV: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:45:54.086983] [WARN ] [MAIN ] EQV: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:45:54.087035] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-17T18:45:54.087106] [DEBUG] [LOCAL ] EQV: No primary data file found to delete. [2025-10-17T18:45:54.087152] [INFO ] [LOCAL ] EQV: Starting deletion of derivative data. [2025-10-17T18:45:54.087382] [DEBUG] [LOCAL ] EQV: Deleted derivative data file. [2025-10-17T18:45:54.087493] [INFO ] [MAIN ] Update Progress: 761/2368 symbols completed. EQV took 13.5s. Estimated remaining: 3h 43m 30s. Rate: 7.2 symbols/min [2025-10-17T18:45:54.272300] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:45:54.303838] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T18:45:54.342273] [DEBUG] [LOCAL ] ESAB: Loaded 26243 existing records from primary storage. [2025-10-17T18:45:54.342626] [INFO ] [MAIN ] ESAB: Loaded 26243 existing records. [2025-10-17T18:45:54.363171] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-17T18:45:54.520334] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:45:54.520544] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-17T18:45:54.520591] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-17T18:45:54.520826] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-17T18:45:54.520883] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-17T18:45:54.874676] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:45:55.158041] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-17T18:45:55.953119] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T18:45:55.960923] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-17T18:45:56.758058] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-17T18:45:57.171488] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-17T18:45:57.318601] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T18:45:57.558037] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-17T18:45:58.358010] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-17T18:45:58.387566] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T18:45:59.158078] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-17T18:45:59.306083] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T18:45:59.957992] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-17T18:46:00.037888] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-17T18:46:00.187453] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T18:46:00.758010] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-17T18:46:01.506111] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T18:46:01.558036] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-17T18:46:02.358029] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-17T18:46:03.158055] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-17T18:46:04.071685] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T18:46:04.082139] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-17T18:46:04.509716] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (3.75 seconds). [2025-10-17T18:46:04.746367] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T18:46:04.758624] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-17T18:46:05.558037] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-17T18:46:05.966745] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T18:46:06.056272] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-17T18:46:06.358028] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-17T18:46:06.744792] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (5.19 seconds). [2025-10-17T18:46:07.158020] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-17T18:46:07.452160] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T18:46:07.459133] [INFO ] [REMOTE ] ERO: Full fetch complete (60475 records). [2025-10-17T18:46:07.459254] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-17T18:46:07.862394] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-17T18:46:07.862506] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-17T18:46:07.863509] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-17T18:46:07.863634] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-17T18:46:07.865252] [DEBUG] [LOCAL ] ERO: Trimmed 60475 records to 42618 (keeping 200 days of data) [2025-10-17T18:46:07.952529] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T18:46:07.978621] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-17T18:46:08.167971] [DEBUG] [LOCAL ] ERO: Primary data saved (42618 records). [2025-10-17T18:46:08.168123] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-17T18:46:08.168286] [INFO ] [MAIN ] Update Progress: 762/2368 symbols completed. ERO took 27.6s. Estimated remaining: 3h 43m 33s. Rate: 7.2 symbols/min [2025-10-17T18:46:08.340700] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:46:08.357927] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T18:46:08.378009] [DEBUG] [LOCAL ] ESE: Loaded 16630 existing records from primary storage. [2025-10-17T18:46:08.378242] [INFO ] [MAIN ] ESE: Loaded 16630 existing records. [2025-10-17T18:46:08.552617] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:46:08.552875] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-17T18:46:08.552924] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-17T18:46:08.553192] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-17T18:46:08.553250] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-17T18:46:08.763835] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-17T18:46:08.922557] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:46:09.558055] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-17T18:46:09.698259] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T18:46:09.927043] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T18:46:10.358019] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-17T18:46:10.576237] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-17T18:46:11.158068] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-17T18:46:11.957999] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-17T18:46:12.042250] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T18:46:12.214362] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T18:46:12.758108] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-17T18:46:13.558033] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-17T18:46:13.772479] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T18:46:13.835327] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T18:46:14.095343] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-17T18:46:14.358034] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-17T18:46:15.158102] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-17T18:46:15.901228] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T18:46:15.958021] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-17T18:46:16.194498] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T18:46:16.758085] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-17T18:46:17.046030] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T18:46:17.558063] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-17T18:46:17.785602] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-17T18:46:18.358080] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-17T18:46:19.158008] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-17T18:46:19.273744] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T18:46:19.958036] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-17T18:46:20.142242] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T18:46:20.164311] [INFO ] [REMOTE ] ERJ: Full fetch complete (72889 records). [2025-10-17T18:46:20.165231] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T18:46:20.165382] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-17T18:46:20.562887] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-17T18:46:20.562987] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-17T18:46:20.563922] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-17T18:46:20.563988] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-17T18:46:20.566100] [DEBUG] [LOCAL ] ERJ: Trimmed 72889 records to 51052 (keeping 200 days of data) [2025-10-17T18:46:20.778515] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-17T18:46:20.886247] [DEBUG] [LOCAL ] ERJ: Primary data saved (51052 records). [2025-10-17T18:46:20.886373] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-17T18:46:20.887323] [INFO ] [MAIN ] Update Progress: 763/2368 symbols completed. ERJ took 40.3s. Estimated remaining: 3h 43m 34s. Rate: 7.2 symbols/min [2025-10-17T18:46:21.070902] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:46:21.127144] [DEBUG] [LOCAL ] ESI: Loaded 51027 existing records from primary storage. [2025-10-17T18:46:21.127505] [INFO ] [MAIN ] ESI: Loaded 51027 existing records. [2025-10-17T18:46:21.312447] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:46:21.312812] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-17T18:46:21.312897] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-17T18:46:21.324419] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-17T18:46:21.324586] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-17T18:46:21.400545] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T18:46:21.431616] [INFO ] [REMOTE ] ESAB: Full fetch complete (36250 records). [2025-10-17T18:46:21.437546] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-17T18:46:21.574066] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-17T18:46:22.001764] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:46:22.087761] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-17T18:46:22.087828] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-17T18:46:22.088399] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-17T18:46:22.088439] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-17T18:46:22.089281] [DEBUG] [LOCAL ] ESAB: Trimmed 36250 records to 26444 (keeping 200 days of data) [2025-10-17T18:46:22.255569] [DEBUG] [LOCAL ] ESAB: Primary data saved (26444 records). [2025-10-17T18:46:22.255761] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-17T18:46:22.255943] [INFO ] [MAIN ] Update Progress: 764/2368 symbols completed. ESAB took 28.2s. Estimated remaining: 3h 43m 11s. Rate: 7.2 symbols/min [2025-10-17T18:46:22.368324] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-17T18:46:22.434259] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:46:22.470034] [DEBUG] [LOCAL ] ESNT: Loaded 38566 existing records from primary storage. [2025-10-17T18:46:22.470319] [INFO ] [MAIN ] ESNT: Loaded 38566 existing records. [2025-10-17T18:46:22.648303] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:46:22.648761] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-17T18:46:22.648906] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-17T18:46:22.649202] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-17T18:46:22.649290] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-17T18:46:22.787992] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-17T18:46:22.804168] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-17T18:46:23.049348] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:46:23.157988] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-17T18:46:23.958006] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-17T18:46:24.005280] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T18:46:24.613783] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-17T18:46:24.657591] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-17T18:46:24.757995] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-17T18:46:25.558007] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-17T18:46:25.710178] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T18:46:25.717601] [INFO ] [REMOTE ] ES: Full fetch complete (76473 records). [2025-10-17T18:46:25.717815] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-17T18:46:26.115928] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-17T18:46:26.116021] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-17T18:46:26.116956] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-17T18:46:26.117020] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-17T18:46:26.118717] [DEBUG] [LOCAL ] ES: Trimmed 76473 records to 53462 (keeping 200 days of data) [2025-10-17T18:46:26.358195] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-17T18:46:26.450290] [DEBUG] [LOCAL ] ES: Primary data saved (53462 records). [2025-10-17T18:46:26.450414] [INFO ] [MAIN ] ES: Full history saved. [2025-10-17T18:46:26.451261] [INFO ] [MAIN ] Update Progress: 765/2368 symbols completed. ES took 45.8s. Estimated remaining: 3h 42m 54s. Rate: 7.2 symbols/min [2025-10-17T18:46:26.616467] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:46:26.658312] [DEBUG] [LOCAL ] ESRT: Loaded 46834 existing records from primary storage. [2025-10-17T18:46:26.658714] [INFO ] [MAIN ] ESRT: Loaded 46834 existing records. [2025-10-17T18:46:26.831058] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:46:26.831247] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-17T18:46:26.831317] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-17T18:46:26.831683] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-17T18:46:26.831753] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-17T18:46:27.185912] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:46:27.158675] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-17T18:46:27.223501] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T18:46:27.830932] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T18:46:27.958053] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-17T18:46:28.393156] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-17T18:46:28.758144] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-17T18:46:29.405501] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T18:46:29.558012] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-17T18:46:29.814726] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T18:46:30.358030] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-17T18:46:31.105576] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T18:46:31.157994] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-17T18:46:31.958006] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-17T18:46:32.008225] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T18:46:32.696076] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T18:46:32.757991] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-17T18:46:32.970348] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T18:46:33.558024] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-17T18:46:34.272130] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T18:46:34.357991] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-17T18:46:35.158074] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-17T18:46:35.201588] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T18:46:35.958104] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-17T18:46:36.345393] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T18:46:36.655413] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T18:46:36.658090] [INFO ] [REMOTE ] ESE: Full fetch complete (22765 records). [2025-10-17T18:46:36.658190] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-17T18:46:36.758434] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-17T18:46:37.040369] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-17T18:46:37.052294] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-17T18:46:37.058168] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-17T18:46:37.068286] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-17T18:46:37.074225] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T18:46:37.083794] [DEBUG] [LOCAL ] ESE: Trimmed 22765 records to 16777 (keeping 200 days of data) [2025-10-17T18:46:37.190289] [DEBUG] [LOCAL ] ESE: Primary data saved (16777 records). [2025-10-17T18:46:37.190420] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-17T18:46:37.190521] [INFO ] [MAIN ] Update Progress: 766/2368 symbols completed. ESE took 29.0s. Estimated remaining: 3h 42m 51s. Rate: 7.2 symbols/min [2025-10-17T18:46:37.357579] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:46:37.388301] [DEBUG] [LOCAL ] ESS: Loaded 30383 existing records from primary storage. [2025-10-17T18:46:37.388560] [INFO ] [MAIN ] ESS: Loaded 30383 existing records. [2025-10-17T18:46:37.559147] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-17T18:46:37.562799] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:46:37.564173] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-17T18:46:37.564243] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-17T18:46:37.564532] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-17T18:46:37.564588] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-17T18:46:37.912511] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:46:38.358027] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-17T18:46:38.416429] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T18:46:38.605193] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T18:46:39.158050] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-17T18:46:39.958007] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-17T18:46:40.126476] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T18:46:40.643467] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-17T18:46:40.757991] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-17T18:46:41.070794] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T18:46:41.558026] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-17T18:46:42.300793] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T18:46:42.358003] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-17T18:46:43.075218] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T18:46:43.158034] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-17T18:46:43.960375] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-17T18:46:43.965698] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T18:46:44.644355] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T18:46:44.758029] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-17T18:46:45.558086] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-17T18:46:45.757539] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T18:46:46.103376] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T18:46:46.358083] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-17T18:46:47.158048] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-17T18:46:47.384281] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T18:46:47.907493] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T18:46:47.958067] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-17T18:46:48.468265] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T18:46:48.758059] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-17T18:46:49.492837] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T18:46:49.558005] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-17T18:46:50.255283] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T18:46:50.358077] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-17T18:46:51.119926] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T18:46:51.158026] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-17T18:46:51.781202] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T18:46:51.958032] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-17T18:46:52.758027] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-17T18:46:52.852833] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T18:46:53.518725] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T18:46:53.558001] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-17T18:46:54.175950] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-17T18:46:54.181711] [INFO ] [REMOTE ] ESNT: Full fetch complete (57231 records). [2025-10-17T18:46:54.181846] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-17T18:46:54.363981] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-17T18:46:54.581511] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-17T18:46:54.581614] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-17T18:46:54.582467] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-17T18:46:54.582534] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-17T18:46:54.583852] [DEBUG] [LOCAL ] ESNT: Trimmed 57231 records to 38819 (keeping 200 days of data) [2025-10-17T18:46:54.821606] [DEBUG] [LOCAL ] ESNT: Primary data saved (38819 records). [2025-10-17T18:46:54.821799] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-17T18:46:54.821902] [INFO ] [MAIN ] Update Progress: 767/2368 symbols completed. ESNT took 32.6s. Estimated remaining: 3h 43m 2s. Rate: 7.2 symbols/min [2025-10-17T18:46:54.994168] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:46:55.042259] [DEBUG] [LOCAL ] ESTC: Loaded 50722 existing records from primary storage. [2025-10-17T18:46:55.042587] [INFO ] [MAIN ] ESTC: Loaded 50722 existing records. [2025-10-17T18:46:55.158765] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-17T18:46:55.223896] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:46:55.240901] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-17T18:46:55.242092] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T18:46:55.242350] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-17T18:46:55.248884] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-17T18:46:55.248982] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-17T18:46:55.254227] [INFO ] [REMOTE ] ESRT: Full fetch complete (66604 records). [2025-10-17T18:46:55.292207] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-17T18:46:56.007677] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:46:56.049702] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-17T18:46:56.072795] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-17T18:46:56.072946] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-17T18:46:56.074029] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-17T18:46:56.074121] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-17T18:46:56.076265] [DEBUG] [LOCAL ] ESRT: Trimmed 66604 records to 47197 (keeping 200 days of data) [2025-10-17T18:46:56.330161] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T18:46:56.426201] [DEBUG] [LOCAL ] ESRT: Primary data saved (47197 records). [2025-10-17T18:46:56.426489] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-17T18:46:56.427531] [INFO ] [MAIN ] Update Progress: 768/2368 symbols completed. ESRT took 30.0s. Estimated remaining: 3h 42m 39s. Rate: 7.2 symbols/min [2025-10-17T18:46:56.624027] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:46:56.690823] [DEBUG] [LOCAL ] ET: Loaded 54179 existing records from primary storage. [2025-10-17T18:46:56.691271] [INFO ] [MAIN ] ET: Loaded 54179 existing records. [2025-10-17T18:46:56.767545] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-17T18:46:56.881600] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:46:56.882259] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-17T18:46:56.882434] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-17T18:46:56.893146] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-17T18:46:56.906258] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-17T18:46:56.975102] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T18:46:57.271428] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:46:57.558011] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-17T18:46:57.895701] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T18:46:57.929207] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T18:46:58.358047] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-17T18:46:59.158066] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-17T18:46:59.559611] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T18:46:59.970728] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-17T18:46:59.998196] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-17T18:47:00.758038] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-17T18:47:01.468259] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-17T18:47:01.558015] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-17T18:47:02.044614] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-17T18:47:02.358096] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-17T18:47:03.158115] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-17T18:47:03.798848] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (3.04 seconds). [2025-10-17T18:47:03.957997] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-17T18:47:04.182192] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T18:47:04.388098] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (2.83 seconds). [2025-10-17T18:47:04.758021] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-17T18:47:05.056616] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T18:47:05.064860] [INFO ] [REMOTE ] ESI: Full fetch complete (73196 records). [2025-10-17T18:47:05.065085] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-17T18:47:05.472859] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-17T18:47:05.473004] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-17T18:47:05.474226] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-17T18:47:05.474297] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-17T18:47:05.476328] [DEBUG] [LOCAL ] ESI: Trimmed 73196 records to 51407 (keeping 200 days of data) [2025-10-17T18:47:05.573464] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-17T18:47:05.812396] [DEBUG] [LOCAL ] ESI: Primary data saved (51407 records). [2025-10-17T18:47:05.812621] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-17T18:47:05.813890] [INFO ] [MAIN ] Update Progress: 769/2368 symbols completed. ESI took 44.9s. Estimated remaining: 3h 42m 33s. Rate: 7.2 symbols/min [2025-10-17T18:47:05.990843] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:47:06.037199] [DEBUG] [LOCAL ] ETB: Loaded 12026 existing records from primary storage. [2025-10-17T18:47:06.040113] [INFO ] [MAIN ] ETB: Loaded 12026 existing records. [2025-10-17T18:47:06.039880] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-17T18:47:06.124896] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T18:47:06.293227] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:47:06.293443] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-17T18:47:06.293490] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-17T18:47:06.293689] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-17T18:47:06.293745] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-17T18:47:06.367168] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-17T18:47:06.644404] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:47:07.158104] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-17T18:47:07.243130] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T18:47:07.710454] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T18:47:07.958030] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-17T18:47:08.161303] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T18:47:08.758040] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-17T18:47:09.558047] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-17T18:47:09.709105] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T18:47:10.172920] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T18:47:10.177411] [INFO ] [REMOTE ] ESS: Full fetch complete (43707 records). [2025-10-17T18:47:10.177513] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-17T18:47:10.366167] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-17T18:47:10.396935] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T18:47:10.580713] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-17T18:47:10.580809] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-17T18:47:10.581575] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-17T18:47:10.581619] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-17T18:47:10.582505] [DEBUG] [LOCAL ] ESS: Trimmed 43707 records to 30619 (keeping 200 days of data) [2025-10-17T18:47:10.767813] [DEBUG] [LOCAL ] ESS: Primary data saved (30619 records). [2025-10-17T18:47:10.767951] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-17T18:47:10.768033] [INFO ] [MAIN ] Update Progress: 770/2368 symbols completed. ESS took 33.6s. Estimated remaining: 3h 42m 18s. Rate: 7.2 symbols/min [2025-10-17T18:47:10.931120] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:47:10.956695] [DEBUG] [LOCAL ] ETD: Loaded 27518 existing records from primary storage. [2025-10-17T18:47:10.956951] [INFO ] [MAIN ] ETD: Loaded 27518 existing records. [2025-10-17T18:47:11.127849] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:47:11.128073] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-17T18:47:11.128120] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-17T18:47:11.128308] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-17T18:47:11.128364] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-17T18:47:11.163972] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-17T18:47:11.475628] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:47:11.958039] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-17T18:47:12.221681] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T18:47:12.758026] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-17T18:47:13.081567] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T18:47:13.511847] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-17T18:47:13.558030] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-17T18:47:14.358136] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-17T18:47:14.561469] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T18:47:14.619834] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T18:47:15.158025] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-17T18:47:15.958040] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-17T18:47:16.718053] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-17T18:47:16.758005] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-17T18:47:17.004245] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T18:47:17.032449] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T18:47:17.558037] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-17T18:47:18.358038] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-17T18:47:18.614983] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T18:47:19.085748] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-17T18:47:19.157999] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-17T18:47:19.723855] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T18:47:19.958042] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-17T18:47:20.758127] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-17T18:47:21.326720] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-17T18:47:21.558030] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-17T18:47:21.867240] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T18:47:21.917618] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T18:47:22.358016] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-17T18:47:23.158004] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-17T18:47:23.304617] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-17T18:47:23.921595] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-17T18:47:23.957995] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-17T18:47:24.164605] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T18:47:24.758103] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-17T18:47:25.020783] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T18:47:25.558016] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-17T18:47:26.075892] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-17T18:47:26.358032] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-17T18:47:27.158032] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-17T18:47:27.435390] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T18:47:27.442687] [INFO ] [REMOTE ] ESTC: Full fetch complete (72477 records). [2025-10-17T18:47:27.442806] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-17T18:47:27.831731] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-17T18:47:27.831814] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-17T18:47:27.832821] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-17T18:47:27.832885] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-17T18:47:27.834210] [DEBUG] [LOCAL ] ESTC: Trimmed 72477 records to 51091 (keeping 200 days of data) [2025-10-17T18:47:27.995385] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-17T18:47:28.123192] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T18:47:28.146948] [DEBUG] [LOCAL ] ESTC: Primary data saved (51091 records). [2025-10-17T18:47:28.147093] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-17T18:47:28.147180] [INFO ] [MAIN ] Update Progress: 771/2368 symbols completed. ESTC took 33.3s. Estimated remaining: 3h 42m 28s. Rate: 7.2 symbols/min [2025-10-17T18:47:28.315485] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:47:28.332721] [DEBUG] [LOCAL ] ETG: Loaded 16789 existing records from primary storage. [2025-10-17T18:47:28.333032] [INFO ] [MAIN ] ETG: Loaded 16789 existing records. [2025-10-17T18:47:28.512614] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:47:28.512884] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-17T18:47:28.513050] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-17T18:47:28.513322] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-17T18:47:28.513430] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-17T18:47:28.758218] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-17T18:47:28.822439] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-17T18:47:28.913415] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:47:29.203616] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T18:47:29.558019] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-17T18:47:29.604823] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T18:47:30.358087] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-17T18:47:31.158062] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-17T18:47:31.691131] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T18:47:31.878778] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-17T18:47:31.905611] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T18:47:31.958036] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-17T18:47:32.757997] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-17T18:47:33.211328] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T18:47:33.535096] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-17T18:47:33.557976] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-17T18:47:34.313906] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-17T18:47:34.358047] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-17T18:47:35.127758] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T18:47:35.157989] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-17T18:47:35.958097] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-17T18:47:36.205322] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T18:47:36.207687] [INFO ] [REMOTE ] ETB: Full fetch complete (18279 records). [2025-10-17T18:47:36.207762] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-17T18:47:36.557437] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-17T18:47:36.557510] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-17T18:47:36.557881] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-17T18:47:36.557945] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-17T18:47:36.558470] [DEBUG] [LOCAL ] ETB: Trimmed 18279 records to 12085 (keeping 200 days of data) [2025-10-17T18:47:36.636203] [DEBUG] [LOCAL ] ETB: Primary data saved (12085 records). [2025-10-17T18:47:36.636313] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-17T18:47:36.636394] [INFO ] [MAIN ] Update Progress: 772/2368 symbols completed. ETB took 30.8s. Estimated remaining: 3h 42m 20s. Rate: 7.2 symbols/min [2025-10-17T18:47:36.772850] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-17T18:47:36.806110] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:47:36.823274] [DEBUG] [LOCAL ] ETJ: Loaded 16898 existing records from primary storage. [2025-10-17T18:47:36.823551] [INFO ] [MAIN ] ETJ: Loaded 16898 existing records. [2025-10-17T18:47:36.998808] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:47:36.999041] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-17T18:47:36.999088] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-17T18:47:36.999279] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-17T18:47:36.999334] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-17T18:47:37.345087] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:47:37.558025] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-17T18:47:37.963816] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T18:47:38.114627] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-17T18:47:38.122238] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-17T18:47:38.122369] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-17T18:47:38.363162] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-17T18:47:38.525972] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-17T18:47:38.526082] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-17T18:47:38.527141] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-17T18:47:38.527220] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-17T18:47:38.528731] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 54569 (keeping 200 days of data) [2025-10-17T18:47:38.636243] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T18:47:38.892976] [DEBUG] [LOCAL ] ET: Primary data saved (54569 records). [2025-10-17T18:47:38.893162] [INFO ] [MAIN ] ET: Full history saved. [2025-10-17T18:47:38.893743] [INFO ] [MAIN ] Update Progress: 773/2368 symbols completed. ET took 42.5s. Estimated remaining: 3h 41m 59s. Rate: 7.2 symbols/min [2025-10-17T18:47:39.071513] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:47:39.122270] [DEBUG] [LOCAL ] ETN: Loaded 53020 existing records from primary storage. [2025-10-17T18:47:39.122578] [INFO ] [MAIN ] ETN: Loaded 53020 existing records. [2025-10-17T18:47:39.164743] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-17T18:47:39.305285] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:47:39.305515] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-17T18:47:39.305563] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-17T18:47:39.305823] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-17T18:47:39.305881] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-17T18:47:39.661566] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:47:39.816715] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T18:47:39.958001] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-17T18:47:40.042945] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T18:47:40.758025] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-17T18:47:41.558065] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-17T18:47:41.727620] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T18:47:41.885697] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-17T18:47:42.233448] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-17T18:47:42.358009] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-17T18:47:43.158036] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-17T18:47:43.421988] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T18:47:43.879202] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T18:47:43.958013] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-17T18:47:44.758073] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-17T18:47:44.884883] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-17T18:47:45.558086] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-17T18:47:46.053845] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T18:47:46.057817] [INFO ] [REMOTE ] ETD: Full fetch complete (38664 records). [2025-10-17T18:47:46.057918] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-17T18:47:46.363114] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-17T18:47:46.434256] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-17T18:47:46.434329] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-17T18:47:46.434938] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-17T18:47:46.435002] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-17T18:47:46.435826] [DEBUG] [LOCAL ] ETD: Trimmed 38664 records to 27663 (keeping 200 days of data) [2025-10-17T18:47:46.556943] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T18:47:46.624708] [DEBUG] [LOCAL ] ETD: Primary data saved (27663 records). [2025-10-17T18:47:46.624832] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-17T18:47:46.624910] [INFO ] [MAIN ] Update Progress: 774/2368 symbols completed. ETD took 35.9s. Estimated remaining: 3h 41m 49s. Rate: 7.2 symbols/min [2025-10-17T18:47:46.790071] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:47:46.798705] [DEBUG] [LOCAL ] ETO: Loaded 7024 existing records from primary storage. [2025-10-17T18:47:46.798884] [INFO ] [MAIN ] ETO: Loaded 7024 existing records. [2025-10-17T18:47:46.970007] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:47:46.970166] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-17T18:47:46.970215] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-17T18:47:46.970370] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-17T18:47:46.970429] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-17T18:47:47.166509] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-17T18:47:47.322190] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:47:47.958026] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-17T18:47:48.260846] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T18:47:48.423350] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-17T18:47:48.455396] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-17T18:47:48.758015] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-17T18:47:49.558037] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-17T18:47:49.762251] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T18:47:50.358028] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-17T18:47:51.104538] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T18:47:51.157999] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-17T18:47:51.486202] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-17T18:47:51.790386] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T18:47:51.958059] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-17T18:47:52.758019] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-17T18:47:53.021437] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T18:47:53.558009] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-17T18:47:53.640631] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-17T18:47:54.358084] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-17T18:47:54.386814] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T18:47:55.158038] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-17T18:47:55.958005] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-17T18:47:55.997064] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T18:47:56.414089] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T18:47:56.478243] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-17T18:47:56.758002] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-17T18:47:57.558027] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-17T18:47:58.357998] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-17T18:47:58.553235] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T18:47:58.556049] [INFO ] [REMOTE ] ETG: Full fetch complete (24813 records). [2025-10-17T18:47:58.556122] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-17T18:47:58.881326] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-17T18:47:58.982338] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-17T18:47:58.982489] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-17T18:47:58.983289] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-17T18:47:58.983353] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-17T18:47:58.984027] [DEBUG] [LOCAL ] ETG: Trimmed 24813 records to 16892 (keeping 200 days of data) [2025-10-17T18:47:59.087151] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-17T18:47:59.127636] [DEBUG] [LOCAL ] ETG: Primary data saved (16892 records). [2025-10-17T18:47:59.127813] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-17T18:47:59.127904] [INFO ] [MAIN ] Update Progress: 775/2368 symbols completed. ETG took 31.0s. Estimated remaining: 3h 41m 50s. Rate: 7.2 symbols/min [2025-10-17T18:47:59.163133] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-17T18:47:59.297183] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:47:59.346034] [DEBUG] [LOCAL ] ETR: Loaded 53597 existing records from primary storage. [2025-10-17T18:47:59.346384] [INFO ] [MAIN ] ETR: Loaded 53597 existing records. [2025-10-17T18:47:59.519144] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:47:59.519351] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-17T18:47:59.519398] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-17T18:47:59.519628] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-17T18:47:59.519744] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-17T18:47:59.862135] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:47:59.957985] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-17T18:48:00.194788] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T18:48:00.758036] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-17T18:48:01.558046] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-17T18:48:02.170516] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-17T18:48:02.358025] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-17T18:48:02.688021] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T18:48:03.091140] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-17T18:48:03.122812] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T18:48:03.157985] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-17T18:48:03.958030] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-17T18:48:04.758001] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-17T18:48:04.953049] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T18:48:04.982471] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T18:48:05.485333] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-17T18:48:05.558018] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-17T18:48:06.357998] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-17T18:48:06.580180] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T18:48:06.583036] [INFO ] [REMOTE ] ETJ: Full fetch complete (25646 records). [2025-10-17T18:48:06.583109] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-17T18:48:06.957372] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-17T18:48:06.957453] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-17T18:48:06.958022] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-17T18:48:06.958085] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-17T18:48:06.958710] [DEBUG] [LOCAL ] ETJ: Trimmed 25646 records to 17031 (keeping 200 days of data) [2025-10-17T18:48:07.059206] [DEBUG] [LOCAL ] ETJ: Primary data saved (17031 records). [2025-10-17T18:48:07.059348] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-17T18:48:07.059426] [INFO ] [MAIN ] Update Progress: 776/2368 symbols completed. ETJ took 30.4s. Estimated remaining: 3h 41m 40s. Rate: 7.2 symbols/min [2025-10-17T18:48:07.158407] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-17T18:48:07.172397] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T18:48:07.244436] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:48:07.293620] [DEBUG] [LOCAL ] ETSY: Loaded 53966 existing records from primary storage. [2025-10-17T18:48:07.293959] [INFO ] [MAIN ] ETSY: Loaded 53966 existing records. [2025-10-17T18:48:07.467032] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:48:07.467282] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-17T18:48:07.467339] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-17T18:48:07.467573] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-17T18:48:07.467629] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-17T18:48:07.831219] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:48:07.958018] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2024-12. [2025-10-17T18:48:08.758006] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-17T18:48:08.942348] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T18:48:09.506345] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T18:48:09.558040] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-17T18:48:09.775349] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T18:48:10.171113] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T18:48:10.358032] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-17T18:48:10.968015] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-17T18:48:11.158077] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-17T18:48:11.958067] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-17T18:48:12.758087] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-17T18:48:12.783293] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-17T18:48:12.785188] [INFO ] [REMOTE ] ETO: Full fetch complete (9735 records). [2025-10-17T18:48:12.785258] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-17T18:48:13.125016] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-17T18:48:13.212621] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-17T18:48:13.212738] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-17T18:48:13.212992] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-17T18:48:13.213042] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-17T18:48:13.213478] [DEBUG] [LOCAL ] ETO: Trimmed 9735 records to 7052 (keeping 200 days of data) [2025-10-17T18:48:13.258414] [DEBUG] [LOCAL ] ETO: Primary data saved (7052 records). [2025-10-17T18:48:13.258539] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-17T18:48:13.258624] [INFO ] [MAIN ] Update Progress: 777/2368 symbols completed. ETO took 26.6s. Estimated remaining: 3h 41m 28s. Rate: 7.2 symbols/min [2025-10-17T18:48:13.434100] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:48:13.456388] [DEBUG] [LOCAL ] ETV: Loaded 22403 existing records from primary storage. [2025-10-17T18:48:13.456634] [INFO ] [MAIN ] ETV: Loaded 22403 existing records. [2025-10-17T18:48:13.563184] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-17T18:48:13.631595] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:48:13.631806] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-17T18:48:13.631853] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-17T18:48:13.632127] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-17T18:48:13.632184] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-17T18:48:13.985248] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:48:14.358032] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-17T18:48:14.850037] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-17T18:48:15.158012] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-17T18:48:15.420158] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-17T18:48:15.893209] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T18:48:15.958004] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-17T18:48:16.757996] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-17T18:48:17.140960] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T18:48:17.467497] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-17T18:48:17.558025] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-17T18:48:18.271793] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T18:48:18.358039] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-17T18:48:18.954376] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T18:48:19.158000] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-17T18:48:19.383255] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T18:48:19.958122] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-17T18:48:20.758013] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-17T18:48:21.029464] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T18:48:21.082400] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T18:48:21.558030] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-17T18:48:22.358047] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-17T18:48:22.673908] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T18:48:23.158078] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-17T18:48:23.391206] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T18:48:23.958072] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-17T18:48:24.758024] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-17T18:48:24.824246] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-17T18:48:24.831959] [INFO ] [REMOTE ] ETN: Full fetch complete (76648 records). [2025-10-17T18:48:24.832106] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-17T18:48:25.129033] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T18:48:25.275736] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-17T18:48:25.275825] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-17T18:48:25.276745] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-17T18:48:25.276815] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-17T18:48:25.278437] [DEBUG] [LOCAL ] ETN: Trimmed 76648 records to 53392 (keeping 200 days of data) [2025-10-17T18:48:25.538250] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T18:48:25.558210] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-17T18:48:25.663392] [DEBUG] [LOCAL ] ETN: Primary data saved (53392 records). [2025-10-17T18:48:25.663590] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-17T18:48:25.664324] [INFO ] [MAIN ] Update Progress: 778/2368 symbols completed. ETN took 46.8s. Estimated remaining: 3h 41m 28s. Rate: 7.2 symbols/min [2025-10-17T18:48:25.838763] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:48:25.868181] [DEBUG] [LOCAL ] ETW: Loaded 25709 existing records from primary storage. [2025-10-17T18:48:25.868449] [INFO ] [MAIN ] ETW: Loaded 25709 existing records. [2025-10-17T18:48:26.064890] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:48:26.065190] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-17T18:48:26.065273] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-17T18:48:26.065489] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-17T18:48:26.065529] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-17T18:48:26.361796] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-17T18:48:26.421195] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:48:26.683191] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T18:48:27.157999] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-17T18:48:27.381521] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-17T18:48:27.518318] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T18:48:27.958012] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-17T18:48:28.717181] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T18:48:28.757983] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-17T18:48:29.558010] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-17T18:48:29.888729] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-17T18:48:30.358076] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-17T18:48:30.431438] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T18:48:30.927882] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T18:48:31.158263] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-17T18:48:31.958060] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-17T18:48:32.171983] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T18:48:32.320086] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T18:48:32.758057] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-17T18:48:33.287238] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T18:48:33.558007] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-17T18:48:33.899128] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T18:48:34.358036] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-17T18:48:35.133404] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T18:48:35.157981] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-17T18:48:35.958013] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-17T18:48:36.324637] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T18:48:36.758003] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-17T18:48:36.977019] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T18:48:37.074236] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T18:48:37.558022] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-17T18:48:38.358072] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-17T18:48:38.491359] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T18:48:38.499756] [INFO ] [REMOTE ] ETSY: Full fetch complete (77666 records). [2025-10-17T18:48:38.499937] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-17T18:48:38.899253] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-17T18:48:38.899363] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-17T18:48:38.900377] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-17T18:48:38.900488] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-17T18:48:38.902265] [DEBUG] [LOCAL ] ETSY: Trimmed 77666 records to 54353 (keeping 200 days of data) [2025-10-17T18:48:39.116522] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T18:48:39.159177] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-17T18:48:39.271793] [DEBUG] [LOCAL ] ETSY: Primary data saved (54353 records). [2025-10-17T18:48:39.271933] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-17T18:48:39.272015] [INFO ] [MAIN ] Update Progress: 779/2368 symbols completed. ETSY took 32.2s. Estimated remaining: 3h 41m 30s. Rate: 7.2 symbols/min [2025-10-17T18:48:39.458065] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:48:39.466149] [DEBUG] [LOCAL ] ETX: Loaded 5276 existing records from primary storage. [2025-10-17T18:48:39.466362] [INFO ] [MAIN ] ETX: Loaded 5276 existing records. [2025-10-17T18:48:39.647349] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:48:39.647880] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-17T18:48:39.648022] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-17T18:48:39.653522] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-17T18:48:39.662600] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-17T18:48:39.669448] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T18:48:39.959850] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-17T18:48:40.026945] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:48:40.047156] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T18:48:40.758088] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-17T18:48:41.269783] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T18:48:41.274385] [INFO ] [REMOTE ] ETV: Full fetch complete (32444 records). [2025-10-17T18:48:41.274540] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-17T18:48:41.470476] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-17T18:48:41.563195] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-17T18:48:41.660001] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-17T18:48:41.660080] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-17T18:48:41.660761] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-17T18:48:41.660828] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-17T18:48:41.661665] [DEBUG] [LOCAL ] ETV: Trimmed 32444 records to 22515 (keeping 200 days of data) [2025-10-17T18:48:41.810675] [DEBUG] [LOCAL ] ETV: Primary data saved (22515 records). [2025-10-17T18:48:41.810813] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-17T18:48:41.810912] [INFO ] [MAIN ] Update Progress: 780/2368 symbols completed. ETV took 28.6s. Estimated remaining: 3h 41m 10s. Rate: 7.2 symbols/min [2025-10-17T18:48:41.982164] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:48:42.008215] [DEBUG] [LOCAL ] ETY: Loaded 23111 existing records from primary storage. [2025-10-17T18:48:42.008530] [INFO ] [MAIN ] ETY: Loaded 23111 existing records. [2025-10-17T18:48:42.186106] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:48:42.186314] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-17T18:48:42.186361] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-17T18:48:42.186600] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-17T18:48:42.186694] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-17T18:48:42.368900] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-17T18:48:42.556402] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:48:42.761363] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-17T18:48:43.158017] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-17T18:48:43.778526] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T18:48:43.958026] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-17T18:48:44.342189] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-17T18:48:44.349734] [INFO ] [REMOTE ] ETR: Full fetch complete (77284 records). [2025-10-17T18:48:44.349855] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-17T18:48:44.733806] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-17T18:48:44.733900] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-17T18:48:44.734807] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-17T18:48:44.734868] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-17T18:48:44.736313] [DEBUG] [LOCAL ] ETR: Trimmed 77284 records to 53984 (keeping 200 days of data) [2025-10-17T18:48:44.791700] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-17T18:48:45.064982] [DEBUG] [LOCAL ] ETR: Primary data saved (53984 records). [2025-10-17T18:48:45.065108] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-17T18:48:45.065185] [INFO ] [MAIN ] Update Progress: 781/2368 symbols completed. ETR took 45.9s. Estimated remaining: 3h 40m 51s. Rate: 7.2 symbols/min [2025-10-17T18:48:45.247933] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:48:45.249150] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-17T18:48:45.272401] [DEBUG] [LOCAL ] EVC: Loaded 18191 existing records from primary storage. [2025-10-17T18:48:45.272669] [INFO ] [MAIN ] EVC: Loaded 18191 existing records. [2025-10-17T18:48:45.459036] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:48:45.460933] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T18:48:45.461071] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-17T18:48:45.461326] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-17T18:48:45.464054] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-17T18:48:45.464128] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-17T18:48:45.562549] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-17T18:48:45.815919] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:48:46.024768] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-17T18:48:46.358027] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-17T18:48:47.158032] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-17T18:48:47.453936] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T18:48:47.454116] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-17T18:48:47.958070] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-17T18:48:48.758048] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-17T18:48:49.314053] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T18:48:49.533242] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T18:48:49.557981] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-17T18:48:50.357997] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-17T18:48:50.692697] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-17T18:48:50.740971] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-17T18:48:51.158034] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-17T18:48:51.958010] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-17T18:48:52.145871] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-17T18:48:52.758032] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-17T18:48:53.313753] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T18:48:53.539339] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-17T18:48:53.557986] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-17T18:48:54.122243] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-17T18:48:54.358059] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-17T18:48:55.158073] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-17T18:48:55.576581] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T18:48:55.958074] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-17T18:48:56.355544] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T18:48:56.758042] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-17T18:48:57.079795] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T18:48:57.492984] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-17T18:48:57.557988] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-17T18:48:58.358027] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-17T18:48:58.898954] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T18:48:59.158057] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-17T18:48:59.709144] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T18:48:59.958047] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-17T18:49:00.255731] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-17T18:49:00.758041] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-17T18:49:01.171036] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-17T18:49:01.558032] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-17T18:49:02.358032] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-17T18:49:02.432435] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T18:49:02.508010] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-17T18:49:03.158033] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-17T18:49:03.411022] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T18:49:03.958041] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-17T18:49:04.368826] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T18:49:04.756634] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T18:49:04.759437] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-17T18:49:05.532730] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T18:49:05.557988] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-17T18:49:06.358011] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-17T18:49:06.648907] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T18:49:07.052953] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-17T18:49:07.054338] [INFO ] [REMOTE ] ETX: Full fetch complete (6874 records). [2025-10-17T18:49:07.054406] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-17T18:49:07.163151] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-17T18:49:07.429885] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-17T18:49:07.429966] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-17T18:49:07.430159] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-17T18:49:07.430220] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-17T18:49:07.430598] [DEBUG] [LOCAL ] ETX: Trimmed 6874 records to 5300 (keeping 200 days of data) [2025-10-17T18:49:07.462478] [DEBUG] [LOCAL ] ETX: Primary data saved (5300 records). [2025-10-17T18:49:07.462567] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-17T18:49:07.462672] [INFO ] [MAIN ] Update Progress: 782/2368 symbols completed. ETX took 28.2s. Estimated remaining: 3h 41m 11s. Rate: 7.2 symbols/min [2025-10-17T18:49:07.634570] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:49:07.668564] [DEBUG] [LOCAL ] EVEX: Loaded 32729 existing records from primary storage. [2025-10-17T18:49:07.668916] [INFO ] [MAIN ] EVEX: Loaded 32729 existing records. [2025-10-17T18:49:07.846098] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:49:07.846330] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-17T18:49:07.846381] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-17T18:49:07.846592] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-17T18:49:07.846693] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-17T18:49:07.963195] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-17T18:49:08.206238] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:49:08.385792] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-17T18:49:08.758059] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-17T18:49:08.782703] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-17T18:49:09.558043] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-17T18:49:09.773911] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T18:49:10.358035] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-17T18:49:10.600851] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T18:49:11.158032] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-17T18:49:11.431011] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T18:49:11.958056] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-17T18:49:12.372361] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T18:49:12.758043] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-17T18:49:13.317016] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T18:49:13.321256] [INFO ] [REMOTE ] ETW: Full fetch complete (36792 records). [2025-10-17T18:49:13.321367] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-17T18:49:13.563193] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-17T18:49:13.712733] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-17T18:49:13.712841] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-17T18:49:13.713676] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-17T18:49:13.713848] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-17T18:49:13.714806] [DEBUG] [LOCAL ] ETW: Trimmed 36792 records to 25887 (keeping 200 days of data) [2025-10-17T18:49:13.845442] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T18:49:13.896665] [DEBUG] [LOCAL ] ETW: Primary data saved (25887 records). [2025-10-17T18:49:13.896811] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-17T18:49:13.896898] [INFO ] [MAIN ] Update Progress: 783/2368 symbols completed. ETW took 48.2s. Estimated remaining: 3h 40m 59s. Rate: 7.2 symbols/min [2025-10-17T18:49:14.068007] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:49:14.078615] [DEBUG] [LOCAL ] EVF: Loaded 9864 existing records from primary storage. [2025-10-17T18:49:14.078821] [INFO ] [MAIN ] EVF: Loaded 9864 existing records. [2025-10-17T18:49:14.264083] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:49:14.264310] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-17T18:49:14.264358] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-17T18:49:14.264504] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-17T18:49:14.264541] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-17T18:49:14.364618] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-17T18:49:14.673619] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:49:14.786190] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T18:49:14.790348] [INFO ] [REMOTE ] ETY: Full fetch complete (34233 records). [2025-10-17T18:49:14.790469] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-17T18:49:15.168086] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-17T18:49:15.191670] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-17T18:49:15.192804] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-17T18:49:15.193496] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-17T18:49:15.193560] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-17T18:49:15.194479] [DEBUG] [LOCAL ] ETY: Trimmed 34233 records to 23210 (keeping 200 days of data) [2025-10-17T18:49:15.342102] [DEBUG] [LOCAL ] ETY: Primary data saved (23210 records). [2025-10-17T18:49:15.342233] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-17T18:49:15.342312] [INFO ] [MAIN ] Update Progress: 784/2368 symbols completed. ETY took 33.5s. Estimated remaining: 3h 40m 37s. Rate: 7.2 symbols/min [2025-10-17T18:49:15.542950] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-17T18:49:15.542467] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:49:15.555095] [DEBUG] [LOCAL ] EVG: Loaded 5979 existing records from primary storage. [2025-10-17T18:49:15.555324] [INFO ] [MAIN ] EVG: Loaded 5979 existing records. [2025-10-17T18:49:15.726098] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:49:15.726284] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-17T18:49:15.726329] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-17T18:49:15.726521] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-17T18:49:15.726575] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-17T18:49:15.963274] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-17T18:49:16.073007] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:49:16.437681] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-17T18:49:16.565926] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-17T18:49:16.757998] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-17T18:49:17.557999] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-17T18:49:17.759392] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T18:49:17.761855] [INFO ] [REMOTE ] EVC: Full fetch complete (28841 records). [2025-10-17T18:49:17.761930] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-17T18:49:18.118956] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-17T18:49:18.119040] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-17T18:49:18.119594] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-17T18:49:18.119633] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-17T18:49:18.120400] [DEBUG] [LOCAL ] EVC: Trimmed 28841 records to 18307 (keeping 200 days of data) [2025-10-17T18:49:18.226177] [DEBUG] [LOCAL ] EVC: Primary data saved (18307 records). [2025-10-17T18:49:18.226311] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-17T18:49:18.226393] [INFO ] [MAIN ] Update Progress: 785/2368 symbols completed. EVC took 33.2s. Estimated remaining: 3h 40m 17s. Rate: 7.2 symbols/min [2025-10-17T18:49:18.310924] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T18:49:18.363234] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-17T18:49:18.411097] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:49:18.454614] [DEBUG] [LOCAL ] EVH: Loaded 49986 existing records from primary storage. [2025-10-17T18:49:18.454986] [INFO ] [MAIN ] EVH: Loaded 49986 existing records. [2025-10-17T18:49:18.630978] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:49:18.631259] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-17T18:49:18.631317] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-17T18:49:18.631494] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-17T18:49:18.631532] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-17T18:49:18.978490] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:49:19.158039] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-17T18:49:19.540322] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T18:49:19.760598] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T18:49:19.958019] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-17T18:49:20.758007] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-17T18:49:21.033710] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T18:49:21.558005] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-17T18:49:21.687429] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T18:49:22.123691] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-17T18:49:22.358017] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-17T18:49:22.961311] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-17T18:49:23.158045] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-17T18:49:23.958105] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-17T18:49:23.983672] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T18:49:24.758027] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-17T18:49:25.558038] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-17T18:49:25.637564] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T18:49:25.672297] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T18:49:26.169672] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T18:49:26.358068] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-17T18:49:27.024794] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-17T18:49:27.158062] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-17T18:49:27.958021] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-17T18:49:28.419755] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T18:49:28.758064] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-17T18:49:29.558058] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-17T18:49:29.599899] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T18:49:30.304725] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-17T18:49:30.340860] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-17T18:49:30.357977] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-17T18:49:31.158024] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-17T18:49:31.953861] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T18:49:31.961929] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-17T18:49:32.663005] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-17T18:49:32.689971] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T18:49:32.758081] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-17T18:49:33.558037] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-17T18:49:34.348573] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-17T18:49:34.358002] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-17T18:49:34.416724] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T18:49:34.967564] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-17T18:49:35.158058] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-17T18:49:35.899444] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T18:49:35.958035] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-17T18:49:36.681333] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-17T18:49:36.757991] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-17T18:49:37.558002] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-17T18:49:38.357999] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-17T18:49:38.424449] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T18:49:38.792480] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-17T18:49:39.158015] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-17T18:49:39.402134] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T18:49:39.408757] [INFO ] [REMOTE ] EVEX: Full fetch complete (43670 records). [2025-10-17T18:49:39.408842] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-17T18:49:39.781930] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-17T18:49:39.782007] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-17T18:49:39.782669] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-17T18:49:39.782731] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-17T18:49:39.783696] [DEBUG] [LOCAL ] EVEX: Trimmed 43670 records to 33091 (keeping 200 days of data) [2025-10-17T18:49:39.963182] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-17T18:49:39.989413] [DEBUG] [LOCAL ] EVEX: Primary data saved (33091 records). [2025-10-17T18:49:39.989575] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-17T18:49:39.990590] [INFO ] [MAIN ] Update Progress: 786/2368 symbols completed. EVEX took 32.5s. Estimated remaining: 3h 40m 36s. Rate: 7.2 symbols/min [2025-10-17T18:49:40.160636] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:49:40.174613] [DEBUG] [LOCAL ] EVN: Loaded 10839 existing records from primary storage. [2025-10-17T18:49:40.174875] [INFO ] [MAIN ] EVN: Loaded 10839 existing records. [2025-10-17T18:49:40.358057] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:49:40.358293] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-17T18:49:40.358340] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-17T18:49:40.358496] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-17T18:49:40.358533] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-17T18:49:40.722508] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:49:40.757990] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-17T18:49:40.997871] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T18:49:40.999256] [INFO ] [REMOTE ] EVG: Full fetch complete (8176 records). [2025-10-17T18:49:40.999326] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-17T18:49:41.389166] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-17T18:49:41.391237] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-17T18:49:41.389598] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-17T18:49:41.401514] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-17T18:49:41.401706] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-17T18:49:41.402765] [DEBUG] [LOCAL ] EVG: Trimmed 8176 records to 6021 (keeping 200 days of data) [2025-10-17T18:49:41.437669] [DEBUG] [LOCAL ] EVG: Primary data saved (6021 records). [2025-10-17T18:49:41.437746] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-17T18:49:41.437818] [INFO ] [MAIN ] Update Progress: 787/2368 symbols completed. EVG took 26.1s. Estimated remaining: 3h 40m 14s. Rate: 7.2 symbols/min [2025-10-17T18:49:41.562862] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-17T18:49:41.607425] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:49:41.617099] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-17T18:49:41.651366] [DEBUG] [LOCAL ] EVR: Loaded 34630 existing records from primary storage. [2025-10-17T18:49:41.651633] [INFO ] [MAIN ] EVR: Loaded 34630 existing records. [2025-10-17T18:49:41.822303] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:49:41.822521] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-17T18:49:41.822568] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-17T18:49:41.822751] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-17T18:49:41.822806] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-17T18:49:42.170936] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:49:42.358026] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-17T18:49:42.383609] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T18:49:43.158074] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-17T18:49:43.775768] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T18:49:43.958005] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-17T18:49:44.164877] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T18:49:44.758027] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-17T18:49:45.525104] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T18:49:45.557982] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-17T18:49:45.692251] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T18:49:46.358084] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-17T18:49:47.158018] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-17T18:49:47.253632] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-17T18:49:47.299510] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T18:49:47.958075] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-17T18:49:48.620440] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T18:49:48.758052] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-17T18:49:49.558049] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-17T18:49:49.652906] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T18:49:50.302058] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-17T18:49:50.349749] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T18:49:50.358125] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-17T18:49:51.119213] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T18:49:51.158045] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-17T18:49:51.958079] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-17T18:49:52.742623] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T18:49:52.757971] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-17T18:49:52.898227] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T18:49:53.558007] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-17T18:49:53.630500] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-17T18:49:54.358056] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-17T18:49:54.972023] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T18:49:55.158002] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-17T18:49:55.715387] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T18:49:55.958008] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-17T18:49:56.508990] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-17T18:49:56.758053] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-17T18:49:57.550623] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T18:49:57.560778] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-17T18:49:58.223335] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T18:49:58.358013] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-17T18:49:58.579091] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T18:49:58.581742] [INFO ] [REMOTE ] EVF: Full fetch complete (12855 records). [2025-10-17T18:49:58.581817] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-17T18:49:58.964785] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-17T18:49:58.964993] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-17T18:49:58.965528] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-17T18:49:58.965592] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-17T18:49:58.966271] [DEBUG] [LOCAL ] EVF: Trimmed 12855 records to 9913 (keeping 200 days of data) [2025-10-17T18:49:59.030549] [DEBUG] [LOCAL ] EVF: Primary data saved (9913 records). [2025-10-17T18:49:59.030837] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-17T18:49:59.031012] [INFO ] [MAIN ] Update Progress: 788/2368 symbols completed. EVF took 45.1s. Estimated remaining: 3h 40m 24s. Rate: 7.2 symbols/min [2025-10-17T18:49:59.119424] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T18:49:59.163089] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-17T18:49:59.223815] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:49:59.241487] [DEBUG] [LOCAL ] EVT: Loaded 16930 existing records from primary storage. [2025-10-17T18:49:59.241757] [INFO ] [MAIN ] EVT: Loaded 16930 existing records. [2025-10-17T18:49:59.413701] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:49:59.413922] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-17T18:49:59.413970] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-17T18:49:59.414162] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-17T18:49:59.414220] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-17T18:49:59.760565] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:49:59.958009] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-17T18:50:00.237106] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-17T18:50:00.758042] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-17T18:50:01.275469] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T18:50:01.558037] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-17T18:50:02.363790] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-17T18:50:02.366137] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T18:50:03.158012] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-17T18:50:03.318377] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-17T18:50:03.325391] [INFO ] [REMOTE ] EVH: Full fetch complete (71844 records). [2025-10-17T18:50:03.325503] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-17T18:50:03.541899] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T18:50:03.733604] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-17T18:50:03.733708] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-17T18:50:03.734689] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-17T18:50:03.734752] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-17T18:50:03.736107] [DEBUG] [LOCAL ] EVH: Trimmed 71844 records to 50335 (keeping 200 days of data) [2025-10-17T18:50:03.958055] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-17T18:50:04.018444] [DEBUG] [LOCAL ] EVH: Primary data saved (50335 records). [2025-10-17T18:50:04.018581] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-17T18:50:04.018695] [INFO ] [MAIN ] Update Progress: 789/2368 symbols completed. EVH took 45.8s. Estimated remaining: 3h 40m 9s. Rate: 7.2 symbols/min [2025-10-17T18:50:04.182478] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:50:04.207763] [DEBUG] [LOCAL ] EVTC: Loaded 27014 existing records from primary storage. [2025-10-17T18:50:04.208013] [INFO ] [MAIN ] EVTC: Loaded 27014 existing records. [2025-10-17T18:50:04.379204] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:50:04.379391] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-17T18:50:04.379436] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-17T18:50:04.379636] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-17T18:50:04.379722] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-17T18:50:04.738147] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:50:04.759342] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-17T18:50:04.762570] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T18:50:04.805773] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T18:50:05.558033] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-17T18:50:05.841306] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T18:50:06.358040] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-17T18:50:06.419895] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-17T18:50:07.158080] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-17T18:50:07.827388] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T18:50:07.832296] [INFO ] [REMOTE ] EVR: Full fetch complete (50847 records). [2025-10-17T18:50:07.832438] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-17T18:50:07.958583] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-17T18:50:08.216909] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-17T18:50:08.217113] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-17T18:50:08.217936] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-17T18:50:08.218043] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-17T18:50:08.230471] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-17T18:50:08.234831] [DEBUG] [LOCAL ] EVR: Trimmed 50847 records to 34821 (keeping 200 days of data) [2025-10-17T18:50:08.452300] [DEBUG] [LOCAL ] EVR: Primary data saved (34821 records). [2025-10-17T18:50:08.452443] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-17T18:50:08.452524] [INFO ] [MAIN ] Update Progress: 790/2368 symbols completed. EVR took 27.0s. Estimated remaining: 3h 39m 52s. Rate: 7.2 symbols/min [2025-10-17T18:50:08.629333] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:50:08.668065] [DEBUG] [LOCAL ] EVTL: Loaded 40675 existing records from primary storage. [2025-10-17T18:50:08.668362] [INFO ] [MAIN ] EVTL: Loaded 40675 existing records. [2025-10-17T18:50:08.764192] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-17T18:50:08.845055] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:50:08.845260] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-17T18:50:08.845308] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-17T18:50:08.845617] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-17T18:50:08.845721] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-17T18:50:09.136809] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-17T18:50:09.226763] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:50:09.558020] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-17T18:50:09.855515] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T18:50:10.358061] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-17T18:50:10.926256] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T18:50:11.158079] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-17T18:50:11.285215] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T18:50:11.958066] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-17T18:50:12.341490] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T18:50:12.758069] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-17T18:50:13.130732] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-17T18:50:13.557986] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-17T18:50:13.728788] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T18:50:14.098971] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-17T18:50:14.358065] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-17T18:50:15.158066] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-17T18:50:15.958109] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-17T18:50:16.000680] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T18:50:16.324229] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T18:50:16.758017] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-17T18:50:16.992287] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T18:50:17.558015] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-17T18:50:18.229207] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T18:50:18.358012] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-17T18:50:18.505995] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T18:50:18.508037] [INFO ] [REMOTE ] EVN: Full fetch complete (17213 records). [2025-10-17T18:50:18.508106] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-17T18:50:18.860001] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-17T18:50:18.860074] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-17T18:50:18.860426] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-17T18:50:18.860465] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-17T18:50:18.860981] [DEBUG] [LOCAL ] EVN: Trimmed 17213 records to 10887 (keeping 200 days of data) [2025-10-17T18:50:18.924100] [DEBUG] [LOCAL ] EVN: Primary data saved (10887 records). [2025-10-17T18:50:18.924238] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-17T18:50:18.924314] [INFO ] [MAIN ] Update Progress: 791/2368 symbols completed. EVN took 38.9s. Estimated remaining: 3h 39m 48s. Rate: 7.2 symbols/min [2025-10-17T18:50:19.092066] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:50:19.116009] [DEBUG] [LOCAL ] EVTR: Loaded 25015 existing records from primary storage. [2025-10-17T18:50:19.116674] [INFO ] [MAIN ] EVTR: Loaded 25015 existing records. [2025-10-17T18:50:19.167901] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-17T18:50:19.319321] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:50:19.319616] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-17T18:50:19.319712] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-17T18:50:19.319958] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-17T18:50:19.320038] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-17T18:50:19.688540] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:50:19.690470] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-17T18:50:19.958011] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-17T18:50:20.557829] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-17T18:50:20.755778] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T18:50:20.759529] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-17T18:50:21.558046] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-17T18:50:21.956758] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T18:50:22.358050] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-17T18:50:22.868556] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T18:50:23.158049] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-17T18:50:23.362980] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T18:50:23.958011] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-17T18:50:24.098958] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T18:50:24.758031] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-17T18:50:25.175235] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-17T18:50:25.557999] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-17T18:50:25.800526] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T18:50:26.358095] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-17T18:50:26.855059] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-17T18:50:27.158064] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-17T18:50:27.304301] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T18:50:27.306813] [INFO ] [REMOTE ] EVT: Full fetch complete (25231 records). [2025-10-17T18:50:27.306887] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-17T18:50:27.675041] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-17T18:50:27.675133] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-17T18:50:27.675666] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-17T18:50:27.675796] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-17T18:50:27.676469] [DEBUG] [LOCAL ] EVT: Trimmed 25231 records to 17008 (keeping 200 days of data) [2025-10-17T18:50:27.778439] [DEBUG] [LOCAL ] EVT: Primary data saved (17008 records). [2025-10-17T18:50:27.778575] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-17T18:50:27.778676] [INFO ] [MAIN ] Update Progress: 792/2368 symbols completed. EVT took 28.7s. Estimated remaining: 3h 39m 41s. Rate: 7.2 symbols/min [2025-10-17T18:50:27.946262] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:50:27.958051] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-17T18:50:27.996822] [DEBUG] [LOCAL ] EW: Loaded 53793 existing records from primary storage. [2025-10-17T18:50:27.997149] [INFO ] [MAIN ] EW: Loaded 53793 existing records. [2025-10-17T18:50:28.178812] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:50:28.179021] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-17T18:50:28.179069] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-17T18:50:28.179362] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-17T18:50:28.179421] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-17T18:50:28.483890] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T18:50:28.566421] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:50:28.758021] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-17T18:50:29.557998] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-17T18:50:29.593043] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T18:50:29.758355] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-17T18:50:30.358026] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-17T18:50:30.564085] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-17T18:50:31.158052] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-17T18:50:31.958044] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-17T18:50:32.188092] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T18:50:32.609388] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T18:50:32.758036] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-17T18:50:32.979540] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T18:50:33.558027] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-17T18:50:34.358004] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-17T18:50:34.674501] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-17T18:50:34.758920] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-17T18:50:35.021912] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-17T18:50:35.158030] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-17T18:50:35.958010] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-17T18:50:36.240876] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T18:50:36.758056] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-17T18:50:37.558005] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-17T18:50:37.679795] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T18:50:38.358057] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-17T18:50:38.447621] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T18:50:38.720540] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T18:50:38.725092] [INFO ] [REMOTE ] EVTC: Full fetch complete (38413 records). [2025-10-17T18:50:38.725170] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-17T18:50:39.093582] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-17T18:50:39.093681] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-17T18:50:39.094297] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-17T18:50:39.094338] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-17T18:50:39.095150] [DEBUG] [LOCAL ] EVTC: Trimmed 38413 records to 27241 (keeping 200 days of data) [2025-10-17T18:50:39.158059] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-17T18:50:39.261256] [DEBUG] [LOCAL ] EVTC: Primary data saved (27241 records). [2025-10-17T18:50:39.261443] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-17T18:50:39.261548] [INFO ] [MAIN ] Update Progress: 793/2368 symbols completed. EVTC took 35.2s. Estimated remaining: 3h 39m 39s. Rate: 7.2 symbols/min [2025-10-17T18:50:39.428030] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:50:39.459598] [DEBUG] [LOCAL ] EXG: Loaded 34277 existing records from primary storage. [2025-10-17T18:50:39.459914] [INFO ] [MAIN ] EXG: Loaded 34277 existing records. [2025-10-17T18:50:39.634913] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:50:39.635122] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-17T18:50:39.635177] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-17T18:50:39.635377] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-17T18:50:39.635415] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-17T18:50:39.986732] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-17T18:50:39.992322] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:50:40.139621] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T18:50:40.251582] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T18:50:40.758031] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-17T18:50:41.558001] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-17T18:50:41.791786] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T18:50:42.035109] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T18:50:42.358038] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-17T18:50:42.835189] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T18:50:43.158034] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-17T18:50:43.958001] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-17T18:50:44.386208] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T18:50:44.394197] [INFO ] [REMOTE ] EVTL: Full fetch complete (54508 records). [2025-10-17T18:50:44.394346] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-17T18:50:44.759720] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-17T18:50:44.783370] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-17T18:50:44.783575] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-17T18:50:44.784529] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-17T18:50:44.784856] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-17T18:50:44.786265] [DEBUG] [LOCAL ] EVTL: Trimmed 54508 records to 41058 (keeping 200 days of data) [2025-10-17T18:50:45.020265] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T18:50:45.066773] [DEBUG] [LOCAL ] EVTL: Primary data saved (41058 records). [2025-10-17T18:50:45.066905] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-17T18:50:45.067705] [INFO ] [MAIN ] Update Progress: 794/2368 symbols completed. EVTL took 36.6s. Estimated remaining: 3h 39m 25s. Rate: 7.2 symbols/min [2025-10-17T18:50:45.262880] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:50:45.280569] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T18:50:45.338849] [DEBUG] [LOCAL ] EXK: Loaded 53561 existing records from primary storage. [2025-10-17T18:50:45.339189] [INFO ] [MAIN ] EXK: Loaded 53561 existing records. [2025-10-17T18:50:45.510273] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:50:45.510465] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-17T18:50:45.510511] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-17T18:50:45.510768] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-17T18:50:45.510836] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-17T18:50:45.571244] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-17T18:50:45.862006] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:50:45.881610] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T18:50:46.358006] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-17T18:50:46.950201] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T18:50:47.158079] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-17T18:50:47.958005] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-17T18:50:48.215037] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T18:50:48.454318] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T18:50:48.459088] [INFO ] [REMOTE ] EVTR: Full fetch complete (33558 records). [2025-10-17T18:50:48.459194] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-17T18:50:48.763211] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-17T18:50:48.833459] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-17T18:50:48.833530] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-17T18:50:48.834174] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-17T18:50:48.834237] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-17T18:50:48.835016] [DEBUG] [LOCAL ] EVTR: Trimmed 33558 records to 25284 (keeping 200 days of data) [2025-10-17T18:50:48.986679] [DEBUG] [LOCAL ] EVTR: Primary data saved (25284 records). [2025-10-17T18:50:49.003301] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-17T18:50:49.003472] [INFO ] [MAIN ] Update Progress: 795/2368 symbols completed. EVTR took 30.1s. Estimated remaining: 3h 39m 8s. Rate: 7.2 symbols/min [2025-10-17T18:50:49.049357] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T18:50:49.182856] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:50:49.212958] [DEBUG] [LOCAL ] EXP: Loaded 29802 existing records from primary storage. [2025-10-17T18:50:49.213209] [INFO ] [MAIN ] EXP: Loaded 29802 existing records. [2025-10-17T18:50:49.391703] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:50:49.391926] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-17T18:50:49.391996] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-17T18:50:49.392209] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-17T18:50:49.392273] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-17T18:50:49.560834] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-17T18:50:49.743027] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:50:50.358034] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-17T18:50:50.571323] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T18:50:50.661865] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-17T18:50:51.158099] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-17T18:50:51.685783] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T18:50:51.958042] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-17T18:50:52.758005] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-17T18:50:52.911992] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T18:50:53.558027] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-17T18:50:53.653547] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T18:50:53.761192] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-17T18:50:54.358033] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-17T18:50:55.158050] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-17T18:50:55.454885] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T18:50:55.958017] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-17T18:50:56.088815] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T18:50:56.665529] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T18:50:56.758030] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-17T18:50:56.846716] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T18:50:57.558027] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-17T18:50:58.358018] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-17T18:50:58.399834] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T18:50:58.896686] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T18:50:59.158035] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-17T18:50:59.655736] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-17T18:50:59.958025] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-17T18:51:00.758035] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-17T18:51:01.558097] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-17T18:51:01.837003] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-17T18:51:01.943081] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-17T18:51:02.358118] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-17T18:51:02.409455] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T18:51:03.158034] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-17T18:51:03.226924] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T18:51:03.958003] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-17T18:51:04.413973] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-17T18:51:04.652634] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T18:51:04.757988] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-17T18:51:05.558086] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-17T18:51:05.590729] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T18:51:06.358045] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-17T18:51:06.447582] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T18:51:06.459172] [INFO ] [REMOTE ] EW: Full fetch complete (77516 records). [2025-10-17T18:51:06.459368] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-17T18:51:06.891785] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-17T18:51:06.928279] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-17T18:51:06.928726] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-17T18:51:06.929945] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-17T18:51:06.930036] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-17T18:51:06.932000] [DEBUG] [LOCAL ] EW: Trimmed 77516 records to 54179 (keeping 200 days of data) [2025-10-17T18:51:07.158713] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-17T18:51:07.278638] [DEBUG] [LOCAL ] EW: Primary data saved (54179 records). [2025-10-17T18:51:07.278813] [INFO ] [MAIN ] EW: Full history saved. [2025-10-17T18:51:07.279475] [INFO ] [MAIN ] Update Progress: 796/2368 symbols completed. EW took 39.5s. Estimated remaining: 3h 39m 19s. Rate: 7.2 symbols/min [2025-10-17T18:51:07.459923] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:51:07.507756] [DEBUG] [LOCAL ] EXPD: Loaded 48303 existing records from primary storage. [2025-10-17T18:51:07.508063] [INFO ] [MAIN ] EXPD: Loaded 48303 existing records. [2025-10-17T18:51:07.690031] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:51:07.690299] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-17T18:51:07.690448] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-17T18:51:07.690756] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-17T18:51:07.690821] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-17T18:51:07.829786] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T18:51:07.963301] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-17T18:51:08.081808] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:51:08.559329] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T18:51:08.758114] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-17T18:51:09.558083] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-17T18:51:09.873630] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-17T18:51:10.358061] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-17T18:51:10.385795] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T18:51:10.497690] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T18:51:11.158078] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-17T18:51:11.853501] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T18:51:11.957996] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-17T18:51:12.758015] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-17T18:51:13.258454] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-17T18:51:13.558017] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-17T18:51:13.656788] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T18:51:14.358032] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-17T18:51:14.493723] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T18:51:15.158011] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-17T18:51:15.579727] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T18:51:15.720497] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-17T18:51:15.958044] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-17T18:51:16.549944] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T18:51:16.554727] [INFO ] [REMOTE ] EXG: Full fetch complete (49795 records). [2025-10-17T18:51:16.554867] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-17T18:51:16.763119] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-17T18:51:16.946433] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-17T18:51:16.946509] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-17T18:51:16.947211] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-17T18:51:16.947312] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-17T18:51:16.948468] [DEBUG] [LOCAL ] EXG: Trimmed 49795 records to 34518 (keeping 200 days of data) [2025-10-17T18:51:17.157564] [DEBUG] [LOCAL ] EXG: Primary data saved (34518 records). [2025-10-17T18:51:17.157774] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-17T18:51:17.157891] [INFO ] [MAIN ] Update Progress: 797/2368 symbols completed. EXG took 37.9s. Estimated remaining: 3h 39m 14s. Rate: 7.2 symbols/min [2025-10-17T18:51:17.558032] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-17T18:51:17.676555] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-17T18:51:18.046013] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-17T18:51:18.358066] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-17T18:51:19.158056] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-17T18:51:19.495051] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T18:51:19.832581] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T18:51:19.837219] [INFO ] [REMOTE ] EXP: Full fetch complete (42965 records). [2025-10-17T18:51:19.837365] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-17T18:51:19.963179] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-17T18:51:20.221669] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-17T18:51:20.221759] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-17T18:51:20.222451] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-17T18:51:20.222492] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-17T18:51:20.223420] [DEBUG] [LOCAL ] EXP: Trimmed 42965 records to 29985 (keeping 200 days of data) [2025-10-17T18:51:20.406762] [DEBUG] [LOCAL ] EXP: Primary data saved (29985 records). [2025-10-17T18:51:20.406902] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-17T18:51:20.408416] [INFO ] [MAIN ] Update Progress: 798/2368 symbols completed. EXP took 31.4s. Estimated remaining: 3h 38m 55s. Rate: 7.2 symbols/min [2025-10-17T18:51:20.895964] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T18:51:20.906520] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-17T18:51:22.144844] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-17T18:51:22.152167] [INFO ] [REMOTE ] EXK: Full fetch complete (76799 records). [2025-10-17T18:51:22.152293] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-17T18:51:22.546538] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-17T18:51:22.546725] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-17T18:51:22.547823] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-17T18:51:22.547902] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-17T18:51:22.550272] [DEBUG] [LOCAL ] EXK: Trimmed 76799 records to 53951 (keeping 200 days of data) [2025-10-17T18:51:22.669078] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T18:51:22.688830] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-17T18:51:22.894098] [DEBUG] [LOCAL ] EXK: Primary data saved (53951 records). [2025-10-17T18:51:22.894238] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-17T18:51:22.895011] [INFO ] [MAIN ] Update Progress: 799/2368 symbols completed. EXK took 37.8s. Estimated remaining: 3h 38m 36s. Rate: 7.2 symbols/min [2025-10-17T18:51:24.505767] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T18:51:24.517620] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-17T18:51:26.078819] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T18:51:26.088516] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-17T18:51:27.837664] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T18:51:27.848848] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-17T18:51:29.494375] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T18:51:29.504709] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-17T18:51:31.263323] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T18:51:31.274204] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-17T18:51:32.115319] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T18:51:32.122053] [INFO ] [REMOTE ] EXPD: Full fetch complete (69482 records). [2025-10-17T18:51:32.122190] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-17T18:51:32.509327] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-17T18:51:32.509460] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-17T18:51:32.510403] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-17T18:51:32.510473] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-17T18:51:32.512021] [DEBUG] [LOCAL ] EXPD: Trimmed 69482 records to 48595 (keeping 200 days of data) [2025-10-17T18:51:32.817725] [DEBUG] [LOCAL ] EXPD: Primary data saved (48595 records). [2025-10-17T18:51:32.817865] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-17T18:51:32.818427] [INFO ] [MAIN ] Update Progress: 800/2368 symbols completed. EXPD took 25.5s. Estimated remaining: 3h 38m 30s. Rate: 7.2 symbols/min [2025-10-17T18:51:33.556615] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:51:33.504211] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:51:33.553629] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:51:33.538477] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:51:33.655948] [DEBUG] [LOCAL ] FAF: Loaded 41803 existing records from primary storage. [2025-10-17T18:51:33.670008] [DEBUG] [LOCAL ] EXR: Loaded 45888 existing records from primary storage. [2025-10-17T18:51:33.671987] [INFO ] [MAIN ] EXR: Loaded 45888 existing records. [2025-10-17T18:51:33.671748] [INFO ] [MAIN ] FAF: Loaded 41803 existing records. [2025-10-17T18:51:33.703782] [DEBUG] [LOCAL ] FBIN: Loaded 50718 existing records from primary storage. [2025-10-17T18:51:33.778744] [INFO ] [MAIN ] FBIN: Loaded 50718 existing records. [2025-10-17T18:51:33.839685] [DEBUG] [LOCAL ] F: Loaded 54210 existing records from primary storage. [2025-10-17T18:51:33.905410] [INFO ] [MAIN ] F: Loaded 54210 existing records. [2025-10-17T18:51:34.158918] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:51:34.206633] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-17T18:51:34.254508] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-17T18:51:34.344723] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-17T18:51:34.348472] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:51:34.348600] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-17T18:51:34.383253] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-17T18:51:34.489154] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:51:34.483322] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:51:34.489376] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-17T18:51:34.500138] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-17T18:51:34.509535] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-17T18:51:34.523595] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-17T18:51:34.439461] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-17T18:51:34.534313] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-17T18:51:34.534247] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-17T18:51:34.539726] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-17T18:51:34.550117] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-17T18:51:34.593374] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-17T18:51:34.636118] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-17T18:51:35.830721] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:51:35.911730] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:51:35.925774] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-17T18:51:35.926847] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-17T18:51:35.929888] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:51:35.945281] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-17T18:51:35.973877] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:51:35.974839] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-17T18:51:37.428282] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T18:51:37.435388] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-17T18:51:37.543229] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T18:51:37.553039] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-17T18:51:37.578753] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T18:51:37.587868] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-17T18:51:38.507555] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-17T18:51:38.518770] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-17T18:51:38.844633] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T18:51:38.853084] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-17T18:51:38.934471] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T18:51:38.943979] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-17T18:51:39.327266] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T18:51:39.337434] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-17T18:51:40.377771] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T18:51:40.384889] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-17T18:51:40.519216] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T18:51:40.528884] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-17T18:51:40.936358] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T18:51:40.946622] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-17T18:51:41.012387] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-17T18:51:41.022916] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-17T18:51:41.806106] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T18:51:41.815304] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-17T18:51:41.932450] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T18:51:41.942221] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-17T18:51:42.681220] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T18:51:42.692016] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-17T18:51:43.411480] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-17T18:51:43.421170] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-17T18:51:43.496333] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-17T18:51:43.506886] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-17T18:51:43.613636] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T18:51:43.623777] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-17T18:51:44.436943] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T18:51:44.448122] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-17T18:51:44.575056] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T18:51:44.584225] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-17T18:51:45.133983] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T18:51:45.143142] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-17T18:51:46.021063] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-17T18:51:46.032270] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-17T18:51:46.179733] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T18:51:46.195596] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T18:51:46.357991] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-17T18:51:46.607484] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T18:51:47.158070] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-17T18:51:47.924274] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T18:51:47.957991] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-17T18:51:48.144613] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-17T18:51:48.758012] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-17T18:51:48.880810] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T18:51:49.558028] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-17T18:51:49.678698] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T18:51:50.357999] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-17T18:51:50.598790] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T18:51:51.157994] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-17T18:51:51.185910] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T18:51:51.948263] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T18:51:51.957996] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-17T18:51:52.621408] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T18:51:52.758082] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-17T18:51:53.558017] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-17T18:51:54.149857] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-17T18:51:54.297615] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-17T18:51:54.357996] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-17T18:51:55.158005] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-17T18:51:55.258043] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T18:51:55.958068] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-17T18:51:56.742470] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-17T18:51:56.757977] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-17T18:51:56.840176] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T18:51:57.558043] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-17T18:51:57.636477] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T18:51:57.643106] [INFO ] [REMOTE ] EXR: Full fetch complete (66180 records). [2025-10-17T18:51:57.643245] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-17T18:51:58.020599] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-17T18:51:58.020721] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-17T18:51:58.021594] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-17T18:51:58.021662] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-17T18:51:58.023049] [DEBUG] [LOCAL ] EXR: Trimmed 66180 records to 46249 (keeping 200 days of data) [2025-10-17T18:51:58.308060] [DEBUG] [LOCAL ] EXR: Primary data saved (46249 records). [2025-10-17T18:51:58.308189] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-17T18:51:58.308269] [INFO ] [MAIN ] Update Progress: 801/2368 symbols completed. EXR took 25.5s. Estimated remaining: 3h 38m 55s. Rate: 7.2 symbols/min [2025-10-17T18:51:58.370388] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-17T18:51:58.479467] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:51:58.506200] [DEBUG] [LOCAL ] FBK: Loaded 27707 existing records from primary storage. [2025-10-17T18:51:58.506455] [INFO ] [MAIN ] FBK: Loaded 27707 existing records. [2025-10-17T18:51:58.679184] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:51:58.679389] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-17T18:51:58.679436] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-17T18:51:58.679713] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-17T18:51:58.679772] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-17T18:51:59.028947] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:51:59.158035] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-17T18:51:59.199110] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T18:51:59.206019] [INFO ] [REMOTE ] FBIN: Full fetch complete (72955 records). [2025-10-17T18:51:59.206188] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-17T18:51:59.599527] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-17T18:51:59.599856] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-17T18:51:59.601024] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-17T18:51:59.626976] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-17T18:51:59.632562] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-10-17T18:51:59.662298] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T18:51:59.669376] [INFO ] [REMOTE ] FAF: Full fetch complete (58147 records). [2025-10-17T18:51:59.669775] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-17T18:51:59.669638] [DEBUG] [LOCAL ] FBIN: Trimmed 72955 records to 51068 (keeping 200 days of data) [2025-10-17T18:51:59.963139] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-17T18:52:00.135377] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T18:52:00.377145] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-17T18:52:00.377417] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-17T18:52:00.392383] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-17T18:52:00.392776] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-17T18:52:00.396627] [DEBUG] [LOCAL ] FAF: Trimmed 58147 records to 42095 (keeping 200 days of data) [2025-10-17T18:52:00.502393] [DEBUG] [LOCAL ] FBIN: Primary data saved (51068 records). [2025-10-17T18:52:00.502970] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-17T18:52:00.503335] [INFO ] [MAIN ] Update Progress: 802/2368 symbols completed. FBIN took 27.7s. Estimated remaining: 3h 38m 35s. Rate: 7.2 symbols/min [2025-10-17T18:52:00.683034] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:52:00.772134] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-17T18:52:00.824028] [DEBUG] [LOCAL ] FBP: Loaded 46111 existing records from primary storage. [2025-10-17T18:52:00.827541] [INFO ] [MAIN ] FBP: Loaded 46111 existing records. [2025-10-17T18:52:01.027472] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:52:01.028744] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-17T18:52:01.029709] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-17T18:52:01.031798] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-17T18:52:01.032227] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-17T18:52:01.442168] [DEBUG] [LOCAL ] FAF: Primary data saved (42095 records). [2025-10-17T18:52:01.444194] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-17T18:52:01.448208] [INFO ] [MAIN ] Update Progress: 803/2368 symbols completed. FAF took 28.6s. Estimated remaining: 3h 38m 12s. Rate: 7.2 symbols/min [2025-10-17T18:52:01.448048] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:52:01.563103] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-17T18:52:01.630156] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:52:01.678004] [DEBUG] [LOCAL ] FBRT: Loaded 35695 existing records from primary storage. [2025-10-17T18:52:01.678399] [INFO ] [MAIN ] FBRT: Loaded 35695 existing records. [2025-10-17T18:52:01.879448] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:52:01.879778] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-17T18:52:01.879837] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-17T18:52:01.880305] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-17T18:52:01.880365] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-17T18:52:02.254088] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:52:02.358121] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-17T18:52:02.786312] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-17T18:52:03.083605] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (3.12 seconds). [2025-10-17T18:52:03.158019] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-17T18:52:03.234775] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T18:52:03.518415] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T18:52:03.958512] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-17T18:52:03.959083] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T18:52:04.758085] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-17T18:52:05.264903] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-17T18:52:05.558045] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-17T18:52:06.357996] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-17T18:52:06.581023] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T18:52:07.123587] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-17T18:52:07.158006] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-17T18:52:07.234417] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T18:52:07.958088] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-17T18:52:08.455277] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T18:52:08.758033] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-17T18:52:08.882834] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-17T18:52:09.558011] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-17T18:52:10.286905] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-17T18:52:10.358027] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-17T18:52:11.062161] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T18:52:11.157991] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-17T18:52:11.843602] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T18:52:11.958093] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-17T18:52:12.458771] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-17T18:52:12.758040] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-17T18:52:13.558007] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-17T18:52:13.785360] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T18:52:14.358040] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-17T18:52:14.554613] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-17T18:52:14.562158] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-17T18:52:14.562295] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-17T18:52:14.950271] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-17T18:52:14.950380] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-17T18:52:14.951336] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-17T18:52:14.951399] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-17T18:52:14.952868] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 54600 (keeping 200 days of data) [2025-10-17T18:52:15.163803] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-17T18:52:15.294415] [DEBUG] [LOCAL ] F: Primary data saved (54600 records). [2025-10-17T18:52:15.294575] [INFO ] [MAIN ] F: Full history saved. [2025-10-17T18:52:15.295610] [INFO ] [MAIN ] Update Progress: 804/2368 symbols completed. F took 42.5s. Estimated remaining: 3h 38m 14s. Rate: 7.2 symbols/min [2025-10-17T18:52:15.467343] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:52:15.500304] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T18:52:15.544266] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T18:52:15.542719] [DEBUG] [LOCAL ] FC: Loaded 14966 existing records from primary storage. [2025-10-17T18:52:15.551455] [INFO ] [MAIN ] FC: Loaded 14966 existing records. [2025-10-17T18:52:15.728100] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:52:15.728356] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-17T18:52:15.728404] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-17T18:52:15.728699] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-17T18:52:15.728756] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-17T18:52:15.963152] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-17T18:52:16.094948] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:52:16.271637] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T18:52:16.758178] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-17T18:52:17.460621] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T18:52:17.558073] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-17T18:52:18.149151] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T18:52:18.166126] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-17T18:52:18.358051] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-17T18:52:19.158034] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-17T18:52:19.663716] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T18:52:19.958023] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-17T18:52:20.460943] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T18:52:20.758076] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-17T18:52:21.558012] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-17T18:52:21.659380] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T18:52:21.721284] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-17T18:52:22.358007] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-17T18:52:22.488482] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T18:52:23.158016] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-17T18:52:23.814869] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T18:52:23.820046] [INFO ] [REMOTE ] FBK: Full fetch complete (35294 records). [2025-10-17T18:52:23.820130] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-17T18:52:23.964781] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-17T18:52:24.217182] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-17T18:52:24.217318] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-17T18:52:24.218258] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-17T18:52:24.218321] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-17T18:52:24.219327] [DEBUG] [LOCAL ] FBK: Trimmed 35294 records to 27962 (keeping 200 days of data) [2025-10-17T18:52:24.388256] [DEBUG] [LOCAL ] FBK: Primary data saved (27962 records). [2025-10-17T18:52:24.388403] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-17T18:52:24.388497] [INFO ] [MAIN ] Update Progress: 805/2368 symbols completed. FBK took 26.1s. Estimated remaining: 3h 38m 7s. Rate: 7.2 symbols/min [2025-10-17T18:52:24.573015] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T18:52:24.597161] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:52:24.637350] [DEBUG] [LOCAL ] FCF: Loaded 39657 existing records from primary storage. [2025-10-17T18:52:24.637716] [INFO ] [MAIN ] FCF: Loaded 39657 existing records. [2025-10-17T18:52:24.760033] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-17T18:52:24.801150] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-17T18:52:24.827601] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:52:24.830950] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-17T18:52:24.831719] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-17T18:52:24.832081] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-17T18:52:24.832140] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-17T18:52:25.185408] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:52:25.558033] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-17T18:52:26.268602] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T18:52:26.274303] [INFO ] [REMOTE ] FBRT: Full fetch complete (49564 records). [2025-10-17T18:52:26.274405] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-17T18:52:26.363677] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-17T18:52:26.630635] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-17T18:52:26.693681] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-17T18:52:26.693834] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-17T18:52:26.695115] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-17T18:52:26.695215] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-17T18:52:26.697073] [DEBUG] [LOCAL ] FBRT: Trimmed 49564 records to 35936 (keeping 200 days of data) [2025-10-17T18:52:26.912002] [DEBUG] [LOCAL ] FBRT: Primary data saved (35936 records). [2025-10-17T18:52:26.912143] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-17T18:52:26.912226] [INFO ] [MAIN ] Update Progress: 806/2368 symbols completed. FBRT took 25.5s. Estimated remaining: 3h 37m 48s. Rate: 7.2 symbols/min [2025-10-17T18:52:27.077565] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:52:27.103564] [DEBUG] [LOCAL ] FCN: Loaded 26219 existing records from primary storage. [2025-10-17T18:52:27.103844] [INFO ] [MAIN ] FCN: Loaded 26219 existing records. [2025-10-17T18:52:27.164695] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-17T18:52:27.279619] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:52:27.279868] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-17T18:52:27.279914] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-17T18:52:27.280251] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-17T18:52:27.280308] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-17T18:52:27.662391] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:52:27.963123] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-17T18:52:27.976144] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T18:52:28.242307] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-17T18:52:28.758005] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-17T18:52:29.130769] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T18:52:29.532963] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-17T18:52:29.557991] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-17T18:52:30.358017] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-17T18:52:30.421042] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-17T18:52:31.158037] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-17T18:52:31.918144] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T18:52:31.957994] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-17T18:52:32.345019] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T18:52:32.758009] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-17T18:52:33.558013] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-17T18:52:33.700753] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T18:52:34.138002] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T18:52:34.357439] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-17T18:52:34.361746] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-17T18:52:35.158038] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-17T18:52:35.800303] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T18:52:35.958029] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-17T18:52:36.588305] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T18:52:36.758055] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-17T18:52:37.058138] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T18:52:37.558017] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-17T18:52:37.665698] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T18:52:38.358033] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-17T18:52:39.090854] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T18:52:39.157993] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-17T18:52:39.344330] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T18:52:39.958020] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-17T18:52:40.646718] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T18:52:40.653442] [INFO ] [REMOTE ] FBP: Full fetch complete (66765 records). [2025-10-17T18:52:40.653544] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-17T18:52:40.763255] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-17T18:52:41.042273] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-17T18:52:41.042433] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-17T18:52:41.043354] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-17T18:52:41.043505] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-17T18:52:41.044838] [DEBUG] [LOCAL ] FBP: Trimmed 66765 records to 46466 (keeping 200 days of data) [2025-10-17T18:52:41.324274] [DEBUG] [LOCAL ] FBP: Primary data saved (46466 records). [2025-10-17T18:52:41.324398] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-17T18:52:41.325052] [INFO ] [MAIN ] Update Progress: 807/2368 symbols completed. FBP took 40.8s. Estimated remaining: 3h 37m 51s. Rate: 7.2 symbols/min [2025-10-17T18:52:41.496906] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T18:52:41.515958] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:52:41.563092] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-17T18:52:41.565178] [DEBUG] [LOCAL ] FCPT: Loaded 37627 existing records from primary storage. [2025-10-17T18:52:41.565504] [INFO ] [MAIN ] FCPT: Loaded 37627 existing records. [2025-10-17T18:52:41.741490] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:52:41.741699] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-17T18:52:41.741755] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-17T18:52:41.742024] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-17T18:52:41.742088] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-17T18:52:42.094103] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:52:42.162400] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T18:52:42.358004] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-17T18:52:43.117079] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T18:52:43.157989] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-17T18:52:43.721617] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T18:52:43.958010] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-17T18:52:44.757998] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-17T18:52:44.944169] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T18:52:45.322428] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T18:52:45.558010] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-17T18:52:45.760665] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T18:52:45.763891] [INFO ] [REMOTE ] FC: Full fetch complete (21862 records). [2025-10-17T18:52:45.763974] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-17T18:52:46.115834] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-17T18:52:46.115906] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-17T18:52:46.116280] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-17T18:52:46.116319] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-17T18:52:46.117049] [DEBUG] [LOCAL ] FC: Trimmed 21862 records to 15052 (keeping 200 days of data) [2025-10-17T18:52:46.209291] [DEBUG] [LOCAL ] FC: Primary data saved (15052 records). [2025-10-17T18:52:46.209512] [INFO ] [MAIN ] FC: Full history saved. [2025-10-17T18:52:46.209718] [INFO ] [MAIN ] Update Progress: 808/2368 symbols completed. FC took 30.9s. Estimated remaining: 3h 37m 36s. Rate: 7.2 symbols/min [2025-10-17T18:52:46.359490] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-17T18:52:46.380191] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:52:46.380481] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-17T18:52:46.380602] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-17T18:52:46.380740] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-17T18:52:46.380784] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-17T18:52:46.380826] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-17T18:52:46.380858] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-17T18:52:46.735549] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:52:46.753114] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-17T18:52:47.158038] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-17T18:52:47.510409] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-17T18:52:47.727516] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T18:52:47.958028] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-17T18:52:48.303222] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-17T18:52:48.758027] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-17T18:52:49.558037] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-17T18:52:50.128995] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T18:52:50.358035] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-17T18:52:50.919112] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T18:52:51.157998] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-17T18:52:51.474347] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T18:52:51.958050] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-17T18:52:52.514721] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T18:52:52.758036] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-17T18:52:53.558008] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-17T18:52:53.638907] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T18:52:54.281143] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-17T18:52:54.348337] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-17T18:52:54.357983] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-17T18:52:55.158073] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-17T18:52:55.726454] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T18:52:55.958020] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-17T18:52:56.389476] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-17T18:52:56.429099] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T18:52:56.758012] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-17T18:52:57.558004] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-17T18:52:57.898089] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-17T18:52:58.358021] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-17T18:52:58.995489] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T18:52:59.158022] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-17T18:52:59.583138] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-17T18:52:59.958004] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-17T18:53:00.490336] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-17T18:53:00.757994] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-17T18:53:00.816746] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T18:53:00.822479] [INFO ] [REMOTE ] FCF: Full fetch complete (58260 records). [2025-10-17T18:53:00.822577] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-17T18:53:01.201446] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-17T18:53:01.201537] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-17T18:53:01.202386] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-17T18:53:01.202456] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-17T18:53:01.203748] [DEBUG] [LOCAL ] FCF: Trimmed 58260 records to 39969 (keeping 200 days of data) [2025-10-17T18:53:01.446421] [DEBUG] [LOCAL ] FCF: Primary data saved (39969 records). [2025-10-17T18:53:01.446625] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-17T18:53:01.446799] [INFO ] [MAIN ] Update Progress: 809/2368 symbols completed. FCF took 37.1s. Estimated remaining: 3h 37m 41s. Rate: 7.2 symbols/min [2025-10-17T18:53:01.563191] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-17T18:53:01.622691] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:53:01.639172] [DEBUG] [LOCAL ] FCT: Loaded 14752 existing records from primary storage. [2025-10-17T18:53:01.639473] [INFO ] [MAIN ] FCT: Loaded 14752 existing records. [2025-10-17T18:53:01.817221] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T18:53:01.823274] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:53:01.826354] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-17T18:53:01.826432] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-17T18:53:01.826667] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-17T18:53:01.826742] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-17T18:53:02.188089] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:53:02.358059] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-17T18:53:03.052638] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T18:53:03.158043] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-17T18:53:03.410024] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T18:53:03.958028] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-17T18:53:04.151868] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T18:53:04.156020] [INFO ] [REMOTE ] FCN: Full fetch complete (36013 records). [2025-10-17T18:53:04.156115] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-17T18:53:04.327590] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-17T18:53:04.564724] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-17T18:53:04.564808] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-17T18:53:04.565397] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-17T18:53:04.565444] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-17T18:53:04.566407] [DEBUG] [LOCAL ] FCN: Trimmed 36013 records to 26402 (keeping 200 days of data) [2025-10-17T18:53:04.719851] [DEBUG] [LOCAL ] FCN: Primary data saved (26402 records). [2025-10-17T18:53:04.719985] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-17T18:53:04.720077] [INFO ] [MAIN ] Update Progress: 810/2368 symbols completed. FCN took 37.8s. Estimated remaining: 3h 37m 23s. Rate: 7.2 symbols/min [2025-10-17T18:53:04.763212] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-17T18:53:04.892264] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:53:04.949394] [DEBUG] [LOCAL ] FCX: Loaded 54091 existing records from primary storage. [2025-10-17T18:53:04.949736] [INFO ] [MAIN ] FCX: Loaded 54091 existing records. [2025-10-17T18:53:05.120786] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:53:05.121018] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-17T18:53:05.121066] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-17T18:53:05.121462] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-17T18:53:05.121548] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-17T18:53:05.462511] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:53:05.557990] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-17T18:53:05.897751] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T18:53:06.358028] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-17T18:53:06.965951] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T18:53:07.158024] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-17T18:53:07.166841] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T18:53:07.958047] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-17T18:53:08.758040] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-17T18:53:08.895583] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-17T18:53:09.165002] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T18:53:09.558029] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-17T18:53:10.097485] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T18:53:10.358055] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-17T18:53:10.516230] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-17T18:53:10.781393] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T18:53:11.158032] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-17T18:53:11.958043] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-17T18:53:11.966801] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T18:53:12.758038] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-17T18:53:13.374134] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T18:53:13.391154] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-17T18:53:13.558030] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-17T18:53:14.358031] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-17T18:53:15.040298] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T18:53:15.157997] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-17T18:53:15.958059] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-17T18:53:16.289259] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-17T18:53:16.400515] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-17T18:53:16.763141] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-17T18:53:16.773781] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T18:53:16.780532] [INFO ] [REMOTE ] FCPT: Full fetch complete (53920 records). [2025-10-17T18:53:16.780737] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-17T18:53:17.170909] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-17T18:53:17.170989] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-17T18:53:17.171765] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-17T18:53:17.171828] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-17T18:53:17.172946] [DEBUG] [LOCAL ] FCPT: Trimmed 53920 records to 37885 (keeping 200 days of data) [2025-10-17T18:53:17.404979] [DEBUG] [LOCAL ] FCPT: Primary data saved (37885 records). [2025-10-17T18:53:17.405117] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-17T18:53:17.405610] [INFO ] [MAIN ] Update Progress: 811/2368 symbols completed. FCPT took 36.1s. Estimated remaining: 3h 37m 22s. Rate: 7.2 symbols/min [2025-10-17T18:53:17.566242] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-17T18:53:17.585897] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:53:17.625363] [DEBUG] [LOCAL ] FDP: Loaded 29961 existing records from primary storage. [2025-10-17T18:53:17.625723] [INFO ] [MAIN ] FDP: Loaded 29961 existing records. [2025-10-17T18:53:17.813989] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:53:17.814265] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-17T18:53:17.814334] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-17T18:53:17.814778] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-17T18:53:17.814855] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-17T18:53:18.196613] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:53:18.358036] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-17T18:53:18.616815] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T18:53:18.685953] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-17T18:53:19.158037] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-17T18:53:19.267995] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T18:53:19.500421] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-17T18:53:19.958049] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-17T18:53:20.758082] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-17T18:53:21.192638] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T18:53:21.558039] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-17T18:53:21.581619] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-17T18:53:22.358069] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-17T18:53:22.789343] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T18:53:23.158051] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-17T18:53:23.278721] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T18:53:23.958028] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-17T18:53:24.566077] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T18:53:24.758042] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-17T18:53:24.886986] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T18:53:24.889596] [INFO ] [REMOTE ] FCT: Full fetch complete (21126 records). [2025-10-17T18:53:24.889705] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-17T18:53:25.211844] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-17T18:53:25.255797] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-17T18:53:25.255871] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-17T18:53:25.256364] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-17T18:53:25.256412] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-17T18:53:25.257077] [DEBUG] [LOCAL ] FCT: Trimmed 21126 records to 14906 (keeping 200 days of data) [2025-10-17T18:53:25.345501] [DEBUG] [LOCAL ] FCT: Primary data saved (14906 records). [2025-10-17T18:53:25.345670] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-17T18:53:25.345772] [INFO ] [MAIN ] Update Progress: 812/2368 symbols completed. FCT took 23.9s. Estimated remaining: 3h 37m 13s. Rate: 7.2 symbols/min [2025-10-17T18:53:25.513381] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:53:25.541607] [DEBUG] [LOCAL ] FDS: Loaded 27887 existing records from primary storage. [2025-10-17T18:53:25.541892] [INFO ] [MAIN ] FDS: Loaded 27887 existing records. [2025-10-17T18:53:25.563261] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-17T18:53:25.716864] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:53:25.717099] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-17T18:53:25.717147] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-17T18:53:25.717343] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-17T18:53:25.717402] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-17T18:53:26.062741] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:53:26.358047] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-17T18:53:26.742329] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-17T18:53:26.743144] [INFO ] [REMOTE ] FCRX: Full fetch complete (1656 records). [2025-10-17T18:53:26.743218] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-17T18:53:26.946661] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-17T18:53:26.946898] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:53:26.946955] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:53:26.947043] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-17T18:53:26.947108] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-17T18:53:26.947144] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-17T18:53:26.947196] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-17T18:53:26.947315] [INFO ] [MAIN ] Update Progress: 813/2368 symbols completed. FCRX took 40.7s. Estimated remaining: 3h 36m 52s. Rate: 7.2 symbols/min [2025-10-17T18:53:27.172387] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-17T18:53:27.175392] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:53:27.234871] [DEBUG] [LOCAL ] FDX: Loaded 51742 existing records from primary storage. [2025-10-17T18:53:27.235257] [INFO ] [MAIN ] FDX: Loaded 51742 existing records. [2025-10-17T18:53:27.410378] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:53:27.411338] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-17T18:53:27.411401] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-17T18:53:27.411619] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-17T18:53:27.411698] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-17T18:53:27.770239] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:53:27.848450] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-17T18:53:27.958059] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-17T18:53:28.352952] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T18:53:28.758147] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-17T18:53:29.558025] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-17T18:53:29.901575] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-17T18:53:30.003123] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T18:53:30.358045] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-17T18:53:31.158082] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-17T18:53:31.601907] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T18:53:31.828687] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T18:53:31.958045] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-17T18:53:32.278296] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T18:53:32.758077] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-17T18:53:33.387544] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T18:53:33.558013] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-17T18:53:34.358015] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-17T18:53:34.870893] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-17T18:53:34.883195] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T18:53:35.157994] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-17T18:53:35.580284] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-17T18:53:35.958014] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-17T18:53:36.758054] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-17T18:53:37.190439] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-17T18:53:37.300468] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T18:53:37.558053] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-17T18:53:38.358000] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-17T18:53:38.642296] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T18:53:38.697184] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T18:53:39.158016] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-17T18:53:39.853021] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T18:53:39.957995] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-17T18:53:40.445242] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T18:53:40.758020] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-17T18:53:41.558000] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-17T18:53:42.004076] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-17T18:53:42.344248] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-17T18:53:42.357989] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-17T18:53:43.106367] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T18:53:43.158026] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-17T18:53:43.958007] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-17T18:53:44.373590] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-17T18:53:44.491111] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T18:53:44.495081] [INFO ] [REMOTE ] FDP: Full fetch complete (42720 records). [2025-10-17T18:53:44.495162] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-17T18:53:44.764075] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-17T18:53:44.863301] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-17T18:53:44.863371] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-17T18:53:44.864032] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-17T18:53:44.864093] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-17T18:53:44.865020] [DEBUG] [LOCAL ] FDP: Trimmed 42720 records to 30199 (keeping 200 days of data) [2025-10-17T18:53:45.047395] [DEBUG] [LOCAL ] FDP: Primary data saved (30199 records). [2025-10-17T18:53:45.047527] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-17T18:53:45.048071] [INFO ] [MAIN ] Update Progress: 814/2368 symbols completed. FDP took 27.6s. Estimated remaining: 3h 37m 2s. Rate: 7.2 symbols/min [2025-10-17T18:53:45.212046] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:53:45.261364] [DEBUG] [LOCAL ] FE: Loaded 53822 existing records from primary storage. [2025-10-17T18:53:45.261684] [INFO ] [MAIN ] FE: Loaded 53822 existing records. [2025-10-17T18:53:45.437800] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:53:45.438034] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-17T18:53:45.438099] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-17T18:53:45.438462] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-17T18:53:45.438522] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-17T18:53:45.563100] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-17T18:53:45.811215] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:53:45.854487] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T18:53:46.022234] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T18:53:46.358027] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-17T18:53:47.158029] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-17T18:53:47.656769] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-17T18:53:47.731634] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T18:53:47.958028] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-17T18:53:48.758012] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-17T18:53:49.041278] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T18:53:49.104032] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T18:53:49.563129] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-17T18:53:49.573761] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T18:53:49.582585] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-17T18:53:49.582740] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-17T18:53:49.964972] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-17T18:53:49.965056] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-17T18:53:49.966023] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-17T18:53:49.966087] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-17T18:53:49.967557] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 54481 (keeping 200 days of data) [2025-10-17T18:53:50.316297] [DEBUG] [LOCAL ] FCX: Primary data saved (54481 records). [2025-10-17T18:53:50.316442] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-17T18:53:50.317336] [INFO ] [MAIN ] Update Progress: 815/2368 symbols completed. FCX took 45.6s. Estimated remaining: 3h 36m 48s. Rate: 7.2 symbols/min [2025-10-17T18:53:50.363135] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-17T18:53:50.489552] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:53:50.489738] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-17T18:53:50.489785] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-17T18:53:50.489895] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-17T18:53:50.489935] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-17T18:53:50.489976] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-17T18:53:50.490008] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-17T18:53:50.841118] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:53:51.158004] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-17T18:53:51.392055] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T18:53:51.466452] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T18:53:51.508241] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-17T18:53:51.958024] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-17T18:53:52.758076] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-17T18:53:53.316754] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T18:53:53.558028] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-17T18:53:54.358080] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-17T18:53:54.434323] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T18:53:54.782349] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-17T18:53:55.158030] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-17T18:53:55.197734] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T18:53:55.203380] [INFO ] [REMOTE ] FDS: Full fetch complete (38873 records). [2025-10-17T18:53:55.203472] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-17T18:53:55.565710] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-17T18:53:55.565798] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-17T18:53:55.566498] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-17T18:53:55.566540] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-17T18:53:55.567578] [DEBUG] [LOCAL ] FDS: Trimmed 38873 records to 28183 (keeping 200 days of data) [2025-10-17T18:53:55.751965] [DEBUG] [LOCAL ] FDS: Primary data saved (28183 records). [2025-10-17T18:53:55.752118] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-17T18:53:55.752204] [INFO ] [MAIN ] Update Progress: 816/2368 symbols completed. FDS took 30.4s. Estimated remaining: 3h 36m 34s. Rate: 7.2 symbols/min [2025-10-17T18:53:55.922155] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:53:55.958038] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-17T18:53:55.975384] [DEBUG] [LOCAL ] FERG: Loaded 49121 existing records from primary storage. [2025-10-17T18:53:55.975808] [INFO ] [MAIN ] FERG: Loaded 49121 existing records. [2025-10-17T18:53:56.154872] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:53:56.155121] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-17T18:53:56.155179] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-17T18:53:56.155539] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-17T18:53:56.155579] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-17T18:53:56.511988] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:53:56.731663] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T18:53:56.757986] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-17T18:53:57.558037] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-17T18:53:57.991607] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T18:53:58.022753] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-17T18:53:58.358004] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-17T18:53:58.615564] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T18:53:59.158041] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-17T18:53:59.958008] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-17T18:54:00.090732] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T18:54:00.483535] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-17T18:54:00.758033] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-17T18:54:01.395028] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-17T18:54:01.558035] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-17T18:54:01.585439] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-17T18:54:02.358079] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-17T18:54:03.158101] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-17T18:54:03.426121] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T18:54:03.451696] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-17T18:54:03.958043] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-17T18:54:04.382389] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T18:54:04.758101] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-17T18:54:05.115564] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-17T18:54:05.563185] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-17T18:54:05.581378] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T18:54:06.358048] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-17T18:54:07.158042] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-17T18:54:07.324685] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-17T18:54:07.485263] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-17T18:54:07.958013] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-17T18:54:08.102033] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T18:54:08.758069] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-17T18:54:09.558112] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-17T18:54:09.915719] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T18:54:10.082150] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-17T18:54:10.354359] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T18:54:10.362986] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-17T18:54:11.158036] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-17T18:54:11.958031] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-17T18:54:12.146320] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T18:54:12.758002] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-17T18:54:12.918263] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T18:54:13.235165] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-17T18:54:13.558003] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-17T18:54:13.950570] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T18:54:14.358035] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-17T18:54:14.841005] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-17T18:54:14.841823] [INFO ] [REMOTE ] FENG: Full fetch complete (2278 records). [2025-10-17T18:54:14.841890] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-17T18:54:15.022553] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T18:54:15.022756] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-17T18:54:15.022907] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-17T18:54:15.022982] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-17T18:54:15.023145] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-17T18:54:15.023213] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-17T18:54:15.023280] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-17T18:54:15.023469] [INFO ] [MAIN ] Update Progress: 817/2368 symbols completed. FENG took 24.7s. Estimated remaining: 3h 36m 46s. Rate: 7.2 symbols/min [2025-10-17T18:54:15.162058] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-17T18:54:15.195677] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:54:15.226480] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T18:54:15.246099] [DEBUG] [LOCAL ] FET: Loaded 12940 existing records from primary storage. [2025-10-17T18:54:15.246307] [INFO ] [MAIN ] FET: Loaded 12940 existing records. [2025-10-17T18:54:15.418235] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:54:15.418450] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-17T18:54:15.418504] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-17T18:54:15.418690] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-17T18:54:15.418746] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-17T18:54:15.764666] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:54:15.958004] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-17T18:54:16.758007] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-17T18:54:16.865254] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T18:54:17.256584] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-17T18:54:17.263760] [INFO ] [REMOTE ] FDX: Full fetch complete (74381 records). [2025-10-17T18:54:17.263909] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-17T18:54:17.559949] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-17T18:54:17.654067] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-17T18:54:17.654160] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-17T18:54:17.655091] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-17T18:54:17.655163] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-17T18:54:17.656708] [DEBUG] [LOCAL ] FDX: Trimmed 74381 records to 52099 (keeping 200 days of data) [2025-10-17T18:54:17.981741] [DEBUG] [LOCAL ] FDX: Primary data saved (52099 records). [2025-10-17T18:54:17.981930] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-17T18:54:17.982959] [INFO ] [MAIN ] Update Progress: 818/2368 symbols completed. FDX took 51.0s. Estimated remaining: 3h 36m 28s. Rate: 7.2 symbols/min [2025-10-17T18:54:18.150345] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:54:18.173696] [DEBUG] [LOCAL ] FF: Loaded 24506 existing records from primary storage. [2025-10-17T18:54:18.173949] [INFO ] [MAIN ] FF: Loaded 24506 existing records. [2025-10-17T18:54:18.304502] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T18:54:18.363530] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-17T18:54:18.395631] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:54:18.403130] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-17T18:54:18.404628] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T18:54:18.406661] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-17T18:54:18.408733] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-17T18:54:18.408793] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-17T18:54:18.760833] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:54:19.158017] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-17T18:54:19.958006] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-17T18:54:20.216682] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T18:54:20.511635] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T18:54:20.758009] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-17T18:54:21.049747] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T18:54:21.526316] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-17T18:54:21.557982] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-17T18:54:22.151387] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T18:54:22.358064] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-17T18:54:23.158027] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-17T18:54:23.499463] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T18:54:23.958007] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-17T18:54:24.188625] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T18:54:24.196959] [INFO ] [REMOTE ] FE: Full fetch complete (77470 records). [2025-10-17T18:54:24.197110] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-17T18:54:24.595112] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-17T18:54:24.595190] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-17T18:54:24.596191] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-17T18:54:24.596259] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-17T18:54:24.597792] [DEBUG] [LOCAL ] FE: Trimmed 77470 records to 54212 (keeping 200 days of data) [2025-10-17T18:54:24.775244] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-17T18:54:24.832547] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-17T18:54:24.939790] [DEBUG] [LOCAL ] FE: Primary data saved (54212 records). [2025-10-17T18:54:24.939931] [INFO ] [MAIN ] FE: Full history saved. [2025-10-17T18:54:24.940485] [INFO ] [MAIN ] Update Progress: 819/2368 symbols completed. FE took 39.9s. Estimated remaining: 3h 36m 16s. Rate: 7.2 symbols/min [2025-10-17T18:54:25.110301] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:54:25.119716] [DEBUG] [LOCAL ] FFA: Loaded 5963 existing records from primary storage. [2025-10-17T18:54:25.119944] [INFO ] [MAIN ] FFA: Loaded 5963 existing records. [2025-10-17T18:54:25.297361] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:54:25.297555] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-17T18:54:25.297603] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-17T18:54:25.297787] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-17T18:54:25.297844] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-17T18:54:25.563158] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-17T18:54:25.658136] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:54:25.952095] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T18:54:26.358074] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-17T18:54:26.488605] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T18:54:27.158028] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-17T18:54:27.958003] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-17T18:54:28.068229] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T18:54:28.136253] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T18:54:28.758083] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-17T18:54:29.300920] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T18:54:29.313624] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T18:54:29.558021] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-17T18:54:30.135610] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-17T18:54:30.358029] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-17T18:54:31.062607] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-17T18:54:31.158028] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-17T18:54:31.958020] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-17T18:54:32.175940] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-17T18:54:32.758045] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-17T18:54:32.796183] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T18:54:33.174419] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-17T18:54:33.558044] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-17T18:54:34.358009] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-17T18:54:35.148553] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T18:54:35.158007] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-17T18:54:35.742626] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T18:54:35.908782] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-17T18:54:35.958011] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-17T18:54:36.758031] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-17T18:54:37.558070] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-17T18:54:37.704235] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T18:54:37.914497] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T18:54:38.169316] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-17T18:54:38.358070] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-17T18:54:39.133420] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-17T18:54:39.158023] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-17T18:54:39.958013] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-17T18:54:40.099828] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-17T18:54:40.603374] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-17T18:54:40.758057] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-17T18:54:41.558072] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-17T18:54:42.020691] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T18:54:42.323106] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T18:54:42.358065] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-17T18:54:43.109626] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-17T18:54:43.111527] [INFO ] [REMOTE ] FFA: Full fetch complete (8739 records). [2025-10-17T18:54:43.111614] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-17T18:54:43.167833] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-17T18:54:43.489337] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-17T18:54:43.489467] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-17T18:54:43.489884] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-17T18:54:43.489961] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-17T18:54:43.490978] [DEBUG] [LOCAL ] FFA: Trimmed 8739 records to 5984 (keeping 200 days of data) [2025-10-17T18:54:43.533340] [DEBUG] [LOCAL ] FFA: Primary data saved (5984 records). [2025-10-17T18:54:43.533531] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-17T18:54:43.533677] [INFO ] [MAIN ] Update Progress: 820/2368 symbols completed. FFA took 18.6s. Estimated remaining: 3h 36m 27s. Rate: 7.2 symbols/min [2025-10-17T18:54:43.708964] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:54:43.729237] [DEBUG] [LOCAL ] FFC: Loaded 16818 existing records from primary storage. [2025-10-17T18:54:43.729579] [INFO ] [MAIN ] FFC: Loaded 16818 existing records. [2025-10-17T18:54:43.917341] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:54:43.917753] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-17T18:54:43.917829] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-17T18:54:43.918165] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-17T18:54:43.918242] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-17T18:54:43.963306] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-17T18:54:44.289484] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:54:44.301712] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T18:54:44.758096] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-17T18:54:45.558043] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-17T18:54:45.830685] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T18:54:46.165201] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-17T18:54:46.172164] [INFO ] [REMOTE ] FERG: Full fetch complete (71149 records). [2025-10-17T18:54:46.172309] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-17T18:54:46.365414] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-17T18:54:46.483708] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T18:54:46.579538] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-17T18:54:46.579617] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-17T18:54:46.580536] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-17T18:54:46.580596] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-17T18:54:46.581972] [DEBUG] [LOCAL ] FERG: Trimmed 71149 records to 49492 (keeping 200 days of data) [2025-10-17T18:54:46.885932] [DEBUG] [LOCAL ] FERG: Primary data saved (49492 records). [2025-10-17T18:54:46.886066] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-17T18:54:46.886161] [INFO ] [MAIN ] Update Progress: 821/2368 symbols completed. FERG took 51.1s. Estimated remaining: 3h 36m 9s. Rate: 7.2 symbols/min [2025-10-17T18:54:47.051494] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:54:47.084318] [DEBUG] [LOCAL ] FFWM: Loaded 36234 existing records from primary storage. [2025-10-17T18:54:47.084588] [INFO ] [MAIN ] FFWM: Loaded 36234 existing records. [2025-10-17T18:54:47.160168] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-17T18:54:47.260137] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:54:47.260372] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-17T18:54:47.260424] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-17T18:54:47.260605] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-17T18:54:47.260685] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-17T18:54:47.513693] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T18:54:47.628282] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:54:47.957993] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-17T18:54:48.285261] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T18:54:48.758030] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-17T18:54:48.915913] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T18:54:49.558049] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-17T18:54:50.160678] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T18:54:50.358020] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-17T18:54:50.621711] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-17T18:54:51.158063] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-17T18:54:51.445717] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T18:54:51.958000] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-17T18:54:52.106376] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-17T18:54:52.758052] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-17T18:54:53.290335] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T18:54:53.558004] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-17T18:54:53.725305] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-17T18:54:53.727760] [INFO ] [REMOTE ] FET: Full fetch complete (18415 records). [2025-10-17T18:54:53.727833] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-17T18:54:54.120574] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-17T18:54:54.120673] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-17T18:54:54.121093] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-17T18:54:54.121152] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-17T18:54:54.121692] [DEBUG] [LOCAL ] FET: Trimmed 18415 records to 13043 (keeping 200 days of data) [2025-10-17T18:54:54.195582] [DEBUG] [LOCAL ] FET: Primary data saved (13043 records). [2025-10-17T18:54:54.195749] [INFO ] [MAIN ] FET: Full history saved. [2025-10-17T18:54:54.195838] [INFO ] [MAIN ] Update Progress: 822/2368 symbols completed. FET took 39.2s. Estimated remaining: 3h 35m 59s. Rate: 7.2 symbols/min [2025-10-17T18:54:54.361879] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-17T18:54:54.361781] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:54:54.387714] [DEBUG] [LOCAL ] FG: Loaded 22335 existing records from primary storage. [2025-10-17T18:54:54.387997] [INFO ] [MAIN ] FG: Loaded 22335 existing records. [2025-10-17T18:54:54.562287] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:54:54.562564] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-17T18:54:54.562615] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-17T18:54:54.562974] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-17T18:54:54.563029] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-17T18:54:54.922606] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:54:54.962108] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T18:54:55.127872] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-17T18:54:55.158074] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-17T18:54:55.926773] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T18:54:55.958073] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-17T18:54:56.758038] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-17T18:54:56.794681] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T18:54:57.558020] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-17T18:54:57.716608] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-17T18:54:58.358038] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-17T18:54:58.370514] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T18:54:59.000160] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-17T18:54:59.158030] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-17T18:54:59.958047] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-17T18:55:00.149426] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T18:55:00.758027] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-17T18:55:01.312734] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-17T18:55:01.316401] [INFO ] [REMOTE ] FF: Full fetch complete (36590 records). [2025-10-17T18:55:01.316505] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-17T18:55:01.563259] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-17T18:55:01.719918] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-17T18:55:01.720018] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-17T18:55:01.720971] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-17T18:55:01.721048] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-17T18:55:01.722195] [DEBUG] [LOCAL ] FF: Trimmed 36590 records to 24686 (keeping 200 days of data) [2025-10-17T18:55:01.882227] [DEBUG] [LOCAL ] FF: Primary data saved (24686 records). [2025-10-17T18:55:01.882385] [INFO ] [MAIN ] FF: Full history saved. [2025-10-17T18:55:01.882475] [INFO ] [MAIN ] Update Progress: 823/2368 symbols completed. FF took 43.9s. Estimated remaining: 3h 35m 49s. Rate: 7.2 symbols/min [2025-10-17T18:55:02.070311] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:55:02.078451] [DEBUG] [LOCAL ] FGN: Loaded 3741 existing records from primary storage. [2025-10-17T18:55:02.078727] [INFO ] [MAIN ] FGN: Loaded 3741 existing records. [2025-10-17T18:55:02.275869] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:55:02.276127] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-17T18:55:02.276203] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-17T18:55:02.276377] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-17T18:55:02.276444] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-17T18:55:02.368226] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-17T18:55:02.667699] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:55:03.110549] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T18:55:03.158024] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-17T18:55:03.267122] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-17T18:55:03.450858] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-17T18:55:03.783040] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-17T18:55:03.958014] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-17T18:55:04.532812] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-17T18:55:04.758152] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-17T18:55:05.558042] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-17T18:55:05.845795] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T18:55:06.358028] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-17T18:55:07.073194] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T18:55:07.158027] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-17T18:55:07.739438] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T18:55:07.957991] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-17T18:55:08.270143] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T18:55:08.758024] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-17T18:55:09.211048] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T18:55:09.343119] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T18:55:09.558032] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-17T18:55:10.358007] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-17T18:55:10.633014] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T18:55:10.635665] [INFO ] [REMOTE ] FFC: Full fetch complete (24497 records). [2025-10-17T18:55:10.635767] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-17T18:55:11.036317] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-17T18:55:11.036407] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-17T18:55:11.037012] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-17T18:55:11.037077] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-17T18:55:11.037794] [DEBUG] [LOCAL ] FFC: Trimmed 24497 records to 16896 (keeping 200 days of data) [2025-10-17T18:55:11.146755] [DEBUG] [LOCAL ] FFC: Primary data saved (16896 records). [2025-10-17T18:55:11.146910] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-17T18:55:11.147001] [INFO ] [MAIN ] Update Progress: 824/2368 symbols completed. FFC took 27.6s. Estimated remaining: 3h 35m 43s. Rate: 7.2 symbols/min [2025-10-17T18:55:11.163114] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-17T18:55:11.337793] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:55:11.337981] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-17T18:55:11.338020] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-17T18:55:11.338130] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-17T18:55:11.338191] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-17T18:55:11.338245] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-17T18:55:11.338282] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-17T18:55:11.738984] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:55:11.920738] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T18:55:11.957981] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-17T18:55:12.192287] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:55:12.192633] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-17T18:55:12.192787] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:55:12.192859] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-17T18:55:12.192931] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:55:12.193006] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-17T18:55:12.193073] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-17T18:55:12.193113] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-17T18:55:12.193153] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-17T18:55:12.193200] [INFO ] [MAIN ] Update Progress: 825/2368 symbols completed. FGSN took 1.0s. Estimated remaining: 3h 35m 21s. Rate: 7.2 symbols/min [2025-10-17T18:55:12.335638] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-17T18:55:12.396197] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:55:12.438567] [DEBUG] [LOCAL ] FHI: Loaded 40215 existing records from primary storage. [2025-10-17T18:55:12.438918] [INFO ] [MAIN ] FHI: Loaded 40215 existing records. [2025-10-17T18:55:12.639270] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:55:12.639520] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-17T18:55:12.639577] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-17T18:55:12.639865] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-17T18:55:12.639935] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-17T18:55:12.763133] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-17T18:55:13.018520] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:55:13.433446] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-17T18:55:13.558023] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-17T18:55:14.358026] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-17T18:55:14.879177] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T18:55:14.952998] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-17T18:55:15.158038] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-17T18:55:15.958101] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-17T18:55:16.480194] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-17T18:55:16.623901] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T18:55:16.758011] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-17T18:55:17.558039] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-17T18:55:18.157930] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T18:55:18.358007] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-17T18:55:18.562715] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-17T18:55:19.158018] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-17T18:55:19.509447] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T18:55:19.764599] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-17T18:55:19.958051] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-17T18:55:20.494486] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-17T18:55:20.758059] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-17T18:55:21.558041] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-17T18:55:22.272146] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T18:55:22.358013] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-17T18:55:22.559891] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-17T18:55:22.949513] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-17T18:55:23.158057] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-17T18:55:23.654101] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-17T18:55:23.958028] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-17T18:55:24.758072] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-17T18:55:25.045611] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T18:55:25.558045] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-17T18:55:26.130765] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T18:55:26.358013] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-17T18:55:26.505964] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T18:55:26.506900] [INFO ] [REMOTE ] FGN: Full fetch complete (5586 records). [2025-10-17T18:55:26.506970] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-17T18:55:26.864620] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-17T18:55:26.864734] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-17T18:55:26.864917] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-17T18:55:26.864977] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-17T18:55:26.865388] [DEBUG] [LOCAL ] FGN: Trimmed 5586 records to 3750 (keeping 200 days of data) [2025-10-17T18:55:26.887997] [DEBUG] [LOCAL ] FGN: Primary data saved (3750 records). [2025-10-17T18:55:26.888071] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-17T18:55:26.888169] [INFO ] [MAIN ] Update Progress: 826/2368 symbols completed. FGN took 25.0s. Estimated remaining: 3h 35m 24s. Rate: 7.2 symbols/min [2025-10-17T18:55:27.053896] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:55:27.054031] [DEBUG] [LOCAL ] FHN: No existing data file found in primary storage. [2025-10-17T18:55:27.054069] [WARN ] [MAIN ] FHN: No existing data found, performing full refresh instead. [2025-10-17T18:55:27.054195] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-17T18:55:27.054241] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-17T18:55:27.054283] [DEBUG] [LOCAL ] FHN: No primary data file found to delete. [2025-10-17T18:55:27.054317] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-17T18:55:27.163085] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-17T18:55:27.405142] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:55:27.429590] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T18:55:27.432989] [INFO ] [REMOTE ] FG: Full fetch complete (28779 records). [2025-10-17T18:55:27.433066] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-17T18:55:27.790767] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-17T18:55:27.790844] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-17T18:55:27.791384] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-17T18:55:27.791424] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-17T18:55:27.792126] [DEBUG] [LOCAL ] FG: Trimmed 28779 records to 22484 (keeping 200 days of data) [2025-10-17T18:55:27.929861] [DEBUG] [LOCAL ] FG: Primary data saved (22484 records). [2025-10-17T18:55:27.929987] [INFO ] [MAIN ] FG: Full history saved. [2025-10-17T18:55:27.930063] [INFO ] [MAIN ] Update Progress: 827/2368 symbols completed. FG took 33.7s. Estimated remaining: 3h 35m 2s. Rate: 7.2 symbols/min [2025-10-17T18:55:27.961233] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-17T18:55:28.097355] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:55:28.159339] [DEBUG] [LOCAL ] FI: Loaded 53970 existing records from primary storage. [2025-10-17T18:55:28.159716] [INFO ] [MAIN ] FI: Loaded 53970 existing records. [2025-10-17T18:55:28.334261] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:55:28.334463] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-17T18:55:28.334510] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-17T18:55:28.334819] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-17T18:55:28.334875] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-17T18:55:28.682395] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:55:28.762983] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-17T18:55:28.764868] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-17T18:55:28.770299] [INFO ] [REMOTE ] FFWM: Full fetch complete (51931 records). [2025-10-17T18:55:28.770397] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-17T18:55:29.136903] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-17T18:55:29.136980] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-17T18:55:29.137783] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-17T18:55:29.137846] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-17T18:55:29.138943] [DEBUG] [LOCAL ] FFWM: Trimmed 51931 records to 36515 (keeping 200 days of data) [2025-10-17T18:55:29.336536] [DEBUG] [LOCAL ] FFWM: Primary data saved (36515 records). [2025-10-17T18:55:29.336697] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-17T18:55:29.336803] [INFO ] [MAIN ] Update Progress: 828/2368 symbols completed. FFWM took 42.5s. Estimated remaining: 3h 34m 41s. Rate: 7.2 symbols/min [2025-10-17T18:55:29.505979] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:55:29.528877] [DEBUG] [LOCAL ] FICO: Loaded 21912 existing records from primary storage. [2025-10-17T18:55:29.529140] [INFO ] [MAIN ] FICO: Loaded 21912 existing records. [2025-10-17T18:55:29.570707] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-17T18:55:29.706865] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:55:29.707108] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-17T18:55:29.707298] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-17T18:55:29.707537] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-17T18:55:29.707593] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-17T18:55:29.910127] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-17T18:55:30.099993] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:55:30.357996] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-17T18:55:30.422226] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T18:55:31.165353] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-17T18:55:31.182504] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T18:55:31.251558] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-17T18:55:31.958067] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-17T18:55:32.758008] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-17T18:55:33.019746] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T18:55:33.557999] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-17T18:55:33.630276] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T18:55:34.260072] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T18:55:34.358018] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-17T18:55:34.966369] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T18:55:35.158018] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-17T18:55:35.958021] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-17T18:55:36.251357] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T18:55:36.758040] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-17T18:55:36.903628] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T18:55:37.551178] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T18:55:37.559418] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-17T18:55:37.885119] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T18:55:38.358039] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-17T18:55:39.158022] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-17T18:55:39.402491] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T18:55:39.888223] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-17T18:55:39.958952] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T18:55:39.959029] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-17T18:55:40.758097] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-17T18:55:41.558015] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-17T18:55:41.785205] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T18:55:42.273206] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T18:55:42.358039] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-17T18:55:43.158055] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-17T18:55:43.766740] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-17T18:55:43.918110] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T18:55:43.957989] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-17T18:55:44.202975] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T18:55:44.758083] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-17T18:55:45.457590] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T18:55:45.463023] [INFO ] [REMOTE ] FHI: Full fetch complete (57712 records). [2025-10-17T18:55:45.463191] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-17T18:55:45.563232] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-17T18:55:45.842293] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-17T18:55:45.842368] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-17T18:55:45.843141] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-17T18:55:45.843202] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-17T18:55:45.844303] [DEBUG] [LOCAL ] FHI: Trimmed 57712 records to 40432 (keeping 200 days of data) [2025-10-17T18:55:46.084251] [DEBUG] [LOCAL ] FHI: Primary data saved (40432 records). [2025-10-17T18:55:46.084415] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-17T18:55:46.084508] [INFO ] [MAIN ] Update Progress: 829/2368 symbols completed. FHI took 33.9s. Estimated remaining: 3h 34m 48s. Rate: 7.2 symbols/min [2025-10-17T18:55:46.259391] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:55:46.259563] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-17T18:55:46.259601] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-17T18:55:46.259737] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-17T18:55:46.259780] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-17T18:55:46.259819] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-17T18:55:46.259851] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-17T18:55:46.363251] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-17T18:55:46.614596] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:55:46.716686] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T18:55:46.784525] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T18:55:47.158026] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-17T18:55:47.958019] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-17T18:55:48.132170] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T18:55:48.757999] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-17T18:55:49.121241] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-17T18:55:49.355435] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T18:55:49.558013] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-17T18:55:50.256700] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T18:55:50.357994] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-17T18:55:50.626276] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T18:55:50.677776] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-17T18:55:51.158037] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-17T18:55:51.384527] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-17T18:55:51.958025] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-17T18:55:52.758031] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-17T18:55:53.330470] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-17T18:55:53.558032] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-17T18:55:54.357997] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-17T18:55:54.921665] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-17T18:55:55.157998] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-17T18:55:55.411766] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T18:55:55.617933] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-17T18:55:55.958006] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-17T18:55:56.758026] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-17T18:55:57.066007] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-17T18:55:57.127594] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-17T18:55:57.178898] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T18:55:57.558021] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-17T18:55:57.851048] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-17T18:55:58.358024] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-17T18:55:59.158035] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-17T18:55:59.958009] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-17T18:56:00.309462] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T18:56:00.360046] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-17T18:56:00.758009] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-17T18:56:00.772494] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T18:56:00.776737] [INFO ] [REMOTE ] FICO: Full fetch complete (29941 records). [2025-10-17T18:56:00.776827] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-17T18:56:01.195930] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-17T18:56:01.196233] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-17T18:56:01.196983] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-17T18:56:01.197067] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-17T18:56:01.197912] [DEBUG] [LOCAL ] FICO: Trimmed 29941 records to 22042 (keeping 200 days of data) [2025-10-17T18:56:01.310068] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-17T18:56:01.344423] [DEBUG] [LOCAL ] FICO: Primary data saved (22042 records). [2025-10-17T18:56:01.344545] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-17T18:56:01.344627] [INFO ] [MAIN ] Update Progress: 830/2368 symbols completed. FICO took 32.0s. Estimated remaining: 3h 34m 52s. Rate: 7.2 symbols/min [2025-10-17T18:56:01.518983] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:56:01.560582] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-17T18:56:01.562421] [DEBUG] [LOCAL ] FIGS: Loaded 48947 existing records from primary storage. [2025-10-17T18:56:01.562859] [INFO ] [MAIN ] FIGS: Loaded 48947 existing records. [2025-10-17T18:56:01.742433] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:56:01.742700] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-17T18:56:01.742758] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-17T18:56:01.743019] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-17T18:56:01.743059] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-17T18:56:02.131857] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:56:02.163096] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:56:02.163610] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-17T18:56:02.163741] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:56:02.163878] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-17T18:56:02.163951] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:56:02.164029] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-17T18:56:02.164107] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-17T18:56:02.164148] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-17T18:56:02.164188] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-17T18:56:02.164242] [INFO ] [MAIN ] Update Progress: 831/2368 symbols completed. FIG took 16.1s. Estimated remaining: 3h 34m 30s. Rate: 7.2 symbols/min [2025-10-17T18:56:02.336659] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:56:02.358040] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-17T18:56:02.375738] [DEBUG] [LOCAL ] FIHL: Loaded 39714 existing records from primary storage. [2025-10-17T18:56:02.376026] [INFO ] [MAIN ] FIHL: Loaded 39714 existing records. [2025-10-17T18:56:02.547249] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:56:02.547460] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-17T18:56:02.547508] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-17T18:56:02.547708] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-17T18:56:02.547765] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-17T18:56:02.892090] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:56:03.158034] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-17T18:56:03.958115] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-17T18:56:04.081870] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T18:56:04.758133] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-17T18:56:04.978518] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T18:56:05.257600] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T18:56:05.558026] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-17T18:56:06.358001] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-17T18:56:06.602759] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T18:56:06.610236] [INFO ] [REMOTE ] FI: Full fetch complete (77457 records). [2025-10-17T18:56:06.610407] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-17T18:56:06.994602] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-17T18:56:06.994758] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-17T18:56:06.995700] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-17T18:56:06.995764] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-17T18:56:06.997194] [DEBUG] [LOCAL ] FI: Trimmed 77457 records to 54357 (keeping 200 days of data) [2025-10-17T18:56:07.168228] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-17T18:56:07.333961] [DEBUG] [LOCAL ] FI: Primary data saved (54357 records). [2025-10-17T18:56:07.334261] [INFO ] [MAIN ] FI: Full history saved. [2025-10-17T18:56:07.334987] [INFO ] [MAIN ] Update Progress: 832/2368 symbols completed. FI took 39.4s. Estimated remaining: 3h 34m 16s. Rate: 7.2 symbols/min [2025-10-17T18:56:07.561094] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:56:07.563789] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-17T18:56:07.598877] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T18:56:07.610165] [DEBUG] [LOCAL ] FINS: Loaded 8363 existing records from primary storage. [2025-10-17T18:56:07.610417] [INFO ] [MAIN ] FINS: Loaded 8363 existing records. [2025-10-17T18:56:07.803232] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:56:07.803739] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-17T18:56:07.803801] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-17T18:56:07.803991] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-17T18:56:07.804049] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-17T18:56:07.963205] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-17T18:56:08.197091] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:56:08.517049] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T18:56:08.758027] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-17T18:56:09.558059] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-17T18:56:09.930976] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-17T18:56:09.938497] [INFO ] [REMOTE ] FHN: Full fetch complete (77472 records). [2025-10-17T18:56:09.938637] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-17T18:56:10.365338] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-17T18:56:10.370788] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-17T18:56:10.373405] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:56:10.373691] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-17T18:56:10.382281] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-17T18:56:10.382771] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-17T18:56:10.385323] [DEBUG] [LOCAL ] FHN: Trimmed 77472 records to 54172 (keeping 200 days of data) [2025-10-17T18:56:10.516820] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-17T18:56:10.737289] [DEBUG] [LOCAL ] FHN: Primary data saved (54172 records). [2025-10-17T18:56:10.737443] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-17T18:56:10.737518] [INFO ] [MAIN ] Update Progress: 833/2368 symbols completed. FHN took 43.8s. Estimated remaining: 3h 33m 58s. Rate: 7.2 symbols/min [2025-10-17T18:56:10.901600] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:56:10.941740] [DEBUG] [LOCAL ] FINV: Loaded 45609 existing records from primary storage. [2025-10-17T18:56:10.942061] [INFO ] [MAIN ] FINV: Loaded 45609 existing records. [2025-10-17T18:56:11.112543] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:56:11.112785] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-17T18:56:11.112832] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-17T18:56:11.113063] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-17T18:56:11.113119] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-17T18:56:11.165789] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-17T18:56:11.462395] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:56:11.958021] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-17T18:56:12.003447] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T18:56:12.036305] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T18:56:12.758043] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-17T18:56:13.306890] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T18:56:13.558008] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-17T18:56:14.218887] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-17T18:56:14.241022] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T18:56:14.358042] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-17T18:56:15.158040] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-17T18:56:15.896684] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T18:56:15.957991] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-17T18:56:16.757997] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-17T18:56:16.844382] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T18:56:17.320293] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T18:56:17.429832] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-17T18:56:17.558054] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-17T18:56:18.358083] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-17T18:56:19.002810] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T18:56:19.158072] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-17T18:56:19.781748] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T18:56:19.958039] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-17T18:56:20.758024] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-17T18:56:20.857807] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T18:56:21.384160] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T18:56:21.558013] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-17T18:56:21.946985] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T18:56:22.358030] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-17T18:56:23.091536] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-17T18:56:23.160170] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-17T18:56:23.162925] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-17T18:56:23.963685] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-17T18:56:23.965997] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T18:56:24.758048] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-17T18:56:25.469212] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T18:56:25.558016] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-17T18:56:26.340038] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T18:56:26.357980] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-17T18:56:27.060122] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T18:56:27.158030] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-17T18:56:27.958011] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-17T18:56:28.174427] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T18:56:28.616118] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T18:56:28.621613] [INFO ] [REMOTE ] FIHL: Full fetch complete (56385 records). [2025-10-17T18:56:28.621763] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-17T18:56:28.763344] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-17T18:56:29.007076] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-17T18:56:29.007159] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-17T18:56:29.007968] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-17T18:56:29.008034] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-17T18:56:29.009223] [DEBUG] [LOCAL ] FIHL: Trimmed 56385 records to 39982 (keeping 200 days of data) [2025-10-17T18:56:29.251384] [DEBUG] [LOCAL ] FIHL: Primary data saved (39982 records). [2025-10-17T18:56:29.251518] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-17T18:56:29.252021] [INFO ] [MAIN ] Update Progress: 834/2368 symbols completed. FIHL took 27.1s. Estimated remaining: 3h 34m 8s. Rate: 7.2 symbols/min [2025-10-17T18:56:29.417461] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:56:29.468959] [DEBUG] [LOCAL ] FIS: Loaded 53727 existing records from primary storage. [2025-10-17T18:56:29.469273] [INFO ] [MAIN ] FIS: Loaded 53727 existing records. [2025-10-17T18:56:29.562993] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-17T18:56:29.654411] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:56:29.654955] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-17T18:56:29.655168] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-17T18:56:29.655614] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-17T18:56:29.655748] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-17T18:56:29.778589] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T18:56:30.046959] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:56:30.339608] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-17T18:56:30.357993] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-17T18:56:30.413446] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T18:56:31.091569] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-17T18:56:31.158022] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-17T18:56:31.855674] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-17T18:56:31.957999] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-17T18:56:32.746625] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T18:56:32.758013] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-17T18:56:33.554530] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T18:56:33.555981] [INFO ] [REMOTE ] FINS: Full fetch complete (11621 records). [2025-10-17T18:56:33.556051] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-17T18:56:33.567245] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-17T18:56:33.923826] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-17T18:56:33.923918] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-17T18:56:33.924216] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-17T18:56:33.924260] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-17T18:56:33.924756] [DEBUG] [LOCAL ] FINS: Trimmed 11621 records to 8404 (keeping 200 days of data) [2025-10-17T18:56:33.977098] [DEBUG] [LOCAL ] FINS: Primary data saved (8404 records). [2025-10-17T18:56:33.977258] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-17T18:56:33.977365] [INFO ] [MAIN ] Update Progress: 835/2368 symbols completed. FINS took 26.6s. Estimated remaining: 3h 33m 53s. Rate: 7.2 symbols/min [2025-10-17T18:56:34.148325] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:56:34.179049] [DEBUG] [LOCAL ] FIX: Loaded 29033 existing records from primary storage. [2025-10-17T18:56:34.179311] [INFO ] [MAIN ] FIX: Loaded 29033 existing records. [2025-10-17T18:56:34.354842] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:56:34.355087] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-17T18:56:34.355137] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-17T18:56:34.355355] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-17T18:56:34.355413] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-17T18:56:34.366696] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-17T18:56:34.717809] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:56:35.158035] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-17T18:56:35.396173] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T18:56:35.958042] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-17T18:56:36.444131] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-17T18:56:36.471409] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T18:56:36.758023] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-17T18:56:37.558099] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-17T18:56:37.593816] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T18:56:38.205065] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T18:56:38.358040] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-17T18:56:39.158053] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-17T18:56:39.725713] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-17T18:56:39.865861] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T18:56:39.958040] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-17T18:56:40.590496] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T18:56:40.758015] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-17T18:56:41.558024] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-17T18:56:41.732490] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T18:56:41.742739] [INFO ] [REMOTE ] FIGS: Full fetch complete (70879 records). [2025-10-17T18:56:41.742881] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-17T18:56:42.125860] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-17T18:56:42.126043] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-17T18:56:42.126949] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-17T18:56:42.127023] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-17T18:56:42.128442] [DEBUG] [LOCAL ] FIGS: Trimmed 70879 records to 49320 (keeping 200 days of data) [2025-10-17T18:56:42.230829] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T18:56:42.358678] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-17T18:56:42.426532] [DEBUG] [LOCAL ] FIGS: Primary data saved (49320 records). [2025-10-17T18:56:42.426684] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-17T18:56:42.426777] [INFO ] [MAIN ] Update Progress: 836/2368 symbols completed. FIGS took 41.1s. Estimated remaining: 3h 33m 45s. Rate: 7.2 symbols/min [2025-10-17T18:56:42.596287] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:56:42.596452] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-17T18:56:42.596494] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-17T18:56:42.596603] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-17T18:56:42.596694] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-17T18:56:42.596778] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-17T18:56:42.596831] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-17T18:56:42.952734] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:56:42.983919] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T18:56:43.158022] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-17T18:56:43.958049] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-17T18:56:44.036271] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T18:56:44.159530] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:56:44.159953] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-17T18:56:44.160073] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:56:44.160168] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-17T18:56:44.160253] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:56:44.160344] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-17T18:56:44.160438] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-17T18:56:44.160498] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-17T18:56:44.160561] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-17T18:56:44.160629] [INFO ] [MAIN ] Update Progress: 837/2368 symbols completed. FIXT took 1.7s. Estimated remaining: 3h 33m 25s. Rate: 7.2 symbols/min [2025-10-17T18:56:44.629849] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T18:56:44.758021] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-17T18:56:45.558035] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-17T18:56:46.358023] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-17T18:56:46.461036] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T18:56:47.158007] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-17T18:56:47.402181] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T18:56:47.958043] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-17T18:56:47.994515] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T18:56:48.758040] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-17T18:56:48.825959] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T18:56:49.558003] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-17T18:56:49.897207] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-17T18:56:50.358032] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-17T18:56:50.388097] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T18:56:51.158001] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-17T18:56:51.251765] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T18:56:51.258593] [INFO ] [REMOTE ] FINV: Full fetch complete (64712 records). [2025-10-17T18:56:51.258733] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-17T18:56:51.687825] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-17T18:56:51.687905] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-17T18:56:51.688893] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-17T18:56:51.688959] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-17T18:56:51.690477] [DEBUG] [LOCAL ] FINV: Trimmed 64712 records to 45943 (keeping 200 days of data) [2025-10-17T18:56:51.964269] [DEBUG] [LOCAL ] FINV: Primary data saved (45943 records). [2025-10-17T18:56:51.964449] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-17T18:56:51.964687] [INFO ] [MAIN ] Update Progress: 838/2368 symbols completed. FINV took 41.2s. Estimated remaining: 3h 33m 15s. Rate: 7.2 symbols/min [2025-10-17T18:56:52.060970] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T18:56:52.072768] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-17T18:56:52.559587] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T18:56:52.758105] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-17T18:56:53.978920] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T18:56:53.994672] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-17T18:56:54.046113] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T18:56:54.358055] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-17T18:56:55.745075] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T18:56:55.751816] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-17T18:56:55.787335] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T18:56:55.958013] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-17T18:56:57.138541] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T18:56:57.145299] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-17T18:56:57.840735] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T18:56:57.852268] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-17T18:56:58.431855] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T18:56:58.438457] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-17T18:56:58.717962] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T18:56:58.726159] [INFO ] [REMOTE ] FIS: Full fetch complete (77393 records). [2025-10-17T18:56:58.726387] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-17T18:56:59.127336] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-17T18:56:59.127458] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-17T18:56:59.128479] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-17T18:56:59.128551] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-17T18:56:59.130700] [DEBUG] [LOCAL ] FIS: Trimmed 77393 records to 54114 (keeping 200 days of data) [2025-10-17T18:56:59.478934] [DEBUG] [LOCAL ] FIS: Primary data saved (54114 records). [2025-10-17T18:56:59.479162] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-17T18:56:59.479991] [INFO ] [MAIN ] Update Progress: 839/2368 symbols completed. FIS took 30.2s. Estimated remaining: 3h 33m 5s. Rate: 7.2 symbols/min [2025-10-17T18:56:59.586069] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T18:56:59.590315] [INFO ] [REMOTE ] FIX: Full fetch complete (45584 records). [2025-10-17T18:56:59.590399] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-17T18:56:59.955344] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-17T18:56:59.955418] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-17T18:56:59.956020] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-17T18:56:59.956081] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-17T18:56:59.956979] [DEBUG] [LOCAL ] FIX: Trimmed 45584 records to 29256 (keeping 200 days of data) [2025-10-17T18:57:00.141003] [DEBUG] [LOCAL ] FIX: Primary data saved (29256 records). [2025-10-17T18:57:00.141178] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-17T18:57:00.141314] [INFO ] [MAIN ] Update Progress: 840/2368 symbols completed. FIX took 26.2s. Estimated remaining: 3h 32m 43s. Rate: 7.2 symbols/min [2025-10-17T18:57:00.828359] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:00.826806] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:00.914730] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:00.952870] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:00.963430] [DEBUG] [LOCAL ] FLC: Loaded 5440 existing records from primary storage. [2025-10-17T18:57:00.963865] [INFO ] [MAIN ] FLC: Loaded 5440 existing records. [2025-10-17T18:57:01.105403] [DEBUG] [LOCAL ] FLNG: Loaded 33918 existing records from primary storage. [2025-10-17T18:57:01.145005] [INFO ] [MAIN ] FLNG: Loaded 33918 existing records. [2025-10-17T18:57:01.245105] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:01.259355] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-17T18:57:01.299092] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-17T18:57:01.324899] [DEBUG] [LOCAL ] FLG: Loaded 53717 existing records from primary storage. [2025-10-17T18:57:01.332072] [DEBUG] [LOCAL ] FLO: Loaded 52459 existing records from primary storage. [2025-10-17T18:57:01.348568] [INFO ] [MAIN ] FLG: Loaded 53717 existing records. [2025-10-17T18:57:01.362570] [INFO ] [MAIN ] FLO: Loaded 52459 existing records. [2025-10-17T18:57:01.354426] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-17T18:57:01.363180] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-17T18:57:01.748998] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:01.836879] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-17T18:57:01.842431] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-17T18:57:01.847947] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-17T18:57:01.849078] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-17T18:57:02.142458] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:02.186127] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-17T18:57:02.199708] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-17T18:57:02.281438] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:02.305966] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-17T18:57:02.328233] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-17T18:57:02.352190] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-17T18:57:02.366881] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-17T18:57:02.411594] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-17T18:57:02.496378] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-17T18:57:02.825799] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:02.874096] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-17T18:57:03.237594] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:03.264447] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-17T18:57:03.483089] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:03.494279] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-17T18:57:03.555723] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:03.556096] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-17T18:57:03.647425] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T18:57:03.649663] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-17T18:57:04.303671] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T18:57:04.305802] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-17T18:57:04.780925] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T18:57:04.789253] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-17T18:57:04.891283] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T18:57:04.894405] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T18:57:04.907915] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-17T18:57:05.373573] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T18:57:05.558064] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-17T18:57:05.905972] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T18:57:06.358080] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-17T18:57:06.633304] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T18:57:07.158049] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-17T18:57:07.306308] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T18:57:07.771875] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T18:57:07.958002] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-17T18:57:08.584138] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T18:57:08.758020] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-17T18:57:09.454297] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-17T18:57:09.557990] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-17T18:57:09.890911] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-17T18:57:10.253719] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-17T18:57:10.358014] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-17T18:57:11.158025] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-17T18:57:11.958069] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-17T18:57:12.182295] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T18:57:12.540952] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-17T18:57:12.552946] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-17T18:57:12.757998] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-17T18:57:13.558071] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-17T18:57:14.213098] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-17T18:57:14.358045] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-17T18:57:14.396764] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T18:57:15.007247] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-17T18:57:15.158019] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-17T18:57:15.864741] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T18:57:15.957984] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-17T18:57:16.549838] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T18:57:16.758024] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-17T18:57:17.311623] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-17T18:57:17.312770] [INFO ] [REMOTE ] FLC: Full fetch complete (7776 records). [2025-10-17T18:57:17.312865] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-17T18:57:17.563193] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-17T18:57:17.673938] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-17T18:57:17.674015] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-17T18:57:17.674223] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-17T18:57:17.674282] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-17T18:57:17.674716] [DEBUG] [LOCAL ] FLC: Trimmed 7776 records to 5454 (keeping 200 days of data) [2025-10-17T18:57:17.707697] [DEBUG] [LOCAL ] FLC: Primary data saved (5454 records). [2025-10-17T18:57:17.707792] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-17T18:57:17.707883] [INFO ] [MAIN ] Update Progress: 841/2368 symbols completed. FLC took 17.6s. Estimated remaining: 3h 32m 51s. Rate: 7.2 symbols/min [2025-10-17T18:57:17.872372] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:17.872539] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-17T18:57:17.872575] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-17T18:57:17.872710] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-17T18:57:17.872766] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-17T18:57:17.872808] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-17T18:57:17.872839] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-17T18:57:18.218301] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:18.358025] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-17T18:57:18.579299] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T18:57:18.579627] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-17T18:57:18.579737] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T18:57:18.579786] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-17T18:57:18.579819] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T18:57:18.579858] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-17T18:57:18.579919] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-17T18:57:18.579953] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-17T18:57:18.579993] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-17T18:57:18.580037] [INFO ] [MAIN ] Update Progress: 842/2368 symbols completed. FLOC took 0.9s. Estimated remaining: 3h 32m 29s. Rate: 7.2 symbols/min [2025-10-17T18:57:18.749952] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:18.801775] [DEBUG] [LOCAL ] FLR: Loaded 53630 existing records from primary storage. [2025-10-17T18:57:18.802092] [INFO ] [MAIN ] FLR: Loaded 53630 existing records. [2025-10-17T18:57:18.980278] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:18.980543] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-17T18:57:18.980596] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-17T18:57:18.981068] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-17T18:57:18.981128] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-17T18:57:19.169380] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-17T18:57:19.338361] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:19.446673] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T18:57:19.958033] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-17T18:57:20.757996] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-17T18:57:21.020817] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T18:57:21.558020] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-17T18:57:21.718184] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T18:57:21.792846] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T18:57:22.358066] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-17T18:57:23.158006] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-17T18:57:23.271597] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T18:57:23.706093] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T18:57:23.958032] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-17T18:57:24.758031] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-17T18:57:24.987737] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T18:57:25.159590] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T18:57:25.558033] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-17T18:57:26.363243] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-17T18:57:26.382250] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:57:26.896758] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-17T18:57:27.158044] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-17T18:57:27.958043] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-17T18:57:28.187374] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T18:57:28.409446] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T18:57:28.758040] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-17T18:57:29.292704] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-17T18:57:29.558018] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-17T18:57:30.357996] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-17T18:57:30.462761] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T18:57:31.158026] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-17T18:57:31.357223] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T18:57:31.817489] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T18:57:31.958011] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-17T18:57:32.620448] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T18:57:32.758019] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-17T18:57:33.464160] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-17T18:57:33.557990] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-17T18:57:34.358055] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-17T18:57:34.513268] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T18:57:35.046959] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T18:57:35.158002] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-17T18:57:35.958004] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-17T18:57:36.129936] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T18:57:36.591357] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T18:57:36.758002] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-17T18:57:37.557990] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-17T18:57:37.775825] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T18:57:38.088035] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T18:57:38.092429] [INFO ] [REMOTE ] FLNG: Full fetch complete (50117 records). [2025-10-17T18:57:38.092509] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-17T18:57:38.363183] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-17T18:57:38.475269] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-17T18:57:38.475341] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-17T18:57:38.476069] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-17T18:57:38.476131] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-17T18:57:38.477110] [DEBUG] [LOCAL ] FLNG: Trimmed 50117 records to 34189 (keeping 200 days of data) [2025-10-17T18:57:38.679130] [DEBUG] [LOCAL ] FLNG: Primary data saved (34189 records). [2025-10-17T18:57:38.679243] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-17T18:57:38.679801] [INFO ] [MAIN ] Update Progress: 843/2368 symbols completed. FLNG took 38.5s. Estimated remaining: 3h 32m 42s. Rate: 7.2 symbols/min [2025-10-17T18:57:38.845302] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:38.892739] [DEBUG] [LOCAL ] FLS: Loaded 50762 existing records from primary storage. [2025-10-17T18:57:38.893246] [INFO ] [MAIN ] FLS: Loaded 50762 existing records. [2025-10-17T18:57:39.074681] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:39.075061] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-17T18:57:39.075153] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-17T18:57:39.075602] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-17T18:57:39.075694] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-17T18:57:39.163947] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-17T18:57:39.278766] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T18:57:39.468585] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:39.958043] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-17T18:57:40.126160] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T18:57:40.758038] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-17T18:57:41.234831] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-17T18:57:41.242522] [INFO ] [REMOTE ] FLG: Full fetch complete (77431 records). [2025-10-17T18:57:41.242687] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-17T18:57:41.559911] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-17T18:57:41.662082] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-17T18:57:41.662308] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-17T18:57:41.663548] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-17T18:57:41.663686] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-17T18:57:41.697836] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T18:57:41.697984] [DEBUG] [LOCAL ] FLG: Trimmed 77431 records to 54107 (keeping 200 days of data) [2025-10-17T18:57:42.047034] [DEBUG] [LOCAL ] FLG: Primary data saved (54107 records). [2025-10-17T18:57:42.047180] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-17T18:57:42.047285] [INFO ] [MAIN ] Update Progress: 844/2368 symbols completed. FLG took 41.9s. Estimated remaining: 3h 32m 25s. Rate: 7.2 symbols/min [2025-10-17T18:57:42.222724] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:42.272277] [DEBUG] [LOCAL ] FLUT: Loaded 51111 existing records from primary storage. [2025-10-17T18:57:42.272732] [INFO ] [MAIN ] FLUT: Loaded 51111 existing records. [2025-10-17T18:57:42.361984] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-17T18:57:42.453333] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:42.462597] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-17T18:57:42.476963] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-17T18:57:42.477390] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-17T18:57:42.477475] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-17T18:57:42.484184] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T18:57:42.839802] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:43.013630] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T18:57:43.022060] [INFO ] [REMOTE ] FLO: Full fetch complete (75278 records). [2025-10-17T18:57:43.022311] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-17T18:57:43.166952] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-17T18:57:43.432583] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-17T18:57:43.432741] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-17T18:57:43.433978] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-17T18:57:43.434044] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-17T18:57:43.435978] [DEBUG] [LOCAL ] FLO: Trimmed 75278 records to 52831 (keeping 200 days of data) [2025-10-17T18:57:43.768972] [DEBUG] [LOCAL ] FLO: Primary data saved (52831 records). [2025-10-17T18:57:43.769178] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-17T18:57:43.769285] [INFO ] [MAIN ] Update Progress: 845/2368 symbols completed. FLO took 43.6s. Estimated remaining: 3h 32m 4s. Rate: 7.2 symbols/min [2025-10-17T18:57:43.945684] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:43.960121] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-17T18:57:43.971863] [DEBUG] [LOCAL ] FLXR: Loaded 21214 existing records from primary storage. [2025-10-17T18:57:43.972219] [INFO ] [MAIN ] FLXR: Loaded 21214 existing records. [2025-10-17T18:57:44.154264] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:44.154857] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-17T18:57:44.155005] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-17T18:57:44.155361] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-17T18:57:44.155423] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-17T18:57:44.474422] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-17T18:57:44.585074] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:44.758053] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-17T18:57:44.893401] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T18:57:45.440878] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T18:57:45.474619] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-17T18:57:45.558040] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-17T18:57:46.358043] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-17T18:57:47.157997] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-17T18:57:47.329174] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T18:57:47.968529] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-17T18:57:47.975331] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:57:48.763286] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-17T18:57:48.767094] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-17T18:57:49.099013] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T18:57:49.558113] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-17T18:57:50.358218] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-17T18:57:50.479496] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T18:57:51.158006] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-17T18:57:51.263498] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T18:57:51.305424] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T18:57:51.958023] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-17T18:57:52.758008] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-17T18:57:53.136539] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-17T18:57:53.144461] [INFO ] [REMOTE ] FLR: Full fetch complete (76814 records). [2025-10-17T18:57:53.144585] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-17T18:57:53.551986] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-17T18:57:53.552139] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-17T18:57:53.553276] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-17T18:57:53.553378] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-17T18:57:53.555183] [DEBUG] [LOCAL ] FLR: Trimmed 76814 records to 54019 (keeping 200 days of data) [2025-10-17T18:57:53.602678] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-17T18:57:53.824875] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:57:53.836100] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T18:57:53.931949] [DEBUG] [LOCAL ] FLR: Primary data saved (54019 records). [2025-10-17T18:57:53.932090] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-17T18:57:53.932168] [INFO ] [MAIN ] Update Progress: 846/2368 symbols completed. FLR took 35.4s. Estimated remaining: 3h 31m 59s. Rate: 7.2 symbols/min [2025-10-17T18:57:54.097247] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:57:54.145241] [DEBUG] [LOCAL ] FMC: Loaded 52236 existing records from primary storage. [2025-10-17T18:57:54.145563] [INFO ] [MAIN ] FMC: Loaded 52236 existing records. [2025-10-17T18:57:54.316883] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:57:54.317156] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-17T18:57:54.317211] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-17T18:57:54.317577] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-17T18:57:54.317634] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-17T18:57:54.369937] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-17T18:57:54.664379] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:57:55.158012] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-17T18:57:55.440741] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T18:57:55.958001] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-17T18:57:56.081325] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T18:57:56.113330] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-17T18:57:56.758007] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-17T18:57:57.558012] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-17T18:57:57.779404] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T18:57:58.365172] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-17T18:57:58.370439] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T18:57:58.555950] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-17T18:57:59.158022] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-17T18:57:59.958012] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-17T18:58:00.235356] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T18:58:00.758043] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-17T18:58:01.350088] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T18:58:01.558035] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-17T18:58:01.589440] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-17T18:58:02.358046] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-17T18:58:03.157990] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-17T18:58:03.188140] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-17T18:58:03.289407] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T18:58:03.957984] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-17T18:58:04.183954] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T18:58:04.285211] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T18:58:04.758066] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-17T18:58:05.558005] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-17T18:58:05.654936] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T18:58:06.358017] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-17T18:58:06.582896] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T18:58:07.158021] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-17T18:58:07.291970] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T18:58:07.958007] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-17T18:58:08.115577] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T18:58:08.291138] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T18:58:08.758023] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-17T18:58:09.558001] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-17T18:58:09.782526] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T18:58:10.358003] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-17T18:58:10.491318] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T18:58:10.498505] [INFO ] [REMOTE ] FLS: Full fetch complete (72471 records). [2025-10-17T18:58:10.498635] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-17T18:58:10.877458] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-17T18:58:10.904801] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-17T18:58:10.905196] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-17T18:58:10.906406] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-17T18:58:10.906473] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-17T18:58:10.907794] [DEBUG] [LOCAL ] FLS: Trimmed 72471 records to 51134 (keeping 200 days of data) [2025-10-17T18:58:11.170257] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-17T18:58:11.213529] [DEBUG] [LOCAL ] FLS: Primary data saved (51134 records). [2025-10-17T18:58:11.213666] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-17T18:58:11.214159] [INFO ] [MAIN ] Update Progress: 847/2368 symbols completed. FLS took 32.5s. Estimated remaining: 3h 32m 7s. Rate: 7.2 symbols/min [2025-10-17T18:58:11.378763] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:58:11.387599] [DEBUG] [LOCAL ] FMN: Loaded 5497 existing records from primary storage. [2025-10-17T18:58:11.387849] [INFO ] [MAIN ] FMN: Loaded 5497 existing records. [2025-10-17T18:58:11.557183] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:58:11.557429] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-17T18:58:11.557484] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-17T18:58:11.557670] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-17T18:58:11.557740] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-17T18:58:11.906045] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:58:11.935532] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T18:58:11.957989] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-17T18:58:12.511540] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T18:58:12.515530] [INFO ] [REMOTE ] FLXR: Full fetch complete (27089 records). [2025-10-17T18:58:12.515676] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-17T18:58:12.737080] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-17T18:58:12.765665] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-17T18:58:12.893284] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-17T18:58:12.893356] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-17T18:58:12.893934] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-17T18:58:12.893996] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-17T18:58:12.894698] [DEBUG] [LOCAL ] FLXR: Trimmed 27089 records to 21398 (keeping 200 days of data) [2025-10-17T18:58:13.020028] [DEBUG] [LOCAL ] FLXR: Primary data saved (21398 records). [2025-10-17T18:58:13.020159] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-17T18:58:13.020236] [INFO ] [MAIN ] Update Progress: 848/2368 symbols completed. FLXR took 29.3s. Estimated remaining: 3h 31m 47s. Rate: 7.2 symbols/min [2025-10-17T18:58:13.189698] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:58:13.220843] [DEBUG] [LOCAL ] FMS: Loaded 30464 existing records from primary storage. [2025-10-17T18:58:13.221108] [INFO ] [MAIN ] FMS: Loaded 30464 existing records. [2025-10-17T18:58:13.395818] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:58:13.396020] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-17T18:58:13.396067] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-17T18:58:13.396302] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-17T18:58:13.396360] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-17T18:58:13.568536] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-17T18:58:13.691554] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T18:58:13.769095] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:58:14.358005] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-17T18:58:15.158055] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-17T18:58:15.366673] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T18:58:15.418881] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-17T18:58:15.958027] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-17T18:58:16.725444] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-17T18:58:16.767175] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-17T18:58:16.788427] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T18:58:17.558017] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-17T18:58:17.581542] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-17T18:58:18.358032] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-17T18:58:19.158059] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-17T18:58:19.417489] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T18:58:19.882268] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T18:58:19.958038] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-17T18:58:20.071423] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T18:58:20.079485] [INFO ] [REMOTE ] FLUT: Full fetch complete (73308 records). [2025-10-17T18:58:20.079761] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-17T18:58:20.484551] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-17T18:58:20.484634] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-17T18:58:20.485593] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-17T18:58:20.485663] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-17T18:58:20.487183] [DEBUG] [LOCAL ] FLUT: Trimmed 73308 records to 51478 (keeping 200 days of data) [2025-10-17T18:58:20.771614] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-17T18:58:20.796662] [DEBUG] [LOCAL ] FLUT: Primary data saved (51478 records). [2025-10-17T18:58:20.796874] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-17T18:58:20.796986] [INFO ] [MAIN ] Update Progress: 849/2368 symbols completed. FLUT took 38.7s. Estimated remaining: 3h 31m 37s. Rate: 7.2 symbols/min [2025-10-17T18:58:20.965978] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:58:21.003628] [DEBUG] [LOCAL ] FMX: Loaded 40866 existing records from primary storage. [2025-10-17T18:58:21.003973] [INFO ] [MAIN ] FMX: Loaded 40866 existing records. [2025-10-17T18:58:21.179044] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:58:21.179375] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-17T18:58:21.179561] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-17T18:58:21.184914] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-17T18:58:21.193271] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-17T18:58:21.261616] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T18:58:21.549413] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:58:21.557989] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-17T18:58:22.358075] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-17T18:58:22.502555] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T18:58:22.929883] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-17T18:58:23.025355] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T18:58:23.158026] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-17T18:58:23.958014] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-17T18:58:24.758005] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-17T18:58:25.044634] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T18:58:25.201892] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T18:58:25.558047] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-17T18:58:25.705144] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T18:58:26.141750] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T18:58:26.358035] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-17T18:58:27.158146] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-17T18:58:27.920714] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T18:58:27.951702] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T18:58:27.958669] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-17T18:58:28.758027] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-17T18:58:29.352238] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-17T18:58:29.558006] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-17T18:58:29.678960] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T18:58:30.196296] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-17T18:58:30.358061] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-17T18:58:31.158088] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-17T18:58:31.958040] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-17T18:58:32.236029] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T18:58:32.641927] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T18:58:32.643682] [INFO ] [REMOTE ] FMN: Full fetch complete (10158 records). [2025-10-17T18:58:32.643771] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-17T18:58:32.760711] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-17T18:58:33.027089] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-17T18:58:33.027222] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-17T18:58:33.027519] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-17T18:58:33.027591] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-17T18:58:33.028210] [DEBUG] [LOCAL ] FMN: Trimmed 10158 records to 5571 (keeping 200 days of data) [2025-10-17T18:58:33.088783] [DEBUG] [LOCAL ] FMN: Primary data saved (5571 records). [2025-10-17T18:58:33.088935] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-17T18:58:33.089031] [INFO ] [MAIN ] Update Progress: 850/2368 symbols completed. FMN took 21.9s. Estimated remaining: 3h 31m 36s. Rate: 7.2 symbols/min [2025-10-17T18:58:33.091040] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-17T18:58:33.266746] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:58:33.270521] [DEBUG] [LOCAL ] FMY: Loaded 1390 existing records from primary storage. [2025-10-17T18:58:33.270690] [INFO ] [MAIN ] FMY: Loaded 1390 existing records. [2025-10-17T18:58:33.441881] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:58:33.442110] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-17T18:58:33.442158] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-17T18:58:33.442348] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-17T18:58:33.442406] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-17T18:58:33.563207] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-17T18:58:33.793240] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:58:34.338434] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T18:58:34.357996] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-17T18:58:35.158116] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-17T18:58:35.938600] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T18:58:35.957987] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-17T18:58:36.004417] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-17T18:58:36.012796] [INFO ] [REMOTE ] FMC: Full fetch complete (75367 records). [2025-10-17T18:58:36.012939] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-17T18:58:36.398449] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-17T18:58:36.398534] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-17T18:58:36.399462] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-17T18:58:36.399526] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-17T18:58:36.400943] [DEBUG] [LOCAL ] FMC: Trimmed 75367 records to 52624 (keeping 200 days of data) [2025-10-17T18:58:36.661992] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T18:58:36.746604] [DEBUG] [LOCAL ] FMC: Primary data saved (52624 records). [2025-10-17T18:58:36.746767] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-17T18:58:36.746866] [INFO ] [MAIN ] Update Progress: 851/2368 symbols completed. FMC took 42.8s. Estimated remaining: 3h 31m 19s. Rate: 7.2 symbols/min [2025-10-17T18:58:36.767295] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-17T18:58:36.922517] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:58:36.958717] [DEBUG] [LOCAL ] FN: Loaded 38016 existing records from primary storage. [2025-10-17T18:58:36.959040] [INFO ] [MAIN ] FN: Loaded 38016 existing records. [2025-10-17T18:58:37.157615] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:58:37.158056] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-17T18:58:37.158127] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-17T18:58:37.158339] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-17T18:58:37.158402] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-17T18:58:37.251135] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-17T18:58:37.512195] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T18:58:37.562002] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-17T18:58:37.605622] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:58:37.933495] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-17T18:58:38.358077] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-17T18:58:39.158013] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-17T18:58:39.871561] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T18:58:39.957989] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-17T18:58:40.536219] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T18:58:40.758090] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-17T18:58:41.532226] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-17T18:58:41.556218] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T18:58:41.558926] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-17T18:58:41.987065] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-17T18:58:42.358112] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-17T18:58:43.158124] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-17T18:58:43.958045] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-17T18:58:44.006219] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T18:58:44.290796] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T18:58:44.462772] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-17T18:58:44.758029] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-17T18:58:45.558046] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-17T18:58:46.358034] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-17T18:58:46.498736] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T18:58:46.710424] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-17T18:58:47.102949] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T18:58:47.158044] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-17T18:58:47.958051] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-17T18:58:48.729563] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T18:58:48.757994] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-17T18:58:49.161087] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-17T18:58:49.558039] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-17T18:58:50.358057] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-17T18:58:50.404919] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T18:58:50.719761] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-17T18:58:51.025841] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T18:58:51.158010] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-17T18:58:51.958041] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-17T18:58:52.758042] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-17T18:58:52.861034] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T18:58:53.384549] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T18:58:53.558003] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-17T18:58:54.021813] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T18:58:54.358039] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-17T18:58:55.016720] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T18:58:55.158033] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-17T18:58:55.808520] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T18:58:55.813037] [INFO ] [REMOTE ] FMS: Full fetch complete (42794 records). [2025-10-17T18:58:55.813139] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-17T18:58:55.959614] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-17T18:58:56.260321] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-17T18:58:56.260400] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-17T18:58:56.261187] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-17T18:58:56.261251] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-17T18:58:56.262340] [DEBUG] [LOCAL ] FMS: Trimmed 42794 records to 30733 (keeping 200 days of data) [2025-10-17T18:58:56.446819] [DEBUG] [LOCAL ] FMS: Primary data saved (30733 records). [2025-10-17T18:58:56.446976] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-17T18:58:56.447064] [INFO ] [MAIN ] Update Progress: 852/2368 symbols completed. FMS took 43.4s. Estimated remaining: 3h 31m 31s. Rate: 7.2 symbols/min [2025-10-17T18:58:56.531636] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T18:58:56.628322] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:58:56.680113] [DEBUG] [LOCAL ] FNB: Loaded 52986 existing records from primary storage. [2025-10-17T18:58:56.680448] [INFO ] [MAIN ] FNB: Loaded 52986 existing records. [2025-10-17T18:58:56.764692] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-17T18:58:56.867173] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T18:58:56.887408] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:58:56.896282] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-17T18:58:56.896452] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-17T18:58:56.896925] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-17T18:58:56.896984] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-17T18:58:57.250795] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:58:57.336221] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-17T18:58:57.558025] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-17T18:58:58.358028] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-17T18:58:59.080380] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T18:58:59.158020] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-17T18:58:59.882150] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T18:58:59.958005] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-17T18:59:00.662696] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T18:59:00.667182] [INFO ] [REMOTE ] FN: Full fetch complete (56338 records). [2025-10-17T18:59:00.667325] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-17T18:59:00.767887] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-17T18:59:01.052905] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-17T18:59:01.052986] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-17T18:59:01.053787] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-17T18:59:01.053860] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-17T18:59:01.055045] [DEBUG] [LOCAL ] FN: Trimmed 56338 records to 38299 (keeping 200 days of data) [2025-10-17T18:59:01.288890] [DEBUG] [LOCAL ] FN: Primary data saved (38299 records). [2025-10-17T18:59:01.289019] [INFO ] [MAIN ] FN: Full history saved. [2025-10-17T18:59:01.289098] [INFO ] [MAIN ] Update Progress: 853/2368 symbols completed. FN took 24.5s. Estimated remaining: 3h 31m 17s. Rate: 7.2 symbols/min [2025-10-17T18:59:01.455489] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:59:01.507929] [DEBUG] [LOCAL ] FND: Loaded 52517 existing records from primary storage. [2025-10-17T18:59:01.508351] [INFO ] [MAIN ] FND: Loaded 52517 existing records. [2025-10-17T18:59:01.570793] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-17T18:59:01.691120] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:59:01.691346] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-17T18:59:01.691428] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-17T18:59:01.691783] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-17T18:59:01.691851] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-17T18:59:01.775960] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T18:59:02.056902] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:59:02.084357] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-17T18:59:02.358074] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-17T18:59:02.794209] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-17T18:59:02.795539] [INFO ] [REMOTE ] FMY: Full fetch complete (1953 records). [2025-10-17T18:59:02.795614] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-17T18:59:03.163484] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-17T18:59:03.170327] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-17T18:59:03.171231] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-17T18:59:03.171379] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-17T18:59:03.171427] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-17T18:59:03.171856] [DEBUG] [LOCAL ] FMY: Trimmed 1953 records to 1397 (keeping 200 days of data) [2025-10-17T18:59:03.181874] [DEBUG] [LOCAL ] FMY: Primary data saved (1397 records). [2025-10-17T18:59:03.181989] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-17T18:59:03.182091] [INFO ] [MAIN ] Update Progress: 854/2368 symbols completed. FMY took 30.1s. Estimated remaining: 3h 30m 57s. Rate: 7.2 symbols/min [2025-10-17T18:59:03.358690] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:59:03.413956] [DEBUG] [LOCAL ] FNF: Loaded 49296 existing records from primary storage. [2025-10-17T18:59:03.414271] [INFO ] [MAIN ] FNF: Loaded 49296 existing records. [2025-10-17T18:59:03.596002] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:59:03.596293] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-17T18:59:03.596367] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-17T18:59:03.596755] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-17T18:59:03.596814] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-17T18:59:03.952135] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:59:03.957986] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-17T18:59:04.154812] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-17T18:59:04.758098] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-17T18:59:05.014672] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T18:59:05.530194] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T18:59:05.557997] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-17T18:59:06.358047] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-17T18:59:06.508965] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T18:59:07.039290] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T18:59:07.044686] [INFO ] [REMOTE ] FMX: Full fetch complete (57971 records). [2025-10-17T18:59:07.044795] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-17T18:59:07.163228] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-17T18:59:07.440172] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-17T18:59:07.440272] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-17T18:59:07.441162] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-17T18:59:07.441227] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-17T18:59:07.442409] [DEBUG] [LOCAL ] FMX: Trimmed 57971 records to 41172 (keeping 200 days of data) [2025-10-17T18:59:07.699314] [DEBUG] [LOCAL ] FMX: Primary data saved (41172 records). [2025-10-17T18:59:07.699446] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-17T18:59:07.699524] [INFO ] [MAIN ] Update Progress: 855/2368 symbols completed. FMX took 46.9s. Estimated remaining: 3h 30m 42s. Rate: 7.2 symbols/min [2025-10-17T18:59:07.875751] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:59:07.923418] [DEBUG] [LOCAL ] FNV: Loaded 46507 existing records from primary storage. [2025-10-17T18:59:07.923798] [INFO ] [MAIN ] FNV: Loaded 46507 existing records. [2025-10-17T18:59:07.967289] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-17T18:59:08.116673] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:59:08.116995] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-17T18:59:08.117114] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-17T18:59:08.117531] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-17T18:59:08.117665] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-17T18:59:08.419832] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-17T18:59:08.516042] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:59:08.763096] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-17T18:59:08.776507] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T18:59:09.276240] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-17T18:59:09.558078] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-17T18:59:10.342059] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T18:59:10.358003] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-17T18:59:11.165515] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-17T18:59:11.181431] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T18:59:11.869615] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T18:59:11.957995] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-17T18:59:12.746336] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T18:59:12.757973] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-17T18:59:13.558038] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-17T18:59:13.737595] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T18:59:14.358077] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-17T18:59:14.497104] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T18:59:15.123266] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T18:59:15.158039] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-17T18:59:15.680955] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-17T18:59:15.958048] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-17T18:59:16.758013] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-17T18:59:16.937810] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T18:59:17.558038] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-17T18:59:17.685721] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T18:59:18.178828] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T18:59:18.358044] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-17T18:59:18.835408] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-17T18:59:19.158080] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-17T18:59:19.958010] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-17T18:59:20.142380] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T18:59:20.763212] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-17T18:59:20.776060] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T18:59:21.558022] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-17T18:59:21.631247] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T18:59:22.358011] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-17T18:59:22.463365] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T18:59:23.163786] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-17T18:59:23.176538] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T18:59:23.660206] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T18:59:23.958038] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-17T18:59:24.758116] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-17T18:59:24.960588] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-17T18:59:25.558011] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-17T18:59:25.684871] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T18:59:26.348779] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T18:59:26.358387] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-17T18:59:27.166253] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-17T18:59:27.183195] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T18:59:27.958020] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-17T18:59:28.033698] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T18:59:28.758001] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-17T18:59:29.215053] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-17T18:59:29.473788] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-17T18:59:29.557986] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-17T18:59:30.316570] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T18:59:30.357987] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-17T18:59:31.158050] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-17T18:59:31.255246] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T18:59:31.958032] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-17T18:59:32.364525] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-17T18:59:32.758056] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-17T18:59:33.017489] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-17T18:59:33.026729] [INFO ] [REMOTE ] FNF: Full fetch complete (70008 records). [2025-10-17T18:59:33.026971] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-17T18:59:33.446606] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-17T18:59:33.446953] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-17T18:59:33.448586] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-17T18:59:33.448729] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-17T18:59:33.479050] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T18:59:33.489131] [DEBUG] [LOCAL ] FNF: Trimmed 70008 records to 49639 (keeping 200 days of data) [2025-10-17T18:59:33.585023] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-17T18:59:33.823540] [DEBUG] [LOCAL ] FNF: Primary data saved (49639 records). [2025-10-17T18:59:33.823797] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-17T18:59:33.824539] [INFO ] [MAIN ] Update Progress: 856/2368 symbols completed. FNF took 30.6s. Estimated remaining: 3h 31m 5s. Rate: 7.2 symbols/min [2025-10-17T18:59:34.005883] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:59:34.025191] [DEBUG] [LOCAL ] FOA: Loaded 13156 existing records from primary storage. [2025-10-17T18:59:34.025592] [INFO ] [MAIN ] FOA: Loaded 13156 existing records. [2025-10-17T18:59:34.225563] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:59:34.226036] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-17T18:59:34.226101] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-17T18:59:34.226372] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-17T18:59:34.226431] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-17T18:59:34.369808] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-17T18:59:34.613880] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:59:34.637858] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T18:59:35.158051] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-17T18:59:35.313058] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T18:59:35.319692] [INFO ] [REMOTE ] FNV: Full fetch complete (66807 records). [2025-10-17T18:59:35.319797] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-17T18:59:35.696765] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-17T18:59:35.696865] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-17T18:59:35.697823] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-17T18:59:35.697889] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-17T18:59:35.699305] [DEBUG] [LOCAL ] FNV: Trimmed 66807 records to 46890 (keeping 200 days of data) [2025-10-17T18:59:35.968929] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-17T18:59:35.995078] [DEBUG] [LOCAL ] FNV: Primary data saved (46890 records). [2025-10-17T18:59:35.995246] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-17T18:59:35.996227] [INFO ] [MAIN ] Update Progress: 857/2368 symbols completed. FNV took 28.3s. Estimated remaining: 3h 30m 45s. Rate: 7.2 symbols/min [2025-10-17T18:59:36.176927] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:59:36.192117] [DEBUG] [LOCAL ] FOF: Loaded 8657 existing records from primary storage. [2025-10-17T18:59:36.192357] [INFO ] [MAIN ] FOF: Loaded 8657 existing records. [2025-10-17T18:59:36.412093] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:59:36.406556] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T18:59:36.422818] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-17T18:59:36.422908] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-17T18:59:36.423321] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-17T18:59:36.423385] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-17T18:59:36.776701] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-17T18:59:36.781713] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:59:36.915367] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T18:59:36.923613] [INFO ] [REMOTE ] FNB: Full fetch complete (76183 records). [2025-10-17T18:59:36.923861] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-17T18:59:37.268949] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T18:59:37.364477] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-17T18:59:37.364610] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-17T18:59:37.366026] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-17T18:59:37.366131] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-17T18:59:37.368457] [DEBUG] [LOCAL ] FNB: Trimmed 76183 records to 53376 (keeping 200 days of data) [2025-10-17T18:59:37.562115] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-17T18:59:37.729976] [DEBUG] [LOCAL ] FNB: Primary data saved (53376 records). [2025-10-17T18:59:37.730208] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-17T18:59:37.730999] [INFO ] [MAIN ] Update Progress: 858/2368 symbols completed. FNB took 41.3s. Estimated remaining: 3h 30m 25s. Rate: 7.2 symbols/min [2025-10-17T18:59:37.911437] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:59:37.945084] [DEBUG] [LOCAL ] FOR: Loaded 19877 existing records from primary storage. [2025-10-17T18:59:37.945438] [INFO ] [MAIN ] FOR: Loaded 19877 existing records. [2025-10-17T18:59:38.138128] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:59:38.138560] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-17T18:59:38.138700] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-17T18:59:38.139106] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-17T18:59:38.139229] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-17T18:59:38.365385] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-17T18:59:38.414511] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T18:59:38.581188] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:59:38.698200] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T18:59:39.158078] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-17T18:59:39.442551] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T18:59:39.958074] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-17T18:59:40.137067] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T18:59:40.758061] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-17T18:59:41.558012] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-17T18:59:41.567500] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T18:59:41.665684] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T18:59:42.358050] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-17T18:59:42.525462] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T18:59:43.018840] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-17T18:59:43.158028] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-17T18:59:43.932287] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-17T18:59:43.958023] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-17T18:59:44.757997] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-17T18:59:44.767286] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T18:59:45.558016] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-17T18:59:45.846884] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T18:59:46.358070] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-17T18:59:47.152791] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-17T18:59:47.157997] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-17T18:59:47.456874] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T18:59:47.464245] [INFO ] [REMOTE ] FND: Full fetch complete (75015 records). [2025-10-17T18:59:47.464370] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-17T18:59:47.852744] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-17T18:59:47.852841] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-17T18:59:47.853852] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-17T18:59:47.853920] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-17T18:59:47.855427] [DEBUG] [LOCAL ] FND: Trimmed 75015 records to 52865 (keeping 200 days of data) [2025-10-17T18:59:47.958175] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-17T18:59:48.180233] [DEBUG] [LOCAL ] FND: Primary data saved (52865 records). [2025-10-17T18:59:48.180380] [INFO ] [MAIN ] FND: Full history saved. [2025-10-17T18:59:48.180460] [INFO ] [MAIN ] Update Progress: 859/2368 symbols completed. FND took 46.9s. Estimated remaining: 3h 30m 21s. Rate: 7.2 symbols/min [2025-10-17T18:59:48.340943] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T18:59:48.365427] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T18:59:48.420457] [DEBUG] [LOCAL ] FOUR: Loaded 50101 existing records from primary storage. [2025-10-17T18:59:48.420925] [INFO ] [MAIN ] FOUR: Loaded 50101 existing records. [2025-10-17T18:59:48.610876] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T18:59:48.611171] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-17T18:59:48.611225] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-17T18:59:48.611463] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-17T18:59:48.611505] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-17T18:59:48.764136] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-17T18:59:49.004149] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T18:59:49.004615] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T18:59:49.558073] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-17T18:59:50.057833] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-17T18:59:50.358063] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-17T18:59:50.529507] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T18:59:51.158053] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-17T18:59:51.635058] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T18:59:51.958069] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-17T18:59:52.763165] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-17T18:59:52.786899] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T18:59:52.991890] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T18:59:53.558058] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-17T18:59:53.874631] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T18:59:54.358066] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-17T18:59:54.566795] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T18:59:55.139075] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-17T18:59:55.157990] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-17T18:59:55.957425] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-17T18:59:55.960329] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-17T18:59:56.758004] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-17T18:59:56.811865] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T18:59:57.558040] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-17T18:59:57.833832] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T18:59:58.285294] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-17T18:59:58.357979] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-17T18:59:59.107021] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T18:59:59.158042] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-17T18:59:59.918539] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T18:59:59.958025] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-17T19:00:00.758003] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-17T19:00:00.979595] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T19:00:00.981280] [INFO ] [REMOTE ] FOF: Full fetch complete (11887 records). [2025-10-17T19:00:00.981354] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-17T19:00:01.345272] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-17T19:00:01.345358] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-17T19:00:01.345755] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-17T19:00:01.345818] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-17T19:00:01.346358] [DEBUG] [LOCAL ] FOF: Trimmed 11887 records to 8707 (keeping 200 days of data) [2025-10-17T19:00:01.402312] [DEBUG] [LOCAL ] FOF: Primary data saved (8707 records). [2025-10-17T19:00:01.402465] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-17T19:00:01.402551] [INFO ] [MAIN ] Update Progress: 860/2368 symbols completed. FOF took 25.4s. Estimated remaining: 3h 30m 21s. Rate: 7.2 symbols/min [2025-10-17T19:00:01.563255] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-17T19:00:01.591223] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:00:01.615736] [DEBUG] [LOCAL ] FPF: Loaded 19054 existing records from primary storage. [2025-10-17T19:00:01.616045] [INFO ] [MAIN ] FPF: Loaded 19054 existing records. [2025-10-17T19:00:01.809585] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:00:01.809858] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-17T19:00:01.809910] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-17T19:00:01.810151] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-17T19:00:01.810211] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-17T19:00:02.276685] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:00:02.286859] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T19:00:02.358053] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-17T19:00:03.158053] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-17T19:00:03.278221] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T19:00:03.368472] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T19:00:03.958066] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-17T19:00:04.758006] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-17T19:00:05.163260] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-17T19:00:05.188154] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-17T19:00:05.558053] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-17T19:00:05.909065] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-17T19:00:06.358053] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-17T19:00:07.158034] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-17T19:00:07.604804] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T19:00:07.607514] [INFO ] [REMOTE ] FOA: Full fetch complete (21588 records). [2025-10-17T19:00:07.607621] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-17T19:00:07.958755] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-17T19:00:07.992095] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-17T19:00:07.992202] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-17T19:00:07.992980] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-17T19:00:07.993207] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-17T19:00:08.023761] [DEBUG] [LOCAL ] FOA: Trimmed 21588 records to 13224 (keeping 200 days of data) [2025-10-17T19:00:08.025465] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-17T19:00:08.114931] [DEBUG] [LOCAL ] FOA: Primary data saved (13224 records). [2025-10-17T19:00:08.115089] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-17T19:00:08.115177] [INFO ] [MAIN ] Update Progress: 861/2368 symbols completed. FOA took 34.3s. Estimated remaining: 3h 30m 9s. Rate: 7.2 symbols/min [2025-10-17T19:00:08.292787] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:00:08.313013] [DEBUG] [LOCAL ] FPH: Loaded 19484 existing records from primary storage. [2025-10-17T19:00:08.313282] [INFO ] [MAIN ] FPH: Loaded 19484 existing records. [2025-10-17T19:00:08.465952] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-17T19:00:08.557775] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:00:08.558024] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-17T19:00:08.558079] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-17T19:00:08.558285] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-17T19:00:08.558327] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-17T19:00:08.767775] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-17T19:00:08.942493] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:00:09.212317] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T19:00:09.215150] [INFO ] [REMOTE ] FOR: Full fetch complete (29834 records). [2025-10-17T19:00:09.215237] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-17T19:00:09.563499] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-17T19:00:09.575775] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-17T19:00:09.575834] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-17T19:00:09.576445] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-17T19:00:09.576599] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-17T19:00:09.577543] [DEBUG] [LOCAL ] FOR: Trimmed 29834 records to 20025 (keeping 200 days of data) [2025-10-17T19:00:09.712526] [DEBUG] [LOCAL ] FOR: Primary data saved (20025 records). [2025-10-17T19:00:09.712703] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-17T19:00:09.712825] [INFO ] [MAIN ] Update Progress: 862/2368 symbols completed. FOR took 32.0s. Estimated remaining: 3h 29m 49s. Rate: 7.2 symbols/min [2025-10-17T19:00:09.881986] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:00:09.915491] [DEBUG] [LOCAL ] FPI: Loaded 31623 existing records from primary storage. [2025-10-17T19:00:09.915778] [INFO ] [MAIN ] FPI: Loaded 31623 existing records. [2025-10-17T19:00:10.087251] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:00:10.087438] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-17T19:00:10.087484] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-17T19:00:10.087717] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-17T19:00:10.087775] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-17T19:00:10.360687] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-17T19:00:10.443609] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:00:10.590292] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T19:00:10.643362] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T19:00:11.158048] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-17T19:00:11.538024] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T19:00:11.958084] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-17T19:00:12.758039] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-17T19:00:13.250976] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-17T19:00:13.337503] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T19:00:13.557983] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-17T19:00:13.792050] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-17T19:00:14.358014] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-17T19:00:14.533689] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-17T19:00:15.158004] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-17T19:00:15.970132] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-17T19:00:15.973512] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T19:00:16.426606] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T19:00:16.758049] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-17T19:00:17.208986] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-17T19:00:17.558047] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-17T19:00:18.025287] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-17T19:00:18.358066] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-17T19:00:19.109844] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T19:00:19.158033] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-17T19:00:19.230318] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-17T19:00:19.958031] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-17T19:00:20.573185] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T19:00:20.758004] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-17T19:00:21.116357] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-17T19:00:21.558026] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-17T19:00:22.357995] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-17T19:00:22.614003] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T19:00:22.674964] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T19:00:23.158111] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-17T19:00:23.438094] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T19:00:23.958097] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-17T19:00:24.407405] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T19:00:24.595684] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-17T19:00:24.758062] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-17T19:00:25.558057] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-17T19:00:25.817280] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T19:00:26.358063] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-17T19:00:26.507515] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T19:00:27.158065] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-17T19:00:27.482190] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T19:00:27.958058] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-17T19:00:28.758004] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-17T19:00:29.078096] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T19:00:29.377627] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T19:00:29.557984] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-17T19:00:29.878083] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T19:00:30.357999] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-17T19:00:30.511124] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-17T19:00:31.157989] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-17T19:00:31.241850] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T19:00:31.957999] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-17T19:00:32.232744] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-17T19:00:32.758022] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-17T19:00:33.558095] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-17T19:00:33.893904] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T19:00:33.967464] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-17T19:00:33.975579] [INFO ] [REMOTE ] FOUR: Full fetch complete (72284 records). [2025-10-17T19:00:33.975901] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-17T19:00:34.363247] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-17T19:00:34.423087] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-17T19:00:34.423181] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-17T19:00:34.424145] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-17T19:00:34.424212] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-17T19:00:34.425711] [DEBUG] [LOCAL ] FOUR: Trimmed 72284 records to 50475 (keeping 200 days of data) [2025-10-17T19:00:34.647140] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T19:00:34.744345] [DEBUG] [LOCAL ] FOUR: Primary data saved (50475 records). [2025-10-17T19:00:34.744487] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-17T19:00:34.744569] [INFO ] [MAIN ] Update Progress: 863/2368 symbols completed. FOUR took 46.6s. Estimated remaining: 3h 30m 10s. Rate: 7.2 symbols/min [2025-10-17T19:00:34.907044] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:00:34.947689] [DEBUG] [LOCAL ] FR: Loaded 46923 existing records from primary storage. [2025-10-17T19:00:34.947989] [INFO ] [MAIN ] FR: Loaded 46923 existing records. [2025-10-17T19:00:35.118121] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:00:35.118289] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-17T19:00:35.118333] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-17T19:00:35.118604] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-17T19:00:35.118688] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-17T19:00:35.163178] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-17T19:00:35.466326] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:00:35.902806] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T19:00:35.958025] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-17T19:00:36.447695] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T19:00:36.451397] [INFO ] [REMOTE ] FPF: Full fetch complete (26710 records). [2025-10-17T19:00:36.451503] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-17T19:00:36.770567] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-17T19:00:36.817679] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-17T19:00:36.817769] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-17T19:00:36.818453] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-17T19:00:36.818492] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-17T19:00:36.819276] [DEBUG] [LOCAL ] FPF: Trimmed 26710 records to 19175 (keeping 200 days of data) [2025-10-17T19:00:36.935619] [DEBUG] [LOCAL ] FPF: Primary data saved (19175 records). [2025-10-17T19:00:36.935784] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-17T19:00:36.935869] [INFO ] [MAIN ] Update Progress: 864/2368 symbols completed. FPF took 35.5s. Estimated remaining: 3h 29m 51s. Rate: 7.2 symbols/min [2025-10-17T19:00:37.094774] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T19:00:37.119921] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:00:37.142374] [DEBUG] [LOCAL ] FRA: Loaded 14371 existing records from primary storage. [2025-10-17T19:00:37.142675] [INFO ] [MAIN ] FRA: Loaded 14371 existing records. [2025-10-17T19:00:37.315454] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:00:37.315720] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-17T19:00:37.315777] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-17T19:00:37.316139] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-17T19:00:37.316197] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-17T19:00:37.563175] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-17T19:00:37.659676] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:00:38.358045] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-17T19:00:38.515737] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T19:00:39.151320] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-17T19:00:39.157976] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-17T19:00:39.276889] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T19:00:39.280811] [INFO ] [REMOTE ] FPH: Full fetch complete (31094 records). [2025-10-17T19:00:39.280910] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-17T19:00:39.661239] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-17T19:00:39.661323] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-17T19:00:39.661978] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-17T19:00:39.662047] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-17T19:00:39.662939] [DEBUG] [LOCAL ] FPH: Trimmed 31094 records to 19603 (keeping 200 days of data) [2025-10-17T19:00:39.772421] [DEBUG] [LOCAL ] FPH: Primary data saved (19603 records). [2025-10-17T19:00:39.772579] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-17T19:00:39.772687] [INFO ] [MAIN ] Update Progress: 865/2368 symbols completed. FPH took 31.7s. Estimated remaining: 3h 29m 33s. Rate: 7.2 symbols/min [2025-10-17T19:00:39.938983] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:00:39.955679] [DEBUG] [LOCAL ] FRGE: Loaded 16223 existing records from primary storage. [2025-10-17T19:00:39.955928] [INFO ] [MAIN ] FRGE: Loaded 16223 existing records. [2025-10-17T19:00:39.967021] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-17T19:00:40.134199] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:00:40.134410] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-17T19:00:40.134478] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-17T19:00:40.134686] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-17T19:00:40.134760] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-17T19:00:40.501870] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:00:40.517872] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T19:00:40.758065] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-17T19:00:41.558005] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-17T19:00:41.659092] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T19:00:41.772015] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-17T19:00:42.358034] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-17T19:00:42.465870] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T19:00:43.158097] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-17T19:00:43.366428] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T19:00:43.958172] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-17T19:00:44.700066] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T19:00:44.758002] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-17T19:00:44.955247] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T19:00:45.558058] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-17T19:00:46.358006] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-17T19:00:46.423690] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T19:00:46.977579] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T19:00:47.162106] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-17T19:00:47.166986] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T19:00:47.958068] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-17T19:00:48.758093] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-17T19:00:48.810710] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T19:00:49.452187] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-17T19:00:49.470856] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-17T19:00:49.558004] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-17T19:00:50.358006] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-17T19:00:50.568932] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-17T19:00:51.158027] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-17T19:00:51.728855] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T19:00:51.953222] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T19:00:51.957971] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-17T19:00:52.758008] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-17T19:00:52.776437] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T19:00:53.558021] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-17T19:00:54.027791] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T19:00:54.032549] [INFO ] [REMOTE ] FPI: Full fetch complete (43900 records). [2025-10-17T19:00:54.032721] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-17T19:00:54.363131] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-17T19:00:54.438628] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-17T19:00:54.438762] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-17T19:00:54.439479] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-17T19:00:54.439529] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-17T19:00:54.440724] [DEBUG] [LOCAL ] FPI: Trimmed 43900 records to 31833 (keeping 200 days of data) [2025-10-17T19:00:54.643779] [DEBUG] [LOCAL ] FPI: Primary data saved (31833 records). [2025-10-17T19:00:54.643946] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-17T19:00:54.644150] [INFO ] [MAIN ] Update Progress: 866/2368 symbols completed. FPI took 44.9s. Estimated remaining: 3h 29m 36s. Rate: 7.2 symbols/min [2025-10-17T19:00:54.817759] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:00:54.835737] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-17T19:00:54.890398] [DEBUG] [LOCAL ] FRO: Loaded 52078 existing records from primary storage. [2025-10-17T19:00:54.890725] [INFO ] [MAIN ] FRO: Loaded 52078 existing records. [2025-10-17T19:00:55.069584] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:00:55.069868] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-17T19:00:55.069934] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-17T19:00:55.070328] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-17T19:00:55.070390] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-17T19:00:55.165217] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-17T19:00:55.431315] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:00:55.474355] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T19:00:55.476788] [INFO ] [REMOTE ] FRA: Full fetch complete (23600 records). [2025-10-17T19:00:55.476868] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-17T19:00:55.831442] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-17T19:00:55.831519] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-17T19:00:55.832018] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-17T19:00:55.832099] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-17T19:00:55.832765] [DEBUG] [LOCAL ] FRA: Trimmed 23600 records to 14476 (keeping 200 days of data) [2025-10-17T19:00:55.921827] [DEBUG] [LOCAL ] FRA: Primary data saved (14476 records). [2025-10-17T19:00:55.921959] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-17T19:00:55.922051] [INFO ] [MAIN ] Update Progress: 867/2368 symbols completed. FRA took 19.0s. Estimated remaining: 3h 29m 15s. Rate: 7.2 symbols/min [2025-10-17T19:00:55.964368] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-17T19:00:56.090576] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:00:56.133763] [DEBUG] [LOCAL ] FRT: Loaded 42000 existing records from primary storage. [2025-10-17T19:00:56.134076] [INFO ] [MAIN ] FRT: Loaded 42000 existing records. [2025-10-17T19:00:56.308794] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:00:56.309042] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-17T19:00:56.309091] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-17T19:00:56.309347] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-17T19:00:56.309386] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-17T19:00:56.668635] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:00:56.752163] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T19:00:56.761492] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-17T19:00:57.393775] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T19:00:57.558026] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-17T19:00:58.263033] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T19:00:58.358016] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-17T19:00:58.839025] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T19:00:59.158062] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-17T19:00:59.896679] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T19:00:59.958014] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-17T19:01:00.670745] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T19:01:00.757988] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-17T19:01:01.141405] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T19:01:01.558059] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-17T19:01:02.364758] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-17T19:01:02.393677] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T19:01:02.418333] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-17T19:01:03.158061] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-17T19:01:03.958022] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-17T19:01:04.049837] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T19:01:04.093489] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-17T19:01:04.758030] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-17T19:01:05.557997] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-17T19:01:05.688532] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T19:01:06.234103] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T19:01:06.358002] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-17T19:01:06.664335] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-17T19:01:07.158057] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-17T19:01:07.958042] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-17T19:01:08.338604] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-17T19:01:08.758085] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-17T19:01:08.891557] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T19:01:08.927797] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-17T19:01:09.558027] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-17T19:01:10.292744] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T19:01:10.358036] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-17T19:01:11.136898] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T19:01:11.157995] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-17T19:01:11.744992] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T19:01:11.751933] [INFO ] [REMOTE ] FR: Full fetch complete (67049 records). [2025-10-17T19:01:11.752086] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-17T19:01:11.963259] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-17T19:01:12.161557] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-17T19:01:12.161684] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-17T19:01:12.162609] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-17T19:01:12.162698] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-17T19:01:12.164176] [DEBUG] [LOCAL ] FR: Trimmed 67049 records to 47301 (keeping 200 days of data) [2025-10-17T19:01:12.455166] [DEBUG] [LOCAL ] FR: Primary data saved (47301 records). [2025-10-17T19:01:12.455308] [INFO ] [MAIN ] FR: Full history saved. [2025-10-17T19:01:12.455391] [INFO ] [MAIN ] Update Progress: 868/2368 symbols completed. FR took 37.7s. Estimated remaining: 3h 29m 21s. Rate: 7.2 symbols/min [2025-10-17T19:01:12.632429] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:01:12.657193] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T19:01:12.698334] [DEBUG] [LOCAL ] FSCO: Loaded 38807 existing records from primary storage. [2025-10-17T19:01:12.698711] [INFO ] [MAIN ] FSCO: Loaded 38807 existing records. [2025-10-17T19:01:12.762788] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-17T19:01:12.878817] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:01:12.879038] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-17T19:01:12.879102] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-17T19:01:12.879332] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-17T19:01:12.879400] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-17T19:01:13.104803] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T19:01:13.144475] [INFO ] [REMOTE ] FRGE: Full fetch complete (30671 records). [2025-10-17T19:01:13.166100] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-17T19:01:13.359824] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:01:13.563187] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-17T19:01:13.627140] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-17T19:01:13.627402] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-17T19:01:13.628144] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-17T19:01:13.628210] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-17T19:01:13.629144] [DEBUG] [LOCAL ] FRGE: Trimmed 30671 records to 16315 (keeping 200 days of data) [2025-10-17T19:01:13.725871] [DEBUG] [LOCAL ] FRGE: Primary data saved (16315 records). [2025-10-17T19:01:13.726010] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-17T19:01:13.726099] [INFO ] [MAIN ] Update Progress: 869/2368 symbols completed. FRGE took 34.0s. Estimated remaining: 3h 29m 0s. Rate: 7.2 symbols/min [2025-10-17T19:01:13.901801] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:01:13.952012] [DEBUG] [LOCAL ] FSK: Loaded 49891 existing records from primary storage. [2025-10-17T19:01:13.952333] [INFO ] [MAIN ] FSK: Loaded 49891 existing records. [2025-10-17T19:01:14.162753] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:01:14.162998] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-17T19:01:14.163047] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-17T19:01:14.163318] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-17T19:01:14.163377] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-17T19:01:14.379802] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-17T19:01:14.525392] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:01:14.879055] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-17T19:01:15.140397] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T19:01:15.157988] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-17T19:01:15.929372] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T19:01:15.957987] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-17T19:01:16.706822] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T19:01:16.757990] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-17T19:01:17.476781] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T19:01:17.558044] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-17T19:01:18.240874] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T19:01:18.358007] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-17T19:01:18.903300] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T19:01:19.158039] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-17T19:01:19.883063] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T19:01:19.888772] [INFO ] [REMOTE ] FRT: Full fetch complete (60545 records). [2025-10-17T19:01:19.888919] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-17T19:01:19.964381] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-17T19:01:20.275442] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-17T19:01:20.275529] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-17T19:01:20.276372] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-17T19:01:20.276435] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-17T19:01:20.277723] [DEBUG] [LOCAL ] FRT: Trimmed 60545 records to 42290 (keeping 200 days of data) [2025-10-17T19:01:20.539569] [DEBUG] [LOCAL ] FRT: Primary data saved (42290 records). [2025-10-17T19:01:20.539720] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-17T19:01:20.539834] [INFO ] [MAIN ] Update Progress: 870/2368 symbols completed. FRT took 24.6s. Estimated remaining: 3h 28m 49s. Rate: 7.2 symbols/min [2025-10-17T19:01:20.712923] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:01:20.748603] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T19:01:20.759000] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-17T19:01:20.794935] [DEBUG] [LOCAL ] FSLY: Loaded 51707 existing records from primary storage. [2025-10-17T19:01:20.795234] [INFO ] [MAIN ] FSLY: Loaded 51707 existing records. [2025-10-17T19:01:20.981431] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:01:20.981680] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-17T19:01:20.981740] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-17T19:01:20.982033] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-17T19:01:20.982073] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-17T19:01:21.346759] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:01:21.435765] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T19:01:21.557992] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-17T19:01:22.358012] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-17T19:01:22.485970] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T19:01:22.973908] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T19:01:23.158063] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-17T19:01:23.958053] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-17T19:01:24.055927] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T19:01:24.674063] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T19:01:24.758007] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-17T19:01:25.558039] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-17T19:01:25.850068] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T19:01:26.358077] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-17T19:01:26.702133] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T19:01:27.112303] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T19:01:27.158002] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-17T19:01:27.958059] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-17T19:01:28.212578] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T19:01:28.758009] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-17T19:01:29.000505] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T19:01:29.376141] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T19:01:29.558040] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-17T19:01:30.358023] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-17T19:01:30.568950] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-17T19:01:30.957786] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T19:01:31.158039] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-17T19:01:31.958082] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-17T19:01:32.512107] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-17T19:01:32.758003] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-17T19:01:33.122784] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-17T19:01:33.558040] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-17T19:01:34.358012] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-17T19:01:34.392864] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T19:01:34.504619] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-17T19:01:35.096860] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T19:01:35.158034] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-17T19:01:35.958107] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-17T19:01:36.210495] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T19:01:36.758045] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-17T19:01:36.854928] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T19:01:37.558050] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-17T19:01:37.741169] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T19:01:38.216918] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T19:01:38.358124] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-17T19:01:39.158050] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-17T19:01:39.590082] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-17T19:01:39.958032] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-17T19:01:40.395595] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-17T19:01:40.758034] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-17T19:01:40.978678] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T19:01:41.504840] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T19:01:41.557987] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-17T19:01:42.358004] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-17T19:01:42.439558] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T19:01:43.158052] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-17T19:01:43.246063] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T19:01:43.252396] [INFO ] [REMOTE ] FSCO: Full fetch complete (55364 records). [2025-10-17T19:01:43.252496] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-17T19:01:43.630851] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-17T19:01:43.630957] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-17T19:01:43.631870] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-17T19:01:43.631954] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-17T19:01:43.633401] [DEBUG] [LOCAL ] FSCO: Trimmed 55364 records to 39152 (keeping 200 days of data) [2025-10-17T19:01:43.865099] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T19:01:43.913419] [DEBUG] [LOCAL ] FSCO: Primary data saved (39152 records). [2025-10-17T19:01:43.913578] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-17T19:01:43.913692] [INFO ] [MAIN ] Update Progress: 871/2368 symbols completed. FSCO took 31.5s. Estimated remaining: 3h 29m 7s. Rate: 7.2 symbols/min [2025-10-17T19:01:43.963227] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-17T19:01:44.117178] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:01:44.173517] [DEBUG] [LOCAL ] FSM: Loaded 53691 existing records from primary storage. [2025-10-17T19:01:44.173942] [INFO ] [MAIN ] FSM: Loaded 53691 existing records. [2025-10-17T19:01:44.364213] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:01:44.364452] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-17T19:01:44.364502] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-17T19:01:44.364758] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-17T19:01:44.364816] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-17T19:01:44.723870] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:01:44.757992] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-17T19:01:44.947357] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-17T19:01:45.558045] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-17T19:01:45.886245] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T19:01:46.358076] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-17T19:01:46.446813] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T19:01:47.071047] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-17T19:01:47.158035] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-17T19:01:47.958043] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-17T19:01:48.264081] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T19:01:48.758013] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-17T19:01:49.074941] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T19:01:49.082331] [INFO ] [REMOTE ] FSK: Full fetch complete (72095 records). [2025-10-17T19:01:49.082471] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-17T19:01:49.479900] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-17T19:01:49.480079] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-17T19:01:49.481157] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-17T19:01:49.490983] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-17T19:01:49.510040] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T19:01:49.521257] [DEBUG] [LOCAL ] FSK: Trimmed 72095 records to 50273 (keeping 200 days of data) [2025-10-17T19:01:49.576046] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-17T19:01:49.833491] [DEBUG] [LOCAL ] FSK: Primary data saved (50273 records). [2025-10-17T19:01:49.833683] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-17T19:01:49.834306] [INFO ] [MAIN ] Update Progress: 872/2368 symbols completed. FSK took 36.1s. Estimated remaining: 3h 28m 54s. Rate: 7.2 symbols/min [2025-10-17T19:01:50.002787] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:01:50.038842] [DEBUG] [LOCAL ] FSS: Loaded 33877 existing records from primary storage. [2025-10-17T19:01:50.039140] [INFO ] [MAIN ] FSS: Loaded 33877 existing records. [2025-10-17T19:01:50.214219] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:01:50.214437] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-17T19:01:50.214485] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-17T19:01:50.214720] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-17T19:01:50.214794] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-17T19:01:50.362742] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-17T19:01:50.572788] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:01:50.751672] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-17T19:01:50.759204] [INFO ] [REMOTE ] FRO: Full fetch complete (75377 records). [2025-10-17T19:01:50.759343] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-17T19:01:51.154747] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-17T19:01:51.154861] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-17T19:01:51.155850] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-17T19:01:51.155999] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-17T19:01:51.157713] [DEBUG] [LOCAL ] FRO: Trimmed 75377 records to 52460 (keeping 200 days of data) [2025-10-17T19:01:51.158183] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-17T19:01:51.404865] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T19:01:51.522270] [DEBUG] [LOCAL ] FRO: Primary data saved (52460 records). [2025-10-17T19:01:51.522407] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-17T19:01:51.523015] [INFO ] [MAIN ] Update Progress: 873/2368 symbols completed. FRO took 56.9s. Estimated remaining: 3h 28m 34s. Rate: 7.2 symbols/min [2025-10-17T19:01:51.686910] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:01:51.696732] [DEBUG] [LOCAL ] FT: Loaded 6851 existing records from primary storage. [2025-10-17T19:01:51.696952] [INFO ] [MAIN ] FT: Loaded 6851 existing records. [2025-10-17T19:01:51.878044] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:01:51.878262] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-17T19:01:51.878310] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-17T19:01:51.878470] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-17T19:01:51.878525] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-17T19:01:51.958438] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-17T19:01:52.282718] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:01:52.312847] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-17T19:01:52.411414] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T19:01:52.758073] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-17T19:01:53.393766] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-17T19:01:53.558079] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-17T19:01:53.736618] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T19:01:54.263016] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-17T19:01:54.358033] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-17T19:01:55.158036] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-17T19:01:55.958072] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-17T19:01:56.189813] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T19:01:56.758063] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-17T19:01:56.999210] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T19:01:57.246771] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T19:01:57.359238] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-17T19:01:57.558042] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-17T19:01:58.358033] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-17T19:01:58.928747] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-17T19:01:58.950882] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T19:01:59.158024] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-17T19:01:59.958058] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-17T19:02:00.758052] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-17T19:02:01.558124] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-17T19:02:01.854481] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-17T19:02:01.862589] [INFO ] [REMOTE ] FSLY: Full fetch complete (74986 records). [2025-10-17T19:02:01.862907] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-17T19:02:02.269579] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-17T19:02:02.317491] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T19:02:02.333048] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-17T19:02:02.333365] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-17T19:02:02.334575] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-17T19:02:02.334703] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-17T19:02:02.336849] [DEBUG] [LOCAL ] FSLY: Trimmed 74986 records to 52088 (keeping 200 days of data) [2025-10-17T19:02:02.381828] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-17T19:02:02.631010] [DEBUG] [LOCAL ] FSLY: Primary data saved (52088 records). [2025-10-17T19:02:02.631152] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-17T19:02:02.631231] [INFO ] [MAIN ] Update Progress: 874/2368 symbols completed. FSLY took 42.1s. Estimated remaining: 3h 28m 30s. Rate: 7.2 symbols/min [2025-10-17T19:02:02.799303] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:02:02.812999] [DEBUG] [LOCAL ] FTHY: Loaded 12446 existing records from primary storage. [2025-10-17T19:02:02.813203] [INFO ] [MAIN ] FTHY: Loaded 12446 existing records. [2025-10-17T19:02:02.993364] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:02:02.993614] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-17T19:02:02.993694] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-17T19:02:02.993887] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-17T19:02:02.993945] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-17T19:02:03.166908] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-17T19:02:03.353147] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:02:03.892717] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-17T19:02:03.918874] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-17T19:02:03.957981] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-17T19:02:04.178223] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T19:02:04.758069] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-17T19:02:05.450857] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-17T19:02:05.480968] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T19:02:05.557991] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-17T19:02:06.247559] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-17T19:02:06.358024] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-17T19:02:07.158081] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-17T19:02:07.866550] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T19:02:07.958055] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-17T19:02:08.758126] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-17T19:02:08.978095] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T19:02:09.355169] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T19:02:09.558002] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-17T19:02:09.881074] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T19:02:10.358040] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-17T19:02:11.158012] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-17T19:02:11.369946] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T19:02:11.369691] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T19:02:11.958164] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-17T19:02:12.673288] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-17T19:02:12.758162] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-17T19:02:13.493809] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-17T19:02:13.558039] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-17T19:02:13.864600] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T19:02:14.358064] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-17T19:02:14.778705] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T19:02:15.158274] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-17T19:02:15.187064] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T19:02:15.958049] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-17T19:02:16.532491] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T19:02:16.639322] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T19:02:16.758239] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-17T19:02:17.501225] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-17T19:02:17.558041] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-17T19:02:18.358028] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-17T19:02:19.158086] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-17T19:02:19.185464] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-17T19:02:19.187869] [INFO ] [REMOTE ] FT: Full fetch complete (9305 records). [2025-10-17T19:02:19.187990] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-17T19:02:19.553981] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-17T19:02:19.554164] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-17T19:02:19.554597] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-17T19:02:19.554793] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-17T19:02:19.555614] [DEBUG] [LOCAL ] FT: Trimmed 9305 records to 6884 (keeping 200 days of data) [2025-10-17T19:02:19.609850] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-17T19:02:19.625045] [INFO ] [REMOTE ] FSM: Full fetch complete (77091 records). [2025-10-17T19:02:19.626427] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-17T19:02:19.734107] [DEBUG] [LOCAL ] FT: Primary data saved (6884 records). [2025-10-17T19:02:19.736499] [INFO ] [MAIN ] FT: Full history saved. [2025-10-17T19:02:19.736594] [INFO ] [MAIN ] Update Progress: 875/2368 symbols completed. FT took 28.2s. Estimated remaining: 3h 28m 37s. Rate: 7.2 symbols/min [2025-10-17T19:02:19.958735] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-17T19:02:20.068676] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:02:20.212524] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-17T19:02:20.213110] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-17T19:02:20.214082] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-17T19:02:20.214183] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-17T19:02:20.215835] [DEBUG] [LOCAL ] FSM: Trimmed 77091 records to 54081 (keeping 200 days of data) [2025-10-17T19:02:20.337119] [DEBUG] [LOCAL ] FTI: Loaded 53685 existing records from primary storage. [2025-10-17T19:02:20.338279] [INFO ] [MAIN ] FTI: Loaded 53685 existing records. [2025-10-17T19:02:20.546080] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:02:20.546374] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-17T19:02:20.546481] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-17T19:02:20.546893] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-17T19:02:20.546954] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-17T19:02:20.846764] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T19:02:20.903036] [INFO ] [REMOTE ] FSS: Full fetch complete (48628 records). [2025-10-17T19:02:20.923780] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-17T19:02:21.223985] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:02:21.286279] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-17T19:02:21.445003] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T19:02:21.558909] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-17T19:02:21.559481] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-17T19:02:21.559420] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-17T19:02:21.565017] [DEBUG] [LOCAL ] FSM: Primary data saved (54081 records). [2025-10-17T19:02:21.565334] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-17T19:02:21.565477] [INFO ] [MAIN ] Update Progress: 876/2368 symbols completed. FSM took 37.7s. Estimated remaining: 3h 28m 17s. Rate: 7.2 symbols/min [2025-10-17T19:02:21.566466] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-17T19:02:21.566568] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-17T19:02:21.660408] [DEBUG] [LOCAL ] FSS: Trimmed 48628 records to 34103 (keeping 200 days of data) [2025-10-17T19:02:21.846953] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:02:21.965535] [DEBUG] [LOCAL ] FSS: Primary data saved (34103 records). [2025-10-17T19:02:21.965972] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-17T19:02:21.966555] [INFO ] [MAIN ] Update Progress: 877/2368 symbols completed. FSS took 32.1s. Estimated remaining: 3h 27m 56s. Rate: 7.2 symbols/min [2025-10-17T19:02:21.997379] [DEBUG] [LOCAL ] FTK: Loaded 33095 existing records from primary storage. [2025-10-17T19:02:21.997807] [INFO ] [MAIN ] FTK: Loaded 33095 existing records. [2025-10-17T19:02:22.191369] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:02:22.191833] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-17T19:02:22.191908] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-17T19:02:22.192147] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-17T19:02:22.192207] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-17T19:02:22.418478] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-17T19:02:22.483921] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-17T19:02:22.565966] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:02:23.108977] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T19:02:23.158073] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-17T19:02:23.279309] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-17T19:02:23.958090] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-17T19:02:24.290095] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T19:02:24.748382] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T19:02:24.758014] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-17T19:02:25.558006] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-17T19:02:25.847207] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T19:02:26.358001] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-17T19:02:26.435277] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T19:02:27.158080] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-17T19:02:27.377101] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T19:02:27.958070] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-17T19:02:28.758124] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-17T19:02:28.817718] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T19:02:29.128258] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-17T19:02:29.548009] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T19:02:29.557999] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-17T19:02:30.358056] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-17T19:02:30.769619] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-17T19:02:31.158109] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-17T19:02:31.372693] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T19:02:31.376194] [INFO ] [REMOTE ] FTHY: Full fetch complete (17252 records). [2025-10-17T19:02:31.376303] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-17T19:02:31.730982] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-17T19:02:31.731061] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-17T19:02:31.731438] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-17T19:02:31.731477] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-17T19:02:31.732050] [DEBUG] [LOCAL ] FTHY: Trimmed 17252 records to 12522 (keeping 200 days of data) [2025-10-17T19:02:31.807347] [DEBUG] [LOCAL ] FTHY: Primary data saved (12522 records). [2025-10-17T19:02:31.807503] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-17T19:02:31.807596] [INFO ] [MAIN ] Update Progress: 878/2368 symbols completed. FTHY took 29.2s. Estimated remaining: 3h 27m 50s. Rate: 7.2 symbols/min [2025-10-17T19:02:31.958024] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-17T19:02:32.579406] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T19:02:32.758025] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-17T19:02:33.620117] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T19:02:33.630492] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-17T19:02:34.226132] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T19:02:34.357999] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-17T19:02:35.548238] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-17T19:02:35.559735] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-17T19:02:35.780394] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T19:02:35.958038] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-17T19:02:37.348804] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T19:02:37.360834] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-17T19:02:37.436214] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T19:02:37.558063] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-17T19:02:39.229067] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T19:02:39.236703] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-17T19:02:39.908076] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-17T19:02:39.920795] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-17T19:02:40.666295] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T19:02:40.671071] [INFO ] [REMOTE ] FTK: Full fetch complete (43984 records). [2025-10-17T19:02:40.671159] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-17T19:02:41.037869] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-17T19:02:41.037946] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-17T19:02:41.038633] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-17T19:02:41.038712] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-17T19:02:41.039670] [DEBUG] [LOCAL ] FTK: Trimmed 43984 records to 33277 (keeping 200 days of data) [2025-10-17T19:02:41.228381] [DEBUG] [LOCAL ] FTK: Primary data saved (33277 records). [2025-10-17T19:02:41.228529] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-17T19:02:41.228609] [INFO ] [MAIN ] Update Progress: 879/2368 symbols completed. FTK took 19.7s. Estimated remaining: 3h 27m 43s. Rate: 7.2 symbols/min [2025-10-17T19:02:41.581229] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T19:02:41.592358] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-17T19:02:43.464200] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-17T19:02:43.481305] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-17T19:02:45.167128] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T19:02:45.178439] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-17T19:02:47.127807] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T19:02:47.139180] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-17T19:02:49.063823] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T19:02:49.071343] [INFO ] [REMOTE ] FTI: Full fetch complete (77330 records). [2025-10-17T19:02:49.071482] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-17T19:02:49.479722] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-17T19:02:49.479803] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-17T19:02:49.481014] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-17T19:02:49.481084] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-17T19:02:49.482602] [DEBUG] [LOCAL ] FTI: Trimmed 77330 records to 54070 (keeping 200 days of data) [2025-10-17T19:02:49.811832] [DEBUG] [LOCAL ] FTI: Primary data saved (54070 records). [2025-10-17T19:02:49.811984] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-17T19:02:49.812067] [INFO ] [MAIN ] Update Progress: 880/2368 symbols completed. FTI took 30.1s. Estimated remaining: 3h 27m 35s. Rate: 7.2 symbols/min [2025-10-17T19:02:50.395994] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:02:50.514390] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:02:50.496713] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:02:50.553897] [DEBUG] [LOCAL ] FTWO: Loaded 1940 existing records from primary storage. [2025-10-17T19:02:50.585620] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:02:50.586173] [INFO ] [MAIN ] FTWO: Loaded 1940 existing records. [2025-10-17T19:02:50.829231] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:02:50.829821] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-17T19:02:50.829894] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-17T19:02:50.830616] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-17T19:02:50.830838] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-17T19:02:50.991114] [DEBUG] [LOCAL ] FTV: Loaded 53454 existing records from primary storage. [2025-10-17T19:02:50.989693] [DEBUG] [LOCAL ] FUBO: Loaded 54108 existing records from primary storage. [2025-10-17T19:02:50.991692] [INFO ] [MAIN ] FTV: Loaded 53454 existing records. [2025-10-17T19:02:50.992559] [DEBUG] [LOCAL ] FTS: Loaded 42838 existing records from primary storage. [2025-10-17T19:02:51.004366] [INFO ] [MAIN ] FTS: Loaded 42838 existing records. [2025-10-17T19:02:50.998216] [INFO ] [MAIN ] FUBO: Loaded 54108 existing records. [2025-10-17T19:02:51.631629] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:02:51.755961] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-17T19:02:51.743964] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:02:51.756180] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-17T19:02:51.789490] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-17T19:02:51.836669] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:02:51.836837] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-17T19:02:51.833124] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-17T19:02:51.837099] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-17T19:02:51.849101] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-17T19:02:51.842288] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-17T19:02:51.881240] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-17T19:02:51.881143] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-17T19:02:51.902017] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-17T19:02:51.907387] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-17T19:02:52.133909] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:02:52.199580] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-17T19:02:52.912938] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:02:52.943939] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-17T19:02:52.970341] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-17T19:02:52.991714] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-17T19:02:53.091493] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:02:53.092868] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-17T19:02:53.113716] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:02:53.114202] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-17T19:02:53.626587] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-17T19:02:53.628346] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-17T19:02:54.108929] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-17T19:02:54.110395] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-17T19:02:54.447366] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T19:02:54.455854] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-17T19:02:54.484113] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-17T19:02:54.485445] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-17T19:02:54.551008] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T19:02:54.561687] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-17T19:02:55.077323] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-17T19:02:55.078417] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-17T19:02:55.122938] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T19:02:55.133904] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-17T19:02:55.419323] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-17T19:02:55.420455] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-17T19:02:55.613020] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T19:02:55.622408] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-17T19:02:55.881206] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-17T19:02:55.882452] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-17T19:02:56.334723] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-17T19:02:56.336204] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-17T19:02:56.368870] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T19:02:56.379471] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-17T19:02:56.787432] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T19:02:56.788615] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-17T19:02:57.033573] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T19:02:57.146921] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-17T19:02:57.190427] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-17T19:02:57.557988] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-17T19:02:57.974416] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T19:02:58.358000] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-17T19:02:58.791981] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-17T19:02:58.793205] [INFO ] [REMOTE ] FTWO: Full fetch complete (3332 records). [2025-10-17T19:02:58.793302] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-17T19:02:59.146262] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-17T19:02:59.146347] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-17T19:02:59.146461] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-17T19:02:59.146500] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-17T19:02:59.146859] [DEBUG] [LOCAL ] FTWO: Trimmed 3332 records to 1965 (keeping 200 days of data) [2025-10-17T19:02:59.159289] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-17T19:02:59.159247] [DEBUG] [LOCAL ] FTWO: Primary data saved (1965 records). [2025-10-17T19:02:59.159443] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-17T19:02:59.160372] [INFO ] [MAIN ] Update Progress: 881/2368 symbols completed. FTWO took 9.3s. Estimated remaining: 3h 27m 28s. Rate: 7.2 symbols/min [2025-10-17T19:02:59.334284] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:02:59.366678] [DEBUG] [LOCAL ] FUL: Loaded 32565 existing records from primary storage. [2025-10-17T19:02:59.366963] [INFO ] [MAIN ] FUL: Loaded 32565 existing records. [2025-10-17T19:02:59.543784] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:02:59.543995] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-17T19:02:59.544052] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-17T19:02:59.544235] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-17T19:02:59.544285] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-17T19:02:59.904564] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:02:59.935127] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-17T19:02:59.957991] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-17T19:03:00.568606] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T19:03:00.758034] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-17T19:03:01.561707] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-17T19:03:02.366228] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-17T19:03:02.369917] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-17T19:03:03.158041] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-17T19:03:03.241570] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-17T19:03:03.335546] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T19:03:03.958136] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-17T19:03:04.098070] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T19:03:04.758043] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-17T19:03:04.963776] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T19:03:05.509957] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-17T19:03:05.558048] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-17T19:03:06.358019] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-17T19:03:06.598089] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T19:03:07.087051] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T19:03:07.157989] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-17T19:03:07.958068] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-17T19:03:08.619033] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T19:03:08.672170] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-17T19:03:08.758001] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-17T19:03:08.914279] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T19:03:09.558045] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-17T19:03:10.358032] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-17T19:03:10.925718] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-17T19:03:11.158047] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-17T19:03:11.305882] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T19:03:11.958047] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-17T19:03:12.035000] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T19:03:12.758037] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-17T19:03:13.528766] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-17T19:03:13.557990] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-17T19:03:13.605408] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T19:03:13.906461] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T19:03:14.358089] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-17T19:03:15.158042] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-17T19:03:15.939125] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-17T19:03:15.957988] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-17T19:03:16.016795] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T19:03:16.758014] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-17T19:03:16.999318] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T19:03:17.558036] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-17T19:03:18.234120] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T19:03:18.240101] [INFO ] [REMOTE ] FTS: Full fetch complete (60653 records). [2025-10-17T19:03:18.240229] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-17T19:03:18.363712] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-17T19:03:18.452697] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-17T19:03:18.676138] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-17T19:03:18.676224] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-17T19:03:18.677230] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-17T19:03:18.677317] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-17T19:03:18.678754] [DEBUG] [LOCAL ] FTS: Trimmed 60653 records to 43161 (keeping 200 days of data) [2025-10-17T19:03:18.940719] [DEBUG] [LOCAL ] FTS: Primary data saved (43161 records). [2025-10-17T19:03:18.940925] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-17T19:03:18.941119] [INFO ] [MAIN ] Update Progress: 882/2368 symbols completed. FTS took 29.1s. Estimated remaining: 3h 27m 39s. Rate: 7.2 symbols/min [2025-10-17T19:03:19.144551] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:03:19.166399] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-17T19:03:19.169027] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T19:03:19.221668] [DEBUG] [LOCAL ] FUN: Loaded 52299 existing records from primary storage. [2025-10-17T19:03:19.221983] [INFO ] [MAIN ] FUN: Loaded 52299 existing records. [2025-10-17T19:03:19.402004] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:03:19.402200] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-17T19:03:19.402254] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-17T19:03:19.402443] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-17T19:03:19.402481] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-17T19:03:19.764593] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:03:19.958042] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-17T19:03:20.225052] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T19:03:20.758077] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-17T19:03:21.458437] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T19:03:21.567342] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-17T19:03:21.572082] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-17T19:03:21.579947] [INFO ] [REMOTE ] FUBO: Full fetch complete (77868 records). [2025-10-17T19:03:21.580057] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-17T19:03:21.969164] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-17T19:03:21.969254] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-17T19:03:21.970218] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-17T19:03:21.970281] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-17T19:03:21.971722] [DEBUG] [LOCAL ] FUBO: Trimmed 77868 records to 54497 (keeping 200 days of data) [2025-10-17T19:03:22.279627] [DEBUG] [LOCAL ] FUBO: Primary data saved (54497 records). [2025-10-17T19:03:22.279784] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-17T19:03:22.280511] [INFO ] [MAIN ] Update Progress: 883/2368 symbols completed. FUBO took 32.5s. Estimated remaining: 3h 27m 22s. Rate: 7.2 symbols/min [2025-10-17T19:03:22.361042] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-17T19:03:22.458306] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:03:22.497164] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T19:03:22.525039] [DEBUG] [LOCAL ] FVR: Loaded 21309 existing records from primary storage. [2025-10-17T19:03:22.525309] [INFO ] [MAIN ] FVR: Loaded 21309 existing records. [2025-10-17T19:03:22.699454] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:03:22.699668] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-17T19:03:22.699729] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-17T19:03:22.699948] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-17T19:03:22.700003] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-17T19:03:23.059534] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:03:23.098921] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-17T19:03:23.157986] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-17T19:03:23.968183] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-17T19:03:23.970860] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T19:03:24.671472] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T19:03:24.758006] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-17T19:03:25.063201] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T19:03:25.558062] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-17T19:03:26.273429] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T19:03:26.358026] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-17T19:03:26.669470] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T19:03:27.158028] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-17T19:03:27.957999] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-17T19:03:28.055150] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T19:03:28.412377] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T19:03:28.758085] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-17T19:03:28.925256] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T19:03:29.558069] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-17T19:03:30.358035] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-17T19:03:30.422567] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T19:03:30.642201] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T19:03:31.158048] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-17T19:03:31.958053] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-17T19:03:32.222274] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-17T19:03:32.229723] [INFO ] [REMOTE ] FTV: Full fetch complete (76625 records). [2025-10-17T19:03:32.229854] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-17T19:03:32.623666] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-17T19:03:32.623754] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-17T19:03:32.624708] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-17T19:03:32.624775] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-17T19:03:32.626188] [DEBUG] [LOCAL ] FTV: Trimmed 76625 records to 53827 (keeping 200 days of data) [2025-10-17T19:03:32.758497] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-17T19:03:32.896988] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T19:03:32.897972] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T19:03:33.025245] [DEBUG] [LOCAL ] FTV: Primary data saved (53827 records). [2025-10-17T19:03:33.025397] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-17T19:03:33.025478] [INFO ] [MAIN ] Update Progress: 884/2368 symbols completed. FTV took 43.2s. Estimated remaining: 3h 27m 18s. Rate: 7.2 symbols/min [2025-10-17T19:03:33.198612] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:03:33.236789] [DEBUG] [LOCAL ] FVRR: Loaded 40901 existing records from primary storage. [2025-10-17T19:03:33.237130] [INFO ] [MAIN ] FVRR: Loaded 40901 existing records. [2025-10-17T19:03:33.413536] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:03:33.413787] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-17T19:03:33.413856] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-17T19:03:33.414116] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-17T19:03:33.414187] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-17T19:03:33.570494] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-17T19:03:33.780868] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:03:34.110419] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-17T19:03:34.358066] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-17T19:03:34.750582] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-17T19:03:35.158038] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-17T19:03:35.958063] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-17T19:03:36.120947] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T19:03:36.575743] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T19:03:36.758250] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-17T19:03:37.333093] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T19:03:37.558041] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-17T19:03:38.194719] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T19:03:38.201780] [INFO ] [REMOTE ] FUL: Full fetch complete (47816 records). [2025-10-17T19:03:38.201953] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-17T19:03:38.363243] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-17T19:03:38.608374] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-17T19:03:38.608470] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-17T19:03:38.609251] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-17T19:03:38.609319] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-17T19:03:38.610523] [DEBUG] [LOCAL ] FUL: Trimmed 47816 records to 32752 (keeping 200 days of data) [2025-10-17T19:03:38.834617] [DEBUG] [LOCAL ] FUL: Primary data saved (32752 records). [2025-10-17T19:03:38.834885] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-17T19:03:38.835050] [INFO ] [MAIN ] Update Progress: 885/2368 symbols completed. FUL took 39.7s. Estimated remaining: 3h 27m 5s. Rate: 7.2 symbols/min [2025-10-17T19:03:39.056010] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:03:39.059912] [DEBUG] [LOCAL ] FXED: Loaded 1251 existing records from primary storage. [2025-10-17T19:03:39.060053] [INFO ] [MAIN ] FXED: Loaded 1251 existing records. [2025-10-17T19:03:39.162156] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-17T19:03:39.258666] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:03:39.259590] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-17T19:03:39.259773] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-17T19:03:39.259996] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-17T19:03:39.260104] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-17T19:03:39.474631] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T19:03:39.674078] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:03:39.687533] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-17T19:03:39.958034] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-17T19:03:40.309615] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-17T19:03:40.758005] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-17T19:03:40.812921] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T19:03:41.558052] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-17T19:03:41.985238] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-17T19:03:42.358018] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-17T19:03:42.544809] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T19:03:43.158037] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-17T19:03:43.957306] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T19:03:43.965100] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-17T19:03:44.298271] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-17T19:03:44.758014] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-17T19:03:44.963270] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:03:44.970947] [INFO ] [REMOTE ] FUN: Full fetch complete (73407 records). [2025-10-17T19:03:44.971069] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-17T19:03:45.133198] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-17T19:03:45.384201] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-17T19:03:45.384305] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-17T19:03:45.385289] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-17T19:03:45.385355] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-17T19:03:45.386740] [DEBUG] [LOCAL ] FUN: Trimmed 73407 records to 52679 (keeping 200 days of data) [2025-10-17T19:03:45.560218] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-17T19:03:45.695325] [DEBUG] [LOCAL ] FUN: Primary data saved (52679 records). [2025-10-17T19:03:45.695462] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-17T19:03:45.696029] [INFO ] [MAIN ] Update Progress: 886/2368 symbols completed. FUN took 26.8s. Estimated remaining: 3h 26m 54s. Rate: 7.2 symbols/min [2025-10-17T19:03:45.862866] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:03:45.908313] [DEBUG] [LOCAL ] G: Loaded 50433 existing records from primary storage. [2025-10-17T19:03:45.908614] [INFO ] [MAIN ] G: Loaded 50433 existing records. [2025-10-17T19:03:46.086288] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:03:46.086515] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-17T19:03:46.086604] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-17T19:03:46.086867] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-17T19:03:46.086926] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-17T19:03:46.363632] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-17T19:03:46.442706] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:03:46.820512] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-17T19:03:47.158022] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-17T19:03:47.198353] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T19:03:47.958049] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-17T19:03:48.763112] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-17T19:03:48.770964] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T19:03:48.958895] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T19:03:49.558035] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-17T19:03:49.906031] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T19:03:49.909691] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-17T19:03:50.358061] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-17T19:03:51.158050] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-17T19:03:51.554238] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-17T19:03:51.558130] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T19:03:51.958028] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-17T19:03:52.758038] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-17T19:03:53.029027] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T19:03:53.558032] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-17T19:03:54.233596] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T19:03:54.358014] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-17T19:03:54.600177] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T19:03:55.158062] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-17T19:03:55.828936] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T19:03:55.958012] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-17T19:03:56.677276] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T19:03:56.758035] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-17T19:03:56.906630] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-17T19:03:57.558040] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-17T19:03:58.358064] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-17T19:03:58.418903] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T19:03:59.148102] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T19:03:59.158080] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-17T19:03:59.347028] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T19:03:59.349705] [INFO ] [REMOTE ] FVR: Full fetch complete (29542 records). [2025-10-17T19:03:59.349779] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-17T19:03:59.713930] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-17T19:03:59.714011] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-17T19:03:59.714598] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-17T19:03:59.714638] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-17T19:03:59.715406] [DEBUG] [LOCAL ] FVR: Trimmed 29542 records to 21415 (keeping 200 days of data) [2025-10-17T19:03:59.844673] [DEBUG] [LOCAL ] FVR: Primary data saved (21415 records). [2025-10-17T19:03:59.844811] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-17T19:03:59.844897] [INFO ] [MAIN ] Update Progress: 887/2368 symbols completed. FVR took 37.6s. Estimated remaining: 3h 26m 56s. Rate: 7.2 symbols/min [2025-10-17T19:03:59.963184] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-17T19:04:00.029132] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:04:00.059464] [DEBUG] [LOCAL ] GAB: Loaded 27933 existing records from primary storage. [2025-10-17T19:04:00.059796] [INFO ] [MAIN ] GAB: Loaded 27933 existing records. [2025-10-17T19:04:00.242513] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:04:00.242762] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-17T19:04:00.242814] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-17T19:04:00.243060] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-17T19:04:00.243116] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-17T19:04:00.595630] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:04:00.758036] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-17T19:04:01.561226] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-17T19:04:01.579954] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-17T19:04:01.906190] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T19:04:01.968914] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-17T19:04:02.358002] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-17T19:04:02.785242] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-17T19:04:02.811830] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T19:04:03.158030] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-17T19:04:03.606737] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-17T19:04:03.958012] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-17T19:04:04.758008] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-17T19:04:05.079290] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T19:04:05.558028] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-17T19:04:06.358042] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-17T19:04:06.745436] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T19:04:07.067822] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-17T19:04:07.104969] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-17T19:04:07.106098] [INFO ] [REMOTE ] FXED: Full fetch complete (1786 records). [2025-10-17T19:04:07.106190] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-17T19:04:07.166561] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-17T19:04:07.509796] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-17T19:04:07.509885] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-17T19:04:07.509991] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-17T19:04:07.510071] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-17T19:04:07.510465] [DEBUG] [LOCAL ] FXED: Trimmed 1786 records to 1259 (keeping 200 days of data) [2025-10-17T19:04:07.519118] [DEBUG] [LOCAL ] FXED: Primary data saved (1259 records). [2025-10-17T19:04:07.519181] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-17T19:04:07.519250] [INFO ] [MAIN ] Update Progress: 888/2368 symbols completed. FXED took 28.7s. Estimated remaining: 3h 26m 46s. Rate: 7.2 symbols/min [2025-10-17T19:04:07.707377] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:04:07.714602] [DEBUG] [LOCAL ] GAM: Loaded 3940 existing records from primary storage. [2025-10-17T19:04:07.714853] [INFO ] [MAIN ] GAM: Loaded 3940 existing records. [2025-10-17T19:04:07.909103] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:04:07.909368] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-17T19:04:07.909436] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-17T19:04:07.909579] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-17T19:04:07.909635] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-17T19:04:07.970157] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-17T19:04:08.265573] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:04:08.758103] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-17T19:04:08.878275] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T19:04:09.559916] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-17T19:04:09.563108] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T19:04:09.822395] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T19:04:09.829556] [INFO ] [REMOTE ] FVRR: Full fetch complete (59300 records). [2025-10-17T19:04:09.829802] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-17T19:04:10.242198] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-17T19:04:10.242274] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-17T19:04:10.243130] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-17T19:04:10.243192] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-17T19:04:10.244304] [DEBUG] [LOCAL ] FVRR: Trimmed 59300 records to 41187 (keeping 200 days of data) [2025-10-17T19:04:10.358134] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-17T19:04:10.486702] [DEBUG] [LOCAL ] FVRR: Primary data saved (41187 records). [2025-10-17T19:04:10.486833] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-17T19:04:10.486916] [INFO ] [MAIN ] Update Progress: 889/2368 symbols completed. FVRR took 37.5s. Estimated remaining: 3h 26m 29s. Rate: 7.2 symbols/min [2025-10-17T19:04:10.668327] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:04:10.724372] [DEBUG] [LOCAL ] GAP: Loaded 54043 existing records from primary storage. [2025-10-17T19:04:10.724797] [INFO ] [MAIN ] GAP: Loaded 54043 existing records. [2025-10-17T19:04:10.927130] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:04:10.927401] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-17T19:04:10.927455] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-17T19:04:10.927896] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-17T19:04:10.927969] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-17T19:04:11.163145] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-17T19:04:11.294794] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:04:11.321427] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T19:04:11.487417] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T19:04:11.828685] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-17T19:04:11.957999] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-17T19:04:12.758033] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-17T19:04:13.389593] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T19:04:13.558020] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-17T19:04:13.739018] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T19:04:14.358027] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-17T19:04:15.079258] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-17T19:04:15.157988] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-17T19:04:15.292452] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T19:04:15.769504] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T19:04:15.957999] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-17T19:04:16.600573] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-17T19:04:16.758021] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-17T19:04:17.558009] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-17T19:04:17.992822] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-17T19:04:18.124355] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-17T19:04:18.358049] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-17T19:04:19.158044] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-17T19:04:19.788064] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-17T19:04:19.958054] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-17T19:04:20.019528] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T19:04:20.540415] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T19:04:20.758042] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-17T19:04:21.237773] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-17T19:04:21.558024] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-17T19:04:22.358114] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-17T19:04:23.158083] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-17T19:04:23.209966] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T19:04:23.213870] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T19:04:23.214017] [INFO ] [REMOTE ] GAM: Full fetch complete (6510 records). [2025-10-17T19:04:23.224187] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-17T19:04:23.594853] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-17T19:04:23.594974] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-17T19:04:23.595187] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-17T19:04:23.595229] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-17T19:04:23.595638] [DEBUG] [LOCAL ] GAM: Trimmed 6510 records to 3971 (keeping 200 days of data) [2025-10-17T19:04:23.619237] [DEBUG] [LOCAL ] GAM: Primary data saved (3971 records). [2025-10-17T19:04:23.619378] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-17T19:04:23.619462] [INFO ] [MAIN ] Update Progress: 890/2368 symbols completed. GAM took 16.1s. Estimated remaining: 3h 26m 28s. Rate: 7.2 symbols/min [2025-10-17T19:04:23.787340] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:04:23.810715] [DEBUG] [LOCAL ] GATX: Loaded 18184 existing records from primary storage. [2025-10-17T19:04:23.811002] [INFO ] [MAIN ] GATX: Loaded 18184 existing records. [2025-10-17T19:04:23.963785] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-17T19:04:23.996523] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:04:23.996800] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-17T19:04:23.996889] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-17T19:04:23.997219] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-17T19:04:23.997305] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-17T19:04:24.386811] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:04:24.607389] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T19:04:24.758028] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-17T19:04:25.558035] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-17T19:04:25.688044] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T19:04:26.358094] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-17T19:04:26.581074] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-17T19:04:26.606564] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T19:04:26.614184] [INFO ] [REMOTE ] G: Full fetch complete (72206 records). [2025-10-17T19:04:26.614355] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-17T19:04:27.002347] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-17T19:04:27.002440] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-17T19:04:27.003391] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-17T19:04:27.003454] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-17T19:04:27.004848] [DEBUG] [LOCAL ] G: Trimmed 72206 records to 50816 (keeping 200 days of data) [2025-10-17T19:04:27.178950] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-17T19:04:27.311329] [DEBUG] [LOCAL ] G: Primary data saved (50816 records). [2025-10-17T19:04:27.311470] [INFO ] [MAIN ] G: Full history saved. [2025-10-17T19:04:27.311970] [INFO ] [MAIN ] Update Progress: 891/2368 symbols completed. G took 41.6s. Estimated remaining: 3h 26m 12s. Rate: 7.2 symbols/min [2025-10-17T19:04:27.487138] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:04:27.504383] [DEBUG] [LOCAL ] GBAB: Loaded 12918 existing records from primary storage. [2025-10-17T19:04:27.504608] [INFO ] [MAIN ] GBAB: Loaded 12918 existing records. [2025-10-17T19:04:27.664667] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T19:04:27.711703] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:04:27.712400] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-17T19:04:27.712461] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-17T19:04:27.713053] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-17T19:04:27.713112] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-17T19:04:27.963168] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-17T19:04:28.064330] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:04:28.256888] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T19:04:28.758103] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-17T19:04:29.185035] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T19:04:29.558041] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-17T19:04:29.657191] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-17T19:04:30.358032] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-17T19:04:30.613995] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T19:04:31.090804] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T19:04:31.157998] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-17T19:04:31.958041] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-17T19:04:32.027344] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T19:04:32.758047] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-17T19:04:32.783998] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T19:04:33.558008] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-17T19:04:33.595145] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-17T19:04:34.358065] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-17T19:04:35.037704] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T19:04:35.136506] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-17T19:04:35.158016] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-17T19:04:35.958052] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-17T19:04:36.127902] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T19:04:36.758082] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-17T19:04:37.558018] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-17T19:04:37.869949] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T19:04:38.005289] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-17T19:04:38.308707] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T19:04:38.358048] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-17T19:04:39.158016] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-17T19:04:39.474421] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T19:04:39.958061] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-17T19:04:40.540534] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T19:04:40.758041] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-17T19:04:41.558034] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-17T19:04:41.645851] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T19:04:41.930222] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T19:04:42.358045] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-17T19:04:42.823398] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T19:04:42.827459] [INFO ] [REMOTE ] GAB: Full fetch complete (39395 records). [2025-10-17T19:04:42.827538] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-17T19:04:43.166854] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-17T19:04:43.199569] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-17T19:04:43.199690] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-17T19:04:43.200416] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-17T19:04:43.200460] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-17T19:04:43.201394] [DEBUG] [LOCAL ] GAB: Trimmed 39395 records to 28162 (keeping 200 days of data) [2025-10-17T19:04:43.301510] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-17T19:04:43.381258] [DEBUG] [LOCAL ] GAB: Primary data saved (28162 records). [2025-10-17T19:04:43.381414] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-17T19:04:43.381520] [INFO ] [MAIN ] Update Progress: 892/2368 symbols completed. GAB took 43.5s. Estimated remaining: 3h 26m 16s. Rate: 7.2 symbols/min [2025-10-17T19:04:43.545463] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:04:43.585016] [DEBUG] [LOCAL ] GBCI: Loaded 41242 existing records from primary storage. [2025-10-17T19:04:43.585311] [INFO ] [MAIN ] GBCI: Loaded 41242 existing records. [2025-10-17T19:04:43.756668] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:04:43.756904] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-17T19:04:43.756950] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-17T19:04:43.757274] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-17T19:04:43.757332] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-17T19:04:43.968329] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-17T19:04:44.125484] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:04:44.757996] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-17T19:04:44.848371] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T19:04:45.125519] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T19:04:45.558005] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-17T19:04:45.773305] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T19:04:46.203678] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-17T19:04:46.358027] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-17T19:04:47.158028] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-17T19:04:47.363061] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T19:04:47.958029] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-17T19:04:48.560760] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T19:04:48.758012] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-17T19:04:49.077127] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T19:04:49.558028] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-17T19:04:50.189695] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T19:04:50.244505] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-17T19:04:50.358021] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-17T19:04:51.158035] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-17T19:04:51.958003] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-17T19:04:52.400865] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T19:04:52.402550] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-17T19:04:52.415566] [INFO ] [REMOTE ] GBAB: Full fetch complete (18875 records). [2025-10-17T19:04:52.415755] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-17T19:04:52.771855] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-17T19:04:52.784122] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-17T19:04:52.784196] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-17T19:04:52.784718] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-17T19:04:52.784785] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-17T19:04:52.785675] [DEBUG] [LOCAL ] GBAB: Trimmed 18875 records to 12974 (keeping 200 days of data) [2025-10-17T19:04:52.869062] [DEBUG] [LOCAL ] GBAB: Primary data saved (12974 records). [2025-10-17T19:04:52.869269] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-17T19:04:52.869469] [INFO ] [MAIN ] Update Progress: 893/2368 symbols completed. GBAB took 25.6s. Estimated remaining: 3h 26m 10s. Rate: 7.2 symbols/min [2025-10-17T19:04:53.037879] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:04:53.038088] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-17T19:04:53.038184] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-17T19:04:53.038412] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-17T19:04:53.038545] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-17T19:04:53.038613] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-17T19:04:53.038750] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-17T19:04:53.150596] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T19:04:53.416156] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:04:53.558052] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-17T19:04:54.358052] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-17T19:04:54.745164] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-17T19:04:54.774079] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-17T19:04:54.950830] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T19:04:55.158062] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-17T19:04:55.564373] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-17T19:04:55.958031] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-17T19:04:56.193066] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-17T19:04:56.758011] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-17T19:04:57.558066] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-17T19:04:58.358014] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-17T19:04:58.618845] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-17T19:04:58.621295] [INFO ] [REMOTE ] GATX: Full fetch complete (24854 records). [2025-10-17T19:04:58.621379] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-17T19:04:59.047899] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-17T19:04:59.048857] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-17T19:04:59.049547] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-17T19:04:59.051515] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-17T19:04:59.051385] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-17T19:04:59.064107] [DEBUG] [LOCAL ] GATX: Trimmed 24854 records to 18269 (keeping 200 days of data) [2025-10-17T19:04:59.159052] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-17T19:04:59.189750] [DEBUG] [LOCAL ] GATX: Primary data saved (18269 records). [2025-10-17T19:04:59.189981] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-17T19:04:59.190139] [INFO ] [MAIN ] Update Progress: 894/2368 symbols completed. GATX took 35.6s. Estimated remaining: 3h 25m 58s. Rate: 7.2 symbols/min [2025-10-17T19:04:59.366563] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:04:59.406822] [DEBUG] [LOCAL ] GBTG: Loaded 40545 existing records from primary storage. [2025-10-17T19:04:59.407352] [INFO ] [MAIN ] GBTG: Loaded 40545 existing records. [2025-10-17T19:04:59.592719] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:04:59.593153] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-17T19:04:59.593277] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-17T19:04:59.593684] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-17T19:04:59.593833] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-17T19:04:59.863837] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T19:04:59.973738] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-17T19:05:00.017758] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:05:00.758026] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-17T19:05:01.558075] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-17T19:05:01.679911] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-17T19:05:01.869279] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T19:05:02.068241] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-17T19:05:02.358110] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-17T19:05:02.797015] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-17T19:05:03.158077] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-17T19:05:03.440179] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-17T19:05:03.459124] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-17T19:05:03.958046] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-17T19:05:04.239998] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-17T19:05:04.758055] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-17T19:05:05.558058] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-17T19:05:06.358038] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-17T19:05:06.717756] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-17T19:05:06.941475] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-17T19:05:06.950575] [INFO ] [REMOTE ] GAP: Full fetch complete (77812 records). [2025-10-17T19:05:06.950836] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-17T19:05:07.126174] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T19:05:07.166831] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-17T19:05:07.402866] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-17T19:05:07.402995] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-17T19:05:07.404117] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-17T19:05:07.404184] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-17T19:05:07.405799] [DEBUG] [LOCAL ] GAP: Trimmed 77812 records to 54433 (keeping 200 days of data) [2025-10-17T19:05:07.748498] [DEBUG] [LOCAL ] GAP: Primary data saved (54433 records). [2025-10-17T19:05:07.748708] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-17T19:05:07.748860] [INFO ] [MAIN ] Update Progress: 895/2368 symbols completed. GAP took 57.3s. Estimated remaining: 3h 25m 50s. Rate: 7.2 symbols/min [2025-10-17T19:05:07.914354] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:05:07.945389] [DEBUG] [LOCAL ] GBX: Loaded 29120 existing records from primary storage. [2025-10-17T19:05:07.945701] [INFO ] [MAIN ] GBX: Loaded 29120 existing records. [2025-10-17T19:05:07.966078] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-17T19:05:08.124156] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:05:08.124366] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-17T19:05:08.124413] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-17T19:05:08.124627] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-17T19:05:08.124712] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-17T19:05:08.473552] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:05:08.654896] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T19:05:08.758009] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-17T19:05:09.558008] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-17T19:05:09.655125] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T19:05:10.003297] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T19:05:10.079896] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T19:05:10.358041] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-17T19:05:11.158039] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-17T19:05:11.941514] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T19:05:11.957994] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-17T19:05:12.725377] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T19:05:12.757989] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-17T19:05:13.119791] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-17T19:05:13.408811] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T19:05:13.558000] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-17T19:05:14.358078] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-17T19:05:15.158002] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-17T19:05:15.181757] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T19:05:15.576007] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-17T19:05:15.576746] [INFO ] [REMOTE ] GBLI: Full fetch complete (1273 records). [2025-10-17T19:05:15.576833] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-17T19:05:15.809290] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-10-17T19:05:15.809623] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:05:15.809780] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:05:15.809912] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-17T19:05:15.810112] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-17T19:05:15.810183] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-17T19:05:15.810365] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-17T19:05:15.810445] [INFO ] [MAIN ] Update Progress: 896/2368 symbols completed. GBLI took 22.9s. Estimated remaining: 3h 25m 41s. Rate: 7.2 symbols/min [2025-10-17T19:05:15.961910] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-17T19:05:15.980062] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:05:16.006357] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T19:05:16.055568] [DEBUG] [LOCAL ] GCI: Loaded 44182 existing records from primary storage. [2025-10-17T19:05:16.055894] [INFO ] [MAIN ] GCI: Loaded 44182 existing records. [2025-10-17T19:05:16.227111] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:05:16.227346] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-17T19:05:16.227415] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-17T19:05:16.227795] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-17T19:05:16.227853] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-17T19:05:16.577676] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:05:16.758005] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-17T19:05:17.174995] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-17T19:05:17.558028] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-17T19:05:18.259630] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T19:05:18.358017] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-17T19:05:18.426837] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T19:05:19.158070] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-17T19:05:19.786361] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T19:05:19.958040] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-17T19:05:20.758024] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-17T19:05:20.960128] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T19:05:20.968520] [INFO ] [REMOTE ] GBCI: Full fetch complete (59214 records). [2025-10-17T19:05:20.968832] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-17T19:05:21.412451] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-17T19:05:21.412674] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-17T19:05:21.414499] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-17T19:05:21.414608] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-17T19:05:21.416666] [DEBUG] [LOCAL ] GBCI: Trimmed 59214 records to 41621 (keeping 200 days of data) [2025-10-17T19:05:21.556601] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T19:05:21.560980] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-17T19:05:21.745564] [DEBUG] [LOCAL ] GBCI: Primary data saved (41621 records). [2025-10-17T19:05:21.745762] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-17T19:05:21.746430] [INFO ] [MAIN ] Update Progress: 897/2368 symbols completed. GBCI took 38.4s. Estimated remaining: 3h 25m 29s. Rate: 7.2 symbols/min [2025-10-17T19:05:21.974148] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:05:22.011523] [DEBUG] [LOCAL ] GCO: Loaded 23761 existing records from primary storage. [2025-10-17T19:05:22.011942] [INFO ] [MAIN ] GCO: Loaded 23761 existing records. [2025-10-17T19:05:22.307244] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:05:22.323250] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-17T19:05:22.325712] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T19:05:22.324234] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-17T19:05:22.333171] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-17T19:05:22.333700] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-17T19:05:22.363368] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-17T19:05:22.862375] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:05:23.082456] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-17T19:05:23.158081] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-17T19:05:23.778155] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T19:05:23.958049] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-17T19:05:24.214984] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T19:05:24.758044] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-17T19:05:25.558013] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-17T19:05:26.050147] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-17T19:05:26.358017] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-17T19:05:26.416907] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T19:05:26.833849] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T19:05:27.158070] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-17T19:05:27.744944] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T19:05:27.958081] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-17T19:05:28.317721] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T19:05:28.758084] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-17T19:05:29.332533] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T19:05:29.560810] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-17T19:05:29.879126] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T19:05:30.358025] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-17T19:05:31.106066] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T19:05:31.158016] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-17T19:05:31.401014] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T19:05:31.958059] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-17T19:05:32.622564] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T19:05:32.628296] [INFO ] [REMOTE ] GBTG: Full fetch complete (56752 records). [2025-10-17T19:05:32.628407] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-17T19:05:32.765091] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-17T19:05:33.011715] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-17T19:05:33.011786] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-17T19:05:33.012564] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-17T19:05:33.012605] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-17T19:05:33.013759] [DEBUG] [LOCAL ] GBTG: Trimmed 56752 records to 40850 (keeping 200 days of data) [2025-10-17T19:05:33.239253] [DEBUG] [LOCAL ] GBTG: Primary data saved (40850 records). [2025-10-17T19:05:33.239414] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-17T19:05:33.239510] [INFO ] [MAIN ] Update Progress: 898/2368 symbols completed. GBTG took 34.0s. Estimated remaining: 3h 25m 25s. Rate: 7.2 symbols/min [2025-10-17T19:05:33.411121] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T19:05:33.436875] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:05:33.468635] [DEBUG] [LOCAL ] GCTS: Loaded 20570 existing records from primary storage. [2025-10-17T19:05:33.468985] [INFO ] [MAIN ] GCTS: Loaded 20570 existing records. [2025-10-17T19:05:33.563136] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-17T19:05:33.658873] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:05:33.659095] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-17T19:05:33.659143] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-17T19:05:33.659439] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-17T19:05:33.659499] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-17T19:05:34.036661] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:05:34.263832] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T19:05:34.358004] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-17T19:05:34.706686] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T19:05:35.130609] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T19:05:35.157992] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-17T19:05:35.958042] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-17T19:05:36.252519] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T19:05:36.704367] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T19:05:36.757997] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-17T19:05:37.558025] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-17T19:05:38.042497] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T19:05:38.358042] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-17T19:05:38.573112] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T19:05:38.578854] [INFO ] [REMOTE ] GBX: Full fetch complete (42863 records). [2025-10-17T19:05:38.578987] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-17T19:05:38.965548] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-17T19:05:38.965626] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-17T19:05:38.966368] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-17T19:05:38.966420] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-17T19:05:38.967371] [DEBUG] [LOCAL ] GBX: Trimmed 42863 records to 29290 (keeping 200 days of data) [2025-10-17T19:05:39.138337] [DEBUG] [LOCAL ] GBX: Primary data saved (29290 records). [2025-10-17T19:05:39.138463] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-17T19:05:39.138544] [INFO ] [MAIN ] Update Progress: 899/2368 symbols completed. GBX took 31.4s. Estimated remaining: 3h 25m 13s. Rate: 7.2 symbols/min [2025-10-17T19:05:39.163160] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-17T19:05:39.312898] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:05:39.322319] [DEBUG] [LOCAL ] GCV: Loaded 7864 existing records from primary storage. [2025-10-17T19:05:39.322502] [INFO ] [MAIN ] GCV: Loaded 7864 existing records. [2025-10-17T19:05:39.421862] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T19:05:39.511908] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:05:39.512189] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-17T19:05:39.512238] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-17T19:05:39.512381] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-17T19:05:39.512420] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-17T19:05:39.886862] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:05:39.958036] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-17T19:05:40.564970] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-17T19:05:40.631958] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T19:05:40.758016] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-17T19:05:41.365118] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-17T19:05:41.558057] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-17T19:05:42.358090] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-17T19:05:43.118887] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:05:43.158019] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-17T19:05:43.502701] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T19:05:43.958043] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-17T19:05:44.696956] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T19:05:44.758065] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-17T19:05:45.009706] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T19:05:45.558035] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-17T19:05:45.970684] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T19:05:46.217874] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-17T19:05:46.358019] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-17T19:05:47.158019] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-17T19:05:47.286894] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-17T19:05:47.958010] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-17T19:05:48.196871] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T19:05:48.758029] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-17T19:05:48.932206] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T19:05:49.558004] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-17T19:05:49.687252] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T19:05:50.358039] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-17T19:05:50.726042] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T19:05:50.766508] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-17T19:05:51.158028] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-17T19:05:51.914862] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T19:05:51.958019] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-17T19:05:52.758050] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-17T19:05:53.558035] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-17T19:05:53.658862] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T19:05:53.828796] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T19:05:54.358081] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-17T19:05:54.787004] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-17T19:05:55.158007] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-17T19:05:55.454493] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T19:05:55.457129] [INFO ] [REMOTE ] GCO: Full fetch complete (34981 records). [2025-10-17T19:05:55.457204] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-17T19:05:55.822471] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-17T19:05:55.822549] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-17T19:05:55.823232] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-17T19:05:55.823295] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-17T19:05:55.824106] [DEBUG] [LOCAL ] GCO: Trimmed 34981 records to 23845 (keeping 200 days of data) [2025-10-17T19:05:55.957033] [DEBUG] [LOCAL ] GCO: Primary data saved (23845 records). [2025-10-17T19:05:55.957162] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-17T19:05:55.957243] [INFO ] [MAIN ] Update Progress: 900/2368 symbols completed. GCO took 34.2s. Estimated remaining: 3h 25m 18s. Rate: 7.2 symbols/min [2025-10-17T19:05:55.968242] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-17T19:05:56.124787] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:05:56.171963] [DEBUG] [LOCAL ] GD: Loaded 47051 existing records from primary storage. [2025-10-17T19:05:56.172265] [INFO ] [MAIN ] GD: Loaded 47051 existing records. [2025-10-17T19:05:56.344195] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:05:56.344401] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-17T19:05:56.344447] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-17T19:05:56.344842] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-17T19:05:56.344900] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-17T19:05:56.710073] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:05:56.748615] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T19:05:56.763120] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-17T19:05:56.777330] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T19:05:57.558027] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-17T19:05:57.837161] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T19:05:58.358077] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-17T19:05:59.044910] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-17T19:05:59.164279] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-17T19:05:59.182466] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T19:05:59.923993] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T19:05:59.957989] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-17T19:06:00.758003] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-17T19:06:01.004524] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T19:06:01.558032] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-17T19:06:02.358020] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-17T19:06:02.789162] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-17T19:06:03.158069] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-17T19:06:03.333308] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-17T19:06:03.516452] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-10-17T19:06:03.943593] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T19:06:03.945670] [INFO ] [REMOTE ] GCV: Full fetch complete (9854 records). [2025-10-17T19:06:03.945779] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-17T19:06:03.963217] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-17T19:06:04.308842] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-17T19:06:04.308926] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-17T19:06:04.309250] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-17T19:06:04.309322] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-17T19:06:04.310145] [DEBUG] [LOCAL ] GCV: Trimmed 9854 records to 7903 (keeping 200 days of data) [2025-10-17T19:06:04.356962] [DEBUG] [LOCAL ] GCV: Primary data saved (7903 records). [2025-10-17T19:06:04.357106] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-17T19:06:04.357190] [INFO ] [MAIN ] Update Progress: 901/2368 symbols completed. GCV took 25.2s. Estimated remaining: 3h 25m 10s. Rate: 7.2 symbols/min [2025-10-17T19:06:04.525767] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:06:04.572798] [DEBUG] [LOCAL ] GDDY: Loaded 50151 existing records from primary storage. [2025-10-17T19:06:04.573145] [INFO ] [MAIN ] GDDY: Loaded 50151 existing records. [2025-10-17T19:06:04.750237] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:06:04.750436] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-17T19:06:04.750481] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-17T19:06:04.750770] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-17T19:06:04.750834] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-17T19:06:04.763350] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-17T19:06:05.099203] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:06:05.503904] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T19:06:05.510149] [INFO ] [REMOTE ] GCI: Full fetch complete (63437 records). [2025-10-17T19:06:05.510278] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-17T19:06:05.564745] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-17T19:06:05.901694] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-17T19:06:05.901781] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-17T19:06:05.902665] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-17T19:06:05.902731] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-17T19:06:05.904075] [DEBUG] [LOCAL ] GCI: Trimmed 63437 records to 44504 (keeping 200 days of data) [2025-10-17T19:06:06.157792] [DEBUG] [LOCAL ] GCI: Primary data saved (44504 records). [2025-10-17T19:06:06.157927] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-17T19:06:06.158421] [INFO ] [MAIN ] Update Progress: 902/2368 symbols completed. GCI took 50.3s. Estimated remaining: 3h 24m 51s. Rate: 7.2 symbols/min [2025-10-17T19:06:06.325033] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:06:06.332802] [DEBUG] [LOCAL ] GDIV: Loaded 3621 existing records from primary storage. [2025-10-17T19:06:06.333070] [INFO ] [MAIN ] GDIV: Loaded 3621 existing records. [2025-10-17T19:06:06.363978] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-17T19:06:06.511665] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:06:06.511891] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-17T19:06:06.511939] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-17T19:06:06.512084] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-17T19:06:06.512124] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-17T19:06:06.866012] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:06:06.894583] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-17T19:06:07.158041] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-17T19:06:07.438427] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T19:06:07.528193] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T19:06:07.958036] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-17T19:06:08.758013] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-17T19:06:08.972878] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-17T19:06:09.012308] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T19:06:09.015424] [INFO ] [REMOTE ] GCTS: Full fetch complete (26950 records). [2025-10-17T19:06:09.015530] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-17T19:06:09.317683] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-17T19:06:09.403115] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-17T19:06:09.403192] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-17T19:06:09.403720] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-17T19:06:09.403782] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-17T19:06:09.404421] [DEBUG] [LOCAL ] GCTS: Trimmed 26950 records to 20642 (keeping 200 days of data) [2025-10-17T19:06:09.515090] [DEBUG] [LOCAL ] GCTS: Primary data saved (20642 records). [2025-10-17T19:06:09.515215] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-17T19:06:09.515297] [INFO ] [MAIN ] Update Progress: 903/2368 symbols completed. GCTS took 36.3s. Estimated remaining: 3h 24m 34s. Rate: 7.2 symbols/min [2025-10-17T19:06:09.567022] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-17T19:06:09.682301] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:06:09.686827] [DEBUG] [LOCAL ] GDL: Loaded 2541 existing records from primary storage. [2025-10-17T19:06:09.686974] [INFO ] [MAIN ] GDL: Loaded 2541 existing records. [2025-10-17T19:06:09.857809] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:06:09.858000] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-17T19:06:09.858047] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-17T19:06:09.858179] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-17T19:06:09.858219] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-17T19:06:10.206102] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:06:10.357988] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-17T19:06:10.829908] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-17T19:06:11.158001] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-17T19:06:11.274302] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T19:06:11.644825] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T19:06:11.958053] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-17T19:06:12.758020] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-17T19:06:13.558107] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-17T19:06:13.710966] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T19:06:14.200197] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T19:06:14.223926] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-17T19:06:14.358125] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-17T19:06:15.158124] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-17T19:06:15.616969] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-17T19:06:15.958045] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-17T19:06:16.266231] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T19:06:16.545776] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T19:06:16.758027] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-17T19:06:17.343294] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T19:06:17.558054] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-17T19:06:18.004778] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-17T19:06:18.358016] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-17T19:06:19.010480] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-17T19:06:19.158042] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-17T19:06:19.644706] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-17T19:06:19.958036] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-17T19:06:20.758038] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-17T19:06:21.219191] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-17T19:06:21.558003] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-17T19:06:21.823708] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T19:06:21.934502] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-17T19:06:22.358032] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-17T19:06:23.158098] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-17T19:06:23.801198] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-17T19:06:23.958002] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-17T19:06:24.078028] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T19:06:24.758020] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-17T19:06:25.315726] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-17T19:06:25.558003] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-17T19:06:25.639972] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T19:06:26.026106] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-17T19:06:26.358016] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-17T19:06:27.158080] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-17T19:06:27.719473] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-17T19:06:27.958030] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-17T19:06:27.993303] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T19:06:28.609769] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-17T19:06:28.758035] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-17T19:06:29.558031] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-17T19:06:30.358040] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-17T19:06:30.435421] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T19:06:30.940432] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-17T19:06:31.158060] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-17T19:06:31.274638] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T19:06:31.664807] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-17T19:06:31.958034] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-17T19:06:32.758027] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-17T19:06:33.229392] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-17T19:06:33.558038] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-17T19:06:33.617523] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T19:06:34.168844] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T19:06:34.169832] [INFO ] [REMOTE ] GDIV: Full fetch complete (5415 records). [2025-10-17T19:06:34.169901] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-17T19:06:34.364507] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-17T19:06:34.520029] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-17T19:06:34.520106] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-17T19:06:34.520258] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-17T19:06:34.520294] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-17T19:06:34.520665] [DEBUG] [LOCAL ] GDIV: Trimmed 5415 records to 3630 (keeping 200 days of data) [2025-10-17T19:06:34.542526] [DEBUG] [LOCAL ] GDIV: Primary data saved (3630 records). [2025-10-17T19:06:34.542611] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-17T19:06:34.542711] [INFO ] [MAIN ] Update Progress: 904/2368 symbols completed. GDIV took 28.4s. Estimated remaining: 3h 24m 53s. Rate: 7.1 symbols/min [2025-10-17T19:06:34.705346] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:06:34.713783] [DEBUG] [LOCAL ] GDO: Loaded 5863 existing records from primary storage. [2025-10-17T19:06:34.713965] [INFO ] [MAIN ] GDO: Loaded 5863 existing records. [2025-10-17T19:06:34.889355] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:06:34.889581] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-17T19:06:34.889635] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-17T19:06:34.889974] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-17T19:06:34.890030] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-17T19:06:35.159798] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-17T19:06:35.239250] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:06:35.958041] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-17T19:06:36.059441] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T19:06:36.504732] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-17T19:06:36.505592] [INFO ] [REMOTE ] GDL: Full fetch complete (3493 records). [2025-10-17T19:06:36.505684] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-17T19:06:36.763230] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-17T19:06:36.855880] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-17T19:06:36.855957] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-17T19:06:36.856082] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-17T19:06:36.856122] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-17T19:06:36.856458] [DEBUG] [LOCAL ] GDL: Trimmed 3493 records to 2550 (keeping 200 days of data) [2025-10-17T19:06:36.871309] [DEBUG] [LOCAL ] GDL: Primary data saved (2550 records). [2025-10-17T19:06:36.871383] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-17T19:06:36.871453] [INFO ] [MAIN ] Update Progress: 905/2368 symbols completed. GDL took 27.4s. Estimated remaining: 3h 24m 35s. Rate: 7.2 symbols/min [2025-10-17T19:06:37.039799] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:06:37.066744] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T19:06:37.107140] [DEBUG] [LOCAL ] GDOT: Loaded 38078 existing records from primary storage. [2025-10-17T19:06:37.107448] [INFO ] [MAIN ] GDOT: Loaded 38078 existing records. [2025-10-17T19:06:37.283091] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:06:37.283320] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-17T19:06:37.283376] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-17T19:06:37.283695] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-17T19:06:37.283758] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-17T19:06:37.559880] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-17T19:06:37.641428] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:06:37.691338] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T19:06:38.358040] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-17T19:06:39.158038] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-17T19:06:39.299803] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T19:06:39.835916] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T19:06:39.957987] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-17T19:06:40.137377] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T19:06:40.143575] [INFO ] [REMOTE ] GD: Full fetch complete (69753 records). [2025-10-17T19:06:40.143717] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-17T19:06:40.527034] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-17T19:06:40.527217] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-17T19:06:40.528272] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-17T19:06:40.528339] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-17T19:06:40.529687] [DEBUG] [LOCAL ] GD: Trimmed 69753 records to 47354 (keeping 200 days of data) [2025-10-17T19:06:40.626184] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T19:06:40.759994] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-17T19:06:40.841829] [DEBUG] [LOCAL ] GD: Primary data saved (47354 records). [2025-10-17T19:06:40.842011] [INFO ] [MAIN ] GD: Full history saved. [2025-10-17T19:06:40.842601] [INFO ] [MAIN ] Update Progress: 906/2368 symbols completed. GD took 44.9s. Estimated remaining: 3h 24m 19s. Rate: 7.2 symbols/min [2025-10-17T19:06:41.011512] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:06:41.032026] [DEBUG] [LOCAL ] GDV: Loaded 19620 existing records from primary storage. [2025-10-17T19:06:41.032298] [INFO ] [MAIN ] GDV: Loaded 19620 existing records. [2025-10-17T19:06:41.206194] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:06:41.206407] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-17T19:06:41.206457] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-17T19:06:41.206761] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-17T19:06:41.206832] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-17T19:06:41.557950] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:06:41.558062] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-17T19:06:42.064293] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T19:06:42.077164] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-17T19:06:42.358031] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-17T19:06:43.039274] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-17T19:06:43.158065] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-17T19:06:43.759487] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T19:06:43.958059] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-17T19:06:44.758042] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-17T19:06:45.089529] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T19:06:45.558071] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-17T19:06:46.063029] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T19:06:46.358026] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-17T19:06:46.657324] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T19:06:47.158039] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-17T19:06:47.958046] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-17T19:06:48.217120] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T19:06:48.291126] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T19:06:48.757992] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-17T19:06:49.155504] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T19:06:49.557987] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-17T19:06:49.723938] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T19:06:50.152313] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-17T19:06:50.358026] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-17T19:06:51.051925] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-17T19:06:51.158137] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-17T19:06:51.762011] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-17T19:06:51.958036] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-17T19:06:52.758131] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-17T19:06:53.558071] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-17T19:06:53.608505] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T19:06:54.358071] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-17T19:06:54.451123] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T19:06:54.667061] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T19:06:55.158122] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-17T19:06:55.814780] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T19:06:55.958047] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-17T19:06:56.758062] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-17T19:06:56.948931] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T19:06:56.956410] [INFO ] [REMOTE ] GDDY: Full fetch complete (72181 records). [2025-10-17T19:06:56.956555] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-17T19:06:57.348706] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-17T19:06:57.348910] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-17T19:06:57.349864] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-17T19:06:57.349947] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-17T19:06:57.351821] [DEBUG] [LOCAL ] GDDY: Trimmed 72181 records to 50516 (keeping 200 days of data) [2025-10-17T19:06:57.416328] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-17T19:06:57.443495] [INFO ] [REMOTE ] GDO: Full fetch complete (8529 records). [2025-10-17T19:06:57.451316] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-17T19:06:57.516591] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:06:57.583426] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-17T19:06:57.994884] [DEBUG] [LOCAL ] GDDY: Primary data saved (50516 records). [2025-10-17T19:06:58.022148] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-17T19:06:58.024748] [INFO ] [MAIN ] Update Progress: 907/2368 symbols completed. GDDY took 53.7s. Estimated remaining: 3h 24m 25s. Rate: 7.1 symbols/min [2025-10-17T19:06:58.189820] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-17T19:06:58.189964] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-17T19:06:58.190231] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-17T19:06:58.190309] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-17T19:06:58.206759] [DEBUG] [LOCAL ] GDO: Trimmed 8529 records to 5892 (keeping 200 days of data) [2025-10-17T19:06:58.288783] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:06:58.295018] [DEBUG] [LOCAL ] GDO: Primary data saved (5892 records). [2025-10-17T19:06:58.295133] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-17T19:06:58.295486] [INFO ] [MAIN ] Update Progress: 908/2368 symbols completed. GDO took 23.8s. Estimated remaining: 3h 24m 3s. Rate: 7.2 symbols/min [2025-10-17T19:06:58.368339] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-17T19:06:58.466230] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:06:58.508598] [DEBUG] [LOCAL ] GE: Loaded 54088 existing records from primary storage. [2025-10-17T19:06:58.508950] [INFO ] [MAIN ] GE: Loaded 54088 existing records. [2025-10-17T19:06:58.616183] [DEBUG] [LOCAL ] GEF: Loaded 20966 existing records from primary storage. [2025-10-17T19:06:58.616458] [INFO ] [MAIN ] GEF: Loaded 20966 existing records. [2025-10-17T19:06:58.802624] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:06:58.846343] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-17T19:06:58.855561] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-17T19:06:58.870539] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-17T19:06:58.883223] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:06:58.883547] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-17T19:06:58.883672] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-17T19:06:58.883364] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-17T19:06:58.918906] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-17T19:06:58.925463] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-17T19:06:59.465075] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T19:06:59.585859] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:06:59.625885] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:06:59.621102] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-17T19:06:59.668853] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T19:06:59.958040] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-17T19:07:00.758026] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-17T19:07:01.287361] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T19:07:01.457808] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T19:07:01.558067] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-17T19:07:02.358070] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-17T19:07:02.721074] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T19:07:03.158118] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-17T19:07:03.696243] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-17T19:07:03.958049] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-17T19:07:04.143304] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T19:07:04.396139] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-17T19:07:04.758031] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-17T19:07:05.531251] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T19:07:05.558044] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-17T19:07:06.358030] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-17T19:07:06.689773] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T19:07:06.861269] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-17T19:07:07.158037] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-17T19:07:07.889451] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T19:07:07.895503] [INFO ] [REMOTE ] GDOT: Full fetch complete (53599 records). [2025-10-17T19:07:07.895604] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-17T19:07:07.963180] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-17T19:07:08.281714] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-17T19:07:08.281924] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-17T19:07:08.282853] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-17T19:07:08.283048] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-17T19:07:08.299887] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T19:07:08.305226] [DEBUG] [LOCAL ] GDOT: Trimmed 53599 records to 38316 (keeping 200 days of data) [2025-10-17T19:07:08.526900] [DEBUG] [LOCAL ] GDOT: Primary data saved (38316 records). [2025-10-17T19:07:08.527072] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-17T19:07:08.527204] [INFO ] [MAIN ] Update Progress: 909/2368 symbols completed. GDOT took 31.7s. Estimated remaining: 3h 23m 58s. Rate: 7.2 symbols/min [2025-10-17T19:07:08.700471] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:07:08.732539] [DEBUG] [LOCAL ] GEL: Loaded 31983 existing records from primary storage. [2025-10-17T19:07:08.732864] [INFO ] [MAIN ] GEL: Loaded 31983 existing records. [2025-10-17T19:07:08.763688] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-17T19:07:08.920423] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:07:08.920693] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-17T19:07:08.920768] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-17T19:07:08.920994] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-17T19:07:08.921050] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-17T19:07:09.274154] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:07:09.558035] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-17T19:07:09.847516] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T19:07:10.045444] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-17T19:07:10.358028] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-17T19:07:10.693715] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T19:07:11.158047] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-17T19:07:11.958069] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-17T19:07:12.535954] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-17T19:07:12.572742] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T19:07:12.758050] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-17T19:07:12.860570] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T19:07:13.558042] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-17T19:07:14.358075] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-17T19:07:14.891145] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T19:07:15.041635] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-17T19:07:15.065105] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-17T19:07:15.158006] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-17T19:07:15.958089] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-17T19:07:16.758059] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-17T19:07:17.526768] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-17T19:07:17.558049] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-17T19:07:17.632717] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T19:07:17.802254] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T19:07:17.806046] [INFO ] [REMOTE ] GDV: Full fetch complete (28412 records). [2025-10-17T19:07:17.806159] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-17T19:07:18.201959] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-17T19:07:18.202102] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-17T19:07:18.203173] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-17T19:07:18.203260] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-17T19:07:18.204890] [DEBUG] [LOCAL ] GDV: Trimmed 28412 records to 19698 (keeping 200 days of data) [2025-10-17T19:07:18.335625] [DEBUG] [LOCAL ] GDV: Primary data saved (19698 records). [2025-10-17T19:07:18.335869] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-17T19:07:18.335978] [INFO ] [MAIN ] Update Progress: 910/2368 symbols completed. GDV took 37.5s. Estimated remaining: 3h 23m 52s. Rate: 7.2 symbols/min [2025-10-17T19:07:18.366684] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-17T19:07:18.511949] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:07:18.571062] [DEBUG] [LOCAL ] GENI: Loaded 53328 existing records from primary storage. [2025-10-17T19:07:18.571498] [INFO ] [MAIN ] GENI: Loaded 53328 existing records. [2025-10-17T19:07:18.747568] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:07:18.747869] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-17T19:07:18.747919] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-17T19:07:18.748232] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-17T19:07:18.748305] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-17T19:07:19.115580] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:07:19.158044] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-17T19:07:19.489867] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T19:07:19.742692] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-17T19:07:19.958040] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-17T19:07:20.515663] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T19:07:20.758012] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-17T19:07:21.558007] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-17T19:07:21.941385] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T19:07:22.268067] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-17T19:07:22.357995] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-17T19:07:23.158014] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-17T19:07:23.232867] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T19:07:23.958103] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-17T19:07:24.167813] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-17T19:07:24.522605] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-17T19:07:24.758029] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-17T19:07:25.558014] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-17T19:07:25.601774] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T19:07:26.006311] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-17T19:07:26.358033] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-17T19:07:27.158046] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-17T19:07:27.471205] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T19:07:27.829248] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T19:07:27.958028] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-17T19:07:28.758016] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-17T19:07:28.970586] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T19:07:29.421969] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T19:07:29.558027] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-17T19:07:29.692138] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T19:07:30.358037] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-17T19:07:30.901626] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T19:07:31.158117] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-17T19:07:31.908209] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T19:07:31.958004] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-17T19:07:32.201807] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T19:07:32.758032] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-17T19:07:33.558014] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-17T19:07:33.762560] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-17T19:07:34.292142] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T19:07:34.358040] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-17T19:07:34.411610] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T19:07:34.419718] [INFO ] [REMOTE ] GE: Full fetch complete (77864 records). [2025-10-17T19:07:34.419952] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-17T19:07:34.827312] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-17T19:07:34.827454] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-17T19:07:34.828866] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-17T19:07:34.828937] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-17T19:07:34.831232] [DEBUG] [LOCAL ] GE: Trimmed 77864 records to 54478 (keeping 200 days of data) [2025-10-17T19:07:35.167696] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-17T19:07:35.202401] [DEBUG] [LOCAL ] GE: Primary data saved (54478 records). [2025-10-17T19:07:35.202690] [INFO ] [MAIN ] GE: Full history saved. [2025-10-17T19:07:35.203965] [INFO ] [MAIN ] Update Progress: 911/2368 symbols completed. GE took 37.2s. Estimated remaining: 3h 23m 57s. Rate: 7.1 symbols/min [2025-10-17T19:07:35.382837] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:07:35.453319] [DEBUG] [LOCAL ] GEO: Loaded 52187 existing records from primary storage. [2025-10-17T19:07:35.453799] [INFO ] [MAIN ] GEO: Loaded 52187 existing records. [2025-10-17T19:07:35.606616] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T19:07:35.678148] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:07:35.678559] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-17T19:07:35.678626] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-17T19:07:35.679069] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-17T19:07:35.679129] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-17T19:07:35.963272] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-17T19:07:36.074887] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:07:36.272748] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T19:07:36.758068] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-17T19:07:37.102455] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T19:07:37.558059] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-17T19:07:38.358071] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-17T19:07:38.674456] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T19:07:38.878157] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T19:07:39.158072] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-17T19:07:39.884598] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T19:07:39.888062] [INFO ] [REMOTE ] GEL: Full fetch complete (48143 records). [2025-10-17T19:07:39.888138] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-17T19:07:39.963204] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-17T19:07:40.258607] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-17T19:07:40.258712] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-17T19:07:40.259482] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-17T19:07:40.259527] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-17T19:07:40.260533] [DEBUG] [LOCAL ] GEL: Trimmed 48143 records to 32124 (keeping 200 days of data) [2025-10-17T19:07:40.445594] [DEBUG] [LOCAL ] GEL: Primary data saved (32124 records). [2025-10-17T19:07:40.445752] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-17T19:07:40.445839] [INFO ] [MAIN ] Update Progress: 912/2368 symbols completed. GEL took 31.9s. Estimated remaining: 3h 23m 44s. Rate: 7.1 symbols/min [2025-10-17T19:07:40.610553] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:07:40.646409] [DEBUG] [LOCAL ] GES: Loaded 38584 existing records from primary storage. [2025-10-17T19:07:40.646703] [INFO ] [MAIN ] GES: Loaded 38584 existing records. [2025-10-17T19:07:40.763170] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-17T19:07:40.822285] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:07:40.822600] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-17T19:07:40.822823] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-17T19:07:40.823566] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-17T19:07:40.823635] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-17T19:07:41.175144] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:07:41.203343] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-17T19:07:41.563098] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-17T19:07:41.580347] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T19:07:41.916502] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T19:07:41.919708] [INFO ] [REMOTE ] GEF: Full fetch complete (29393 records). [2025-10-17T19:07:41.919780] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-17T19:07:42.277926] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-17T19:07:42.278001] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-17T19:07:42.278561] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-17T19:07:42.278600] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-17T19:07:42.279269] [DEBUG] [LOCAL ] GEF: Trimmed 29393 records to 21098 (keeping 200 days of data) [2025-10-17T19:07:42.367901] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-17T19:07:42.409797] [DEBUG] [LOCAL ] GEF: Primary data saved (21098 records). [2025-10-17T19:07:42.409909] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-17T19:07:42.409998] [INFO ] [MAIN ] Update Progress: 913/2368 symbols completed. GEF took 44.1s. Estimated remaining: 3h 23m 25s. Rate: 7.2 symbols/min [2025-10-17T19:07:42.580410] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:07:42.617013] [DEBUG] [LOCAL ] GETY: Loaded 35351 existing records from primary storage. [2025-10-17T19:07:42.617321] [INFO ] [MAIN ] GETY: Loaded 35351 existing records. [2025-10-17T19:07:42.796670] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:07:42.796900] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-17T19:07:42.796948] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-17T19:07:42.797139] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-17T19:07:42.797195] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-17T19:07:43.145106] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:07:43.166914] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-17T19:07:43.171914] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T19:07:43.957999] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-17T19:07:44.241438] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-17T19:07:44.618766] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T19:07:44.758041] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-17T19:07:45.513881] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T19:07:45.557990] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-17T19:07:46.358107] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-17T19:07:46.624388] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T19:07:47.093272] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T19:07:47.158018] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-17T19:07:47.907720] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T19:07:47.958027] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-17T19:07:48.758023] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-17T19:07:48.824840] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T19:07:49.558026] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-17T19:07:49.778815] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T19:07:50.358014] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-17T19:07:50.689069] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-17T19:07:50.756070] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T19:07:51.158042] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-17T19:07:51.958035] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-17T19:07:52.494711] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-17T19:07:52.503609] [INFO ] [REMOTE ] GENI: Full fetch complete (76063 records). [2025-10-17T19:07:52.503854] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-17T19:07:52.764156] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-17T19:07:52.775803] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T19:07:53.021571] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-17T19:07:53.021732] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-17T19:07:53.023030] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-17T19:07:53.023112] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-17T19:07:53.025449] [DEBUG] [LOCAL ] GENI: Trimmed 76063 records to 53717 (keeping 200 days of data) [2025-10-17T19:07:53.362094] [DEBUG] [LOCAL ] GENI: Primary data saved (53717 records). [2025-10-17T19:07:53.362309] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-17T19:07:53.363137] [INFO ] [MAIN ] Update Progress: 914/2368 symbols completed. GENI took 35.0s. Estimated remaining: 3h 23m 21s. Rate: 7.2 symbols/min [2025-10-17T19:07:53.556306] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:07:53.558022] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-17T19:07:53.611439] [DEBUG] [LOCAL ] GEV: Loaded 53389 existing records from primary storage. [2025-10-17T19:07:53.611807] [INFO ] [MAIN ] GEV: Loaded 53389 existing records. [2025-10-17T19:07:53.791524] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:07:53.791937] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-17T19:07:53.792092] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-17T19:07:53.792381] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-17T19:07:53.792464] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-17T19:07:54.096310] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-17T19:07:54.205995] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:07:54.229070] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T19:07:54.358076] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-17T19:07:55.118714] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T19:07:55.158007] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-17T19:07:55.958077] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-17T19:07:56.569417] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-17T19:07:56.665415] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T19:07:56.758032] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-17T19:07:57.558048] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-17T19:07:57.824789] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T19:07:58.139273] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T19:07:58.358038] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-17T19:07:59.158039] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-17T19:07:59.821769] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T19:07:59.958023] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-17T19:08:00.093345] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-17T19:08:00.758021] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-17T19:08:01.558040] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-17T19:08:01.591311] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-17T19:08:01.762140] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T19:08:02.358056] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-17T19:08:03.124334] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T19:08:03.158046] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-17T19:08:03.375574] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T19:08:03.509741] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-10-17T19:08:03.958027] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-17T19:08:04.757995] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-17T19:08:05.140472] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-17T19:08:05.558030] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-17T19:08:06.147808] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-17T19:08:06.177453] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T19:08:06.358039] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-17T19:08:07.158037] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-17T19:08:07.320244] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T19:08:07.837192] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T19:08:07.842279] [INFO ] [REMOTE ] GETY: Full fetch complete (55671 records). [2025-10-17T19:08:07.842366] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-17T19:08:07.963183] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-17T19:08:08.221390] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-17T19:08:08.221477] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-17T19:08:08.222344] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-17T19:08:08.222407] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-17T19:08:08.223448] [DEBUG] [LOCAL ] GETY: Trimmed 55671 records to 35677 (keeping 200 days of data) [2025-10-17T19:08:08.416479] [DEBUG] [LOCAL ] GETY: Primary data saved (35677 records). [2025-10-17T19:08:08.416611] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-17T19:08:08.417190] [INFO ] [MAIN ] Update Progress: 915/2368 symbols completed. GETY took 26.0s. Estimated remaining: 3h 23m 23s. Rate: 7.1 symbols/min [2025-10-17T19:08:08.582566] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:08:08.588430] [DEBUG] [LOCAL ] GF: Loaded 2700 existing records from primary storage. [2025-10-17T19:08:08.588620] [INFO ] [MAIN ] GF: Loaded 2700 existing records. [2025-10-17T19:08:08.779448] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-17T19:08:08.784127] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:08:08.784368] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-17T19:08:08.784464] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-17T19:08:08.785484] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-17T19:08:08.785546] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-17T19:08:09.138221] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:08:09.567754] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-17T19:08:09.587184] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-17T19:08:09.906260] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T19:08:10.196302] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-17T19:08:10.358075] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-17T19:08:10.395812] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T19:08:11.158076] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-17T19:08:11.737231] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-17T19:08:11.958012] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-17T19:08:12.211302] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T19:08:12.222263] [INFO ] [REMOTE ] GEO: Full fetch complete (75571 records). [2025-10-17T19:08:12.222586] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-17T19:08:12.611591] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-17T19:08:12.611792] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-17T19:08:12.616375] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-17T19:08:12.616526] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-17T19:08:12.617289] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-17T19:08:12.619967] [DEBUG] [LOCAL ] GEO: Trimmed 75571 records to 52550 (keeping 200 days of data) [2025-10-17T19:08:12.788760] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-17T19:08:12.929243] [DEBUG] [LOCAL ] GEO: Primary data saved (52550 records). [2025-10-17T19:08:12.929397] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-17T19:08:12.929480] [INFO ] [MAIN ] Update Progress: 916/2368 symbols completed. GEO took 37.7s. Estimated remaining: 3h 23m 8s. Rate: 7.1 symbols/min [2025-10-17T19:08:13.096491] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:08:13.124720] [DEBUG] [LOCAL ] GFF: Loaded 30148 existing records from primary storage. [2025-10-17T19:08:13.124973] [INFO ] [MAIN ] GFF: Loaded 30148 existing records. [2025-10-17T19:08:13.311517] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:08:13.311750] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-17T19:08:13.311808] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-17T19:08:13.312007] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-17T19:08:13.312088] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-17T19:08:13.563294] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-17T19:08:13.655783] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-17T19:08:13.678379] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:08:14.358089] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-17T19:08:15.149393] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T19:08:15.157939] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-17T19:08:15.775367] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T19:08:15.958028] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-17T19:08:16.560815] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T19:08:16.758042] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-17T19:08:17.189403] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-17T19:08:17.319300] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T19:08:17.558035] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-17T19:08:18.358042] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-17T19:08:18.869946] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T19:08:18.875091] [INFO ] [REMOTE ] GES: Full fetch complete (58646 records). [2025-10-17T19:08:18.875210] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-17T19:08:19.163251] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-17T19:08:19.283555] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-17T19:08:19.283719] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-17T19:08:19.285027] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-17T19:08:19.285095] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-17T19:08:19.286327] [DEBUG] [LOCAL ] GES: Trimmed 58646 records to 38876 (keeping 200 days of data) [2025-10-17T19:08:19.519212] [DEBUG] [LOCAL ] GES: Primary data saved (38876 records). [2025-10-17T19:08:19.519354] [INFO ] [MAIN ] GES: Full history saved. [2025-10-17T19:08:19.519436] [INFO ] [MAIN ] Update Progress: 917/2368 symbols completed. GES took 39.1s. Estimated remaining: 3h 22m 57s. Rate: 7.1 symbols/min [2025-10-17T19:08:19.958097] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-17T19:08:20.584554] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T19:08:20.597714] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T19:08:20.755369] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-17T19:08:20.759417] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-17T19:08:21.343338] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T19:08:21.558017] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-17T19:08:22.011507] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-17T19:08:22.358013] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-17T19:08:23.158065] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-17T19:08:23.758833] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T19:08:23.958046] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-17T19:08:24.063772] [DEBUG] [REMOTE ] GF: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-17T19:08:24.064094] [WARN ] [REMOTE ] GF: No data returned for month 2025-08 [2025-10-17T19:08:24.064183] [FATAL] [REMOTE ] GF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:08:24.064260] [FATAL] [MAIN ] GF: Failed to fetch primary data. [2025-10-17T19:08:24.064322] [WARN ] [MAIN ] GF: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:08:24.064394] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-17T19:08:24.064457] [DEBUG] [LOCAL ] GF: No primary data file found to delete. [2025-10-17T19:08:24.064493] [INFO ] [LOCAL ] GF: Starting deletion of derivative data. [2025-10-17T19:08:24.064671] [DEBUG] [LOCAL ] GF: Deleted derivative data file. [2025-10-17T19:08:24.064756] [INFO ] [MAIN ] Update Progress: 918/2368 symbols completed. GF took 15.6s. Estimated remaining: 3h 22m 43s. Rate: 7.2 symbols/min [2025-10-17T19:08:24.758009] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-17T19:08:25.305198] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-17T19:08:25.558026] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-17T19:08:26.260118] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T19:08:26.358041] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-17T19:08:27.792229] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T19:08:27.800265] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-17T19:08:27.929041] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-17T19:08:27.957992] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-17T19:08:28.952214] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T19:08:28.958319] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-17T19:08:30.188120] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-17T19:08:30.194687] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-17T19:08:30.295226] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-17T19:08:30.358038] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-17T19:08:31.570379] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T19:08:31.578519] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-17T19:08:32.710335] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T19:08:32.716224] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-17T19:08:32.842383] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-17T19:08:32.854313] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-17T19:08:33.978163] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T19:08:33.982875] [INFO ] [REMOTE ] GFF: Full fetch complete (43937 records). [2025-10-17T19:08:33.983033] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-17T19:08:34.377214] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-17T19:08:34.377354] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-17T19:08:34.378579] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-17T19:08:34.378672] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-17T19:08:34.380058] [DEBUG] [LOCAL ] GFF: Trimmed 43937 records to 30283 (keeping 200 days of data) [2025-10-17T19:08:34.584115] [DEBUG] [LOCAL ] GFF: Primary data saved (30283 records). [2025-10-17T19:08:34.584334] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-17T19:08:34.584499] [INFO ] [MAIN ] Update Progress: 919/2368 symbols completed. GFF took 21.7s. Estimated remaining: 3h 22m 38s. Rate: 7.2 symbols/min [2025-10-17T19:08:35.420329] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-17T19:08:35.427746] [INFO ] [REMOTE ] GEV: Full fetch complete (77035 records). [2025-10-17T19:08:35.427891] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-17T19:08:35.819792] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-17T19:08:35.819888] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-17T19:08:35.820946] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-17T19:08:35.821012] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-17T19:08:35.822515] [DEBUG] [LOCAL ] GEV: Trimmed 77035 records to 53772 (keeping 200 days of data) [2025-10-17T19:08:36.173223] [DEBUG] [LOCAL ] GEV: Primary data saved (53772 records). [2025-10-17T19:08:36.173369] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-17T19:08:36.173930] [INFO ] [MAIN ] Update Progress: 920/2368 symbols completed. GEV took 42.8s. Estimated remaining: 3h 22m 18s. Rate: 7.2 symbols/min [2025-10-17T19:08:36.811766] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:08:36.788917] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:08:36.906184] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:08:36.926070] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:08:36.932699] [DEBUG] [LOCAL ] GFR: Loaded 7789 existing records from primary storage. [2025-10-17T19:08:36.933533] [INFO ] [MAIN ] GFR: Loaded 7789 existing records. [2025-10-17T19:08:37.201228] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:08:37.204260] [DEBUG] [LOCAL ] GFL: Loaded 48000 existing records from primary storage. [2025-10-17T19:08:37.204764] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-17T19:08:37.205002] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-17T19:08:37.205528] [INFO ] [MAIN ] GFL: Loaded 48000 existing records. [2025-10-17T19:08:37.217018] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-17T19:08:37.261886] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-17T19:08:37.326493] [DEBUG] [LOCAL ] GGB: Loaded 51854 existing records from primary storage. [2025-10-17T19:08:37.364364] [INFO ] [MAIN ] GGB: Loaded 51854 existing records. [2025-10-17T19:08:37.457674] [DEBUG] [LOCAL ] GFI: Loaded 53505 existing records from primary storage. [2025-10-17T19:08:37.501340] [INFO ] [MAIN ] GFI: Loaded 53505 existing records. [2025-10-17T19:08:37.900360] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:08:37.926563] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-17T19:08:37.964121] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-17T19:08:37.962160] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:08:38.044427] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-17T19:08:38.050081] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-17T19:08:38.038960] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-17T19:08:38.086950] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-17T19:08:38.147936] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:08:38.233686] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-17T19:08:38.200145] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-17T19:08:38.254397] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-17T19:08:38.254293] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-17T19:08:38.333936] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-17T19:08:38.369582] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-17T19:08:38.735722] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:08:38.771420] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-17T19:08:39.380949] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:08:39.415089] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-17T19:08:39.512601] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:08:39.515385] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:08:39.515845] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-17T19:08:39.516069] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-17T19:08:39.852299] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T19:08:39.855549] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-17T19:08:40.597229] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-17T19:08:40.599715] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-17T19:08:40.996686] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T19:08:41.005686] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-17T19:08:41.094098] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T19:08:41.104173] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-17T19:08:41.251480] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T19:08:41.262328] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-17T19:08:41.487288] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T19:08:41.489589] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-17T19:08:42.335525] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T19:08:42.338628] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-17T19:08:42.578589] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T19:08:42.587978] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-17T19:08:42.669400] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T19:08:43.005971] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-17T19:08:43.045947] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-17T19:08:43.158056] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-17T19:08:43.885297] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T19:08:43.920087] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T19:08:43.957987] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-17T19:08:44.399318] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T19:08:44.758040] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-17T19:08:45.411587] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-17T19:08:45.558036] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-17T19:08:46.196467] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T19:08:46.358091] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-17T19:08:47.067734] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-17T19:08:47.158060] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-17T19:08:47.958083] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-17T19:08:48.758145] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-17T19:08:48.830716] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T19:08:49.557999] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-17T19:08:49.788589] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T19:08:50.358051] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-17T19:08:50.395947] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T19:08:50.982784] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T19:08:51.104891] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-17T19:08:51.106524] [INFO ] [REMOTE ] GFR: Full fetch complete (12093 records). [2025-10-17T19:08:51.106631] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-17T19:08:51.163219] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-17T19:08:51.467963] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-17T19:08:51.468049] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-17T19:08:51.468317] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-17T19:08:51.468358] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-17T19:08:51.468838] [DEBUG] [LOCAL ] GFR: Trimmed 12093 records to 7837 (keeping 200 days of data) [2025-10-17T19:08:51.515409] [DEBUG] [LOCAL ] GFR: Primary data saved (7837 records). [2025-10-17T19:08:51.515550] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-17T19:08:51.515702] [INFO ] [MAIN ] Update Progress: 921/2368 symbols completed. GFR took 15.3s. Estimated remaining: 3h 22m 21s. Rate: 7.2 symbols/min [2025-10-17T19:08:51.713528] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:08:51.752983] [DEBUG] [LOCAL ] GGG: Loaded 40973 existing records from primary storage. [2025-10-17T19:08:51.753271] [INFO ] [MAIN ] GGG: Loaded 40973 existing records. [2025-10-17T19:08:51.937075] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:08:51.937252] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-17T19:08:51.937335] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-17T19:08:51.937662] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-17T19:08:51.937738] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-17T19:08:51.969043] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-17T19:08:52.295615] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:08:52.757995] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-17T19:08:53.192973] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T19:08:53.298725] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-17T19:08:53.558040] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-17T19:08:54.056563] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T19:08:54.358069] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-17T19:08:54.709939] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T19:08:55.158124] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-17T19:08:55.958089] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-17T19:08:56.512038] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-17T19:08:56.758086] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-17T19:08:56.891675] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T19:08:57.404510] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T19:08:57.558028] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-17T19:08:58.358038] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-17T19:08:58.576232] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T19:08:59.118992] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:08:59.157985] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-17T19:08:59.958043] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-17T19:09:00.105695] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T19:09:00.674506] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T19:09:00.757996] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-17T19:09:01.558012] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-17T19:09:01.972538] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-17T19:09:02.358004] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-17T19:09:02.792196] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-17T19:09:03.158008] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-17T19:09:03.487776] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-17T19:09:03.958095] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-17T19:09:04.201803] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T19:09:04.365145] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-17T19:09:04.758035] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-17T19:09:05.559231] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-17T19:09:05.564291] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T19:09:06.358048] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-17T19:09:06.890436] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-17T19:09:07.132538] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T19:09:07.157991] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-17T19:09:07.958108] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-17T19:09:08.017369] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T19:09:08.758005] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-17T19:09:09.423109] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-17T19:09:09.558115] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-17T19:09:09.612473] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T19:09:10.358047] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-17T19:09:10.568569] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:09:10.575162] [INFO ] [REMOTE ] GFL: Full fetch complete (69538 records). [2025-10-17T19:09:10.575287] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-17T19:09:10.955760] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-17T19:09:10.955843] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-17T19:09:10.956741] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-17T19:09:10.956808] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-17T19:09:10.958195] [DEBUG] [LOCAL ] GFL: Trimmed 69538 records to 48336 (keeping 200 days of data) [2025-10-17T19:09:11.180687] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-17T19:09:11.270055] [DEBUG] [LOCAL ] GFL: Primary data saved (48336 records). [2025-10-17T19:09:11.270188] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-17T19:09:11.270285] [INFO ] [MAIN ] Update Progress: 922/2368 symbols completed. GFL took 35.1s. Estimated remaining: 3h 22m 30s. Rate: 7.1 symbols/min [2025-10-17T19:09:11.468704] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:09:11.471358] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T19:09:11.494813] [DEBUG] [LOCAL ] GGT: Loaded 14507 existing records from primary storage. [2025-10-17T19:09:11.495043] [INFO ] [MAIN ] GGT: Loaded 14507 existing records. [2025-10-17T19:09:11.670305] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:09:11.670524] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-17T19:09:11.670583] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-17T19:09:11.670799] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-17T19:09:11.670866] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-17T19:09:11.958196] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-17T19:09:12.032514] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:09:12.057201] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T19:09:12.758049] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-17T19:09:13.446718] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-17T19:09:13.454740] [INFO ] [REMOTE ] GFI: Full fetch complete (76872 records). [2025-10-17T19:09:13.454908] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-17T19:09:13.559450] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-17T19:09:13.874848] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-17T19:09:13.875200] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-17T19:09:13.887198] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-17T19:09:13.900379] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-17T19:09:13.914228] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-17T19:09:13.925918] [DEBUG] [LOCAL ] GFI: Trimmed 76872 records to 53895 (keeping 200 days of data) [2025-10-17T19:09:14.039254] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T19:09:14.310558] [DEBUG] [LOCAL ] GFI: Primary data saved (53895 records). [2025-10-17T19:09:14.310813] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-17T19:09:14.311181] [INFO ] [MAIN ] Update Progress: 923/2368 symbols completed. GFI took 38.1s. Estimated remaining: 3h 22m 14s. Rate: 7.1 symbols/min [2025-10-17T19:09:14.365036] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-17T19:09:14.502378] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:09:14.513581] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T19:09:14.521383] [DEBUG] [LOCAL ] GGZ: Loaded 2437 existing records from primary storage. [2025-10-17T19:09:14.521719] [INFO ] [MAIN ] GGZ: Loaded 2437 existing records. [2025-10-17T19:09:14.703723] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:09:14.703970] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-17T19:09:14.704020] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-17T19:09:14.704153] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-17T19:09:14.704192] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-17T19:09:15.050202] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:09:15.158023] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-17T19:09:15.723716] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-17T19:09:15.958038] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-17T19:09:16.468687] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-17T19:09:16.476446] [INFO ] [REMOTE ] GGB: Full fetch complete (74334 records). [2025-10-17T19:09:16.476590] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-17T19:09:16.609174] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T19:09:16.763234] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-17T19:09:16.903133] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-17T19:09:16.903269] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-17T19:09:16.904928] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-17T19:09:16.905010] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-17T19:09:16.907301] [DEBUG] [LOCAL ] GGB: Trimmed 74334 records to 52241 (keeping 200 days of data) [2025-10-17T19:09:17.234239] [DEBUG] [LOCAL ] GGB: Primary data saved (52241 records). [2025-10-17T19:09:17.234448] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-17T19:09:17.234555] [INFO ] [MAIN ] Update Progress: 924/2368 symbols completed. GGB took 41.1s. Estimated remaining: 3h 21m 57s. Rate: 7.2 symbols/min [2025-10-17T19:09:17.321258] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-17T19:09:17.435463] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:09:17.444989] [DEBUG] [LOCAL ] GHC: Loaded 2948 existing records from primary storage. [2025-10-17T19:09:17.445338] [INFO ] [MAIN ] GHC: Loaded 2948 existing records. [2025-10-17T19:09:17.563202] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-17T19:09:17.666361] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:09:17.666703] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-17T19:09:17.666771] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-17T19:09:17.667029] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-17T19:09:17.667090] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-17T19:09:18.023429] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:09:18.339903] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T19:09:18.357991] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-17T19:09:19.103285] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T19:09:19.158002] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-17T19:09:19.817363] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-17T19:09:19.958003] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-17T19:09:20.411932] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-17T19:09:20.758015] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-17T19:09:21.363740] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T19:09:21.558002] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-17T19:09:22.358020] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-17T19:09:22.368191] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T19:09:22.895858] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-17T19:09:23.158039] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-17T19:09:23.536241] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-17T19:09:23.958054] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-17T19:09:24.758042] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-17T19:09:24.865227] [DEBUG] [REMOTE ] GGT: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-17T19:09:24.865519] [WARN ] [REMOTE ] GGT: No data returned for month 2025-05 [2025-10-17T19:09:24.865610] [FATAL] [REMOTE ] GGT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:09:24.865736] [FATAL] [MAIN ] GGT: Failed to fetch primary data. [2025-10-17T19:09:24.865802] [WARN ] [MAIN ] GGT: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:09:24.865887] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-17T19:09:24.865961] [DEBUG] [LOCAL ] GGT: No primary data file found to delete. [2025-10-17T19:09:24.865999] [INFO ] [LOCAL ] GGT: Starting deletion of derivative data. [2025-10-17T19:09:24.866123] [DEBUG] [LOCAL ] GGT: Deleted derivative data file. [2025-10-17T19:09:24.866206] [INFO ] [MAIN ] Update Progress: 925/2368 symbols completed. GGT took 13.6s. Estimated remaining: 3h 21m 47s. Rate: 7.2 symbols/min [2025-10-17T19:09:25.031260] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:09:25.036605] [DEBUG] [LOCAL ] GHG: Loaded 3303 existing records from primary storage. [2025-10-17T19:09:25.036785] [INFO ] [MAIN ] GHG: Loaded 3303 existing records. [2025-10-17T19:09:25.211467] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:09:25.211697] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-17T19:09:25.211754] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-17T19:09:25.211888] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-17T19:09:25.211925] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-17T19:09:25.558722] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-17T19:09:25.558584] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:09:25.586577] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T19:09:26.032198] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-17T19:09:26.358037] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-17T19:09:27.158024] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-17T19:09:27.649407] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-17T19:09:27.816899] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T19:09:27.958035] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-17T19:09:28.758015] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-17T19:09:29.220539] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-17T19:09:29.389414] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T19:09:29.558025] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-17T19:09:30.358023] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-17T19:09:30.800583] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-17T19:09:30.945223] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T19:09:30.950702] [INFO ] [REMOTE ] GGG: Full fetch complete (59469 records). [2025-10-17T19:09:30.950807] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-17T19:09:31.163193] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-17T19:09:31.335701] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-17T19:09:31.335781] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-17T19:09:31.336597] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-17T19:09:31.336638] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-17T19:09:31.338024] [DEBUG] [LOCAL ] GGG: Trimmed 59469 records to 41252 (keeping 200 days of data) [2025-10-17T19:09:31.581677] [DEBUG] [LOCAL ] GGG: Primary data saved (41252 records). [2025-10-17T19:09:31.581801] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-17T19:09:31.581879] [INFO ] [MAIN ] Update Progress: 926/2368 symbols completed. GGG took 40.1s. Estimated remaining: 3h 21m 36s. Rate: 7.2 symbols/min [2025-10-17T19:09:31.748252] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:09:31.758475] [DEBUG] [LOCAL ] GHI: Loaded 7465 existing records from primary storage. [2025-10-17T19:09:31.758674] [INFO ] [MAIN ] GHI: Loaded 7465 existing records. [2025-10-17T19:09:31.840208] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T19:09:31.940220] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:09:31.940543] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-17T19:09:31.940600] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-17T19:09:31.940797] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-17T19:09:31.940859] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-17T19:09:31.963275] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-17T19:09:32.288148] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:09:32.490812] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-17T19:09:32.758024] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-17T19:09:33.558021] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-17T19:09:33.746266] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T19:09:33.925503] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-17T19:09:34.358049] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-17T19:09:35.000448] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-17T19:09:35.001378] [INFO ] [REMOTE ] GGZ: Full fetch complete (3910 records). [2025-10-17T19:09:35.001447] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-17T19:09:35.170460] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-17T19:09:35.356093] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-17T19:09:35.356184] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-17T19:09:35.356333] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-17T19:09:35.356374] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-17T19:09:35.356735] [DEBUG] [LOCAL ] GGZ: Trimmed 3910 records to 2448 (keeping 200 days of data) [2025-10-17T19:09:35.371765] [DEBUG] [LOCAL ] GGZ: Primary data saved (2448 records). [2025-10-17T19:09:35.371827] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-17T19:09:35.371891] [INFO ] [MAIN ] Update Progress: 927/2368 symbols completed. GGZ took 21.1s. Estimated remaining: 3h 21m 21s. Rate: 7.2 symbols/min [2025-10-17T19:09:35.537823] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:09:35.544737] [DEBUG] [LOCAL ] GHLD: Loaded 4312 existing records from primary storage. [2025-10-17T19:09:35.544923] [INFO ] [MAIN ] GHLD: Loaded 4312 existing records. [2025-10-17T19:09:35.719088] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:09:35.719356] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-17T19:09:35.719416] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-17T19:09:35.719568] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-17T19:09:35.719624] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-17T19:09:35.963269] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-17T19:09:36.068736] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T19:09:36.087769] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:09:36.443419] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-17T19:09:36.758030] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-17T19:09:37.217371] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-17T19:09:37.558024] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-17T19:09:38.140015] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-17T19:09:38.358031] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-17T19:09:38.806876] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-17T19:09:39.158094] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-17T19:09:39.619175] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-17T19:09:39.958027] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-17T19:09:40.386401] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-17T19:09:40.758009] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-17T19:09:41.118110] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-17T19:09:41.558038] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-17T19:09:42.210748] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-17T19:09:42.358019] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-17T19:09:43.138602] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-17T19:09:43.157993] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-17T19:09:43.882907] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T19:09:43.958081] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-17T19:09:44.569423] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T19:09:44.758056] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-17T19:09:45.376436] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-17T19:09:45.558030] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-17T19:09:46.211050] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-17T19:09:46.358057] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-17T19:09:46.900453] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-17T19:09:47.158037] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-17T19:09:47.797959] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-17T19:09:47.958045] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-17T19:09:48.416048] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-17T19:09:48.758076] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-17T19:09:49.303631] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-17T19:09:49.558032] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-17T19:09:50.025006] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-17T19:09:50.358056] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-17T19:09:50.988887] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-17T19:09:51.158094] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-17T19:09:51.658369] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-17T19:09:51.957992] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-17T19:09:52.581729] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T19:09:52.758060] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-17T19:09:53.336510] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-17T19:09:53.558044] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-17T19:09:54.030023] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-17T19:09:54.358052] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-17T19:09:55.025395] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-17T19:09:55.026480] [INFO ] [REMOTE ] GHG: Full fetch complete (4168 records). [2025-10-17T19:09:55.026549] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-17T19:09:55.163133] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-17T19:09:55.380493] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-17T19:09:55.380570] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-17T19:09:55.380721] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-17T19:09:55.380782] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-17T19:09:55.381199] [DEBUG] [LOCAL ] GHG: Trimmed 4168 records to 3317 (keeping 200 days of data) [2025-10-17T19:09:55.402697] [DEBUG] [LOCAL ] GHG: Primary data saved (3317 records). [2025-10-17T19:09:55.402843] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-17T19:09:55.402953] [INFO ] [MAIN ] Update Progress: 928/2368 symbols completed. GHG took 30.5s. Estimated remaining: 3h 21m 30s. Rate: 7.1 symbols/min [2025-10-17T19:09:55.567230] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:09:55.581931] [DEBUG] [LOCAL ] GHM: Loaded 14491 existing records from primary storage. [2025-10-17T19:09:55.582129] [INFO ] [MAIN ] GHM: Loaded 14491 existing records. [2025-10-17T19:09:55.768820] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-17T19:09:55.768664] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:09:55.770417] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-17T19:09:55.770468] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-17T19:09:55.770613] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-17T19:09:55.770687] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-17T19:09:55.967347] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-17T19:09:56.123546] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:09:56.537668] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-17T19:09:56.758070] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-17T19:09:57.558013] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-17T19:09:57.704099] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T19:09:58.085668] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-17T19:09:58.358004] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-17T19:09:58.801801] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-17T19:09:59.158048] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-17T19:09:59.751451] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-17T19:09:59.958032] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-17T19:10:00.758009] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-17T19:10:00.823270] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T19:10:01.558068] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-17T19:10:02.358118] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-17T19:10:02.740863] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-17T19:10:02.866119] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T19:10:02.867205] [INFO ] [REMOTE ] GHC: Full fetch complete (3644 records). [2025-10-17T19:10:02.867293] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-17T19:10:03.150613] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-17T19:10:03.163383] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-17T19:10:03.234268] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-17T19:10:03.234343] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-17T19:10:03.234460] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-17T19:10:03.234499] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-17T19:10:03.234913] [DEBUG] [LOCAL ] GHC: Trimmed 3644 records to 2977 (keeping 200 days of data) [2025-10-17T19:10:03.253852] [DEBUG] [LOCAL ] GHC: Primary data saved (2977 records). [2025-10-17T19:10:03.253934] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-17T19:10:03.254011] [INFO ] [MAIN ] Update Progress: 929/2368 symbols completed. GHC took 46.0s. Estimated remaining: 3h 21m 21s. Rate: 7.1 symbols/min [2025-10-17T19:10:03.419235] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:10:03.440837] [DEBUG] [LOCAL ] GHY: Loaded 21076 existing records from primary storage. [2025-10-17T19:10:03.441090] [INFO ] [MAIN ] GHY: Loaded 21076 existing records. [2025-10-17T19:10:03.613482] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:10:03.613710] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-17T19:10:03.613769] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-17T19:10:03.614022] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-17T19:10:03.614253] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-17T19:10:03.962745] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-17T19:10:03.962664] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:10:04.135988] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T19:10:04.534701] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T19:10:04.758096] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-17T19:10:05.558039] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-17T19:10:05.651065] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T19:10:06.357999] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-17T19:10:06.686640] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T19:10:07.158002] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-17T19:10:07.370613] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T19:10:07.950021] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T19:10:07.957978] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-17T19:10:08.758028] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-17T19:10:09.221919] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T19:10:09.558048] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-17T19:10:09.747208] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T19:10:10.358052] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-17T19:10:10.525848] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-17T19:10:10.527989] [INFO ] [REMOTE ] GHI: Full fetch complete (11273 records). [2025-10-17T19:10:10.528096] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-17T19:10:10.901142] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-17T19:10:10.901218] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-17T19:10:10.901469] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-17T19:10:10.901508] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-17T19:10:10.901959] [DEBUG] [LOCAL ] GHI: Trimmed 11273 records to 7591 (keeping 200 days of data) [2025-10-17T19:10:10.948513] [DEBUG] [LOCAL ] GHI: Primary data saved (7591 records). [2025-10-17T19:10:10.948673] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-17T19:10:10.948782] [INFO ] [MAIN ] Update Progress: 930/2368 symbols completed. GHI took 39.4s. Estimated remaining: 3h 21m 12s. Rate: 7.1 symbols/min [2025-10-17T19:10:11.158776] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-17T19:10:11.161850] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:10:11.195842] [DEBUG] [LOCAL ] GIB: Loaded 31938 existing records from primary storage. [2025-10-17T19:10:11.196263] [INFO ] [MAIN ] GIB: Loaded 31938 existing records. [2025-10-17T19:10:11.314679] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T19:10:11.401452] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:10:11.401744] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-17T19:10:11.401811] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-17T19:10:11.402044] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-17T19:10:11.402099] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-17T19:10:11.778281] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:10:11.910022] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-17T19:10:11.911284] [INFO ] [REMOTE ] GHLD: Full fetch complete (5100 records). [2025-10-17T19:10:11.911354] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-17T19:10:11.963433] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-17T19:10:12.271201] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-17T19:10:12.271275] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-17T19:10:12.271417] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-17T19:10:12.271475] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-17T19:10:12.271876] [DEBUG] [LOCAL ] GHLD: Trimmed 5100 records to 4348 (keeping 200 days of data) [2025-10-17T19:10:12.297304] [DEBUG] [LOCAL ] GHLD: Primary data saved (4348 records). [2025-10-17T19:10:12.297400] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-17T19:10:12.297485] [INFO ] [MAIN ] Update Progress: 931/2368 symbols completed. GHLD took 36.9s. Estimated remaining: 3h 20m 52s. Rate: 7.2 symbols/min [2025-10-17T19:10:12.464872] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:10:12.480022] [DEBUG] [LOCAL ] GIC: Loaded 13495 existing records from primary storage. [2025-10-17T19:10:12.480299] [INFO ] [MAIN ] GIC: Loaded 13495 existing records. [2025-10-17T19:10:12.664858] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:10:12.665051] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-17T19:10:12.665099] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-17T19:10:12.665250] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-17T19:10:12.665288] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-17T19:10:12.763163] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-17T19:10:12.973428] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T19:10:13.034153] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:10:13.558032] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-17T19:10:13.925463] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T19:10:14.358071] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-17T19:10:14.483369] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T19:10:15.158005] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-17T19:10:15.552398] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-17T19:10:15.958000] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-17T19:10:16.109032] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T19:10:16.758069] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-17T19:10:16.776267] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T19:10:17.558033] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-17T19:10:17.941232] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T19:10:18.358033] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-17T19:10:18.637202] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T19:10:19.158052] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-17T19:10:19.336486] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-17T19:10:19.958010] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-17T19:10:20.136501] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-17T19:10:20.758016] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-17T19:10:20.939136] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-17T19:10:21.558020] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-17T19:10:22.058182] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T19:10:22.358075] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-17T19:10:22.431590] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-17T19:10:23.158051] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-17T19:10:23.765365] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T19:10:23.958034] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-17T19:10:24.528352] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-17T19:10:24.758014] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-17T19:10:24.901534] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-17T19:10:25.396867] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T19:10:25.558032] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-17T19:10:26.358060] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-17T19:10:26.499200] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T19:10:27.158057] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-17T19:10:27.808477] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T19:10:27.907847] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T19:10:27.958064] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-17T19:10:28.758106] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-17T19:10:28.926004] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-17T19:10:29.558685] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-17T19:10:29.866852] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T19:10:29.869763] [INFO ] [REMOTE ] GHM: Full fetch complete (22080 records). [2025-10-17T19:10:29.869838] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-17T19:10:30.242549] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-17T19:10:30.242626] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-17T19:10:30.243101] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-17T19:10:30.243152] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-17T19:10:30.243762] [DEBUG] [LOCAL ] GHM: Trimmed 22080 records to 14580 (keeping 200 days of data) [2025-10-17T19:10:30.326877] [DEBUG] [LOCAL ] GHM: Primary data saved (14580 records). [2025-10-17T19:10:30.327009] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-17T19:10:30.327090] [INFO ] [MAIN ] Update Progress: 932/2368 symbols completed. GHM took 34.9s. Estimated remaining: 3h 20m 59s. Rate: 7.1 symbols/min [2025-10-17T19:10:30.364380] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-17T19:10:30.501448] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:10:30.542370] [DEBUG] [LOCAL ] GIL: Loaded 44162 existing records from primary storage. [2025-10-17T19:10:30.542697] [INFO ] [MAIN ] GIL: Loaded 44162 existing records. [2025-10-17T19:10:30.657935] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T19:10:30.738029] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:10:30.738257] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-17T19:10:30.738305] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-17T19:10:30.738673] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-17T19:10:30.738731] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-17T19:10:31.080023] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:10:31.157990] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-17T19:10:31.964560] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-17T19:10:31.980213] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T19:10:32.568204] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T19:10:32.758005] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-17T19:10:33.117427] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T19:10:33.121174] [INFO ] [REMOTE ] GHY: Full fetch complete (32570 records). [2025-10-17T19:10:33.121253] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-17T19:10:33.498192] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-17T19:10:33.498528] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-17T19:10:33.499305] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-17T19:10:33.499370] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-17T19:10:33.500175] [DEBUG] [LOCAL ] GHY: Trimmed 32570 records to 21330 (keeping 200 days of data) [2025-10-17T19:10:33.562411] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-17T19:10:33.638936] [DEBUG] [LOCAL ] GHY: Primary data saved (21330 records). [2025-10-17T19:10:33.639107] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-17T19:10:33.639217] [INFO ] [MAIN ] Update Progress: 933/2368 symbols completed. GHY took 30.4s. Estimated remaining: 3h 20m 42s. Rate: 7.1 symbols/min [2025-10-17T19:10:33.814606] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:10:33.868308] [DEBUG] [LOCAL ] GIS: Loaded 54063 existing records from primary storage. [2025-10-17T19:10:33.868665] [INFO ] [MAIN ] GIS: Loaded 54063 existing records. [2025-10-17T19:10:34.048098] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:10:34.048640] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-17T19:10:34.048937] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-17T19:10:34.049543] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-17T19:10:34.068107] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-17T19:10:34.119426] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T19:10:34.365313] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-17T19:10:34.462924] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:10:34.470753] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T19:10:35.158015] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-17T19:10:35.651756] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T19:10:35.716818] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-17T19:10:35.958059] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-17T19:10:36.758044] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-17T19:10:37.180869] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T19:10:37.558039] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-17T19:10:38.146920] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T19:10:38.358032] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-17T19:10:38.399439] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-17T19:10:39.158043] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-17T19:10:39.880405] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T19:10:39.957984] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-17T19:10:40.608101] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T19:10:40.758027] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-17T19:10:41.558034] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-17T19:10:41.602371] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T19:10:41.692890] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T19:10:42.358015] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-17T19:10:42.665305] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-17T19:10:43.158026] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-17T19:10:43.958065] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-17T19:10:44.258434] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T19:10:44.345502] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T19:10:44.758059] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-17T19:10:45.464453] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T19:10:45.558010] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-17T19:10:45.691390] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T19:10:46.358050] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-17T19:10:46.887092] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T19:10:47.158064] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-17T19:10:47.318886] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T19:10:47.321856] [INFO ] [REMOTE ] GIC: Full fetch complete (19918 records). [2025-10-17T19:10:47.321973] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-17T19:10:47.682810] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-17T19:10:47.682910] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-17T19:10:47.683394] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-17T19:10:47.683435] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-17T19:10:47.684100] [DEBUG] [LOCAL ] GIC: Trimmed 19918 records to 13587 (keeping 200 days of data) [2025-10-17T19:10:47.766051] [DEBUG] [LOCAL ] GIC: Primary data saved (13587 records). [2025-10-17T19:10:47.766195] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-17T19:10:47.766278] [INFO ] [MAIN ] Update Progress: 934/2368 symbols completed. GIC took 35.5s. Estimated remaining: 3h 20m 43s. Rate: 7.1 symbols/min [2025-10-17T19:10:47.930924] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:10:47.967356] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-17T19:10:47.970456] [DEBUG] [LOCAL ] GKOS: Loaded 42824 existing records from primary storage. [2025-10-17T19:10:47.970879] [INFO ] [MAIN ] GKOS: Loaded 42824 existing records. [2025-10-17T19:10:48.146085] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:10:48.146291] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-17T19:10:48.146337] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-17T19:10:48.146540] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-17T19:10:48.146596] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-17T19:10:48.503007] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:10:48.606388] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T19:10:48.758075] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-17T19:10:49.440941] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T19:10:49.446520] [INFO ] [REMOTE ] GIB: Full fetch complete (46221 records). [2025-10-17T19:10:49.446662] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-17T19:10:49.563140] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-17T19:10:49.834861] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-17T19:10:49.834947] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-17T19:10:49.835773] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-17T19:10:49.835838] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-17T19:10:49.836872] [DEBUG] [LOCAL ] GIB: Trimmed 46221 records to 32143 (keeping 200 days of data) [2025-10-17T19:10:50.032922] [DEBUG] [LOCAL ] GIB: Primary data saved (32143 records). [2025-10-17T19:10:50.033072] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-17T19:10:50.034162] [INFO ] [MAIN ] Update Progress: 935/2368 symbols completed. GIB took 39.1s. Estimated remaining: 3h 20m 25s. Rate: 7.2 symbols/min [2025-10-17T19:10:50.211944] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:10:50.257709] [DEBUG] [LOCAL ] GL: Loaded 37863 existing records from primary storage. [2025-10-17T19:10:50.258021] [INFO ] [MAIN ] GL: Loaded 37863 existing records. [2025-10-17T19:10:50.359829] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-17T19:10:50.442251] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:10:50.442596] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-17T19:10:50.442740] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-17T19:10:50.442977] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-17T19:10:50.443128] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-17T19:10:50.622477] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T19:10:50.873598] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:10:50.895580] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T19:10:51.158057] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-17T19:10:51.958030] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-17T19:10:52.225035] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T19:10:52.758020] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-17T19:10:52.783338] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T19:10:53.402307] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T19:10:53.558038] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-17T19:10:54.358034] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-17T19:10:54.604812] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T19:10:55.020720] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T19:10:55.157994] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-17T19:10:55.712611] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:10:55.958104] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-17T19:10:56.758057] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-17T19:10:57.152369] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T19:10:57.547526] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T19:10:57.553924] [INFO ] [REMOTE ] GIL: Full fetch complete (62402 records). [2025-10-17T19:10:57.554067] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-17T19:10:57.567291] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-17T19:10:57.948862] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-17T19:10:57.948962] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-17T19:10:57.949845] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-17T19:10:57.949929] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-17T19:10:57.951231] [DEBUG] [LOCAL ] GIL: Trimmed 62402 records to 44482 (keeping 200 days of data) [2025-10-17T19:10:58.221057] [DEBUG] [LOCAL ] GIL: Primary data saved (44482 records). [2025-10-17T19:10:58.221185] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-17T19:10:58.221868] [INFO ] [MAIN ] Update Progress: 936/2368 symbols completed. GIL took 27.9s. Estimated remaining: 3h 20m 16s. Rate: 7.2 symbols/min [2025-10-17T19:10:58.369241] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-17T19:10:58.391592] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:10:58.423946] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T19:10:58.477558] [DEBUG] [LOCAL ] GLOB: Loaded 48330 existing records from primary storage. [2025-10-17T19:10:58.477931] [INFO ] [MAIN ] GLOB: Loaded 48330 existing records. [2025-10-17T19:10:58.656918] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:10:58.657121] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-17T19:10:58.657168] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-17T19:10:58.657362] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-17T19:10:58.657419] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-17T19:10:59.012512] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:10:59.095145] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-17T19:10:59.157987] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-17T19:10:59.958007] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-17T19:11:00.433355] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T19:11:00.589906] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T19:11:00.758053] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-17T19:11:01.558003] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-17T19:11:01.657427] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T19:11:02.358019] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-17T19:11:02.852314] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T19:11:03.006495] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-17T19:11:03.158023] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-17T19:11:03.902478] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T19:11:03.957990] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-17T19:11:04.666068] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T19:11:04.758000] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-17T19:11:05.369621] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-17T19:11:05.558042] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-17T19:11:06.358007] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-17T19:11:06.720178] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-17T19:11:07.157996] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-17T19:11:07.239321] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T19:11:07.885816] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T19:11:07.958065] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-17T19:11:08.725787] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T19:11:08.757994] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-17T19:11:09.558031] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-17T19:11:09.776442] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T19:11:09.869198] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T19:11:10.358086] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-17T19:11:11.158020] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-17T19:11:11.252461] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T19:11:11.834437] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T19:11:11.958076] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-17T19:11:12.618375] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T19:11:12.758043] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-17T19:11:13.170444] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-17T19:11:13.558026] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-17T19:11:14.357998] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-17T19:11:14.422358] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T19:11:14.452018] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T19:11:14.459572] [INFO ] [REMOTE ] GIS: Full fetch complete (77838 records). [2025-10-17T19:11:14.459787] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-17T19:11:14.854051] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-17T19:11:14.854149] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-17T19:11:14.855145] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-17T19:11:14.855210] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-17T19:11:14.856723] [DEBUG] [LOCAL ] GIS: Trimmed 77838 records to 54452 (keeping 200 days of data) [2025-10-17T19:11:15.168121] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-17T19:11:15.198095] [DEBUG] [LOCAL ] GIS: Primary data saved (54452 records). [2025-10-17T19:11:15.198202] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-17T19:11:15.198989] [INFO ] [MAIN ] Update Progress: 937/2368 symbols completed. GIS took 41.6s. Estimated remaining: 3h 20m 21s. Rate: 7.1 symbols/min [2025-10-17T19:11:15.368895] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:11:15.381515] [DEBUG] [LOCAL ] GLP: Loaded 9346 existing records from primary storage. [2025-10-17T19:11:15.381785] [INFO ] [MAIN ] GLP: Loaded 9346 existing records. [2025-10-17T19:11:15.558568] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:11:15.558866] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-17T19:11:15.558934] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-17T19:11:15.559114] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-17T19:11:15.559181] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-17T19:11:15.922537] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:11:15.958007] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-17T19:11:16.204444] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T19:11:16.558181] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T19:11:16.758004] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-17T19:11:16.782848] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-17T19:11:17.558039] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-17T19:11:18.238951] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T19:11:18.358033] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-17T19:11:19.158046] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-17T19:11:19.279726] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T19:11:19.958078] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-17T19:11:19.996576] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T19:11:20.688684] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T19:11:20.694070] [INFO ] [REMOTE ] GL: Full fetch complete (55071 records). [2025-10-17T19:11:20.694172] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-17T19:11:20.763154] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-17T19:11:20.811770] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-17T19:11:21.083076] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-17T19:11:21.083156] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-17T19:11:21.083997] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-17T19:11:21.084062] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-17T19:11:21.085162] [DEBUG] [LOCAL ] GL: Trimmed 55071 records to 38100 (keeping 200 days of data) [2025-10-17T19:11:21.325017] [DEBUG] [LOCAL ] GL: Primary data saved (38100 records). [2025-10-17T19:11:21.325160] [INFO ] [MAIN ] GL: Full history saved. [2025-10-17T19:11:21.326043] [INFO ] [MAIN ] Update Progress: 938/2368 symbols completed. GL took 31.3s. Estimated remaining: 3h 20m 9s. Rate: 7.1 symbols/min [2025-10-17T19:11:21.491886] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:11:21.543218] [DEBUG] [LOCAL ] GLW: Loaded 54026 existing records from primary storage. [2025-10-17T19:11:21.543543] [INFO ] [MAIN ] GLW: Loaded 54026 existing records. [2025-10-17T19:11:21.563728] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-17T19:11:21.723845] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:11:21.724063] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-17T19:11:21.724111] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-17T19:11:21.724324] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-17T19:11:21.724381] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-17T19:11:22.066986] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:11:22.358110] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-17T19:11:22.563005] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-17T19:11:23.161829] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-17T19:11:23.162992] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T19:11:23.196329] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T19:11:23.958042] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-17T19:11:24.758038] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-17T19:11:25.054301] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T19:11:25.219167] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T19:11:25.225917] [INFO ] [REMOTE ] GKOS: Full fetch complete (60358 records). [2025-10-17T19:11:25.226107] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-17T19:11:25.574272] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-17T19:11:25.630118] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-17T19:11:25.630200] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-17T19:11:25.631089] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-17T19:11:25.631155] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-17T19:11:25.632384] [DEBUG] [LOCAL ] GKOS: Trimmed 60358 records to 43111 (keeping 200 days of data) [2025-10-17T19:11:25.894794] [DEBUG] [LOCAL ] GKOS: Primary data saved (43111 records). [2025-10-17T19:11:25.894992] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-17T19:11:25.895118] [INFO ] [MAIN ] Update Progress: 939/2368 symbols completed. GKOS took 38.1s. Estimated remaining: 3h 19m 55s. Rate: 7.1 symbols/min [2025-10-17T19:11:26.078094] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:11:26.132015] [DEBUG] [LOCAL ] GM: Loaded 54119 existing records from primary storage. [2025-10-17T19:11:26.132366] [INFO ] [MAIN ] GM: Loaded 54119 existing records. [2025-10-17T19:11:26.308565] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:11:26.308994] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-17T19:11:26.309101] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-17T19:11:26.309382] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-17T19:11:26.309440] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-17T19:11:26.371275] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-17T19:11:26.618597] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-17T19:11:26.707805] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:11:27.148994] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T19:11:27.160578] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-17T19:11:27.331976] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T19:11:27.958044] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-17T19:11:28.758011] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-17T19:11:28.910373] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T19:11:29.558020] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-17T19:11:29.819299] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-17T19:11:30.358004] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-17T19:11:30.512967] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T19:11:31.158022] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-17T19:11:31.261372] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T19:11:31.958021] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-17T19:11:32.152938] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T19:11:32.758025] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-17T19:11:33.138849] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-17T19:11:33.265559] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T19:11:33.284578] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-17T19:11:33.558041] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-17T19:11:34.358025] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-17T19:11:35.109462] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T19:11:35.116092] [INFO ] [REMOTE ] GLOB: Full fetch complete (65823 records). [2025-10-17T19:11:35.116198] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-17T19:11:35.169826] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-17T19:11:35.494519] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-17T19:11:35.494595] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-17T19:11:35.495445] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-17T19:11:35.495507] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-17T19:11:35.496795] [DEBUG] [LOCAL ] GLOB: Trimmed 65823 records to 48655 (keeping 200 days of data) [2025-10-17T19:11:35.784559] [DEBUG] [LOCAL ] GLOB: Primary data saved (48655 records). [2025-10-17T19:11:35.784729] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-17T19:11:35.785238] [INFO ] [MAIN ] Update Progress: 940/2368 symbols completed. GLOB took 37.6s. Estimated remaining: 3h 19m 49s. Rate: 7.1 symbols/min [2025-10-17T19:11:35.953829] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:11:35.958037] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-17T19:11:36.005400] [DEBUG] [LOCAL ] GME: Loaded 54171 existing records from primary storage. [2025-10-17T19:11:36.005757] [INFO ] [MAIN ] GME: Loaded 54171 existing records. [2025-10-17T19:11:36.119629] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-17T19:11:36.195748] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:11:36.195940] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-17T19:11:36.195987] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-17T19:11:36.196267] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-17T19:11:36.196324] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-17T19:11:36.561994] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:11:36.580639] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-17T19:11:36.757995] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-17T19:11:37.558013] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-17T19:11:38.002433] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T19:11:38.358046] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-17T19:11:38.954308] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-17T19:11:38.971394] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-17T19:11:39.158031] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-17T19:11:39.958027] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-17T19:11:40.335002] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-10-17T19:11:40.758048] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-17T19:11:41.558004] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-17T19:11:41.604226] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-17T19:11:41.882027] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T19:11:42.279899] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-17T19:11:42.358052] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-17T19:11:42.886087] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-17T19:11:43.158063] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-17T19:11:43.415900] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-10-17T19:11:43.958049] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-17T19:11:44.758013] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-17T19:11:44.888613] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T19:11:45.562357] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-17T19:11:45.565516] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T19:11:45.930665] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T19:11:46.358104] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-17T19:11:47.158090] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-17T19:11:47.895637] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-17T19:11:47.897485] [INFO ] [REMOTE ] GLP: Full fetch complete (14288 records). [2025-10-17T19:11:47.897557] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-17T19:11:47.961582] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-17T19:11:48.311796] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-17T19:11:48.312143] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-17T19:11:48.314274] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-10-17T19:11:48.314693] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-17T19:11:48.314891] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-17T19:11:48.325518] [DEBUG] [LOCAL ] GLP: Trimmed 14288 records to 9431 (keeping 200 days of data) [2025-10-17T19:11:48.409897] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-17T19:11:48.425362] [DEBUG] [LOCAL ] GLP: Primary data saved (9431 records). [2025-10-17T19:11:48.425476] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-17T19:11:48.425555] [INFO ] [MAIN ] Update Progress: 941/2368 symbols completed. GLP took 33.2s. Estimated remaining: 3h 19m 47s. Rate: 7.1 symbols/min [2025-10-17T19:11:48.589121] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:11:48.639041] [DEBUG] [LOCAL ] GMED: Loaded 48602 existing records from primary storage. [2025-10-17T19:11:48.639399] [INFO ] [MAIN ] GMED: Loaded 48602 existing records. [2025-10-17T19:11:48.763195] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-17T19:11:48.817569] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:11:48.817818] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-17T19:11:48.817883] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-17T19:11:48.818113] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-17T19:11:48.818185] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-17T19:11:49.164139] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:11:49.557993] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-17T19:11:49.977363] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-17T19:11:50.358031] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-17T19:11:50.765668] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-17T19:11:51.158094] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-17T19:11:51.947501] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-17T19:11:51.958211] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-17T19:11:52.587723] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-17T19:11:52.757983] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-17T19:11:53.331336] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-17T19:11:53.558048] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-17T19:11:53.695039] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T19:11:54.358062] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-17T19:11:54.744964] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-17T19:11:54.774897] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-17T19:11:54.782393] [INFO ] [REMOTE ] GLW: Full fetch complete (77793 records). [2025-10-17T19:11:54.782529] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-17T19:11:55.167941] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-17T19:11:55.172912] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-17T19:11:55.172971] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-17T19:11:55.173946] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-17T19:11:55.174093] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-17T19:11:55.175557] [DEBUG] [LOCAL ] GLW: Trimmed 77793 records to 54416 (keeping 200 days of data) [2025-10-17T19:11:55.518148] [DEBUG] [LOCAL ] GLW: Primary data saved (54416 records). [2025-10-17T19:11:55.518292] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-17T19:11:55.518375] [INFO ] [MAIN ] Update Progress: 942/2368 symbols completed. GLW took 34.2s. Estimated remaining: 3h 19m 37s. Rate: 7.1 symbols/min [2025-10-17T19:11:55.684675] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:11:55.720229] [DEBUG] [LOCAL ] GMRE: Loaded 37278 existing records from primary storage. [2025-10-17T19:11:55.720516] [INFO ] [MAIN ] GMRE: Loaded 37278 existing records. [2025-10-17T19:11:55.897155] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:11:55.897400] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-17T19:11:55.897465] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-17T19:11:55.897741] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-17T19:11:55.897817] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-17T19:11:55.964499] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-17T19:11:56.271519] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:11:56.307201] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-10-17T19:11:56.443789] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T19:11:56.758024] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-17T19:11:57.558057] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-17T19:11:57.978630] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-17T19:11:58.164013] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T19:11:58.358022] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-17T19:11:59.156860] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T19:11:59.165493] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-17T19:11:59.717732] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T19:11:59.958015] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-17T19:12:00.039972] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T19:12:00.048779] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-17T19:12:00.049042] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-17T19:12:00.455418] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-17T19:12:00.455518] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-17T19:12:00.456560] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-17T19:12:00.456629] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-17T19:12:00.458222] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 54509 (keeping 200 days of data) [2025-10-17T19:12:00.772856] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-17T19:12:00.802071] [DEBUG] [LOCAL ] GM: Primary data saved (54509 records). [2025-10-17T19:12:00.802223] [INFO ] [MAIN ] GM: Full history saved. [2025-10-17T19:12:00.802312] [INFO ] [MAIN ] Update Progress: 943/2368 symbols completed. GM took 34.9s. Estimated remaining: 3h 19m 23s. Rate: 7.1 symbols/min [2025-10-17T19:12:00.970639] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:12:00.988756] [DEBUG] [LOCAL ] GNE: Loaded 18130 existing records from primary storage. [2025-10-17T19:12:00.989013] [INFO ] [MAIN ] GNE: Loaded 18130 existing records. [2025-10-17T19:12:01.165433] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:12:01.165687] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-17T19:12:01.165756] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-17T19:12:01.165972] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-17T19:12:01.166052] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-17T19:12:01.522320] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:12:01.557998] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-17T19:12:01.887051] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T19:12:02.358070] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-17T19:12:03.158062] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-17T19:12:03.245147] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T19:12:03.726333] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-10-17T19:12:03.963111] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-17T19:12:03.981418] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T19:12:04.011157] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T19:12:04.758042] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-17T19:12:05.545246] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T19:12:05.557982] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-17T19:12:06.340962] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T19:12:06.357982] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-17T19:12:06.467203] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-17T19:12:07.158006] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-17T19:12:07.213506] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T19:12:07.958025] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-17T19:12:08.758018] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-17T19:12:08.787897] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-17T19:12:08.928244] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T19:12:09.558047] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-17T19:12:10.093777] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T19:12:10.358043] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-17T19:12:11.157185] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T19:12:11.165901] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-17T19:12:11.958069] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-17T19:12:12.661212] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T19:12:12.758026] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-17T19:12:12.943948] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-17T19:12:13.321113] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T19:12:13.558010] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-17T19:12:14.184557] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T19:12:14.358038] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-17T19:12:15.087562] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T19:12:15.144100] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-17T19:12:15.157996] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-17T19:12:15.958028] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-17T19:12:16.367871] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T19:12:16.758061] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-17T19:12:17.557998] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-17T19:12:17.946445] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-17T19:12:18.358058] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-17T19:12:18.435045] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-17T19:12:18.977219] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T19:12:19.158026] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-17T19:12:19.958044] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-17T19:12:20.604212] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T19:12:20.757984] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-17T19:12:20.799186] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-17T19:12:21.558005] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-17T19:12:21.766831] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:12:21.773904] [INFO ] [REMOTE ] GMED: Full fetch complete (69977 records). [2025-10-17T19:12:21.774076] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-17T19:12:22.167743] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-17T19:12:22.167878] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-17T19:12:22.168948] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-17T19:12:22.169122] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-17T19:12:22.170838] [DEBUG] [LOCAL ] GMED: Trimmed 69977 records to 48880 (keeping 200 days of data) [2025-10-17T19:12:22.320370] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T19:12:22.366015] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-17T19:12:22.497211] [DEBUG] [LOCAL ] GMED: Primary data saved (48880 records). [2025-10-17T19:12:22.497393] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-17T19:12:22.498016] [INFO ] [MAIN ] Update Progress: 944/2368 symbols completed. GMED took 34.1s. Estimated remaining: 3h 19m 35s. Rate: 7.1 symbols/min [2025-10-17T19:12:22.663211] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:12:22.707092] [DEBUG] [LOCAL ] GNK: Loaded 40280 existing records from primary storage. [2025-10-17T19:12:22.707541] [INFO ] [MAIN ] GNK: Loaded 40280 existing records. [2025-10-17T19:12:22.880253] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:12:22.880552] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-17T19:12:22.880599] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-17T19:12:22.880913] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-17T19:12:22.880970] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-17T19:12:23.163202] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-17T19:12:23.229172] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:12:23.541865] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-17T19:12:23.958003] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-17T19:12:24.112539] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-17T19:12:24.386425] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T19:12:24.758022] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-17T19:12:25.397892] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T19:12:25.558003] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-17T19:12:26.186356] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T19:12:26.190505] [INFO ] [REMOTE ] GMRE: Full fetch complete (52377 records). [2025-10-17T19:12:26.190619] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-17T19:12:26.367613] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-17T19:12:26.563573] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T19:12:26.596139] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-17T19:12:26.596331] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-17T19:12:26.597474] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-17T19:12:26.597537] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-17T19:12:26.598594] [DEBUG] [LOCAL ] GMRE: Trimmed 52377 records to 37414 (keeping 200 days of data) [2025-10-17T19:12:26.820457] [DEBUG] [LOCAL ] GMRE: Primary data saved (37414 records). [2025-10-17T19:12:26.820592] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-17T19:12:26.820693] [INFO ] [MAIN ] Update Progress: 945/2368 symbols completed. GMRE took 31.3s. Estimated remaining: 3h 19m 21s. Rate: 7.1 symbols/min [2025-10-17T19:12:26.986528] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:12:27.025544] [DEBUG] [LOCAL ] GNL: Loaded 47059 existing records from primary storage. [2025-10-17T19:12:27.025863] [INFO ] [MAIN ] GNL: Loaded 47059 existing records. [2025-10-17T19:12:27.163174] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-17T19:12:27.202577] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:12:27.202795] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-17T19:12:27.202844] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-17T19:12:27.203039] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-17T19:12:27.203095] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-17T19:12:27.563086] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:12:27.958041] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-17T19:12:28.252150] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-17T19:12:28.254450] [INFO ] [REMOTE ] GNE: Full fetch complete (22515 records). [2025-10-17T19:12:28.254521] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-17T19:12:28.620401] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-17T19:12:28.620485] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-17T19:12:28.621020] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-17T19:12:28.621084] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-17T19:12:28.621893] [DEBUG] [LOCAL ] GNE: Trimmed 22515 records to 18212 (keeping 200 days of data) [2025-10-17T19:12:28.738619] [DEBUG] [LOCAL ] GNE: Primary data saved (18212 records). [2025-10-17T19:12:28.739051] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-17T19:12:28.739146] [INFO ] [MAIN ] Update Progress: 946/2368 symbols completed. GNE took 27.9s. Estimated remaining: 3h 19m 2s. Rate: 7.1 symbols/min [2025-10-17T19:12:28.770940] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-17T19:12:28.919109] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:12:28.966621] [DEBUG] [LOCAL ] GNRC: Loaded 45849 existing records from primary storage. [2025-10-17T19:12:28.967018] [INFO ] [MAIN ] GNRC: Loaded 45849 existing records. [2025-10-17T19:12:29.190422] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:12:29.190866] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-17T19:12:29.191112] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-17T19:12:29.191991] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-17T19:12:29.192219] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-17T19:12:29.229300] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.86 seconds). [2025-10-17T19:12:29.311957] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T19:12:29.344850] [INFO ] [REMOTE ] GME: Full fetch complete (77923 records). [2025-10-17T19:12:29.346306] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-17T19:12:29.597450] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-17T19:12:29.966600] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:12:30.050436] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-17T19:12:30.050537] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-17T19:12:30.051531] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-17T19:12:30.051715] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-17T19:12:30.053384] [DEBUG] [LOCAL ] GME: Trimmed 77923 records to 54561 (keeping 200 days of data) [2025-10-17T19:12:30.299390] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T19:12:30.378515] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-17T19:12:30.432067] [DEBUG] [LOCAL ] GME: Primary data saved (54561 records). [2025-10-17T19:12:30.432189] [INFO ] [MAIN ] GME: Full history saved. [2025-10-17T19:12:30.432269] [INFO ] [MAIN ] Update Progress: 947/2368 symbols completed. GME took 54.6s. Estimated remaining: 3h 18m 44s. Rate: 7.2 symbols/min [2025-10-17T19:12:30.597114] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:12:30.607231] [DEBUG] [LOCAL ] GNT: Loaded 8541 existing records from primary storage. [2025-10-17T19:12:30.607518] [INFO ] [MAIN ] GNT: Loaded 8541 existing records. [2025-10-17T19:12:30.791891] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:12:30.792158] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-17T19:12:30.792221] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-17T19:12:30.792404] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-17T19:12:30.792477] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-17T19:12:31.098285] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T19:12:31.164663] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-17T19:12:31.185019] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:12:31.958025] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-17T19:12:32.009478] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T19:12:32.729057] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T19:12:32.758013] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-17T19:12:33.558001] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-17T19:12:33.600189] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T19:12:34.252787] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-17T19:12:34.281620] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T19:12:34.357992] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-17T19:12:35.158037] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-17T19:12:35.958000] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-17T19:12:36.053624] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T19:12:36.700184] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T19:12:36.757991] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-17T19:12:37.561722] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-17T19:12:37.566751] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T19:12:38.217980] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T19:12:38.358030] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-17T19:12:38.955950] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T19:12:39.158005] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-17T19:12:39.299789] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T19:12:39.958027] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-17T19:12:40.678329] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-17T19:12:40.706346] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T19:12:40.758032] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-17T19:12:41.558025] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-17T19:12:42.358063] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-17T19:12:42.399712] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T19:12:43.158072] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-17T19:12:43.217018] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T19:12:43.958010] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-17T19:12:44.124397] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T19:12:44.544755] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T19:12:44.758060] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-17T19:12:44.855438] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T19:12:45.558034] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-17T19:12:46.307465] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-17T19:12:46.357998] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-17T19:12:46.399856] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T19:12:47.098504] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T19:12:47.157996] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-17T19:12:47.904878] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-17T19:12:47.958018] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-17T19:12:48.758033] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-17T19:12:49.554904] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-17T19:12:49.558299] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-17T19:12:50.156127] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-17T19:12:50.180041] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T19:12:50.358053] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-17T19:12:50.826829] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-17T19:12:51.158049] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-17T19:12:51.958035] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-17T19:12:52.669621] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T19:12:52.763166] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-17T19:12:52.764148] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T19:12:53.558013] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-17T19:12:54.306416] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T19:12:54.314738] [INFO ] [REMOTE ] GNK: Full fetch complete (57308 records). [2025-10-17T19:12:54.314921] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-17T19:12:54.359208] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-17T19:12:54.423429] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T19:12:54.468868] [INFO ] [REMOTE ] GNT: Full fetch complete (11303 records). [2025-10-17T19:12:54.511736] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-17T19:12:55.022016] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-17T19:12:55.027506] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-17T19:12:55.061834] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-17T19:12:55.086715] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-17T19:12:55.159284] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-17T19:12:55.202152] [DEBUG] [LOCAL ] GNK: Trimmed 57308 records to 40529 (keeping 200 days of data) [2025-10-17T19:12:55.418745] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-17T19:12:55.419285] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-17T19:12:55.419867] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-17T19:12:55.422070] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-17T19:12:55.425992] [DEBUG] [LOCAL ] GNT: Trimmed 11303 records to 8665 (keeping 200 days of data) [2025-10-17T19:12:55.499404] [DEBUG] [LOCAL ] GNT: Primary data saved (8665 records). [2025-10-17T19:12:55.501014] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-17T19:12:55.501730] [INFO ] [MAIN ] Update Progress: 948/2368 symbols completed. GNT took 25.1s. Estimated remaining: 3h 19m 1s. Rate: 7.1 symbols/min [2025-10-17T19:12:55.683143] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:12:55.840620] [DEBUG] [LOCAL ] GNW: Loaded 51779 existing records from primary storage. [2025-10-17T19:12:55.842145] [INFO ] [MAIN ] GNW: Loaded 51779 existing records. [2025-10-17T19:12:55.863260] [DEBUG] [LOCAL ] GNK: Primary data saved (40529 records). [2025-10-17T19:12:55.897195] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-17T19:12:55.923279] [INFO ] [MAIN ] Update Progress: 949/2368 symbols completed. GNK took 33.4s. Estimated remaining: 3h 18m 40s. Rate: 7.1 symbols/min [2025-10-17T19:12:56.125953] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:12:56.130046] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-17T19:12:56.130133] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-17T19:12:56.130665] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-17T19:12:56.141184] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-17T19:12:56.329024] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:12:56.357403] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-17T19:12:56.453262] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-17T19:12:56.688541] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:12:56.689629] [DEBUG] [LOCAL ] GOF: Loaded 42964 existing records from primary storage. [2025-10-17T19:12:56.690271] [INFO ] [MAIN ] GOF: Loaded 42964 existing records. [2025-10-17T19:12:56.761920] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-17T19:12:56.869109] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:12:56.869478] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-17T19:12:56.869596] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-17T19:12:56.869882] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-17T19:12:56.869941] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-17T19:12:57.071389] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-17T19:12:57.266943] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:12:57.558042] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-17T19:12:58.025061] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T19:12:58.358067] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-17T19:12:58.599522] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T19:12:58.833839] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T19:12:59.158064] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-17T19:12:59.958040] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-17T19:13:00.056932] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T19:13:00.758054] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-17T19:13:01.571809] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-17T19:13:01.574527] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-17T19:13:02.035675] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-17T19:13:02.358090] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-17T19:13:03.158008] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-17T19:13:03.497342] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-17T19:13:03.940210] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T19:13:03.957981] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-17T19:13:04.386745] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T19:13:04.510493] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-10-17T19:13:04.758078] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-17T19:13:05.558049] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-17T19:13:05.752929] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T19:13:06.358014] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-17T19:13:06.404589] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T19:13:07.049392] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T19:13:07.157996] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-17T19:13:07.958090] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-17T19:13:08.077969] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T19:13:08.606244] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T19:13:08.758042] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-17T19:13:09.558050] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-17T19:13:09.731350] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T19:13:09.737994] [INFO ] [REMOTE ] GNL: Full fetch complete (68204 records). [2025-10-17T19:13:09.738141] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-17T19:13:10.130057] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-17T19:13:10.130138] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-17T19:13:10.131131] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-17T19:13:10.131196] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-17T19:13:10.132667] [DEBUG] [LOCAL ] GNL: Trimmed 68204 records to 47399 (keeping 200 days of data) [2025-10-17T19:13:10.358835] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-17T19:13:10.435140] [DEBUG] [LOCAL ] GNL: Primary data saved (47399 records). [2025-10-17T19:13:10.435323] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-17T19:13:10.435421] [INFO ] [MAIN ] Update Progress: 950/2368 symbols completed. GNL took 43.6s. Estimated remaining: 3h 18m 41s. Rate: 7.1 symbols/min [2025-10-17T19:13:10.610877] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:13:10.641824] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T19:13:10.677849] [DEBUG] [LOCAL ] GOLF: Loaded 31115 existing records from primary storage. [2025-10-17T19:13:10.678140] [INFO ] [MAIN ] GOLF: Loaded 31115 existing records. [2025-10-17T19:13:10.853846] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:13:10.854129] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-17T19:13:10.854194] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-17T19:13:10.854414] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-17T19:13:10.854484] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-17T19:13:11.182919] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-17T19:13:11.219969] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:13:11.258349] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T19:13:11.842544] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T19:13:11.958037] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-17T19:13:12.758029] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-17T19:13:12.927165] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T19:13:12.933563] [INFO ] [REMOTE ] GNRC: Full fetch complete (65709 records). [2025-10-17T19:13:12.933705] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-17T19:13:13.324294] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-17T19:13:13.324395] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-17T19:13:13.325422] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-17T19:13:13.325561] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-17T19:13:13.348632] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T19:13:13.358144] [DEBUG] [LOCAL ] GNRC: Trimmed 65709 records to 46194 (keeping 200 days of data) [2025-10-17T19:13:13.565349] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-17T19:13:13.637945] [DEBUG] [LOCAL ] GNRC: Primary data saved (46194 records). [2025-10-17T19:13:13.638083] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-17T19:13:13.638219] [INFO ] [MAIN ] Update Progress: 951/2368 symbols completed. GNRC took 44.9s. Estimated remaining: 3h 18m 25s. Rate: 7.1 symbols/min [2025-10-17T19:13:13.806817] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:13:13.848903] [DEBUG] [LOCAL ] GOOS: Loaded 44895 existing records from primary storage. [2025-10-17T19:13:13.849216] [INFO ] [MAIN ] GOOS: Loaded 44895 existing records. [2025-10-17T19:13:14.015414] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T19:13:14.049683] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:13:14.049902] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-17T19:13:14.049949] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-17T19:13:14.050146] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-17T19:13:14.050203] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-17T19:13:14.372010] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-17T19:13:14.413837] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:13:15.158060] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-17T19:13:15.280404] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T19:13:15.958091] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-17T19:13:16.069673] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T19:13:16.132811] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T19:13:16.758059] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-17T19:13:17.547948] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T19:13:17.558781] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-17T19:13:18.358004] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-17T19:13:18.423287] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T19:13:18.596610] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T19:13:19.158040] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-17T19:13:19.958068] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-17T19:13:20.044999] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T19:13:20.633929] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T19:13:20.758012] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-17T19:13:21.115250] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T19:13:21.558048] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-17T19:13:21.935042] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T19:13:22.358042] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-17T19:13:23.158070] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-17T19:13:23.321480] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T19:13:23.662018] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T19:13:23.958047] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-17T19:13:24.129296] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T19:13:24.758058] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-17T19:13:25.516951] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T19:13:25.558014] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-17T19:13:26.359495] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-17T19:13:26.362330] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T19:13:26.796169] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T19:13:27.158025] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-17T19:13:27.958035] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-17T19:13:28.223197] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-17T19:13:28.230537] [INFO ] [REMOTE ] GNW: Full fetch complete (73875 records). [2025-10-17T19:13:28.230729] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-17T19:13:28.661373] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-17T19:13:28.661490] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-17T19:13:28.662521] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-17T19:13:28.662634] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-17T19:13:28.664567] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T19:13:28.671934] [DEBUG] [LOCAL ] GNW: Trimmed 73875 records to 52153 (keeping 200 days of data) [2025-10-17T19:13:28.758031] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-17T19:13:28.963104] [DEBUG] [LOCAL ] GNW: Primary data saved (52153 records). [2025-10-17T19:13:28.963243] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-17T19:13:28.963773] [INFO ] [MAIN ] Update Progress: 952/2368 symbols completed. GNW took 33.5s. Estimated remaining: 3h 18m 27s. Rate: 7.1 symbols/min [2025-10-17T19:13:29.129822] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:13:29.168600] [DEBUG] [LOCAL ] GOTU: Loaded 37487 existing records from primary storage. [2025-10-17T19:13:29.168919] [INFO ] [MAIN ] GOTU: Loaded 37487 existing records. [2025-10-17T19:13:29.342113] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:13:29.342295] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-17T19:13:29.342340] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-17T19:13:29.342517] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-17T19:13:29.342555] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-17T19:13:29.564135] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-17T19:13:29.700089] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:13:29.719329] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T19:13:29.726586] [INFO ] [REMOTE ] GOF: Full fetch complete (62482 records). [2025-10-17T19:13:29.726759] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-17T19:13:30.167421] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-17T19:13:30.167532] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-17T19:13:30.168563] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-17T19:13:30.168669] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-17T19:13:30.189884] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T19:13:30.190049] [DEBUG] [LOCAL ] GOF: Trimmed 62482 records to 43353 (keeping 200 days of data) [2025-10-17T19:13:30.392037] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-17T19:13:30.495144] [DEBUG] [LOCAL ] GOF: Primary data saved (43353 records). [2025-10-17T19:13:30.495309] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-17T19:13:30.495410] [INFO ] [MAIN ] Update Progress: 953/2368 symbols completed. GOF took 34.6s. Estimated remaining: 3h 18m 8s. Rate: 7.1 symbols/min [2025-10-17T19:13:30.678808] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:13:30.725611] [DEBUG] [LOCAL ] GPC: Loaded 46350 existing records from primary storage. [2025-10-17T19:13:30.725988] [INFO ] [MAIN ] GPC: Loaded 46350 existing records. [2025-10-17T19:13:30.934982] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:13:30.935322] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-17T19:13:30.935382] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-17T19:13:30.935570] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-17T19:13:30.935610] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-17T19:13:31.163182] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-17T19:13:31.348329] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T19:13:31.373191] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:13:31.958038] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-17T19:13:32.099021] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T19:13:32.609571] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T19:13:32.757998] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-17T19:13:33.508511] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T19:13:33.557994] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-17T19:13:33.575702] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T19:13:34.358028] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-17T19:13:35.121480] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T19:13:35.157981] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-17T19:13:35.294346] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T19:13:35.298598] [INFO ] [REMOTE ] GOLF: Full fetch complete (45375 records). [2025-10-17T19:13:35.298742] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-17T19:13:35.713322] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-17T19:13:35.713406] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-17T19:13:35.714291] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-17T19:13:35.714360] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-17T19:13:35.715404] [DEBUG] [LOCAL ] GOLF: Trimmed 45375 records to 31259 (keeping 200 days of data) [2025-10-17T19:13:35.936566] [DEBUG] [LOCAL ] GOLF: Primary data saved (31259 records). [2025-10-17T19:13:35.936755] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-17T19:13:35.936903] [INFO ] [MAIN ] Update Progress: 954/2368 symbols completed. GOLF took 25.5s. Estimated remaining: 3h 17m 55s. Rate: 7.1 symbols/min [2025-10-17T19:13:35.971730] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-17T19:13:36.108576] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:13:36.125668] [DEBUG] [LOCAL ] GPI: Loaded 15026 existing records from primary storage. [2025-10-17T19:13:36.125911] [INFO ] [MAIN ] GPI: Loaded 15026 existing records. [2025-10-17T19:13:36.297332] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:13:36.297577] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-17T19:13:36.297626] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-17T19:13:36.297829] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-17T19:13:36.297886] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-17T19:13:36.653420] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:13:36.758015] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-17T19:13:36.937406] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T19:13:37.558017] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-17T19:13:37.683456] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T19:13:37.781152] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T19:13:38.358032] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-17T19:13:39.106103] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T19:13:39.157992] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-17T19:13:39.958028] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-17T19:13:40.033304] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T19:13:40.683341] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T19:13:40.758014] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-17T19:13:41.558034] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-17T19:13:41.642810] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T19:13:42.183696] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T19:13:42.189262] [INFO ] [REMOTE ] GOOS: Full fetch complete (64848 records). [2025-10-17T19:13:42.189371] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-17T19:13:42.360856] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-17T19:13:42.569935] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T19:13:42.593070] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-17T19:13:42.593152] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-17T19:13:42.594119] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-17T19:13:42.594186] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-17T19:13:42.595545] [DEBUG] [LOCAL ] GOOS: Trimmed 64848 records to 45143 (keeping 200 days of data) [2025-10-17T19:13:42.849558] [DEBUG] [LOCAL ] GOOS: Primary data saved (45143 records). [2025-10-17T19:13:42.849741] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-17T19:13:42.849869] [INFO ] [MAIN ] Update Progress: 955/2368 symbols completed. GOOS took 29.2s. Estimated remaining: 3h 17m 45s. Rate: 7.1 symbols/min [2025-10-17T19:13:43.014454] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:13:43.021042] [DEBUG] [LOCAL ] GPJA: Loaded 4213 existing records from primary storage. [2025-10-17T19:13:43.021225] [INFO ] [MAIN ] GPJA: Loaded 4213 existing records. [2025-10-17T19:13:43.167248] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-17T19:13:43.196887] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:13:43.197189] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-17T19:13:43.197236] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-17T19:13:43.197404] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-17T19:13:43.197467] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-17T19:13:43.571761] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:13:43.957996] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-17T19:13:44.106151] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T19:13:44.189485] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T19:13:44.502698] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-17T19:13:44.758044] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-17T19:13:45.541068] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T19:13:45.557989] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-17T19:13:46.123152] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-17T19:13:46.358061] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-17T19:13:47.158048] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-17T19:13:47.567888] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T19:13:47.718986] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-17T19:13:47.958060] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-17T19:13:48.516660] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T19:13:48.758028] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-17T19:13:49.218288] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-17T19:13:49.558036] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-17T19:13:50.358111] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-17T19:13:50.958547] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T19:13:51.158050] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-17T19:13:51.345875] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T19:13:51.958069] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-17T19:13:52.303962] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T19:13:52.610382] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-17T19:13:52.758066] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-17T19:13:53.558033] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-17T19:13:53.576037] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T19:13:54.358147] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-17T19:13:55.158076] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-17T19:13:55.295600] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T19:13:55.736905] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T19:13:55.958052] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-17T19:13:56.084437] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T19:13:56.758078] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-17T19:13:57.206910] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-17T19:13:57.558003] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-17T19:13:57.702531] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-17T19:13:58.358081] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-17T19:13:59.118704] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:13:59.158016] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-17T19:13:59.435992] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T19:13:59.958045] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-17T19:14:00.210754] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T19:14:00.758048] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-17T19:14:00.802090] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T19:14:01.558029] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-17T19:14:02.358079] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-17T19:14:02.661634] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T19:14:02.662574] [INFO ] [REMOTE ] GPJA: Full fetch complete (6944 records). [2025-10-17T19:14:02.662671] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-17T19:14:03.017522] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-17T19:14:03.017599] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-17T19:14:03.017808] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-17T19:14:03.017870] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-17T19:14:03.018270] [DEBUG] [LOCAL ] GPJA: Trimmed 6944 records to 4230 (keeping 200 days of data) [2025-10-17T19:14:03.043518] [DEBUG] [LOCAL ] GPJA: Primary data saved (4230 records). [2025-10-17T19:14:03.043597] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-17T19:14:03.043695] [INFO ] [MAIN ] Update Progress: 956/2368 symbols completed. GPJA took 20.2s. Estimated remaining: 3h 17m 54s. Rate: 7.1 symbols/min [2025-10-17T19:14:03.163112] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-17T19:14:03.225671] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:14:03.275978] [DEBUG] [LOCAL ] GPK: Loaded 53165 existing records from primary storage. [2025-10-17T19:14:03.276309] [INFO ] [MAIN ] GPK: Loaded 53165 existing records. [2025-10-17T19:14:03.456550] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:14:03.456943] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-17T19:14:03.457032] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-17T19:14:03.464136] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-17T19:14:03.476891] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-17T19:14:03.555232] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-17T19:14:03.850635] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:14:03.859032] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-17T19:14:03.957984] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-17T19:14:04.253276] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T19:14:04.758103] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-17T19:14:05.438220] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T19:14:05.558000] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-17T19:14:05.694471] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T19:14:06.358077] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-17T19:14:06.914392] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T19:14:07.158081] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-17T19:14:07.799607] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T19:14:07.958034] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-17T19:14:08.758119] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-17T19:14:09.424241] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-17T19:14:09.515779] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T19:14:09.557993] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-17T19:14:10.358072] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-17T19:14:10.537970] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T19:14:10.542847] [INFO ] [REMOTE ] GOTU: Full fetch complete (58473 records). [2025-10-17T19:14:10.542969] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-17T19:14:10.940889] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-17T19:14:10.940983] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-17T19:14:10.941939] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-17T19:14:10.942007] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-17T19:14:10.943342] [DEBUG] [LOCAL ] GOTU: Trimmed 58473 records to 37702 (keeping 200 days of data) [2025-10-17T19:14:11.156752] [DEBUG] [LOCAL ] GOTU: Primary data saved (37702 records). [2025-10-17T19:14:11.156896] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-17T19:14:11.157408] [INFO ] [MAIN ] Update Progress: 957/2368 symbols completed. GOTU took 42.2s. Estimated remaining: 3h 17m 45s. Rate: 7.1 symbols/min [2025-10-17T19:14:11.157997] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-17T19:14:11.982835] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T19:14:11.993241] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-17T19:14:12.161750] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-17T19:14:12.295843] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T19:14:12.299995] [INFO ] [REMOTE ] GPI: Full fetch complete (21656 records). [2025-10-17T19:14:12.300109] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-17T19:14:12.667780] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-17T19:14:12.667851] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-17T19:14:12.668319] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-17T19:14:12.668362] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-17T19:14:12.669145] [DEBUG] [LOCAL ] GPI: Trimmed 21656 records to 15097 (keeping 200 days of data) [2025-10-17T19:14:12.763215] [DEBUG] [LOCAL ] GPI: Primary data saved (15097 records). [2025-10-17T19:14:12.761162] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-17T19:14:12.764137] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-17T19:14:12.764231] [INFO ] [MAIN ] Update Progress: 958/2368 symbols completed. GPI took 36.8s. Estimated remaining: 3h 17m 26s. Rate: 7.1 symbols/min [2025-10-17T19:14:13.706314] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T19:14:13.716958] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-17T19:14:14.384629] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T19:14:14.395705] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-17T19:14:15.282073] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T19:14:15.291355] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-17T19:14:16.126053] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T19:14:16.137089] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-17T19:14:16.562122] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-17T19:14:16.758073] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-17T19:14:17.972501] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T19:14:17.983779] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-17T19:14:18.037227] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T19:14:18.043555] [INFO ] [REMOTE ] GPC: Full fetch complete (68688 records). [2025-10-17T19:14:18.043727] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-17T19:14:18.433274] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-17T19:14:18.433363] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-17T19:14:18.434284] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-17T19:14:18.434350] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-17T19:14:18.435716] [DEBUG] [LOCAL ] GPC: Trimmed 68688 records to 46707 (keeping 200 days of data) [2025-10-17T19:14:18.732551] [DEBUG] [LOCAL ] GPC: Primary data saved (46707 records). [2025-10-17T19:14:18.732718] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-17T19:14:18.733331] [INFO ] [MAIN ] Update Progress: 959/2368 symbols completed. GPC took 48.2s. Estimated remaining: 3h 17m 14s. Rate: 7.1 symbols/min [2025-10-17T19:14:19.708379] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T19:14:19.719466] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-17T19:14:21.492586] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T19:14:21.504450] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-17T19:14:23.391484] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T19:14:23.402824] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-17T19:14:25.021717] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T19:14:25.032911] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-17T19:14:26.831620] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T19:14:26.839079] [INFO ] [REMOTE ] GPK: Full fetch complete (75999 records). [2025-10-17T19:14:26.839235] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-17T19:14:27.241422] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-17T19:14:27.241502] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-17T19:14:27.242508] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-17T19:14:27.242574] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-17T19:14:27.244037] [DEBUG] [LOCAL ] GPK: Trimmed 75999 records to 53548 (keeping 200 days of data) [2025-10-17T19:14:27.569471] [DEBUG] [LOCAL ] GPK: Primary data saved (53548 records). [2025-10-17T19:14:27.569613] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-17T19:14:27.569725] [INFO ] [MAIN ] Update Progress: 960/2368 symbols completed. GPK took 24.5s. Estimated remaining: 3h 17m 7s. Rate: 7.1 symbols/min [2025-10-17T19:14:28.159217] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:14:28.263979] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:14:28.310814] [DEBUG] [LOCAL ] GPOR: No existing data file found in primary storage. [2025-10-17T19:14:28.310093] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:14:28.311547] [WARN ] [MAIN ] GPOR: No existing data found, performing full refresh instead. [2025-10-17T19:14:28.313010] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:14:28.313476] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-17T19:14:28.313556] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-17T19:14:28.313931] [DEBUG] [LOCAL ] GPOR: No primary data file found to delete. [2025-10-17T19:14:28.314124] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-17T19:14:28.551444] [DEBUG] [LOCAL ] GPMT: Loaded 26072 existing records from primary storage. [2025-10-17T19:14:28.575253] [INFO ] [MAIN ] GPMT: Loaded 26072 existing records. [2025-10-17T19:14:28.701741] [DEBUG] [LOCAL ] GPRK: Loaded 40056 existing records from primary storage. [2025-10-17T19:14:28.764549] [DEBUG] [LOCAL ] GPN: Loaded 52372 existing records from primary storage. [2025-10-17T19:14:28.764695] [INFO ] [MAIN ] GPRK: Loaded 40056 existing records. [2025-10-17T19:14:28.865493] [INFO ] [MAIN ] GPN: Loaded 52372 existing records. [2025-10-17T19:14:28.891387] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:14:28.896893] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-17T19:14:29.101607] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:14:29.152750] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-17T19:14:29.224114] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-17T19:14:29.228284] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:14:29.228753] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-17T19:14:29.229132] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-17T19:14:29.228690] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-17T19:14:29.239622] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-17T19:14:29.308817] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-17T19:14:29.340379] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-17T19:14:29.450172] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:14:29.490618] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-17T19:14:29.508023] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-17T19:14:29.565703] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-17T19:14:29.565870] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-17T19:14:30.185428] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:14:30.250926] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-17T19:14:30.355183] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:14:30.355857] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-17T19:14:30.438550] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:14:30.438923] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-17T19:14:30.455046] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T19:14:30.460889] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-17T19:14:31.529272] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T19:14:31.535263] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-17T19:14:31.824991] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T19:14:31.831324] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-17T19:14:31.860973] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T19:14:31.871686] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-17T19:14:31.946070] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T19:14:31.953759] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-17T19:14:32.778060] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T19:14:32.783240] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-17T19:14:32.966481] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T19:14:32.971363] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-17T19:14:33.354819] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T19:14:33.363785] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-17T19:14:33.509885] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T19:14:33.520330] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-17T19:14:33.903548] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T19:14:33.908582] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-17T19:14:33.965509] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T19:14:33.971327] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-17T19:14:34.418921] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T19:14:34.426881] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-17T19:14:35.030726] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T19:14:35.036189] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-17T19:14:35.192587] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T19:14:35.197915] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-17T19:14:35.266691] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T19:14:35.539184] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T19:14:35.957950] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-17T19:14:36.022732] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-17T19:14:36.042905] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T19:14:36.758111] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-17T19:14:37.417101] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T19:14:37.558008] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-17T19:14:37.867262] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T19:14:38.358052] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-17T19:14:39.133316] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T19:14:39.158038] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-17T19:14:39.498625] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T19:14:39.958134] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-17T19:14:40.758049] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-17T19:14:40.953866] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T19:14:41.120807] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T19:14:41.558029] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-17T19:14:42.033952] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-17T19:14:42.358049] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-17T19:14:42.998325] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T19:14:43.158102] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-17T19:14:43.652166] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T19:14:43.958023] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-17T19:14:44.758000] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-17T19:14:44.983753] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T19:14:45.011681] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T19:14:45.015363] [INFO ] [REMOTE ] GPOR: Full fetch complete (34994 records). [2025-10-17T19:14:45.015440] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-17T19:14:45.376489] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-17T19:14:45.376569] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-17T19:14:45.377243] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-17T19:14:45.377334] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-17T19:14:45.378152] [DEBUG] [LOCAL ] GPOR: Trimmed 34994 records to 23691 (keeping 200 days of data) [2025-10-17T19:14:45.520244] [DEBUG] [LOCAL ] GPOR: Primary data saved (23691 records). [2025-10-17T19:14:45.520671] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-17T19:14:45.520764] [INFO ] [MAIN ] Update Progress: 961/2368 symbols completed. GPOR took 17.9s. Estimated remaining: 3h 17m 12s. Rate: 7.1 symbols/min [2025-10-17T19:14:45.563334] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-17T19:14:45.697160] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:14:45.724111] [DEBUG] [LOCAL ] GRBK: Loaded 27274 existing records from primary storage. [2025-10-17T19:14:45.724467] [INFO ] [MAIN ] GRBK: Loaded 27274 existing records. [2025-10-17T19:14:45.908217] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:14:45.908399] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-17T19:14:45.908473] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-17T19:14:45.909036] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-17T19:14:45.909099] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-17T19:14:46.272241] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:14:46.293501] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T19:14:46.357994] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-17T19:14:47.052116] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T19:14:47.157998] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-17T19:14:47.222450] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-17T19:14:47.958037] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-17T19:14:48.610808] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T19:14:48.758036] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-17T19:14:49.558007] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-17T19:14:49.804451] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T19:14:49.841669] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-17T19:14:50.358032] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-17T19:14:50.770479] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T19:14:51.008744] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-17T19:14:51.158021] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-17T19:14:51.958010] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-17T19:14:52.597904] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T19:14:52.757989] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-17T19:14:53.558006] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-17T19:14:53.726294] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T19:14:54.289954] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T19:14:54.295901] [INFO ] [REMOTE ] GPRK: Full fetch complete (58217 records). [2025-10-17T19:14:54.296018] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-17T19:14:54.363288] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-17T19:14:54.677726] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-17T19:14:54.677809] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-17T19:14:54.678623] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-17T19:14:54.678731] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-17T19:14:54.679920] [DEBUG] [LOCAL ] GPRK: Trimmed 58217 records to 40348 (keeping 200 days of data) [2025-10-17T19:14:54.906880] [DEBUG] [LOCAL ] GPRK: Primary data saved (40348 records). [2025-10-17T19:14:54.907122] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-17T19:14:54.912381] [INFO ] [MAIN ] Update Progress: 962/2368 symbols completed. GPRK took 27.3s. Estimated remaining: 3h 17m 5s. Rate: 7.1 symbols/min [2025-10-17T19:14:54.990023] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T19:14:55.100392] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:14:55.111052] [DEBUG] [LOCAL ] GRC: Loaded 9376 existing records from primary storage. [2025-10-17T19:14:55.111256] [INFO ] [MAIN ] GRC: Loaded 9376 existing records. [2025-10-17T19:14:55.163896] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-17T19:14:55.289079] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:14:55.289337] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-17T19:14:55.289391] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-17T19:14:55.289532] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-17T19:14:55.289571] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-17T19:14:55.675928] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:14:55.958100] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-17T19:14:56.259118] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T19:14:56.301137] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T19:14:56.758059] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-17T19:14:56.893245] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T19:14:57.531916] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T19:14:57.557987] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-17T19:14:58.358019] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-17T19:14:58.402749] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T19:14:59.158012] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-17T19:14:59.433306] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T19:14:59.436363] [INFO ] [REMOTE ] GPMT: Full fetch complete (36657 records). [2025-10-17T19:14:59.436451] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-17T19:14:59.809249] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-17T19:14:59.809335] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-17T19:14:59.810077] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-17T19:14:59.810139] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-17T19:14:59.811025] [DEBUG] [LOCAL ] GPMT: Trimmed 36657 records to 26215 (keeping 200 days of data) [2025-10-17T19:14:59.959942] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-17T19:14:59.962361] [DEBUG] [LOCAL ] GPMT: Primary data saved (26215 records). [2025-10-17T19:14:59.962500] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-17T19:14:59.962592] [INFO ] [MAIN ] Update Progress: 963/2368 symbols completed. GPMT took 32.4s. Estimated remaining: 3h 16m 52s. Rate: 7.1 symbols/min [2025-10-17T19:15:00.130333] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:15:00.151775] [DEBUG] [LOCAL ] GRDN: Loaded 21092 existing records from primary storage. [2025-10-17T19:15:00.152024] [INFO ] [MAIN ] GRDN: Loaded 21092 existing records. [2025-10-17T19:15:00.349993] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:15:00.350216] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-17T19:15:00.350263] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-17T19:15:00.350455] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-17T19:15:00.350510] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-17T19:15:00.703186] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:15:00.757990] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-17T19:15:00.990212] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T19:15:01.558004] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-17T19:15:01.697931] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-17T19:15:02.358033] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-17T19:15:03.158058] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-17T19:15:03.327735] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-10-17T19:15:03.395844] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T19:15:03.958025] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-17T19:15:04.619776] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-17T19:15:04.758025] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-17T19:15:04.800416] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T19:15:04.821612] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T19:15:05.558041] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-17T19:15:06.358005] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-17T19:15:06.380320] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-17T19:15:06.833605] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-17T19:15:06.841959] [INFO ] [REMOTE ] GPN: Full fetch complete (75088 records). [2025-10-17T19:15:06.842204] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-17T19:15:07.172973] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-17T19:15:07.231288] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-17T19:15:07.231373] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-17T19:15:07.232371] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-17T19:15:07.232442] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-17T19:15:07.233962] [DEBUG] [LOCAL ] GPN: Trimmed 75088 records to 52716 (keeping 200 days of data) [2025-10-17T19:15:07.563711] [DEBUG] [LOCAL ] GPN: Primary data saved (52716 records). [2025-10-17T19:15:07.563839] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-17T19:15:07.563948] [INFO ] [MAIN ] Update Progress: 964/2368 symbols completed. GPN took 40.0s. Estimated remaining: 3h 16m 42s. Rate: 7.1 symbols/min [2025-10-17T19:15:07.752678] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-17T19:15:07.755799] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:15:07.803863] [DEBUG] [LOCAL ] GRMN: Loaded 40670 existing records from primary storage. [2025-10-17T19:15:07.804147] [INFO ] [MAIN ] GRMN: Loaded 40670 existing records. [2025-10-17T19:15:07.958682] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-17T19:15:07.979681] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:15:07.980997] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-17T19:15:07.981123] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-17T19:15:07.986596] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-17T19:15:07.986760] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-17T19:15:07.992607] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-17T19:15:08.343779] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:15:08.758045] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-17T19:15:08.784492] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-17T19:15:09.558009] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-17T19:15:09.871602] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T19:15:10.220811] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-17T19:15:10.357992] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-17T19:15:11.157995] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-17T19:15:11.560272] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T19:15:11.958041] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-17T19:15:12.758082] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-17T19:15:12.970146] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T19:15:12.986226] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T19:15:13.558037] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-17T19:15:14.017038] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T19:15:14.358024] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-17T19:15:15.115979] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T19:15:15.157986] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-17T19:15:15.596862] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T19:15:15.958075] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-17T19:15:16.463629] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T19:15:16.723588] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T19:15:16.758006] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-17T19:15:17.526137] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T19:15:17.557996] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-17T19:15:18.358044] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-17T19:15:18.526343] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-17T19:15:18.528474] [INFO ] [REMOTE ] GRC: Full fetch complete (13387 records). [2025-10-17T19:15:18.528542] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-17T19:15:18.895864] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-17T19:15:18.895938] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-17T19:15:18.896238] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-17T19:15:18.896276] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-17T19:15:18.896759] [DEBUG] [LOCAL ] GRC: Trimmed 13387 records to 9440 (keeping 200 days of data) [2025-10-17T19:15:18.954628] [DEBUG] [LOCAL ] GRC: Primary data saved (9440 records). [2025-10-17T19:15:18.954788] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-17T19:15:18.954874] [INFO ] [MAIN ] Update Progress: 965/2368 symbols completed. GRC took 24.0s. Estimated remaining: 3h 16m 38s. Rate: 7.1 symbols/min [2025-10-17T19:15:19.123820] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:15:19.158014] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-17T19:15:19.181968] [DEBUG] [LOCAL ] GRND: Loaded 50505 existing records from primary storage. [2025-10-17T19:15:19.182334] [INFO ] [MAIN ] GRND: Loaded 50505 existing records. [2025-10-17T19:15:19.361523] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T19:15:19.387811] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:15:19.392085] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-17T19:15:19.392150] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-17T19:15:19.392345] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-17T19:15:19.392403] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-17T19:15:19.743360] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:15:19.957996] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-17T19:15:20.348465] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T19:15:20.758001] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-17T19:15:21.047824] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T19:15:21.558042] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-17T19:15:22.358033] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-17T19:15:22.622284] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T19:15:23.084555] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T19:15:23.157986] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-17T19:15:23.714528] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T19:15:23.719119] [INFO ] [REMOTE ] GRBK: Full fetch complete (40267 records). [2025-10-17T19:15:23.719282] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-17T19:15:23.963179] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-17T19:15:24.169411] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-17T19:15:24.169517] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-17T19:15:24.170449] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-17T19:15:24.170517] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-17T19:15:24.171442] [DEBUG] [LOCAL ] GRBK: Trimmed 40267 records to 27388 (keeping 200 days of data) [2025-10-17T19:15:24.346409] [DEBUG] [LOCAL ] GRBK: Primary data saved (27388 records). [2025-10-17T19:15:24.346564] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-17T19:15:24.346678] [INFO ] [MAIN ] Update Progress: 966/2368 symbols completed. GRBK took 38.8s. Estimated remaining: 3h 16m 26s. Rate: 7.1 symbols/min [2025-10-17T19:15:24.522718] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:15:24.559034] [DEBUG] [LOCAL ] GRNT: Loaded 34222 existing records from primary storage. [2025-10-17T19:15:24.559451] [INFO ] [MAIN ] GRNT: Loaded 34222 existing records. [2025-10-17T19:15:24.739225] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:15:24.739618] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-17T19:15:24.739852] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-17T19:15:24.740103] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-17T19:15:24.740217] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-17T19:15:24.771002] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-17T19:15:24.894486] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T19:15:25.142088] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:15:25.557994] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-17T19:15:25.796055] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T19:15:25.955121] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T19:15:26.358061] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-17T19:15:26.671158] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T19:15:27.158042] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-17T19:15:27.958045] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-17T19:15:27.988157] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T19:15:28.144950] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T19:15:28.758090] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-17T19:15:29.558051] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-17T19:15:29.777867] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T19:15:30.194958] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T19:15:30.358005] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-17T19:15:31.158038] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-17T19:15:31.235759] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T19:15:31.283299] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T19:15:31.958062] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-17T19:15:32.030492] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T19:15:32.758031] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-17T19:15:33.558035] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-17T19:15:33.688317] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T19:15:33.751394] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T19:15:34.357994] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-17T19:15:34.466910] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T19:15:35.158078] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-17T19:15:35.958043] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-17T19:15:35.995164] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T19:15:36.452606] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T19:15:36.457836] [INFO ] [REMOTE ] GRDN: Full fetch complete (26337 records). [2025-10-17T19:15:36.457954] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-17T19:15:36.763092] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-17T19:15:36.830344] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-17T19:15:36.830425] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-17T19:15:36.831069] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-17T19:15:36.831134] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-17T19:15:36.832007] [DEBUG] [LOCAL ] GRDN: Trimmed 26337 records to 21216 (keeping 200 days of data) [2025-10-17T19:15:36.965976] [DEBUG] [LOCAL ] GRDN: Primary data saved (21216 records). [2025-10-17T19:15:36.966103] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-17T19:15:36.966194] [INFO ] [MAIN ] Update Progress: 967/2368 symbols completed. GRDN took 37.0s. Estimated remaining: 3h 16m 23s. Rate: 7.1 symbols/min [2025-10-17T19:15:37.140750] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:15:37.151943] [DEBUG] [LOCAL ] GROV: Loaded 8795 existing records from primary storage. [2025-10-17T19:15:37.152112] [INFO ] [MAIN ] GROV: Loaded 8795 existing records. [2025-10-17T19:15:37.340435] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:15:37.340630] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-17T19:15:37.340715] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-17T19:15:37.340901] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-17T19:15:37.340968] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-17T19:15:37.563122] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-17T19:15:37.573375] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T19:15:37.732373] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:15:38.358004] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-17T19:15:38.414545] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T19:15:39.158046] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-17T19:15:39.419683] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T19:15:39.672548] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T19:15:39.958048] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-17T19:15:40.504979] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-17T19:15:40.758052] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-17T19:15:40.931883] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T19:15:41.358071] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-17T19:15:41.558027] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-17T19:15:42.358026] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-17T19:15:42.847784] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T19:15:43.158092] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-17T19:15:43.949179] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T19:15:43.957980] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-17T19:15:43.985556] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T19:15:44.758034] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-17T19:15:45.514270] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T19:15:45.519708] [INFO ] [REMOTE ] GRMN: Full fetch complete (59673 records). [2025-10-17T19:15:45.519848] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-17T19:15:45.563148] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-17T19:15:45.913131] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-17T19:15:45.913215] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-17T19:15:45.914077] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-17T19:15:45.914143] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-17T19:15:45.921064] [DEBUG] [LOCAL ] GRMN: Trimmed 59673 records to 40933 (keeping 200 days of data) [2025-10-17T19:15:46.175934] [DEBUG] [LOCAL ] GRMN: Primary data saved (40933 records). [2025-10-17T19:15:46.176063] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-17T19:15:46.176948] [INFO ] [MAIN ] Update Progress: 968/2368 symbols completed. GRMN took 38.6s. Estimated remaining: 3h 16m 16s. Rate: 7.1 symbols/min [2025-10-17T19:15:46.365057] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:15:46.363111] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-17T19:15:46.373998] [DEBUG] [LOCAL ] GRX: Loaded 4828 existing records from primary storage. [2025-10-17T19:15:46.374216] [INFO ] [MAIN ] GRX: Loaded 4828 existing records. [2025-10-17T19:15:46.561805] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:15:46.562304] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-17T19:15:46.562470] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-17T19:15:46.562713] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-17T19:15:46.562781] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-17T19:15:46.783560] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-17T19:15:46.843810] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-17T19:15:46.970947] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:15:47.158027] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-17T19:15:47.337040] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T19:15:47.812731] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-17T19:15:47.958062] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-17T19:15:48.758088] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-17T19:15:49.292616] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T19:15:49.322159] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T19:15:49.558033] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-17T19:15:50.358050] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-17T19:15:51.051969] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-17T19:15:51.158054] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-17T19:15:51.770716] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T19:15:51.775993] [INFO ] [REMOTE ] GRNT: Full fetch complete (48330 records). [2025-10-17T19:15:51.776162] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-17T19:15:51.958870] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-17T19:15:52.171295] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-17T19:15:52.171371] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-17T19:15:52.172127] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-17T19:15:52.172188] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-17T19:15:52.173166] [DEBUG] [LOCAL ] GRNT: Trimmed 48330 records to 34443 (keeping 200 days of data) [2025-10-17T19:15:52.375475] [DEBUG] [LOCAL ] GRNT: Primary data saved (34443 records). [2025-10-17T19:15:52.375637] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-17T19:15:52.375765] [INFO ] [MAIN ] Update Progress: 969/2368 symbols completed. GRNT took 28.0s. Estimated remaining: 3h 16m 4s. Rate: 7.1 symbols/min [2025-10-17T19:15:52.560953] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:15:52.561164] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-17T19:15:52.611444] [DEBUG] [LOCAL ] GS: Loaded 52170 existing records from primary storage. [2025-10-17T19:15:52.611782] [INFO ] [MAIN ] GS: Loaded 52170 existing records. [2025-10-17T19:15:52.759030] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-17T19:15:52.789980] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:15:52.790372] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-17T19:15:52.790477] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-17T19:15:52.790832] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-17T19:15:52.790943] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-17T19:15:52.952546] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T19:15:53.216828] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:15:53.558003] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-17T19:15:53.573943] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-17T19:15:54.358021] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-17T19:15:55.114277] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T19:15:55.158007] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-17T19:15:55.336740] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T19:15:55.931505] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-17T19:15:55.957996] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-17T19:15:56.758074] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-17T19:15:56.821541] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-17T19:15:57.558043] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-17T19:15:58.113066] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-17T19:15:58.358007] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-17T19:15:58.813402] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-17T19:15:59.158031] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-17T19:15:59.387917] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T19:15:59.958025] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-17T19:16:00.649852] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-17T19:16:00.758043] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-17T19:16:01.403670] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-17T19:16:01.412671] [INFO ] [REMOTE ] GRND: Full fetch complete (71655 records). [2025-10-17T19:16:01.412808] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-17T19:16:01.563160] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-17T19:16:01.838830] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-17T19:16:01.838919] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-17T19:16:01.839861] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-17T19:16:01.839926] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-17T19:16:01.841345] [DEBUG] [LOCAL ] GRND: Trimmed 71655 records to 50893 (keeping 200 days of data) [2025-10-17T19:16:02.071933] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T19:16:02.140178] [DEBUG] [LOCAL ] GRND: Primary data saved (50893 records). [2025-10-17T19:16:02.140322] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-17T19:16:02.140406] [INFO ] [MAIN ] Update Progress: 970/2368 symbols completed. GRND took 43.2s. Estimated remaining: 3h 15m 58s. Rate: 7.1 symbols/min [2025-10-17T19:16:02.310158] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:16:02.348073] [DEBUG] [LOCAL ] GSBD: Loaded 39923 existing records from primary storage. [2025-10-17T19:16:02.348399] [INFO ] [MAIN ] GSBD: Loaded 39923 existing records. [2025-10-17T19:16:02.363170] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-17T19:16:02.527554] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:16:02.527758] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-17T19:16:02.527832] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-17T19:16:02.528081] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-17T19:16:02.528149] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-17T19:16:02.870282] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:16:03.158024] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-17T19:16:03.249745] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T19:16:03.948480] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-17T19:16:03.958591] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-17T19:16:04.551853] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T19:16:04.758016] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-17T19:16:04.815766] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T19:16:05.312322] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-17T19:16:05.558036] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-17T19:16:06.280913] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T19:16:06.282369] [INFO ] [REMOTE ] GROV: Full fetch complete (13902 records). [2025-10-17T19:16:06.282439] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-17T19:16:06.363141] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-17T19:16:06.637929] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-17T19:16:06.638009] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-17T19:16:06.638351] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-17T19:16:06.638395] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-17T19:16:06.638916] [DEBUG] [LOCAL ] GROV: Trimmed 13902 records to 8805 (keeping 200 days of data) [2025-10-17T19:16:06.687681] [DEBUG] [LOCAL ] GROV: Primary data saved (8805 records). [2025-10-17T19:16:06.687793] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-17T19:16:06.687871] [INFO ] [MAIN ] Update Progress: 971/2368 symbols completed. GROV took 29.7s. Estimated remaining: 3h 15m 44s. Rate: 7.1 symbols/min [2025-10-17T19:16:06.855364] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:16:06.910249] [DEBUG] [LOCAL ] GSK: Loaded 53895 existing records from primary storage. [2025-10-17T19:16:06.910563] [INFO ] [MAIN ] GSK: Loaded 53895 existing records. [2025-10-17T19:16:07.084837] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-17T19:16:07.089900] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:16:07.091908] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-17T19:16:07.091963] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-17T19:16:07.092460] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-17T19:16:07.092518] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-17T19:16:07.163241] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-17T19:16:07.443602] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:16:07.958071] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-17T19:16:08.588753] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-17T19:16:08.758056] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-17T19:16:08.793443] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T19:16:09.558021] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-17T19:16:10.358093] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-17T19:16:10.652876] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T19:16:11.077749] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-17T19:16:11.158040] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-17T19:16:11.603724] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-17T19:16:11.929016] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-17T19:16:11.930444] [INFO ] [REMOTE ] GRX: Full fetch complete (6523 records). [2025-10-17T19:16:11.930517] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-17T19:16:11.963188] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-17T19:16:12.287247] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-17T19:16:12.287378] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-17T19:16:12.287612] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-17T19:16:12.287682] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-17T19:16:12.288078] [DEBUG] [LOCAL ] GRX: Trimmed 6523 records to 4862 (keeping 200 days of data) [2025-10-17T19:16:12.316365] [DEBUG] [LOCAL ] GRX: Primary data saved (4862 records). [2025-10-17T19:16:12.316471] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-17T19:16:12.316554] [INFO ] [MAIN ] Update Progress: 972/2368 symbols completed. GRX took 26.1s. Estimated remaining: 3h 15m 32s. Rate: 7.1 symbols/min [2025-10-17T19:16:12.483509] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:16:12.516925] [DEBUG] [LOCAL ] GSL: Loaded 33526 existing records from primary storage. [2025-10-17T19:16:12.517205] [INFO ] [MAIN ] GSL: Loaded 33526 existing records. [2025-10-17T19:16:12.703503] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:16:12.703780] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-17T19:16:12.703831] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-17T19:16:12.704032] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-17T19:16:12.704087] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-17T19:16:12.766161] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-17T19:16:13.057758] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:16:13.558026] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-17T19:16:14.252004] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-17T19:16:14.358019] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-17T19:16:14.905171] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-17T19:16:15.138095] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T19:16:15.157984] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-17T19:16:15.958046] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-17T19:16:16.732590] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-17T19:16:16.758073] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-17T19:16:17.025258] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T19:16:17.447533] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T19:16:17.558029] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-17T19:16:17.806309] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T19:16:18.358136] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-17T19:16:19.158076] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-17T19:16:19.638546] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-17T19:16:19.958080] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-17T19:16:20.266417] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T19:16:20.758018] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-17T19:16:20.834206] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T19:16:21.558024] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-17T19:16:21.718597] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T19:16:22.358074] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-17T19:16:22.472252] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T19:16:22.659200] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T19:16:23.158030] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-17T19:16:23.958066] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-17T19:16:24.618149] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-17T19:16:24.648341] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T19:16:24.758030] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-17T19:16:25.558009] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-17T19:16:25.801448] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T19:16:26.358050] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-17T19:16:27.041000] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-17T19:16:27.113444] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T19:16:27.158019] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-17T19:16:27.874153] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-17T19:16:27.958042] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-17T19:16:28.735282] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T19:16:28.758026] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-17T19:16:29.558037] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-17T19:16:30.154984] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-17T19:16:30.217278] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T19:16:30.358038] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-17T19:16:31.059367] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T19:16:31.158008] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-17T19:16:31.182203] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T19:16:31.189685] [INFO ] [REMOTE ] GS: Full fetch complete (75827 records). [2025-10-17T19:16:31.189815] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-17T19:16:31.591333] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-17T19:16:31.591428] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-17T19:16:31.592509] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-17T19:16:31.592582] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-17T19:16:31.594128] [DEBUG] [LOCAL ] GS: Trimmed 75827 records to 52558 (keeping 200 days of data) [2025-10-17T19:16:31.927207] [DEBUG] [LOCAL ] GS: Primary data saved (52558 records). [2025-10-17T19:16:31.927380] [INFO ] [MAIN ] GS: Full history saved. [2025-10-17T19:16:31.927884] [INFO ] [MAIN ] Update Progress: 973/2368 symbols completed. GS took 39.6s. Estimated remaining: 3h 15m 39s. Rate: 7.1 symbols/min [2025-10-17T19:16:31.963206] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-17T19:16:32.098223] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:16:32.152700] [DEBUG] [LOCAL ] GTES: Loaded 50766 existing records from primary storage. [2025-10-17T19:16:32.153032] [INFO ] [MAIN ] GTES: Loaded 50766 existing records. [2025-10-17T19:16:32.330377] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:16:32.330588] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-17T19:16:32.330662] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-17T19:16:32.330948] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-17T19:16:32.331006] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-17T19:16:32.693175] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:16:32.757999] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-17T19:16:32.795472] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T19:16:33.558004] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-17T19:16:33.910479] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T19:16:34.358010] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-17T19:16:34.432477] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T19:16:34.948883] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T19:16:35.158046] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-17T19:16:35.958029] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-17T19:16:36.079380] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T19:16:36.637242] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T19:16:36.758084] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-17T19:16:37.199382] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T19:16:37.558028] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-17T19:16:38.106388] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T19:16:38.358043] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-17T19:16:39.168952] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-17T19:16:39.174449] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T19:16:39.750333] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T19:16:39.958072] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-17T19:16:40.714638] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T19:16:40.724873] [INFO ] [REMOTE ] GSBD: Full fetch complete (58689 records). [2025-10-17T19:16:40.725067] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-17T19:16:40.763203] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-17T19:16:41.225905] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-17T19:16:41.226075] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-17T19:16:41.227211] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-17T19:16:41.227324] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-17T19:16:41.229147] [DEBUG] [LOCAL ] GSBD: Trimmed 58689 records to 40293 (keeping 200 days of data) [2025-10-17T19:16:41.561764] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-17T19:16:41.562955] [DEBUG] [LOCAL ] GSBD: Primary data saved (40293 records). [2025-10-17T19:16:41.564518] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-17T19:16:41.564844] [INFO ] [MAIN ] Update Progress: 974/2368 symbols completed. GSBD took 39.4s. Estimated remaining: 3h 15m 33s. Rate: 7.1 symbols/min [2025-10-17T19:16:41.803671] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:16:41.849504] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T19:16:41.911453] [DEBUG] [LOCAL ] GTLS: Loaded 43612 existing records from primary storage. [2025-10-17T19:16:41.911869] [INFO ] [MAIN ] GTLS: Loaded 43612 existing records. [2025-10-17T19:16:42.100158] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:16:42.100503] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-17T19:16:42.100558] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-17T19:16:42.100779] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-17T19:16:42.100836] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-17T19:16:42.365326] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-17T19:16:42.460577] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:16:42.707558] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T19:16:43.156603] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T19:16:43.163394] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-17T19:16:43.958055] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-17T19:16:44.758037] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-17T19:16:44.860957] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-17T19:16:45.150142] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T19:16:45.558040] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-17T19:16:46.090221] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-17T19:16:46.097908] [INFO ] [REMOTE ] GSK: Full fetch complete (77636 records). [2025-10-17T19:16:46.098081] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-17T19:16:46.362666] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-17T19:16:46.529473] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T19:16:46.560787] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-17T19:16:46.560902] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-17T19:16:46.562221] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-17T19:16:46.562285] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-17T19:16:46.563719] [DEBUG] [LOCAL ] GSK: Trimmed 77636 records to 54285 (keeping 200 days of data) [2025-10-17T19:16:46.922862] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T19:16:46.943148] [DEBUG] [LOCAL ] GSK: Primary data saved (54285 records). [2025-10-17T19:16:46.943278] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-17T19:16:46.943824] [INFO ] [MAIN ] Update Progress: 975/2368 symbols completed. GSK took 40.3s. Estimated remaining: 3h 15m 20s. Rate: 7.1 symbols/min [2025-10-17T19:16:47.128879] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:16:47.158044] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-17T19:16:47.174367] [DEBUG] [LOCAL ] GTN: Loaded 45496 existing records from primary storage. [2025-10-17T19:16:47.174737] [INFO ] [MAIN ] GTN: Loaded 45496 existing records. [2025-10-17T19:16:47.370675] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:16:47.370891] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-17T19:16:47.370940] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-17T19:16:47.371217] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-17T19:16:47.371322] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-17T19:16:47.752933] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:16:47.937957] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T19:16:47.957982] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-17T19:16:48.575205] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T19:16:48.758055] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-17T19:16:49.008248] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T19:16:49.558039] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-17T19:16:50.343372] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T19:16:50.357987] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-17T19:16:50.920408] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T19:16:50.925372] [INFO ] [REMOTE ] GSL: Full fetch complete (48330 records). [2025-10-17T19:16:50.925493] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-17T19:16:51.169399] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-17T19:16:51.308776] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-17T19:16:51.308864] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-17T19:16:51.309718] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-17T19:16:51.309783] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-17T19:16:51.310943] [DEBUG] [LOCAL ] GSL: Trimmed 48330 records to 33725 (keeping 200 days of data) [2025-10-17T19:16:51.521666] [DEBUG] [LOCAL ] GSL: Primary data saved (33725 records). [2025-10-17T19:16:51.522054] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-17T19:16:51.522145] [INFO ] [MAIN ] Update Progress: 976/2368 symbols completed. GSL took 39.2s. Estimated remaining: 3h 15m 6s. Rate: 7.1 symbols/min [2025-10-17T19:16:51.693930] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:16:51.722954] [DEBUG] [LOCAL ] GTY: Loaded 30529 existing records from primary storage. [2025-10-17T19:16:51.723230] [INFO ] [MAIN ] GTY: Loaded 30529 existing records. [2025-10-17T19:16:51.902922] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:16:51.903183] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-17T19:16:51.903281] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-17T19:16:51.903895] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-17T19:16:51.903953] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-17T19:16:51.965164] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-17T19:16:52.208597] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T19:16:52.295136] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:16:52.758071] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-17T19:16:52.813442] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T19:16:53.557998] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-17T19:16:53.642607] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T19:16:53.954039] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-17T19:16:54.358039] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-17T19:16:55.158022] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-17T19:16:55.305367] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T19:16:55.749675] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T19:16:55.958016] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-17T19:16:56.758055] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-17T19:16:56.829240] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T19:16:57.089033] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T19:16:57.558050] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-17T19:16:58.358011] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-17T19:16:58.421883] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T19:16:58.991919] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T19:16:59.158007] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-17T19:16:59.808807] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T19:16:59.958090] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-17T19:17:00.679567] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T19:17:00.758028] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-17T19:17:01.557999] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-17T19:17:01.804237] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T19:17:02.281995] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T19:17:02.358059] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-17T19:17:03.158088] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-17T19:17:03.704902] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T19:17:03.958068] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-17T19:17:04.716683] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T19:17:04.758011] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-17T19:17:05.558010] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-17T19:17:05.699523] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T19:17:05.706807] [INFO ] [REMOTE ] GTES: Full fetch complete (73945 records). [2025-10-17T19:17:05.706944] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-17T19:17:06.097086] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-17T19:17:06.097187] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-17T19:17:06.098228] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-17T19:17:06.098290] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-17T19:17:06.099724] [DEBUG] [LOCAL ] GTES: Trimmed 73945 records to 51134 (keeping 200 days of data) [2025-10-17T19:17:06.387266] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (4.83 seconds). [2025-10-17T19:17:06.419240] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-17T19:17:06.443125] [DEBUG] [LOCAL ] GTES: Primary data saved (51134 records). [2025-10-17T19:17:06.443378] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-17T19:17:06.444534] [INFO ] [MAIN ] Update Progress: 977/2368 symbols completed. GTES took 34.5s. Estimated remaining: 3h 15m 7s. Rate: 7.1 symbols/min [2025-10-17T19:17:06.622236] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T19:17:06.657074] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:17:06.672532] [DEBUG] [LOCAL ] GUG: Loaded 12217 existing records from primary storage. [2025-10-17T19:17:06.672804] [INFO ] [MAIN ] GUG: Loaded 12217 existing records. [2025-10-17T19:17:06.880406] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:17:06.883111] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T19:17:06.883386] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-17T19:17:06.883629] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-17T19:17:06.892193] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-17T19:17:06.892252] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-17T19:17:07.159635] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-17T19:17:07.236300] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:17:07.958014] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-17T19:17:08.136475] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T19:17:08.223032] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T19:17:08.758038] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-17T19:17:09.541876] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T19:17:09.557982] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-17T19:17:09.975096] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T19:17:10.358053] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-17T19:17:11.135601] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-17T19:17:11.141902] [INFO ] [REMOTE ] GTLS: Full fetch complete (61667 records). [2025-10-17T19:17:11.142063] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-17T19:17:11.163146] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-17T19:17:11.478977] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T19:17:11.551727] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-17T19:17:11.551808] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-17T19:17:11.552754] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-17T19:17:11.552818] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-17T19:17:11.553986] [DEBUG] [LOCAL ] GTLS: Trimmed 61667 records to 43892 (keeping 200 days of data) [2025-10-17T19:17:11.805959] [DEBUG] [LOCAL ] GTLS: Primary data saved (43892 records). [2025-10-17T19:17:11.806086] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-17T19:17:11.806178] [INFO ] [MAIN ] Update Progress: 978/2368 symbols completed. GTLS took 30.2s. Estimated remaining: 3h 14m 54s. Rate: 7.1 symbols/min [2025-10-17T19:17:11.971779] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:17:11.969137] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-17T19:17:11.988961] [DEBUG] [LOCAL ] GUT: Loaded 15736 existing records from primary storage. [2025-10-17T19:17:11.989192] [INFO ] [MAIN ] GUT: Loaded 15736 existing records. [2025-10-17T19:17:12.162187] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:17:12.162417] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-17T19:17:12.162465] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-17T19:17:12.162740] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-17T19:17:12.162808] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-17T19:17:12.518113] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:17:12.534524] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T19:17:12.757990] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-17T19:17:13.052697] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T19:17:13.558011] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-17T19:17:13.763405] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T19:17:14.358043] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-17T19:17:15.003061] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T19:17:15.007861] [INFO ] [REMOTE ] GTY: Full fetch complete (43896 records). [2025-10-17T19:17:15.007990] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-17T19:17:15.164403] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-17T19:17:15.386090] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-17T19:17:15.386168] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-17T19:17:15.386908] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-17T19:17:15.386972] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-17T19:17:15.387972] [DEBUG] [LOCAL ] GTY: Trimmed 43896 records to 30765 (keeping 200 days of data) [2025-10-17T19:17:15.581012] [DEBUG] [LOCAL ] GTY: Primary data saved (30765 records). [2025-10-17T19:17:15.581245] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-17T19:17:15.581392] [INFO ] [MAIN ] Update Progress: 979/2368 symbols completed. GTY took 24.1s. Estimated remaining: 3h 14m 39s. Rate: 7.1 symbols/min [2025-10-17T19:17:15.756857] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:17:15.785931] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T19:17:15.824036] [DEBUG] [LOCAL ] GVA: Loaded 32925 existing records from primary storage. [2025-10-17T19:17:15.824325] [INFO ] [MAIN ] GVA: Loaded 32925 existing records. [2025-10-17T19:17:15.963223] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-17T19:17:16.003312] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:17:16.003516] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-17T19:17:16.003564] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-17T19:17:16.003781] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-17T19:17:16.003838] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-17T19:17:16.140395] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T19:17:16.380972] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:17:16.758037] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-17T19:17:16.979245] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-17T19:17:17.558039] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-17T19:17:17.597201] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-17T19:17:18.358087] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-17T19:17:19.068531] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T19:17:19.158040] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-17T19:17:19.933440] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T19:17:19.957988] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-17T19:17:20.632471] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T19:17:20.758033] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-17T19:17:21.452062] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T19:17:21.558047] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-17T19:17:21.874445] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T19:17:22.358047] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-17T19:17:22.907426] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T19:17:22.930988] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-17T19:17:23.158030] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-17T19:17:23.874784] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T19:17:23.958046] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-17T19:17:24.758058] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-17T19:17:25.010088] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T19:17:25.558033] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-17T19:17:26.347492] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T19:17:26.357974] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-17T19:17:26.454609] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T19:17:27.158066] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-17T19:17:27.883898] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T19:17:27.958027] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-17T19:17:27.985231] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T19:17:28.758054] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-17T19:17:29.546142] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T19:17:29.547068] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-17T19:17:29.557007] [INFO ] [REMOTE ] GTN: Full fetch complete (66069 records). [2025-10-17T19:17:29.557128] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-17T19:17:29.563134] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-17T19:17:29.950530] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-17T19:17:29.950622] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-17T19:17:29.951624] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-17T19:17:29.951721] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-17T19:17:29.953409] [DEBUG] [LOCAL ] GTN: Trimmed 66069 records to 45765 (keeping 200 days of data) [2025-10-17T19:17:30.217809] [DEBUG] [LOCAL ] GTN: Primary data saved (45765 records). [2025-10-17T19:17:30.217940] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-17T19:17:30.218593] [INFO ] [MAIN ] Update Progress: 980/2368 symbols completed. GTN took 43.3s. Estimated remaining: 3h 14m 39s. Rate: 7.1 symbols/min [2025-10-17T19:17:30.336348] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T19:17:30.366954] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-17T19:17:30.404768] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:17:30.428873] [DEBUG] [LOCAL ] GWH: Loaded 19024 existing records from primary storage. [2025-10-17T19:17:30.429157] [INFO ] [MAIN ] GWH: Loaded 19024 existing records. [2025-10-17T19:17:30.613746] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:17:30.614016] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-17T19:17:30.614087] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-17T19:17:30.614320] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-17T19:17:30.614384] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-17T19:17:30.958932] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:17:31.157987] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-17T19:17:31.352540] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T19:17:31.957988] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-17T19:17:32.025121] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T19:17:32.758004] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-17T19:17:32.783007] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-17T19:17:32.784888] [INFO ] [REMOTE ] GUG: Full fetch complete (18955 records). [2025-10-17T19:17:32.784957] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-17T19:17:33.137912] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-17T19:17:33.137984] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-17T19:17:33.138350] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-17T19:17:33.138390] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-17T19:17:33.138953] [DEBUG] [LOCAL ] GUG: Trimmed 18955 records to 12286 (keeping 200 days of data) [2025-10-17T19:17:33.214803] [DEBUG] [LOCAL ] GUG: Primary data saved (12286 records). [2025-10-17T19:17:33.214938] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-17T19:17:33.215046] [INFO ] [MAIN ] Update Progress: 981/2368 symbols completed. GUG took 26.8s. Estimated remaining: 3h 14m 23s. Rate: 7.1 symbols/min [2025-10-17T19:17:33.391685] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:17:33.439813] [DEBUG] [LOCAL ] GWRE: Loaded 40226 existing records from primary storage. [2025-10-17T19:17:33.440170] [INFO ] [MAIN ] GWRE: Loaded 40226 existing records. [2025-10-17T19:17:33.561293] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-17T19:17:33.650812] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:17:33.651223] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-17T19:17:33.651291] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-17T19:17:33.651529] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-17T19:17:33.651600] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-17T19:17:34.069357] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T19:17:34.154403] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:17:34.358089] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-17T19:17:35.121390] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T19:17:35.158062] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-17T19:17:35.218753] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-17T19:17:35.804010] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-17T19:17:35.958043] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-17T19:17:36.758001] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-17T19:17:36.991683] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T19:17:37.435782] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T19:17:37.558028] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-17T19:17:38.358018] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-17T19:17:38.417465] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T19:17:39.158049] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-17T19:17:39.920565] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T19:17:39.958022] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-17T19:17:39.971526] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T19:17:40.758023] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-17T19:17:41.333266] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T19:17:41.466530] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-17T19:17:41.558037] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-17T19:17:42.358064] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-17T19:17:42.913626] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T19:17:43.158051] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-17T19:17:43.521274] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T19:17:43.958050] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-17T19:17:44.589065] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T19:17:44.758068] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-17T19:17:45.226367] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T19:17:45.558051] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-17T19:17:46.110225] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T19:17:46.358032] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-17T19:17:46.637694] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T19:17:47.158075] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-17T19:17:47.333358] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-17T19:17:47.958083] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-17T19:17:48.290487] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T19:17:48.758066] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-17T19:17:49.448125] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T19:17:49.558029] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-17T19:17:49.873917] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T19:17:50.358004] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-17T19:17:50.512221] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T19:17:51.158092] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-17T19:17:51.958031] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-17T19:17:52.020675] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T19:17:52.087088] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T19:17:52.758080] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-17T19:17:52.924791] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T19:17:53.504693] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-17T19:17:53.507673] [INFO ] [REMOTE ] GUT: Full fetch complete (22566 records). [2025-10-17T19:17:53.507788] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-17T19:17:53.563279] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-17T19:17:53.873368] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-17T19:17:53.873447] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-17T19:17:53.873930] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-17T19:17:53.873994] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-17T19:17:53.874595] [DEBUG] [LOCAL ] GUT: Trimmed 22566 records to 15859 (keeping 200 days of data) [2025-10-17T19:17:53.966239] [DEBUG] [LOCAL ] GUT: Primary data saved (15859 records). [2025-10-17T19:17:53.966388] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-17T19:17:53.966489] [INFO ] [MAIN ] Update Progress: 982/2368 symbols completed. GUT took 42.2s. Estimated remaining: 3h 14m 32s. Rate: 7.1 symbols/min [2025-10-17T19:17:54.137898] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:17:54.158225] [DEBUG] [LOCAL ] GWW: Loaded 19681 existing records from primary storage. [2025-10-17T19:17:54.158498] [INFO ] [MAIN ] GWW: Loaded 19681 existing records. [2025-10-17T19:17:54.334198] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:17:54.334414] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-17T19:17:54.334461] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-17T19:17:54.334633] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-17T19:17:54.334727] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-17T19:17:54.365077] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-17T19:17:54.694996] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:17:54.921088] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T19:17:55.158083] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-17T19:17:55.958124] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-17T19:17:56.065455] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T19:17:56.421131] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-17T19:17:56.427399] [INFO ] [REMOTE ] GWH: Full fetch complete (23794 records). [2025-10-17T19:17:56.427569] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-17T19:17:56.766757] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-17T19:17:56.814066] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-17T19:17:56.814149] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-17T19:17:56.814676] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-17T19:17:56.814735] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-17T19:17:56.815477] [DEBUG] [LOCAL ] GWH: Trimmed 23794 records to 19414 (keeping 200 days of data) [2025-10-17T19:17:56.922448] [DEBUG] [LOCAL ] GWH: Primary data saved (19414 records). [2025-10-17T19:17:56.922597] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-17T19:17:56.922706] [INFO ] [MAIN ] Update Progress: 983/2368 symbols completed. GWH took 26.7s. Estimated remaining: 3h 14m 16s. Rate: 7.1 symbols/min [2025-10-17T19:17:57.091707] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:17:57.140377] [DEBUG] [LOCAL ] GXO: Loaded 47088 existing records from primary storage. [2025-10-17T19:17:57.140710] [INFO ] [MAIN ] GXO: Loaded 47088 existing records. [2025-10-17T19:17:57.324746] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:17:57.325037] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-17T19:17:57.325092] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-17T19:17:57.325407] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-17T19:17:57.325463] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-17T19:17:57.565676] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-17T19:17:57.699367] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:17:57.727035] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-17T19:17:58.019941] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T19:17:58.358117] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-17T19:17:58.759938] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-17T19:17:58.765201] [INFO ] [REMOTE ] GVA: Full fetch complete (48436 records). [2025-10-17T19:17:58.765525] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-17T19:17:59.163534] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-17T19:17:59.214038] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-17T19:17:59.214155] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-17T19:17:59.215205] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-17T19:17:59.215274] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-17T19:17:59.216789] [DEBUG] [LOCAL ] GVA: Trimmed 48436 records to 33145 (keeping 200 days of data) [2025-10-17T19:17:59.447922] [DEBUG] [LOCAL ] GVA: Primary data saved (33145 records). [2025-10-17T19:17:59.448132] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-17T19:17:59.448258] [INFO ] [MAIN ] Update Progress: 984/2368 symbols completed. GVA took 43.9s. Estimated remaining: 3h 13m 60s. Rate: 7.1 symbols/min [2025-10-17T19:17:59.629070] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:17:59.633920] [DEBUG] [LOCAL ] GYLD: Loaded 1553 existing records from primary storage. [2025-10-17T19:17:59.634122] [INFO ] [MAIN ] GYLD: Loaded 1553 existing records. [2025-10-17T19:17:59.821751] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:17:59.822053] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-17T19:17:59.822228] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-17T19:17:59.822524] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-17T19:17:59.822589] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-17T19:17:59.969539] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-17T19:18:00.164606] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T19:18:00.263006] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:18:00.758037] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-17T19:18:01.444923] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T19:18:01.498923] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-17T19:18:01.558006] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-17T19:18:02.329162] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T19:18:02.358054] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-17T19:18:03.158081] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-17T19:18:03.335338] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T19:18:03.600163] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-17T19:18:03.958044] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-17T19:18:04.103993] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T19:18:04.758010] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-17T19:18:05.158085] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T19:18:05.558041] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-17T19:18:06.360719] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-17T19:18:06.374683] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T19:18:06.672490] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T19:18:07.158040] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-17T19:18:07.834994] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T19:18:07.958035] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-17T19:18:08.758049] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-17T19:18:08.834632] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T19:18:09.203058] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-17T19:18:09.541037] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T19:18:09.557973] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-17T19:18:10.358087] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-17T19:18:11.084878] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T19:18:11.089960] [INFO ] [REMOTE ] GWRE: Full fetch complete (60304 records). [2025-10-17T19:18:11.090060] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-17T19:18:11.163240] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-17T19:18:11.473963] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-17T19:18:11.474100] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-17T19:18:11.474981] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-17T19:18:11.475046] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-17T19:18:11.476313] [DEBUG] [LOCAL ] GWRE: Trimmed 60304 records to 40437 (keeping 200 days of data) [2025-10-17T19:18:11.569484] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-17T19:18:11.725097] [DEBUG] [LOCAL ] GWRE: Primary data saved (40437 records). [2025-10-17T19:18:11.725260] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-17T19:18:11.725963] [INFO ] [MAIN ] Update Progress: 985/2368 symbols completed. GWRE took 38.5s. Estimated remaining: 3h 13m 57s. Rate: 7.1 symbols/min [2025-10-17T19:18:11.894123] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:18:11.894290] [DEBUG] [LOCAL ] H: No existing data file found in primary storage. [2025-10-17T19:18:11.894329] [WARN ] [MAIN ] H: No existing data found, performing full refresh instead. [2025-10-17T19:18:11.894451] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-17T19:18:11.894514] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-17T19:18:11.894584] [DEBUG] [LOCAL ] H: No primary data file found to delete. [2025-10-17T19:18:11.894631] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-17T19:18:11.962765] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-17T19:18:12.302743] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:18:12.298777] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T19:18:12.322270] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-17T19:18:12.758032] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-17T19:18:13.127598] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-17T19:18:13.558041] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-17T19:18:13.992725] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-17T19:18:14.358085] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-17T19:18:15.158034] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-17T19:18:15.344211] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T19:18:15.958091] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-17T19:18:16.358775] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-17T19:18:16.758010] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-17T19:18:17.125768] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T19:18:17.195989] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T19:18:17.558036] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-17T19:18:18.358091] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-17T19:18:19.112616] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T19:18:19.158092] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-17T19:18:19.474787] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T19:18:19.958027] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-17T19:18:20.757996] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-17T19:18:20.841621] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T19:18:21.003726] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T19:18:21.275890] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-17T19:18:21.558057] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-17T19:18:22.358037] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-17T19:18:22.680224] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T19:18:22.683226] [INFO ] [REMOTE ] GWW: Full fetch complete (29138 records). [2025-10-17T19:18:22.683300] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-17T19:18:22.813475] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-17T19:18:23.069479] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-17T19:18:23.069554] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-17T19:18:23.070175] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-17T19:18:23.070237] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-17T19:18:23.070937] [DEBUG] [LOCAL ] GWW: Trimmed 29138 records to 19822 (keeping 200 days of data) [2025-10-17T19:18:23.160807] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-17T19:18:23.199006] [DEBUG] [LOCAL ] GWW: Primary data saved (19822 records). [2025-10-17T19:18:23.199141] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-17T19:18:23.199221] [INFO ] [MAIN ] Update Progress: 986/2368 symbols completed. GWW took 29.2s. Estimated remaining: 3h 13m 52s. Rate: 7.1 symbols/min [2025-10-17T19:18:23.366763] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:18:23.403206] [DEBUG] [LOCAL ] HAE: Loaded 39700 existing records from primary storage. [2025-10-17T19:18:23.403512] [INFO ] [MAIN ] HAE: Loaded 39700 existing records. [2025-10-17T19:18:23.578720] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:18:23.578927] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-17T19:18:23.578976] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-17T19:18:23.579199] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-17T19:18:23.579256] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-17T19:18:23.936881] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:18:23.957982] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-17T19:18:24.768481] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-17T19:18:24.773815] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T19:18:25.403956] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-17T19:18:25.425249] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T19:18:25.558002] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-17T19:18:26.358027] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-17T19:18:26.901328] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-17T19:18:26.902143] [INFO ] [REMOTE ] GYLD: Full fetch complete (2099 records). [2025-10-17T19:18:26.902210] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-17T19:18:27.104151] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T19:18:27.173556] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-17T19:18:27.299026] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-17T19:18:27.299106] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-17T19:18:27.299212] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-17T19:18:27.299251] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-17T19:18:27.299578] [DEBUG] [LOCAL ] GYLD: Trimmed 2099 records to 1562 (keeping 200 days of data) [2025-10-17T19:18:27.309391] [DEBUG] [LOCAL ] GYLD: Primary data saved (1562 records). [2025-10-17T19:18:27.309449] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-17T19:18:27.309516] [INFO ] [MAIN ] Update Progress: 987/2368 symbols completed. GYLD took 27.9s. Estimated remaining: 3h 13m 38s. Rate: 7.1 symbols/min [2025-10-17T19:18:27.475518] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:18:27.513578] [DEBUG] [LOCAL ] HAFN: Loaded 43242 existing records from primary storage. [2025-10-17T19:18:27.513916] [INFO ] [MAIN ] HAFN: Loaded 43242 existing records. [2025-10-17T19:18:27.689008] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:18:27.689199] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-17T19:18:27.689250] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-17T19:18:27.689531] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-17T19:18:27.689597] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-17T19:18:27.960729] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-17T19:18:28.040318] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:18:28.758032] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-17T19:18:28.981268] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T19:18:29.558004] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-17T19:18:29.635148] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T19:18:30.111817] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T19:18:30.358030] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-17T19:18:31.167415] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-17T19:18:31.193044] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T19:18:31.958029] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-17T19:18:32.186253] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T19:18:32.758048] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-17T19:18:32.802974] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T19:18:33.506004] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T19:18:33.558039] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-17T19:18:34.324388] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T19:18:34.357987] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-17T19:18:35.139620] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T19:18:35.157999] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-17T19:18:35.517474] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T19:18:35.958055] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-17T19:18:36.591099] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T19:18:36.758006] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-17T19:18:37.558015] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-17T19:18:37.598377] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T19:18:38.358001] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-17T19:18:38.446798] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T19:18:39.091064] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T19:18:39.158105] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-17T19:18:39.953579] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T19:18:39.963109] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-17T19:18:40.758000] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-17T19:18:40.866872] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T19:18:41.442278] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T19:18:41.558005] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-17T19:18:42.358110] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-17T19:18:42.457348] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T19:18:43.158026] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-17T19:18:43.196016] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T19:18:43.477559] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T19:18:43.958027] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-17T19:18:44.753041] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-17T19:18:44.758699] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-17T19:18:44.760320] [INFO ] [REMOTE ] H: Full fetch complete (63021 records). [2025-10-17T19:18:44.760503] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-17T19:18:45.149551] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-17T19:18:45.149732] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-17T19:18:45.150693] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-17T19:18:45.150851] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-17T19:18:45.152132] [DEBUG] [LOCAL ] H: Trimmed 63021 records to 45047 (keeping 200 days of data) [2025-10-17T19:18:45.276024] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T19:18:45.454618] [DEBUG] [LOCAL ] H: Primary data saved (45047 records). [2025-10-17T19:18:45.454774] [INFO ] [MAIN ] H: Full history saved. [2025-10-17T19:18:45.454853] [INFO ] [MAIN ] Update Progress: 988/2368 symbols completed. H took 33.7s. Estimated remaining: 3h 13m 43s. Rate: 7.1 symbols/min [2025-10-17T19:18:45.563189] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-17T19:18:45.623841] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:18:45.678902] [DEBUG] [LOCAL ] HAL: Loaded 54108 existing records from primary storage. [2025-10-17T19:18:45.679235] [INFO ] [MAIN ] HAL: Loaded 54108 existing records. [2025-10-17T19:18:45.851247] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:18:45.851498] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-17T19:18:45.851543] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-17T19:18:45.851822] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-17T19:18:45.851878] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-17T19:18:46.206258] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:18:46.358042] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-17T19:18:46.537531] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T19:18:47.040088] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T19:18:47.158061] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-17T19:18:47.958095] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-17T19:18:48.265936] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T19:18:48.742506] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T19:18:48.757997] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-17T19:18:49.536561] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T19:18:49.557983] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-17T19:18:50.358042] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-17T19:18:50.422585] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T19:18:50.428744] [INFO ] [REMOTE ] GXO: Full fetch complete (69560 records). [2025-10-17T19:18:50.428847] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-17T19:18:50.807276] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-17T19:18:50.807384] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-17T19:18:50.808315] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-17T19:18:50.808379] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-17T19:18:50.809807] [DEBUG] [LOCAL ] GXO: Trimmed 69560 records to 47418 (keeping 200 days of data) [2025-10-17T19:18:51.087952] [DEBUG] [LOCAL ] GXO: Primary data saved (47418 records). [2025-10-17T19:18:51.088335] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-17T19:18:51.089158] [INFO ] [MAIN ] Update Progress: 989/2368 symbols completed. GXO took 54.2s. Estimated remaining: 3h 13m 31s. Rate: 7.1 symbols/min [2025-10-17T19:18:51.163007] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-17T19:18:51.283989] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T19:18:51.287236] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:18:51.346001] [DEBUG] [LOCAL ] HASI: Loaded 48039 existing records from primary storage. [2025-10-17T19:18:51.346314] [INFO ] [MAIN ] HASI: Loaded 48039 existing records. [2025-10-17T19:18:51.528359] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:18:51.528663] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-17T19:18:51.528727] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-17T19:18:51.529250] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-17T19:18:51.529309] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-17T19:18:51.900634] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:18:51.924681] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T19:18:51.957996] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-17T19:18:52.758021] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-17T19:18:53.121260] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T19:18:53.529033] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T19:18:53.558024] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-17T19:18:54.349018] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T19:18:54.358234] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-17T19:18:55.158040] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-17T19:18:55.206204] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T19:18:55.930191] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T19:18:55.957983] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-17T19:18:56.689619] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T19:18:56.758013] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-17T19:18:57.551870] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T19:18:57.558024] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-17T19:18:57.557917] [INFO ] [REMOTE ] HAFN: Full fetch complete (64878 records). [2025-10-17T19:18:57.558231] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-17T19:18:57.971397] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-17T19:18:57.971478] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-17T19:18:57.972413] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-17T19:18:57.972483] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-17T19:18:57.973936] [DEBUG] [LOCAL ] HAFN: Trimmed 64878 records to 43553 (keeping 200 days of data) [2025-10-17T19:18:58.227585] [DEBUG] [LOCAL ] HAFN: Primary data saved (43553 records). [2025-10-17T19:18:58.227741] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-17T19:18:58.227832] [INFO ] [MAIN ] Update Progress: 990/2368 symbols completed. HAFN took 30.9s. Estimated remaining: 3h 13m 21s. Rate: 7.1 symbols/min [2025-10-17T19:18:58.367101] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-17T19:18:58.429806] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:18:58.432380] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T19:18:58.485239] [DEBUG] [LOCAL ] HAYW: Loaded 49275 existing records from primary storage. [2025-10-17T19:18:58.485562] [INFO ] [MAIN ] HAYW: Loaded 49275 existing records. [2025-10-17T19:18:58.657906] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:18:58.658146] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-17T19:18:58.658193] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-17T19:18:58.658394] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-17T19:18:58.658449] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-17T19:18:59.010003] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:18:59.157985] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-17T19:18:59.602497] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-17T19:18:59.941269] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T19:18:59.947397] [INFO ] [REMOTE ] HAE: Full fetch complete (59081 records). [2025-10-17T19:18:59.947616] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-17T19:18:59.968792] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-17T19:19:00.378137] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-17T19:19:00.378253] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-17T19:19:00.379299] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-17T19:19:00.379390] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-17T19:19:00.381045] [DEBUG] [LOCAL ] HAE: Trimmed 59081 records to 40001 (keeping 200 days of data) [2025-10-17T19:19:00.636679] [DEBUG] [LOCAL ] HAE: Primary data saved (40001 records). [2025-10-17T19:19:00.636896] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-17T19:19:00.637095] [INFO ] [MAIN ] Update Progress: 991/2368 symbols completed. HAE took 37.4s. Estimated remaining: 3h 13m 4s. Rate: 7.1 symbols/min [2025-10-17T19:19:00.762516] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-17T19:19:00.855408] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:19:00.893281] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T19:19:00.908401] [DEBUG] [LOCAL ] HBB: Loaded 6511 existing records from primary storage. [2025-10-17T19:19:00.908664] [INFO ] [MAIN ] HBB: Loaded 6511 existing records. [2025-10-17T19:19:01.092086] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:19:01.092306] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-17T19:19:01.092354] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-17T19:19:01.092542] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-17T19:19:01.092599] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-17T19:19:01.443726] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:19:01.558021] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-17T19:19:02.358136] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-17T19:19:02.656463] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-17T19:19:02.705933] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-17T19:19:02.965370] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T19:19:03.160027] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-17T19:19:03.162637] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-17T19:19:03.958043] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-17T19:19:04.719274] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T19:19:04.758032] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-17T19:19:05.558016] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-17T19:19:05.681907] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T19:19:06.251875] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T19:19:06.357999] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-17T19:19:07.158039] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-17T19:19:07.605324] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-17T19:19:07.958058] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-17T19:19:08.033075] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T19:19:08.758012] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-17T19:19:08.831070] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T19:19:09.557996] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-17T19:19:09.727918] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T19:19:10.212992] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T19:19:10.320055] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:19:10.357996] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-17T19:19:11.158092] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-17T19:19:11.859228] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T19:19:11.958062] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-17T19:19:12.758083] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-17T19:19:12.911472] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T19:19:13.558039] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-17T19:19:13.857734] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T19:19:14.155487] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-17T19:19:14.329196] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T19:19:14.358031] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-17T19:19:15.150867] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T19:19:15.158019] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-17T19:19:15.958033] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-17T19:19:16.758016] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-17T19:19:16.787257] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T19:19:17.564981] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-17T19:19:17.587900] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T19:19:18.358002] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-17T19:19:18.855973] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-17T19:19:18.905493] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T19:19:19.158039] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-17T19:19:19.958016] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-17T19:19:20.037444] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T19:19:20.758014] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-17T19:19:20.783937] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-17T19:19:21.074842] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T19:19:21.558024] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-17T19:19:22.158697] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T19:19:22.358007] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-17T19:19:22.756029] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T19:19:22.764422] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-17T19:19:22.764628] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-17T19:19:23.167828] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-17T19:19:23.164008] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-17T19:19:23.168095] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-17T19:19:23.169768] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-17T19:19:23.169936] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-17T19:19:23.171437] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 54498 (keeping 200 days of data) [2025-10-17T19:19:23.549519] [DEBUG] [LOCAL ] HAL: Primary data saved (54498 records). [2025-10-17T19:19:23.549697] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-17T19:19:23.549809] [INFO ] [MAIN ] Update Progress: 992/2368 symbols completed. HAL took 38.1s. Estimated remaining: 3h 13m 16s. Rate: 7.1 symbols/min [2025-10-17T19:19:23.747851] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:19:23.803470] [DEBUG] [LOCAL ] HBI: Loaded 53362 existing records from primary storage. [2025-10-17T19:19:23.803899] [INFO ] [MAIN ] HBI: Loaded 53362 existing records. [2025-10-17T19:19:23.965873] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-17T19:19:24.012436] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:19:24.013902] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-17T19:19:24.013998] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-17T19:19:24.020970] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-17T19:19:24.021156] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-17T19:19:24.052274] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-17T19:19:24.227261] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T19:19:24.332232] [INFO ] [REMOTE ] HAYW: Full fetch complete (70913 records). [2025-10-17T19:19:24.349526] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-17T19:19:24.560489] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:19:24.765546] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-17T19:19:24.872522] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-17T19:19:24.872599] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-17T19:19:24.873520] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-17T19:19:24.873583] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-17T19:19:24.874965] [DEBUG] [LOCAL ] HAYW: Trimmed 70913 records to 49622 (keeping 200 days of data) [2025-10-17T19:19:25.164967] [DEBUG] [LOCAL ] HAYW: Primary data saved (49622 records). [2025-10-17T19:19:25.165103] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-17T19:19:25.165208] [INFO ] [MAIN ] Update Progress: 993/2368 symbols completed. HAYW took 26.9s. Estimated remaining: 3h 12m 58s. Rate: 7.1 symbols/min [2025-10-17T19:19:25.332266] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:19:25.366632] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T19:19:25.386598] [DEBUG] [LOCAL ] HBM: Loaded 53348 existing records from primary storage. [2025-10-17T19:19:25.386934] [INFO ] [MAIN ] HBM: Loaded 53348 existing records. [2025-10-17T19:19:25.568124] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:19:25.560892] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-17T19:19:25.569622] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-17T19:19:25.569785] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-17T19:19:25.570067] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-17T19:19:25.570129] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-17T19:19:25.957230] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T19:19:25.987814] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:19:26.225807] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-17T19:19:26.358028] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-17T19:19:27.158138] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-17T19:19:27.957998] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-17T19:19:28.000400] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T19:19:28.758073] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-17T19:19:28.812678] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T19:19:28.914440] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T19:19:29.558021] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-17T19:19:30.358015] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-17T19:19:30.785837] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T19:19:30.792555] [INFO ] [REMOTE ] HASI: Full fetch complete (68420 records). [2025-10-17T19:19:30.792841] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-17T19:19:30.950124] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T19:19:31.170435] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-17T19:19:31.195996] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-17T19:19:31.196101] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-17T19:19:31.197360] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-17T19:19:31.197680] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-17T19:19:31.199463] [DEBUG] [LOCAL ] HASI: Trimmed 68420 records to 48399 (keeping 200 days of data) [2025-10-17T19:19:31.356376] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T19:19:31.558857] [DEBUG] [LOCAL ] HASI: Primary data saved (48399 records). [2025-10-17T19:19:31.558994] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-17T19:19:31.559628] [INFO ] [MAIN ] Update Progress: 994/2368 symbols completed. HASI took 40.5s. Estimated remaining: 3h 12m 47s. Rate: 7.1 symbols/min [2025-10-17T19:19:31.746297] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:19:31.792279] [DEBUG] [LOCAL ] HCA: Loaded 47337 existing records from primary storage. [2025-10-17T19:19:31.792618] [INFO ] [MAIN ] HCA: Loaded 47337 existing records. [2025-10-17T19:19:31.961180] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-17T19:19:31.964849] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:19:31.966136] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-17T19:19:31.966199] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-17T19:19:31.966406] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-17T19:19:31.966462] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-17T19:19:32.311177] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:19:32.616736] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-17T19:19:32.617937] [INFO ] [REMOTE ] HBB: Full fetch complete (9309 records). [2025-10-17T19:19:32.618008] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-17T19:19:32.760478] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-17T19:19:32.995785] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T19:19:33.036734] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-17T19:19:33.036811] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-17T19:19:33.037043] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-17T19:19:33.037083] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-17T19:19:33.037560] [DEBUG] [LOCAL ] HBB: Trimmed 9309 records to 6540 (keeping 200 days of data) [2025-10-17T19:19:33.075817] [DEBUG] [LOCAL ] HBB: Primary data saved (6540 records). [2025-10-17T19:19:33.075903] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-17T19:19:33.075974] [INFO ] [MAIN ] Update Progress: 995/2368 symbols completed. HBB took 32.4s. Estimated remaining: 3h 12m 29s. Rate: 7.1 symbols/min [2025-10-17T19:19:33.240944] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:19:33.282184] [DEBUG] [LOCAL ] HCC: Loaded 45525 existing records from primary storage. [2025-10-17T19:19:33.282500] [INFO ] [MAIN ] HCC: Loaded 45525 existing records. [2025-10-17T19:19:33.466325] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:19:33.466552] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-17T19:19:33.466600] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-17T19:19:33.466811] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-17T19:19:33.466866] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-17T19:19:33.567632] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-17T19:19:33.853025] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:19:34.358104] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-17T19:19:34.587439] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T19:19:35.158044] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-17T19:19:35.255799] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T19:19:35.873941] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T19:19:35.958000] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-17T19:19:36.508255] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T19:19:36.758070] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-17T19:19:37.471825] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T19:19:37.558035] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-17T19:19:38.358039] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-17T19:19:38.502254] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T19:19:39.157993] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-17T19:19:39.401076] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T19:19:39.958983] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-17T19:19:39.958863] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T19:19:40.758005] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-17T19:19:41.001539] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T19:19:41.499183] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T19:19:41.558006] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-17T19:19:42.358004] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-17T19:19:42.677385] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T19:19:43.102696] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T19:19:43.158023] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-17T19:19:43.958081] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-17T19:19:44.164962] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T19:19:44.758099] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-17T19:19:44.849063] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T19:19:45.558064] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-17T19:19:45.683024] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T19:19:46.358083] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-17T19:19:46.726236] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T19:19:47.158049] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-17T19:19:47.399035] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T19:19:47.918203] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T19:19:47.957995] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-17T19:19:48.758082] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-17T19:19:48.931480] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T19:19:49.558044] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-17T19:19:49.733431] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T19:19:50.358030] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-17T19:19:50.817082] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-17T19:19:51.158030] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-17T19:19:51.607619] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-17T19:19:51.858687] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T19:19:51.957999] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-17T19:19:52.758019] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-17T19:19:53.052678] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T19:19:53.558044] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-17T19:19:53.679453] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T19:19:54.358007] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-17T19:19:54.794497] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-17T19:19:55.157998] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-17T19:19:55.356594] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T19:19:55.958033] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-17T19:19:56.245788] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-17T19:19:56.758000] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-17T19:19:56.797793] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T19:19:57.558016] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-17T19:19:57.681815] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T19:19:58.178312] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T19:19:58.358027] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-17T19:19:58.812987] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T19:19:59.158078] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-17T19:19:59.948625] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T19:19:59.958054] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-17T19:20:00.758004] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-17T19:20:01.084502] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-17T19:20:01.558073] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-17T19:20:01.985700] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T19:20:01.993903] [INFO ] [REMOTE ] HBI: Full fetch complete (77020 records). [2025-10-17T19:20:01.994088] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-17T19:20:02.365719] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-17T19:20:02.411922] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-17T19:20:02.412108] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-17T19:20:02.413343] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-17T19:20:02.413417] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-17T19:20:02.415337] [DEBUG] [LOCAL ] HBI: Trimmed 77020 records to 53738 (keeping 200 days of data) [2025-10-17T19:20:02.726556] [DEBUG] [LOCAL ] HBI: Primary data saved (53738 records). [2025-10-17T19:20:02.726731] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-17T19:20:02.726822] [INFO ] [MAIN ] Update Progress: 996/2368 symbols completed. HBI took 39.2s. Estimated remaining: 3h 12m 49s. Rate: 7.1 symbols/min [2025-10-17T19:20:02.900487] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:02.922935] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-17T19:20:02.930761] [INFO ] [REMOTE ] HCA: Full fetch complete (68908 records). [2025-10-17T19:20:02.930975] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-17T19:20:03.108684] [DEBUG] [LOCAL ] HCI: Loaded 14289 existing records from primary storage. [2025-10-17T19:20:03.110797] [INFO ] [MAIN ] HCI: Loaded 14289 existing records. [2025-10-17T19:20:03.577993] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-17T19:20:03.584310] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:20:03.584816] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-17T19:20:03.585026] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-17T19:20:03.584932] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-17T19:20:03.586301] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-17T19:20:03.585337] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-17T19:20:03.586499] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-17T19:20:03.586748] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-17T19:20:03.689825] [DEBUG] [LOCAL ] HCA: Trimmed 68908 records to 47654 (keeping 200 days of data) [2025-10-17T19:20:04.210006] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-17T19:20:04.207516] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:04.222699] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-17T19:20:04.222971] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-17T19:20:04.269326] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T19:20:04.342222] [DEBUG] [LOCAL ] HCA: Primary data saved (47654 records). [2025-10-17T19:20:04.342353] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-17T19:20:04.342957] [INFO ] [MAIN ] Update Progress: 997/2368 symbols completed. HCA took 32.8s. Estimated remaining: 3h 12m 32s. Rate: 7.1 symbols/min [2025-10-17T19:20:04.758118] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-17T19:20:05.247003] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-17T19:20:05.558048] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-17T19:20:06.216769] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-17T19:20:06.224311] [INFO ] [REMOTE ] HBM: Full fetch complete (76711 records). [2025-10-17T19:20:06.224438] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-17T19:20:06.467262] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T19:20:06.497715] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-17T19:20:06.631926] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-17T19:20:06.632077] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-17T19:20:06.633067] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-17T19:20:06.633130] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-17T19:20:06.634600] [DEBUG] [LOCAL ] HBM: Trimmed 76711 records to 53738 (keeping 200 days of data) [2025-10-17T19:20:06.733534] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-17T19:20:06.743714] [INFO ] [REMOTE ] HCC: Full fetch complete (64861 records). [2025-10-17T19:20:06.751165] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-17T19:20:07.389454] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-17T19:20:07.389724] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-17T19:20:07.390729] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-17T19:20:07.389593] [DEBUG] [LOCAL ] HBM: Primary data saved (53738 records). [2025-10-17T19:20:07.390812] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-17T19:20:07.391138] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-17T19:20:07.391255] [INFO ] [MAIN ] Update Progress: 998/2368 symbols completed. HBM took 42.2s. Estimated remaining: 3h 12m 16s. Rate: 7.1 symbols/min [2025-10-17T19:20:07.392314] [DEBUG] [LOCAL ] HCC: Trimmed 64861 records to 45791 (keeping 200 days of data) [2025-10-17T19:20:07.491186] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-17T19:20:07.511441] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-17T19:20:07.679251] [DEBUG] [LOCAL ] HCC: Primary data saved (45791 records). [2025-10-17T19:20:07.679403] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-17T19:20:07.679488] [INFO ] [MAIN ] Update Progress: 999/2368 symbols completed. HCC took 34.6s. Estimated remaining: 3h 11m 56s. Rate: 7.1 symbols/min [2025-10-17T19:20:08.517732] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T19:20:08.521021] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-17T19:20:09.524332] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T19:20:09.528004] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-17T19:20:10.360007] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-17T19:20:10.363731] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-17T19:20:11.431393] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T19:20:11.435700] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-17T19:20:12.512211] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T19:20:12.516128] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-17T19:20:13.362342] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T19:20:13.365794] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-17T19:20:14.231933] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-17T19:20:14.235373] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-17T19:20:14.994294] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-17T19:20:14.996771] [INFO ] [REMOTE ] HCI: Full fetch complete (19636 records). [2025-10-17T19:20:14.996846] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-17T19:20:15.386144] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-17T19:20:15.386226] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-17T19:20:15.386697] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-17T19:20:15.386762] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-17T19:20:15.387402] [DEBUG] [LOCAL ] HCI: Trimmed 19636 records to 14354 (keeping 200 days of data) [2025-10-17T19:20:15.476210] [DEBUG] [LOCAL ] HCI: Primary data saved (14354 records). [2025-10-17T19:20:15.476337] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-17T19:20:15.476418] [INFO ] [MAIN ] Update Progress: 1000/2368 symbols completed. HCI took 12.7s. Estimated remaining: 3h 11m 47s. Rate: 7.1 symbols/min [2025-10-17T19:20:16.171152] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:16.170214] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:16.172719] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:16.191939] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:16.193199] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-17T19:20:16.193307] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-17T19:20:16.193471] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-17T19:20:16.193537] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-17T19:20:16.193598] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-17T19:20:16.193682] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-17T19:20:16.521542] [DEBUG] [LOCAL ] HE: Loaded 49287 existing records from primary storage. [2025-10-17T19:20:16.538054] [INFO ] [MAIN ] HE: Loaded 49287 existing records. [2025-10-17T19:20:16.618042] [DEBUG] [LOCAL ] HD: Loaded 53874 existing records from primary storage. [2025-10-17T19:20:16.624504] [INFO ] [MAIN ] HD: Loaded 53874 existing records. [2025-10-17T19:20:16.730228] [DEBUG] [LOCAL ] HDB: Loaded 52321 existing records from primary storage. [2025-10-17T19:20:16.857056] [INFO ] [MAIN ] HDB: Loaded 52321 existing records. [2025-10-17T19:20:16.881701] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:16.903129] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-17T19:20:17.102354] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:20:17.120408] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-17T19:20:17.138584] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:20:17.149792] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-17T19:20:17.149427] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-17T19:20:17.160411] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-17T19:20:17.160519] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-17T19:20:17.170884] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-17T19:20:17.176155] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-17T19:20:17.210903] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-17T19:20:17.284947] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:20:17.341498] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-17T19:20:17.360787] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-17T19:20:17.399560] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-17T19:20:17.399688] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-17T19:20:17.514249] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-17T19:20:17.538637] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-17T19:20:18.055715] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-17T19:20:18.080406] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-17T19:20:18.249991] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:18.274538] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-17T19:20:18.324481] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:18.361093] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-17T19:20:18.368051] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:18.368617] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-17T19:20:18.499514] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-17T19:20:18.500306] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-17T19:20:18.821421] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-17T19:20:19.158023] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-17T19:20:19.386187] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-17T19:20:19.957986] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-17T19:20:20.107476] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T19:20:20.152578] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T19:20:20.211561] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-17T19:20:20.457238] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-17T19:20:20.758014] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-17T19:20:21.558031] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-17T19:20:22.358000] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-17T19:20:22.594877] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-17T19:20:22.631307] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T19:20:23.157990] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-17T19:20:23.391258] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-17T19:20:23.419994] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T19:20:23.958037] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-17T19:20:24.758030] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-17T19:20:25.540911] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T19:20:25.557984] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-17T19:20:26.358013] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-17T19:20:26.446373] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T19:20:27.076063] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T19:20:27.158067] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-17T19:20:27.399337] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-17T19:20:27.958021] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-17T19:20:28.141982] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T19:20:28.198175] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-17T19:20:28.758048] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-17T19:20:29.072962] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-17T19:20:29.073844] [INFO ] [REMOTE ] HCXY: Full fetch complete (514 records). [2025-10-17T19:20:29.073921] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-17T19:20:29.074333] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T19:20:29.074423] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:20:29.074494] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:20:29.074573] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-17T19:20:29.074753] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-17T19:20:29.074808] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-17T19:20:29.074853] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-17T19:20:29.074915] [INFO ] [MAIN ] Update Progress: 1001/2368 symbols completed. HCXY took 13.6s. Estimated remaining: 3h 11m 46s. Rate: 7.1 symbols/min [2025-10-17T19:20:29.247965] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:29.283296] [DEBUG] [LOCAL ] HEI: Loaded 31397 existing records from primary storage. [2025-10-17T19:20:29.283573] [INFO ] [MAIN ] HEI: Loaded 31397 existing records. [2025-10-17T19:20:29.456637] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:20:29.456882] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-17T19:20:29.456930] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-17T19:20:29.457322] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-17T19:20:29.457386] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-17T19:20:29.563091] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-17T19:20:29.819159] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:30.358007] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-17T19:20:30.463932] [DEBUG] [REMOTE ] HEI: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-17T19:20:30.464182] [WARN ] [REMOTE ] HEI: No data returned for month 2024-12 [2025-10-17T19:20:30.464270] [FATAL] [REMOTE ] HEI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:20:30.464323] [FATAL] [MAIN ] HEI: Failed to fetch primary data. [2025-10-17T19:20:30.464360] [WARN ] [MAIN ] HEI: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:20:30.464430] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-17T19:20:30.464494] [DEBUG] [LOCAL ] HEI: No primary data file found to delete. [2025-10-17T19:20:30.464532] [INFO ] [LOCAL ] HEI: Starting deletion of derivative data. [2025-10-17T19:20:30.464705] [DEBUG] [LOCAL ] HEI: Deleted derivative data file. [2025-10-17T19:20:30.465176] [INFO ] [MAIN ] Update Progress: 1002/2368 symbols completed. HEI took 1.4s. Estimated remaining: 3h 11m 28s. Rate: 7.1 symbols/min [2025-10-17T19:20:30.632276] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:30.642548] [DEBUG] [LOCAL ] HEQ: Loaded 6834 existing records from primary storage. [2025-10-17T19:20:30.642804] [INFO ] [MAIN ] HEQ: Loaded 6834 existing records. [2025-10-17T19:20:30.824956] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:20:30.825131] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-17T19:20:30.825203] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-17T19:20:30.825378] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-17T19:20:30.825435] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-17T19:20:31.171692] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-17T19:20:31.177901] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:31.404591] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T19:20:31.958041] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-17T19:20:32.701021] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-17T19:20:32.757982] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-17T19:20:33.558069] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-17T19:20:34.063328] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-17T19:20:34.153515] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-17T19:20:34.358007] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-17T19:20:34.704095] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T19:20:35.029167] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-17T19:20:35.158092] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-17T19:20:35.958070] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-17T19:20:36.758029] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-17T19:20:37.294008] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-17T19:20:37.558005] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-17T19:20:37.648850] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T19:20:38.358005] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-17T19:20:38.482532] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T19:20:38.513035] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T19:20:39.158115] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-17T19:20:39.958060] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-17T19:20:40.510302] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-17T19:20:40.758002] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-17T19:20:40.930190] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T19:20:41.558090] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-17T19:20:41.678119] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T19:20:42.358024] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-17T19:20:42.869585] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-17T19:20:43.158020] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-17T19:20:43.264254] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T19:20:43.761330] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-17T19:20:43.958000] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-17T19:20:44.078519] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T19:20:44.696508] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-17T19:20:44.758000] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-17T19:20:45.405465] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-17T19:20:45.558013] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-17T19:20:46.358073] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-17T19:20:46.932390] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-17T19:20:47.158017] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-17T19:20:47.255505] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T19:20:47.909259] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T19:20:47.957989] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-17T19:20:48.572800] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T19:20:48.758061] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-17T19:20:49.558020] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-17T19:20:49.565735] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T19:20:50.358038] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-17T19:20:51.137220] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T19:20:51.139498] [INFO ] [REMOTE ] HEQ: Full fetch complete (9611 records). [2025-10-17T19:20:51.139630] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-17T19:20:51.163169] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-17T19:20:51.551268] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-17T19:20:51.551915] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-17T19:20:51.552246] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-17T19:20:51.556253] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-17T19:20:51.556126] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-17T19:20:51.567981] [DEBUG] [LOCAL ] HEQ: Trimmed 9611 records to 6898 (keeping 200 days of data) [2025-10-17T19:20:51.609736] [DEBUG] [LOCAL ] HEQ: Primary data saved (6898 records). [2025-10-17T19:20:51.609861] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-17T19:20:51.609951] [INFO ] [MAIN ] Update Progress: 1003/2368 symbols completed. HEQ took 21.1s. Estimated remaining: 3h 11m 37s. Rate: 7.1 symbols/min [2025-10-17T19:20:51.785972] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:51.831179] [DEBUG] [LOCAL ] HESM: Loaded 48904 existing records from primary storage. [2025-10-17T19:20:51.831486] [INFO ] [MAIN ] HESM: Loaded 48904 existing records. [2025-10-17T19:20:51.963287] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-17T19:20:52.013253] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:20:52.013518] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-17T19:20:52.013575] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-17T19:20:52.014364] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-17T19:20:52.014424] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-17T19:20:52.364924] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:52.758039] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-17T19:20:52.890999] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T19:20:53.558029] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-17T19:20:53.753093] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-17T19:20:53.815119] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-17T19:20:54.358041] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-17T19:20:55.158019] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-17T19:20:55.228494] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T19:20:55.958042] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-17T19:20:56.170402] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:20:56.178252] [INFO ] [REMOTE ] HE: Full fetch complete (72169 records). [2025-10-17T19:20:56.178435] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-17T19:20:56.569746] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-17T19:20:56.569868] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-17T19:20:56.571081] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-17T19:20:56.571148] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-17T19:20:56.572678] [DEBUG] [LOCAL ] HE: Trimmed 72169 records to 49612 (keeping 200 days of data) [2025-10-17T19:20:56.776841] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-17T19:20:56.862293] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T19:20:56.907085] [DEBUG] [LOCAL ] HE: Primary data saved (49612 records). [2025-10-17T19:20:56.907252] [INFO ] [MAIN ] HE: Full history saved. [2025-10-17T19:20:56.907371] [INFO ] [MAIN ] Update Progress: 1004/2368 symbols completed. HE took 41.4s. Estimated remaining: 3h 11m 24s. Rate: 7.1 symbols/min [2025-10-17T19:20:57.082973] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:57.083167] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-17T19:20:57.083210] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-17T19:20:57.083323] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-17T19:20:57.083366] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-17T19:20:57.083410] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-17T19:20:57.083443] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-17T19:20:57.440994] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:57.558019] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-17T19:20:57.624435] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T19:20:57.631930] [INFO ] [REMOTE ] HDB: Full fetch complete (75628 records). [2025-10-17T19:20:57.632130] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-17T19:20:58.026838] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-17T19:20:58.026930] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-17T19:20:58.027945] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-17T19:20:58.028012] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-17T19:20:58.029505] [DEBUG] [LOCAL ] HDB: Trimmed 75628 records to 52710 (keeping 200 days of data) [2025-10-17T19:20:58.345728] [DEBUG] [LOCAL ] HDB: Primary data saved (52710 records). [2025-10-17T19:20:58.345878] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-17T19:20:58.345961] [INFO ] [MAIN ] Update Progress: 1005/2368 symbols completed. HDB took 42.8s. Estimated remaining: 3h 11m 6s. Rate: 7.1 symbols/min [2025-10-17T19:20:58.378028] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-17T19:20:58.522487] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:20:58.522661] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-17T19:20:58.522720] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-17T19:20:58.522831] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-17T19:20:58.522874] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-17T19:20:58.522918] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-17T19:20:58.522952] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-17T19:20:58.806184] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-17T19:20:58.886447] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:20:58.921597] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-17T19:20:58.957677] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T19:20:59.158071] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-17T19:20:59.435207] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-17T19:20:59.958019] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-17T19:21:00.330618] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-17T19:21:00.758095] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-17T19:21:01.558113] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-17T19:21:01.876015] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-17T19:21:02.358061] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-17T19:21:02.600041] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-17T19:21:02.764961] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-17T19:21:03.158040] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-17T19:21:03.418429] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-17T19:21:03.958040] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-17T19:21:04.758093] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-17T19:21:05.001927] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-17T19:21:05.558023] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-17T19:21:05.887829] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-17T19:21:06.163883] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-17T19:21:06.358049] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-17T19:21:07.158039] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-17T19:21:07.963102] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-17T19:21:07.978053] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T19:21:08.219313] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-17T19:21:08.758097] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-17T19:21:09.004383] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-17T19:21:09.296889] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-17T19:21:09.558028] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-17T19:21:10.358075] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-17T19:21:10.592304] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-17T19:21:11.158008] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-17T19:21:11.286779] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T19:21:11.663927] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-17T19:21:11.671307] [INFO ] [REMOTE ] HD: Full fetch complete (77562 records). [2025-10-17T19:21:11.671441] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-17T19:21:11.963346] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-17T19:21:12.069407] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-17T19:21:12.069500] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-17T19:21:12.070482] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-17T19:21:12.070547] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-17T19:21:12.073146] [DEBUG] [LOCAL ] HD: Trimmed 77562 records to 54264 (keeping 200 days of data) [2025-10-17T19:21:12.266321] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-17T19:21:12.413458] [DEBUG] [LOCAL ] HD: Primary data saved (54264 records). [2025-10-17T19:21:12.413596] [INFO ] [MAIN ] HD: Full history saved. [2025-10-17T19:21:12.413699] [INFO ] [MAIN ] Update Progress: 1006/2368 symbols completed. HD took 56.9s. Estimated remaining: 3h 11m 5s. Rate: 7.1 symbols/min [2025-10-17T19:21:12.584405] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:21:12.603137] [DEBUG] [LOCAL ] HFRO: Loaded 16982 existing records from primary storage. [2025-10-17T19:21:12.603399] [INFO ] [MAIN ] HFRO: Loaded 16982 existing records. [2025-10-17T19:21:12.758017] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-17T19:21:12.778315] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:21:12.779337] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-17T19:21:12.779384] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-17T19:21:12.779680] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-17T19:21:12.779749] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-17T19:21:13.125165] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:21:13.558079] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-17T19:21:13.981847] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-17T19:21:14.358049] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-17T19:21:14.540718] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T19:21:15.158133] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-17T19:21:15.239025] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-17T19:21:15.958050] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-17T19:21:16.758068] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-17T19:21:16.915429] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T19:21:17.072554] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T19:21:17.153685] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-17T19:21:17.154426] [INFO ] [REMOTE ] HF: Full fetch complete (436 records). [2025-10-17T19:21:17.154517] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-17T19:21:17.334843] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-17T19:21:17.335031] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:21:17.335100] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:21:17.335171] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-17T19:21:17.335236] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-17T19:21:17.335272] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-17T19:21:17.335311] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-17T19:21:17.335367] [INFO ] [MAIN ] Update Progress: 1007/2368 symbols completed. HF took 20.4s. Estimated remaining: 3h 10m 52s. Rate: 7.1 symbols/min [2025-10-17T19:21:17.522152] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:21:17.539312] [DEBUG] [LOCAL ] HGER: Loaded 15086 existing records from primary storage. [2025-10-17T19:21:17.539572] [INFO ] [MAIN ] HGER: Loaded 15086 existing records. [2025-10-17T19:21:17.563108] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-17T19:21:17.739066] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:21:17.739291] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-17T19:21:17.739340] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-17T19:21:17.739532] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-17T19:21:17.739597] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-17T19:21:18.123158] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:21:18.358030] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-17T19:21:19.158076] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-17T19:21:19.294971] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T19:21:19.431552] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-17T19:21:19.640174] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-17T19:21:19.958113] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-17T19:21:20.542493] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T19:21:20.758026] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-17T19:21:21.086915] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-17T19:21:21.558026] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-17T19:21:22.358007] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-17T19:21:22.604850] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T19:21:23.158026] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-17T19:21:23.888896] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T19:21:23.958026] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-17T19:21:24.151291] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T19:21:24.266616] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-17T19:21:24.758033] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-17T19:21:25.458697] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-17T19:21:25.558026] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-17T19:21:26.358062] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-17T19:21:26.956477] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-17T19:21:27.158027] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-17T19:21:27.395519] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T19:21:27.402989] [INFO ] [REMOTE ] HESM: Full fetch complete (69700 records). [2025-10-17T19:21:27.403173] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-17T19:21:27.843512] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-17T19:21:27.843678] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-17T19:21:27.844813] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-17T19:21:27.844921] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-17T19:21:27.846896] [DEBUG] [LOCAL ] HESM: Trimmed 69700 records to 49235 (keeping 200 days of data) [2025-10-17T19:21:27.958734] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-17T19:21:28.180316] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-17T19:21:28.202118] [DEBUG] [LOCAL ] HESM: Primary data saved (49235 records). [2025-10-17T19:21:28.202275] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-17T19:21:28.202918] [INFO ] [MAIN ] Update Progress: 1008/2368 symbols completed. HESM took 36.6s. Estimated remaining: 3h 10m 47s. Rate: 7.1 symbols/min [2025-10-17T19:21:28.385754] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:21:28.397292] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-17T19:21:28.403722] [DEBUG] [LOCAL ] HGLB: Loaded 9718 existing records from primary storage. [2025-10-17T19:21:28.404007] [INFO ] [MAIN ] HGLB: Loaded 9718 existing records. [2025-10-17T19:21:28.607706] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:21:28.607952] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-17T19:21:28.608014] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-17T19:21:28.608214] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-17T19:21:28.608267] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-17T19:21:28.767243] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-17T19:21:28.995095] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:21:29.562139] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-17T19:21:29.565712] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-17T19:21:30.358024] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-17T19:21:30.414328] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T19:21:30.796972] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-17T19:21:31.158022] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-17T19:21:31.575335] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-17T19:21:31.958018] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-17T19:21:32.670160] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-17T19:21:32.758033] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-17T19:21:33.558041] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-17T19:21:33.569499] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T19:21:34.356632] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-17T19:21:34.359554] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-17T19:21:35.145546] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T19:21:35.157984] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-17T19:21:35.947393] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-17T19:21:35.958006] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-17T19:21:36.675532] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T19:21:36.758083] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-17T19:21:37.503298] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-17T19:21:37.557990] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-17T19:21:38.293967] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T19:21:38.358079] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-17T19:21:39.158008] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-17T19:21:39.216192] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-17T19:21:39.629825] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-17T19:21:39.630631] [INFO ] [REMOTE ] HFND: Full fetch complete (1758 records). [2025-10-17T19:21:39.630735] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-17T19:21:39.839766] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-17T19:21:39.839914] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:21:39.839982] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:21:39.840073] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-17T19:21:39.840156] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-17T19:21:39.840212] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-17T19:21:39.840286] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-17T19:21:39.840356] [INFO ] [MAIN ] Update Progress: 1009/2368 symbols completed. HFND took 41.5s. Estimated remaining: 3h 10m 43s. Rate: 7.1 symbols/min [2025-10-17T19:21:39.963194] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-17T19:21:40.009352] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:21:40.025171] [DEBUG] [LOCAL ] HGTY: Loaded 13424 existing records from primary storage. [2025-10-17T19:21:40.025401] [INFO ] [MAIN ] HGTY: Loaded 13424 existing records. [2025-10-17T19:21:40.196916] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:21:40.197091] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-17T19:21:40.197137] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-17T19:21:40.197292] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-17T19:21:40.197372] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-17T19:21:40.535878] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:21:40.758039] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-17T19:21:40.933763] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T19:21:41.538010] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-17T19:21:41.557977] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-17T19:21:42.358008] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-17T19:21:42.416339] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T19:21:42.418438] [INFO ] [REMOTE ] HGLB: Full fetch complete (14662 records). [2025-10-17T19:21:42.418506] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-17T19:21:42.781084] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-17T19:21:42.781172] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-17T19:21:42.781487] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-17T19:21:42.781527] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-17T19:21:42.782122] [DEBUG] [LOCAL ] HGLB: Trimmed 14662 records to 9785 (keeping 200 days of data) [2025-10-17T19:21:42.840664] [DEBUG] [LOCAL ] HGLB: Primary data saved (9785 records). [2025-10-17T19:21:42.840806] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-17T19:21:42.840889] [INFO ] [MAIN ] Update Progress: 1010/2368 symbols completed. HGLB took 14.6s. Estimated remaining: 3h 10m 27s. Rate: 7.1 symbols/min [2025-10-17T19:21:43.014100] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:21:43.059035] [DEBUG] [LOCAL ] HGV: Loaded 46673 existing records from primary storage. [2025-10-17T19:21:43.059364] [INFO ] [MAIN ] HGV: Loaded 46673 existing records. [2025-10-17T19:21:43.159689] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-17T19:21:43.241686] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:21:43.241965] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-17T19:21:43.242097] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-17T19:21:43.250360] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-17T19:21:43.251034] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-17T19:21:43.250779] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-17T19:21:43.622241] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:21:43.958041] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-17T19:21:44.172017] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-17T19:21:44.737713] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-17T19:21:44.758056] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-17T19:21:45.558000] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-17T19:21:45.636181] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-17T19:21:46.358026] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-17T19:21:47.040703] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T19:21:47.120692] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T19:21:47.157984] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-17T19:21:47.929988] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-17T19:21:47.958045] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-17T19:21:48.758076] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-17T19:21:48.966176] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T19:21:49.165821] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-17T19:21:49.558027] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-17T19:21:50.358067] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-17T19:21:50.483588] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-17T19:21:51.158072] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-17T19:21:51.324716] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-17T19:21:51.922783] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T19:21:51.958011] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-17T19:21:52.729226] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-17T19:21:52.758062] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-17T19:21:53.480345] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T19:21:53.558035] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-17T19:21:54.311885] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T19:21:54.358074] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-17T19:21:55.158058] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-17T19:21:55.858633] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T19:21:55.957984] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-17T19:21:56.160863] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T19:21:56.758093] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-17T19:21:57.451862] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T19:21:57.558036] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-17T19:21:57.829211] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-17T19:21:58.083128] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-17T19:21:58.358006] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-17T19:21:59.158007] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-17T19:21:59.356903] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T19:21:59.958031] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-17T19:22:00.173211] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T19:22:00.175674] [INFO ] [REMOTE ] HFRO: Full fetch complete (27584 records). [2025-10-17T19:22:00.175763] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-17T19:22:00.550579] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-17T19:22:00.550681] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-17T19:22:00.551322] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-17T19:22:00.551386] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-17T19:22:00.552156] [DEBUG] [LOCAL ] HFRO: Trimmed 27584 records to 17015 (keeping 200 days of data) [2025-10-17T19:22:00.657198] [DEBUG] [LOCAL ] HFRO: Primary data saved (17015 records). [2025-10-17T19:22:00.657382] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-17T19:22:00.657499] [INFO ] [MAIN ] Update Progress: 1011/2368 symbols completed. HFRO took 48.2s. Estimated remaining: 3h 10m 31s. Rate: 7.1 symbols/min [2025-10-17T19:22:00.763234] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-17T19:22:00.839895] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:22:00.873730] [DEBUG] [LOCAL ] HHH: Loaded 33409 existing records from primary storage. [2025-10-17T19:22:00.874038] [INFO ] [MAIN ] HHH: Loaded 33409 existing records. [2025-10-17T19:22:01.060277] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:22:01.060466] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-17T19:22:01.060514] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-17T19:22:01.060728] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-17T19:22:01.060788] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-17T19:22:01.440063] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:22:01.452959] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T19:22:01.558033] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-17T19:22:02.358052] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-17T19:22:02.792957] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T19:22:02.795841] [INFO ] [REMOTE ] HGTY: Full fetch complete (17577 records). [2025-10-17T19:22:02.795916] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-17T19:22:03.000300] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T19:22:03.081963] [INFO ] [REMOTE ] HGER: Full fetch complete (18452 records). [2025-10-17T19:22:03.093288] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-17T19:22:03.163088] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-17T19:22:03.333525] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-17T19:22:03.357765] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-17T19:22:03.366919] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-17T19:22:03.368892] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-17T19:22:03.408824] [DEBUG] [LOCAL ] HGTY: Trimmed 17577 records to 13543 (keeping 200 days of data) [2025-10-17T19:22:03.660576] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T19:22:03.672520] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-17T19:22:03.679674] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-17T19:22:03.680417] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-17T19:22:03.680857] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-17T19:22:03.687954] [DEBUG] [LOCAL ] HGER: Trimmed 18452 records to 15286 (keeping 200 days of data) [2025-10-17T19:22:03.737829] [DEBUG] [LOCAL ] HGTY: Primary data saved (13543 records). [2025-10-17T19:22:03.757942] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-17T19:22:03.769218] [INFO ] [MAIN ] Update Progress: 1012/2368 symbols completed. HGTY took 23.9s. Estimated remaining: 3h 10m 16s. Rate: 7.1 symbols/min [2025-10-17T19:22:03.794508] [DEBUG] [LOCAL ] HGER: Primary data saved (15286 records). [2025-10-17T19:22:03.825711] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-17T19:22:03.846001] [INFO ] [MAIN ] Update Progress: 1013/2368 symbols completed. HGER took 46.5s. Estimated remaining: 3h 9m 56s. Rate: 7.1 symbols/min [2025-10-17T19:22:03.961304] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-17T19:22:04.090075] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:22:04.140174] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:22:04.173320] [DEBUG] [LOCAL ] HI: Loaded 36147 existing records from primary storage. [2025-10-17T19:22:04.173682] [INFO ] [MAIN ] HI: Loaded 36147 existing records. [2025-10-17T19:22:04.366516] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:22:04.382441] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-17T19:22:04.382549] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-17T19:22:04.383571] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-17T19:22:04.383531] [DEBUG] [LOCAL ] HIG: Loaded 51580 existing records from primary storage. [2025-10-17T19:22:04.383698] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-17T19:22:04.415363] [INFO ] [MAIN ] HIG: Loaded 51580 existing records. [2025-10-17T19:22:04.823521] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:22:04.841192] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-17T19:22:04.862458] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-17T19:22:04.873603] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-17T19:22:04.884115] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-17T19:22:04.979700] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:22:04.985415] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-17T19:22:05.160127] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-17T19:22:05.353718] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:22:05.488686] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-17T19:22:05.558034] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-17T19:22:06.358007] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-17T19:22:06.396567] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T19:22:06.896916] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T19:22:07.158018] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-17T19:22:07.958009] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-17T19:22:08.103015] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T19:22:08.432935] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T19:22:08.758038] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-17T19:22:08.819971] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T19:22:09.558006] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-17T19:22:10.359420] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-17T19:22:10.363288] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T19:22:11.158053] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-17T19:22:11.226082] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T19:22:11.712988] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T19:22:11.958022] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-17T19:22:12.639006] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T19:22:12.758271] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-17T19:22:12.953210] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-17T19:22:13.558024] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-17T19:22:14.358058] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-17T19:22:14.512456] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T19:22:14.834466] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-17T19:22:15.158020] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-17T19:22:15.835403] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T19:22:15.958012] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-17T19:22:16.747114] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T19:22:16.757974] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-17T19:22:17.522884] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T19:22:17.558026] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-17T19:22:18.358004] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-17T19:22:18.554127] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T19:22:18.878296] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-17T19:22:19.158030] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-17T19:22:19.529438] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T19:22:19.958067] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-17T19:22:20.758068] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-17T19:22:20.843247] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T19:22:21.558076] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-17T19:22:21.845592] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T19:22:22.182256] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-17T19:22:22.188354] [INFO ] [REMOTE ] HGV: Full fetch complete (65953 records). [2025-10-17T19:22:22.188543] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-17T19:22:22.363528] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-17T19:22:22.586818] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-17T19:22:22.586927] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-17T19:22:22.587917] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-17T19:22:22.587982] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-17T19:22:22.589382] [DEBUG] [LOCAL ] HGV: Trimmed 65953 records to 46933 (keeping 200 days of data) [2025-10-17T19:22:22.866292] [DEBUG] [LOCAL ] HGV: Primary data saved (46933 records). [2025-10-17T19:22:22.866435] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-17T19:22:22.866977] [INFO ] [MAIN ] Update Progress: 1014/2368 symbols completed. HGV took 40.0s. Estimated remaining: 3h 10m 2s. Rate: 7.1 symbols/min [2025-10-17T19:22:23.041484] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:22:23.065076] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T19:22:23.103673] [DEBUG] [LOCAL ] HII: Loaded 34070 existing records from primary storage. [2025-10-17T19:22:23.104019] [INFO ] [MAIN ] HII: Loaded 34070 existing records. [2025-10-17T19:22:23.168181] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-17T19:22:23.320702] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:22:23.320986] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-17T19:22:23.321035] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-17T19:22:23.321594] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-17T19:22:23.321682] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-17T19:22:23.680889] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:22:23.913455] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T19:22:23.957991] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-17T19:22:24.636088] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T19:22:24.758015] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-17T19:22:25.511484] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T19:22:25.557991] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-17T19:22:26.103980] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T19:22:26.358041] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-17T19:22:26.724083] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-17T19:22:27.158047] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-17T19:22:27.813280] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T19:22:27.958102] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-17T19:22:28.128331] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T19:22:28.758100] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-17T19:22:29.417598] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T19:22:29.558043] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-17T19:22:30.093891] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T19:22:30.358049] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-17T19:22:31.152496] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T19:22:31.160602] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-17T19:22:31.958028] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-17T19:22:32.054889] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T19:22:32.190879] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T19:22:32.195180] [INFO ] [REMOTE ] HHH: Full fetch complete (46024 records). [2025-10-17T19:22:32.195264] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-17T19:22:32.565255] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-17T19:22:32.565329] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-17T19:22:32.566021] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-17T19:22:32.566083] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-17T19:22:32.567053] [DEBUG] [LOCAL ] HHH: Trimmed 46024 records to 33589 (keeping 200 days of data) [2025-10-17T19:22:32.763270] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-17T19:22:32.763362] [DEBUG] [LOCAL ] HHH: Primary data saved (33589 records). [2025-10-17T19:22:32.763539] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-17T19:22:32.763677] [INFO ] [MAIN ] Update Progress: 1015/2368 symbols completed. HHH took 32.1s. Estimated remaining: 3h 9m 56s. Rate: 7.1 symbols/min [2025-10-17T19:22:32.930888] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:22:32.979947] [DEBUG] [LOCAL ] HIMS: Loaded 54207 existing records from primary storage. [2025-10-17T19:22:32.980271] [INFO ] [MAIN ] HIMS: Loaded 54207 existing records. [2025-10-17T19:22:33.157068] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:22:33.157277] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-17T19:22:33.157352] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-17T19:22:33.157598] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-17T19:22:33.157687] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-17T19:22:33.508413] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:22:33.557988] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-17T19:22:33.731166] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T19:22:34.018450] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-17T19:22:34.358062] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-17T19:22:35.158028] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-17T19:22:35.470298] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T19:22:35.958034] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-17T19:22:36.758006] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-17T19:22:36.861177] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-10-17T19:22:36.957366] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T19:22:37.546011] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T19:22:37.557972] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-17T19:22:37.802621] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-17T19:22:38.358012] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-17T19:22:39.158038] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-17T19:22:39.429575] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T19:22:39.930225] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T19:22:39.935837] [INFO ] [REMOTE ] HI: Full fetch complete (50807 records). [2025-10-17T19:22:39.935945] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-17T19:22:39.967796] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-17T19:22:40.328410] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-17T19:22:40.328478] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-17T19:22:40.329262] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-17T19:22:40.329324] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-17T19:22:40.330490] [DEBUG] [LOCAL ] HI: Trimmed 50807 records to 36524 (keeping 200 days of data) [2025-10-17T19:22:40.553806] [DEBUG] [LOCAL ] HI: Primary data saved (36524 records). [2025-10-17T19:22:40.553933] [INFO ] [MAIN ] HI: Full history saved. [2025-10-17T19:22:40.554010] [INFO ] [MAIN ] Update Progress: 1016/2368 symbols completed. HI took 36.8s. Estimated remaining: 3h 9m 46s. Rate: 7.1 symbols/min [2025-10-17T19:22:40.718755] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:22:40.751373] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:22:40.757981] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-17T19:22:40.777708] [DEBUG] [LOCAL ] HIO: Loaded 24541 existing records from primary storage. [2025-10-17T19:22:40.777944] [INFO ] [MAIN ] HIO: Loaded 24541 existing records. [2025-10-17T19:22:40.959406] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:22:40.959591] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-17T19:22:40.959636] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-17T19:22:40.959842] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-17T19:22:40.959883] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-17T19:22:41.310439] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:22:41.557978] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-17T19:22:42.244751] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T19:22:42.327887] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T19:22:42.360005] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-17T19:22:42.362743] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-17T19:22:43.158017] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-17T19:22:43.805724] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T19:22:43.957991] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-17T19:22:44.041384] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-17T19:22:44.048301] [INFO ] [REMOTE ] HIG: Full fetch complete (73536 records). [2025-10-17T19:22:44.048418] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-17T19:22:44.459517] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-17T19:22:44.459597] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-17T19:22:44.460554] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-17T19:22:44.460617] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-17T19:22:44.462005] [DEBUG] [LOCAL ] HIG: Trimmed 73536 records to 51943 (keeping 200 days of data) [2025-10-17T19:22:44.763694] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-17T19:22:44.785725] [DEBUG] [LOCAL ] HIG: Primary data saved (51943 records). [2025-10-17T19:22:44.785813] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-17T19:22:44.786707] [INFO ] [MAIN ] Update Progress: 1017/2368 symbols completed. HIG took 40.9s. Estimated remaining: 3h 9m 32s. Rate: 7.1 symbols/min [2025-10-17T19:22:44.954901] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:22:44.976561] [DEBUG] [LOCAL ] HIPO: Loaded 21976 existing records from primary storage. [2025-10-17T19:22:44.976841] [INFO ] [MAIN ] HIPO: Loaded 21976 existing records. [2025-10-17T19:22:45.148688] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:22:45.148891] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-17T19:22:45.148937] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-17T19:22:45.149121] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-17T19:22:45.149176] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-17T19:22:45.491985] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:22:45.557980] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-17T19:22:46.124501] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T19:22:46.358004] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-17T19:22:46.466517] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-10-17T19:22:46.648279] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T19:22:47.158012] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-17T19:22:47.571447] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T19:22:47.958036] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-17T19:22:48.758086] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-17T19:22:49.404590] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T19:22:49.558026] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-17T19:22:49.696155] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-17T19:22:49.976339] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T19:22:50.358060] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-17T19:22:50.702541] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T19:22:50.707201] [INFO ] [REMOTE ] HII: Full fetch complete (52482 records). [2025-10-17T19:22:50.707350] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-17T19:22:51.093200] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-17T19:22:51.093280] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-17T19:22:51.094099] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-17T19:22:51.094169] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-17T19:22:51.096014] [DEBUG] [LOCAL ] HII: Trimmed 52482 records to 34269 (keeping 200 days of data) [2025-10-17T19:22:51.161970] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-17T19:22:51.316335] [DEBUG] [LOCAL ] HII: Primary data saved (34269 records). [2025-10-17T19:22:51.316467] [INFO ] [MAIN ] HII: Full history saved. [2025-10-17T19:22:51.317100] [INFO ] [MAIN ] Update Progress: 1018/2368 symbols completed. HII took 28.4s. Estimated remaining: 3h 9m 21s. Rate: 7.1 symbols/min [2025-10-17T19:22:51.450587] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T19:22:51.502618] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:22:51.543455] [DEBUG] [LOCAL ] HIW: Loaded 44926 existing records from primary storage. [2025-10-17T19:22:51.543774] [INFO ] [MAIN ] HIW: Loaded 44926 existing records. [2025-10-17T19:22:51.719106] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:22:51.719317] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-17T19:22:51.719365] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-17T19:22:51.719580] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-17T19:22:51.719679] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-17T19:22:51.970252] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-17T19:22:52.089991] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:22:52.758046] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-17T19:22:53.558038] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-17T19:23:05.984893] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (14.82 seconds). [2025-10-17T19:23:05.991847] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-17T19:23:07.752568] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (14.19 seconds). [2025-10-17T19:23:07.761598] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-17T19:23:09.025017] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (17.05 seconds). [2025-10-17T19:23:09.030024] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-17T19:23:09.212119] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (16.45 seconds). [2025-10-17T19:23:09.223845] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-17T19:23:09.250863] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (3.26 seconds). [2025-10-17T19:23:09.256931] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-17T19:23:10.271061] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-17T19:23:10.280369] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-17T19:23:10.527102] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T19:23:10.545270] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-17T19:23:10.544510] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T19:23:10.551549] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-17T19:23:11.550169] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T19:23:11.555315] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-17T19:23:11.634742] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T19:23:11.640632] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-17T19:23:11.757694] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-17T19:23:11.769905] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-17T19:23:11.809174] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T19:23:11.818976] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-17T19:23:12.670072] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T19:23:12.675129] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-17T19:23:12.732129] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T19:23:12.738014] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-17T19:23:13.336363] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T19:23:13.346384] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-17T19:23:13.476763] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T19:23:13.482623] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-17T19:23:13.892124] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T19:23:13.898798] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-17T19:23:14.347567] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-17T19:23:14.358454] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-17T19:23:14.729521] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-17T19:23:14.735816] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-17T19:23:14.991794] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T19:23:14.999089] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-17T19:23:15.333901] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T19:23:15.343713] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-17T19:23:16.045231] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T19:23:16.052322] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-17T19:23:16.072107] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T19:23:16.077222] [INFO ] [REMOTE ] HIO: Full fetch complete (37949 records). [2025-10-17T19:23:16.077369] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-17T19:23:16.454351] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-17T19:23:16.454451] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-17T19:23:16.455162] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-17T19:23:16.455223] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-17T19:23:16.456052] [DEBUG] [LOCAL ] HIO: Trimmed 37949 records to 24778 (keeping 200 days of data) [2025-10-17T19:23:16.595830] [DEBUG] [LOCAL ] HIO: Primary data saved (24778 records). [2025-10-17T19:23:16.596003] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-17T19:23:16.596088] [INFO ] [MAIN ] Update Progress: 1019/2368 symbols completed. HIO took 36.0s. Estimated remaining: 3h 9m 35s. Rate: 7.1 symbols/min [2025-10-17T19:23:16.767082] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:23:16.787827] [DEBUG] [LOCAL ] HIX: Loaded 20590 existing records from primary storage. [2025-10-17T19:23:16.788070] [INFO ] [MAIN ] HIX: Loaded 20590 existing records. [2025-10-17T19:23:16.972158] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:23:16.972504] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-17T19:23:16.972571] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-17T19:23:16.973273] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-17T19:23:16.973442] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-17T19:23:17.165792] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T19:23:17.284025] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-17T19:23:17.285047] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-17T19:23:17.306707] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-10-17T19:23:17.360981] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-17T19:23:17.402254] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-17T19:23:17.468565] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:23:17.468965] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-17T19:23:18.324509] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T19:23:18.327181] [INFO ] [REMOTE ] HIPO: Full fetch complete (31162 records). [2025-10-17T19:23:18.327251] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-17T19:23:18.700704] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-17T19:23:18.701018] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-17T19:23:18.707635] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-17T19:23:18.717690] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-17T19:23:18.719209] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T19:23:18.725956] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-17T19:23:18.727251] [DEBUG] [LOCAL ] HIPO: Trimmed 31162 records to 22131 (keeping 200 days of data) [2025-10-17T19:23:18.857481] [DEBUG] [LOCAL ] HIPO: Primary data saved (22131 records). [2025-10-17T19:23:18.857622] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-17T19:23:18.857743] [INFO ] [MAIN ] Update Progress: 1020/2368 symbols completed. HIPO took 34.1s. Estimated remaining: 3h 9m 19s. Rate: 7.1 symbols/min [2025-10-17T19:23:19.062588] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:23:19.064147] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T19:23:19.073883] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-17T19:23:19.091338] [DEBUG] [LOCAL ] HKD: Loaded 18776 existing records from primary storage. [2025-10-17T19:23:19.091989] [INFO ] [MAIN ] HKD: Loaded 18776 existing records. [2025-10-17T19:23:19.270397] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:23:19.270716] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-17T19:23:19.270776] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-17T19:23:19.271006] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-17T19:23:19.271063] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-17T19:23:19.634730] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:23:19.635164] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-17T19:23:19.873166] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T19:23:19.878631] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-17T19:23:20.119635] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-10-17T19:23:20.132200] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-17T19:23:20.604116] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T19:23:20.619630] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-17T19:23:20.743724] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T19:23:20.752996] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-17T19:23:20.929852] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T19:23:20.934483] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-17T19:23:21.940669] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T19:23:21.945080] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-17T19:23:22.159423] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T19:23:22.199670] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T19:23:22.358058] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-17T19:23:22.780111] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-17T19:23:23.022203] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-17T19:23:23.158032] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-17T19:23:23.958099] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-17T19:23:24.011699] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T19:23:24.758073] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-17T19:23:25.145214] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T19:23:25.558030] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-17T19:23:25.686790] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.53 seconds). [2025-10-17T19:23:25.694067] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-17T19:23:25.694194] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-17T19:23:26.078535] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-17T19:23:26.078613] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-17T19:23:26.079597] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-17T19:23:26.079684] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-17T19:23:26.081152] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 54597 (keeping 200 days of data) [2025-10-17T19:23:26.358326] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-17T19:23:26.454713] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T19:23:26.462778] [INFO ] [REMOTE ] HIW: Full fetch complete (64841 records). [2025-10-17T19:23:26.465243] [DEBUG] [LOCAL ] HIMS: Primary data saved (54597 records). [2025-10-17T19:23:26.465384] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-17T19:23:26.465541] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-17T19:23:26.465884] [INFO ] [MAIN ] Update Progress: 1021/2368 symbols completed. HIMS took 53.7s. Estimated remaining: 3h 9m 9s. Rate: 7.1 symbols/min [2025-10-17T19:23:26.847943] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-17T19:23:26.857102] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:23:27.072828] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-17T19:23:27.073032] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-17T19:23:27.074013] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-17T19:23:27.074160] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-17T19:23:27.089434] [DEBUG] [LOCAL ] HIW: Trimmed 64841 records to 45201 (keeping 200 days of data) [2025-10-17T19:23:27.181372] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-17T19:23:27.204570] [DEBUG] [LOCAL ] HL: Loaded 54065 existing records from primary storage. [2025-10-17T19:23:27.208442] [INFO ] [MAIN ] HL: Loaded 54065 existing records. [2025-10-17T19:23:27.484783] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:23:27.485103] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-17T19:23:27.510524] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-17T19:23:27.521244] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-17T19:23:27.521585] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-17T19:23:27.570754] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T19:23:27.914048] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:23:27.958442] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-17T19:23:27.964469] [DEBUG] [LOCAL ] HIW: Primary data saved (45201 records). [2025-10-17T19:23:27.964723] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-17T19:23:27.965409] [INFO ] [MAIN ] Update Progress: 1022/2368 symbols completed. HIW took 36.6s. Estimated remaining: 3h 8m 52s. Rate: 7.1 symbols/min [2025-10-17T19:23:28.137286] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:23:28.193148] [DEBUG] [LOCAL ] HLF: Loaded 48878 existing records from primary storage. [2025-10-17T19:23:28.193476] [INFO ] [MAIN ] HLF: Loaded 48878 existing records. [2025-10-17T19:23:28.315838] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T19:23:28.388919] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:23:28.389138] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-17T19:23:28.389187] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-17T19:23:28.389451] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-17T19:23:28.389507] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-17T19:23:28.738970] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:23:28.757980] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-17T19:23:29.558023] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-17T19:23:29.838499] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T19:23:30.317100] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T19:23:30.336831] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T19:23:30.358000] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-17T19:23:31.158013] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-17T19:23:31.775479] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T19:23:31.958037] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-17T19:23:32.758036] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-17T19:23:32.903635] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T19:23:33.075387] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-17T19:23:33.558042] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-17T19:23:33.845697] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T19:23:34.358125] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-17T19:23:35.167524] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-17T19:23:35.175549] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T19:23:35.325234] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T19:23:35.958032] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-17T19:23:36.758078] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-17T19:23:37.054998] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T19:23:37.232727] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-17T19:23:37.558009] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-17T19:23:37.871193] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T19:23:38.358083] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-17T19:23:39.158036] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-17T19:23:39.380351] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-17T19:23:39.473515] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T19:23:39.958103] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-17T19:23:40.098685] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T19:23:40.102060] [INFO ] [REMOTE ] HKD: Full fetch complete (28201 records). [2025-10-17T19:23:40.102176] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-17T19:23:40.481252] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-17T19:23:40.481326] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-17T19:23:40.481899] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-17T19:23:40.481971] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-17T19:23:40.482637] [DEBUG] [LOCAL ] HKD: Trimmed 28201 records to 18952 (keeping 200 days of data) [2025-10-17T19:23:40.587249] [DEBUG] [LOCAL ] HKD: Primary data saved (18952 records). [2025-10-17T19:23:40.587413] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-17T19:23:40.587511] [INFO ] [MAIN ] Update Progress: 1023/2368 symbols completed. HKD took 21.7s. Estimated remaining: 3h 8m 49s. Rate: 7.1 symbols/min [2025-10-17T19:23:40.768883] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-17T19:23:40.770065] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:23:40.772867] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T19:23:40.819706] [DEBUG] [LOCAL ] HLI: Loaded 31106 existing records from primary storage. [2025-10-17T19:23:40.820014] [INFO ] [MAIN ] HLI: Loaded 31106 existing records. [2025-10-17T19:23:40.996176] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:23:40.996407] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-17T19:23:40.996484] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-17T19:23:40.996771] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-17T19:23:40.996841] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-17T19:23:41.343496] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:23:41.558020] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-17T19:23:42.325737] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T19:23:42.357977] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-17T19:23:42.528825] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-17T19:23:43.158117] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-17T19:23:43.958078] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-17T19:23:44.033373] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T19:23:44.585960] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T19:23:44.758073] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-17T19:23:45.042438] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T19:23:45.045518] [INFO ] [REMOTE ] HIX: Full fetch complete (29863 records). [2025-10-17T19:23:45.045598] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-17T19:23:45.408217] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-17T19:23:45.408298] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-17T19:23:45.408919] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-17T19:23:45.408980] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-17T19:23:45.409748] [DEBUG] [LOCAL ] HIX: Trimmed 29863 records to 20696 (keeping 200 days of data) [2025-10-17T19:23:45.526189] [DEBUG] [LOCAL ] HIX: Primary data saved (20696 records). [2025-10-17T19:23:45.526321] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-17T19:23:45.526399] [INFO ] [MAIN ] Update Progress: 1024/2368 symbols completed. HIX took 28.9s. Estimated remaining: 3h 8m 36s. Rate: 7.1 symbols/min [2025-10-17T19:23:45.563213] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-17T19:23:45.702230] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:23:45.731461] [DEBUG] [LOCAL ] HLIO: Loaded 28465 existing records from primary storage. [2025-10-17T19:23:45.731749] [INFO ] [MAIN ] HLIO: Loaded 28465 existing records. [2025-10-17T19:23:45.906470] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:23:45.906733] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-17T19:23:45.906787] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-17T19:23:45.906980] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-17T19:23:45.907035] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-17T19:23:46.256938] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:23:46.358016] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-17T19:23:46.668840] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T19:23:46.880357] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-17T19:23:46.972942] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-17T19:23:47.158065] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-17T19:23:47.957997] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-17T19:23:48.189579] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-17T19:23:48.758108] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-17T19:23:49.250585] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T19:23:49.558003] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-17T19:23:49.698623] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T19:23:50.358081] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-17T19:23:51.158059] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-17T19:23:51.420731] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T19:23:51.613727] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T19:23:51.958030] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-17T19:23:52.636227] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T19:23:52.758032] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-17T19:23:53.308257] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T19:23:53.558063] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-17T19:23:54.358015] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-17T19:23:54.471406] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T19:23:54.755435] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T19:23:55.158085] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-17T19:23:55.958013] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-17T19:23:56.308733] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T19:23:56.553297] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T19:23:56.758047] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-17T19:23:57.203367] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-17T19:23:57.558095] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-17T19:23:58.358101] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-17T19:23:58.771412] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-17T19:23:58.830664] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T19:23:59.158086] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-17T19:23:59.633238] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T19:23:59.958083] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-17T19:24:00.156345] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-17T19:24:00.758048] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-17T19:24:01.558000] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-17T19:24:01.757204] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T19:24:02.358061] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-17T19:24:02.586630] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T19:24:03.158067] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-17T19:24:03.581068] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T19:24:03.663072] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T19:24:03.958022] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-17T19:24:04.758069] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-17T19:24:04.970906] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:24:04.977739] [INFO ] [REMOTE ] HLF: Full fetch complete (70963 records). [2025-10-17T19:24:04.977904] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-17T19:24:05.366809] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-17T19:24:05.366910] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-17T19:24:05.367973] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-17T19:24:05.368039] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-17T19:24:05.369468] [DEBUG] [LOCAL ] HLF: Trimmed 70963 records to 49226 (keeping 200 days of data) [2025-10-17T19:24:05.565824] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-17T19:24:05.651337] [DEBUG] [LOCAL ] HLF: Primary data saved (49226 records). [2025-10-17T19:24:05.651474] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-17T19:24:05.652195] [INFO ] [MAIN ] Update Progress: 1025/2368 symbols completed. HLF took 37.7s. Estimated remaining: 3h 8m 43s. Rate: 7.1 symbols/min [2025-10-17T19:24:05.825174] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:05.860418] [DEBUG] [LOCAL ] HLLY: Loaded 33658 existing records from primary storage. [2025-10-17T19:24:05.860732] [INFO ] [MAIN ] HLLY: Loaded 33658 existing records. [2025-10-17T19:24:06.049800] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:24:06.050436] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-17T19:24:06.050545] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-17T19:24:06.077781] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-17T19:24:06.092959] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-17T19:24:06.141263] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-17T19:24:06.283754] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T19:24:06.366888] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-17T19:24:06.515809] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:06.937685] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T19:24:07.158081] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-17T19:24:07.958020] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-17T19:24:08.499993] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-17T19:24:08.578849] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-17T19:24:08.758052] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-17T19:24:09.296847] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T19:24:09.557993] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-17T19:24:10.000351] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T19:24:10.358039] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-17T19:24:10.903363] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-17T19:24:10.908055] [INFO ] [REMOTE ] HLI: Full fetch complete (45284 records). [2025-10-17T19:24:10.908203] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-17T19:24:11.159352] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-17T19:24:11.288452] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-17T19:24:11.288533] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-17T19:24:11.289296] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-17T19:24:11.289358] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-17T19:24:11.290348] [DEBUG] [LOCAL ] HLI: Trimmed 45284 records to 31316 (keeping 200 days of data) [2025-10-17T19:24:11.407786] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T19:24:11.515188] [DEBUG] [LOCAL ] HLI: Primary data saved (31316 records). [2025-10-17T19:24:11.515364] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-17T19:24:11.515454] [INFO ] [MAIN ] Update Progress: 1026/2368 symbols completed. HLI took 30.9s. Estimated remaining: 3h 8m 31s. Rate: 7.1 symbols/min [2025-10-17T19:24:11.684787] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:11.738914] [DEBUG] [LOCAL ] HLN: Loaded 53512 existing records from primary storage. [2025-10-17T19:24:11.739258] [INFO ] [MAIN ] HLN: Loaded 53512 existing records. [2025-10-17T19:24:11.914869] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:24:11.915106] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-17T19:24:11.915153] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-17T19:24:11.915410] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-17T19:24:11.915465] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-17T19:24:11.963265] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-17T19:24:12.297877] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:12.424520] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T19:24:12.758224] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-17T19:24:13.558104] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-17T19:24:14.067271] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T19:24:14.156740] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-17T19:24:14.165242] [INFO ] [REMOTE ] HL: Full fetch complete (77824 records). [2025-10-17T19:24:14.165461] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-17T19:24:14.372849] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-17T19:24:14.580502] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-17T19:24:14.580602] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-17T19:24:14.581673] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-17T19:24:14.581742] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-17T19:24:14.583279] [DEBUG] [LOCAL ] HL: Trimmed 77824 records to 54455 (keeping 200 days of data) [2025-10-17T19:24:14.910734] [DEBUG] [LOCAL ] HL: Primary data saved (54455 records). [2025-10-17T19:24:14.910884] [INFO ] [MAIN ] HL: Full history saved. [2025-10-17T19:24:14.910984] [INFO ] [MAIN ] Update Progress: 1027/2368 symbols completed. HL took 48.4s. Estimated remaining: 3h 8m 16s. Rate: 7.1 symbols/min [2025-10-17T19:24:15.079954] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:15.130994] [DEBUG] [LOCAL ] HLT: Loaded 50910 existing records from primary storage. [2025-10-17T19:24:15.131316] [INFO ] [MAIN ] HLT: Loaded 50910 existing records. [2025-10-17T19:24:15.163118] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-17T19:24:15.322829] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:24:15.323291] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-17T19:24:15.323490] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-17T19:24:15.324150] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-17T19:24:15.324214] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-17T19:24:15.455251] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T19:24:15.724456] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:15.940748] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T19:24:15.957982] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-17T19:24:16.269780] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T19:24:16.758030] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-17T19:24:17.276351] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-17T19:24:17.558034] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-17T19:24:18.357205] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T19:24:18.366895] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-17T19:24:19.158015] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-17T19:24:19.381181] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T19:24:19.465624] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T19:24:19.958039] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-17T19:24:20.371928] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T19:24:20.377913] [INFO ] [REMOTE ] HLIO: Full fetch complete (37014 records). [2025-10-17T19:24:20.378137] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-17T19:24:20.755421] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-17T19:24:20.755494] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-17T19:24:20.756180] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-17T19:24:20.756242] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-17T19:24:20.757060] [DEBUG] [LOCAL ] HLIO: Trimmed 37014 records to 28680 (keeping 200 days of data) [2025-10-17T19:24:20.758207] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-17T19:24:20.934164] [DEBUG] [LOCAL ] HLIO: Primary data saved (28680 records). [2025-10-17T19:24:20.934298] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-17T19:24:20.934389] [INFO ] [MAIN ] Update Progress: 1028/2368 symbols completed. HLIO took 35.4s. Estimated remaining: 3h 8m 4s. Rate: 7.1 symbols/min [2025-10-17T19:24:21.103369] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:21.146486] [DEBUG] [LOCAL ] HLX: Loaded 47821 existing records from primary storage. [2025-10-17T19:24:21.146856] [INFO ] [MAIN ] HLX: Loaded 47821 existing records. [2025-10-17T19:24:21.323306] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:24:21.323520] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-17T19:24:21.323567] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-17T19:24:21.323801] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-17T19:24:21.323858] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-17T19:24:21.563210] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-17T19:24:21.682714] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:21.712391] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T19:24:22.109337] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T19:24:22.358108] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-17T19:24:23.158045] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-17T19:24:23.404956] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-17T19:24:23.958090] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-17T19:24:24.758024] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-17T19:24:24.837255] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T19:24:25.558061] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-17T19:24:25.822759] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T19:24:26.371868] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-17T19:24:26.374287] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T19:24:26.644612] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T19:24:27.158070] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-17T19:24:27.505116] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (5.15 seconds). [2025-10-17T19:24:27.849780] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T19:24:27.958001] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-17T19:24:28.694905] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T19:24:28.758023] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-17T19:24:29.558048] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-17T19:24:29.866811] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T19:24:30.358066] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-17T19:24:30.644947] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T19:24:30.909241] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:24:31.158025] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-17T19:24:31.921496] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T19:24:31.958073] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-17T19:24:32.758074] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-17T19:24:33.170757] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-17T19:24:33.558037] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-17T19:24:33.677328] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T19:24:34.076125] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T19:24:34.080924] [INFO ] [REMOTE ] HLLY: Full fetch complete (45979 records). [2025-10-17T19:24:34.081045] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-17T19:24:34.363151] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-17T19:24:34.477841] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-17T19:24:34.477922] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-17T19:24:34.478750] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-17T19:24:34.478812] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-17T19:24:34.480117] [DEBUG] [LOCAL ] HLLY: Trimmed 45979 records to 33825 (keeping 200 days of data) [2025-10-17T19:24:34.675510] [DEBUG] [LOCAL ] HLLY: Primary data saved (33825 records). [2025-10-17T19:24:34.675667] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-17T19:24:34.676172] [INFO ] [MAIN ] Update Progress: 1029/2368 symbols completed. HLLY took 29.0s. Estimated remaining: 3h 8m 3s. Rate: 7.1 symbols/min [2025-10-17T19:24:34.844148] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:34.888234] [DEBUG] [LOCAL ] HMC: Loaded 46822 existing records from primary storage. [2025-10-17T19:24:34.888559] [INFO ] [MAIN ] HMC: Loaded 46822 existing records. [2025-10-17T19:24:35.067807] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:24:35.068005] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-17T19:24:35.068051] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-17T19:24:35.068354] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-17T19:24:35.068435] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-17T19:24:35.167960] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-17T19:24:35.429208] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:35.458455] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-17T19:24:35.958013] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-17T19:24:36.125638] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T19:24:36.689124] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-17T19:24:36.758074] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-17T19:24:37.558013] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-17T19:24:37.686842] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T19:24:37.938992] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T19:24:38.358067] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-17T19:24:39.158073] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-17T19:24:39.325165] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T19:24:39.958011] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-17T19:24:40.368217] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T19:24:40.687121] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T19:24:40.758006] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-17T19:24:41.413251] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T19:24:41.558017] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-17T19:24:42.358013] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-17T19:24:42.559881] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T19:24:43.157993] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-17T19:24:43.347228] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T19:24:43.861596] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T19:24:43.958023] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-17T19:24:44.758000] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-17T19:24:45.010611] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T19:24:45.018181] [INFO ] [REMOTE ] HLN: Full fetch complete (77028 records). [2025-10-17T19:24:45.018340] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-17T19:24:45.419932] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-17T19:24:45.420158] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-17T19:24:45.421233] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-17T19:24:45.421310] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-17T19:24:45.422957] [DEBUG] [LOCAL ] HLN: Trimmed 77028 records to 53902 (keeping 200 days of data) [2025-10-17T19:24:45.560069] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T19:24:45.560625] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-17T19:24:45.811527] [DEBUG] [LOCAL ] HLN: Primary data saved (53902 records). [2025-10-17T19:24:45.811707] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-17T19:24:45.812448] [INFO ] [MAIN ] Update Progress: 1030/2368 symbols completed. HLN took 34.3s. Estimated remaining: 3h 7m 58s. Rate: 7.1 symbols/min [2025-10-17T19:24:45.983270] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:46.006885] [DEBUG] [LOCAL ] HMN: Loaded 23613 existing records from primary storage. [2025-10-17T19:24:46.007165] [INFO ] [MAIN ] HMN: Loaded 23613 existing records. [2025-10-17T19:24:46.196468] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:24:46.212044] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-17T19:24:46.212718] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-17T19:24:46.213849] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T19:24:46.223275] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-17T19:24:46.223785] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-17T19:24:46.365759] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-17T19:24:46.581464] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:47.158053] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-17T19:24:47.300211] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T19:24:47.958032] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-17T19:24:48.173639] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-17T19:24:48.275802] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T19:24:48.758050] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-17T19:24:49.558093] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-17T19:24:49.630700] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T19:24:50.281404] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T19:24:50.358071] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-17T19:24:51.158110] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-17T19:24:51.373673] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T19:24:51.583574] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-17T19:24:51.597871] [INFO ] [REMOTE ] HLT: Full fetch complete (73597 records). [2025-10-17T19:24:51.598051] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-17T19:24:51.963694] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-17T19:24:51.987789] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-17T19:24:51.987869] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-17T19:24:51.988840] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-17T19:24:51.988905] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-17T19:24:51.990301] [DEBUG] [LOCAL ] HLT: Trimmed 73597 records to 51246 (keeping 200 days of data) [2025-10-17T19:24:52.109803] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T19:24:52.119086] [INFO ] [REMOTE ] HLX: Full fetch complete (69055 records). [2025-10-17T19:24:52.125045] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-17T19:24:52.643309] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-17T19:24:52.643979] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-17T19:24:52.645213] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-17T19:24:52.645588] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-17T19:24:52.650279] [DEBUG] [LOCAL ] HLX: Trimmed 69055 records to 48172 (keeping 200 days of data) [2025-10-17T19:24:52.769272] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-17T19:24:52.996816] [DEBUG] [LOCAL ] HLX: Primary data saved (48172 records). [2025-10-17T19:24:53.000983] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-17T19:24:53.001413] [INFO ] [MAIN ] Update Progress: 1031/2368 symbols completed. HLX took 32.1s. Estimated remaining: 3h 7m 48s. Rate: 7.1 symbols/min [2025-10-17T19:24:53.107508] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T19:24:53.197958] [DEBUG] [LOCAL ] HLT: Primary data saved (51246 records). [2025-10-17T19:24:53.199451] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:53.199986] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-17T19:24:53.200785] [INFO ] [MAIN ] Update Progress: 1032/2368 symbols completed. HLT took 38.3s. Estimated remaining: 3h 7m 29s. Rate: 7.1 symbols/min [2025-10-17T19:24:53.411695] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:53.411931] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-17T19:24:53.411996] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-17T19:24:53.412114] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-17T19:24:53.412155] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-17T19:24:53.412196] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-17T19:24:53.412228] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-17T19:24:53.558811] [DEBUG] [LOCAL ] HMY: Loaded 53556 existing records from primary storage. [2025-10-17T19:24:53.558937] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-17T19:24:53.609274] [INFO ] [MAIN ] HMY: Loaded 53556 existing records. [2025-10-17T19:24:53.984236] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:24:53.991550] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:53.991991] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-17T19:24:53.992346] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-17T19:24:53.992582] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-17T19:24:53.992681] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-17T19:24:54.365723] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:54.359473] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-17T19:24:54.459136] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T19:24:54.706919] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:24:54.707221] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-17T19:24:54.707332] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:24:54.707390] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-17T19:24:54.707451] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:24:54.707524] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-17T19:24:54.707590] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-17T19:24:54.707627] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-17T19:24:54.707712] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-17T19:24:54.707781] [INFO ] [MAIN ] Update Progress: 1033/2368 symbols completed. HNGE took 1.5s. Estimated remaining: 3h 7m 12s. Rate: 7.1 symbols/min [2025-10-17T19:24:54.828021] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-17T19:24:54.896131] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:24:54.926158] [DEBUG] [LOCAL ] HNI: Loaded 29900 existing records from primary storage. [2025-10-17T19:24:54.926424] [INFO ] [MAIN ] HNI: Loaded 29900 existing records. [2025-10-17T19:24:55.100131] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:24:55.100338] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-17T19:24:55.100384] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-17T19:24:55.100579] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-17T19:24:55.100635] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-17T19:24:55.163160] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-17T19:24:55.444877] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:24:55.958017] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-17T19:24:56.204154] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T19:24:56.758039] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-17T19:24:57.525611] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T19:24:57.557995] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-17T19:24:57.874557] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T19:24:58.358045] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-17T19:24:59.158026] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-17T19:24:59.378060] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T19:24:59.627467] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T19:24:59.958033] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-17T19:25:00.013506] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-17T19:25:00.758041] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-17T19:25:01.465445] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T19:25:01.558041] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-17T19:25:02.358060] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-17T19:25:03.158066] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-17T19:25:03.447544] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-17T19:25:03.685394] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T19:25:03.958006] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-17T19:25:04.044512] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-17T19:25:04.284808] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T19:25:04.758082] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-17T19:25:05.558036] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-17T19:25:05.656259] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T19:25:06.095973] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T19:25:06.358057] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-17T19:25:06.494000] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-17T19:25:07.158009] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-17T19:25:07.405285] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T19:25:07.958121] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-17T19:25:08.758100] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-17T19:25:08.938002] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T19:25:08.945043] [INFO ] [REMOTE ] HMC: Full fetch complete (68851 records). [2025-10-17T19:25:08.945195] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-17T19:25:09.326517] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-17T19:25:09.326605] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-17T19:25:09.327631] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-17T19:25:09.327717] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-17T19:25:09.329135] [DEBUG] [LOCAL ] HMC: Trimmed 68851 records to 47137 (keeping 200 days of data) [2025-10-17T19:25:09.558020] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-17T19:25:09.606625] [DEBUG] [LOCAL ] HMC: Primary data saved (47137 records). [2025-10-17T19:25:09.606776] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-17T19:25:09.607279] [INFO ] [MAIN ] Update Progress: 1034/2368 symbols completed. HMC took 34.9s. Estimated remaining: 3h 7m 12s. Rate: 7.1 symbols/min [2025-10-17T19:25:09.777067] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:25:09.826229] [DEBUG] [LOCAL ] HOG: Loaded 51193 existing records from primary storage. [2025-10-17T19:25:09.826677] [INFO ] [MAIN ] HOG: Loaded 51193 existing records. [2025-10-17T19:25:10.031467] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-17T19:25:10.030038] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:25:10.037362] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-17T19:25:10.037621] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-17T19:25:10.038496] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-17T19:25:10.038563] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-17T19:25:10.179263] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-17T19:25:10.363125] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-17T19:25:10.475631] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:25:10.777011] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T19:25:11.158059] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-17T19:25:11.957991] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-17T19:25:12.368011] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T19:25:12.473825] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-17T19:25:12.758025] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-17T19:25:13.102729] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T19:25:13.105663] [INFO ] [REMOTE ] HMN: Full fetch complete (31606 records). [2025-10-17T19:25:13.105745] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-17T19:25:13.461848] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-17T19:25:13.461923] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-17T19:25:13.462544] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-17T19:25:13.462582] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-17T19:25:13.463337] [DEBUG] [LOCAL ] HMN: Trimmed 31606 records to 23749 (keeping 200 days of data) [2025-10-17T19:25:13.558587] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-17T19:25:13.608203] [DEBUG] [LOCAL ] HMN: Primary data saved (23749 records). [2025-10-17T19:25:13.608326] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-17T19:25:13.608402] [INFO ] [MAIN ] Update Progress: 1035/2368 symbols completed. HMN took 27.8s. Estimated remaining: 3h 6m 57s. Rate: 7.1 symbols/min [2025-10-17T19:25:13.777616] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:25:13.822933] [DEBUG] [LOCAL ] HOMB: Loaded 44016 existing records from primary storage. [2025-10-17T19:25:13.823256] [INFO ] [MAIN ] HOMB: Loaded 44016 existing records. [2025-10-17T19:25:14.012049] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:25:14.012349] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-17T19:25:14.012447] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-17T19:25:14.018049] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-17T19:25:14.024952] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-17T19:25:14.065816] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T19:25:14.363107] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-17T19:25:14.422794] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:25:15.157997] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-17T19:25:15.581977] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T19:25:15.958009] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-17T19:25:16.038354] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T19:25:16.683736] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T19:25:16.758038] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-17T19:25:17.558025] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-17T19:25:18.272248] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-17T19:25:18.318067] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T19:25:18.358032] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-17T19:25:19.158027] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-17T19:25:19.230237] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T19:25:19.382737] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T19:25:19.958036] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-17T19:25:20.758072] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-17T19:25:21.274628] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-17T19:25:21.568843] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-17T19:25:21.571833] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T19:25:22.358133] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-17T19:25:22.486443] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T19:25:23.158025] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-17T19:25:23.403994] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T19:25:23.670153] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-17T19:25:23.958039] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-17T19:25:24.758118] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-17T19:25:24.972721] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T19:25:25.558068] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-17T19:25:25.995263] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T19:25:26.358062] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-17T19:25:26.504221] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T19:25:26.703261] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T19:25:27.158067] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-17T19:25:27.958045] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-17T19:25:28.401802] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-17T19:25:28.553749] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-17T19:25:28.758066] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-17T19:25:29.390155] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T19:25:29.558033] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-17T19:25:30.358084] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-17T19:25:30.889043] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-17T19:25:30.915495] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T19:25:30.920485] [INFO ] [REMOTE ] HNI: Full fetch complete (42067 records). [2025-10-17T19:25:30.920633] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-17T19:25:31.168923] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-17T19:25:31.305335] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-17T19:25:31.305409] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-17T19:25:31.306123] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-17T19:25:31.306184] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-17T19:25:31.307226] [DEBUG] [LOCAL ] HNI: Trimmed 42067 records to 30085 (keeping 200 days of data) [2025-10-17T19:25:31.492069] [DEBUG] [LOCAL ] HNI: Primary data saved (30085 records). [2025-10-17T19:25:31.492191] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-17T19:25:31.492265] [INFO ] [MAIN ] Update Progress: 1036/2368 symbols completed. HNI took 36.8s. Estimated remaining: 3h 7m 1s. Rate: 7.1 symbols/min [2025-10-17T19:25:31.659729] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:25:31.699903] [DEBUG] [LOCAL ] HOUS: Loaded 45728 existing records from primary storage. [2025-10-17T19:25:31.700246] [INFO ] [MAIN ] HOUS: Loaded 45728 existing records. [2025-10-17T19:25:31.884853] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:25:31.885109] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-17T19:25:31.885224] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-17T19:25:31.885493] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-17T19:25:31.885588] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-17T19:25:31.959155] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-17T19:25:32.085036] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T19:25:32.292932] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:25:32.758132] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-17T19:25:33.388617] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-17T19:25:33.396265] [INFO ] [REMOTE ] HMY: Full fetch complete (77058 records). [2025-10-17T19:25:33.396432] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-17T19:25:33.579980] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-17T19:25:33.811411] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-17T19:25:33.811589] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-17T19:25:33.812722] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-17T19:25:33.812805] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-17T19:25:33.814526] [DEBUG] [LOCAL ] HMY: Trimmed 77058 records to 53946 (keeping 200 days of data) [2025-10-17T19:25:33.935667] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-17T19:25:34.186477] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T19:25:34.215775] [DEBUG] [LOCAL ] HMY: Primary data saved (53946 records). [2025-10-17T19:25:34.215904] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-17T19:25:34.215985] [INFO ] [MAIN ] Update Progress: 1037/2368 symbols completed. HMY took 41.2s. Estimated remaining: 3h 6m 45s. Rate: 7.1 symbols/min [2025-10-17T19:25:34.357994] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-17T19:25:35.102767] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T19:25:35.158064] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-17T19:25:35.958037] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-17T19:25:36.024549] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T19:25:36.524663] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T19:25:36.758035] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-17T19:25:37.067784] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T19:25:37.558084] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-17T19:25:38.226042] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T19:25:38.358085] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-17T19:25:38.963237] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T19:25:39.158077] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-17T19:25:39.958052] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-17T19:25:40.173372] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T19:25:40.726332] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T19:25:40.757987] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-17T19:25:41.498499] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T19:25:41.558007] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-17T19:25:42.357998] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-17T19:25:42.471126] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T19:25:42.477891] [INFO ] [REMOTE ] HOMB: Full fetch complete (64365 records). [2025-10-17T19:25:42.478037] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-17T19:25:42.886253] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-17T19:25:42.886365] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-17T19:25:42.887546] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-17T19:25:42.887629] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-17T19:25:42.898007] [DEBUG] [LOCAL ] HOMB: Trimmed 64365 records to 44387 (keeping 200 days of data) [2025-10-17T19:25:42.915424] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T19:25:43.158267] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-17T19:25:43.212043] [DEBUG] [LOCAL ] HOMB: Primary data saved (44387 records). [2025-10-17T19:25:43.212182] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-17T19:25:43.212829] [INFO ] [MAIN ] Update Progress: 1038/2368 symbols completed. HOMB took 29.6s. Estimated remaining: 3h 6m 38s. Rate: 7.1 symbols/min [2025-10-17T19:25:44.138890] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T19:25:44.153547] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-17T19:25:44.278875] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T19:25:44.758086] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-17T19:25:46.061437] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T19:25:46.078415] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-17T19:25:46.319003] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T19:25:46.357981] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-17T19:25:47.748370] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T19:25:47.755693] [INFO ] [REMOTE ] HOG: Full fetch complete (74284 records). [2025-10-17T19:25:47.755851] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-17T19:25:47.964739] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T19:25:48.064027] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-17T19:25:48.192687] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-17T19:25:48.192805] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-17T19:25:48.193897] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-17T19:25:48.193961] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-17T19:25:48.195376] [DEBUG] [LOCAL ] HOG: Trimmed 74284 records to 51493 (keeping 200 days of data) [2025-10-17T19:25:48.514625] [DEBUG] [LOCAL ] HOG: Primary data saved (51493 records). [2025-10-17T19:25:48.514777] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-17T19:25:48.514881] [INFO ] [MAIN ] Update Progress: 1039/2368 symbols completed. HOG took 38.9s. Estimated remaining: 3h 6m 25s. Rate: 7.1 symbols/min [2025-10-17T19:25:50.081926] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-17T19:25:50.091950] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-17T19:25:51.775478] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T19:25:51.785951] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-17T19:25:53.599389] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:25:53.607173] [INFO ] [REMOTE ] HOUS: Full fetch complete (64537 records). [2025-10-17T19:25:53.607288] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-17T19:25:53.995463] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-17T19:25:53.995578] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-17T19:25:53.996534] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-17T19:25:53.996598] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-17T19:25:53.998090] [DEBUG] [LOCAL ] HOUS: Trimmed 64537 records to 46109 (keeping 200 days of data) [2025-10-17T19:25:54.263792] [DEBUG] [LOCAL ] HOUS: Primary data saved (46109 records). [2025-10-17T19:25:54.263940] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-17T19:25:54.264042] [INFO ] [MAIN ] Update Progress: 1040/2368 symbols completed. HOUS took 22.8s. Estimated remaining: 3h 6m 14s. Rate: 7.1 symbols/min [2025-10-17T19:25:54.892376] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:25:55.016214] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:25:55.023215] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:25:55.022118] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:25:55.038717] [DEBUG] [LOCAL ] HOV: Loaded 14093 existing records from primary storage. [2025-10-17T19:25:55.039253] [INFO ] [MAIN ] HOV: Loaded 14093 existing records. [2025-10-17T19:25:55.090932] [DEBUG] [LOCAL ] HPF: Loaded 7539 existing records from primary storage. [2025-10-17T19:25:55.131371] [INFO ] [MAIN ] HPF: Loaded 7539 existing records. [2025-10-17T19:25:55.396768] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:25:55.397513] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-17T19:25:55.409254] [DEBUG] [LOCAL ] HP: Loaded 51892 existing records from primary storage. [2025-10-17T19:25:55.438050] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-17T19:25:55.470760] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-17T19:25:55.464904] [INFO ] [MAIN ] HP: Loaded 51892 existing records. [2025-10-17T19:25:55.494499] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:25:55.505286] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-17T19:25:55.472037] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-17T19:25:55.515229] [DEBUG] [LOCAL ] HPE: Loaded 54087 existing records from primary storage. [2025-10-17T19:25:55.525712] [INFO ] [MAIN ] HPE: Loaded 54087 existing records. [2025-10-17T19:25:55.525818] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-17T19:25:55.652809] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-17T19:25:55.706184] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-17T19:25:56.061572] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:25:56.145844] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:25:56.151313] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-17T19:25:56.170822] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-17T19:25:56.235415] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-17T19:25:56.235295] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-17T19:25:56.263274] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-17T19:25:56.291772] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-17T19:25:56.272381] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-17T19:25:56.367582] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-17T19:25:56.722876] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:25:56.723504] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-17T19:25:57.157801] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:25:57.215621] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-17T19:25:57.369143] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:25:57.374488] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-17T19:25:57.374241] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:25:57.374789] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-17T19:25:57.752606] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-17T19:25:57.756145] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-17T19:25:58.102963] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-17T19:25:58.105443] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-17T19:25:58.582050] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T19:25:58.585734] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-17T19:25:58.821494] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T19:25:58.822829] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T19:25:58.833593] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-17T19:25:58.837916] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-17T19:25:59.440289] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-17T19:25:59.443440] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-17T19:25:59.488050] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-17T19:25:59.504728] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-17T19:25:59.507577] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-17T19:25:59.518530] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-17T19:26:00.028048] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-17T19:26:00.030088] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-17T19:26:00.241575] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-17T19:26:00.244534] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-17T19:26:00.466611] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T19:26:00.758044] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-17T19:26:00.892085] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-17T19:26:01.373254] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T19:26:01.558059] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-17T19:26:01.926124] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-17T19:26:02.340192] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T19:26:02.358020] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-17T19:26:02.859139] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-17T19:26:03.158013] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-17T19:26:03.189930] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T19:26:03.924994] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-17T19:26:03.958034] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-17T19:26:04.758024] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-17T19:26:05.003735] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T19:26:05.558077] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-17T19:26:06.308804] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T19:26:06.358037] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-17T19:26:06.649808] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T19:26:07.079325] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-17T19:26:07.158024] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-17T19:26:07.958025] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-17T19:26:08.205326] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T19:26:08.758009] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-17T19:26:09.509976] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-17T19:26:09.558014] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-17T19:26:09.963882] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-17T19:26:10.351630] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T19:26:10.353204] [INFO ] [REMOTE ] HPF: Full fetch complete (10586 records). [2025-10-17T19:26:10.353285] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-17T19:26:10.364676] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-17T19:26:10.747777] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-17T19:26:10.747869] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-17T19:26:10.748183] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-17T19:26:10.748246] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-17T19:26:10.748772] [DEBUG] [LOCAL ] HPF: Trimmed 10586 records to 7566 (keeping 200 days of data) [2025-10-17T19:26:10.796133] [DEBUG] [LOCAL ] HPF: Primary data saved (7566 records). [2025-10-17T19:26:10.796276] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-17T19:26:10.796385] [INFO ] [MAIN ] Update Progress: 1041/2368 symbols completed. HPF took 16.5s. Estimated remaining: 3h 6m 15s. Rate: 7.1 symbols/min [2025-10-17T19:26:10.971416] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:26:10.984131] [DEBUG] [LOCAL ] HPI: Loaded 10730 existing records from primary storage. [2025-10-17T19:26:10.984334] [INFO ] [MAIN ] HPI: Loaded 10730 existing records. [2025-10-17T19:26:11.169629] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-17T19:26:11.177566] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:26:11.177953] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-17T19:26:11.178065] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-17T19:26:11.178286] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-17T19:26:11.178328] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-17T19:26:11.563874] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:26:11.958065] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-17T19:26:12.126357] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T19:26:12.205582] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T19:26:12.758079] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-17T19:26:13.558048] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-17T19:26:13.681293] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T19:26:13.876292] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T19:26:14.358027] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-17T19:26:14.985752] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T19:26:15.158036] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-17T19:26:15.266523] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-17T19:26:15.269715] [INFO ] [REMOTE ] HOV: Full fetch complete (19066 records). [2025-10-17T19:26:15.269868] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-17T19:26:15.696183] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-17T19:26:15.696284] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-17T19:26:15.696903] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-17T19:26:15.696981] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-17T19:26:15.698016] [DEBUG] [LOCAL ] HOV: Trimmed 19066 records to 14171 (keeping 200 days of data) [2025-10-17T19:26:15.802934] [DEBUG] [LOCAL ] HOV: Primary data saved (14171 records). [2025-10-17T19:26:15.803114] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-17T19:26:15.803235] [INFO ] [MAIN ] Update Progress: 1042/2368 symbols completed. HOV took 21.5s. Estimated remaining: 3h 6m 3s. Rate: 7.1 symbols/min [2025-10-17T19:26:15.965821] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-17T19:26:16.011079] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:26:16.084529] [DEBUG] [LOCAL ] HPP: Loaded 51562 existing records from primary storage. [2025-10-17T19:26:16.085226] [INFO ] [MAIN ] HPP: Loaded 51562 existing records. [2025-10-17T19:26:16.335847] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:26:16.336106] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-17T19:26:16.336166] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-17T19:26:16.336438] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-17T19:26:16.336504] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-17T19:26:16.759270] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-17T19:26:16.784424] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:26:17.120001] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T19:26:17.555255] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-17T19:26:17.558132] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-17T19:26:18.005155] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-17T19:26:18.348342] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T19:26:18.358031] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-17T19:26:18.965114] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-17T19:26:19.158063] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-17T19:26:19.944909] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T19:26:19.957979] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-17T19:26:20.758306] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-17T19:26:20.768560] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T19:26:21.558034] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-17T19:26:22.368119] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-17T19:26:22.390974] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T19:26:22.425248] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-17T19:26:23.158084] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-17T19:26:23.958019] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-17T19:26:24.009925] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T19:26:24.758011] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-17T19:26:25.105418] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-17T19:26:25.559239] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-17T19:26:25.561773] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T19:26:25.603484] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T19:26:26.358059] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-17T19:26:27.158016] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-17T19:26:27.334895] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T19:26:27.944067] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T19:26:27.957985] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-17T19:26:28.758070] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-17T19:26:28.889186] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T19:26:29.163328] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T19:26:29.558043] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-17T19:26:30.358095] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-17T19:26:30.580093] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T19:26:31.142330] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-17T19:26:31.158032] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-17T19:26:31.221812] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T19:26:31.958089] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-17T19:26:31.968560] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-17T19:26:32.758085] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-17T19:26:33.558075] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-17T19:26:34.098266] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-17T19:26:34.358015] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-17T19:26:34.586899] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-17T19:26:34.619921] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-17T19:26:35.158094] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-17T19:26:35.959510] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-17T19:26:35.966855] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T19:26:36.047232] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T19:26:36.049177] [INFO ] [REMOTE ] HPI: Full fetch complete (13931 records). [2025-10-17T19:26:36.049329] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-17T19:26:36.403916] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-17T19:26:36.403986] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-17T19:26:36.404288] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-17T19:26:36.404325] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-17T19:26:36.404821] [DEBUG] [LOCAL ] HPI: Trimmed 13931 records to 10785 (keeping 200 days of data) [2025-10-17T19:26:36.470473] [DEBUG] [LOCAL ] HPI: Primary data saved (10785 records). [2025-10-17T19:26:36.470608] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-17T19:26:36.470719] [INFO ] [MAIN ] Update Progress: 1043/2368 symbols completed. HPI took 25.7s. Estimated remaining: 3h 6m 10s. Rate: 7.1 symbols/min [2025-10-17T19:26:36.637256] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:26:36.685522] [DEBUG] [LOCAL ] HPQ: Loaded 54059 existing records from primary storage. [2025-10-17T19:26:36.685901] [INFO ] [MAIN ] HPQ: Loaded 54059 existing records. [2025-10-17T19:26:36.763178] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-17T19:26:36.864568] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:26:36.864827] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-17T19:26:36.864892] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-17T19:26:36.865118] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-17T19:26:36.865177] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-17T19:26:37.207809] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:26:37.557985] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-17T19:26:38.135773] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-17T19:26:38.143118] [INFO ] [REMOTE ] HPE: Full fetch complete (77875 records). [2025-10-17T19:26:38.143229] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-17T19:26:38.363172] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-17T19:26:38.538369] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T19:26:38.590873] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-17T19:26:38.591064] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-17T19:26:38.592078] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-17T19:26:38.592164] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-17T19:26:38.593879] [DEBUG] [LOCAL ] HPE: Trimmed 77875 records to 54477 (keeping 200 days of data) [2025-10-17T19:26:38.951844] [DEBUG] [LOCAL ] HPE: Primary data saved (54477 records). [2025-10-17T19:26:38.952137] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-17T19:26:38.952242] [INFO ] [MAIN ] Update Progress: 1044/2368 symbols completed. HPE took 44.7s. Estimated remaining: 3h 5m 54s. Rate: 7.1 symbols/min [2025-10-17T19:26:39.127330] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:26:39.158601] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T19:26:39.158880] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-17T19:26:39.179383] [DEBUG] [LOCAL ] HPS: Loaded 10382 existing records from primary storage. [2025-10-17T19:26:39.179606] [INFO ] [MAIN ] HPS: Loaded 10382 existing records. [2025-10-17T19:26:39.355836] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:26:39.356049] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-17T19:26:39.356097] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-17T19:26:39.356249] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-17T19:26:39.356288] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-17T19:26:39.708532] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:26:39.958026] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-17T19:26:40.120449] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T19:26:40.130927] [INFO ] [REMOTE ] HP: Full fetch complete (74076 records). [2025-10-17T19:26:40.131113] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-17T19:26:40.581603] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-17T19:26:40.581800] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-17T19:26:40.583263] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-17T19:26:40.583366] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-17T19:26:40.585393] [DEBUG] [LOCAL ] HP: Trimmed 74076 records to 52245 (keeping 200 days of data) [2025-10-17T19:26:40.788389] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-17T19:26:40.873874] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T19:26:40.973862] [DEBUG] [LOCAL ] HP: Primary data saved (52245 records). [2025-10-17T19:26:40.974048] [INFO ] [MAIN ] HP: Full history saved. [2025-10-17T19:26:40.974139] [INFO ] [MAIN ] Update Progress: 1045/2368 symbols completed. HP took 46.7s. Estimated remaining: 3h 5m 37s. Rate: 7.1 symbols/min [2025-10-17T19:26:41.140298] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:26:41.167544] [DEBUG] [LOCAL ] HQH: Loaded 26023 existing records from primary storage. [2025-10-17T19:26:41.167836] [INFO ] [MAIN ] HQH: Loaded 26023 existing records. [2025-10-17T19:26:41.345993] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:26:41.346251] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-17T19:26:41.346300] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-17T19:26:41.346480] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-17T19:26:41.346519] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-17T19:26:41.569085] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-17T19:26:41.671103] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-17T19:26:41.730498] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:26:41.827481] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T19:26:42.358075] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-17T19:26:43.158041] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-17T19:26:43.417182] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T19:26:43.958192] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-17T19:26:44.204917] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T19:26:44.262233] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T19:26:44.727408] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T19:26:44.758059] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-17T19:26:45.558040] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-17T19:26:46.358004] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-17T19:26:46.612196] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T19:26:46.661340] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T19:26:47.158025] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-17T19:26:47.237939] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T19:26:47.958019] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-17T19:26:48.237861] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T19:26:48.758095] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-17T19:26:49.558013] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-17T19:26:49.695291] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T19:26:49.802299] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T19:26:50.323545] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-17T19:26:50.358018] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-17T19:26:51.094172] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-17T19:26:51.158029] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-17T19:26:51.895338] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T19:26:51.958115] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-17T19:26:52.757998] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-17T19:26:53.156100] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T19:26:53.558098] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-17T19:26:54.358100] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-17T19:26:54.384254] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T19:26:54.764352] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-17T19:26:55.158101] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-17T19:26:55.530832] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T19:26:55.958035] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-17T19:26:56.758019] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-17T19:26:56.895300] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T19:26:57.557997] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-17T19:26:57.887866] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T19:26:57.912730] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T19:26:58.358003] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-17T19:26:58.464751] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T19:26:59.158140] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-17T19:26:59.958012] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-17T19:27:00.141787] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T19:27:00.758020] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-17T19:27:01.261141] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-17T19:27:01.491863] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-17T19:27:01.500539] [INFO ] [REMOTE ] HPP: Full fetch complete (73416 records). [2025-10-17T19:27:01.501166] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-17T19:27:01.568845] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-17T19:27:01.929760] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-17T19:27:01.929858] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-17T19:27:01.930848] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-17T19:27:01.930921] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-17T19:27:01.932424] [DEBUG] [LOCAL ] HPP: Trimmed 73416 records to 51937 (keeping 200 days of data) [2025-10-17T19:27:02.242031] [DEBUG] [LOCAL ] HPP: Primary data saved (51937 records). [2025-10-17T19:27:02.242217] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-17T19:27:02.242330] [INFO ] [MAIN ] Update Progress: 1046/2368 symbols completed. HPP took 46.4s. Estimated remaining: 3h 5m 45s. Rate: 7.1 symbols/min [2025-10-17T19:27:02.363171] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-17T19:27:02.418718] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:27:02.436499] [DEBUG] [LOCAL ] HQL: Loaded 17085 existing records from primary storage. [2025-10-17T19:27:02.436790] [INFO ] [MAIN ] HQL: Loaded 17085 existing records. [2025-10-17T19:27:02.526317] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T19:27:02.628093] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:27:02.628275] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-17T19:27:02.628342] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-17T19:27:02.628537] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-17T19:27:02.628593] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-17T19:27:02.979089] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:27:03.010756] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-17T19:27:03.157994] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-17T19:27:03.523446] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T19:27:03.958022] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-17T19:27:04.758003] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-17T19:27:05.140867] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T19:27:05.216301] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-17T19:27:05.534756] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-17T19:27:05.557989] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-17T19:27:06.358008] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-17T19:27:06.832747] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T19:27:06.837026] [INFO ] [REMOTE ] HQH: Full fetch complete (37212 records). [2025-10-17T19:27:06.837105] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-17T19:27:07.163106] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-17T19:27:07.204163] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-17T19:27:07.204245] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-17T19:27:07.205008] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-17T19:27:07.205071] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-17T19:27:07.205979] [DEBUG] [LOCAL ] HQH: Trimmed 37212 records to 26187 (keeping 200 days of data) [2025-10-17T19:27:07.358130] [DEBUG] [LOCAL ] HQH: Primary data saved (26187 records). [2025-10-17T19:27:07.358255] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-17T19:27:07.358336] [INFO ] [MAIN ] Update Progress: 1047/2368 symbols completed. HQH took 26.4s. Estimated remaining: 3h 5m 33s. Rate: 7.1 symbols/min [2025-10-17T19:27:07.524587] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:27:07.574778] [DEBUG] [LOCAL ] HR: Loaded 52488 existing records from primary storage. [2025-10-17T19:27:07.575086] [INFO ] [MAIN ] HR: Loaded 52488 existing records. [2025-10-17T19:27:07.746510] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:27:07.746739] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-17T19:27:07.746791] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-17T19:27:07.746967] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-17T19:27:07.747004] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-17T19:27:07.982388] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-17T19:27:08.101630] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:27:08.175603] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T19:27:08.177815] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T19:27:08.190712] [INFO ] [REMOTE ] HPS: Full fetch complete (15140 records). [2025-10-17T19:27:08.191117] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-17T19:27:08.601633] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-17T19:27:08.601783] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-17T19:27:08.602341] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-17T19:27:08.602418] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-17T19:27:08.603439] [DEBUG] [LOCAL ] HPS: Trimmed 15140 records to 10447 (keeping 200 days of data) [2025-10-17T19:27:08.701741] [DEBUG] [LOCAL ] HPS: Primary data saved (10447 records). [2025-10-17T19:27:08.701947] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-17T19:27:08.702078] [INFO ] [MAIN ] Update Progress: 1048/2368 symbols completed. HPS took 29.7s. Estimated remaining: 3h 5m 15s. Rate: 7.1 symbols/min [2025-10-17T19:27:08.763540] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-17T19:27:08.988076] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:27:09.044625] [DEBUG] [LOCAL ] HRB: Loaded 48745 existing records from primary storage. [2025-10-17T19:27:09.057434] [INFO ] [MAIN ] HRB: Loaded 48745 existing records. [2025-10-17T19:27:09.093009] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T19:27:09.268988] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:27:09.269270] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-17T19:27:09.269341] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-17T19:27:09.269595] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-17T19:27:09.269710] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-17T19:27:09.563765] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-17T19:27:09.647918] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:27:10.358019] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-17T19:27:10.494788] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T19:27:10.503038] [INFO ] [REMOTE ] HPQ: Full fetch complete (77842 records). [2025-10-17T19:27:10.503272] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-17T19:27:10.961318] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-17T19:27:10.961718] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-17T19:27:10.967878] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-17T19:27:10.963830] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-17T19:27:10.979213] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-17T19:27:10.981192] [DEBUG] [LOCAL ] HPQ: Trimmed 77842 records to 54449 (keeping 200 days of data) [2025-10-17T19:27:11.170553] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-17T19:27:11.358059] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-17T19:27:11.386170] [DEBUG] [LOCAL ] HPQ: Primary data saved (54449 records). [2025-10-17T19:27:11.386385] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-17T19:27:11.386494] [INFO ] [MAIN ] Update Progress: 1049/2368 symbols completed. HPQ took 34.9s. Estimated remaining: 3h 4m 60s. Rate: 7.1 symbols/min [2025-10-17T19:27:11.570265] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:27:11.609713] [DEBUG] [LOCAL ] HRI: Loaded 32632 existing records from primary storage. [2025-10-17T19:27:11.610166] [INFO ] [MAIN ] HRI: Loaded 32632 existing records. [2025-10-17T19:27:11.823282] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:27:11.823709] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-17T19:27:11.823772] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-17T19:27:11.823989] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-17T19:27:11.824029] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-17T19:27:11.968709] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-17T19:27:12.196982] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:27:12.691274] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T19:27:12.757994] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-17T19:27:13.558043] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-17T19:27:13.610224] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T19:27:14.365926] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-17T19:27:14.370907] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T19:27:14.704919] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T19:27:15.158034] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-17T19:27:15.958035] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-17T19:27:15.996513] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T19:27:16.524358] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T19:27:16.758071] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-17T19:27:17.558070] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-17T19:27:17.627764] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T19:27:17.688614] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T19:27:18.358005] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-17T19:27:18.959146] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T19:27:19.158014] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-17T19:27:19.375131] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T19:27:19.958066] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-17T19:27:20.770318] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-17T19:27:20.795074] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T19:27:21.163396] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T19:27:21.558033] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-17T19:27:21.775822] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T19:27:22.358095] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-17T19:27:23.158115] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-17T19:27:23.293379] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T19:27:23.958034] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-17T19:27:24.032935] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T19:27:24.731177] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T19:27:24.758066] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-17T19:27:25.558096] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-17T19:27:25.648780] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T19:27:26.222823] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T19:27:26.358049] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-17T19:27:27.158098] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-17T19:27:27.273371] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T19:27:27.786112] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T19:27:27.958050] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-17T19:27:28.263968] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T19:27:28.758073] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-17T19:27:29.310627] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-17T19:27:29.386601] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T19:27:29.558021] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-17T19:27:30.358027] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-17T19:27:31.158064] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-17T19:27:31.200386] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T19:27:31.947295] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T19:27:31.957984] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-17T19:27:32.581128] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T19:27:32.758121] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-17T19:27:33.558018] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-17T19:27:33.697875] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T19:27:34.358011] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-17T19:27:34.542201] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T19:27:34.898857] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-17T19:27:35.158008] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-17T19:27:35.475487] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T19:27:35.958061] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-17T19:27:36.452124] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T19:27:36.758047] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-17T19:27:37.558039] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-17T19:27:37.630178] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T19:27:37.675076] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T19:27:38.358043] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-17T19:27:38.859496] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T19:27:38.864020] [INFO ] [REMOTE ] HRI: Full fetch complete (46578 records). [2025-10-17T19:27:38.864178] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-17T19:27:39.163123] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-17T19:27:39.262925] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-17T19:27:39.263002] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-17T19:27:39.263777] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-17T19:27:39.263840] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-17T19:27:39.264943] [DEBUG] [LOCAL ] HRI: Trimmed 46578 records to 32839 (keeping 200 days of data) [2025-10-17T19:27:39.472304] [DEBUG] [LOCAL ] HRI: Primary data saved (32839 records). [2025-10-17T19:27:39.472425] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-17T19:27:39.473129] [INFO ] [MAIN ] Update Progress: 1050/2368 symbols completed. HRI took 28.1s. Estimated remaining: 3h 5m 16s. Rate: 7.1 symbols/min [2025-10-17T19:27:39.639071] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:27:39.691360] [DEBUG] [LOCAL ] HRL: Loaded 53516 existing records from primary storage. [2025-10-17T19:27:39.691711] [INFO ] [MAIN ] HRL: Loaded 53516 existing records. [2025-10-17T19:27:39.877123] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:27:39.877877] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-17T19:27:39.877963] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-17T19:27:39.878951] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-17T19:27:39.879026] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-17T19:27:39.966755] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-17T19:27:40.270489] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:27:40.282430] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T19:27:40.321219] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T19:27:40.758043] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-17T19:27:41.558013] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-17T19:27:41.724501] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T19:27:42.358017] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-17T19:27:42.459639] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T19:27:43.049045] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-17T19:27:43.158079] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-17T19:27:43.958081] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-17T19:27:44.066507] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T19:27:44.073065] [INFO ] [REMOTE ] HRB: Full fetch complete (70084 records). [2025-10-17T19:27:44.073177] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-17T19:27:44.464043] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-17T19:27:44.464124] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-17T19:27:44.465073] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-17T19:27:44.465161] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-17T19:27:44.466503] [DEBUG] [LOCAL ] HRB: Trimmed 70084 records to 49064 (keeping 200 days of data) [2025-10-17T19:27:44.760870] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-17T19:27:44.767463] [DEBUG] [LOCAL ] HRB: Primary data saved (49064 records). [2025-10-17T19:27:44.767679] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-17T19:27:44.767794] [INFO ] [MAIN ] Update Progress: 1051/2368 symbols completed. HRB took 36.1s. Estimated remaining: 3h 5m 3s. Rate: 7.1 symbols/min [2025-10-17T19:27:44.949520] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:27:44.971471] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:27:44.979965] [INFO ] [REMOTE ] HR: Full fetch complete (75065 records). [2025-10-17T19:27:44.980244] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-17T19:27:45.181255] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T19:27:45.290563] [INFO ] [REMOTE ] HQL: Full fetch complete (25289 records). [2025-10-17T19:27:45.312086] [DEBUG] [LOCAL ] HRTG: Loaded 34673 existing records from primary storage. [2025-10-17T19:27:45.317373] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-17T19:27:45.340197] [INFO ] [MAIN ] HRTG: Loaded 34673 existing records. [2025-10-17T19:27:45.663575] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-17T19:27:45.677865] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-17T19:27:45.679901] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-17T19:27:45.721613] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-17T19:27:45.804736] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:27:45.836408] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-17T19:27:45.890244] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-17T19:27:45.939403] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-17T19:27:45.939756] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-17T19:27:45.947389] [DEBUG] [LOCAL ] HR: Trimmed 75065 records to 52870 (keeping 200 days of data) [2025-10-17T19:27:46.233894] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-17T19:27:46.235465] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-17T19:27:46.246812] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-17T19:27:46.252482] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-17T19:27:46.310835] [DEBUG] [LOCAL ] HQL: Trimmed 25289 records to 17218 (keeping 200 days of data) [2025-10-17T19:27:46.806706] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:27:46.800543] [DEBUG] [LOCAL ] HQL: Primary data saved (17218 records). [2025-10-17T19:27:46.824794] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-17T19:27:46.825085] [INFO ] [MAIN ] Update Progress: 1052/2368 symbols completed. HQL took 44.6s. Estimated remaining: 3h 4m 47s. Rate: 7.1 symbols/min [2025-10-17T19:27:46.838685] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-17T19:27:46.854790] [DEBUG] [LOCAL ] HR: Primary data saved (52870 records). [2025-10-17T19:27:46.855119] [INFO ] [MAIN ] HR: Full history saved. [2025-10-17T19:27:46.855909] [INFO ] [MAIN ] Update Progress: 1053/2368 symbols completed. HR took 39.5s. Estimated remaining: 3h 4m 28s. Rate: 7.1 symbols/min [2025-10-17T19:27:47.184987] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:27:47.205912] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:27:47.242690] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-17T19:27:47.253859] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-17T19:27:47.260196] [DEBUG] [LOCAL ] HSHP: Loaded 14969 existing records from primary storage. [2025-10-17T19:27:47.260387] [INFO ] [MAIN ] HSHP: Loaded 14969 existing records. [2025-10-17T19:27:47.468969] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:27:47.470672] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-17T19:27:47.470735] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-17T19:27:47.471802] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-17T19:27:47.471889] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-17T19:27:47.471731] [DEBUG] [LOCAL ] HSBC: Loaded 51390 existing records from primary storage. [2025-10-17T19:27:47.534581] [INFO ] [MAIN ] HSBC: Loaded 51390 existing records. [2025-10-17T19:27:47.910103] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:27:47.959414] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-17T19:27:47.970613] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-17T19:27:47.971066] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-17T19:27:47.986749] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-17T19:27:48.103410] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:27:48.154961] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-17T19:27:48.179988] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-17T19:27:48.195818] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-17T19:27:48.438225] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:27:48.758010] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-17T19:27:48.996151] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T19:27:49.157478] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T19:27:49.258233] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T19:27:49.558048] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-17T19:27:50.358077] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-17T19:27:50.484738] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T19:27:50.536368] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T19:27:51.158062] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-17T19:27:51.260771] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T19:27:51.958006] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-17T19:27:52.221684] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T19:27:52.758075] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-17T19:27:53.221732] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T19:27:53.558007] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-17T19:27:53.705973] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T19:27:54.358054] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-17T19:27:54.966796] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-17T19:27:55.158037] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-17T19:27:55.653958] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T19:27:55.958089] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-17T19:27:56.758106] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-17T19:27:57.090812] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T19:27:57.558010] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-17T19:27:57.692554] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T19:27:58.117460] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T19:27:58.358067] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-17T19:27:59.158010] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-17T19:27:59.307865] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T19:27:59.358504] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T19:27:59.958071] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-17T19:28:00.249859] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T19:28:00.758035] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-17T19:28:00.997870] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T19:28:01.558172] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-17T19:28:02.358072] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-17T19:28:03.158079] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-17T19:28:03.360980] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T19:28:03.515286] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-10-17T19:28:03.563109] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-17T19:28:03.958041] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-17T19:28:04.758045] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-17T19:28:05.033264] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-17T19:28:05.337901] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T19:28:05.558014] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-17T19:28:05.700952] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-17T19:28:06.358035] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-17T19:28:06.899395] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T19:28:07.153698] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T19:28:07.157971] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-17T19:28:07.958015] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-17T19:28:08.163853] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T19:28:08.758052] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-17T19:28:09.558000] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-17T19:28:09.743420] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T19:28:09.745681] [INFO ] [REMOTE ] HSHP: Full fetch complete (23278 records). [2025-10-17T19:28:09.745853] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-17T19:28:10.180334] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-17T19:28:10.183253] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-17T19:28:10.183791] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-17T19:28:10.184018] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-17T19:28:10.185874] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-17T19:28:10.197104] [DEBUG] [LOCAL ] HSHP: Trimmed 23278 records to 15028 (keeping 200 days of data) [2025-10-17T19:28:10.288743] [DEBUG] [LOCAL ] HSHP: Primary data saved (15028 records). [2025-10-17T19:28:10.288939] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-17T19:28:10.289082] [INFO ] [MAIN ] Update Progress: 1054/2368 symbols completed. HSHP took 23.4s. Estimated remaining: 3h 4m 38s. Rate: 7.1 symbols/min [2025-10-17T19:28:10.363131] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-17T19:28:10.461036] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:28:10.511100] [DEBUG] [LOCAL ] HSY: Loaded 50818 existing records from primary storage. [2025-10-17T19:28:10.511399] [INFO ] [MAIN ] HSY: Loaded 50818 existing records. [2025-10-17T19:28:10.685754] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:28:10.686018] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-17T19:28:10.686071] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-17T19:28:10.686335] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-17T19:28:10.686374] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-17T19:28:11.057508] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:28:11.063543] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T19:28:11.069049] [INFO ] [REMOTE ] HRTG: Full fetch complete (44213 records). [2025-10-17T19:28:11.069132] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-17T19:28:11.166271] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-17T19:28:11.439826] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-17T19:28:11.439902] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-17T19:28:11.440676] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-17T19:28:11.440738] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-17T19:28:11.441664] [DEBUG] [LOCAL ] HRTG: Trimmed 44213 records to 34930 (keeping 200 days of data) [2025-10-17T19:28:11.641800] [DEBUG] [LOCAL ] HRTG: Primary data saved (34930 records). [2025-10-17T19:28:11.641938] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-17T19:28:11.642020] [INFO ] [MAIN ] Update Progress: 1055/2368 symbols completed. HRTG took 26.9s. Estimated remaining: 3h 4m 21s. Rate: 7.1 symbols/min [2025-10-17T19:28:11.808591] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:28:11.808770] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-17T19:28:11.808813] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-17T19:28:11.808923] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-17T19:28:11.808980] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-17T19:28:11.809051] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-17T19:28:11.809097] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-17T19:28:11.965723] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-17T19:28:12.176943] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:28:12.275130] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T19:28:12.758003] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-17T19:28:12.865412] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T19:28:13.558018] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-17T19:28:13.940021] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T19:28:14.173865] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T19:28:14.358041] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-17T19:28:15.158021] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-17T19:28:15.270090] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T19:28:15.958024] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-17T19:28:16.197178] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-17T19:28:16.727274] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T19:28:16.757995] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-17T19:28:17.558031] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-17T19:28:17.759382] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:28:17.759729] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-17T19:28:17.759829] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:28:17.759875] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-17T19:28:17.759933] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:28:17.760001] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-17T19:28:17.760080] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-17T19:28:17.760134] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-17T19:28:17.760178] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-17T19:28:17.760223] [INFO ] [MAIN ] Update Progress: 1056/2368 symbols completed. HTB took 6.1s. Estimated remaining: 3h 4m 10s. Rate: 7.1 symbols/min [2025-10-17T19:28:17.937860] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:28:17.974431] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-17T19:28:17.997130] [DEBUG] [LOCAL ] HTD: Loaded 14244 existing records from primary storage. [2025-10-17T19:28:17.997416] [INFO ] [MAIN ] HTD: Loaded 14244 existing records. [2025-10-17T19:28:18.172722] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:28:18.172922] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-17T19:28:18.172969] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-17T19:28:18.173225] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-17T19:28:18.173281] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-17T19:28:18.363142] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-17T19:28:18.544471] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:28:18.601429] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T19:28:19.158146] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-17T19:28:19.958112] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-17T19:28:20.253718] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T19:28:20.758099] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-17T19:28:21.074494] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T19:28:21.558055] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-17T19:28:21.795864] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T19:28:22.047248] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-17T19:28:22.358056] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-17T19:28:22.765112] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-17T19:28:23.140365] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T19:28:23.158010] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-17T19:28:23.913373] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T19:28:23.958061] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-17T19:28:24.758002] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-17T19:28:24.884186] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-17T19:28:25.558049] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-17T19:28:26.358049] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-17T19:28:26.730259] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-17T19:28:26.740564] [INFO ] [REMOTE ] HSBC: Full fetch complete (74144 records). [2025-10-17T19:28:26.740776] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-17T19:28:27.149169] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-17T19:28:27.149270] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-17T19:28:27.150368] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-17T19:28:27.150437] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-17T19:28:27.151980] [DEBUG] [LOCAL ] HSBC: Trimmed 74144 records to 51777 (keeping 200 days of data) [2025-10-17T19:28:27.203830] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-17T19:28:27.468569] [DEBUG] [LOCAL ] HSBC: Primary data saved (51777 records). [2025-10-17T19:28:27.468738] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-17T19:28:27.468827] [INFO ] [MAIN ] Update Progress: 1057/2368 symbols completed. HSBC took 40.6s. Estimated remaining: 3h 4m 3s. Rate: 7.1 symbols/min [2025-10-17T19:28:27.639356] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:28:27.639690] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-17T19:28:27.639876] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-17T19:28:27.640019] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-17T19:28:27.640247] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-17T19:28:27.640407] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-17T19:28:27.640622] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-17T19:28:27.769920] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-17T19:28:27.822795] [INFO ] [REMOTE ] HRL: Full fetch complete (76987 records). [2025-10-17T19:28:27.832692] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-17T19:28:28.161297] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:28:28.182614] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-17T19:28:28.427295] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T19:28:28.479318] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-17T19:28:28.480212] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-17T19:28:28.481666] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-17T19:28:28.481734] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-17T19:28:28.483671] [DEBUG] [LOCAL ] HRL: Trimmed 76987 records to 53904 (keeping 200 days of data) [2025-10-17T19:28:28.514316] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-17T19:28:28.615055] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-17T19:28:28.758126] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-17T19:28:28.876512] [DEBUG] [LOCAL ] HRL: Primary data saved (53904 records). [2025-10-17T19:28:28.876736] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-17T19:28:28.876854] [INFO ] [MAIN ] Update Progress: 1058/2368 symbols completed. HRL took 49.4s. Estimated remaining: 3h 3m 46s. Rate: 7.1 symbols/min [2025-10-17T19:28:29.052556] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:28:29.091271] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-17T19:28:29.114183] [DEBUG] [LOCAL ] HTGC: Loaded 48100 existing records from primary storage. [2025-10-17T19:28:29.114601] [INFO ] [MAIN ] HTGC: Loaded 48100 existing records. [2025-10-17T19:28:29.292350] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:28:29.292608] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-17T19:28:29.292701] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-17T19:28:29.292929] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-17T19:28:29.292995] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-17T19:28:29.563167] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-17T19:28:29.648509] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:28:30.358011] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-17T19:28:31.158024] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-17T19:28:31.222980] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-17T19:28:31.273885] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T19:28:31.433971] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-17T19:28:31.958032] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-17T19:28:32.758054] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-17T19:28:33.410402] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T19:28:33.426867] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T19:28:33.557999] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-17T19:28:34.358093] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-17T19:28:35.053985] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T19:28:35.158057] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-17T19:28:35.259608] [DEBUG] [REMOTE ] HTGC: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-17T19:28:35.259995] [WARN ] [REMOTE ] HTGC: No data returned for month 2025-02 [2025-10-17T19:28:35.260085] [FATAL] [REMOTE ] HTGC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:28:35.260163] [FATAL] [MAIN ] HTGC: Failed to fetch primary data. [2025-10-17T19:28:35.260200] [WARN ] [MAIN ] HTGC: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:28:35.260275] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-17T19:28:35.260387] [DEBUG] [LOCAL ] HTGC: No primary data file found to delete. [2025-10-17T19:28:35.260428] [INFO ] [LOCAL ] HTGC: Starting deletion of derivative data. [2025-10-17T19:28:35.260594] [DEBUG] [LOCAL ] HTGC: Deleted derivative data file. [2025-10-17T19:28:35.260704] [INFO ] [MAIN ] Update Progress: 1059/2368 symbols completed. HTGC took 6.4s. Estimated remaining: 3h 3m 35s. Rate: 7.1 symbols/min [2025-10-17T19:28:35.435446] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:28:35.466476] [DEBUG] [LOCAL ] HTH: Loaded 32799 existing records from primary storage. [2025-10-17T19:28:35.466806] [INFO ] [MAIN ] HTH: Loaded 32799 existing records. [2025-10-17T19:28:35.662072] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:28:35.662396] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-17T19:28:35.662555] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-17T19:28:35.662792] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-17T19:28:35.662848] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-17T19:28:35.962125] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-17T19:28:36.014883] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:28:36.041886] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T19:28:36.758108] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-17T19:28:36.943104] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-17T19:28:37.121869] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-17T19:28:37.558037] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-17T19:28:38.358025] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-17T19:28:39.124857] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T19:28:39.158044] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-17T19:28:39.427625] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-17T19:28:39.958047] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-17T19:28:40.143235] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T19:28:40.386437] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-17T19:28:40.758060] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-17T19:28:41.558068] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-17T19:28:41.840631] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T19:28:42.358040] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-17T19:28:42.672690] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-17T19:28:43.107529] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T19:28:43.158031] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-17T19:28:43.958033] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-17T19:28:44.758055] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-17T19:28:44.834536] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T19:28:45.044159] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T19:28:45.063261] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-17T19:28:45.558046] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-17T19:28:46.358128] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-17T19:28:47.158066] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-17T19:28:47.262824] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T19:28:47.269770] [INFO ] [REMOTE ] HSY: Full fetch complete (73659 records). [2025-10-17T19:28:47.269929] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-17T19:28:47.418017] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-17T19:28:47.439709] [INFO ] [REMOTE ] HTD: Full fetch complete (19548 records). [2025-10-17T19:28:47.461332] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-17T19:28:47.975990] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-17T19:28:47.996725] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-17T19:28:48.014712] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-17T19:28:48.027249] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-17T19:28:48.027854] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-17T19:28:48.106214] [DEBUG] [LOCAL ] HSY: Trimmed 73659 records to 51192 (keeping 200 days of data) [2025-10-17T19:28:48.119474] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-17T19:28:48.119902] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-17T19:28:48.120181] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-17T19:28:48.120290] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-17T19:28:48.120980] [DEBUG] [LOCAL ] HTD: Trimmed 19548 records to 14424 (keeping 200 days of data) [2025-10-17T19:28:48.306209] [DEBUG] [LOCAL ] HTD: Primary data saved (14424 records). [2025-10-17T19:28:48.307433] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-17T19:28:48.307564] [INFO ] [MAIN ] Update Progress: 1060/2368 symbols completed. HTD took 30.5s. Estimated remaining: 3h 3m 32s. Rate: 7.1 symbols/min [2025-10-17T19:28:48.476777] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-17T19:28:48.521258] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:28:48.680551] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T19:28:48.690172] [DEBUG] [LOCAL ] HUBB: Loaded 36713 existing records from primary storage. [2025-10-17T19:28:48.692253] [INFO ] [MAIN ] HUBB: Loaded 36713 existing records. [2025-10-17T19:28:48.763192] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-17T19:28:48.887528] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:28:48.888473] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-17T19:28:48.890239] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-17T19:28:48.891295] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-17T19:28:48.891364] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-17T19:28:49.276635] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:28:49.352245] [DEBUG] [LOCAL ] HSY: Primary data saved (51192 records). [2025-10-17T19:28:49.352408] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-17T19:28:49.352995] [INFO ] [MAIN ] Update Progress: 1061/2368 symbols completed. HSY took 39.1s. Estimated remaining: 3h 3m 15s. Rate: 7.1 symbols/min [2025-10-17T19:28:49.521378] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:28:49.565616] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-17T19:28:49.568774] [DEBUG] [LOCAL ] HUBS: Loaded 40357 existing records from primary storage. [2025-10-17T19:28:49.569186] [INFO ] [MAIN ] HUBS: Loaded 40357 existing records. [2025-10-17T19:28:49.751111] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:28:49.751336] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-17T19:28:49.751384] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-17T19:28:49.751636] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-17T19:28:49.751735] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-17T19:28:50.127747] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:28:50.135247] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T19:28:50.358035] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-17T19:28:50.881355] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T19:28:51.158050] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-17T19:28:51.627789] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T19:28:51.958010] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-17T19:28:52.103175] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-17T19:28:52.758081] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-17T19:28:53.400029] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T19:28:53.558070] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-17T19:28:54.104003] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T19:28:54.358100] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-17T19:28:54.927485] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T19:28:55.158041] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-17T19:28:55.717085] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-17T19:28:55.958032] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-17T19:28:56.297251] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T19:28:56.758042] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-17T19:28:57.005394] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T19:28:57.558023] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-17T19:28:58.363870] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-17T19:28:58.370539] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T19:28:58.767108] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T19:28:59.158058] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-17T19:28:59.958049] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-17T19:29:00.004544] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T19:29:00.690359] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-17T19:29:00.731447] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T19:29:00.758047] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-17T19:29:01.502516] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-17T19:29:01.558016] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-17T19:29:01.966421] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-17T19:29:01.967125] [INFO ] [REMOTE ] HTFC: Full fetch complete (838 records). [2025-10-17T19:29:01.967194] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-17T19:29:02.141208] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-17T19:29:02.141393] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:29:02.141461] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:29:02.141533] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-17T19:29:02.141598] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-17T19:29:02.141635] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-17T19:29:02.141720] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-17T19:29:02.141785] [INFO ] [MAIN ] Update Progress: 1062/2368 symbols completed. HTFC took 34.7s. Estimated remaining: 3h 3m 12s. Rate: 7.1 symbols/min [2025-10-17T19:29:02.306104] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:29:02.350833] [DEBUG] [LOCAL ] HUM: Loaded 49651 existing records from primary storage. [2025-10-17T19:29:02.351154] [INFO ] [MAIN ] HUM: Loaded 49651 existing records. [2025-10-17T19:29:02.363237] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-17T19:29:02.534493] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:29:02.534844] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-17T19:29:02.534905] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-17T19:29:02.535223] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-17T19:29:02.535284] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-17T19:29:02.884560] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:29:03.158034] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-17T19:29:03.958005] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-17T19:29:04.009433] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T19:29:04.414286] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T19:29:04.758041] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-17T19:29:05.563387] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-17T19:29:05.569486] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T19:29:06.215613] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-17T19:29:06.358002] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-17T19:29:07.093013] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T19:29:07.158030] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-17T19:29:07.792983] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T19:29:07.957997] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-17T19:29:08.591529] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T19:29:08.758007] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-17T19:29:09.456971] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T19:29:09.558022] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-17T19:29:10.125921] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T19:29:10.358016] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-17T19:29:10.888866] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T19:29:11.158025] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-17T19:29:11.708987] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:29:11.958036] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-17T19:29:12.614454] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T19:29:12.758072] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-17T19:29:13.402981] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T19:29:13.407916] [INFO ] [REMOTE ] HUBB: Full fetch complete (54290 records). [2025-10-17T19:29:13.408029] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-17T19:29:13.581159] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-17T19:29:13.787943] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-17T19:29:13.788049] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-17T19:29:13.788880] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-17T19:29:13.788941] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-17T19:29:13.790016] [DEBUG] [LOCAL ] HUBB: Trimmed 54290 records to 36909 (keeping 200 days of data) [2025-10-17T19:29:14.024202] [DEBUG] [LOCAL ] HUBB: Primary data saved (36909 records). [2025-10-17T19:29:14.024404] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-17T19:29:14.024502] [INFO ] [MAIN ] Update Progress: 1063/2368 symbols completed. HUBB took 25.7s. Estimated remaining: 3h 3m 8s. Rate: 7.1 symbols/min [2025-10-17T19:29:14.194473] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:29:14.244473] [DEBUG] [LOCAL ] HUN: Loaded 53604 existing records from primary storage. [2025-10-17T19:29:14.244798] [INFO ] [MAIN ] HUN: Loaded 53604 existing records. [2025-10-17T19:29:14.374349] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-17T19:29:14.456100] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:29:14.456660] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-17T19:29:14.456766] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-17T19:29:14.457280] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-17T19:29:14.457359] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-17T19:29:14.658177] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-17T19:29:14.858277] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T19:29:14.862686] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:29:14.867121] [INFO ] [REMOTE ] HTH: Full fetch complete (46864 records). [2025-10-17T19:29:14.867199] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-17T19:29:15.161397] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-17T19:29:15.250334] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-17T19:29:15.250410] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-17T19:29:15.251158] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-17T19:29:15.251220] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-17T19:29:15.252177] [DEBUG] [LOCAL ] HTH: Trimmed 46864 records to 33038 (keeping 200 days of data) [2025-10-17T19:29:15.445078] [DEBUG] [LOCAL ] HTH: Primary data saved (33038 records). [2025-10-17T19:29:15.445207] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-17T19:29:15.445284] [INFO ] [MAIN ] Update Progress: 1064/2368 symbols completed. HTH took 40.2s. Estimated remaining: 3h 2m 51s. Rate: 7.1 symbols/min [2025-10-17T19:29:15.616709] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:29:15.660567] [DEBUG] [LOCAL ] HUYA: Loaded 44168 existing records from primary storage. [2025-10-17T19:29:15.660914] [INFO ] [MAIN ] HUYA: Loaded 44168 existing records. [2025-10-17T19:29:15.845202] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:29:15.845508] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-17T19:29:15.845582] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-17T19:29:15.845826] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-17T19:29:15.845882] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-17T19:29:15.963108] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-17T19:29:16.204150] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:29:16.229455] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T19:29:16.758004] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-17T19:29:17.123448] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-17T19:29:17.351297] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-17T19:29:17.558011] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-17T19:29:18.358066] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-17T19:29:18.384540] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T19:29:19.158010] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-17T19:29:19.312023] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T19:29:19.928866] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T19:29:19.957982] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-17T19:29:20.481063] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T19:29:20.487766] [INFO ] [REMOTE ] HUBS: Full fetch complete (56809 records). [2025-10-17T19:29:20.487937] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-17T19:29:20.763154] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-17T19:29:20.875524] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-17T19:29:20.875601] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-17T19:29:20.876440] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-17T19:29:20.876502] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-17T19:29:20.877702] [DEBUG] [LOCAL ] HUBS: Trimmed 56809 records to 40651 (keeping 200 days of data) [2025-10-17T19:29:21.123603] [DEBUG] [LOCAL ] HUBS: Primary data saved (40651 records). [2025-10-17T19:29:21.123749] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-17T19:29:21.124575] [INFO ] [MAIN ] Update Progress: 1065/2368 symbols completed. HUBS took 31.8s. Estimated remaining: 3h 2m 39s. Rate: 7.1 symbols/min [2025-10-17T19:29:21.293634] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:29:21.310621] [DEBUG] [LOCAL ] HVT: Loaded 15241 existing records from primary storage. [2025-10-17T19:29:21.310966] [INFO ] [MAIN ] HVT: Loaded 15241 existing records. [2025-10-17T19:29:21.489519] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:29:21.489764] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-17T19:29:21.489830] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-17T19:29:21.490080] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-17T19:29:21.490138] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-17T19:29:21.560280] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-17T19:29:21.807170] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T19:29:21.893263] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:29:22.357996] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-17T19:29:22.712707] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T19:29:22.805319] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T19:29:23.158006] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-17T19:29:23.343576] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T19:29:23.958047] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-17T19:29:24.721899] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T19:29:24.757986] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-17T19:29:25.558030] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-17T19:29:25.967584] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-17T19:29:26.358082] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-17T19:29:26.431827] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T19:29:27.131063] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T19:29:27.158032] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-17T19:29:27.308678] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T19:29:27.958044] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-17T19:29:28.758002] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-17T19:29:28.856840] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T19:29:28.931459] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T19:29:29.558031] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-17T19:29:30.358055] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-17T19:29:30.460011] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T19:29:31.158092] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-17T19:29:31.247358] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T19:29:31.958054] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-17T19:29:32.166808] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T19:29:32.758038] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-17T19:29:32.974539] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T19:29:32.997219] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T19:29:33.558013] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-17T19:29:34.187999] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T19:29:34.358001] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-17T19:29:34.775942] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T19:29:35.158084] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-17T19:29:35.958033] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-17T19:29:36.124513] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T19:29:36.763127] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-17T19:29:36.778217] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T19:29:37.557987] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-17T19:29:37.659948] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T19:29:37.757811] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-17T19:29:38.358037] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-17T19:29:38.948731] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-17T19:29:39.158083] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-17T19:29:39.958012] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-17T19:29:40.125901] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T19:29:40.229973] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T19:29:40.758049] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-17T19:29:41.529466] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T19:29:41.557987] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-17T19:29:42.358003] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-17T19:29:42.470198] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T19:29:43.158026] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-17T19:29:43.282954] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T19:29:43.283324] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T19:29:43.958038] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-17T19:29:44.758008] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-17T19:29:44.824825] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T19:29:44.831864] [INFO ] [REMOTE ] HUM: Full fetch complete (71107 records). [2025-10-17T19:29:44.832018] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-17T19:29:45.224439] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-17T19:29:45.224557] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-17T19:29:45.225874] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-17T19:29:45.225985] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-17T19:29:45.227451] [DEBUG] [LOCAL ] HUM: Trimmed 71107 records to 50015 (keeping 200 days of data) [2025-10-17T19:29:45.563102] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-17T19:29:45.563005] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T19:29:45.582728] [DEBUG] [LOCAL ] HUM: Primary data saved (50015 records). [2025-10-17T19:29:45.582856] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-17T19:29:45.582934] [INFO ] [MAIN ] Update Progress: 1066/2368 symbols completed. HUM took 43.4s. Estimated remaining: 3h 2m 50s. Rate: 7.1 symbols/min [2025-10-17T19:29:45.748672] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:29:45.798760] [DEBUG] [LOCAL ] HWM: Loaded 53180 existing records from primary storage. [2025-10-17T19:29:45.799079] [INFO ] [MAIN ] HWM: Loaded 53180 existing records. [2025-10-17T19:29:45.973485] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:29:45.973734] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-17T19:29:45.973790] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-17T19:29:45.973977] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-17T19:29:45.974015] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-17T19:29:46.325150] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:29:46.357978] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-17T19:29:46.468566] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T19:29:46.547554] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T19:29:47.158087] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-17T19:29:47.958000] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-17T19:29:48.120267] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T19:29:48.757998] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-17T19:29:48.948328] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T19:29:48.955620] [INFO ] [REMOTE ] HUN: Full fetch complete (76972 records). [2025-10-17T19:29:48.955784] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-17T19:29:49.349829] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-17T19:29:49.349961] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-17T19:29:49.351096] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-17T19:29:49.351239] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-17T19:29:49.352804] [DEBUG] [LOCAL ] HUN: Trimmed 76972 records to 53992 (keeping 200 days of data) [2025-10-17T19:29:49.564470] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-17T19:29:49.606136] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T19:29:49.714890] [DEBUG] [LOCAL ] HUN: Primary data saved (53992 records). [2025-10-17T19:29:49.715038] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-17T19:29:49.715138] [INFO ] [MAIN ] Update Progress: 1067/2368 symbols completed. HUN took 35.7s. Estimated remaining: 3h 2m 36s. Rate: 7.1 symbols/min [2025-10-17T19:29:49.882316] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:29:49.925309] [DEBUG] [LOCAL ] HXL: Loaded 46186 existing records from primary storage. [2025-10-17T19:29:49.925596] [INFO ] [MAIN ] HXL: Loaded 46186 existing records. [2025-10-17T19:29:50.099401] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:29:50.099627] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-17T19:29:50.099705] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-17T19:29:50.100325] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-17T19:29:50.100382] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-17T19:29:50.364327] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-17T19:29:50.464137] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:29:50.472793] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T19:29:50.819247] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-17T19:29:51.158043] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-17T19:29:51.958003] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-17T19:29:52.086934] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T19:29:52.093271] [INFO ] [REMOTE ] HUYA: Full fetch complete (64053 records). [2025-10-17T19:29:52.093371] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-17T19:29:52.476198] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-17T19:29:52.476315] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-17T19:29:52.477380] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-17T19:29:52.477518] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-17T19:29:52.478960] [DEBUG] [LOCAL ] HUYA: Trimmed 64053 records to 44415 (keeping 200 days of data) [2025-10-17T19:29:52.704145] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T19:29:52.759747] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-17T19:29:52.767842] [DEBUG] [LOCAL ] HUYA: Primary data saved (44415 records). [2025-10-17T19:29:52.767930] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-17T19:29:52.768006] [INFO ] [MAIN ] Update Progress: 1068/2368 symbols completed. HUYA took 37.3s. Estimated remaining: 3h 2m 21s. Rate: 7.1 symbols/min [2025-10-17T19:29:52.934817] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:29:52.946165] [DEBUG] [LOCAL ] HY: Loaded 10116 existing records from primary storage. [2025-10-17T19:29:52.946346] [INFO ] [MAIN ] HY: Loaded 10116 existing records. [2025-10-17T19:29:53.119862] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:29:53.120052] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-17T19:29:53.120098] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-17T19:29:53.120267] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-17T19:29:53.120322] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-17T19:29:53.476359] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:29:53.498725] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T19:29:53.557978] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-17T19:29:53.757791] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T19:29:53.760131] [INFO ] [REMOTE ] HVT: Full fetch complete (23122 records). [2025-10-17T19:29:53.760202] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-17T19:29:54.114411] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-17T19:29:54.114484] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-17T19:29:54.114909] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-17T19:29:54.114971] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-17T19:29:54.115528] [DEBUG] [LOCAL ] HVT: Trimmed 23122 records to 15340 (keeping 200 days of data) [2025-10-17T19:29:54.205891] [DEBUG] [LOCAL ] HVT: Primary data saved (15340 records). [2025-10-17T19:29:54.206061] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-17T19:29:54.206144] [INFO ] [MAIN ] Update Progress: 1069/2368 symbols completed. HVT took 33.1s. Estimated remaining: 3h 2m 5s. Rate: 7.1 symbols/min [2025-10-17T19:29:54.373360] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-17T19:29:54.375883] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:29:54.377123] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-17T19:29:54.377231] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-17T19:29:54.377557] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-17T19:29:54.377701] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-17T19:29:54.377817] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-17T19:29:54.377852] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-17T19:29:54.722396] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:29:55.077489] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T19:29:55.157984] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-17T19:29:55.958037] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-17T19:29:56.285358] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-17T19:29:56.389250] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T19:29:56.651142] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T19:29:56.758000] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-17T19:29:57.558034] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-17T19:29:57.878419] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-17T19:29:58.358023] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-17T19:29:58.746093] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T19:29:59.158040] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-17T19:29:59.966623] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-17T19:29:59.969143] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T19:30:00.758063] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-17T19:30:00.817755] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T19:30:01.080780] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T19:30:01.558038] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-17T19:30:02.358089] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-17T19:30:02.381061] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T19:30:03.158081] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-17T19:30:03.773216] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T19:30:03.958009] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-17T19:30:04.692636] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (3.13 seconds). [2025-10-17T19:30:04.758022] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-17T19:30:04.878753] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T19:30:04.886473] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T19:30:05.558026] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-17T19:30:06.358016] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-17T19:30:06.433803] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-17T19:30:06.701603] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-17T19:30:06.705895] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T19:30:07.158042] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-17T19:30:07.958046] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-17T19:30:08.062623] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T19:30:08.206625] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-17T19:30:08.758046] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-17T19:30:09.558051] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-17T19:30:09.886872] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-17T19:30:10.358009] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-17T19:30:10.672544] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T19:30:11.158075] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-17T19:30:11.582349] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-17T19:30:11.958161] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-17T19:30:12.021933] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T19:30:12.194128] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-17T19:30:12.758086] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-17T19:30:13.558043] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-17T19:30:14.358012] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-17T19:30:14.414006] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-17T19:30:14.582367] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-17T19:30:14.650914] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T19:30:15.158020] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-17T19:30:15.958027] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-17T19:30:16.669860] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-17T19:30:16.758060] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-17T19:30:17.530480] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-17T19:30:17.531314] [INFO ] [REMOTE ] HYAC: Full fetch complete (922 records). [2025-10-17T19:30:17.531383] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-17T19:30:17.531762] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T19:30:17.531858] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:30:17.531940] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:30:17.532032] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-17T19:30:17.532119] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-17T19:30:17.532156] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-17T19:30:17.532195] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-17T19:30:17.532246] [INFO ] [MAIN ] Update Progress: 1070/2368 symbols completed. HYAC took 23.3s. Estimated remaining: 3h 2m 14s. Rate: 7.1 symbols/min [2025-10-17T19:30:17.563136] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-17T19:30:17.712121] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:30:17.712289] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-17T19:30:17.712326] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-17T19:30:17.712469] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-17T19:30:17.712544] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-17T19:30:17.712604] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-17T19:30:17.712639] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-17T19:30:18.073113] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:30:18.360500] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-17T19:30:18.366401] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T19:30:18.875158] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T19:30:19.158077] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-17T19:30:19.958067] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-17T19:30:20.304437] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T19:30:20.311501] [INFO ] [REMOTE ] HWM: Full fetch complete (76668 records). [2025-10-17T19:30:20.311630] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-17T19:30:20.745634] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-17T19:30:20.745849] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-17T19:30:20.747149] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-17T19:30:20.747586] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-17T19:30:20.763046] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-17T19:30:20.775903] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T19:30:20.787041] [DEBUG] [LOCAL ] HWM: Trimmed 76668 records to 53536 (keeping 200 days of data) [2025-10-17T19:30:20.886767] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T19:30:21.141859] [DEBUG] [LOCAL ] HWM: Primary data saved (53536 records). [2025-10-17T19:30:21.142009] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-17T19:30:21.142094] [INFO ] [MAIN ] Update Progress: 1071/2368 symbols completed. HWM took 35.6s. Estimated remaining: 3h 2m 0s. Rate: 7.1 symbols/min [2025-10-17T19:30:21.211916] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-17T19:30:21.323719] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:30:21.337966] [DEBUG] [LOCAL ] HYI: Loaded 9891 existing records from primary storage. [2025-10-17T19:30:21.338203] [INFO ] [MAIN ] HYI: Loaded 9891 existing records. [2025-10-17T19:30:21.512239] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:30:21.512481] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-17T19:30:21.512529] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-17T19:30:21.512758] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-17T19:30:21.512816] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-17T19:30:21.563941] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-17T19:30:21.862637] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:30:21.963845] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-17T19:30:22.358117] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-17T19:30:23.158040] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-17T19:30:23.391599] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-17T19:30:23.958030] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-17T19:30:24.063549] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T19:30:24.500776] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-17T19:30:24.758048] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-17T19:30:25.558039] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-17T19:30:26.289691] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T19:30:26.358034] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-17T19:30:26.499768] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T19:30:27.158073] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-17T19:30:27.921748] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T19:30:27.943693] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T19:30:27.945451] [INFO ] [REMOTE ] HY: Full fetch complete (14993 records). [2025-10-17T19:30:27.945521] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-17T19:30:27.965726] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-17T19:30:28.312725] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-17T19:30:28.312812] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-17T19:30:28.313133] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-17T19:30:28.313172] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-17T19:30:28.313736] [DEBUG] [LOCAL ] HY: Trimmed 14993 records to 10191 (keeping 200 days of data) [2025-10-17T19:30:28.373880] [DEBUG] [LOCAL ] HY: Primary data saved (10191 records). [2025-10-17T19:30:28.373997] [INFO ] [MAIN ] HY: Full history saved. [2025-10-17T19:30:28.374076] [INFO ] [MAIN ] Update Progress: 1072/2368 symbols completed. HY took 35.6s. Estimated remaining: 3h 1m 50s. Rate: 7.1 symbols/min [2025-10-17T19:30:28.538606] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:30:28.570844] [DEBUG] [LOCAL ] HYT: Loaded 33837 existing records from primary storage. [2025-10-17T19:30:28.571107] [INFO ] [MAIN ] HYT: Loaded 33837 existing records. [2025-10-17T19:30:28.743905] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:30:28.744098] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-17T19:30:28.744145] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-17T19:30:28.744352] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-17T19:30:28.744418] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-17T19:30:28.764416] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-17T19:30:29.099478] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:30:29.355615] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T19:30:29.558019] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-17T19:30:29.737497] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T19:30:29.744498] [INFO ] [REMOTE ] HXL: Full fetch complete (66543 records). [2025-10-17T19:30:29.744661] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-17T19:30:30.129208] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-17T19:30:30.129305] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-17T19:30:30.130269] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-17T19:30:30.130350] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-17T19:30:30.134222] [DEBUG] [LOCAL ] HXL: Trimmed 66543 records to 46542 (keeping 200 days of data) [2025-10-17T19:30:30.351863] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T19:30:30.358840] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-17T19:30:30.429276] [DEBUG] [LOCAL ] HXL: Primary data saved (46542 records). [2025-10-17T19:30:30.429409] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-17T19:30:30.429504] [INFO ] [MAIN ] Update Progress: 1073/2368 symbols completed. HXL took 40.7s. Estimated remaining: 3h 1m 34s. Rate: 7.1 symbols/min [2025-10-17T19:30:30.600691] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:30:30.603578] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-17T19:30:30.609685] [DEBUG] [LOCAL ] HYTR: Loaded 3165 existing records from primary storage. [2025-10-17T19:30:30.609868] [INFO ] [MAIN ] HYTR: Loaded 3165 existing records. [2025-10-17T19:30:30.781459] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:30:30.781739] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-17T19:30:30.781813] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-17T19:30:30.781993] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-17T19:30:30.782059] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-17T19:30:31.132958] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:30:31.157986] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-17T19:30:31.906933] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-17T19:30:31.957989] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-17T19:30:32.758012] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-17T19:30:32.872676] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-17T19:30:33.065743] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-17T19:30:33.558029] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-17T19:30:34.009910] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-17T19:30:34.358025] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-17T19:30:34.694857] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-17T19:30:35.158058] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-17T19:30:35.719303] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-17T19:30:35.958056] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-17T19:30:36.271629] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-17T19:30:36.758080] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-17T19:30:37.301783] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-17T19:30:37.558049] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-17T19:30:38.358046] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-17T19:30:38.715971] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T19:30:39.109204] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T19:30:39.158063] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-17T19:30:39.454060] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-17T19:30:39.958075] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-17T19:30:40.292701] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-17T19:30:40.758056] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-17T19:30:41.074174] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-17T19:30:41.558046] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-17T19:30:42.282418] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T19:30:42.358007] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-17T19:30:42.615970] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-17T19:30:43.158062] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-17T19:30:43.765432] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T19:30:43.958025] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-17T19:30:44.395041] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-17T19:30:44.395737] [INFO ] [REMOTE ] HYBX: Full fetch complete (703 records). [2025-10-17T19:30:44.395807] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-17T19:30:44.574734] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-10-17T19:30:44.574964] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:30:44.575053] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:30:44.575150] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-17T19:30:44.575252] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-17T19:30:44.575292] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-17T19:30:44.575333] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-17T19:30:44.575390] [INFO ] [MAIN ] Update Progress: 1074/2368 symbols completed. HYBX took 27.0s. Estimated remaining: 3h 1m 33s. Rate: 7.1 symbols/min [2025-10-17T19:30:44.749231] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:30:44.758079] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-17T19:30:44.779906] [DEBUG] [LOCAL ] HZO: Loaded 29275 existing records from primary storage. [2025-10-17T19:30:44.780191] [INFO ] [MAIN ] HZO: Loaded 29275 existing records. [2025-10-17T19:30:44.953815] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:30:44.954028] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-17T19:30:44.954078] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-17T19:30:44.954292] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-17T19:30:44.954352] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-17T19:30:45.313565] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:30:45.318576] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-17T19:30:45.558036] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-17T19:30:46.361760] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-17T19:30:46.363887] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T19:30:46.917276] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-17T19:30:47.158043] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-17T19:30:47.904731] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T19:30:47.958051] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-17T19:30:48.758049] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-17T19:30:49.455306] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T19:30:49.487691] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-17T19:30:49.558029] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-17T19:30:50.358028] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-17T19:30:50.549467] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T19:30:50.551976] [INFO ] [REMOTE ] HYI: Full fetch complete (13983 records). [2025-10-17T19:30:50.552064] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-17T19:30:50.929506] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T19:30:50.941597] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-17T19:30:50.941685] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-17T19:30:50.942006] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-17T19:30:50.942047] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-17T19:30:50.942505] [DEBUG] [LOCAL ] HYI: Trimmed 13983 records to 9962 (keeping 200 days of data) [2025-10-17T19:30:51.001997] [DEBUG] [LOCAL ] HYI: Primary data saved (9962 records). [2025-10-17T19:30:51.002140] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-17T19:30:51.002253] [INFO ] [MAIN ] Update Progress: 1075/2368 symbols completed. HYI took 29.9s. Estimated remaining: 3h 1m 22s. Rate: 7.1 symbols/min [2025-10-17T19:30:51.163680] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-17T19:30:51.183334] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:30:51.192385] [DEBUG] [LOCAL ] IAE: Loaded 6326 existing records from primary storage. [2025-10-17T19:30:51.192581] [INFO ] [MAIN ] IAE: Loaded 6326 existing records. [2025-10-17T19:30:51.370879] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:30:51.371086] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-17T19:30:51.371135] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-17T19:30:51.371296] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-17T19:30:51.371353] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-17T19:30:51.717629] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:30:51.957993] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-17T19:30:52.268874] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T19:30:52.631005] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-17T19:30:52.757987] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-17T19:30:53.490220] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T19:30:53.558019] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-17T19:30:54.139193] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-17T19:30:54.358036] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-17T19:30:55.158100] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-17T19:30:55.709387] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T19:30:55.797671] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-17T19:30:55.958054] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-17T19:30:56.470980] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-17T19:30:56.758047] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-17T19:30:57.531052] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-17T19:30:57.558026] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-17T19:30:58.358000] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-17T19:30:58.686865] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T19:30:58.953963] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T19:30:58.955140] [INFO ] [REMOTE ] HYTR: Full fetch complete (4689 records). [2025-10-17T19:30:58.955215] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-17T19:30:59.164429] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-17T19:30:59.321389] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-17T19:30:59.321465] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-17T19:30:59.321639] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-17T19:30:59.321721] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-17T19:30:59.322082] [DEBUG] [LOCAL ] HYTR: Trimmed 4689 records to 3189 (keeping 200 days of data) [2025-10-17T19:30:59.343880] [DEBUG] [LOCAL ] HYTR: Primary data saved (3189 records). [2025-10-17T19:30:59.343959] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-17T19:30:59.344054] [INFO ] [MAIN ] Update Progress: 1076/2368 symbols completed. HYTR took 28.9s. Estimated remaining: 3h 1m 13s. Rate: 7.1 symbols/min [2025-10-17T19:30:59.513229] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:30:59.566969] [DEBUG] [LOCAL ] IAG: Loaded 53878 existing records from primary storage. [2025-10-17T19:30:59.567326] [INFO ] [MAIN ] IAG: Loaded 53878 existing records. [2025-10-17T19:30:59.741106] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:30:59.741314] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-17T19:30:59.741367] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-17T19:30:59.741571] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-17T19:30:59.741627] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-17T19:30:59.966407] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-17T19:31:00.089172] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:31:00.758009] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-17T19:31:01.130484] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-17T19:31:01.150871] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T19:31:01.558017] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-17T19:31:02.358030] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-17T19:31:02.627988] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-17T19:31:03.158085] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-17T19:31:03.238331] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T19:31:03.854523] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T19:31:03.958028] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-17T19:31:04.758049] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-17T19:31:04.921070] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T19:31:05.366501] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T19:31:05.378400] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T19:31:05.558036] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-17T19:31:06.330294] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-17T19:31:06.358013] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-17T19:31:07.158038] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-17T19:31:07.796870] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T19:31:07.958126] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-17T19:31:08.330994] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-17T19:31:08.758093] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-17T19:31:09.207894] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T19:31:09.491010] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-17T19:31:09.558027] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-17T19:31:10.343108] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T19:31:10.344891] [INFO ] [REMOTE ] IAE: Full fetch complete (9010 records). [2025-10-17T19:31:10.344976] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-17T19:31:10.365284] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-17T19:31:10.696707] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-17T19:31:10.696812] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-17T19:31:10.697109] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-17T19:31:10.697167] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-17T19:31:10.697687] [DEBUG] [LOCAL ] IAE: Trimmed 9010 records to 6362 (keeping 200 days of data) [2025-10-17T19:31:10.735161] [DEBUG] [LOCAL ] IAE: Primary data saved (6362 records). [2025-10-17T19:31:10.735313] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-17T19:31:10.735419] [INFO ] [MAIN ] Update Progress: 1077/2368 symbols completed. IAE took 19.7s. Estimated remaining: 3h 1m 8s. Rate: 7.1 symbols/min [2025-10-17T19:31:11.158051] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-17T19:31:11.830217] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T19:31:11.958038] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-17T19:31:12.758150] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-17T19:31:12.985467] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T19:31:13.252590] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T19:31:13.558038] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-17T19:31:14.180485] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T19:31:14.358064] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-17T19:31:14.709952] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T19:31:15.158082] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-17T19:31:15.872483] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T19:31:15.958053] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-17T19:31:16.008049] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-17T19:31:16.758052] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-17T19:31:17.558003] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-17T19:31:18.071354] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T19:31:18.119001] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-17T19:31:18.358036] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-17T19:31:18.702369] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T19:31:19.158079] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-17T19:31:19.687827] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T19:31:19.692768] [INFO ] [REMOTE ] HYT: Full fetch complete (48060 records). [2025-10-17T19:31:19.692860] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-17T19:31:19.970081] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-17T19:31:20.090541] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-17T19:31:20.090615] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-17T19:31:20.091392] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-17T19:31:20.091448] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-17T19:31:20.092405] [DEBUG] [LOCAL ] HYT: Trimmed 48060 records to 34156 (keeping 200 days of data) [2025-10-17T19:31:20.291793] [DEBUG] [LOCAL ] HYT: Primary data saved (34156 records). [2025-10-17T19:31:20.291918] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-17T19:31:20.291994] [INFO ] [MAIN ] Update Progress: 1078/2368 symbols completed. HYT took 51.9s. Estimated remaining: 3h 1m 1s. Rate: 7.1 symbols/min [2025-10-17T19:31:20.419360] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T19:31:20.758230] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-17T19:31:21.882781] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T19:31:21.894007] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-17T19:31:22.058702] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T19:31:22.358086] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-17T19:31:23.565558] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-17T19:31:23.572475] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-17T19:31:23.678637] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T19:31:23.958013] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-17T19:31:24.854604] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T19:31:24.859406] [INFO ] [REMOTE ] HZO: Full fetch complete (41379 records). [2025-10-17T19:31:24.859520] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-17T19:31:25.229114] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-17T19:31:25.229312] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-17T19:31:25.230136] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-17T19:31:25.230201] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-17T19:31:25.231329] [DEBUG] [LOCAL ] HZO: Trimmed 41379 records to 29442 (keeping 200 days of data) [2025-10-17T19:31:25.404369] [DEBUG] [LOCAL ] HZO: Primary data saved (29442 records). [2025-10-17T19:31:25.404494] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-17T19:31:25.404571] [INFO ] [MAIN ] Update Progress: 1079/2368 symbols completed. HZO took 40.8s. Estimated remaining: 3h 0m 49s. Rate: 7.1 symbols/min [2025-10-17T19:31:25.871922] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T19:31:25.883266] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-17T19:31:27.724692] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T19:31:27.736161] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-17T19:31:29.769328] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-17T19:31:29.780911] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-17T19:31:31.801198] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-17T19:31:31.808923] [INFO ] [REMOTE ] IAG: Full fetch complete (77493 records). [2025-10-17T19:31:31.809188] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-17T19:31:32.208191] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-17T19:31:32.208285] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-17T19:31:32.209356] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-17T19:31:32.209429] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-17T19:31:32.210968] [DEBUG] [LOCAL ] IAG: Trimmed 77493 records to 54268 (keeping 200 days of data) [2025-10-17T19:31:32.530118] [DEBUG] [LOCAL ] IAG: Primary data saved (54268 records). [2025-10-17T19:31:32.530287] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-17T19:31:32.530387] [INFO ] [MAIN ] Update Progress: 1080/2368 symbols completed. IAG took 33.2s. Estimated remaining: 3h 0m 39s. Rate: 7.1 symbols/min [2025-10-17T19:31:33.219094] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:31:33.282767] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:31:33.321092] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:31:33.325244] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:31:33.390050] [DEBUG] [LOCAL ] IBP: Loaded 29018 existing records from primary storage. [2025-10-17T19:31:33.404683] [DEBUG] [LOCAL ] IBTA: Loaded 36892 existing records from primary storage. [2025-10-17T19:31:33.405596] [INFO ] [MAIN ] IBTA: Loaded 36892 existing records. [2025-10-17T19:31:33.405193] [INFO ] [MAIN ] IBP: Loaded 29018 existing records. [2025-10-17T19:31:33.645763] [DEBUG] [LOCAL ] IBN: Loaded 53205 existing records from primary storage. [2025-10-17T19:31:33.668014] [DEBUG] [LOCAL ] IBM: Loaded 54023 existing records from primary storage. [2025-10-17T19:31:33.678752] [INFO ] [MAIN ] IBN: Loaded 53205 existing records. [2025-10-17T19:31:33.714563] [INFO ] [MAIN ] IBM: Loaded 54023 existing records. [2025-10-17T19:31:33.944738] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:31:34.055968] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-17T19:31:34.080977] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-17T19:31:34.187916] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:31:34.215871] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-17T19:31:34.287705] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-17T19:31:34.287929] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-17T19:31:34.308716] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:31:34.314236] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-17T19:31:34.371583] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-17T19:31:34.378940] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-17T19:31:34.404594] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-17T19:31:34.408965] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:31:34.430408] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-17T19:31:34.430269] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-17T19:31:34.430679] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-17T19:31:34.440279] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-17T19:31:34.509207] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-17T19:31:34.602324] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-17T19:31:34.634420] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-17T19:31:35.763324] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:31:35.796760] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:31:35.833382] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-17T19:31:35.873522] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-17T19:31:35.938926] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:31:35.967076] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:31:35.967980] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-17T19:31:35.968622] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-17T19:31:37.198673] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T19:31:37.200120] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T19:31:37.208010] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-17T19:31:37.214191] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-17T19:31:37.746348] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T19:31:37.756871] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-17T19:31:38.346588] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T19:31:38.352335] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-17T19:31:38.395717] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-17T19:31:38.407076] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-17T19:31:38.425307] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T19:31:38.430776] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-17T19:31:39.451435] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T19:31:39.458157] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-17T19:31:39.492773] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T19:31:39.504591] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-17T19:31:39.543701] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T19:31:39.549636] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-17T19:31:40.262937] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T19:31:40.273800] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-17T19:31:40.961144] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T19:31:40.967766] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-17T19:31:41.063115] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T19:31:41.072984] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-17T19:31:41.123277] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T19:31:41.133280] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-17T19:31:42.346300] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T19:31:42.353354] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-17T19:31:42.384804] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-17T19:31:42.394879] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-17T19:31:42.591257] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T19:31:42.602868] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-17T19:31:42.639946] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T19:31:43.158028] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-17T19:31:43.384016] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T19:31:43.958011] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-17T19:31:44.363466] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T19:31:44.511992] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T19:31:44.589846] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T19:31:44.758002] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-17T19:31:45.158809] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T19:31:45.563139] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-17T19:31:45.573097] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T19:31:46.358082] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-17T19:31:47.158050] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-17T19:31:47.425044] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T19:31:47.958108] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-17T19:31:48.128453] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-17T19:31:48.683424] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-17T19:31:48.758067] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-17T19:31:49.251708] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T19:31:49.558067] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-17T19:31:50.358082] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-17T19:31:50.554037] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T19:31:51.101943] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T19:31:51.158037] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-17T19:31:51.780552] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T19:31:51.958080] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-17T19:31:52.757998] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-17T19:31:53.034760] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T19:31:53.558043] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-17T19:31:53.976471] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T19:31:54.184699] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-17T19:31:54.358028] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-17T19:31:55.165329] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-17T19:31:55.189008] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T19:31:55.599357] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-17T19:31:55.958032] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-17T19:31:56.758002] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-17T19:31:57.265045] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-17T19:31:57.383054] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T19:31:57.388047] [INFO ] [REMOTE ] IBTA: Full fetch complete (51237 records). [2025-10-17T19:31:57.388145] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-17T19:31:57.563318] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-17T19:31:57.794738] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-17T19:31:57.794839] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-17T19:31:57.795761] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-17T19:31:57.795837] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-17T19:31:57.807532] [DEBUG] [LOCAL ] IBTA: Trimmed 51237 records to 37129 (keeping 200 days of data) [2025-10-17T19:31:57.807398] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T19:31:57.812108] [INFO ] [REMOTE ] IBP: Full fetch complete (41026 records). [2025-10-17T19:31:57.812251] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-17T19:31:58.329754] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-17T19:31:58.329918] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-17T19:31:58.331673] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-17T19:31:58.370379] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-17T19:31:58.379332] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-17T19:31:58.408432] [DEBUG] [LOCAL ] IBP: Trimmed 41026 records to 29142 (keeping 200 days of data) [2025-10-17T19:31:58.526606] [DEBUG] [LOCAL ] IBTA: Primary data saved (37129 records). [2025-10-17T19:31:58.527698] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-17T19:31:58.528100] [INFO ] [MAIN ] Update Progress: 1081/2368 symbols completed. IBTA took 26.0s. Estimated remaining: 3h 0m 52s. Rate: 7.1 symbols/min [2025-10-17T19:31:58.711450] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:31:58.816256] [DEBUG] [LOCAL ] ICE: Loaded 53408 existing records from primary storage. [2025-10-17T19:31:58.817363] [INFO ] [MAIN ] ICE: Loaded 53408 existing records. [2025-10-17T19:31:58.988325] [DEBUG] [LOCAL ] IBP: Primary data saved (29142 records). [2025-10-17T19:31:58.996933] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-17T19:31:59.009956] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:31:59.004477] [INFO ] [MAIN ] Update Progress: 1082/2368 symbols completed. IBP took 26.5s. Estimated remaining: 3h 0m 34s. Rate: 7.1 symbols/min [2025-10-17T19:31:59.010354] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-17T19:31:59.042271] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-17T19:31:59.080538] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-17T19:31:59.086428] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-17T19:31:59.325240] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:31:59.559818] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:31:59.570031] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-17T19:31:59.572132] [DEBUG] [LOCAL ] ICL: Loaded 38831 existing records from primary storage. [2025-10-17T19:31:59.572338] [INFO ] [MAIN ] ICL: Loaded 38831 existing records. [2025-10-17T19:31:59.762537] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:31:59.763185] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-17T19:31:59.763251] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-17T19:31:59.763605] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-17T19:31:59.763717] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-17T19:32:00.212765] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-17T19:32:00.216091] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:32:00.227561] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-17T19:32:00.261906] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T19:32:00.758018] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-17T19:32:01.558028] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-17T19:32:01.844926] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-17T19:32:02.183400] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T19:32:02.358084] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-17T19:32:03.158034] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-17T19:32:03.244373] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T19:32:03.252464] [INFO ] [REMOTE ] IBN: Full fetch complete (76594 records). [2025-10-17T19:32:03.252778] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-17T19:32:03.588341] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-10-17T19:32:03.696239] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-17T19:32:03.696316] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-17T19:32:03.697432] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-17T19:32:03.697499] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-17T19:32:03.699001] [DEBUG] [LOCAL ] IBN: Trimmed 76594 records to 53593 (keeping 200 days of data) [2025-10-17T19:32:03.985427] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-17T19:32:04.038714] [DEBUG] [LOCAL ] IBN: Primary data saved (53593 records). [2025-10-17T19:32:04.038869] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-17T19:32:04.038953] [INFO ] [MAIN ] Update Progress: 1083/2368 symbols completed. IBN took 31.5s. Estimated remaining: 3h 0m 21s. Rate: 7.1 symbols/min [2025-10-17T19:32:04.213387] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:32:04.261779] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-17T19:32:04.296414] [DEBUG] [LOCAL ] IDA: Loaded 32985 existing records from primary storage. [2025-10-17T19:32:04.296768] [INFO ] [MAIN ] IDA: Loaded 32985 existing records. [2025-10-17T19:32:04.486318] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:32:04.486510] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-17T19:32:04.486559] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-17T19:32:04.487223] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-17T19:32:04.487281] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-17T19:32:04.763319] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-17T19:32:04.782403] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T19:32:04.886874] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:32:05.558048] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-17T19:32:06.358012] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-17T19:32:06.482061] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-17T19:32:06.520589] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T19:32:06.737515] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T19:32:07.158082] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-17T19:32:07.839016] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T19:32:07.958058] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-17T19:32:08.758035] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-17T19:32:08.907602] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T19:32:09.558024] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-17T19:32:09.592472] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T19:32:10.077143] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-17T19:32:10.358106] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-17T19:32:11.158096] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-17T19:32:11.183472] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-17T19:32:11.191932] [INFO ] [REMOTE ] IBM: Full fetch complete (77739 records). [2025-10-17T19:32:11.192121] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-17T19:32:11.594202] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-17T19:32:11.594298] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-17T19:32:11.595347] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-17T19:32:11.605433] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-17T19:32:11.625216] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-17T19:32:11.635943] [DEBUG] [LOCAL ] IBM: Trimmed 77739 records to 54411 (keeping 200 days of data) [2025-10-17T19:32:11.958122] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-17T19:32:11.979228] [DEBUG] [LOCAL ] IBM: Primary data saved (54411 records). [2025-10-17T19:32:11.979422] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-17T19:32:11.979512] [INFO ] [MAIN ] Update Progress: 1084/2368 symbols completed. IBM took 39.4s. Estimated remaining: 3h 0m 12s. Rate: 7.1 symbols/min [2025-10-17T19:32:12.149124] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:32:12.160509] [DEBUG] [LOCAL ] IDE: Loaded 9225 existing records from primary storage. [2025-10-17T19:32:12.160760] [INFO ] [MAIN ] IDE: Loaded 9225 existing records. [2025-10-17T19:32:12.335256] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:32:12.335448] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-17T19:32:12.335520] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-17T19:32:12.335790] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-17T19:32:12.335910] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-17T19:32:12.719188] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:32:12.721111] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T19:32:12.757977] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-17T19:32:13.261864] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T19:32:13.285678] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-17T19:32:13.557993] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-17T19:32:14.312061] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T19:32:14.357999] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-17T19:32:15.065212] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-17T19:32:15.158067] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-17T19:32:15.842190] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-17T19:32:15.958114] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-17T19:32:16.758079] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-17T19:32:17.366376] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T19:32:17.558034] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-17T19:32:18.310991] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T19:32:18.357994] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-17T19:32:18.780432] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T19:32:19.158053] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-17T19:32:19.840063] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T19:32:19.870836] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-17T19:32:19.958039] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-17T19:32:20.703226] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T19:32:20.757994] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-17T19:32:21.514162] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-17T19:32:21.558003] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-17T19:32:22.358026] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-17T19:32:23.158005] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-17T19:32:23.223572] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T19:32:23.224231] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T19:32:23.958000] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-17T19:32:24.132066] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T19:32:24.758074] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-17T19:32:25.440492] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T19:32:25.558026] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-17T19:32:26.358075] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-17T19:32:26.537708] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T19:32:26.920023] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T19:32:27.135196] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T19:32:27.158073] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-17T19:32:27.958080] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-17T19:32:28.549766] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T19:32:28.555029] [INFO ] [REMOTE ] ICL: Full fetch complete (56146 records). [2025-10-17T19:32:28.555135] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-17T19:32:28.765041] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-17T19:32:28.981209] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-17T19:32:28.981303] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-17T19:32:28.982186] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-17T19:32:28.982253] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-17T19:32:28.983482] [DEBUG] [LOCAL ] ICL: Trimmed 56146 records to 39044 (keeping 200 days of data) [2025-10-17T19:32:29.231662] [DEBUG] [LOCAL ] ICL: Primary data saved (39044 records). [2025-10-17T19:32:29.231826] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-17T19:32:29.231926] [INFO ] [MAIN ] Update Progress: 1085/2368 symbols completed. ICL took 30.2s. Estimated remaining: 3h 0m 14s. Rate: 7.1 symbols/min [2025-10-17T19:32:29.413313] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:32:29.433920] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T19:32:29.456182] [DEBUG] [LOCAL ] IDT: Loaded 18660 existing records from primary storage. [2025-10-17T19:32:29.456431] [INFO ] [MAIN ] IDT: Loaded 18660 existing records. [2025-10-17T19:32:29.563124] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-17T19:32:29.644179] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:32:29.645453] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-17T19:32:29.645082] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-17T19:32:29.647977] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-17T19:32:29.648974] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-17T19:32:29.649089] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-17T19:32:30.003312] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:32:30.358058] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-17T19:32:31.158127] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-17T19:32:31.203552] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T19:32:31.307147] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T19:32:31.958010] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-17T19:32:32.733848] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T19:32:32.758029] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-17T19:32:32.816671] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T19:32:33.558041] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-17T19:32:34.063052] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T19:32:34.358092] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-17T19:32:34.414445] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T19:32:34.416430] [INFO ] [REMOTE ] IDE: Full fetch complete (12799 records). [2025-10-17T19:32:34.416509] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-17T19:32:34.777767] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-17T19:32:34.777852] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-17T19:32:34.778153] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-17T19:32:34.778192] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-17T19:32:34.778717] [DEBUG] [LOCAL ] IDE: Trimmed 12799 records to 9258 (keeping 200 days of data) [2025-10-17T19:32:34.835496] [DEBUG] [LOCAL ] IDE: Primary data saved (9258 records). [2025-10-17T19:32:34.835637] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-17T19:32:34.835762] [INFO ] [MAIN ] Update Progress: 1086/2368 symbols completed. IDE took 22.9s. Estimated remaining: 3h 0m 2s. Rate: 7.1 symbols/min [2025-10-17T19:32:35.009790] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:32:35.047491] [DEBUG] [LOCAL ] IEX: Loaded 38731 existing records from primary storage. [2025-10-17T19:32:35.047849] [INFO ] [MAIN ] IEX: Loaded 38731 existing records. [2025-10-17T19:32:35.155828] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T19:32:35.158011] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-17T19:32:35.239787] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:32:35.240012] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-17T19:32:35.240062] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-17T19:32:35.240834] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-17T19:32:35.240894] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-17T19:32:35.585472] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:32:35.958043] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-17T19:32:36.549567] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T19:32:36.758114] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-17T19:32:36.962610] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T19:32:37.558018] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-17T19:32:38.019315] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-17T19:32:38.357996] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-17T19:32:38.801733] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T19:32:39.158066] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-17T19:32:39.615869] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T19:32:39.958057] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-17T19:32:40.539749] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T19:32:40.758097] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-17T19:32:41.362672] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T19:32:41.367465] [INFO ] [REMOTE ] IDA: Full fetch complete (45271 records). [2025-10-17T19:32:41.367546] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-17T19:32:41.567687] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-17T19:32:41.747635] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-17T19:32:41.747739] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-17T19:32:41.748482] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-17T19:32:41.748528] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-17T19:32:41.750107] [DEBUG] [LOCAL ] IDA: Trimmed 45271 records to 33149 (keeping 200 days of data) [2025-10-17T19:32:41.954029] [DEBUG] [LOCAL ] IDA: Primary data saved (33149 records). [2025-10-17T19:32:41.954156] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-17T19:32:41.954936] [INFO ] [MAIN ] Update Progress: 1087/2368 symbols completed. IDA took 37.9s. Estimated remaining: 2h 59m 52s. Rate: 7.1 symbols/min [2025-10-17T19:32:42.119234] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:32:42.168201] [DEBUG] [LOCAL ] IFF: Loaded 51530 existing records from primary storage. [2025-10-17T19:32:42.168502] [INFO ] [MAIN ] IFF: Loaded 51530 existing records. [2025-10-17T19:32:42.350324] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:32:42.350571] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-17T19:32:42.350630] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-17T19:32:42.351164] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-17T19:32:42.351231] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-17T19:32:42.382049] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-17T19:32:42.709002] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:32:42.721204] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-17T19:32:42.754610] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-17T19:32:43.158025] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-17T19:32:43.887353] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T19:32:43.957984] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-17T19:32:44.095583] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-17T19:32:44.758029] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-17T19:32:45.474767] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T19:32:45.557995] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-17T19:32:46.358011] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-17T19:32:46.535837] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T19:32:47.148437] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T19:32:47.157995] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-17T19:32:47.161213] [INFO ] [REMOTE ] ICE: Full fetch complete (76984 records). [2025-10-17T19:32:47.161320] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-17T19:32:47.479684] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T19:32:47.578747] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-17T19:32:47.578828] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-17T19:32:47.579805] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-17T19:32:47.579887] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-17T19:32:47.581326] [DEBUG] [LOCAL ] ICE: Trimmed 76984 records to 53798 (keeping 200 days of data) [2025-10-17T19:32:47.922756] [DEBUG] [LOCAL ] ICE: Primary data saved (53798 records). [2025-10-17T19:32:47.922885] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-17T19:32:47.922976] [INFO ] [MAIN ] Update Progress: 1088/2368 symbols completed. ICE took 49.4s. Estimated remaining: 2h 59m 41s. Rate: 7.1 symbols/min [2025-10-17T19:32:47.965280] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-17T19:32:48.092551] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:32:48.112631] [DEBUG] [LOCAL ] IFN: Loaded 18627 existing records from primary storage. [2025-10-17T19:32:48.112876] [INFO ] [MAIN ] IFN: Loaded 18627 existing records. [2025-10-17T19:32:48.291710] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:32:48.291968] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-17T19:32:48.292038] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-17T19:32:48.292302] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-17T19:32:48.292367] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-17T19:32:48.640607] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:32:48.690967] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T19:32:48.758009] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-17T19:32:49.068196] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T19:32:49.558050] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-17T19:32:50.358036] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-17T19:32:50.417388] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T19:32:50.552577] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T19:32:51.158038] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-17T19:32:51.753036] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T19:32:51.958026] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-17T19:32:52.758884] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-17T19:32:52.762146] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T19:32:53.150297] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T19:32:53.558025] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-17T19:32:53.584085] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T19:32:54.358028] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-17T19:32:55.158064] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-17T19:32:55.251280] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T19:32:55.711208] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-17T19:32:55.832431] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T19:32:55.958026] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-17T19:32:56.758038] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-17T19:32:57.557992] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-17T19:32:57.778817] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T19:32:57.879743] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T19:32:58.358051] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-17T19:32:59.044610] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T19:32:59.158047] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-17T19:32:59.323220] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T19:32:59.958083] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-17T19:33:00.354155] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-17T19:33:00.758077] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-17T19:33:01.558056] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-17T19:33:01.767095] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T19:33:02.358100] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-17T19:33:03.158118] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-17T19:33:03.526624] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (2.77 seconds). [2025-10-17T19:33:03.531798] [INFO ] [REMOTE ] IEX: Full fetch complete (53760 records). [2025-10-17T19:33:03.531923] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-17T19:33:03.926581] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-17T19:33:03.926690] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-17T19:33:03.927521] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-17T19:33:03.927585] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-17T19:33:03.928735] [DEBUG] [LOCAL ] IEX: Trimmed 53760 records to 38977 (keeping 200 days of data) [2025-10-17T19:33:04.173700] [DEBUG] [LOCAL ] IEX: Primary data saved (38977 records). [2025-10-17T19:33:04.173841] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-17T19:33:04.173971] [INFO ] [MAIN ] Update Progress: 1089/2368 symbols completed. IEX took 29.3s. Estimated remaining: 2h 59m 42s. Rate: 7.1 symbols/min [2025-10-17T19:33:04.361920] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:33:04.376039] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T19:33:04.381085] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-17T19:33:04.399623] [DEBUG] [LOCAL ] IFS: Loaded 22745 existing records from primary storage. [2025-10-17T19:33:04.399938] [INFO ] [MAIN ] IFS: Loaded 22745 existing records. [2025-10-17T19:33:04.591236] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:33:04.591581] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-17T19:33:04.591736] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-17T19:33:04.592080] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-17T19:33:04.592253] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-17T19:33:04.706889] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-17T19:33:04.736266] [INFO ] [REMOTE ] IDT: Full fetch complete (23892 records). [2025-10-17T19:33:04.760521] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-17T19:33:04.829073] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (3.27 seconds). [2025-10-17T19:33:04.993293] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-17T19:33:05.298852] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:33:05.420081] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-17T19:33:05.420233] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-17T19:33:05.420877] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-17T19:33:05.420943] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-17T19:33:05.421755] [DEBUG] [LOCAL ] IDT: Trimmed 23892 records to 18788 (keeping 200 days of data) [2025-10-17T19:33:05.527603] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T19:33:05.558764] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-17T19:33:05.562588] [DEBUG] [LOCAL ] IDT: Primary data saved (18788 records). [2025-10-17T19:33:05.562754] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-17T19:33:05.562847] [INFO ] [MAIN ] Update Progress: 1090/2368 symbols completed. IDT took 36.3s. Estimated remaining: 2h 59m 25s. Rate: 7.1 symbols/min [2025-10-17T19:33:05.728289] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:33:05.740419] [DEBUG] [LOCAL ] IGA: Loaded 10286 existing records from primary storage. [2025-10-17T19:33:05.740632] [INFO ] [MAIN ] IGA: Loaded 10286 existing records. [2025-10-17T19:33:05.923101] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:33:05.923316] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-17T19:33:05.923365] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-17T19:33:05.923513] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-17T19:33:05.923550] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-17T19:33:06.274259] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:33:06.358014] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-17T19:33:06.431115] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-17T19:33:06.636453] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T19:33:06.988270] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-17T19:33:07.158035] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-17T19:33:07.901895] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-17T19:33:07.958003] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-17T19:33:08.687485] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-17T19:33:08.757998] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-17T19:33:09.465562] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-17T19:33:09.558002] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-17T19:33:10.358091] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-17T19:33:10.712621] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-17T19:33:11.158016] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-17T19:33:11.273519] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-17T19:33:11.958086] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-17T19:33:12.171484] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T19:33:12.758033] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-17T19:33:13.558002] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-17T19:33:13.675598] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T19:33:13.891415] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T19:33:14.027569] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T19:33:14.358027] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-17T19:33:15.158015] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-17T19:33:15.229107] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-17T19:33:15.958006] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-17T19:33:16.084900] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T19:33:16.758000] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-17T19:33:16.928180] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T19:33:17.558022] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-17T19:33:18.358073] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-17T19:33:18.462752] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T19:33:18.685590] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T19:33:19.158036] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-17T19:33:19.433014] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T19:33:19.435993] [INFO ] [REMOTE ] IFN: Full fetch complete (28436 records). [2025-10-17T19:33:19.436073] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-17T19:33:19.805822] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-17T19:33:19.805919] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-17T19:33:19.806566] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-17T19:33:19.806635] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-17T19:33:19.807390] [DEBUG] [LOCAL ] IFN: Trimmed 28436 records to 18730 (keeping 200 days of data) [2025-10-17T19:33:19.922748] [DEBUG] [LOCAL ] IFN: Primary data saved (18730 records). [2025-10-17T19:33:19.922890] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-17T19:33:19.922972] [INFO ] [MAIN ] Update Progress: 1091/2368 symbols completed. IFN took 32.0s. Estimated remaining: 2h 59m 24s. Rate: 7.1 symbols/min [2025-10-17T19:33:19.965771] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-17T19:33:20.098012] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:33:20.116315] [DEBUG] [LOCAL ] IGD: Loaded 19512 existing records from primary storage. [2025-10-17T19:33:20.116547] [INFO ] [MAIN ] IGD: Loaded 19512 existing records. [2025-10-17T19:33:20.291969] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:33:20.292176] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-17T19:33:20.292241] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-17T19:33:20.292696] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-17T19:33:20.292754] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-17T19:33:20.687370] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:33:20.757983] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-17T19:33:20.808463] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-17T19:33:21.008036] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T19:33:21.558034] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-17T19:33:21.721121] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-17T19:33:22.124487] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-17T19:33:22.358033] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-17T19:33:23.158018] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-17T19:33:23.444588] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T19:33:23.958046] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-17T19:33:24.752375] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T19:33:24.762910] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-17T19:33:24.764495] [INFO ] [REMOTE ] IFF: Full fetch complete (73651 records). [2025-10-17T19:33:24.764637] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-17T19:33:25.161218] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-17T19:33:25.161366] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-17T19:33:25.168114] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-17T19:33:25.177349] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-17T19:33:25.179154] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T19:33:25.186243] [DEBUG] [LOCAL ] IFF: Trimmed 73651 records to 51919 (keeping 200 days of data) [2025-10-17T19:33:25.507767] [DEBUG] [LOCAL ] IFF: Primary data saved (51919 records). [2025-10-17T19:33:25.507907] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-17T19:33:25.507987] [INFO ] [MAIN ] Update Progress: 1092/2368 symbols completed. IFF took 43.6s. Estimated remaining: 2h 59m 12s. Rate: 7.1 symbols/min [2025-10-17T19:33:25.570783] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-17T19:33:25.684690] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:33:25.690579] [DEBUG] [LOCAL ] IGI: Loaded 4035 existing records from primary storage. [2025-10-17T19:33:25.690851] [INFO ] [MAIN ] IGI: Loaded 4035 existing records. [2025-10-17T19:33:25.871335] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:33:25.871619] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-17T19:33:25.871702] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-17T19:33:25.871965] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-17T19:33:25.872026] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-17T19:33:26.252022] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:33:26.253665] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T19:33:26.277178] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-17T19:33:26.358012] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-17T19:33:27.158055] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-17T19:33:27.785406] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T19:33:27.921181] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T19:33:27.958056] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-17T19:33:28.758063] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-17T19:33:28.976600] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-17T19:33:29.351010] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T19:33:29.353259] [INFO ] [REMOTE ] IGA: Full fetch complete (14266 records). [2025-10-17T19:33:29.353330] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-17T19:33:29.564556] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-17T19:33:29.716304] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-17T19:33:29.716386] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-17T19:33:29.716867] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-17T19:33:29.716928] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-17T19:33:29.717669] [DEBUG] [LOCAL ] IGA: Trimmed 14266 records to 10395 (keeping 200 days of data) [2025-10-17T19:33:29.782465] [DEBUG] [LOCAL ] IGA: Primary data saved (10395 records). [2025-10-17T19:33:29.782615] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-17T19:33:29.782734] [INFO ] [MAIN ] Update Progress: 1093/2368 symbols completed. IGA took 24.2s. Estimated remaining: 2h 58m 59s. Rate: 7.1 symbols/min [2025-10-17T19:33:29.948576] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:33:29.979364] [DEBUG] [LOCAL ] IGR: Loaded 30626 existing records from primary storage. [2025-10-17T19:33:29.979619] [INFO ] [MAIN ] IGR: Loaded 30626 existing records. [2025-10-17T19:33:30.153724] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:33:30.153940] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-17T19:33:30.154928] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-17T19:33:30.155122] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-17T19:33:30.155162] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-17T19:33:30.363111] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-17T19:33:30.525125] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:33:30.593871] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T19:33:31.158009] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-17T19:33:31.196749] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T19:33:31.876761] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-17T19:33:31.958032] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-17T19:33:32.758009] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-17T19:33:33.132987] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T19:33:33.558022] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-17T19:33:33.816068] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T19:33:34.358594] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-17T19:33:34.359705] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T19:33:34.363899] [INFO ] [REMOTE ] IFS: Full fetch complete (32111 records). [2025-10-17T19:33:34.364046] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-17T19:33:34.761918] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-17T19:33:34.762000] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-17T19:33:34.762680] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-17T19:33:34.762741] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-17T19:33:34.763447] [DEBUG] [LOCAL ] IFS: Trimmed 32111 records to 22863 (keeping 200 days of data) [2025-10-17T19:33:34.896032] [DEBUG] [LOCAL ] IFS: Primary data saved (22863 records). [2025-10-17T19:33:34.896157] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-17T19:33:34.896237] [INFO ] [MAIN ] Update Progress: 1094/2368 symbols completed. IFS took 30.7s. Estimated remaining: 2h 58m 46s. Rate: 7.1 symbols/min [2025-10-17T19:33:35.069281] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:33:35.074311] [DEBUG] [LOCAL ] IH: Loaded 2814 existing records from primary storage. [2025-10-17T19:33:35.074464] [INFO ] [MAIN ] IH: Loaded 2814 existing records. [2025-10-17T19:33:35.164917] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-17T19:33:35.259493] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:33:35.259758] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-17T19:33:35.259810] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-17T19:33:35.259967] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-17T19:33:35.260026] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-17T19:33:35.624269] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:33:35.933152] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T19:33:35.958027] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-17T19:33:36.341218] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T19:33:36.396175] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-17T19:33:36.758033] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-17T19:33:37.201505] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-17T19:33:37.558012] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-17T19:33:38.068416] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-17T19:33:38.358046] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-17T19:33:38.459409] [DEBUG] [REMOTE ] IH: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-17T19:33:38.459704] [WARN ] [REMOTE ] IH: No data returned for month 2025-02 [2025-10-17T19:33:38.459792] [FATAL] [REMOTE ] IH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:33:38.459895] [FATAL] [MAIN ] IH: Failed to fetch primary data. [2025-10-17T19:33:38.459963] [WARN ] [MAIN ] IH: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:33:38.460032] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-17T19:33:38.460095] [DEBUG] [LOCAL ] IH: No primary data file found to delete. [2025-10-17T19:33:38.460133] [INFO ] [LOCAL ] IH: Starting deletion of derivative data. [2025-10-17T19:33:38.460288] [DEBUG] [LOCAL ] IH: Deleted derivative data file. [2025-10-17T19:33:38.460371] [INFO ] [MAIN ] Update Progress: 1095/2368 symbols completed. IH took 3.6s. Estimated remaining: 2h 58m 32s. Rate: 7.1 symbols/min [2025-10-17T19:33:38.675485] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:33:38.684820] [DEBUG] [LOCAL ] IHD: Loaded 7367 existing records from primary storage. [2025-10-17T19:33:38.685016] [INFO ] [MAIN ] IHD: Loaded 7367 existing records. [2025-10-17T19:33:38.863259] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:33:38.863488] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-17T19:33:38.863537] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-17T19:33:38.863763] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-17T19:33:38.863822] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-17T19:33:39.163166] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-17T19:33:39.222250] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:33:39.641506] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-17T19:33:39.958036] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-17T19:33:40.758090] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-17T19:33:40.962055] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-17T19:33:41.523054] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-17T19:33:41.557984] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-17T19:33:42.311659] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T19:33:42.358010] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-17T19:33:43.089483] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-17T19:33:43.158037] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-17T19:33:43.958014] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-17T19:33:44.193483] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T19:33:44.528751] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-17T19:33:44.758020] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-17T19:33:45.428051] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-17T19:33:45.557996] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-17T19:33:46.358061] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-17T19:33:46.548080] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T19:33:47.158072] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-17T19:33:47.846894] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-17T19:33:47.958030] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-17T19:33:47.993982] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T19:33:48.758110] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-17T19:33:49.343945] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T19:33:49.558038] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-17T19:33:49.736463] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T19:33:50.358051] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-17T19:33:50.509855] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T19:33:50.800755] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-17T19:33:51.158040] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-17T19:33:51.958074] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-17T19:33:52.135398] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-17T19:33:52.698437] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T19:33:52.758028] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-17T19:33:53.414881] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-17T19:33:53.558010] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-17T19:33:54.358038] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-17T19:33:54.712898] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T19:33:54.716914] [INFO ] [REMOTE ] IGD: Full fetch complete (30126 records). [2025-10-17T19:33:54.716997] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-17T19:33:55.011460] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-17T19:33:55.095051] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-17T19:33:55.095123] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-17T19:33:55.095727] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-17T19:33:55.095789] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-17T19:33:55.096450] [DEBUG] [LOCAL ] IGD: Trimmed 30126 records to 19676 (keeping 200 days of data) [2025-10-17T19:33:55.175521] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-17T19:33:55.213589] [DEBUG] [LOCAL ] IGD: Primary data saved (19676 records). [2025-10-17T19:33:55.213754] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-17T19:33:55.213841] [INFO ] [MAIN ] Update Progress: 1096/2368 symbols completed. IGD took 35.3s. Estimated remaining: 2h 58m 34s. Rate: 7.1 symbols/min [2025-10-17T19:33:55.386404] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:33:55.411414] [DEBUG] [LOCAL ] IHG: Loaded 24519 existing records from primary storage. [2025-10-17T19:33:55.411717] [INFO ] [MAIN ] IHG: Loaded 24519 existing records. [2025-10-17T19:33:55.591036] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:33:55.591254] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-17T19:33:55.591301] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-17T19:33:55.591864] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-17T19:33:55.591922] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-17T19:33:55.941776] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:33:55.957977] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-17T19:33:56.491049] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-17T19:33:56.758022] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-17T19:33:57.198617] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T19:33:57.558022] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-17T19:33:57.759088] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T19:33:58.358034] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-17T19:33:58.571087] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T19:33:58.936405] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T19:33:59.158027] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-17T19:33:59.643765] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-17T19:33:59.958037] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-17T19:34:00.758047] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-17T19:34:01.055848] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T19:34:01.057736] [INFO ] [REMOTE ] IHD: Full fetch complete (11848 records). [2025-10-17T19:34:01.057811] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-17T19:34:01.412940] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-17T19:34:01.413024] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-17T19:34:01.413440] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-17T19:34:01.413482] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-17T19:34:01.413962] [DEBUG] [LOCAL ] IHD: Trimmed 11848 records to 7396 (keeping 200 days of data) [2025-10-17T19:34:01.458552] [DEBUG] [LOCAL ] IHD: Primary data saved (7396 records). [2025-10-17T19:34:01.458736] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-17T19:34:01.458836] [INFO ] [MAIN ] Update Progress: 1097/2368 symbols completed. IHD took 23.0s. Estimated remaining: 2h 58m 23s. Rate: 7.1 symbols/min [2025-10-17T19:34:01.563249] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-17T19:34:01.638572] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:34:01.674826] [DEBUG] [LOCAL ] IHS: Loaded 37894 existing records from primary storage. [2025-10-17T19:34:01.675164] [INFO ] [MAIN ] IHS: Loaded 37894 existing records. [2025-10-17T19:34:01.854910] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:34:01.855140] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-17T19:34:01.855188] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-17T19:34:01.855804] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-17T19:34:01.855863] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-17T19:34:02.210040] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:34:02.318614] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T19:34:02.358046] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-17T19:34:03.157998] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-17T19:34:03.527615] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T19:34:03.728230] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T19:34:03.752608] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-17T19:34:03.958067] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-17T19:34:04.620391] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T19:34:04.758167] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-17T19:34:05.558065] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-17T19:34:05.775696] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T19:34:06.358043] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-17T19:34:06.650466] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T19:34:06.944330] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T19:34:07.158041] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-17T19:34:07.957995] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-17T19:34:08.092020] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T19:34:08.093487] [INFO ] [REMOTE ] IGI: Full fetch complete (5518 records). [2025-10-17T19:34:08.093574] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-17T19:34:08.442231] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-17T19:34:08.442303] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-17T19:34:08.442436] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-17T19:34:08.442475] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-17T19:34:08.442860] [DEBUG] [LOCAL ] IGI: Trimmed 5518 records to 4092 (keeping 200 days of data) [2025-10-17T19:34:08.466754] [DEBUG] [LOCAL ] IGI: Primary data saved (4092 records). [2025-10-17T19:34:08.466823] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-17T19:34:08.466904] [INFO ] [MAIN ] Update Progress: 1098/2368 symbols completed. IGI took 43.0s. Estimated remaining: 2h 58m 13s. Rate: 7.1 symbols/min [2025-10-17T19:34:08.631728] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:34:08.638232] [DEBUG] [LOCAL ] IIF: Loaded 5612 existing records from primary storage. [2025-10-17T19:34:08.638386] [INFO ] [MAIN ] IIF: Loaded 5612 existing records. [2025-10-17T19:34:08.763145] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-17T19:34:08.817075] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:34:08.817775] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-17T19:34:08.817955] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-17T19:34:08.818336] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-17T19:34:08.818397] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-17T19:34:09.174753] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:34:09.189031] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T19:34:09.557985] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-17T19:34:09.953253] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-17T19:34:10.358085] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-17T19:34:10.972351] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-17T19:34:11.104180] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T19:34:11.158028] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-17T19:34:11.929116] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T19:34:11.957999] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-17T19:34:12.744888] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T19:34:12.757997] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-17T19:34:13.355003] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-17T19:34:13.557988] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-17T19:34:14.357999] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-17T19:34:14.607366] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T19:34:15.158017] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-17T19:34:15.694198] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T19:34:15.958047] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-17T19:34:16.000691] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-17T19:34:16.758007] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-17T19:34:16.990541] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T19:34:17.558037] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-17T19:34:18.219444] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T19:34:18.358074] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-17T19:34:18.978508] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T19:34:19.158001] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-17T19:34:19.180568] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-17T19:34:19.958108] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-17T19:34:20.266165] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-17T19:34:20.758038] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-17T19:34:21.326638] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T19:34:21.362360] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T19:34:21.558038] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-17T19:34:22.147551] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-17T19:34:22.358093] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-17T19:34:23.158124] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-17T19:34:23.667419] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T19:34:23.932907] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-17T19:34:23.958022] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-17T19:34:24.565671] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-17T19:34:24.758080] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-17T19:34:25.558111] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-17T19:34:26.094090] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T19:34:26.100059] [INFO ] [REMOTE ] IGR: Full fetch complete (44801 records). [2025-10-17T19:34:26.100208] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-17T19:34:26.363323] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-17T19:34:26.500955] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-17T19:34:26.501122] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-17T19:34:26.501949] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-17T19:34:26.502013] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-17T19:34:26.503084] [DEBUG] [LOCAL ] IGR: Trimmed 44801 records to 30813 (keeping 200 days of data) [2025-10-17T19:34:26.686955] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T19:34:26.705929] [DEBUG] [LOCAL ] IGR: Primary data saved (30813 records). [2025-10-17T19:34:26.706080] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-17T19:34:26.706163] [INFO ] [MAIN ] Update Progress: 1099/2368 symbols completed. IGR took 56.9s. Estimated remaining: 2h 58m 16s. Rate: 7.1 symbols/min [2025-10-17T19:34:26.902674] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:34:26.918810] [DEBUG] [LOCAL ] IIIN: Loaded 16246 existing records from primary storage. [2025-10-17T19:34:26.919071] [INFO ] [MAIN ] IIIN: Loaded 16246 existing records. [2025-10-17T19:34:27.049731] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-17T19:34:27.102617] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:34:27.102814] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-17T19:34:27.102880] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-17T19:34:27.103418] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-17T19:34:27.103477] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-17T19:34:27.164479] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-17T19:34:27.460899] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:34:27.794705] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-17T19:34:27.795684] [INFO ] [REMOTE ] IIF: Full fetch complete (8973 records). [2025-10-17T19:34:27.795755] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-17T19:34:27.967715] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-17T19:34:28.186728] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-17T19:34:28.186819] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-17T19:34:28.187070] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-17T19:34:28.187113] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-17T19:34:28.187572] [DEBUG] [LOCAL ] IIF: Trimmed 8973 records to 5622 (keeping 200 days of data) [2025-10-17T19:34:28.221758] [DEBUG] [LOCAL ] IIF: Primary data saved (5622 records). [2025-10-17T19:34:28.221908] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-17T19:34:28.221990] [INFO ] [MAIN ] Update Progress: 1100/2368 symbols completed. IIF took 19.8s. Estimated remaining: 2h 57m 59s. Rate: 7.1 symbols/min [2025-10-17T19:34:28.388401] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:34:28.404662] [DEBUG] [LOCAL ] IIM: Loaded 15782 existing records from primary storage. [2025-10-17T19:34:28.404945] [INFO ] [MAIN ] IIM: Loaded 15782 existing records. [2025-10-17T19:34:28.581746] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:34:28.581995] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-17T19:34:28.582055] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-17T19:34:28.582589] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-17T19:34:28.582683] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-17T19:34:28.763301] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-17T19:34:28.947960] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:34:29.275859] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T19:34:29.558000] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-17T19:34:29.939732] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T19:34:30.358017] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-17T19:34:30.693003] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T19:34:31.158062] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-17T19:34:31.687135] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T19:34:31.691111] [INFO ] [REMOTE ] IHG: Full fetch complete (34181 records). [2025-10-17T19:34:31.691197] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-17T19:34:31.966283] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-17T19:34:32.072852] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-17T19:34:32.072934] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-17T19:34:32.073708] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-17T19:34:32.073773] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-17T19:34:32.074588] [DEBUG] [LOCAL ] IHG: Trimmed 34181 records to 24671 (keeping 200 days of data) [2025-10-17T19:34:32.178788] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T19:34:32.242607] [DEBUG] [LOCAL ] IHG: Primary data saved (24671 records). [2025-10-17T19:34:32.242761] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-17T19:34:32.242848] [INFO ] [MAIN ] Update Progress: 1101/2368 symbols completed. IHG took 37.0s. Estimated remaining: 2h 57m 46s. Rate: 7.1 symbols/min [2025-10-17T19:34:32.423797] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:34:32.453186] [DEBUG] [LOCAL ] IIPR: Loaded 29694 existing records from primary storage. [2025-10-17T19:34:32.453458] [INFO ] [MAIN ] IIPR: Loaded 29694 existing records. [2025-10-17T19:34:32.636554] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:34:32.636809] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-17T19:34:32.636859] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-17T19:34:32.637505] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-17T19:34:32.637565] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-17T19:34:32.763195] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-17T19:34:33.008096] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:34:33.558008] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-17T19:34:33.614662] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T19:34:34.113980] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T19:34:34.358041] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-17T19:34:34.987247] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T19:34:35.158058] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-17T19:34:35.830774] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T19:34:35.958012] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-17T19:34:36.264216] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T19:34:36.758027] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-17T19:34:37.465230] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-17T19:34:37.558001] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-17T19:34:37.673844] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-17T19:34:38.358006] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-17T19:34:38.605938] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T19:34:39.158031] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-17T19:34:39.779451] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T19:34:39.958047] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-17T19:34:40.327215] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T19:34:40.758053] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-17T19:34:40.951422] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T19:34:41.558068] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-17T19:34:42.136370] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T19:34:42.358008] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-17T19:34:42.625338] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T19:34:43.158058] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-17T19:34:43.743777] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-17T19:34:43.958043] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-17T19:34:44.248169] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T19:34:44.758039] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-17T19:34:45.200181] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T19:34:45.204845] [INFO ] [REMOTE ] IHS: Full fetch complete (51661 records). [2025-10-17T19:34:45.205063] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-17T19:34:45.565467] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-17T19:34:45.610926] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-17T19:34:45.611010] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-17T19:34:45.611847] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-17T19:34:45.611909] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-17T19:34:45.613036] [DEBUG] [LOCAL ] IHS: Trimmed 51661 records to 38062 (keeping 200 days of data) [2025-10-17T19:34:45.826594] [DEBUG] [LOCAL ] IHS: Primary data saved (38062 records). [2025-10-17T19:34:45.826781] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-17T19:34:45.826934] [INFO ] [MAIN ] Update Progress: 1102/2368 symbols completed. IHS took 44.4s. Estimated remaining: 2h 57m 43s. Rate: 7.1 symbols/min [2025-10-17T19:34:45.936087] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T19:34:46.007412] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:34:46.049021] [DEBUG] [LOCAL ] IMAX: Loaded 43543 existing records from primary storage. [2025-10-17T19:34:46.049303] [INFO ] [MAIN ] IMAX: Loaded 43543 existing records. [2025-10-17T19:34:46.220666] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:34:46.220868] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-17T19:34:46.220915] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-17T19:34:46.221225] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-17T19:34:46.221278] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-17T19:34:46.366357] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-17T19:34:46.590260] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:34:47.134613] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T19:34:47.157995] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-17T19:34:47.452817] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T19:34:47.958027] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-17T19:34:48.465171] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T19:34:48.758005] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-17T19:34:48.888815] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-17T19:34:49.558029] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-17T19:34:49.785527] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T19:34:50.269698] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-17T19:34:50.358000] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-17T19:34:51.158015] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-17T19:34:51.701975] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T19:34:51.958019] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-17T19:34:52.104328] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T19:34:52.758038] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-17T19:34:53.410921] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T19:34:53.558031] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-17T19:34:54.365266] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-17T19:34:54.371274] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T19:34:54.387293] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-17T19:34:55.157995] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-17T19:34:55.279674] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T19:34:55.958019] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-17T19:34:56.107037] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T19:34:56.109595] [INFO ] [REMOTE ] IIIN: Full fetch complete (24807 records). [2025-10-17T19:34:56.109691] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-17T19:34:56.465409] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-17T19:34:56.465483] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-17T19:34:56.465949] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-17T19:34:56.466010] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-17T19:34:56.466591] [DEBUG] [LOCAL ] IIIN: Trimmed 24807 records to 16427 (keeping 200 days of data) [2025-10-17T19:34:56.567114] [DEBUG] [LOCAL ] IIIN: Primary data saved (16427 records). [2025-10-17T19:34:56.567244] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-17T19:34:56.567341] [INFO ] [MAIN ] Update Progress: 1103/2368 symbols completed. IIIN took 29.9s. Estimated remaining: 2h 57m 37s. Rate: 7.1 symbols/min [2025-10-17T19:34:56.736331] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:34:56.761258] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-17T19:34:56.783455] [DEBUG] [LOCAL ] INFA: Loaded 49327 existing records from primary storage. [2025-10-17T19:34:56.783831] [INFO ] [MAIN ] INFA: Loaded 49327 existing records. [2025-10-17T19:34:56.967692] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:34:56.967887] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-17T19:34:56.967957] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-17T19:34:56.968802] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-17T19:34:56.968869] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-17T19:34:57.326819] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:34:57.346872] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T19:34:57.558000] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-17T19:34:58.054172] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T19:34:58.358038] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-17T19:34:58.622540] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T19:34:59.158021] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-17T19:34:59.958019] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-17T19:35:00.073482] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-17T19:35:00.572199] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T19:35:00.577070] [INFO ] [REMOTE ] IIPR: Full fetch complete (44034 records). [2025-10-17T19:35:00.577159] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-17T19:35:00.764565] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-17T19:35:00.954564] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-17T19:35:00.954657] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-17T19:35:00.955424] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-17T19:35:00.955468] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-17T19:35:00.957263] [DEBUG] [LOCAL ] IIPR: Trimmed 44034 records to 29862 (keeping 200 days of data) [2025-10-17T19:35:01.155355] [DEBUG] [LOCAL ] IIPR: Primary data saved (29862 records). [2025-10-17T19:35:01.155522] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-17T19:35:01.155614] [INFO ] [MAIN ] Update Progress: 1104/2368 symbols completed. IIPR took 28.9s. Estimated remaining: 2h 57m 25s. Rate: 7.1 symbols/min [2025-10-17T19:35:01.333969] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:35:01.394958] [DEBUG] [LOCAL ] INFY: Loaded 53987 existing records from primary storage. [2025-10-17T19:35:01.395296] [INFO ] [MAIN ] INFY: Loaded 53987 existing records. [2025-10-17T19:35:01.572394] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T19:35:01.577858] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-17T19:35:01.614153] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:35:01.614787] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-17T19:35:01.614845] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-17T19:35:01.615192] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-17T19:35:01.615250] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-17T19:35:01.983500] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:35:02.358038] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-17T19:35:03.158041] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-17T19:35:03.237504] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-17T19:35:03.560502] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-17T19:35:03.927846] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-17T19:35:03.957988] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-17T19:35:04.758029] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-17T19:35:05.259984] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-17T19:35:05.558021] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-17T19:35:05.994695] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-17T19:35:06.301158] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T19:35:06.358092] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-17T19:35:07.158053] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-17T19:35:07.433759] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T19:35:07.436607] [INFO ] [REMOTE ] IIM: Full fetch complete (25064 records). [2025-10-17T19:35:07.436727] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-17T19:35:07.829767] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-17T19:35:07.829913] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-17T19:35:07.830478] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-17T19:35:07.830553] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-17T19:35:07.841528] [DEBUG] [LOCAL ] IIM: Trimmed 25064 records to 15903 (keeping 200 days of data) [2025-10-17T19:35:07.860324] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-17T19:35:07.960684] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-17T19:35:07.965220] [DEBUG] [LOCAL ] IIM: Primary data saved (15903 records). [2025-10-17T19:35:07.965322] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-17T19:35:07.965455] [INFO ] [MAIN ] Update Progress: 1105/2368 symbols completed. IIM took 39.7s. Estimated remaining: 2h 57m 14s. Rate: 7.1 symbols/min [2025-10-17T19:35:08.139854] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:35:08.190742] [DEBUG] [LOCAL ] ING: Loaded 51112 existing records from primary storage. [2025-10-17T19:35:08.191054] [INFO ] [MAIN ] ING: Loaded 51112 existing records. [2025-10-17T19:35:08.370148] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:35:08.370466] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-17T19:35:08.370555] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-17T19:35:08.371161] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-17T19:35:08.371272] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-17T19:35:08.623029] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T19:35:08.764097] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-17T19:35:08.770149] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:35:09.563156] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-17T19:35:09.577675] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T19:35:10.036375] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T19:35:10.358072] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-17T19:35:11.158086] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-17T19:35:11.625042] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-17T19:35:11.678358] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-17T19:35:11.958152] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-17T19:35:12.758080] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-17T19:35:12.995962] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-17T19:35:13.558035] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-17T19:35:13.666808] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T19:35:14.218564] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T19:35:14.358035] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-17T19:35:15.158032] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-17T19:35:15.455834] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T19:35:15.595862] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T19:35:15.958083] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-17T19:35:16.758089] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-17T19:35:16.792137] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T19:35:17.558003] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-17T19:35:17.790066] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T19:35:18.358011] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-17T19:35:18.549600] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T19:35:19.087236] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T19:35:19.157997] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-17T19:35:19.958018] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-17T19:35:20.159273] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T19:35:20.675108] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T19:35:20.758024] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-17T19:35:21.293068] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T19:35:21.558025] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-17T19:35:22.358019] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-17T19:35:22.440676] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T19:35:23.158010] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-17T19:35:23.218930] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T19:35:23.958101] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-17T19:35:24.045126] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T19:35:24.490141] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T19:35:24.758092] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-17T19:35:25.558060] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-17T19:35:25.723631] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T19:35:26.224708] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T19:35:26.358040] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-17T19:35:27.158077] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-17T19:35:27.224189] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T19:35:27.230796] [INFO ] [REMOTE ] IMAX: Full fetch complete (60843 records). [2025-10-17T19:35:27.230962] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-17T19:35:27.622357] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-17T19:35:27.622438] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-17T19:35:27.623326] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-17T19:35:27.623390] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-17T19:35:27.624831] [DEBUG] [LOCAL ] IMAX: Trimmed 60843 records to 43881 (keeping 200 days of data) [2025-10-17T19:35:27.874948] [DEBUG] [LOCAL ] IMAX: Primary data saved (43881 records). [2025-10-17T19:35:27.875084] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-17T19:35:27.875163] [INFO ] [MAIN ] Update Progress: 1106/2368 symbols completed. IMAX took 42.0s. Estimated remaining: 2h 57m 19s. Rate: 7.1 symbols/min [2025-10-17T19:35:27.965816] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-17T19:35:28.079867] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:35:28.111200] [DEBUG] [LOCAL ] INGM: Loaded 28536 existing records from primary storage. [2025-10-17T19:35:28.111495] [INFO ] [MAIN ] INGM: Loaded 28536 existing records. [2025-10-17T19:35:28.297214] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:35:28.297589] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-17T19:35:28.297713] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-17T19:35:28.298038] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-17T19:35:28.298113] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-17T19:35:28.519504] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-17T19:35:28.703346] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:35:28.757994] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-17T19:35:28.827950] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T19:35:29.450030] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T19:35:29.558031] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-17T19:35:30.158226] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T19:35:30.358053] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-17T19:35:31.158005] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-17T19:35:31.365829] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T19:35:31.958074] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-17T19:35:32.182464] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T19:35:32.584951] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T19:35:32.591003] [INFO ] [REMOTE ] INFA: Full fetch complete (70935 records). [2025-10-17T19:35:32.591142] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-17T19:35:32.765494] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-17T19:35:32.984342] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-17T19:35:32.984470] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-17T19:35:32.985496] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-17T19:35:32.985582] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-17T19:35:32.986954] [DEBUG] [LOCAL ] INFA: Trimmed 70935 records to 49646 (keeping 200 days of data) [2025-10-17T19:35:33.269773] [DEBUG] [LOCAL ] INFA: Primary data saved (49646 records). [2025-10-17T19:35:33.269919] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-17T19:35:33.270777] [INFO ] [MAIN ] Update Progress: 1107/2368 symbols completed. INFA took 36.7s. Estimated remaining: 2h 57m 7s. Rate: 7.1 symbols/min [2025-10-17T19:35:33.445155] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:35:33.480434] [DEBUG] [LOCAL ] INGR: Loaded 34043 existing records from primary storage. [2025-10-17T19:35:33.480868] [INFO ] [MAIN ] INGR: Loaded 34043 existing records. [2025-10-17T19:35:33.559412] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-17T19:35:33.660549] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:35:33.660862] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-17T19:35:33.660932] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-17T19:35:33.671265] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-17T19:35:33.685326] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-17T19:35:33.756237] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T19:35:34.064028] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T19:35:34.171018] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:35:34.358107] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-17T19:35:35.158055] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-17T19:35:35.501102] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T19:35:35.508370] [INFO ] [REMOTE ] INFY: Full fetch complete (77737 records). [2025-10-17T19:35:35.508495] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-17T19:35:35.896896] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-17T19:35:35.916286] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-17T19:35:35.917439] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-17T19:35:35.917524] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-17T19:35:35.919844] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T19:35:35.928533] [DEBUG] [LOCAL ] INFY: Trimmed 77737 records to 54376 (keeping 200 days of data) [2025-10-17T19:35:35.983056] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-17T19:35:36.260969] [DEBUG] [LOCAL ] INFY: Primary data saved (54376 records). [2025-10-17T19:35:36.261134] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-17T19:35:36.261219] [INFO ] [MAIN ] Update Progress: 1108/2368 symbols completed. INFY took 35.1s. Estimated remaining: 2h 56m 53s. Rate: 7.1 symbols/min [2025-10-17T19:35:36.439982] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:35:36.477535] [DEBUG] [LOCAL ] INN: Loaded 42104 existing records from primary storage. [2025-10-17T19:35:36.477918] [INFO ] [MAIN ] INN: Loaded 42104 existing records. [2025-10-17T19:35:36.659753] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:35:36.660055] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-17T19:35:36.660128] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-17T19:35:36.660971] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-17T19:35:36.661033] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-17T19:35:36.763684] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-17T19:35:37.064164] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:35:37.066864] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T19:35:37.545735] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T19:35:37.557988] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-17T19:35:38.023222] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T19:35:38.358048] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-17T19:35:39.038776] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T19:35:39.158040] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-17T19:35:39.797084] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T19:35:39.958054] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-17T19:35:40.659320] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T19:35:40.757995] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-17T19:35:41.557993] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-17T19:35:41.622330] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T19:35:42.020729] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T19:35:42.358016] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-17T19:35:43.158077] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-17T19:35:43.191109] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T19:35:43.770593] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-17T19:35:43.958086] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-17T19:35:44.614040] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T19:35:44.758033] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-17T19:35:45.318797] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T19:35:45.558097] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-17T19:35:46.357994] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-17T19:35:46.659772] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T19:35:46.666983] [INFO ] [REMOTE ] ING: Full fetch complete (73828 records). [2025-10-17T19:35:46.667192] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-17T19:35:46.982346] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T19:35:47.081220] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-17T19:35:47.081294] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-17T19:35:47.082286] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-17T19:35:47.082350] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-17T19:35:47.083699] [DEBUG] [LOCAL ] ING: Trimmed 73828 records to 51494 (keeping 200 days of data) [2025-10-17T19:35:47.172274] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-17T19:35:47.394248] [DEBUG] [LOCAL ] ING: Primary data saved (51494 records). [2025-10-17T19:35:47.394375] [INFO ] [MAIN ] ING: Full history saved. [2025-10-17T19:35:47.394451] [INFO ] [MAIN ] Update Progress: 1109/2368 symbols completed. ING took 39.4s. Estimated remaining: 2h 56m 47s. Rate: 7.1 symbols/min [2025-10-17T19:35:47.570795] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:35:47.571041] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-17T19:35:47.571097] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-17T19:35:47.571208] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-17T19:35:47.571252] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-17T19:35:47.571328] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-17T19:35:47.571387] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-17T19:35:47.871548] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T19:35:47.957107] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:35:47.957984] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-17T19:35:48.162421] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:35:48.162750] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-17T19:35:48.162841] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:35:48.162940] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-17T19:35:48.163019] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:35:48.163081] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-17T19:35:48.163158] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-17T19:35:48.163212] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-17T19:35:48.163267] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-17T19:35:48.163329] [INFO ] [MAIN ] Update Progress: 1110/2368 symbols completed. INR took 0.8s. Estimated remaining: 2h 56m 30s. Rate: 7.1 symbols/min [2025-10-17T19:35:48.337514] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:35:48.373749] [DEBUG] [LOCAL ] INSP: Loaded 38596 existing records from primary storage. [2025-10-17T19:35:48.374054] [INFO ] [MAIN ] INSP: Loaded 38596 existing records. [2025-10-17T19:35:48.564266] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:35:48.564561] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-17T19:35:48.581858] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-17T19:35:48.583670] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T19:35:48.583724] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-17T19:35:48.590474] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-17T19:35:48.763245] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-17T19:35:48.958125] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:35:49.558032] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-17T19:35:50.303296] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T19:35:50.357996] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-17T19:35:50.907461] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T19:35:51.158045] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-17T19:35:51.889490] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T19:35:51.958015] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-17T19:35:52.624519] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T19:35:52.758066] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-17T19:35:53.311021] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T19:35:53.558080] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-17T19:35:53.894452] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T19:35:54.358129] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-17T19:35:54.938664] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T19:35:55.158049] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-17T19:35:55.178909] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-17T19:35:55.958021] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-17T19:35:56.758102] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-17T19:35:56.886339] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T19:35:57.558413] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-17T19:35:57.558274] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-17T19:35:58.001059] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T19:35:58.358077] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-17T19:35:59.080041] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T19:35:59.157980] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-17T19:35:59.713312] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T19:35:59.719080] [INFO ] [REMOTE ] INGR: Full fetch complete (50746 records). [2025-10-17T19:35:59.719212] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-17T19:35:59.963911] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-17T19:36:00.102719] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-17T19:36:00.102814] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-17T19:36:00.103629] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-17T19:36:00.103710] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-17T19:36:00.104879] [DEBUG] [LOCAL ] INGR: Trimmed 50746 records to 34266 (keeping 200 days of data) [2025-10-17T19:36:00.318676] [DEBUG] [LOCAL ] INGR: Primary data saved (34266 records). [2025-10-17T19:36:00.318837] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-17T19:36:00.319339] [INFO ] [MAIN ] Update Progress: 1111/2368 symbols completed. INGR took 27.0s. Estimated remaining: 2h 56m 26s. Rate: 7.1 symbols/min [2025-10-17T19:36:00.492484] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:36:00.531504] [DEBUG] [LOCAL ] INSW: Loaded 39916 existing records from primary storage. [2025-10-17T19:36:00.531859] [INFO ] [MAIN ] INSW: Loaded 39916 existing records. [2025-10-17T19:36:00.680171] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T19:36:00.739823] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:36:00.740048] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-17T19:36:00.740095] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-17T19:36:00.740789] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-17T19:36:00.740847] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-17T19:36:00.763151] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-17T19:36:01.094306] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:36:01.523897] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T19:36:01.558029] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-17T19:36:02.358053] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-17T19:36:02.594084] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T19:36:03.158047] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-17T19:36:03.619750] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T19:36:03.623898] [INFO ] [REMOTE ] INGM: Full fetch complete (41842 records). [2025-10-17T19:36:03.623977] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-17T19:36:03.973479] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-17T19:36:04.034259] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-17T19:36:04.034363] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-17T19:36:04.035142] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-17T19:36:04.035223] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-17T19:36:04.037979] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-17T19:36:04.048068] [DEBUG] [LOCAL ] INGM: Trimmed 41842 records to 28706 (keeping 200 days of data) [2025-10-17T19:36:04.215394] [DEBUG] [LOCAL ] INGM: Primary data saved (28706 records). [2025-10-17T19:36:04.215523] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-17T19:36:04.215603] [INFO ] [MAIN ] Update Progress: 1112/2368 symbols completed. INGM took 36.3s. Estimated remaining: 2h 56m 12s. Rate: 7.1 symbols/min [2025-10-17T19:36:04.387684] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:36:04.436001] [DEBUG] [LOCAL ] INVH: Loaded 53585 existing records from primary storage. [2025-10-17T19:36:04.436300] [INFO ] [MAIN ] INVH: Loaded 53585 existing records. [2025-10-17T19:36:04.613275] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:36:04.613506] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-17T19:36:04.613563] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-17T19:36:04.614405] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-17T19:36:04.614462] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-17T19:36:04.759935] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-17T19:36:04.984974] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:36:05.009096] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T19:36:05.531525] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T19:36:05.558000] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-17T19:36:06.027853] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T19:36:06.358035] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-17T19:36:06.970244] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T19:36:07.158119] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-17T19:36:07.958109] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-17T19:36:08.046182] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T19:36:08.758073] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-17T19:36:08.799942] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T19:36:08.879053] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T19:36:09.558030] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-17T19:36:10.117796] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T19:36:10.358134] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-17T19:36:11.158040] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-17T19:36:11.431224] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-17T19:36:11.683845] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T19:36:11.958061] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-17T19:36:12.602213] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T19:36:12.758041] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-17T19:36:13.411687] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T19:36:13.558036] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-17T19:36:14.358077] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-17T19:36:14.413389] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T19:36:15.158106] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-17T19:36:15.288085] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T19:36:15.958391] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T19:36:15.958566] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-17T19:36:16.519100] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T19:36:16.758272] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-17T19:36:17.558040] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-17T19:36:17.595044] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T19:36:18.358077] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-17T19:36:18.586118] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T19:36:19.060767] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T19:36:19.066340] [INFO ] [REMOTE ] INN: Full fetch complete (57800 records). [2025-10-17T19:36:19.066492] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-17T19:36:19.163123] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-17T19:36:19.455509] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-17T19:36:19.455592] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-17T19:36:19.456517] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-17T19:36:19.456580] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-17T19:36:19.457886] [DEBUG] [LOCAL ] INN: Trimmed 57800 records to 42375 (keeping 200 days of data) [2025-10-17T19:36:19.705552] [DEBUG] [LOCAL ] INN: Primary data saved (42375 records). [2025-10-17T19:36:19.705710] [INFO ] [MAIN ] INN: Full history saved. [2025-10-17T19:36:19.705808] [INFO ] [MAIN ] Update Progress: 1113/2368 symbols completed. INN took 43.4s. Estimated remaining: 2h 56m 12s. Rate: 7.1 symbols/min [2025-10-17T19:36:19.881964] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:36:19.909736] [DEBUG] [LOCAL ] INVX: Loaded 29473 existing records from primary storage. [2025-10-17T19:36:19.910011] [INFO ] [MAIN ] INVX: Loaded 29473 existing records. [2025-10-17T19:36:19.965685] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-17T19:36:20.122170] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:36:20.124300] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T19:36:20.122954] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-17T19:36:20.133018] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-17T19:36:20.133950] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-17T19:36:20.134015] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-17T19:36:20.495907] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:36:20.758077] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-17T19:36:20.882716] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T19:36:20.888960] [INFO ] [REMOTE ] INSP: Full fetch complete (53820 records). [2025-10-17T19:36:20.889107] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-17T19:36:21.279939] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-17T19:36:21.280014] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-17T19:36:21.280859] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-17T19:36:21.280922] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-17T19:36:21.281967] [DEBUG] [LOCAL ] INSP: Trimmed 53820 records to 38922 (keeping 200 days of data) [2025-10-17T19:36:21.508148] [DEBUG] [LOCAL ] INSP: Primary data saved (38922 records). [2025-10-17T19:36:21.508275] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-17T19:36:21.508352] [INFO ] [MAIN ] Update Progress: 1114/2368 symbols completed. INSP took 33.3s. Estimated remaining: 2h 55m 56s. Rate: 7.1 symbols/min [2025-10-17T19:36:21.570985] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-17T19:36:21.689661] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:36:21.739855] [DEBUG] [LOCAL ] IONQ: Loaded 54178 existing records from primary storage. [2025-10-17T19:36:21.740151] [INFO ] [MAIN ] IONQ: Loaded 54178 existing records. [2025-10-17T19:36:21.909558] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T19:36:21.959899] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:36:21.960729] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-17T19:36:21.960818] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-17T19:36:21.961544] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-17T19:36:21.961603] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-17T19:36:22.227832] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T19:36:22.346039] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:36:22.357978] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-17T19:36:23.119331] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T19:36:23.158000] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-17T19:36:23.726774] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T19:36:23.958046] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-17T19:36:24.758032] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-17T19:36:24.918947] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T19:36:25.081852] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T19:36:25.558027] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-17T19:36:26.358086] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-17T19:36:26.814041] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T19:36:27.158023] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-17T19:36:27.424707] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-17T19:36:27.853336] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T19:36:27.958085] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-17T19:36:28.758020] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-17T19:36:28.936174] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T19:36:29.448565] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T19:36:29.558035] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-17T19:36:29.795991] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T19:36:30.358088] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-17T19:36:31.158069] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-17T19:36:31.812077] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T19:36:31.958026] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-17T19:36:32.083058] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-17T19:36:32.758058] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-17T19:36:32.983547] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T19:36:33.426224] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T19:36:33.431598] [INFO ] [REMOTE ] INSW: Full fetch complete (59863 records). [2025-10-17T19:36:33.431764] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-17T19:36:33.570597] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-17T19:36:33.820302] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-17T19:36:33.820380] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-17T19:36:33.821269] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-17T19:36:33.821369] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-17T19:36:33.822568] [DEBUG] [LOCAL ] INSW: Trimmed 59863 records to 40192 (keeping 200 days of data) [2025-10-17T19:36:34.066568] [DEBUG] [LOCAL ] INSW: Primary data saved (40192 records). [2025-10-17T19:36:34.066740] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-17T19:36:34.067676] [INFO ] [MAIN ] Update Progress: 1115/2368 symbols completed. INSW took 33.7s. Estimated remaining: 2h 55m 52s. Rate: 7.1 symbols/min [2025-10-17T19:36:34.242767] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:36:34.297808] [DEBUG] [LOCAL ] IOT: Loaded 53870 existing records from primary storage. [2025-10-17T19:36:34.298152] [INFO ] [MAIN ] IOT: Loaded 53870 existing records. [2025-10-17T19:36:34.365460] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-17T19:36:34.495816] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:36:34.496045] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-17T19:36:34.496095] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-17T19:36:34.497254] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-17T19:36:34.497359] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-17T19:36:34.881805] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:36:34.940255] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-17T19:36:34.941672] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-17T19:36:35.158079] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-17T19:36:35.958040] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-17T19:36:36.034628] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T19:36:36.758006] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-17T19:36:37.069639] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T19:36:37.558042] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-17T19:36:38.358092] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-17T19:36:38.560887] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T19:36:38.728310] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-10-17T19:36:38.773785] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T19:36:39.158134] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-17T19:36:39.778080] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T19:36:39.958043] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-17T19:36:40.066820] [DEBUG] [REMOTE ] INVX: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-17T19:36:40.067130] [WARN ] [REMOTE ] INVX: No data returned for month 2025-07 [2025-10-17T19:36:40.067221] [FATAL] [REMOTE ] INVX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:36:40.067343] [FATAL] [MAIN ] INVX: Failed to fetch primary data. [2025-10-17T19:36:40.067415] [WARN ] [MAIN ] INVX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:36:40.067486] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-17T19:36:40.067551] [DEBUG] [LOCAL ] INVX: No primary data file found to delete. [2025-10-17T19:36:40.067587] [INFO ] [LOCAL ] INVX: Starting deletion of derivative data. [2025-10-17T19:36:40.067757] [DEBUG] [LOCAL ] INVX: Deleted derivative data file. [2025-10-17T19:36:40.067841] [INFO ] [MAIN ] Update Progress: 1116/2368 symbols completed. INVX took 20.4s. Estimated remaining: 2h 55m 41s. Rate: 7.1 symbols/min [2025-10-17T19:36:40.240326] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:36:40.293383] [DEBUG] [LOCAL ] IP: Loaded 53697 existing records from primary storage. [2025-10-17T19:36:40.293799] [INFO ] [MAIN ] IP: Loaded 53697 existing records. [2025-10-17T19:36:40.469317] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:36:40.469534] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-17T19:36:40.469613] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-17T19:36:40.470156] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-17T19:36:40.470217] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-17T19:36:40.763200] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-17T19:36:40.839131] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:36:40.947440] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T19:36:40.954756] [INFO ] [REMOTE ] INVH: Full fetch complete (76970 records). [2025-10-17T19:36:40.954874] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-17T19:36:41.337217] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-17T19:36:41.337299] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-17T19:36:41.338590] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-17T19:36:41.338865] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-17T19:36:41.340284] [DEBUG] [LOCAL ] INVH: Trimmed 76970 records to 53973 (keeping 200 days of data) [2025-10-17T19:36:41.566875] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-17T19:36:41.663858] [DEBUG] [LOCAL ] INVH: Primary data saved (53973 records). [2025-10-17T19:36:41.664021] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-17T19:36:41.664105] [INFO ] [MAIN ] Update Progress: 1117/2368 symbols completed. INVH took 37.4s. Estimated remaining: 2h 55m 25s. Rate: 7.1 symbols/min [2025-10-17T19:36:42.358033] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-17T19:36:43.315757] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T19:36:43.325909] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-17T19:36:43.554915] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-17T19:36:43.958099] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-17T19:36:44.464420] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-17T19:36:44.758028] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-17T19:36:45.385046] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T19:36:45.558021] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-17T19:36:46.540007] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T19:36:46.550697] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-17T19:36:46.645360] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-17T19:36:47.035670] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T19:36:47.158027] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-17T19:36:47.958054] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-17T19:36:48.089939] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T19:36:48.586261] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T19:36:48.758012] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-17T19:36:49.558030] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-17T19:36:50.598209] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-17T19:36:50.609960] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-17T19:36:50.663576] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T19:36:51.158027] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-17T19:36:51.237242] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T19:36:51.958027] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-17T19:36:53.158243] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-17T19:36:53.169338] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-17T19:36:53.362204] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-17T19:36:53.559518] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-17T19:36:53.566015] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T19:36:54.358085] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-17T19:36:55.031551] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T19:36:55.157997] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-17T19:36:56.191828] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-17T19:36:56.205369] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-17T19:36:56.323556] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-17T19:36:56.758004] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-17T19:36:56.893975] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T19:36:57.558054] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-17T19:36:58.706490] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T19:36:58.718063] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-17T19:36:58.751973] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-17T19:36:59.158012] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-17T19:36:59.457902] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T19:36:59.958025] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-17T19:37:00.813018] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-17T19:37:00.820352] [INFO ] [REMOTE ] IOT: Full fetch complete (77555 records). [2025-10-17T19:37:00.820475] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-17T19:37:01.219705] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-17T19:37:01.219796] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-17T19:37:01.220899] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-17T19:37:01.220975] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-17T19:37:01.222458] [DEBUG] [LOCAL ] IOT: Trimmed 77555 records to 54260 (keeping 200 days of data) [2025-10-17T19:37:01.538777] [DEBUG] [LOCAL ] IOT: Primary data saved (54260 records). [2025-10-17T19:37:01.539014] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-17T19:37:01.539127] [INFO ] [MAIN ] Update Progress: 1118/2368 symbols completed. IOT took 27.5s. Estimated remaining: 2h 55m 30s. Rate: 7.1 symbols/min [2025-10-17T19:37:02.080271] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-17T19:37:02.092808] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-17T19:37:02.430096] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (3.27 seconds). [2025-10-17T19:37:02.438185] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-17T19:37:02.438389] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-17T19:37:02.852477] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-17T19:37:02.852563] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-17T19:37:02.853578] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-17T19:37:02.853665] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-17T19:37:02.855132] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54568 (keeping 200 days of data) [2025-10-17T19:37:03.182725] [DEBUG] [LOCAL ] IONQ: Primary data saved (54568 records). [2025-10-17T19:37:03.182953] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-17T19:37:03.183121] [INFO ] [MAIN ] Update Progress: 1119/2368 symbols completed. IONQ took 41.7s. Estimated remaining: 2h 55m 14s. Rate: 7.1 symbols/min [2025-10-17T19:37:03.893682] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T19:37:03.908423] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-17T19:37:05.818892] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-17T19:37:05.826294] [INFO ] [REMOTE ] IP: Full fetch complete (77394 records). [2025-10-17T19:37:05.826433] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-17T19:37:06.218168] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-17T19:37:06.218273] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-17T19:37:06.219288] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-17T19:37:06.219351] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-17T19:37:06.220789] [DEBUG] [LOCAL ] IP: Trimmed 77394 records to 54087 (keeping 200 days of data) [2025-10-17T19:37:06.552594] [DEBUG] [LOCAL ] IP: Primary data saved (54087 records). [2025-10-17T19:37:06.552795] [INFO ] [MAIN ] IP: Full history saved. [2025-10-17T19:37:06.552945] [INFO ] [MAIN ] Update Progress: 1120/2368 symbols completed. IP took 26.5s. Estimated remaining: 2h 54m 60s. Rate: 7.1 symbols/min [2025-10-17T19:37:07.155104] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:07.220171] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:07.256314] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:07.259916] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:07.285808] [DEBUG] [LOCAL ] IPI: Loaded 21575 existing records from primary storage. [2025-10-17T19:37:07.286435] [INFO ] [MAIN ] IPI: Loaded 21575 existing records. [2025-10-17T19:37:07.323868] [DEBUG] [LOCAL ] IQI: Loaded 17994 existing records from primary storage. [2025-10-17T19:37:07.358337] [INFO ] [MAIN ] IQI: Loaded 17994 existing records. [2025-10-17T19:37:07.706011] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:07.707401] [DEBUG] [LOCAL ] IPG: Loaded 53721 existing records from primary storage. [2025-10-17T19:37:07.706517] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-17T19:37:07.707791] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-17T19:37:07.707925] [INFO ] [MAIN ] IPG: Loaded 53721 existing records. [2025-10-17T19:37:07.713143] [DEBUG] [LOCAL ] IQV: Loaded 50425 existing records from primary storage. [2025-10-17T19:37:07.736304] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-17T19:37:07.756251] [INFO ] [MAIN ] IQV: Loaded 50425 existing records. [2025-10-17T19:37:07.741740] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-17T19:37:07.776004] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:07.841983] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-17T19:37:07.938188] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-17T19:37:08.082804] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-17T19:37:08.140249] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:08.174320] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-17T19:37:08.198677] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-17T19:37:08.231348] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-17T19:37:08.231274] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:08.280770] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-17T19:37:08.293678] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-17T19:37:08.328965] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-17T19:37:08.298926] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-17T19:37:08.361799] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-17T19:37:08.356617] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-17T19:37:08.926549] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:08.981104] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-17T19:37:09.381750] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:09.414295] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-17T19:37:09.576901] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:09.571373] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:09.577204] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-17T19:37:09.577502] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-17T19:37:10.144097] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T19:37:10.147841] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-17T19:37:10.796921] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T19:37:10.801665] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-17T19:37:11.104299] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-17T19:37:11.108466] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-17T19:37:11.286139] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T19:37:11.296066] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-17T19:37:11.678858] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-17T19:37:11.698045] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-17T19:37:11.703160] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-17T19:37:11.714296] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-17T19:37:11.881889] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T19:37:11.886347] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-17T19:37:12.770584] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T19:37:12.780248] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-17T19:37:12.838683] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T19:37:12.843992] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-17T19:37:12.953925] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T19:37:12.958845] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-17T19:37:13.502857] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T19:37:13.547416] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T19:37:13.557974] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-17T19:37:13.953499] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-17T19:37:14.220208] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-17T19:37:14.358012] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-17T19:37:14.401817] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T19:37:15.158038] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-17T19:37:15.957993] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-17T19:37:16.060761] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T19:37:16.758034] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-17T19:37:17.061351] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T19:37:17.151049] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-17T19:37:17.558068] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-17T19:37:18.358027] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-17T19:37:18.520089] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T19:37:19.158050] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-17T19:37:19.254255] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T19:37:19.291008] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T19:37:19.958073] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-17T19:37:20.217930] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T19:37:20.758035] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-17T19:37:21.093678] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T19:37:21.558008] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-17T19:37:21.849425] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T19:37:22.358027] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-17T19:37:23.158013] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-17T19:37:23.323228] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-17T19:37:23.373353] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T19:37:23.958028] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-17T19:37:24.758077] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-17T19:37:25.004597] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T19:37:25.037428] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T19:37:25.558000] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-17T19:37:26.317587] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:37:26.357982] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-17T19:37:26.584481] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T19:37:27.158023] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-17T19:37:27.958070] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-17T19:37:28.040341] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T19:37:28.396778] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T19:37:28.400547] [INFO ] [REMOTE ] IPI: Full fetch complete (30124 records). [2025-10-17T19:37:28.400672] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-17T19:37:28.764077] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-17T19:37:28.767231] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-17T19:37:28.767348] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-17T19:37:28.768032] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-17T19:37:28.768094] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-17T19:37:28.769054] [DEBUG] [LOCAL ] IPI: Trimmed 30124 records to 21783 (keeping 200 days of data) [2025-10-17T19:37:28.896086] [DEBUG] [LOCAL ] IPI: Primary data saved (21783 records). [2025-10-17T19:37:28.896229] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-17T19:37:28.896313] [INFO ] [MAIN ] Update Progress: 1121/2368 symbols completed. IPI took 22.3s. Estimated remaining: 2h 55m 7s. Rate: 7.1 symbols/min [2025-10-17T19:37:29.066347] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:29.123101] [DEBUG] [LOCAL ] IR: Loaded 53164 existing records from primary storage. [2025-10-17T19:37:29.123479] [INFO ] [MAIN ] IR: Loaded 53164 existing records. [2025-10-17T19:37:29.306965] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:29.307305] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-17T19:37:29.307449] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-17T19:37:29.308351] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-17T19:37:29.308425] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-17T19:37:29.489430] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T19:37:29.565328] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-17T19:37:29.760592] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:29.769160] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T19:37:30.358029] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-17T19:37:31.158031] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-17T19:37:31.409035] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T19:37:31.958085] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-17T19:37:32.184742] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T19:37:32.757997] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-17T19:37:32.945815] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T19:37:33.558008] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-17T19:37:33.607954] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T19:37:34.358013] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-17T19:37:34.527096] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T19:37:34.575375] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T19:37:35.158057] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-17T19:37:35.958096] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-17T19:37:36.061296] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T19:37:36.758056] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-17T19:37:36.866809] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T19:37:37.558039] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-17T19:37:37.643193] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T19:37:38.357993] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-17T19:37:38.511460] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T19:37:38.514627] [INFO ] [REMOTE ] IQI: Full fetch complete (26483 records). [2025-10-17T19:37:38.514751] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-17T19:37:38.718602] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-17T19:37:38.805256] [INFO ] [REMOTE ] IQV: Full fetch complete (72431 records). [2025-10-17T19:37:38.829914] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-17T19:37:39.079698] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-17T19:37:39.081130] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-17T19:37:39.115841] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-17T19:37:39.161697] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-17T19:37:39.161804] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-17T19:37:39.213146] [DEBUG] [LOCAL ] IQI: Trimmed 26483 records to 18096 (keeping 200 days of data) [2025-10-17T19:37:39.401786] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-17T19:37:39.402122] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-17T19:37:39.403163] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-17T19:37:39.404063] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-17T19:37:39.413361] [DEBUG] [LOCAL ] IQV: Trimmed 72431 records to 50750 (keeping 200 days of data) [2025-10-17T19:37:39.528040] [DEBUG] [LOCAL ] IQI: Primary data saved (18096 records). [2025-10-17T19:37:39.528959] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-17T19:37:39.529303] [INFO ] [MAIN ] Update Progress: 1122/2368 symbols completed. IQI took 33.0s. Estimated remaining: 2h 55m 1s. Rate: 7.1 symbols/min [2025-10-17T19:37:39.716269] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:39.927898] [DEBUG] [LOCAL ] IQV: Primary data saved (50750 records). [2025-10-17T19:37:39.928287] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-17T19:37:39.940723] [INFO ] [MAIN ] Update Progress: 1123/2368 symbols completed. IQV took 33.4s. Estimated remaining: 2h 54m 43s. Rate: 7.1 symbols/min [2025-10-17T19:37:39.943713] [DEBUG] [LOCAL ] IRM: Loaded 49463 existing records from primary storage. [2025-10-17T19:37:39.974564] [INFO ] [MAIN ] IRM: Loaded 49463 existing records. [2025-10-17T19:37:40.259213] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:40.332516] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:40.333087] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-17T19:37:40.335100] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-17T19:37:40.335287] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-17T19:37:40.346054] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-17T19:37:40.347006] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-17T19:37:40.347078] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-17T19:37:40.467086] [DEBUG] [LOCAL ] IRS: Loaded 23269 existing records from primary storage. [2025-10-17T19:37:40.478160] [INFO ] [MAIN ] IRS: Loaded 23269 existing records. [2025-10-17T19:37:40.871382] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:40.889296] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-17T19:37:40.889428] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-17T19:37:40.918257] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:40.918782] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-17T19:37:40.918886] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-17T19:37:40.919110] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-17T19:37:41.203340] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-17T19:37:41.237909] [INFO ] [REMOTE ] IPG: Full fetch complete (77435 records). [2025-10-17T19:37:41.248344] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-17T19:37:41.416511] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:41.575795] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-17T19:37:41.710467] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-17T19:37:41.710695] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-17T19:37:41.711890] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-17T19:37:41.712011] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-17T19:37:41.713723] [DEBUG] [LOCAL ] IPG: Trimmed 77435 records to 54111 (keeping 200 days of data) [2025-10-17T19:37:41.990509] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T19:37:42.087599] [DEBUG] [LOCAL ] IPG: Primary data saved (54111 records). [2025-10-17T19:37:42.087747] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-17T19:37:42.087856] [INFO ] [MAIN ] Update Progress: 1124/2368 symbols completed. IPG took 35.5s. Estimated remaining: 2h 54m 28s. Rate: 7.1 symbols/min [2025-10-17T19:37:42.261816] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:42.295305] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T19:37:42.344791] [DEBUG] [LOCAL ] IRT: Loaded 50924 existing records from primary storage. [2025-10-17T19:37:42.345112] [INFO ] [MAIN ] IRT: Loaded 50924 existing records. [2025-10-17T19:37:42.365407] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-17T19:37:42.537548] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:42.537787] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-17T19:37:42.537842] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-17T19:37:42.538336] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-17T19:37:42.538403] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-17T19:37:42.841985] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T19:37:42.922174] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:43.158005] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-17T19:37:43.958000] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-17T19:37:44.154732] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T19:37:44.661179] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T19:37:44.758004] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-17T19:37:45.195330] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T19:37:45.558023] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-17T19:37:46.330056] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T19:37:46.357982] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-17T19:37:47.158002] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-17T19:37:47.319775] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T19:37:47.839089] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T19:37:47.958001] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-17T19:37:48.147023] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T19:37:48.758036] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-17T19:37:49.553697] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T19:37:49.563399] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-17T19:37:49.808788] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T19:37:50.358029] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-17T19:37:51.163107] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-17T19:37:51.182676] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T19:37:51.958044] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-17T19:37:52.090944] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T19:37:52.704576] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-17T19:37:52.758013] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-17T19:37:52.842616] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T19:37:53.558027] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-17T19:37:54.115594] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T19:37:54.358016] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-17T19:37:54.604161] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T19:37:55.158058] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-17T19:37:55.824228] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-17T19:37:55.957995] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-17T19:37:56.758037] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-17T19:37:57.020327] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T19:37:57.558004] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-17T19:37:57.772110] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:37:57.791297] [INFO ] [REMOTE ] IR: Full fetch complete (76494 records). [2025-10-17T19:37:57.791705] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-17T19:37:57.792718] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T19:37:58.182337] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-17T19:37:58.182441] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-17T19:37:58.183442] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-17T19:37:58.183504] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-17T19:37:58.185073] [DEBUG] [LOCAL ] IR: Trimmed 76494 records to 53548 (keeping 200 days of data) [2025-10-17T19:37:58.364122] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-17T19:37:58.510063] [DEBUG] [LOCAL ] IR: Primary data saved (53548 records). [2025-10-17T19:37:58.510192] [INFO ] [MAIN ] IR: Full history saved. [2025-10-17T19:37:58.510933] [INFO ] [MAIN ] Update Progress: 1125/2368 symbols completed. IR took 29.6s. Estimated remaining: 2h 54m 28s. Rate: 7.1 symbols/min [2025-10-17T19:37:58.678255] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:37:58.694813] [DEBUG] [LOCAL ] ISD: Loaded 15985 existing records from primary storage. [2025-10-17T19:37:58.695098] [INFO ] [MAIN ] ISD: Loaded 15985 existing records. [2025-10-17T19:37:58.879823] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:37:58.880014] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-17T19:37:58.880091] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-17T19:37:58.880551] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-17T19:37:58.880612] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-17T19:37:59.163113] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-17T19:37:59.256518] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:37:59.284060] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T19:37:59.958038] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-17T19:38:00.168446] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T19:38:00.299069] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T19:38:00.758057] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-17T19:38:01.558017] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-17T19:38:02.354265] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-17T19:38:02.358067] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-17T19:38:02.777804] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-17T19:38:02.810155] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T19:38:03.158070] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-17T19:38:03.958048] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-17T19:38:04.144023] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-17T19:38:04.298836] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T19:38:04.758083] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-17T19:38:05.309161] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:38:05.558053] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-17T19:38:06.357996] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-17T19:38:06.448792] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T19:38:06.467811] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T19:38:07.158032] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-17T19:38:07.453487] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T19:38:07.458034] [INFO ] [REMOTE ] IRS: Full fetch complete (32700 records). [2025-10-17T19:38:07.458191] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-17T19:38:07.850113] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-17T19:38:07.850188] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-17T19:38:07.850967] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-17T19:38:07.851032] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-17T19:38:07.852036] [DEBUG] [LOCAL ] IRS: Trimmed 32700 records to 23427 (keeping 200 days of data) [2025-10-17T19:38:07.959005] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-17T19:38:07.987914] [DEBUG] [LOCAL ] IRS: Primary data saved (23427 records). [2025-10-17T19:38:07.988054] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-17T19:38:07.988152] [INFO ] [MAIN ] Update Progress: 1126/2368 symbols completed. IRS took 28.0s. Estimated remaining: 2h 54m 21s. Rate: 7.1 symbols/min [2025-10-17T19:38:08.166602] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:38:08.205262] [DEBUG] [LOCAL ] IT: Loaded 42544 existing records from primary storage. [2025-10-17T19:38:08.205615] [INFO ] [MAIN ] IT: Loaded 42544 existing records. [2025-10-17T19:38:08.381000] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:38:08.381783] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-17T19:38:08.381835] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-17T19:38:08.382583] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-17T19:38:08.382664] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-17T19:38:08.759879] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-17T19:38:08.759811] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:38:08.891578] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T19:38:09.558053] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-17T19:38:09.728745] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T19:38:09.768599] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T19:38:10.358034] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-17T19:38:10.953210] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T19:38:11.158020] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-17T19:38:11.958034] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-17T19:38:12.136580] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T19:38:12.504245] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T19:38:12.758072] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-17T19:38:13.558003] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-17T19:38:13.600603] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T19:38:13.828772] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T19:38:14.358147] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-17T19:38:15.158014] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-17T19:38:15.427990] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T19:38:15.471281] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T19:38:15.958033] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-17T19:38:16.548409] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T19:38:16.758009] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-17T19:38:16.891459] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T19:38:17.558042] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-17T19:38:18.104309] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T19:38:18.358047] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-17T19:38:18.846976] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T19:38:19.158031] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-17T19:38:19.958013] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-17T19:38:20.122190] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T19:38:20.489800] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-17T19:38:20.758003] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-17T19:38:20.815941] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T19:38:21.558033] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-17T19:38:22.357995] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-17T19:38:22.466447] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T19:38:22.588178] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-17T19:38:22.595000] [INFO ] [REMOTE ] IRM: Full fetch complete (72285 records). [2025-10-17T19:38:22.595114] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-17T19:38:22.976411] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-17T19:38:22.976481] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-17T19:38:22.977509] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-17T19:38:22.977575] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-17T19:38:22.978909] [DEBUG] [LOCAL ] IRM: Trimmed 72285 records to 49820 (keeping 200 days of data) [2025-10-17T19:38:23.163493] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-17T19:38:23.284496] [DEBUG] [LOCAL ] IRM: Primary data saved (49820 records). [2025-10-17T19:38:23.284636] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-17T19:38:23.284770] [INFO ] [MAIN ] Update Progress: 1127/2368 symbols completed. IRM took 43.8s. Estimated remaining: 2h 54m 20s. Rate: 7.1 symbols/min [2025-10-17T19:38:23.448192] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:38:23.477994] [DEBUG] [LOCAL ] ITGR: Loaded 31563 existing records from primary storage. [2025-10-17T19:38:23.478276] [INFO ] [MAIN ] ITGR: Loaded 31563 existing records. [2025-10-17T19:38:23.652261] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:38:23.652501] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-17T19:38:23.652549] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-17T19:38:23.653347] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-17T19:38:23.653428] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-17T19:38:23.965552] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-17T19:38:24.062380] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:38:24.064159] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T19:38:24.071928] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T19:38:24.079118] [INFO ] [REMOTE ] IRT: Full fetch complete (72946 records). [2025-10-17T19:38:24.079220] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-17T19:38:24.453332] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-17T19:38:24.453412] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-17T19:38:24.454384] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-17T19:38:24.454448] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-17T19:38:24.455812] [DEBUG] [LOCAL ] IRT: Trimmed 72946 records to 51273 (keeping 200 days of data) [2025-10-17T19:38:24.758075] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-17T19:38:24.762226] [DEBUG] [LOCAL ] IRT: Primary data saved (51273 records). [2025-10-17T19:38:24.762402] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-17T19:38:24.762545] [INFO ] [MAIN ] Update Progress: 1128/2368 symbols completed. IRT took 42.7s. Estimated remaining: 2h 54m 4s. Rate: 7.1 symbols/min [2025-10-17T19:38:24.928664] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:38:24.960811] [DEBUG] [LOCAL ] ITT: Loaded 32949 existing records from primary storage. [2025-10-17T19:38:24.961084] [INFO ] [MAIN ] ITT: Loaded 32949 existing records. [2025-10-17T19:38:25.132785] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:38:25.133014] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-17T19:38:25.133062] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-17T19:38:25.133775] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-17T19:38:25.133845] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-17T19:38:25.486571] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:38:25.557985] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-17T19:38:25.691938] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T19:38:25.801598] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T19:38:26.358027] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-17T19:38:26.877553] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T19:38:27.158011] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-17T19:38:27.417705] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T19:38:27.958029] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-17T19:38:28.450103] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T19:38:28.758096] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-17T19:38:28.892476] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T19:38:28.895996] [INFO ] [REMOTE ] ISD: Full fetch complete (24138 records). [2025-10-17T19:38:28.896155] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-17T19:38:29.416003] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-17T19:38:29.416103] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-17T19:38:29.416761] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-17T19:38:29.416826] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-17T19:38:29.417755] [DEBUG] [LOCAL ] ISD: Trimmed 24138 records to 16121 (keeping 200 days of data) [2025-10-17T19:38:29.518084] [DEBUG] [LOCAL ] ISD: Primary data saved (16121 records). [2025-10-17T19:38:29.518247] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-17T19:38:29.518338] [INFO ] [MAIN ] Update Progress: 1129/2368 symbols completed. ISD took 31.0s. Estimated remaining: 2h 53m 52s. Rate: 7.1 symbols/min [2025-10-17T19:38:29.563603] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-17T19:38:29.707674] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:38:29.762313] [DEBUG] [LOCAL ] ITUB: Loaded 53720 existing records from primary storage. [2025-10-17T19:38:29.762629] [INFO ] [MAIN ] ITUB: Loaded 53720 existing records. [2025-10-17T19:38:29.950391] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:38:29.950810] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-17T19:38:29.950884] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-17T19:38:29.951436] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-17T19:38:29.951495] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-17T19:38:30.244226] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T19:38:30.325257] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:38:30.358022] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-17T19:38:30.510987] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T19:38:31.158030] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-17T19:38:31.380305] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T19:38:31.958146] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-17T19:38:32.699529] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T19:38:32.757994] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-17T19:38:33.374873] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T19:38:33.558050] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-17T19:38:33.910262] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-17T19:38:34.358033] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-17T19:38:35.158015] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-17T19:38:35.243892] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T19:38:35.958015] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-17T19:38:36.202631] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T19:38:36.693545] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T19:38:36.758015] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-17T19:38:37.558001] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-17T19:38:37.996893] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-17T19:38:38.358076] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-17T19:38:38.572766] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T19:38:39.146611] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T19:38:39.157986] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-17T19:38:39.928455] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T19:38:39.957980] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-17T19:38:40.404185] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T19:38:40.758083] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-17T19:38:41.418728] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T19:38:41.558045] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-17T19:38:42.109531] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T19:38:42.358029] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-17T19:38:43.158019] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-17T19:38:43.282135] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-17T19:38:43.958000] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-17T19:38:44.000046] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T19:38:44.037869] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T19:38:44.044014] [INFO ] [REMOTE ] IT: Full fetch complete (57583 records). [2025-10-17T19:38:44.044113] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-17T19:38:44.430909] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-17T19:38:44.431024] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-17T19:38:44.431902] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-17T19:38:44.431965] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-17T19:38:44.433119] [DEBUG] [LOCAL ] IT: Trimmed 57583 records to 42892 (keeping 200 days of data) [2025-10-17T19:38:44.681943] [DEBUG] [LOCAL ] IT: Primary data saved (42892 records). [2025-10-17T19:38:44.682071] [INFO ] [MAIN ] IT: Full history saved. [2025-10-17T19:38:44.682147] [INFO ] [MAIN ] Update Progress: 1130/2368 symbols completed. IT took 36.7s. Estimated remaining: 2h 53m 51s. Rate: 7.1 symbols/min [2025-10-17T19:38:44.763191] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-17T19:38:44.849315] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:38:44.888685] [DEBUG] [LOCAL ] ITW: Loaded 46082 existing records from primary storage. [2025-10-17T19:38:44.888973] [INFO ] [MAIN ] ITW: Loaded 46082 existing records. [2025-10-17T19:38:45.068353] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:38:45.068573] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-17T19:38:45.068630] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-17T19:38:45.069616] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-17T19:38:45.069708] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-17T19:38:45.423251] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:38:45.440709] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T19:38:45.557994] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-17T19:38:46.164161] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T19:38:46.357991] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-17T19:38:47.085466] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T19:38:47.158005] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-17T19:38:47.753132] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T19:38:47.958022] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-17T19:38:48.758034] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-17T19:38:48.939066] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T19:38:49.098166] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-17T19:38:49.558039] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-17T19:38:50.357998] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-17T19:38:50.395204] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T19:38:50.988907] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T19:38:51.157996] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-17T19:38:51.957996] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-17T19:38:52.171845] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T19:38:52.377158] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T19:38:52.758082] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-17T19:38:53.291231] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T19:38:53.558060] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-17T19:38:54.092365] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T19:38:54.097166] [INFO ] [REMOTE ] ITT: Full fetch complete (47401 records). [2025-10-17T19:38:54.097362] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-17T19:38:54.363251] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-17T19:38:54.491233] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-17T19:38:54.491325] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-17T19:38:54.492168] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-17T19:38:54.492344] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-17T19:38:54.493543] [DEBUG] [LOCAL ] ITT: Trimmed 47401 records to 33177 (keeping 200 days of data) [2025-10-17T19:38:54.703469] [DEBUG] [LOCAL ] ITT: Primary data saved (33177 records). [2025-10-17T19:38:54.703611] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-17T19:38:54.703728] [INFO ] [MAIN ] Update Progress: 1131/2368 symbols completed. ITT took 29.9s. Estimated remaining: 2h 53m 44s. Rate: 7.1 symbols/min [2025-10-17T19:38:54.889119] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:38:54.908027] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:38:54.953439] [DEBUG] [LOCAL ] IVR: Loaded 48437 existing records from primary storage. [2025-10-17T19:38:54.953798] [INFO ] [MAIN ] IVR: Loaded 48437 existing records. [2025-10-17T19:38:55.140245] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:38:55.140450] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-17T19:38:55.140498] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-17T19:38:55.140948] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-17T19:38:55.141006] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-17T19:38:55.163120] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-17T19:38:55.505485] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:38:55.878418] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T19:38:55.958003] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-17T19:38:56.599044] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T19:38:56.603436] [INFO ] [REMOTE ] ITGR: Full fetch complete (42898 records). [2025-10-17T19:38:56.603532] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-17T19:38:56.763631] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-17T19:38:57.010318] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-17T19:38:57.010399] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-17T19:38:57.011150] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-17T19:38:57.011212] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-17T19:38:57.012762] [DEBUG] [LOCAL ] ITGR: Trimmed 42898 records to 31722 (keeping 200 days of data) [2025-10-17T19:38:57.201620] [DEBUG] [LOCAL ] ITGR: Primary data saved (31722 records). [2025-10-17T19:38:57.201785] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-17T19:38:57.201885] [INFO ] [MAIN ] Update Progress: 1132/2368 symbols completed. ITGR took 33.9s. Estimated remaining: 2h 53m 29s. Rate: 7.1 symbols/min [2025-10-17T19:38:57.369501] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:38:57.400900] [DEBUG] [LOCAL ] IVT: Loaded 31572 existing records from primary storage. [2025-10-17T19:38:57.401158] [INFO ] [MAIN ] IVT: Loaded 31572 existing records. [2025-10-17T19:38:57.563671] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-17T19:38:57.585825] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:38:57.586115] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-17T19:38:57.586164] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-17T19:38:57.586441] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-17T19:38:57.586489] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-17T19:38:57.944223] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:38:57.973090] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-17T19:38:58.358011] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-17T19:38:58.700018] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T19:38:59.158001] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-17T19:38:59.320240] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T19:38:59.958052] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-17T19:38:59.994095] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T19:39:00.758074] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-17T19:39:01.558034] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-17T19:39:01.695560] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-17T19:39:02.358069] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-17T19:39:02.401398] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T19:39:02.467093] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-17T19:39:03.158129] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-17T19:39:03.219961] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T19:39:03.746387] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T19:39:03.958057] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-17T19:39:04.747497] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T19:39:04.758049] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-17T19:39:04.903587] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T19:39:05.558033] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-17T19:39:06.358011] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-17T19:39:06.517518] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T19:39:07.158014] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-17T19:39:07.237130] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T19:39:07.958037] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-17T19:39:08.175884] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T19:39:08.758077] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-17T19:39:09.044466] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T19:39:09.244456] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T19:39:09.558065] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-17T19:39:10.316224] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T19:39:10.358030] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-17T19:39:11.158032] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-17T19:39:11.824222] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-17T19:39:11.831504] [INFO ] [REMOTE ] ITUB: Full fetch complete (77318 records). [2025-10-17T19:39:11.831700] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-17T19:39:11.959098] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-17T19:39:12.207514] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T19:39:12.274239] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-17T19:39:12.274985] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-17T19:39:12.276114] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-17T19:39:12.276179] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-17T19:39:12.277962] [DEBUG] [LOCAL ] ITUB: Trimmed 77318 records to 54103 (keeping 200 days of data) [2025-10-17T19:39:12.499521] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T19:39:12.622607] [DEBUG] [LOCAL ] ITUB: Primary data saved (54103 records). [2025-10-17T19:39:12.622779] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-17T19:39:12.623606] [INFO ] [MAIN ] Update Progress: 1133/2368 symbols completed. ITUB took 43.1s. Estimated remaining: 2h 53m 28s. Rate: 7.1 symbols/min [2025-10-17T19:39:12.765102] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-17T19:39:12.798706] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:39:12.852325] [DEBUG] [LOCAL ] IVZ: Loaded 53506 existing records from primary storage. [2025-10-17T19:39:12.852693] [INFO ] [MAIN ] IVZ: Loaded 53506 existing records. [2025-10-17T19:39:13.030148] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:39:13.030413] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-17T19:39:13.030481] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-17T19:39:13.031411] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-17T19:39:13.031504] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-17T19:39:13.386847] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:39:13.558105] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-17T19:39:13.689284] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T19:39:14.237478] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T19:39:14.358038] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-17T19:39:15.158030] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-17T19:39:15.247350] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T19:39:15.254576] [INFO ] [REMOTE ] ITW: Full fetch complete (66724 records). [2025-10-17T19:39:15.254713] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-17T19:39:15.644496] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-17T19:39:15.644576] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-17T19:39:15.645512] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-17T19:39:15.645579] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-17T19:39:15.647085] [DEBUG] [LOCAL ] ITW: Trimmed 66724 records to 46398 (keeping 200 days of data) [2025-10-17T19:39:15.948611] [DEBUG] [LOCAL ] ITW: Primary data saved (46398 records). [2025-10-17T19:39:15.948887] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-17T19:39:15.949097] [INFO ] [MAIN ] Update Progress: 1134/2368 symbols completed. ITW took 31.3s. Estimated remaining: 2h 53m 14s. Rate: 7.1 symbols/min [2025-10-17T19:39:15.980262] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-17T19:39:16.128477] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T19:39:16.145305] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:39:16.176665] [DEBUG] [LOCAL ] IX: Loaded 22439 existing records from primary storage. [2025-10-17T19:39:16.176947] [INFO ] [MAIN ] IX: Loaded 22439 existing records. [2025-10-17T19:39:16.351011] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:39:16.351246] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-17T19:39:16.351297] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-17T19:39:16.351770] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-17T19:39:16.351870] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-17T19:39:16.719458] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:39:16.758019] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-17T19:39:17.070307] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T19:39:17.357839] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T19:39:17.558038] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-17T19:39:18.276467] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-17T19:39:18.358005] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-17T19:39:18.846035] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-17T19:39:19.158048] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-17T19:39:19.576574] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T19:39:19.958028] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-17T19:39:20.758112] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-17T19:39:20.813369] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-17T19:39:20.903751] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T19:39:21.558060] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-17T19:39:22.358092] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-17T19:39:22.426752] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T19:39:23.158095] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-17T19:39:23.188029] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-17T19:39:23.362183] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T19:39:23.958108] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-17T19:39:24.511512] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T19:39:24.758085] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-17T19:39:25.040680] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T19:39:25.558037] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-17T19:39:26.358008] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-17T19:39:26.656837] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T19:39:26.664275] [INFO ] [REMOTE ] IVR: Full fetch complete (69175 records). [2025-10-17T19:39:26.664429] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-17T19:39:26.995439] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-17T19:39:27.132132] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-17T19:39:27.132323] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-17T19:39:27.134088] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-17T19:39:27.134162] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-17T19:39:27.136150] [DEBUG] [LOCAL ] IVR: Trimmed 69175 records to 48761 (keeping 200 days of data) [2025-10-17T19:39:27.193195] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-17T19:39:27.359380] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-17T19:39:27.489036] [DEBUG] [LOCAL ] IVR: Primary data saved (48761 records). [2025-10-17T19:39:27.489226] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-17T19:39:27.489385] [INFO ] [MAIN ] Update Progress: 1135/2368 symbols completed. IVR took 32.8s. Estimated remaining: 2h 53m 9s. Rate: 7.1 symbols/min [2025-10-17T19:39:27.662077] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:39:27.705372] [DEBUG] [LOCAL ] J: Loaded 40700 existing records from primary storage. [2025-10-17T19:39:27.705790] [INFO ] [MAIN ] J: Loaded 40700 existing records. [2025-10-17T19:39:27.886808] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:39:27.887098] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-17T19:39:27.887150] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-17T19:39:27.888191] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-17T19:39:27.888259] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-17T19:39:27.966368] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-17T19:39:28.254199] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:39:28.758046] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-17T19:39:28.873323] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T19:39:29.506565] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T19:39:29.557983] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-17T19:39:30.139826] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T19:39:30.358043] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-17T19:39:30.710857] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T19:39:31.158055] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-17T19:39:31.843943] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T19:39:31.849180] [INFO ] [REMOTE ] IVT: Full fetch complete (45899 records). [2025-10-17T19:39:31.849267] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-17T19:39:31.963285] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-17T19:39:32.234487] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-17T19:39:32.234565] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-17T19:39:32.235362] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-17T19:39:32.235423] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-17T19:39:32.236424] [DEBUG] [LOCAL ] IVT: Trimmed 45899 records to 31836 (keeping 200 days of data) [2025-10-17T19:39:32.432533] [DEBUG] [LOCAL ] IVT: Primary data saved (31836 records). [2025-10-17T19:39:32.432734] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-17T19:39:32.432838] [INFO ] [MAIN ] Update Progress: 1136/2368 symbols completed. IVT took 35.2s. Estimated remaining: 2h 52m 57s. Rate: 7.1 symbols/min [2025-10-17T19:39:32.606521] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:39:32.648801] [DEBUG] [LOCAL ] JBGS: Loaded 42407 existing records from primary storage. [2025-10-17T19:39:32.649159] [INFO ] [MAIN ] JBGS: Loaded 42407 existing records. [2025-10-17T19:39:32.762617] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-17T19:39:32.831544] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:39:32.831905] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-17T19:39:32.832020] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-17T19:39:32.833260] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-17T19:39:32.833327] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-17T19:39:33.235963] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-17T19:39:33.233924] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:39:33.248422] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T19:39:33.558024] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-17T19:39:34.358030] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-17T19:39:34.439610] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T19:39:34.534604] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-17T19:39:35.158018] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-17T19:39:35.407849] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T19:39:35.958066] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-17T19:39:36.758019] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-17T19:39:37.012016] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T19:39:37.335079] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T19:39:37.352881] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T19:39:37.558038] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-17T19:39:38.358060] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-17T19:39:39.000410] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T19:39:39.072965] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T19:39:39.076946] [INFO ] [REMOTE ] IX: Full fetch complete (28358 records). [2025-10-17T19:39:39.077021] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-17T19:39:39.163217] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-17T19:39:39.445072] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-17T19:39:39.445161] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-17T19:39:39.445766] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-17T19:39:39.445826] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-17T19:39:39.447166] [DEBUG] [LOCAL ] IX: Trimmed 28358 records to 22572 (keeping 200 days of data) [2025-10-17T19:39:39.574015] [DEBUG] [LOCAL ] IX: Primary data saved (22572 records). [2025-10-17T19:39:39.574140] [INFO ] [MAIN ] IX: Full history saved. [2025-10-17T19:39:39.574239] [INFO ] [MAIN ] Update Progress: 1137/2368 symbols completed. IX took 23.6s. Estimated remaining: 2h 52m 47s. Rate: 7.1 symbols/min [2025-10-17T19:39:39.740834] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:39:39.778458] [DEBUG] [LOCAL ] JBI: Loaded 43293 existing records from primary storage. [2025-10-17T19:39:39.778789] [INFO ] [MAIN ] JBI: Loaded 43293 existing records. [2025-10-17T19:39:39.951394] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:39:39.951601] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-17T19:39:39.951677] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-17T19:39:39.952344] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-17T19:39:39.952417] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-17T19:39:39.963635] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-17T19:39:40.309108] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:39:40.557445] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T19:39:40.757990] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-17T19:39:41.438010] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T19:39:41.558003] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-17T19:39:42.351411] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T19:39:42.359825] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-17T19:39:43.065765] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T19:39:43.158002] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-17T19:39:43.963202] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-17T19:39:43.985751] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T19:39:44.695466] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T19:39:44.758048] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-17T19:39:45.558020] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-17T19:39:45.796715] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T19:39:46.358005] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-17T19:39:46.390599] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T19:39:47.069915] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T19:39:47.158037] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-17T19:39:47.906821] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T19:39:47.958037] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-17T19:39:48.758036] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-17T19:39:48.884729] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T19:39:49.534124] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T19:39:49.558019] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-17T19:39:50.299891] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T19:39:50.357991] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-17T19:39:51.161081] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-17T19:39:51.166603] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T19:39:51.391485] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T19:39:51.958224] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-17T19:39:52.758005] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-17T19:39:53.141528] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-17T19:39:53.518285] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:39:53.557994] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-17T19:39:54.358043] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-17T19:39:54.507479] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T19:39:55.056971] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T19:39:55.158070] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-17T19:39:55.958081] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-17T19:39:56.000477] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T19:39:56.700147] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T19:39:56.757992] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-17T19:39:57.123964] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T19:39:57.558042] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-17T19:39:58.187350] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T19:39:58.358012] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-17T19:39:59.104149] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T19:39:59.158055] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-17T19:39:59.808781] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T19:39:59.958003] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-17T19:40:00.758075] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-17T19:40:01.558123] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-17T19:40:01.644508] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T19:40:01.740942] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (2.58 seconds). [2025-10-17T19:40:01.749542] [INFO ] [REMOTE ] IVZ: Full fetch complete (77024 records). [2025-10-17T19:40:01.749856] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-17T19:40:02.184245] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-17T19:40:02.184341] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-17T19:40:02.185404] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-17T19:40:02.185469] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-17T19:40:02.186969] [DEBUG] [LOCAL ] IVZ: Trimmed 77024 records to 53895 (keeping 200 days of data) [2025-10-17T19:40:02.362391] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-17T19:40:02.516753] [DEBUG] [LOCAL ] IVZ: Primary data saved (53895 records). [2025-10-17T19:40:02.516910] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-17T19:40:02.517674] [INFO ] [MAIN ] Update Progress: 1138/2368 symbols completed. IVZ took 49.9s. Estimated remaining: 2h 52m 55s. Rate: 7.1 symbols/min [2025-10-17T19:40:02.698255] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:02.728268] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T19:40:02.780944] [DEBUG] [LOCAL ] JBL: Loaded 48716 existing records from primary storage. [2025-10-17T19:40:02.781279] [INFO ] [MAIN ] JBL: Loaded 48716 existing records. [2025-10-17T19:40:02.967186] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:40:02.967507] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-17T19:40:02.967578] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-17T19:40:02.967959] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-17T19:40:02.968032] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-17T19:40:03.159796] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-17T19:40:03.331136] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T19:40:03.382065] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:03.958017] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-17T19:40:04.286775] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T19:40:04.292808] [INFO ] [REMOTE ] JBGS: Full fetch complete (59299 records). [2025-10-17T19:40:04.293019] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-17T19:40:04.683581] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-17T19:40:04.683734] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-17T19:40:04.684769] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-17T19:40:04.684848] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-17T19:40:04.686104] [DEBUG] [LOCAL ] JBGS: Trimmed 59299 records to 42660 (keeping 200 days of data) [2025-10-17T19:40:04.773051] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-17T19:40:04.934195] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T19:40:04.992732] [DEBUG] [LOCAL ] JBGS: Primary data saved (42660 records). [2025-10-17T19:40:04.992879] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-17T19:40:04.992964] [INFO ] [MAIN ] Update Progress: 1139/2368 symbols completed. JBGS took 32.6s. Estimated remaining: 2h 52m 40s. Rate: 7.1 symbols/min [2025-10-17T19:40:05.168557] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:05.194923] [DEBUG] [LOCAL ] JBND: Loaded 27187 existing records from primary storage. [2025-10-17T19:40:05.195189] [INFO ] [MAIN ] JBND: Loaded 27187 existing records. [2025-10-17T19:40:05.373219] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:40:05.373482] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-17T19:40:05.373620] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-17T19:40:05.373950] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-17T19:40:05.374023] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-17T19:40:05.564471] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-17T19:40:05.585522] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T19:40:05.624122] [INFO ] [REMOTE ] JBI: Full fetch complete (63909 records). [2025-10-17T19:40:05.656398] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-17T19:40:05.929551] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:06.167527] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-17T19:40:06.167624] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-17T19:40:06.168740] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-17T19:40:06.168822] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-17T19:40:06.170292] [DEBUG] [LOCAL ] JBI: Trimmed 63909 records to 43558 (keeping 200 days of data) [2025-10-17T19:40:06.370126] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-17T19:40:06.426720] [DEBUG] [LOCAL ] JBI: Primary data saved (43558 records). [2025-10-17T19:40:06.426859] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-17T19:40:06.427681] [INFO ] [MAIN ] Update Progress: 1140/2368 symbols completed. JBI took 26.9s. Estimated remaining: 2h 52m 24s. Rate: 7.1 symbols/min [2025-10-17T19:40:06.609065] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:06.609470] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-17T19:40:06.609523] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-17T19:40:06.631495] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-17T19:40:06.634267] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-17T19:40:06.634529] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-17T19:40:06.635015] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-17T19:40:06.636040] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-17T19:40:07.005409] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:07.158006] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-17T19:40:07.184030] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T19:40:07.958065] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-17T19:40:08.076165] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T19:40:08.758050] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-17T19:40:08.932113] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T19:40:08.959068] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:40:08.959448] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-17T19:40:08.959561] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:40:08.959609] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-17T19:40:08.959672] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:40:08.959734] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-17T19:40:08.959795] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-17T19:40:08.959831] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-17T19:40:08.959871] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-17T19:40:08.959920] [INFO ] [MAIN ] Update Progress: 1141/2368 symbols completed. JBS took 2.5s. Estimated remaining: 2h 52m 9s. Rate: 7.1 symbols/min [2025-10-17T19:40:09.154120] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:09.154311] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-17T19:40:09.154351] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-17T19:40:09.154471] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-17T19:40:09.154514] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-17T19:40:09.154559] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-17T19:40:09.154593] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-17T19:40:09.562692] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-17T19:40:09.562551] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:09.628281] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T19:40:10.358090] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-17T19:40:10.529383] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T19:40:10.552287] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:40:10.552618] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-17T19:40:10.552734] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:40:10.552782] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-17T19:40:10.552815] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:40:10.552852] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-17T19:40:10.552909] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-17T19:40:10.552943] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-17T19:40:10.552982] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-17T19:40:10.553028] [INFO ] [MAIN ] Update Progress: 1142/2368 symbols completed. JBTM took 1.6s. Estimated remaining: 2h 51m 53s. Rate: 7.1 symbols/min [2025-10-17T19:40:10.720750] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:10.720920] [DEBUG] [LOCAL ] JCE: No existing data file found in primary storage. [2025-10-17T19:40:10.720957] [WARN ] [MAIN ] JCE: No existing data found, performing full refresh instead. [2025-10-17T19:40:10.721070] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-17T19:40:10.721111] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-17T19:40:10.721151] [DEBUG] [LOCAL ] JCE: No primary data file found to delete. [2025-10-17T19:40:10.721183] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-17T19:40:11.068009] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:11.158013] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-17T19:40:11.958068] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-17T19:40:12.025769] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T19:40:12.758127] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-17T19:40:12.889892] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T19:40:13.558029] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-17T19:40:14.238483] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T19:40:14.358027] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-17T19:40:14.485779] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T19:40:14.493433] [INFO ] [REMOTE ] J: Full fetch complete (59639 records). [2025-10-17T19:40:14.493619] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-17T19:40:15.068357] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-17T19:40:15.068474] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-17T19:40:15.069987] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-17T19:40:15.070101] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-17T19:40:15.071884] [DEBUG] [LOCAL ] J: Trimmed 59639 records to 41066 (keeping 200 days of data) [2025-10-17T19:40:15.161684] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-17T19:40:15.464044] [DEBUG] [LOCAL ] J: Primary data saved (41066 records). [2025-10-17T19:40:15.464228] [INFO ] [MAIN ] J: Full history saved. [2025-10-17T19:40:15.464333] [INFO ] [MAIN ] Update Progress: 1143/2368 symbols completed. J took 48.0s. Estimated remaining: 2h 51m 41s. Rate: 7.1 symbols/min [2025-10-17T19:40:15.614863] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-17T19:40:15.681775] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:15.735111] [DEBUG] [LOCAL ] JCI: Loaded 53916 existing records from primary storage. [2025-10-17T19:40:15.735460] [INFO ] [MAIN ] JCI: Loaded 53916 existing records. [2025-10-17T19:40:15.931466] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:40:15.931812] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-17T19:40:15.936410] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-17T19:40:15.936605] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-17T19:40:15.938497] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-17T19:40:15.939142] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-17T19:40:15.963194] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-17T19:40:16.318422] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:16.758045] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-17T19:40:17.244161] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T19:40:17.558052] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-17T19:40:18.225296] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-17T19:40:18.358069] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-17T19:40:18.744102] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T19:40:19.158082] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-17T19:40:19.945852] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-17T19:40:19.957992] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-17T19:40:19.996519] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T19:40:20.592596] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T19:40:20.758040] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-17T19:40:21.514473] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-17T19:40:21.558017] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-17T19:40:22.309823] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T19:40:22.358064] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-17T19:40:23.158064] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-17T19:40:23.504347] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T19:40:23.958051] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-17T19:40:24.758002] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-17T19:40:24.981787] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-17T19:40:25.080502] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T19:40:25.358141] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T19:40:25.558068] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-17T19:40:26.358043] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-17T19:40:27.158021] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-17T19:40:27.177514] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T19:40:27.446121] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T19:40:27.958081] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-17T19:40:28.371274] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-17T19:40:28.758070] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-17T19:40:29.558050] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-17T19:40:29.681894] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-17T19:40:29.684004] [INFO ] [REMOTE ] JCE: Full fetch complete (9741 records). [2025-10-17T19:40:29.684074] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-17T19:40:30.006143] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-17T19:40:30.084736] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-17T19:40:30.084816] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-17T19:40:30.085038] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-17T19:40:30.085075] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-17T19:40:30.085485] [DEBUG] [LOCAL ] JCE: Trimmed 9741 records to 7507 (keeping 200 days of data) [2025-10-17T19:40:30.131417] [DEBUG] [LOCAL ] JCE: Primary data saved (7507 records). [2025-10-17T19:40:30.131538] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-17T19:40:30.131608] [INFO ] [MAIN ] Update Progress: 1144/2368 symbols completed. JCE took 19.6s. Estimated remaining: 2h 51m 39s. Rate: 7.1 symbols/min [2025-10-17T19:40:30.296890] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:30.343169] [DEBUG] [LOCAL ] JEF: Loaded 50561 existing records from primary storage. [2025-10-17T19:40:30.343480] [INFO ] [MAIN ] JEF: Loaded 50561 existing records. [2025-10-17T19:40:30.363566] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-17T19:40:30.522574] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:40:30.522845] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-17T19:40:30.522900] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-17T19:40:30.523935] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-17T19:40:30.523995] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-17T19:40:30.881147] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:31.166424] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-17T19:40:31.185399] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T19:40:31.301762] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-17T19:40:31.958043] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-17T19:40:32.758051] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-17T19:40:32.794499] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T19:40:33.290557] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T19:40:33.558037] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-17T19:40:34.358019] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-17T19:40:34.535852] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T19:40:34.990483] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T19:40:34.995770] [INFO ] [REMOTE ] JBND: Full fetch complete (35748 records). [2025-10-17T19:40:34.995847] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-17T19:40:35.161984] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-17T19:40:35.388266] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-17T19:40:35.388339] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-17T19:40:35.389043] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-17T19:40:35.389107] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-17T19:40:35.389964] [DEBUG] [LOCAL ] JBND: Trimmed 35748 records to 27442 (keeping 200 days of data) [2025-10-17T19:40:35.559735] [DEBUG] [LOCAL ] JBND: Primary data saved (27442 records). [2025-10-17T19:40:35.560132] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-17T19:40:35.560220] [INFO ] [MAIN ] Update Progress: 1145/2368 symbols completed. JBND took 30.6s. Estimated remaining: 2h 51m 28s. Rate: 7.1 symbols/min [2025-10-17T19:40:35.730146] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:35.769466] [DEBUG] [LOCAL ] JELD: Loaded 46434 existing records from primary storage. [2025-10-17T19:40:35.769783] [INFO ] [MAIN ] JELD: Loaded 46434 existing records. [2025-10-17T19:40:35.958272] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-17T19:40:35.958181] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:40:35.959361] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-17T19:40:35.959560] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-17T19:40:35.960831] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-17T19:40:35.960895] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-17T19:40:36.090974] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T19:40:36.352286] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:36.758013] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-17T19:40:37.036161] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-17T19:40:37.558034] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-17T19:40:37.906607] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T19:40:38.309247] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T19:40:38.358025] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-17T19:40:39.158084] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-17T19:40:39.307055] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T19:40:39.699287] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T19:40:39.958044] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-17T19:40:40.758084] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-17T19:40:40.993587] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T19:40:41.470889] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T19:40:41.558037] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-17T19:40:42.268552] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T19:40:42.357984] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-17T19:40:43.157992] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-17T19:40:43.280890] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T19:40:43.964900] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-17T19:40:43.971182] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T19:40:44.758043] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-17T19:40:45.097553] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-17T19:40:45.558008] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-17T19:40:45.678202] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T19:40:46.358009] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-17T19:40:46.646021] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T19:40:47.158015] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-17T19:40:47.365477] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T19:40:47.958001] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-17T19:40:48.129585] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T19:40:48.758009] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-17T19:40:48.903914] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T19:40:49.557994] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-17T19:40:49.878426] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T19:40:50.279284] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T19:40:50.358029] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-17T19:40:51.074070] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T19:40:51.158005] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-17T19:40:51.906709] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T19:40:51.914637] [INFO ] [REMOTE ] JBL: Full fetch complete (70582 records). [2025-10-17T19:40:51.914898] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-17T19:40:51.963328] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-17T19:40:52.307749] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-17T19:40:52.307834] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-17T19:40:52.308863] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-17T19:40:52.308928] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-17T19:40:52.310268] [DEBUG] [LOCAL ] JBL: Trimmed 70582 records to 49045 (keeping 200 days of data) [2025-10-17T19:40:52.611139] [DEBUG] [LOCAL ] JBL: Primary data saved (49045 records). [2025-10-17T19:40:52.611275] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-17T19:40:52.611891] [INFO ] [MAIN ] Update Progress: 1146/2368 symbols completed. JBL took 50.1s. Estimated remaining: 2h 51m 29s. Rate: 7.1 symbols/min [2025-10-17T19:40:52.761500] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-17T19:40:52.794573] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:52.829092] [DEBUG] [LOCAL ] JFR: Loaded 31245 existing records from primary storage. [2025-10-17T19:40:52.829368] [INFO ] [MAIN ] JFR: Loaded 31245 existing records. [2025-10-17T19:40:53.024372] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:40:53.024688] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-17T19:40:53.024863] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-17T19:40:53.035017] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-17T19:40:53.052356] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-17T19:40:53.097280] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-17T19:40:53.440962] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:53.567760] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-17T19:40:53.589915] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T19:40:54.087360] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T19:40:54.358032] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-17T19:40:55.153273] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T19:40:55.157980] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-17T19:40:55.162161] [INFO ] [REMOTE ] JCI: Full fetch complete (77631 records). [2025-10-17T19:40:55.162269] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-17T19:40:55.314329] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T19:40:55.581084] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-17T19:40:55.581170] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-17T19:40:55.582171] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-17T19:40:55.582242] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-17T19:40:55.583760] [DEBUG] [LOCAL ] JCI: Trimmed 77631 records to 54306 (keeping 200 days of data) [2025-10-17T19:40:55.918393] [DEBUG] [LOCAL ] JCI: Primary data saved (54306 records). [2025-10-17T19:40:55.918538] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-17T19:40:55.918621] [INFO ] [MAIN ] Update Progress: 1147/2368 symbols completed. JCI took 40.5s. Estimated remaining: 2h 51m 15s. Rate: 7.1 symbols/min [2025-10-17T19:40:55.965248] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-17T19:40:56.098244] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:40:56.111120] [DEBUG] [LOCAL ] JGH: Loaded 12686 existing records from primary storage. [2025-10-17T19:40:56.111338] [INFO ] [MAIN ] JGH: Loaded 12686 existing records. [2025-10-17T19:40:56.286284] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:40:56.286475] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-17T19:40:56.286543] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-17T19:40:56.286913] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-17T19:40:56.286982] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-17T19:40:56.641616] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:40:56.757989] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-17T19:40:56.843470] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T19:40:57.558084] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-17T19:40:57.692626] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T19:40:57.753221] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-17T19:40:58.358082] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-17T19:40:59.119543] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-17T19:40:59.129258] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T19:40:59.157997] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-17T19:40:59.817226] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-17T19:40:59.958100] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-17T19:41:00.758044] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-17T19:41:01.558022] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-17T19:41:01.891360] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-17T19:41:02.217455] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-17T19:41:02.358057] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-17T19:41:02.512309] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T19:41:03.157999] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-17T19:41:03.438047] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-17T19:41:03.958078] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-17T19:41:04.642066] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T19:41:04.758058] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-17T19:41:05.056882] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T19:41:05.229486] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T19:41:05.558012] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-17T19:41:06.358158] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-17T19:41:07.158037] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-17T19:41:07.410474] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T19:41:07.418266] [INFO ] [REMOTE ] JEF: Full fetch complete (73319 records). [2025-10-17T19:41:07.418450] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-17T19:41:07.824914] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-17T19:41:07.825087] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-17T19:41:07.826217] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-17T19:41:07.826344] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-17T19:41:07.857024] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T19:41:07.865553] [DEBUG] [LOCAL ] JEF: Trimmed 73319 records to 50950 (keeping 200 days of data) [2025-10-17T19:41:07.963715] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-17T19:41:08.193521] [DEBUG] [LOCAL ] JEF: Primary data saved (50950 records). [2025-10-17T19:41:08.193724] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-17T19:41:08.194338] [INFO ] [MAIN ] Update Progress: 1148/2368 symbols completed. JEF took 38.1s. Estimated remaining: 2h 51m 10s. Rate: 7.1 symbols/min [2025-10-17T19:41:08.369514] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:41:08.412907] [DEBUG] [LOCAL ] JHG: Loaded 47922 existing records from primary storage. [2025-10-17T19:41:08.413239] [INFO ] [MAIN ] JHG: Loaded 47922 existing records. [2025-10-17T19:41:08.609122] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:41:08.609475] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-17T19:41:08.609611] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-17T19:41:08.610595] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-17T19:41:08.610690] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-17T19:41:08.767445] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-17T19:41:08.878844] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T19:41:08.953234] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T19:41:09.042583] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:41:09.558033] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-17T19:41:10.144963] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T19:41:10.358082] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-17T19:41:11.045578] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T19:41:11.158098] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-17T19:41:11.923465] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T19:41:11.958018] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-17T19:41:12.689883] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T19:41:12.696032] [INFO ] [REMOTE ] JELD: Full fetch complete (64468 records). [2025-10-17T19:41:12.696143] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-17T19:41:12.763130] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-17T19:41:13.073548] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-17T19:41:13.073637] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-17T19:41:13.074571] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-17T19:41:13.074617] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-17T19:41:13.075991] [DEBUG] [LOCAL ] JELD: Trimmed 64468 records to 46697 (keeping 200 days of data) [2025-10-17T19:41:13.340104] [DEBUG] [LOCAL ] JELD: Primary data saved (46697 records). [2025-10-17T19:41:13.340239] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-17T19:41:13.340319] [INFO ] [MAIN ] Update Progress: 1149/2368 symbols completed. JELD took 37.8s. Estimated remaining: 2h 50m 59s. Rate: 7.1 symbols/min [2025-10-17T19:41:13.515088] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:41:13.542616] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T19:41:13.554286] [DEBUG] [LOCAL ] JHI: Loaded 4106 existing records from primary storage. [2025-10-17T19:41:13.555192] [INFO ] [MAIN ] JHI: Loaded 4106 existing records. [2025-10-17T19:41:13.566183] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-17T19:41:13.666978] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-17T19:41:13.747595] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:41:13.747841] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-17T19:41:13.747889] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-17T19:41:13.748107] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-17T19:41:13.748164] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-17T19:41:14.106755] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:41:14.358029] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-17T19:41:15.158009] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-17T19:41:15.214095] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T19:41:15.230284] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T19:41:15.958045] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-17T19:41:16.074963] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-17T19:41:16.758004] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-17T19:41:16.758448] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-17T19:41:17.558033] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-17T19:41:18.358002] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-17T19:41:18.465005] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T19:41:18.814160] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T19:41:19.158050] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-17T19:41:19.453931] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T19:41:19.457671] [INFO ] [REMOTE ] JGH: Full fetch complete (16365 records). [2025-10-17T19:41:19.457745] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-17T19:41:19.810072] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-17T19:41:19.810144] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-17T19:41:19.810507] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-17T19:41:19.810569] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-17T19:41:19.811144] [DEBUG] [LOCAL ] JGH: Trimmed 16365 records to 12828 (keeping 200 days of data) [2025-10-17T19:41:19.911254] [DEBUG] [LOCAL ] JGH: Primary data saved (12828 records). [2025-10-17T19:41:19.911465] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-17T19:41:19.911615] [INFO ] [MAIN ] Update Progress: 1150/2368 symbols completed. JGH took 24.0s. Estimated remaining: 2h 50m 48s. Rate: 7.1 symbols/min [2025-10-17T19:41:19.963315] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-17T19:41:20.089808] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:41:20.094539] [DEBUG] [LOCAL ] JHS: Loaded 2944 existing records from primary storage. [2025-10-17T19:41:20.094789] [INFO ] [MAIN ] JHS: Loaded 2944 existing records. [2025-10-17T19:41:20.269482] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:41:20.269777] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-17T19:41:20.269830] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-17T19:41:20.270028] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-17T19:41:20.270084] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-17T19:41:20.660075] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:41:20.758005] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-17T19:41:21.212393] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-17T19:41:21.266471] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-17T19:41:21.406751] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T19:41:21.558029] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-17T19:41:22.358029] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-17T19:41:23.158062] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-17T19:41:23.332954] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T19:41:23.663452] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T19:41:23.709270] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-17T19:41:23.958088] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-17T19:41:24.758086] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-17T19:41:25.547937] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T19:41:25.558222] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-17T19:41:25.572957] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T19:41:26.358134] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-17T19:41:26.897531] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-17T19:41:27.134150] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T19:41:27.158042] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-17T19:41:27.668002] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-17T19:41:27.958085] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-17T19:41:28.467749] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-17T19:41:28.758054] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-17T19:41:29.232384] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T19:41:29.558028] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-17T19:41:30.358049] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-17T19:41:30.876202] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-17T19:41:31.158093] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-17T19:41:31.541909] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-17T19:41:31.583434] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-17T19:41:31.958081] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-17T19:41:32.543140] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T19:41:32.758037] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-17T19:41:33.352829] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-17T19:41:33.558027] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-17T19:41:34.030868] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T19:41:34.358071] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-17T19:41:34.787735] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-17T19:41:35.158093] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-17T19:41:35.958027] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-17T19:41:36.432187] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-17T19:41:36.597381] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T19:41:36.602398] [INFO ] [REMOTE ] JFR: Full fetch complete (48412 records). [2025-10-17T19:41:36.602484] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-17T19:41:36.773638] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-17T19:41:36.978839] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-17T19:41:36.978902] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-17T19:41:36.979711] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-17T19:41:36.979774] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-17T19:41:36.980775] [DEBUG] [LOCAL ] JFR: Trimmed 48412 records to 31519 (keeping 200 days of data) [2025-10-17T19:41:37.157080] [DEBUG] [LOCAL ] JFR: Primary data saved (31519 records). [2025-10-17T19:41:37.157208] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-17T19:41:37.157287] [INFO ] [MAIN ] Update Progress: 1151/2368 symbols completed. JFR took 44.5s. Estimated remaining: 2h 50m 49s. Rate: 7.1 symbols/min [2025-10-17T19:41:37.328638] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:41:37.378736] [DEBUG] [LOCAL ] JHX: Loaded 53550 existing records from primary storage. [2025-10-17T19:41:37.379159] [INFO ] [MAIN ] JHX: Loaded 53550 existing records. [2025-10-17T19:41:37.461878] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-17T19:41:37.558085] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:41:37.558174] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-17T19:41:37.558548] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-17T19:41:37.559387] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-17T19:41:37.560384] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-17T19:41:37.560447] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-17T19:41:37.911584] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:41:38.176037] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T19:41:38.358027] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-17T19:41:38.896065] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-17T19:41:39.158021] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-17T19:41:39.710736] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-17T19:41:39.958063] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-17T19:41:40.758045] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-17T19:41:41.558049] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-17T19:41:42.038155] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T19:41:42.070021] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-17T19:41:42.358026] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-17T19:41:42.901431] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-17T19:41:43.070234] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T19:41:43.158031] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-17T19:41:43.727031] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T19:41:43.958035] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-17T19:41:44.519027] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-17T19:41:44.519974] [INFO ] [REMOTE ] JHS: Full fetch complete (4473 records). [2025-10-17T19:41:44.520041] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-17T19:41:44.763244] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-17T19:41:44.881219] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-17T19:41:44.881301] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-17T19:41:44.881443] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-17T19:41:44.881482] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-17T19:41:44.881880] [DEBUG] [LOCAL ] JHS: Trimmed 4473 records to 2952 (keeping 200 days of data) [2025-10-17T19:41:44.899339] [DEBUG] [LOCAL ] JHS: Primary data saved (2952 records). [2025-10-17T19:41:44.899445] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-17T19:41:44.899523] [INFO ] [MAIN ] Update Progress: 1152/2368 symbols completed. JHS took 25.0s. Estimated remaining: 2h 50m 40s. Rate: 7.1 symbols/min [2025-10-17T19:41:45.069291] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:41:45.085140] [DEBUG] [LOCAL ] JILL: Loaded 15989 existing records from primary storage. [2025-10-17T19:41:45.085359] [INFO ] [MAIN ] JILL: Loaded 15989 existing records. [2025-10-17T19:41:45.262145] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:41:45.262393] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-17T19:41:45.262441] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-17T19:41:45.262838] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-17T19:41:45.262896] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-17T19:41:45.561749] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-17T19:41:45.629299] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:41:45.635427] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T19:41:45.637341] [INFO ] [REMOTE ] JHI: Full fetch complete (5772 records). [2025-10-17T19:41:45.637435] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-17T19:41:45.992416] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-17T19:41:45.992493] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-17T19:41:45.992665] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-17T19:41:45.992726] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-17T19:41:45.993097] [DEBUG] [LOCAL ] JHI: Trimmed 5772 records to 4176 (keeping 200 days of data) [2025-10-17T19:41:46.018433] [DEBUG] [LOCAL ] JHI: Primary data saved (4176 records). [2025-10-17T19:41:46.018570] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-17T19:41:46.018677] [INFO ] [MAIN ] Update Progress: 1153/2368 symbols completed. JHI took 32.7s. Estimated remaining: 2h 50m 24s. Rate: 7.1 symbols/min [2025-10-17T19:41:46.186663] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:41:46.222493] [DEBUG] [LOCAL ] JKS: Loaded 39945 existing records from primary storage. [2025-10-17T19:41:46.222805] [INFO ] [MAIN ] JKS: Loaded 39945 existing records. [2025-10-17T19:41:46.363205] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-17T19:41:46.402842] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:41:46.403044] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-17T19:41:46.403091] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-17T19:41:46.403786] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-17T19:41:46.403844] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-17T19:41:46.754209] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:41:47.158062] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-17T19:41:47.370091] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T19:41:47.376843] [INFO ] [REMOTE ] JHG: Full fetch complete (68579 records). [2025-10-17T19:41:47.377001] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-17T19:41:47.777820] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-17T19:41:47.777630] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T19:41:47.778021] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-17T19:41:47.783494] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-17T19:41:47.783564] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-17T19:41:47.785008] [DEBUG] [LOCAL ] JHG: Trimmed 68579 records to 48298 (keeping 200 days of data) [2025-10-17T19:41:47.961997] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-17T19:41:48.081282] [DEBUG] [LOCAL ] JHG: Primary data saved (48298 records). [2025-10-17T19:41:48.081420] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-17T19:41:48.081954] [INFO ] [MAIN ] Update Progress: 1154/2368 symbols completed. JHG took 39.9s. Estimated remaining: 2h 50m 9s. Rate: 7.1 symbols/min [2025-10-17T19:41:48.191854] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-17T19:41:48.264455] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:41:48.294513] [DEBUG] [LOCAL ] JLL: Loaded 31952 existing records from primary storage. [2025-10-17T19:41:48.294834] [INFO ] [MAIN ] JLL: Loaded 31952 existing records. [2025-10-17T19:41:48.465105] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:41:48.465320] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-17T19:41:48.465369] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-17T19:41:48.466071] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-17T19:41:48.466131] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-17T19:41:48.763261] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-17T19:41:48.819762] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:41:48.829180] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T19:41:49.558049] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-17T19:41:49.687401] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-17T19:41:50.358134] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-17T19:41:51.158066] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-17T19:41:51.192239] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T19:41:51.254522] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-17T19:41:51.958095] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-17T19:41:52.318407] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T19:41:52.758051] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-17T19:41:53.558069] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-17T19:41:53.691678] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T19:41:54.358047] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-17T19:41:54.412210] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T19:41:54.784002] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T19:41:55.158078] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-17T19:41:55.942060] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T19:41:55.957986] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-17T19:41:56.541890] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T19:41:56.758040] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-17T19:41:57.558004] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-17T19:41:57.691467] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T19:41:58.058568] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T19:41:58.358062] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-17T19:41:58.781927] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T19:41:59.155138] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T19:41:59.158068] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-17T19:41:59.958059] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-17T19:42:00.758148] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-17T19:42:01.563669] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-17T19:42:01.581512] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-17T19:42:02.119563] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-17T19:42:02.206576] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T19:42:02.358024] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-17T19:42:03.157998] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-17T19:42:03.556286] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T19:42:03.958044] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-17T19:42:04.488118] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-17T19:42:04.758028] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-17T19:42:05.161607] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-17T19:42:05.381328] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T19:42:05.558012] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-17T19:42:05.884732] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T19:42:06.358066] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-17T19:42:07.158001] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-17T19:42:07.180556] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T19:42:07.958033] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-17T19:42:08.319028] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-17T19:42:08.541064] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T19:42:08.757999] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-17T19:42:08.874371] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-17T19:42:09.558000] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-17T19:42:09.751619] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T19:42:10.358031] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-17T19:42:11.158020] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-17T19:42:11.498184] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T19:42:11.601790] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-17T19:42:11.609279] [INFO ] [REMOTE ] JHX: Full fetch complete (61683 records). [2025-10-17T19:42:11.609428] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-17T19:42:11.963829] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-17T19:42:12.009587] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-17T19:42:12.009699] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-17T19:42:12.010629] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-17T19:42:12.010716] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-17T19:42:12.012162] [DEBUG] [LOCAL ] JHX: Trimmed 61683 records to 53939 (keeping 200 days of data) [2025-10-17T19:42:12.332782] [DEBUG] [LOCAL ] JHX: Primary data saved (53939 records). [2025-10-17T19:42:12.332940] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-17T19:42:12.333744] [INFO ] [MAIN ] Update Progress: 1155/2368 symbols completed. JHX took 35.2s. Estimated remaining: 2h 50m 17s. Rate: 7.1 symbols/min [2025-10-17T19:42:12.502179] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:42:12.509251] [DEBUG] [LOCAL ] JLS: Loaded 4239 existing records from primary storage. [2025-10-17T19:42:12.509790] [INFO ] [MAIN ] JLS: Loaded 4239 existing records. [2025-10-17T19:42:12.698579] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:42:12.714555] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-17T19:42:12.714683] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-17T19:42:12.716689] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T19:42:12.716756] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-17T19:42:12.716972] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-17T19:42:12.766285] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-17T19:42:13.073125] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:42:13.558033] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-17T19:42:13.587052] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T19:42:13.677852] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T19:42:14.358028] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-17T19:42:14.906254] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:42:15.158083] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-17T19:42:15.898926] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T19:42:15.958104] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-17T19:42:16.113618] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T19:42:16.758075] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-17T19:42:17.344181] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T19:42:17.348225] [INFO ] [REMOTE ] JLL: Full fetch complete (45122 records). [2025-10-17T19:42:17.348350] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-17T19:42:17.566125] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-17T19:42:17.761918] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-17T19:42:17.762017] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-17T19:42:17.762966] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-17T19:42:17.763031] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-17T19:42:17.764272] [DEBUG] [LOCAL ] JLL: Trimmed 45122 records to 32147 (keeping 200 days of data) [2025-10-17T19:42:17.869583] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T19:42:17.988599] [DEBUG] [LOCAL ] JLL: Primary data saved (32147 records). [2025-10-17T19:42:17.988837] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-17T19:42:17.988974] [INFO ] [MAIN ] Update Progress: 1156/2368 symbols completed. JLL took 29.9s. Estimated remaining: 2h 50m 6s. Rate: 7.1 symbols/min [2025-10-17T19:42:18.168596] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:42:18.219480] [DEBUG] [LOCAL ] JMIA: Loaded 51442 existing records from primary storage. [2025-10-17T19:42:18.225460] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-17T19:42:18.225946] [INFO ] [MAIN ] JMIA: Loaded 51442 existing records. [2025-10-17T19:42:18.363254] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-17T19:42:18.405169] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:42:18.405525] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-17T19:42:18.405576] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-17T19:42:18.406460] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-17T19:42:18.406520] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-17T19:42:18.773862] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:42:19.158069] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-17T19:42:19.813799] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-17T19:42:19.911269] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T19:42:19.957992] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-17T19:42:20.758119] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-17T19:42:21.395683] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-17T19:42:21.470147] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T19:42:21.558001] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-17T19:42:22.358037] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-17T19:42:22.858060] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-17T19:42:23.158026] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-17T19:42:23.312747] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T19:42:23.318623] [INFO ] [REMOTE ] JKS: Full fetch complete (58833 records). [2025-10-17T19:42:23.318815] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-17T19:42:23.715741] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-17T19:42:23.715883] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-17T19:42:23.716930] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-17T19:42:23.717005] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-17T19:42:23.718364] [DEBUG] [LOCAL ] JKS: Trimmed 58833 records to 40154 (keeping 200 days of data) [2025-10-17T19:42:23.962881] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-17T19:42:23.962798] [DEBUG] [LOCAL ] JKS: Primary data saved (40154 records). [2025-10-17T19:42:23.964052] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-17T19:42:23.964139] [INFO ] [MAIN ] Update Progress: 1157/2368 symbols completed. JKS took 37.9s. Estimated remaining: 2h 49m 55s. Rate: 7.1 symbols/min [2025-10-17T19:42:24.173874] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T19:42:24.176151] [INFO ] [REMOTE ] JILL: Full fetch complete (22480 records). [2025-10-17T19:42:24.176256] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-17T19:42:24.563120] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-17T19:42:24.567958] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-17T19:42:24.569159] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-17T19:42:24.569277] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-17T19:42:24.568606] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T19:42:24.572347] [DEBUG] [LOCAL ] JILL: Trimmed 22480 records to 16049 (keeping 200 days of data) [2025-10-17T19:42:24.672624] [DEBUG] [LOCAL ] JILL: Primary data saved (16049 records). [2025-10-17T19:42:24.672791] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-17T19:42:24.672922] [INFO ] [MAIN ] Update Progress: 1158/2368 symbols completed. JILL took 39.8s. Estimated remaining: 2h 49m 38s. Rate: 7.1 symbols/min [2025-10-17T19:42:24.758043] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-17T19:42:25.558025] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-17T19:42:26.151953] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-17T19:42:26.358045] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-17T19:42:26.498099] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T19:42:26.694579] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-17T19:42:27.158002] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-17T19:42:27.958074] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-17T19:42:28.552157] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-17T19:42:28.757971] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-17T19:42:28.944002] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T19:42:29.066302] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-17T19:42:29.558058] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-17T19:42:30.135825] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-17T19:42:30.357996] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-17T19:42:31.036002] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T19:42:31.037127] [INFO ] [REMOTE ] JLS: Full fetch complete (5842 records). [2025-10-17T19:42:31.037219] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-17T19:42:31.163137] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-17T19:42:31.402214] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-17T19:42:31.402290] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-17T19:42:31.402454] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-17T19:42:31.402512] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-17T19:42:31.402918] [DEBUG] [LOCAL ] JLS: Trimmed 5842 records to 4259 (keeping 200 days of data) [2025-10-17T19:42:31.428194] [DEBUG] [LOCAL ] JLS: Primary data saved (4259 records). [2025-10-17T19:42:31.428267] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-17T19:42:31.428450] [INFO ] [MAIN ] Update Progress: 1159/2368 symbols completed. JLS took 19.1s. Estimated remaining: 2h 49m 28s. Rate: 7.1 symbols/min [2025-10-17T19:42:33.099510] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-17T19:42:33.109298] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-17T19:42:34.970482] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T19:42:34.980510] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-17T19:42:36.703123] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T19:42:36.713784] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-17T19:42:38.435773] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T19:42:38.446345] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-17T19:42:40.176556] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T19:42:40.190428] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-17T19:42:41.911139] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T19:42:41.922441] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-17T19:42:43.891356] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-17T19:42:43.902477] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-17T19:42:49.415630] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (5.51 seconds). [2025-10-17T19:42:49.426889] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-17T19:42:51.626128] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-17T19:42:51.633349] [INFO ] [REMOTE ] JMIA: Full fetch complete (73456 records). [2025-10-17T19:42:51.633486] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-17T19:42:52.022672] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-17T19:42:52.022766] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-17T19:42:52.023745] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-17T19:42:52.023810] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-17T19:42:52.025173] [DEBUG] [LOCAL ] JMIA: Trimmed 73456 records to 51831 (keeping 200 days of data) [2025-10-17T19:42:52.319927] [DEBUG] [LOCAL ] JMIA: Primary data saved (51831 records). [2025-10-17T19:42:52.320066] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-17T19:42:52.320735] [INFO ] [MAIN ] Update Progress: 1160/2368 symbols completed. JMIA took 34.3s. Estimated remaining: 2h 49m 33s. Rate: 7.1 symbols/min [2025-10-17T19:42:53.003437] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:42:53.033232] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:42:53.009718] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:42:53.044275] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-17T19:42:53.058951] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-17T19:42:53.060071] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-17T19:42:53.060410] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-17T19:42:53.091369] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-17T19:42:53.095174] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:42:53.095582] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-17T19:42:53.227567] [DEBUG] [LOCAL ] JOE: Loaded 24021 existing records from primary storage. [2025-10-17T19:42:53.258447] [INFO ] [MAIN ] JOE: Loaded 24021 existing records. [2025-10-17T19:42:53.573151] [DEBUG] [LOCAL ] JNJ: Loaded 54143 existing records from primary storage. [2025-10-17T19:42:53.626419] [INFO ] [MAIN ] JNJ: Loaded 54143 existing records. [2025-10-17T19:42:53.668621] [DEBUG] [LOCAL ] JOBY: Loaded 54198 existing records from primary storage. [2025-10-17T19:42:53.699166] [INFO ] [MAIN ] JOBY: Loaded 54198 existing records. [2025-10-17T19:42:53.734143] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:42:53.792299] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-17T19:42:53.844491] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:42:53.859821] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-17T19:42:53.854296] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-17T19:42:53.905600] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-17T19:42:53.911216] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-17T19:42:54.223819] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:42:54.257449] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-17T19:42:54.257555] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-17T19:42:54.257048] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:42:54.266043] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-17T19:42:54.266141] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-17T19:42:54.272754] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-17T19:42:54.273083] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-17T19:42:54.278403] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-17T19:42:54.285459] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-17T19:42:54.608162] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T19:42:54.614434] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-17T19:42:55.145761] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-17T19:42:55.135223] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:42:55.163020] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-17T19:42:55.174747] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-17T19:42:55.370212] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:42:55.382628] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-17T19:42:55.393574] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:42:55.395004] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-17T19:42:55.645746] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-17T19:42:55.647208] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-17T19:42:55.982596] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-17T19:42:55.983554] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-17T19:42:56.467082] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-17T19:42:56.472853] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-17T19:42:56.519559] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-17T19:42:56.520726] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-17T19:42:57.027298] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-17T19:42:57.028698] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-17T19:42:57.501015] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-17T19:42:57.502298] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-17T19:42:57.686222] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T19:42:57.693451] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-17T19:42:57.782263] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-17T19:42:57.793919] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-17T19:42:58.019311] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-17T19:42:58.031409] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-17T19:42:58.043417] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-17T19:42:58.044932] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-17T19:42:58.484955] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-17T19:42:58.486168] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-17T19:42:58.733774] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T19:42:58.739297] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-17T19:42:58.958312] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-17T19:42:58.959509] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-17T19:42:59.411794] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-17T19:42:59.412587] [INFO ] [REMOTE ] JMM: Full fetch complete (2295 records). [2025-10-17T19:42:59.412696] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-17T19:42:59.626324] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-17T19:42:59.626518] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:42:59.626563] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:42:59.626602] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-17T19:42:59.626684] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-17T19:42:59.626738] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-17T19:42:59.626781] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-17T19:42:59.626837] [INFO ] [MAIN ] Update Progress: 1161/2368 symbols completed. JMM took 7.3s. Estimated remaining: 2h 49m 23s. Rate: 7.1 symbols/min [2025-10-17T19:42:59.800605] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:42:59.808598] [DEBUG] [LOCAL ] JOF: Loaded 6944 existing records from primary storage. [2025-10-17T19:42:59.808801] [INFO ] [MAIN ] JOF: Loaded 6944 existing records. [2025-10-17T19:42:59.991764] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:42:59.992241] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-17T19:42:59.992626] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-17T19:42:59.993268] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-17T19:42:59.993472] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-17T19:43:00.087887] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T19:43:00.122414] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-17T19:43:00.248908] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-17T19:43:00.349124] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-17T19:43:00.466976] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:43:00.467604] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-17T19:43:00.657369] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-17T19:43:00.667969] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-17T19:43:02.066697] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T19:43:02.073417] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-17T19:43:02.207784] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T19:43:02.210210] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-17T19:43:02.601890] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-17T19:43:02.612793] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-17T19:43:02.802816] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T19:43:02.804906] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-17T19:43:03.215420] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-17T19:43:03.225918] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-17T19:43:03.282910] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T19:43:03.288508] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-17T19:43:03.348858] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-17T19:43:03.350571] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-17T19:43:04.221172] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-17T19:43:04.223943] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-17T19:43:04.554547] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T19:43:04.560051] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-17T19:43:04.665734] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-17T19:43:04.677124] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-17T19:43:05.069797] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T19:43:05.072914] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-17T19:43:05.385341] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T19:43:05.456009] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-17T19:43:05.558001] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-17T19:43:05.701584] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T19:43:06.358002] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-17T19:43:06.761286] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-17T19:43:06.975950] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T19:43:07.158000] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-17T19:43:07.197626] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T19:43:07.815632] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-17T19:43:07.958081] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-17T19:43:08.758103] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-17T19:43:09.046958] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T19:43:09.558083] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-17T19:43:10.358066] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-17T19:43:10.602807] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T19:43:10.606092] [INFO ] [REMOTE ] JOE: Full fetch complete (35653 records). [2025-10-17T19:43:10.606231] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-17T19:43:10.966026] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-17T19:43:10.966114] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-17T19:43:10.966837] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-17T19:43:10.966898] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-17T19:43:10.967750] [DEBUG] [LOCAL ] JOE: Trimmed 35653 records to 24168 (keeping 200 days of data) [2025-10-17T19:43:11.116823] [DEBUG] [LOCAL ] JOE: Primary data saved (24168 records). [2025-10-17T19:43:11.117072] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-17T19:43:11.117363] [INFO ] [MAIN ] Update Progress: 1162/2368 symbols completed. JOE took 18.8s. Estimated remaining: 2h 49m 18s. Rate: 7.1 symbols/min [2025-10-17T19:43:11.185703] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-17T19:43:11.212766] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T19:43:11.303213] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:43:11.334198] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-17T19:43:11.375247] [DEBUG] [LOCAL ] JPC: Loaded 37494 existing records from primary storage. [2025-10-17T19:43:11.375532] [INFO ] [MAIN ] JPC: Loaded 37494 existing records. [2025-10-17T19:43:11.548386] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:43:11.548631] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-17T19:43:11.548714] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-17T19:43:11.549427] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-17T19:43:11.549497] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-17T19:43:11.893104] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:43:11.957996] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-17T19:43:12.758034] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-17T19:43:13.469999] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T19:43:13.557999] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-17T19:43:13.591092] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-17T19:43:14.358023] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-17T19:43:15.023128] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T19:43:15.158055] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-17T19:43:15.233765] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-17T19:43:15.958131] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-17T19:43:16.490741] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-17T19:43:16.633102] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T19:43:16.675025] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-17T19:43:16.758060] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-17T19:43:17.558062] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-17T19:43:18.173519] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T19:43:18.358047] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-17T19:43:19.158071] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-17T19:43:19.857832] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T19:43:19.960872] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-17T19:43:19.965624] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-17T19:43:20.758113] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-17T19:43:20.774692] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T19:43:20.777477] [INFO ] [REMOTE ] JOF: Full fetch complete (9416 records). [2025-10-17T19:43:20.777581] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-17T19:43:21.162952] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-17T19:43:21.163062] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-17T19:43:21.163308] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-17T19:43:21.163371] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-17T19:43:21.163968] [DEBUG] [LOCAL ] JOF: Trimmed 9416 records to 6969 (keeping 200 days of data) [2025-10-17T19:43:21.207133] [DEBUG] [LOCAL ] JOF: Primary data saved (6969 records). [2025-10-17T19:43:21.207278] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-17T19:43:21.207414] [INFO ] [MAIN ] Update Progress: 1163/2368 symbols completed. JOF took 21.6s. Estimated remaining: 2h 49m 11s. Rate: 7.1 symbols/min [2025-10-17T19:43:21.382720] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:43:21.434896] [DEBUG] [LOCAL ] JPM: Loaded 54184 existing records from primary storage. [2025-10-17T19:43:21.435261] [INFO ] [MAIN ] JPM: Loaded 54184 existing records. [2025-10-17T19:43:21.560077] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-17T19:43:21.646663] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-17T19:43:21.663815] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:43:21.676050] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-17T19:43:21.676609] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-17T19:43:21.677910] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-17T19:43:21.677994] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-17T19:43:22.033981] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:43:22.242108] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T19:43:22.358045] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-17T19:43:23.158046] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-17T19:43:23.771763] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T19:43:23.958015] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-17T19:43:24.335327] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-10-17T19:43:24.758039] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-17T19:43:25.021730] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T19:43:25.067117] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T19:43:25.558033] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-17T19:43:26.358071] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-17T19:43:26.801757] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-17T19:43:27.011227] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T19:43:27.157997] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-17T19:43:27.958038] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-17T19:43:28.758013] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-17T19:43:29.155549] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-17T19:43:29.340955] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T19:43:29.453945] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-17T19:43:29.558042] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-17T19:43:30.358042] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-17T19:43:31.074505] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-17T19:43:31.158007] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-17T19:43:31.546298] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-17T19:43:31.554220] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-17T19:43:31.554394] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-17T19:43:31.949319] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-17T19:43:31.949411] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-17T19:43:31.950546] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-17T19:43:31.950612] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-17T19:43:31.952225] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 54533 (keeping 200 days of data) [2025-10-17T19:43:32.007505] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-17T19:43:32.289117] [DEBUG] [LOCAL ] JNJ: Primary data saved (54533 records). [2025-10-17T19:43:32.289260] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-17T19:43:32.290400] [INFO ] [MAIN ] Update Progress: 1164/2368 symbols completed. JNJ took 40.0s. Estimated remaining: 2h 49m 5s. Rate: 7.1 symbols/min [2025-10-17T19:43:32.453400] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:43:32.485736] [DEBUG] [LOCAL ] JQC: Loaded 33945 existing records from primary storage. [2025-10-17T19:43:32.486011] [INFO ] [MAIN ] JQC: Loaded 33945 existing records. [2025-10-17T19:43:32.662756] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:43:32.662982] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-17T19:43:32.663033] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-17T19:43:32.663634] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-17T19:43:32.663721] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-17T19:43:33.026486] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:43:33.026825] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-17T19:43:33.113708] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-10-17T19:43:33.184126] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-17T19:43:33.433689] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T19:43:33.439188] [INFO ] [REMOTE ] JPC: Full fetch complete (55191 records). [2025-10-17T19:43:33.439298] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-17T19:43:33.563128] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-17T19:43:33.820822] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-17T19:43:33.820904] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-17T19:43:33.821772] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-17T19:43:33.821835] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-17T19:43:33.822965] [DEBUG] [LOCAL ] JPC: Trimmed 55191 records to 37747 (keeping 200 days of data) [2025-10-17T19:43:34.035304] [DEBUG] [LOCAL ] JPC: Primary data saved (37747 records). [2025-10-17T19:43:34.035439] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-17T19:43:34.035993] [INFO ] [MAIN ] Update Progress: 1165/2368 symbols completed. JPC took 22.9s. Estimated remaining: 2h 48m 50s. Rate: 7.1 symbols/min [2025-10-17T19:43:34.200332] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:43:34.217161] [DEBUG] [LOCAL ] JRI: Loaded 15503 existing records from primary storage. [2025-10-17T19:43:34.217420] [INFO ] [MAIN ] JRI: Loaded 15503 existing records. [2025-10-17T19:43:34.366698] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-17T19:43:34.397251] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:43:34.397459] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-17T19:43:34.397506] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-17T19:43:34.397989] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-17T19:43:34.398047] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-17T19:43:34.561433] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T19:43:34.765964] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:43:35.158031] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-17T19:43:35.958046] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-17T19:43:36.472361] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.91 seconds). [2025-10-17T19:43:36.481451] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-17T19:43:36.481733] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-17T19:43:36.615158] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T19:43:36.788577] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-17T19:43:36.908031] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-17T19:43:36.966924] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-17T19:43:36.967359] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-17T19:43:36.968406] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-17T19:43:36.968616] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-17T19:43:36.970153] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 54588 (keeping 200 days of data) [2025-10-17T19:43:37.185986] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-17T19:43:37.308171] [DEBUG] [LOCAL ] JOBY: Primary data saved (54588 records). [2025-10-17T19:43:37.308315] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-17T19:43:37.308422] [INFO ] [MAIN ] Update Progress: 1166/2368 symbols completed. JOBY took 45.0s. Estimated remaining: 2h 48m 36s. Rate: 7.1 symbols/min [2025-10-17T19:43:37.471330] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:43:37.482432] [DEBUG] [LOCAL ] JRS: Loaded 11746 existing records from primary storage. [2025-10-17T19:43:37.482620] [INFO ] [MAIN ] JRS: Loaded 11746 existing records. [2025-10-17T19:43:37.563281] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-17T19:43:37.658887] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:43:37.659099] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-17T19:43:37.659158] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-17T19:43:37.659473] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-17T19:43:37.659530] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-17T19:43:38.011052] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:43:38.106848] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T19:43:38.358012] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-17T19:43:39.158018] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-17T19:43:39.523278] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T19:43:39.958006] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-17T19:43:40.117077] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-17T19:43:40.576608] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T19:43:40.758031] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-17T19:43:41.402525] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T19:43:41.411431] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T19:43:41.558068] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-17T19:43:42.358038] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-17T19:43:43.097488] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-17T19:43:43.158045] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-17T19:43:43.814749] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-17T19:43:43.958028] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-17T19:43:43.980486] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T19:43:44.758059] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-17T19:43:45.533039] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-17T19:43:45.558039] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-17T19:43:46.342590] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-17T19:43:46.357988] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-17T19:43:46.375669] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T19:43:47.158030] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-17T19:43:47.947930] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-17T19:43:47.957989] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-17T19:43:48.364923] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-17T19:43:48.758021] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-17T19:43:48.772828] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T19:43:49.558067] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-17T19:43:50.327502] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T19:43:50.357999] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-17T19:43:50.534724] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T19:43:51.158006] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-17T19:43:51.181350] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T19:43:51.958083] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-17T19:43:52.758135] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-17T19:43:53.202194] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T19:43:53.558066] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-17T19:43:53.776303] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-17T19:43:53.818840] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T19:43:54.358005] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-17T19:43:54.506712] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T19:43:54.513951] [INFO ] [REMOTE ] JRS: Full fetch complete (16256 records). [2025-10-17T19:43:54.514251] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-17T19:43:54.899576] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-17T19:43:54.899739] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-17T19:43:54.900366] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-17T19:43:54.900417] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-17T19:43:54.901582] [DEBUG] [LOCAL ] JRS: Trimmed 16256 records to 11802 (keeping 200 days of data) [2025-10-17T19:43:54.976448] [DEBUG] [LOCAL ] JRS: Primary data saved (11802 records). [2025-10-17T19:43:54.976679] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-17T19:43:54.976810] [INFO ] [MAIN ] Update Progress: 1167/2368 symbols completed. JRS took 17.7s. Estimated remaining: 2h 48m 37s. Rate: 7.1 symbols/min [2025-10-17T19:43:55.151035] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:43:55.158070] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-17T19:43:55.197000] [DEBUG] [LOCAL ] JXN: Loaded 45020 existing records from primary storage. [2025-10-17T19:43:55.197461] [INFO ] [MAIN ] JXN: Loaded 45020 existing records. [2025-10-17T19:43:55.382724] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:43:55.383028] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-17T19:43:55.383081] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-17T19:43:55.384101] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-17T19:43:55.384164] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-17T19:43:55.755872] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:43:55.958055] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-17T19:43:56.563605] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T19:43:56.724606] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-17T19:43:56.757983] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-17T19:43:56.944561] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T19:43:57.558024] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-17T19:43:58.358024] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-17T19:43:58.861502] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T19:43:59.158043] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-17T19:43:59.189770] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-17T19:43:59.791067] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-17T19:43:59.933417] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T19:43:59.958023] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-17T19:44:00.758115] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-17T19:44:01.558049] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-17T19:44:01.733372] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T19:44:02.358043] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-17T19:44:02.548277] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-17T19:44:03.158031] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-17T19:44:03.413155] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-17T19:44:03.894721] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (3.14 seconds). [2025-10-17T19:44:03.903065] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-17T19:44:03.903295] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-17T19:44:03.969129] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-17T19:44:04.133383] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-17T19:44:04.429453] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-17T19:44:04.429568] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-17T19:44:04.431157] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-17T19:44:04.431228] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-17T19:44:04.433337] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 54574 (keeping 200 days of data) [2025-10-17T19:44:04.775924] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-17T19:44:04.808918] [DEBUG] [LOCAL ] JPM: Primary data saved (54574 records). [2025-10-17T19:44:04.809133] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-17T19:44:04.810197] [INFO ] [MAIN ] Update Progress: 1168/2368 symbols completed. JPM took 43.6s. Estimated remaining: 2h 48m 31s. Rate: 7.1 symbols/min [2025-10-17T19:44:04.987471] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:44:05.050782] [DEBUG] [LOCAL ] K: Loaded 50804 existing records from primary storage. [2025-10-17T19:44:05.051237] [INFO ] [MAIN ] K: Loaded 50804 existing records. [2025-10-17T19:44:05.236784] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:44:05.237103] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-17T19:44:05.237157] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-17T19:44:05.238332] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-17T19:44:05.238394] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-17T19:44:05.585037] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-17T19:44:05.614186] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:44:05.644243] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T19:44:06.245774] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T19:44:06.254701] [INFO ] [REMOTE ] JQC: Full fetch complete (49816 records). [2025-10-17T19:44:06.254883] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-17T19:44:06.366000] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-17T19:44:06.682095] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-17T19:44:06.682210] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-17T19:44:06.683379] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-17T19:44:06.683455] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-17T19:44:06.684937] [DEBUG] [LOCAL ] JQC: Trimmed 49816 records to 34272 (keeping 200 days of data) [2025-10-17T19:44:06.803498] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-17T19:44:06.928137] [DEBUG] [LOCAL ] JQC: Primary data saved (34272 records). [2025-10-17T19:44:06.928290] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-17T19:44:06.928376] [INFO ] [MAIN ] Update Progress: 1169/2368 symbols completed. JQC took 34.6s. Estimated remaining: 2h 48m 16s. Rate: 7.1 symbols/min [2025-10-17T19:44:07.109455] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:44:07.123794] [DEBUG] [LOCAL ] KAI: Loaded 13688 existing records from primary storage. [2025-10-17T19:44:07.124041] [INFO ] [MAIN ] KAI: Loaded 13688 existing records. [2025-10-17T19:44:07.167557] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-17T19:44:07.308521] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:44:07.308780] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-17T19:44:07.308842] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-17T19:44:07.309243] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-17T19:44:07.309300] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-17T19:44:07.658163] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:44:07.958015] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-17T19:44:08.096206] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T19:44:08.117098] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T19:44:08.758040] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-17T19:44:09.558026] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-17T19:44:09.634253] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T19:44:09.799233] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-17T19:44:10.358088] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-17T19:44:11.158071] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-17T19:44:11.214235] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T19:44:11.252430] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T19:44:11.255500] [INFO ] [REMOTE ] JRI: Full fetch complete (23151 records). [2025-10-17T19:44:11.255592] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-17T19:44:11.630824] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-17T19:44:11.630904] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-17T19:44:11.631386] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-17T19:44:11.631426] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-17T19:44:11.632131] [DEBUG] [LOCAL ] JRI: Trimmed 23151 records to 15593 (keeping 200 days of data) [2025-10-17T19:44:11.727947] [DEBUG] [LOCAL ] JRI: Primary data saved (15593 records). [2025-10-17T19:44:11.728083] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-17T19:44:11.728164] [INFO ] [MAIN ] Update Progress: 1170/2368 symbols completed. JRI took 37.7s. Estimated remaining: 2h 48m 3s. Rate: 7.1 symbols/min [2025-10-17T19:44:11.896724] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:44:11.933151] [DEBUG] [LOCAL ] KAR: Loaded 40339 existing records from primary storage. [2025-10-17T19:44:11.933445] [INFO ] [MAIN ] KAR: Loaded 40339 existing records. [2025-10-17T19:44:11.963310] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-17T19:44:12.109393] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:44:12.109631] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-17T19:44:12.109714] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-17T19:44:12.110430] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-17T19:44:12.110488] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-17T19:44:12.487634] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:44:12.758047] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-17T19:44:12.869943] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T19:44:13.558073] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-17T19:44:13.656627] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-17T19:44:13.900564] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-17T19:44:14.358045] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-17T19:44:14.952483] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-17T19:44:15.158049] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-17T19:44:15.958021] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-17T19:44:15.995786] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T19:44:16.534144] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T19:44:16.758028] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-17T19:44:17.558024] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-17T19:44:17.627274] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T19:44:18.331538] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T19:44:18.357985] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-17T19:44:18.412601] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T19:44:19.158076] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-17T19:44:19.351999] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-17T19:44:19.958038] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-17T19:44:20.584280] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T19:44:20.758054] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-17T19:44:21.436090] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T19:44:21.558053] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-17T19:44:22.358011] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-17T19:44:22.512672] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T19:44:23.136833] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T19:44:23.158107] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-17T19:44:23.367932] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T19:44:23.958065] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-17T19:44:24.758084] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-17T19:44:24.842774] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T19:44:25.467507] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T19:44:25.558002] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-17T19:44:26.277149] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T19:44:26.358064] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-17T19:44:27.050965] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T19:44:27.158062] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-17T19:44:27.958008] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-17T19:44:28.020063] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T19:44:28.619344] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T19:44:28.757992] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-17T19:44:29.016975] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T19:44:29.558032] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-17T19:44:30.080766] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T19:44:30.358027] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-17T19:44:31.158063] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-17T19:44:31.307840] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T19:44:31.313731] [INFO ] [REMOTE ] JXN: Full fetch complete (65629 records). [2025-10-17T19:44:31.313916] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-17T19:44:31.714063] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-17T19:44:31.714178] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-17T19:44:31.715342] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-17T19:44:31.715455] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-17T19:44:31.716832] [DEBUG] [LOCAL ] JXN: Trimmed 65629 records to 45301 (keeping 200 days of data) [2025-10-17T19:44:31.962382] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-17T19:44:31.965000] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T19:44:32.046482] [DEBUG] [LOCAL ] JXN: Primary data saved (45301 records). [2025-10-17T19:44:32.046691] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-17T19:44:32.047421] [INFO ] [MAIN ] Update Progress: 1171/2368 symbols completed. JXN took 37.1s. Estimated remaining: 2h 48m 7s. Rate: 7.1 symbols/min [2025-10-17T19:44:32.234743] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:44:32.233070] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T19:44:32.261108] [DEBUG] [LOCAL ] KB: Loaded 23518 existing records from primary storage. [2025-10-17T19:44:32.261360] [INFO ] [MAIN ] KB: Loaded 23518 existing records. [2025-10-17T19:44:32.437242] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:44:32.437517] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-17T19:44:32.437585] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-17T19:44:32.438082] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-17T19:44:32.438140] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-17T19:44:32.760469] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-17T19:44:32.796735] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:44:33.527266] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T19:44:33.558001] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-17T19:44:34.358062] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-17T19:44:34.453056] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T19:44:34.797042] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T19:44:35.158042] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-17T19:44:35.790838] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T19:44:35.958007] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-17T19:44:36.349123] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T19:44:36.758042] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-17T19:44:37.462173] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T19:44:37.558045] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-17T19:44:37.833142] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T19:44:38.358054] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-17T19:44:39.158058] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-17T19:44:39.271408] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T19:44:39.774065] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-17T19:44:39.779519] [INFO ] [REMOTE ] KAR: Full fetch complete (56988 records). [2025-10-17T19:44:39.779609] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-17T19:44:39.968338] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-17T19:44:40.161353] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-17T19:44:40.161428] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-17T19:44:40.162355] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-17T19:44:40.162417] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-17T19:44:40.163497] [DEBUG] [LOCAL ] KAR: Trimmed 56988 records to 40601 (keeping 200 days of data) [2025-10-17T19:44:40.400468] [DEBUG] [LOCAL ] KAR: Primary data saved (40601 records). [2025-10-17T19:44:40.400604] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-17T19:44:40.401304] [INFO ] [MAIN ] Update Progress: 1172/2368 symbols completed. KAR took 28.7s. Estimated remaining: 2h 47m 59s. Rate: 7.1 symbols/min [2025-10-17T19:44:40.538180] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-17T19:44:40.606226] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:44:40.628499] [DEBUG] [LOCAL ] KBDC: Loaded 22431 existing records from primary storage. [2025-10-17T19:44:40.628789] [INFO ] [MAIN ] KBDC: Loaded 22431 existing records. [2025-10-17T19:44:40.763291] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-17T19:44:40.801986] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:44:40.802155] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-17T19:44:40.802200] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-17T19:44:40.802672] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-17T19:44:40.802730] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-17T19:44:41.144496] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:44:41.558029] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-17T19:44:41.911548] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T19:44:41.919959] [INFO ] [REMOTE ] K: Full fetch complete (72339 records). [2025-10-17T19:44:41.920286] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-17T19:44:42.040292] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T19:44:42.330895] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-17T19:44:42.330972] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-17T19:44:42.331933] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-17T19:44:42.331995] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-17T19:44:42.333332] [DEBUG] [LOCAL ] K: Trimmed 72339 records to 51154 (keeping 200 days of data) [2025-10-17T19:44:42.390501] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-17T19:44:42.598835] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T19:44:42.668947] [DEBUG] [LOCAL ] K: Primary data saved (51154 records). [2025-10-17T19:44:42.669074] [INFO ] [MAIN ] K: Full history saved. [2025-10-17T19:44:42.669153] [INFO ] [MAIN ] Update Progress: 1173/2368 symbols completed. K took 37.9s. Estimated remaining: 2h 47m 44s. Rate: 7.1 symbols/min [2025-10-17T19:44:42.832987] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:44:42.873412] [DEBUG] [LOCAL ] KBH: Loaded 49212 existing records from primary storage. [2025-10-17T19:44:42.873731] [INFO ] [MAIN ] KBH: Loaded 49212 existing records. [2025-10-17T19:44:43.045839] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:44:43.045989] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-17T19:44:43.046036] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-17T19:44:43.046902] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-17T19:44:43.046960] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-17T19:44:43.162543] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-17T19:44:43.397252] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:44:43.565408] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T19:44:43.958003] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-17T19:44:44.202986] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T19:44:44.757999] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-17T19:44:45.074093] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T19:44:45.558033] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-17T19:44:45.759928] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T19:44:46.228758] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T19:44:46.358019] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-17T19:44:47.158054] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-17T19:44:47.272446] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T19:44:47.958050] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-17T19:44:48.758073] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-17T19:44:49.068424] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T19:44:49.119624] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T19:44:49.558004] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-17T19:44:49.589308] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T19:44:50.358024] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-17T19:44:51.157999] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-17T19:44:51.238704] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-17T19:44:51.343425] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T19:44:51.958009] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-17T19:44:52.254218] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T19:44:52.757996] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-17T19:44:52.987438] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T19:44:52.990028] [INFO ] [REMOTE ] KAI: Full fetch complete (19233 records). [2025-10-17T19:44:52.990103] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-17T19:44:53.360548] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-17T19:44:53.360626] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-17T19:44:53.361106] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-17T19:44:53.361159] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-17T19:44:53.361772] [DEBUG] [LOCAL ] KAI: Trimmed 19233 records to 13783 (keeping 200 days of data) [2025-10-17T19:44:53.447497] [DEBUG] [LOCAL ] KAI: Primary data saved (13783 records). [2025-10-17T19:44:53.447637] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-17T19:44:53.447764] [INFO ] [MAIN ] Update Progress: 1174/2368 symbols completed. KAI took 46.5s. Estimated remaining: 2h 47m 38s. Rate: 7.1 symbols/min [2025-10-17T19:44:53.563104] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-17T19:44:53.620270] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:44:53.662742] [DEBUG] [LOCAL ] KBR: Loaded 48409 existing records from primary storage. [2025-10-17T19:44:53.663106] [INFO ] [MAIN ] KBR: Loaded 48409 existing records. [2025-10-17T19:44:53.843275] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:44:53.843503] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-17T19:44:53.843551] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-17T19:44:53.844495] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-17T19:44:53.844555] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-17T19:44:54.237992] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:44:54.358020] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-17T19:44:54.405628] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T19:44:54.594085] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T19:44:55.158122] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-17T19:44:55.379762] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-17T19:44:55.958098] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-17T19:44:56.758067] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-17T19:44:56.837829] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T19:44:57.045957] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T19:44:57.558013] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-17T19:44:57.662575] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T19:44:58.358006] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-17T19:44:59.163313] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-17T19:44:59.182177] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T19:44:59.418787] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T19:44:59.958085] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-17T19:45:00.758044] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-17T19:45:01.477635] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T19:45:01.558039] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-17T19:45:01.811534] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-10-17T19:45:02.358049] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-17T19:45:02.704390] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T19:45:03.158086] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-17T19:45:03.482962] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T19:45:03.958074] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-17T19:45:04.758144] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-17T19:45:04.835021] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-17T19:45:05.320956] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-17T19:45:05.346915] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T19:45:05.352076] [INFO ] [REMOTE ] KBDC: Full fetch complete (30621 records). [2025-10-17T19:45:05.352212] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-17T19:45:05.565703] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-17T19:45:05.743194] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-17T19:45:05.743358] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-17T19:45:05.744272] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-17T19:45:05.744338] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-17T19:45:05.745550] [DEBUG] [LOCAL ] KBDC: Trimmed 30621 records to 22794 (keeping 200 days of data) [2025-10-17T19:45:05.860158] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T19:45:05.888116] [INFO ] [REMOTE ] KB: Full fetch complete (33622 records). [2025-10-17T19:45:05.893874] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-17T19:45:06.004242] [DEBUG] [LOCAL ] KBDC: Primary data saved (22794 records). [2025-10-17T19:45:06.027473] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-17T19:45:06.039108] [INFO ] [MAIN ] Update Progress: 1175/2368 symbols completed. KBDC took 25.6s. Estimated remaining: 2h 47m 34s. Rate: 7.1 symbols/min [2025-10-17T19:45:06.362753] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-17T19:45:06.396012] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:45:06.522872] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-17T19:45:06.522964] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-17T19:45:06.523673] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-17T19:45:06.523812] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-17T19:45:06.524715] [DEBUG] [LOCAL ] KB: Trimmed 33622 records to 23613 (keeping 200 days of data) [2025-10-17T19:45:06.652725] [DEBUG] [LOCAL ] KD: Loaded 52742 existing records from primary storage. [2025-10-17T19:45:06.654527] [INFO ] [MAIN ] KD: Loaded 52742 existing records. [2025-10-17T19:45:06.849406] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:45:06.851131] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-17T19:45:06.852128] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-17T19:45:06.853611] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-17T19:45:06.853712] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-17T19:45:07.052226] [DEBUG] [LOCAL ] KB: Primary data saved (23613 records). [2025-10-17T19:45:07.086548] [INFO ] [MAIN ] KB: Full history saved. [2025-10-17T19:45:07.137298] [INFO ] [MAIN ] Update Progress: 1176/2368 symbols completed. KB took 35.1s. Estimated remaining: 2h 47m 18s. Rate: 7.1 symbols/min [2025-10-17T19:45:07.405324] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:45:07.437601] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-17T19:45:07.458183] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:45:07.494197] [DEBUG] [LOCAL ] KEN: Loaded 4721 existing records from primary storage. [2025-10-17T19:45:07.494536] [INFO ] [MAIN ] KEN: Loaded 4721 existing records. [2025-10-17T19:45:07.562470] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T19:45:07.687775] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:45:07.687967] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-17T19:45:07.688039] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-17T19:45:07.688270] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-17T19:45:07.688342] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-17T19:45:07.958475] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-17T19:45:08.069693] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:45:08.120126] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T19:45:08.758083] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-17T19:45:09.260665] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T19:45:09.258962] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-17T19:45:09.346058] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T19:45:09.558042] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-17T19:45:10.358103] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-17T19:45:11.158084] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-17T19:45:11.634467] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-17T19:45:11.958053] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-17T19:45:12.080177] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T19:45:12.710253] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T19:45:12.758001] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-17T19:45:12.961705] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T19:45:13.558036] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-17T19:45:14.082092] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-17T19:45:14.357997] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-17T19:45:14.465942] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T19:45:15.158036] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-17T19:45:15.958008] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-17T19:45:16.190695] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T19:45:16.573272] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T19:45:16.758039] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-17T19:45:17.557994] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-17T19:45:17.792842] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T19:45:18.058568] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-17T19:45:18.358142] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-17T19:45:18.554332] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T19:45:18.561868] [INFO ] [REMOTE ] KBH: Full fetch complete (71099 records). [2025-10-17T19:45:18.562050] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-17T19:45:18.961454] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-17T19:45:18.961558] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-17T19:45:18.962677] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-17T19:45:18.962764] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-17T19:45:18.964342] [DEBUG] [LOCAL ] KBH: Trimmed 71099 records to 49532 (keeping 200 days of data) [2025-10-17T19:45:19.168038] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-17T19:45:19.258095] [DEBUG] [LOCAL ] KBH: Primary data saved (49532 records). [2025-10-17T19:45:19.258226] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-17T19:45:19.258395] [INFO ] [MAIN ] Update Progress: 1177/2368 symbols completed. KBH took 36.6s. Estimated remaining: 2h 47m 13s. Rate: 7.1 symbols/min [2025-10-17T19:45:19.423259] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:45:19.453524] [DEBUG] [LOCAL ] KEP: Loaded 32230 existing records from primary storage. [2025-10-17T19:45:19.453831] [INFO ] [MAIN ] KEP: Loaded 32230 existing records. [2025-10-17T19:45:19.638976] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:45:19.639224] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-17T19:45:19.639290] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-17T19:45:19.640015] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-17T19:45:19.640084] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-17T19:45:19.964600] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-17T19:45:20.007752] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:45:20.016364] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T19:45:20.202994] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T19:45:20.758071] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-17T19:45:21.558012] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-17T19:45:21.595492] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T19:45:22.027364] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T19:45:22.358072] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-17T19:45:23.158007] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-17T19:45:23.439354] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T19:45:23.538812] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T19:45:23.606377] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-17T19:45:23.958060] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-17T19:45:24.758027] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-17T19:45:25.558016] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-17T19:45:25.740624] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T19:45:25.926206] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-17T19:45:26.358036] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-17T19:45:26.507184] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T19:45:26.981200] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-17T19:45:27.158048] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-17T19:45:27.958028] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-17T19:45:28.758831] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T19:45:28.758957] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-17T19:45:28.997539] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T19:45:29.356739] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T19:45:29.558026] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-17T19:45:30.358017] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-17T19:45:31.157999] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-17T19:45:31.340248] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T19:45:31.435475] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T19:45:31.566866] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-17T19:45:31.958044] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-17T19:45:32.544559] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T19:45:32.545592] [INFO ] [REMOTE ] KEN: Full fetch complete (5954 records). [2025-10-17T19:45:32.545717] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-17T19:45:32.763175] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-17T19:45:32.907787] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-17T19:45:32.907873] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-17T19:45:32.908056] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-17T19:45:32.908098] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-17T19:45:32.908478] [DEBUG] [LOCAL ] KEN: Trimmed 5954 records to 4731 (keeping 200 days of data) [2025-10-17T19:45:32.940528] [DEBUG] [LOCAL ] KEN: Primary data saved (4731 records). [2025-10-17T19:45:32.940719] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-17T19:45:32.940830] [INFO ] [MAIN ] Update Progress: 1178/2368 symbols completed. KEN took 25.8s. Estimated remaining: 2h 47m 10s. Rate: 7.1 symbols/min [2025-10-17T19:45:33.119416] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:45:33.157572] [DEBUG] [LOCAL ] KEX: Loaded 38962 existing records from primary storage. [2025-10-17T19:45:33.157939] [INFO ] [MAIN ] KEX: Loaded 38962 existing records. [2025-10-17T19:45:33.333813] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:45:33.334031] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-17T19:45:33.334077] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-17T19:45:33.335238] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-17T19:45:33.335298] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-17T19:45:33.563284] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-17T19:45:33.686276] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:45:34.358054] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-17T19:45:34.422429] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T19:45:35.158011] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-17T19:45:35.469179] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T19:45:35.879953] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T19:45:35.957997] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-17T19:45:36.431966] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T19:45:36.758047] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-17T19:45:37.558105] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-17T19:45:37.839822] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-17T19:45:38.103499] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T19:45:38.358096] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-17T19:45:39.001617] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T19:45:39.008274] [INFO ] [REMOTE ] KBR: Full fetch complete (69959 records). [2025-10-17T19:45:39.008425] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-17T19:45:39.163273] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-17T19:45:39.401701] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-17T19:45:39.401803] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-17T19:45:39.402813] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-17T19:45:39.402882] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-17T19:45:39.404313] [DEBUG] [LOCAL ] KBR: Trimmed 69959 records to 48737 (keeping 200 days of data) [2025-10-17T19:45:39.696678] [DEBUG] [LOCAL ] KBR: Primary data saved (48737 records). [2025-10-17T19:45:39.696829] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-17T19:45:39.696956] [INFO ] [MAIN ] Update Progress: 1179/2368 symbols completed. KBR took 46.2s. Estimated remaining: 2h 47m 0s. Rate: 7.1 symbols/min [2025-10-17T19:45:39.869418] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:45:39.869615] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-17T19:45:39.869684] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-17T19:45:39.869805] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-17T19:45:39.869846] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-17T19:45:39.869887] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-17T19:45:39.869919] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-17T19:45:39.960012] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-17T19:45:40.230023] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:45:40.260489] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T19:45:40.758136] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-17T19:45:40.814095] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T19:45:41.482324] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T19:45:41.558006] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-17T19:45:42.358116] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-17T19:45:42.408627] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T19:45:42.415989] [INFO ] [REMOTE ] KD: Full fetch complete (76090 records). [2025-10-17T19:45:42.416141] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-17T19:45:42.818142] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-17T19:45:42.818303] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-17T19:45:42.819411] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-17T19:45:42.819536] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-17T19:45:42.821363] [DEBUG] [LOCAL ] KD: Trimmed 76090 records to 53125 (keeping 200 days of data) [2025-10-17T19:45:42.943867] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T19:45:43.158293] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-17T19:45:43.171360] [DEBUG] [LOCAL ] KD: Primary data saved (53125 records). [2025-10-17T19:45:43.171523] [INFO ] [MAIN ] KD: Full history saved. [2025-10-17T19:45:43.172169] [INFO ] [MAIN ] Update Progress: 1180/2368 symbols completed. KD took 37.1s. Estimated remaining: 2h 46m 47s. Rate: 7.1 symbols/min [2025-10-17T19:45:43.341864] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:45:43.383584] [DEBUG] [LOCAL ] KEYS: Loaded 43613 existing records from primary storage. [2025-10-17T19:45:43.383945] [INFO ] [MAIN ] KEYS: Loaded 43613 existing records. [2025-10-17T19:45:43.560029] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:45:43.560253] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-17T19:45:43.560300] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-17T19:45:43.561082] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-17T19:45:43.561151] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-17T19:45:43.924438] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:45:43.957995] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-17T19:45:44.111795] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T19:45:44.758117] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-17T19:45:44.781424] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T19:45:45.258726] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T19:45:45.558035] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-17T19:45:46.358048] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-17T19:45:46.627784] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T19:45:46.860259] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T19:45:47.158007] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-17T19:45:47.820482] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T19:45:47.958098] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-17T19:45:48.446170] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T19:45:48.758029] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-17T19:45:49.437769] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T19:45:49.558038] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-17T19:45:50.222629] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T19:45:50.358024] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-17T19:45:51.137357] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T19:45:51.157994] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-17T19:45:51.903871] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T19:45:51.958041] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-17T19:45:52.739787] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T19:45:52.758014] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-17T19:45:52.973347] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-17T19:45:53.558026] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-17T19:45:54.358004] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-17T19:45:54.393521] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T19:45:54.980890] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T19:45:55.158041] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-17T19:45:55.511709] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T19:45:55.516513] [INFO ] [REMOTE ] KEP: Full fetch complete (42229 records). [2025-10-17T19:45:55.516622] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-17T19:45:55.899872] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-17T19:45:55.899970] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-17T19:45:55.900739] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-17T19:45:55.900801] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-17T19:45:55.901821] [DEBUG] [LOCAL ] KEP: Trimmed 42229 records to 32548 (keeping 200 days of data) [2025-10-17T19:45:55.959358] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-17T19:45:56.092685] [DEBUG] [LOCAL ] KEP: Primary data saved (32548 records). [2025-10-17T19:45:56.092829] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-17T19:45:56.092912] [INFO ] [MAIN ] Update Progress: 1181/2368 symbols completed. KEP took 36.8s. Estimated remaining: 2h 46m 43s. Rate: 7.1 symbols/min [2025-10-17T19:45:56.261916] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:45:56.265835] [DEBUG] [LOCAL ] KF: Loaded 2377 existing records from primary storage. [2025-10-17T19:45:56.265987] [INFO ] [MAIN ] KF: Loaded 2377 existing records. [2025-10-17T19:45:56.446294] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:45:56.446550] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-17T19:45:56.446617] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-17T19:45:56.446899] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-17T19:45:56.446974] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-17T19:45:56.786698] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-17T19:45:56.811067] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:45:56.841161] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T19:45:57.558035] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-17T19:45:57.929626] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T19:45:58.343512] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T19:45:58.357983] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-17T19:45:58.437086] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-17T19:45:59.158032] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-17T19:45:59.958021] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-17T19:46:00.055560] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T19:46:00.223260] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T19:46:00.758066] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-17T19:46:01.558056] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-17T19:46:02.149841] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T19:46:02.186997] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-17T19:46:02.358016] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-17T19:46:02.718619] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-17T19:46:02.724867] [INFO ] [REMOTE ] KEX: Full fetch complete (56100 records). [2025-10-17T19:46:02.724983] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-17T19:46:02.910000] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-17T19:46:03.133371] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-17T19:46:03.133483] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-17T19:46:03.134795] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-17T19:46:03.134880] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-17T19:46:03.136523] [DEBUG] [LOCAL ] KEX: Trimmed 56100 records to 39285 (keeping 200 days of data) [2025-10-17T19:46:03.194553] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-17T19:46:03.394387] [DEBUG] [LOCAL ] KEX: Primary data saved (39285 records). [2025-10-17T19:46:03.394542] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-17T19:46:03.394671] [INFO ] [MAIN ] Update Progress: 1182/2368 symbols completed. KEX took 30.5s. Estimated remaining: 2h 46m 33s. Rate: 7.1 symbols/min [2025-10-17T19:46:03.578749] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:46:03.605727] [DEBUG] [LOCAL ] KFRC: Loaded 20719 existing records from primary storage. [2025-10-17T19:46:03.606039] [INFO ] [MAIN ] KFRC: Loaded 20719 existing records. [2025-10-17T19:46:03.859852] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:46:03.860157] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-17T19:46:03.860228] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-17T19:46:03.860694] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-17T19:46:03.860754] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-17T19:46:03.963251] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-17T19:46:04.322776] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:46:04.566733] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-17T19:46:04.758006] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-17T19:46:05.161062] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T19:46:05.187896] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-17T19:46:05.558082] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-17T19:46:06.136410] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T19:46:06.358019] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-17T19:46:07.158088] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-17T19:46:07.754089] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T19:46:07.958085] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-17T19:46:08.377053] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-17T19:46:08.697952] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T19:46:08.758051] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-17T19:46:09.558027] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-17T19:46:10.274721] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T19:46:10.358049] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-17T19:46:11.158027] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-17T19:46:11.558868] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-17T19:46:11.625215] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T19:46:11.958016] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-17T19:46:12.106380] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T19:46:12.758085] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-17T19:46:13.546317] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T19:46:13.557985] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-17T19:46:13.652509] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T19:46:14.358006] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-17T19:46:14.481001] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-17T19:46:15.158073] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-17T19:46:15.616002] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-17T19:46:15.958043] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-17T19:46:16.147083] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T19:46:16.758089] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-17T19:46:17.504491] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T19:46:17.558025] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-17T19:46:18.358026] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-17T19:46:18.534468] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T19:46:18.795689] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-17T19:46:19.158057] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-17T19:46:19.958064] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-17T19:46:20.520222] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-17T19:46:20.521245] [INFO ] [REMOTE ] KF: Full fetch complete (3531 records). [2025-10-17T19:46:20.521319] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-17T19:46:20.760049] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-17T19:46:20.880283] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-17T19:46:20.880362] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-17T19:46:20.880506] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-17T19:46:20.880547] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-17T19:46:20.880930] [DEBUG] [LOCAL ] KF: Trimmed 3531 records to 2385 (keeping 200 days of data) [2025-10-17T19:46:20.894931] [DEBUG] [LOCAL ] KF: Primary data saved (2385 records). [2025-10-17T19:46:20.894994] [INFO ] [MAIN ] KF: Full history saved. [2025-10-17T19:46:20.895063] [INFO ] [MAIN ] Update Progress: 1183/2368 symbols completed. KF took 24.8s. Estimated remaining: 2h 46m 34s. Rate: 7.1 symbols/min [2025-10-17T19:46:21.068130] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:46:21.077727] [DEBUG] [LOCAL ] KFS: Loaded 8736 existing records from primary storage. [2025-10-17T19:46:21.077939] [INFO ] [MAIN ] KFS: Loaded 8736 existing records. [2025-10-17T19:46:21.257911] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:46:21.258243] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-17T19:46:21.258319] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-17T19:46:21.258737] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-17T19:46:21.258799] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-17T19:46:21.336045] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-17T19:46:21.392589] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-17T19:46:21.392782] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-17T19:46:21.756627] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T19:46:21.762855] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:46:21.776441] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:46:21.780983] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-17T19:46:21.797088] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-17T19:46:21.871532] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:46:21.871606] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-17T19:46:21.874380] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-17T19:46:21.874132] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T19:46:21.875455] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-17T19:46:21.875598] [INFO ] [MAIN ] Update Progress: 1184/2368 symbols completed. KEY took 42.2s. Estimated remaining: 2h 46m 18s. Rate: 7.1 symbols/min [2025-10-17T19:46:22.053576] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (4.50 seconds). [2025-10-17T19:46:22.070680] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:46:22.076418] [INFO ] [REMOTE ] KEYS: Full fetch complete (62699 records). [2025-10-17T19:46:22.076505] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-17T19:46:22.077599] [FATAL] [VALIDATOR ] KEYS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T19:46:22.077744] [FATAL] [MAIN ] KEYS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:46:22.077791] [WARN ] [MAIN ] KEYS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:46:22.077890] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-17T19:46:22.077982] [DEBUG] [LOCAL ] KEYS: No primary data file found to delete. [2025-10-17T19:46:22.078033] [INFO ] [LOCAL ] KEYS: Starting deletion of derivative data. [2025-10-17T19:46:22.078317] [DEBUG] [LOCAL ] KEYS: Deleted derivative data file. [2025-10-17T19:46:22.078790] [INFO ] [MAIN ] Update Progress: 1185/2368 symbols completed. KEYS took 38.9s. Estimated remaining: 2h 46m 1s. Rate: 7.1 symbols/min [2025-10-17T19:46:22.267049] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:46:22.269141] [DEBUG] [LOCAL ] KFY: Loaded 30189 existing records from primary storage. [2025-10-17T19:46:22.269552] [INFO ] [MAIN ] KFY: Loaded 30189 existing records. [2025-10-17T19:46:22.360157] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-17T19:46:22.457024] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:46:22.457365] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-17T19:46:22.457428] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-17T19:46:22.458068] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-17T19:46:22.458126] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-17T19:46:22.569293] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-17T19:46:22.659691] [DEBUG] [LOCAL ] KGC: Loaded 54090 existing records from primary storage. [2025-10-17T19:46:22.679850] [INFO ] [MAIN ] KGC: Loaded 54090 existing records. [2025-10-17T19:46:23.085343] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:46:23.122009] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:46:23.122557] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-17T19:46:23.123064] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-17T19:46:23.124189] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-17T19:46:23.124251] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-17T19:46:23.160118] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-17T19:46:23.472282] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-17T19:46:23.526730] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:46:23.926572] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T19:46:23.958056] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-17T19:46:24.758034] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-17T19:46:25.349337] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T19:46:25.558044] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-17T19:46:26.114580] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-17T19:46:26.358082] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-17T19:46:26.986292] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T19:46:27.053747] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-17T19:46:27.158025] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-17T19:46:27.753426] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-17T19:46:27.958034] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-17T19:46:28.758032] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-17T19:46:29.135334] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T19:46:29.317709] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-17T19:46:29.558012] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-17T19:46:30.358031] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-17T19:46:30.992557] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T19:46:31.158029] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-17T19:46:31.957988] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-17T19:46:32.365470] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-17T19:46:32.410148] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-17T19:46:32.467168] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T19:46:32.758093] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-17T19:46:33.558037] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-17T19:46:34.358016] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-17T19:46:34.685566] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T19:46:34.719456] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-17T19:46:35.158038] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-17T19:46:35.529529] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T19:46:35.958025] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-17T19:46:36.714331] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T19:46:36.757989] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-17T19:46:37.256193] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-17T19:46:37.558024] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-17T19:46:37.574615] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T19:46:38.358047] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-17T19:46:38.919420] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-17T19:46:39.158018] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-17T19:46:39.639417] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T19:46:39.643129] [INFO ] [REMOTE ] KFRC: Full fetch complete (26733 records). [2025-10-17T19:46:39.643201] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-17T19:46:39.963261] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-17T19:46:40.009982] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-17T19:46:40.010061] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-17T19:46:40.010672] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-17T19:46:40.010736] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-17T19:46:40.011484] [DEBUG] [LOCAL ] KFRC: Trimmed 26733 records to 20885 (keeping 200 days of data) [2025-10-17T19:46:40.140945] [DEBUG] [LOCAL ] KFRC: Primary data saved (20885 records). [2025-10-17T19:46:40.141069] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-17T19:46:40.141145] [INFO ] [MAIN ] Update Progress: 1186/2368 symbols completed. KFRC took 36.7s. Estimated remaining: 2h 46m 3s. Rate: 7.1 symbols/min [2025-10-17T19:46:40.309891] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:46:40.331536] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T19:46:40.389796] [DEBUG] [LOCAL ] KGS: Loaded 46426 existing records from primary storage. [2025-10-17T19:46:40.390138] [INFO ] [MAIN ] KGS: Loaded 46426 existing records. [2025-10-17T19:46:40.571980] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:46:40.572199] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-17T19:46:40.572246] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-17T19:46:40.573016] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-17T19:46:40.573075] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-17T19:46:40.763270] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-17T19:46:40.932854] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:46:41.362503] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-17T19:46:41.558005] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-17T19:46:41.860930] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T19:46:42.320100] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T19:46:42.357986] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-17T19:46:43.158051] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-17T19:46:43.866699] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T19:46:43.957990] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-17T19:46:44.683434] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T19:46:44.757994] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-17T19:46:45.333960] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-17T19:46:45.558024] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-17T19:46:46.306187] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T19:46:46.357981] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-17T19:46:46.505097] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T19:46:47.124518] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T19:46:47.158003] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-17T19:46:47.958032] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-17T19:46:48.758062] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-17T19:46:49.186599] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T19:46:49.483137] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T19:46:49.542837] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T19:46:49.557977] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-17T19:46:50.358073] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-17T19:46:51.143811] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T19:46:51.145736] [INFO ] [REMOTE ] KFS: Full fetch complete (11104 records). [2025-10-17T19:46:51.145820] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-17T19:46:51.166599] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-17T19:46:51.363537] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T19:46:51.552373] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-17T19:46:51.552471] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-17T19:46:51.552841] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-17T19:46:51.552907] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-17T19:46:51.553446] [DEBUG] [LOCAL ] KFS: Trimmed 11104 records to 8837 (keeping 200 days of data) [2025-10-17T19:46:51.603894] [DEBUG] [LOCAL ] KFS: Primary data saved (8837 records). [2025-10-17T19:46:51.604024] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-17T19:46:51.604107] [INFO ] [MAIN ] Update Progress: 1187/2368 symbols completed. KFS took 30.7s. Estimated remaining: 2h 45m 57s. Rate: 7.1 symbols/min [2025-10-17T19:46:51.769570] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:46:51.820113] [DEBUG] [LOCAL ] KIM: Loaded 53394 existing records from primary storage. [2025-10-17T19:46:51.820490] [INFO ] [MAIN ] KIM: Loaded 53394 existing records. [2025-10-17T19:46:51.963169] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-17T19:46:52.002320] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:46:52.002496] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-17T19:46:52.002545] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-17T19:46:52.003503] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-17T19:46:52.003560] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-17T19:46:52.367401] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:46:52.758001] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-17T19:46:53.210395] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-17T19:46:53.563123] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-17T19:46:53.579853] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T19:46:54.358007] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-17T19:46:54.473318] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T19:46:54.520248] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T19:46:55.158028] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-17T19:46:55.473558] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T19:46:55.958062] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-17T19:46:56.758108] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-17T19:46:56.902422] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T19:46:57.558075] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-17T19:46:58.316373] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-17T19:46:58.358017] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-17T19:46:58.424353] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T19:46:58.892856] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T19:46:58.897209] [INFO ] [REMOTE ] KFY: Full fetch complete (43366 records). [2025-10-17T19:46:58.897319] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-17T19:46:59.163201] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-17T19:46:59.288341] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-17T19:46:59.288422] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-17T19:46:59.289244] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-17T19:46:59.289308] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-17T19:46:59.290358] [DEBUG] [LOCAL ] KFY: Trimmed 43366 records to 30339 (keeping 200 days of data) [2025-10-17T19:46:59.470216] [DEBUG] [LOCAL ] KFY: Primary data saved (30339 records). [2025-10-17T19:46:59.470348] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-17T19:46:59.470430] [INFO ] [MAIN ] Update Progress: 1188/2368 symbols completed. KFY took 37.6s. Estimated remaining: 2h 45m 48s. Rate: 7.1 symbols/min [2025-10-17T19:46:59.636126] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:46:59.655984] [DEBUG] [LOCAL ] KIO: Loaded 21866 existing records from primary storage. [2025-10-17T19:46:59.656205] [INFO ] [MAIN ] KIO: Loaded 21866 existing records. [2025-10-17T19:46:59.832322] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:46:59.832530] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-17T19:46:59.832576] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-17T19:46:59.833085] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-17T19:46:59.833142] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-17T19:46:59.962417] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-17T19:47:00.149518] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T19:47:00.234894] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:00.758017] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-17T19:47:01.017293] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T19:47:01.558056] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-17T19:47:01.800096] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T19:47:02.358036] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-17T19:47:02.758376] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-17T19:47:03.158051] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-17T19:47:03.958112] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-17T19:47:04.482810] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-17T19:47:04.763558] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-17T19:47:04.777308] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T19:47:05.019302] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T19:47:05.558020] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-17T19:47:05.912447] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (5.15 seconds). [2025-10-17T19:47:06.358013] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-17T19:47:07.073374] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-17T19:47:07.081513] [INFO ] [REMOTE ] KGC: Full fetch complete (77872 records). [2025-10-17T19:47:07.081711] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-17T19:47:07.168307] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-17T19:47:07.213760] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T19:47:07.446254] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T19:47:07.570775] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-17T19:47:07.570858] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-17T19:47:07.571993] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-17T19:47:07.572059] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-17T19:47:07.573530] [DEBUG] [LOCAL ] KGC: Trimmed 77872 records to 54480 (keeping 200 days of data) [2025-10-17T19:47:07.907387] [DEBUG] [LOCAL ] KGC: Primary data saved (54480 records). [2025-10-17T19:47:07.907524] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-17T19:47:07.908289] [INFO ] [MAIN ] Update Progress: 1189/2368 symbols completed. KGC took 45.8s. Estimated remaining: 2h 45m 40s. Rate: 7.1 symbols/min [2025-10-17T19:47:07.970084] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-17T19:47:08.075468] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:47:08.126661] [DEBUG] [LOCAL ] KKR: Loaded 53893 existing records from primary storage. [2025-10-17T19:47:08.126997] [INFO ] [MAIN ] KKR: Loaded 53893 existing records. [2025-10-17T19:47:08.302120] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:47:08.302317] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-17T19:47:08.302362] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-17T19:47:08.303383] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-17T19:47:08.303442] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-17T19:47:08.671083] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:08.757992] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-17T19:47:09.140399] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T19:47:09.166080] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-17T19:47:09.558029] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-17T19:47:10.358035] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-17T19:47:10.593321] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T19:47:11.158001] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-17T19:47:11.340993] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T19:47:11.387268] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T19:47:11.958050] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-17T19:47:12.758002] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-17T19:47:12.880473] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T19:47:12.887484] [INFO ] [REMOTE ] KGS: Full fetch complete (66496 records). [2025-10-17T19:47:12.887674] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-17T19:47:13.022797] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T19:47:13.282396] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-17T19:47:13.282479] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-17T19:47:13.283432] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-17T19:47:13.283499] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-17T19:47:13.284895] [DEBUG] [LOCAL ] KGS: Trimmed 66496 records to 46744 (keeping 200 days of data) [2025-10-17T19:47:13.558137] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-17T19:47:13.565120] [DEBUG] [LOCAL ] KGS: Primary data saved (46744 records). [2025-10-17T19:47:13.565293] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-17T19:47:13.565858] [INFO ] [MAIN ] Update Progress: 1190/2368 symbols completed. KGS took 33.4s. Estimated remaining: 2h 45m 29s. Rate: 7.1 symbols/min [2025-10-17T19:47:13.733636] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:47:13.741481] [DEBUG] [LOCAL ] KKRS: Loaded 5648 existing records from primary storage. [2025-10-17T19:47:13.741760] [INFO ] [MAIN ] KKRS: Loaded 5648 existing records. [2025-10-17T19:47:13.912627] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:47:13.912856] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-17T19:47:13.912903] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-17T19:47:13.913125] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-17T19:47:13.913181] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-17T19:47:14.262572] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:14.357987] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-17T19:47:14.553955] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T19:47:15.072527] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-17T19:47:15.158058] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-17T19:47:15.368871] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T19:47:15.958088] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-17T19:47:16.352342] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-17T19:47:16.765106] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-17T19:47:16.771165] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T19:47:17.558018] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-17T19:47:17.825618] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T19:47:18.358044] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-17T19:47:19.158031] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-17T19:47:19.588100] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T19:47:19.958077] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-17T19:47:20.157383] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T19:47:20.341438] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-17T19:47:20.758124] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-17T19:47:21.558008] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-17T19:47:21.921803] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T19:47:22.185597] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T19:47:22.358084] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-17T19:47:22.484673] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T19:47:23.158007] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-17T19:47:23.482367] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T19:47:23.958077] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-17T19:47:24.521880] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-17T19:47:24.758027] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-17T19:47:25.089869] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T19:47:25.515070] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T19:47:25.558019] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-17T19:47:26.321986] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T19:47:26.358020] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-17T19:47:27.158084] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-17T19:47:27.356047] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T19:47:27.958060] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-17T19:47:28.758027] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-17T19:47:28.994892] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-17T19:47:29.163688] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T19:47:29.167605] [INFO ] [REMOTE ] KIO: Full fetch complete (32127 records). [2025-10-17T19:47:29.167759] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-17T19:47:29.533838] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-17T19:47:29.533923] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-17T19:47:29.534544] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-17T19:47:29.534587] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-17T19:47:29.535322] [DEBUG] [LOCAL ] KIO: Trimmed 32127 records to 22090 (keeping 200 days of data) [2025-10-17T19:47:29.586319] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-17T19:47:29.669445] [DEBUG] [LOCAL ] KIO: Primary data saved (22090 records). [2025-10-17T19:47:29.669568] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-17T19:47:29.669676] [INFO ] [MAIN ] Update Progress: 1191/2368 symbols completed. KIO took 30.2s. Estimated remaining: 2h 45m 28s. Rate: 7.1 symbols/min [2025-10-17T19:47:29.839435] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:47:29.839628] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-17T19:47:29.839704] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-17T19:47:29.839829] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-17T19:47:29.839895] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-17T19:47:29.839966] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-17T19:47:29.840021] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-17T19:47:30.197349] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:30.219543] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-17T19:47:30.358012] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-17T19:47:30.554476] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T19:47:30.575846] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:47:30.576148] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-17T19:47:30.576237] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:47:30.576287] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-17T19:47:30.576346] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:47:30.576418] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-17T19:47:30.576510] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-17T19:47:30.576549] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-17T19:47:30.576589] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-17T19:47:30.576633] [INFO ] [MAIN ] Update Progress: 1192/2368 symbols completed. KKRT took 0.9s. Estimated remaining: 2h 45m 12s. Rate: 7.1 symbols/min [2025-10-17T19:47:30.739731] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:47:30.739913] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-17T19:47:30.739950] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-17T19:47:30.740060] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-17T19:47:30.740102] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-17T19:47:30.740142] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-17T19:47:30.740174] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-17T19:47:31.097383] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:31.158015] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-17T19:47:31.369029] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:47:31.369339] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-17T19:47:31.369432] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:47:31.369505] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-17T19:47:31.369582] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:47:31.369703] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-17T19:47:31.369802] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-17T19:47:31.369912] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-17T19:47:31.370004] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-17T19:47:31.370095] [INFO ] [MAIN ] Update Progress: 1193/2368 symbols completed. KLAR took 0.8s. Estimated remaining: 2h 44m 56s. Rate: 7.1 symbols/min [2025-10-17T19:47:31.540734] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:47:31.574409] [DEBUG] [LOCAL ] KLC: Loaded 36757 existing records from primary storage. [2025-10-17T19:47:31.574742] [INFO ] [MAIN ] KLC: Loaded 36757 existing records. [2025-10-17T19:47:31.746949] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:47:31.747142] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-17T19:47:31.747188] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-17T19:47:31.747791] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-17T19:47:31.747848] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-17T19:47:31.963234] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-17T19:47:32.102322] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:32.758024] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-17T19:47:33.329740] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T19:47:33.558002] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-17T19:47:33.835028] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T19:47:33.842702] [INFO ] [REMOTE ] KIM: Full fetch complete (76972 records). [2025-10-17T19:47:33.842891] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-17T19:47:34.267037] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-17T19:47:34.267165] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-17T19:47:34.268485] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-17T19:47:34.268594] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-17T19:47:34.270296] [DEBUG] [LOCAL ] KIM: Trimmed 76972 records to 53783 (keeping 200 days of data) [2025-10-17T19:47:34.363111] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-17T19:47:34.615505] [DEBUG] [LOCAL ] KIM: Primary data saved (53783 records). [2025-10-17T19:47:34.615675] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-17T19:47:34.615793] [INFO ] [MAIN ] Update Progress: 1194/2368 symbols completed. KIM took 43.0s. Estimated remaining: 2h 44m 42s. Rate: 7.1 symbols/min [2025-10-17T19:47:34.800464] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:47:34.850664] [DEBUG] [LOCAL ] KMI: Loaded 54083 existing records from primary storage. [2025-10-17T19:47:34.851034] [INFO ] [MAIN ] KMI: Loaded 54083 existing records. [2025-10-17T19:47:35.041890] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:47:35.042119] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-17T19:47:35.042168] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-17T19:47:35.043228] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-17T19:47:35.043311] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-17T19:47:35.163159] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-17T19:47:35.437436] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:35.508844] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T19:47:35.823583] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T19:47:35.870434] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T19:47:35.958045] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-17T19:47:36.502924] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-17T19:47:36.758048] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-17T19:47:37.558031] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-17T19:47:37.977118] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T19:47:38.358067] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-17T19:47:39.158007] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-17T19:47:39.454601] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T19:47:39.708826] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-17T19:47:39.710045] [INFO ] [REMOTE ] KKRS: Full fetch complete (7632 records). [2025-10-17T19:47:39.710127] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-17T19:47:39.963112] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-17T19:47:40.067235] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-17T19:47:40.067388] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-17T19:47:40.067616] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-17T19:47:40.067756] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-17T19:47:40.068168] [DEBUG] [LOCAL ] KKRS: Trimmed 7632 records to 5669 (keeping 200 days of data) [2025-10-17T19:47:40.101417] [DEBUG] [LOCAL ] KKRS: Primary data saved (5669 records). [2025-10-17T19:47:40.101497] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-17T19:47:40.101582] [INFO ] [MAIN ] Update Progress: 1195/2368 symbols completed. KKRS took 26.5s. Estimated remaining: 2h 44m 31s. Rate: 7.1 symbols/min [2025-10-17T19:47:40.274626] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:47:40.282275] [DEBUG] [LOCAL ] KMPB: Loaded 3667 existing records from primary storage. [2025-10-17T19:47:40.282484] [INFO ] [MAIN ] KMPB: Loaded 3667 existing records. [2025-10-17T19:47:40.460675] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:47:40.460978] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-17T19:47:40.461037] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-17T19:47:40.471365] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-17T19:47:40.485333] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-17T19:47:40.564564] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-17T19:47:40.765722] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-17T19:47:40.854709] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:41.558002] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-17T19:47:41.928425] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-17T19:47:42.357994] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-17T19:47:42.679226] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T19:47:43.158021] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-17T19:47:43.198472] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-17T19:47:43.957997] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-17T19:47:44.290124] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T19:47:44.297423] [INFO ] [REMOTE ] KKR: Full fetch complete (77638 records). [2025-10-17T19:47:44.297542] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-17T19:47:44.437870] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-17T19:47:44.733005] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T19:47:44.731793] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-17T19:47:44.740500] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-17T19:47:44.741896] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-17T19:47:44.741959] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-17T19:47:44.743253] [DEBUG] [LOCAL ] KKR: Trimmed 77638 records to 54283 (keeping 200 days of data) [2025-10-17T19:47:44.797765] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-17T19:47:45.073278] [DEBUG] [LOCAL ] KKR: Primary data saved (54283 records). [2025-10-17T19:47:45.073407] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-17T19:47:45.074091] [INFO ] [MAIN ] Update Progress: 1196/2368 symbols completed. KKR took 37.2s. Estimated remaining: 2h 44m 19s. Rate: 7.1 symbols/min [2025-10-17T19:47:45.250540] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:47:45.275203] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-17T19:47:45.291341] [DEBUG] [LOCAL ] KMPR: Loaded 40369 existing records from primary storage. [2025-10-17T19:47:45.291674] [INFO ] [MAIN ] KMPR: Loaded 40369 existing records. [2025-10-17T19:47:45.463266] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:47:45.463514] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-17T19:47:45.463572] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-17T19:47:45.464280] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-17T19:47:45.464337] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-17T19:47:45.561457] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-17T19:47:45.808202] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:47:46.358088] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-17T19:47:47.061980] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T19:47:47.157998] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-17T19:47:47.958022] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-17T19:47:48.323703] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-17T19:47:48.393599] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-17T19:47:48.557150] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T19:47:48.758093] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-17T19:47:49.558031] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-17T19:47:50.358075] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-17T19:47:50.699165] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T19:47:50.790583] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T19:47:51.158054] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-17T19:47:51.686269] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T19:47:51.710760] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-17T19:47:51.958086] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-17T19:47:52.758104] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-17T19:47:53.252245] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T19:47:53.558044] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-17T19:47:53.903972] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T19:47:54.085565] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-17T19:47:54.358063] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-17T19:47:55.158066] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-17T19:47:55.958008] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-17T19:47:56.341222] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-17T19:47:56.614064] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T19:47:56.749983] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T19:47:56.757993] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-17T19:47:57.558064] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-17T19:47:58.014323] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-17T19:47:58.083806] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-17T19:47:58.358039] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-17T19:47:59.158050] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-17T19:47:59.845147] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T19:47:59.958075] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-17T19:48:00.758085] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-17T19:48:01.438059] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T19:48:01.499957] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-17T19:48:01.558070] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-17T19:48:02.358078] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-17T19:48:03.158079] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-17T19:48:04.108401] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T19:48:04.119538] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-17T19:48:04.681087] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T19:48:04.758031] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-17T19:48:05.625027] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (4.07 seconds). [2025-10-17T19:48:05.629042] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (4.87 seconds). [2025-10-17T19:48:05.630517] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-17T19:48:06.139147] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-17T19:48:06.144409] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T19:48:06.285396] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T19:48:06.357992] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-17T19:48:07.158083] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-17T19:48:07.935385] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T19:48:07.958004] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-17T19:48:08.641340] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T19:48:08.647167] [INFO ] [REMOTE ] KLC: Full fetch complete (50568 records). [2025-10-17T19:48:08.647358] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-17T19:48:08.763212] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-17T19:48:09.044036] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-17T19:48:09.044135] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-17T19:48:09.045073] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-17T19:48:09.045137] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-17T19:48:09.046167] [DEBUG] [LOCAL ] KLC: Trimmed 50568 records to 37016 (keeping 200 days of data) [2025-10-17T19:48:09.259509] [DEBUG] [LOCAL ] KLC: Primary data saved (37016 records). [2025-10-17T19:48:09.259682] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-17T19:48:09.259783] [INFO ] [MAIN ] Update Progress: 1197/2368 symbols completed. KLC took 37.9s. Estimated remaining: 2h 44m 26s. Rate: 7.1 symbols/min [2025-10-17T19:48:09.471241] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T19:48:09.558020] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-17T19:48:10.358043] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-17T19:48:10.764058] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-17T19:48:10.859578] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-17T19:48:11.158085] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-17T19:48:11.183220] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T19:48:11.189516] [INFO ] [REMOTE ] KMPR: Full fetch complete (53208 records). [2025-10-17T19:48:11.189690] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-17T19:48:11.564361] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-17T19:48:11.564446] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-17T19:48:11.565312] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-17T19:48:11.565375] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-17T19:48:11.566554] [DEBUG] [LOCAL ] KMPR: Trimmed 53208 records to 40730 (keeping 200 days of data) [2025-10-17T19:48:11.785308] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-17T19:48:11.827163] [DEBUG] [LOCAL ] KMPR: Primary data saved (40730 records). [2025-10-17T19:48:11.827290] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-17T19:48:11.828035] [INFO ] [MAIN ] Update Progress: 1198/2368 symbols completed. KMPR took 26.8s. Estimated remaining: 2h 44m 12s. Rate: 7.1 symbols/min [2025-10-17T19:48:11.958149] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-17T19:48:12.541461] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-17T19:48:12.542437] [INFO ] [REMOTE ] KMPB: Full fetch complete (4975 records). [2025-10-17T19:48:12.542508] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-17T19:48:12.779632] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-17T19:48:12.896097] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-17T19:48:12.896175] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-17T19:48:12.896318] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-17T19:48:12.896355] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-17T19:48:12.896809] [DEBUG] [LOCAL ] KMPB: Trimmed 4975 records to 3680 (keeping 200 days of data) [2025-10-17T19:48:12.919121] [DEBUG] [LOCAL ] KMPB: Primary data saved (3680 records). [2025-10-17T19:48:12.919250] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-17T19:48:12.919346] [INFO ] [MAIN ] Update Progress: 1199/2368 symbols completed. KMPB took 32.8s. Estimated remaining: 2h 43m 57s. Rate: 7.1 symbols/min [2025-10-17T19:48:14.771392] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T19:48:14.784953] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-17T19:48:16.864441] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-17T19:48:16.872509] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-17T19:48:16.872696] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-17T19:48:17.255386] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-17T19:48:17.255465] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-17T19:48:17.256511] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-17T19:48:17.256577] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-17T19:48:17.258113] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 54473 (keeping 200 days of data) [2025-10-17T19:48:17.584522] [DEBUG] [LOCAL ] KMI: Primary data saved (54473 records). [2025-10-17T19:48:17.584679] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-17T19:48:17.584791] [INFO ] [MAIN ] Update Progress: 1200/2368 symbols completed. KMI took 43.0s. Estimated remaining: 2h 43m 44s. Rate: 7.1 symbols/min [2025-10-17T19:48:18.142959] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:48:18.295466] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:48:18.343887] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:48:18.346578] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:48:18.381718] [DEBUG] [LOCAL ] KNF: Loaded 36840 existing records from primary storage. [2025-10-17T19:48:18.382116] [INFO ] [MAIN ] KNF: Loaded 36840 existing records. [2025-10-17T19:48:18.578556] [DEBUG] [LOCAL ] KMT: Loaded 43226 existing records from primary storage. [2025-10-17T19:48:18.610519] [DEBUG] [LOCAL ] KN: Loaded 38866 existing records from primary storage. [2025-10-17T19:48:18.632070] [INFO ] [MAIN ] KMT: Loaded 43226 existing records. [2025-10-17T19:48:18.635183] [INFO ] [MAIN ] KN: Loaded 38866 existing records. [2025-10-17T19:48:18.783040] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:48:18.754337] [DEBUG] [LOCAL ] KMX: Loaded 53667 existing records from primary storage. [2025-10-17T19:48:18.813728] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-17T19:48:18.826198] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-17T19:48:18.873248] [INFO ] [MAIN ] KMX: Loaded 53667 existing records. [2025-10-17T19:48:18.873402] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-17T19:48:18.937025] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-17T19:48:19.361545] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:48:19.365699] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:48:19.406595] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-17T19:48:19.382139] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-17T19:48:19.418979] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-17T19:48:19.445786] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-17T19:48:19.418869] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-17T19:48:19.446008] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-17T19:48:19.522921] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-17T19:48:19.523096] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-17T19:48:19.527726] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:48:19.701741] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-17T19:48:19.752931] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-17T19:48:19.840511] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-17T19:48:19.902408] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-17T19:48:20.258267] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:48:20.319564] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-17T19:48:20.624383] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:48:20.648917] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-17T19:48:20.758759] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:48:20.820430] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-17T19:48:20.940767] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:48:20.941090] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-17T19:48:21.841854] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T19:48:21.848509] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-17T19:48:22.154843] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T19:48:22.162765] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-17T19:48:22.325222] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T19:48:22.347194] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-17T19:48:22.350634] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T19:48:22.361886] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-17T19:48:22.827373] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-17T19:48:22.834322] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-17T19:48:23.603055] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T19:48:23.611989] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-17T19:48:23.696148] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T19:48:23.708039] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-17T19:48:23.806403] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T19:48:23.815046] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-17T19:48:24.028984] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T19:48:24.035333] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-17T19:48:25.006496] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T19:48:25.015997] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-17T19:48:25.068772] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T19:48:25.144445] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T19:48:25.343977] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T19:48:25.558024] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-17T19:48:26.357990] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-17T19:48:26.835346] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T19:48:27.030285] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T19:48:27.158017] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-17T19:48:27.725537] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-17T19:48:27.958041] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-17T19:48:28.758018] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-17T19:48:28.785252] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T19:48:29.559490] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-17T19:48:29.564934] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T19:48:30.358032] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-17T19:48:30.720535] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T19:48:30.785142] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-17T19:48:31.158091] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-17T19:48:31.704058] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T19:48:31.958068] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-17T19:48:32.642002] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T19:48:32.758021] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-17T19:48:33.558042] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-17T19:48:33.821350] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T19:48:34.358002] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-17T19:48:34.437780] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T19:48:35.124031] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T19:48:35.157988] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-17T19:48:35.756975] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T19:48:35.958022] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-17T19:48:36.758042] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-17T19:48:36.800550] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T19:48:37.467694] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T19:48:37.558039] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-17T19:48:38.357995] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-17T19:48:38.766526] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-17T19:48:39.042137] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T19:48:39.157998] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-17T19:48:39.745891] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T19:48:39.958044] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-17T19:48:40.466514] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T19:48:40.758111] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-17T19:48:41.558034] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-17T19:48:41.590776] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T19:48:42.358038] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-17T19:48:42.552205] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T19:48:43.047858] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T19:48:43.158057] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-17T19:48:43.898120] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T19:48:43.903753] [INFO ] [REMOTE ] KMT: Full fetch complete (61904 records). [2025-10-17T19:48:43.903857] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-17T19:48:43.970014] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-17T19:48:44.290034] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-17T19:48:44.290108] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-17T19:48:44.290977] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-17T19:48:44.291040] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-17T19:48:44.292212] [DEBUG] [LOCAL ] KMT: Trimmed 61904 records to 43532 (keeping 200 days of data) [2025-10-17T19:48:44.546743] [DEBUG] [LOCAL ] KMT: Primary data saved (43532 records). [2025-10-17T19:48:44.546864] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-17T19:48:44.546945] [INFO ] [MAIN ] Update Progress: 1201/2368 symbols completed. KMT took 27.0s. Estimated remaining: 2h 43m 54s. Rate: 7.1 symbols/min [2025-10-17T19:48:44.718435] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:48:44.729750] [DEBUG] [LOCAL ] KNOP: Loaded 10555 existing records from primary storage. [2025-10-17T19:48:44.729954] [INFO ] [MAIN ] KNOP: Loaded 10555 existing records. [2025-10-17T19:48:44.770955] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-17T19:48:44.909229] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:48:44.909593] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-17T19:48:44.909756] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-17T19:48:44.910038] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-17T19:48:44.910094] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-17T19:48:45.267727] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:48:45.314145] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-17T19:48:45.458068] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T19:48:45.557983] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-17T19:48:46.254824] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T19:48:46.358033] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-17T19:48:47.033032] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T19:48:47.039118] [INFO ] [REMOTE ] KNF: Full fetch complete (51386 records). [2025-10-17T19:48:47.039261] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-17T19:48:47.163227] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-17T19:48:47.462790] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-17T19:48:47.462876] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-17T19:48:47.463920] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-17T19:48:47.463987] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-17T19:48:47.465677] [DEBUG] [LOCAL ] KNF: Trimmed 51386 records to 37116 (keeping 200 days of data) [2025-10-17T19:48:47.698702] [DEBUG] [LOCAL ] KNF: Primary data saved (37116 records). [2025-10-17T19:48:47.698851] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-17T19:48:47.698938] [INFO ] [MAIN ] Update Progress: 1202/2368 symbols completed. KNF took 30.1s. Estimated remaining: 2h 43m 41s. Rate: 7.1 symbols/min [2025-10-17T19:48:47.867083] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:48:47.890238] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T19:48:47.912975] [DEBUG] [LOCAL ] KNSL: Loaded 18656 existing records from primary storage. [2025-10-17T19:48:47.913216] [INFO ] [MAIN ] KNSL: Loaded 18656 existing records. [2025-10-17T19:48:47.965882] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-17T19:48:48.091983] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:48:48.092197] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-17T19:48:48.092245] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-17T19:48:48.092408] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-17T19:48:48.092447] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-17T19:48:48.382710] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T19:48:48.456990] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:48:48.758079] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-17T19:48:48.826504] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T19:48:48.834675] [INFO ] [REMOTE ] KMX: Full fetch complete (76363 records). [2025-10-17T19:48:48.834841] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-17T19:48:49.226500] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-17T19:48:49.226589] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-17T19:48:49.227754] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-17T19:48:49.227866] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-17T19:48:49.229386] [DEBUG] [LOCAL ] KMX: Trimmed 76363 records to 54057 (keeping 200 days of data) [2025-10-17T19:48:49.541421] [DEBUG] [LOCAL ] KMX: Primary data saved (54057 records). [2025-10-17T19:48:49.541546] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-17T19:48:49.542115] [INFO ] [MAIN ] Update Progress: 1203/2368 symbols completed. KMX took 32.0s. Estimated remaining: 2h 43m 26s. Rate: 7.1 symbols/min [2025-10-17T19:48:49.563329] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-17T19:48:49.715311] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:48:49.759674] [DEBUG] [LOCAL ] KNTK: Loaded 47433 existing records from primary storage. [2025-10-17T19:48:49.760005] [INFO ] [MAIN ] KNTK: Loaded 47433 existing records. [2025-10-17T19:48:49.879877] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T19:48:49.948819] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:48:49.949053] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-17T19:48:49.949100] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-17T19:48:49.949785] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-17T19:48:49.949841] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-17T19:48:50.294784] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:48:50.358019] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-17T19:48:51.076419] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T19:48:51.157998] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-17T19:48:51.958025] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-17T19:48:51.972810] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T19:48:52.047401] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T19:48:52.758091] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-17T19:48:53.407945] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T19:48:53.413257] [INFO ] [REMOTE ] KN: Full fetch complete (56533 records). [2025-10-17T19:48:53.413368] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-17T19:48:53.560292] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-17T19:48:53.794792] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-17T19:48:53.794926] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-17T19:48:53.795849] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-17T19:48:53.795911] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-17T19:48:53.797027] [DEBUG] [LOCAL ] KN: Trimmed 56533 records to 39111 (keeping 200 days of data) [2025-10-17T19:48:53.915552] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T19:48:54.046433] [DEBUG] [LOCAL ] KN: Primary data saved (39111 records). [2025-10-17T19:48:54.046576] [INFO ] [MAIN ] KN: Full history saved. [2025-10-17T19:48:54.046684] [INFO ] [MAIN ] Update Progress: 1204/2368 symbols completed. KN took 36.4s. Estimated remaining: 2h 43m 14s. Rate: 7.1 symbols/min [2025-10-17T19:48:54.239215] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:48:54.290933] [DEBUG] [LOCAL ] KNX: Loaded 53005 existing records from primary storage. [2025-10-17T19:48:54.291263] [INFO ] [MAIN ] KNX: Loaded 53005 existing records. [2025-10-17T19:48:54.363737] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-17T19:48:54.370579] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T19:48:54.509499] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:48:54.509736] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-17T19:48:54.509823] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-17T19:48:54.510771] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-17T19:48:54.510831] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-17T19:48:54.918638] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:48:55.157999] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-17T19:48:55.501131] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T19:48:55.958076] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-17T19:48:56.758098] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-17T19:48:56.775933] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T19:48:56.814328] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T19:48:57.558066] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-17T19:48:58.213816] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T19:48:58.358070] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-17T19:48:59.158011] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-17T19:48:59.193745] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-17T19:48:59.379119] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-17T19:48:59.958027] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-17T19:49:00.540952] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T19:49:00.758048] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-17T19:49:00.845268] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-17T19:49:01.558038] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-17T19:49:02.333330] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-17T19:49:02.358019] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-17T19:49:02.917970] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-17T19:49:03.158032] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-17T19:49:03.877543] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T19:49:03.925130] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-17T19:49:03.957986] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-17T19:49:04.758122] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T19:49:04.758195] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-17T19:49:05.558032] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-17T19:49:05.779057] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T19:49:06.358014] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-17T19:49:06.461943] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T19:49:07.158028] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-17T19:49:07.958052] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-17T19:49:08.075907] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T19:49:08.215486] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-17T19:49:08.218331] [INFO ] [REMOTE ] KNOP: Full fetch complete (14668 records). [2025-10-17T19:49:08.218598] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-17T19:49:08.624901] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-17T19:49:08.624980] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-17T19:49:08.625323] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-17T19:49:08.625363] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-17T19:49:08.625884] [DEBUG] [LOCAL ] KNOP: Trimmed 14668 records to 10627 (keeping 200 days of data) [2025-10-17T19:49:08.686363] [DEBUG] [LOCAL ] KNOP: Primary data saved (10627 records). [2025-10-17T19:49:08.686510] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-17T19:49:08.686593] [INFO ] [MAIN ] Update Progress: 1205/2368 symbols completed. KNOP took 24.1s. Estimated remaining: 2h 43m 11s. Rate: 7.1 symbols/min [2025-10-17T19:49:08.763837] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-17T19:49:08.864123] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:49:08.864309] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-17T19:49:08.864347] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-17T19:49:08.864463] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-17T19:49:08.864505] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-17T19:49:08.864545] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-17T19:49:08.864577] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-17T19:49:09.240030] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:49:09.254089] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T19:49:09.558032] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-17T19:49:10.358012] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-17T19:49:10.479763] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T19:49:10.599481] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T19:49:11.158044] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-17T19:49:11.958051] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-17T19:49:12.245189] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T19:49:12.758020] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-17T19:49:13.067451] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-10-17T19:49:13.542005] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T19:49:13.557985] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-17T19:49:13.930221] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T19:49:14.358053] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-17T19:49:15.158031] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-17T19:49:15.368617] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T19:49:15.958082] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-17T19:49:16.198265] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-10-17T19:49:16.758057] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-17T19:49:16.789405] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T19:49:16.837187] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-17T19:49:17.558046] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-17T19:49:18.358055] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-17T19:49:18.488590] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T19:49:19.092150] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T19:49:19.158025] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-17T19:49:19.958074] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-17T19:49:20.536299] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-17T19:49:20.758004] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-17T19:49:20.859363] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T19:49:21.424580] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T19:49:21.558016] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-17T19:49:22.358066] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-17T19:49:23.158004] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-17T19:49:23.330811] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T19:49:23.395337] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-17T19:49:23.480227] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T19:49:23.483939] [INFO ] [REMOTE ] KNSL: Full fetch complete (27159 records). [2025-10-17T19:49:23.484050] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-17T19:49:23.875345] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-17T19:49:23.875436] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-17T19:49:23.876006] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-17T19:49:23.876067] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-17T19:49:23.876811] [DEBUG] [LOCAL ] KNSL: Trimmed 27159 records to 18750 (keeping 200 days of data) [2025-10-17T19:49:23.959225] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-17T19:49:24.000142] [DEBUG] [LOCAL ] KNSL: Primary data saved (18750 records). [2025-10-17T19:49:24.000327] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-17T19:49:24.000468] [INFO ] [MAIN ] Update Progress: 1206/2368 symbols completed. KNSL took 36.3s. Estimated remaining: 2h 43m 9s. Rate: 7.1 symbols/min [2025-10-17T19:49:24.187906] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:49:24.233517] [DEBUG] [LOCAL ] KODK: Loaded 44120 existing records from primary storage. [2025-10-17T19:49:24.233844] [INFO ] [MAIN ] KODK: Loaded 44120 existing records. [2025-10-17T19:49:24.447737] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:49:24.448091] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-17T19:49:24.448157] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-17T19:49:24.448595] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-17T19:49:24.448704] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-17T19:49:24.771765] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-17T19:49:24.854635] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:49:24.886374] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T19:49:25.558084] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-17T19:49:25.665592] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T19:49:26.358121] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-17T19:49:27.158089] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-17T19:49:27.370251] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T19:49:27.537542] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-17T19:49:27.958006] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-17T19:49:28.060204] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T19:49:28.758031] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-17T19:49:28.795800] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T19:49:29.558043] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-17T19:49:29.579557] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T19:49:29.587524] [INFO ] [REMOTE ] KNX: Full fetch complete (76244 records). [2025-10-17T19:49:29.587729] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-17T19:49:29.988025] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-17T19:49:29.988134] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-17T19:49:29.989293] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-17T19:49:29.989384] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-17T19:49:29.991222] [DEBUG] [LOCAL ] KNX: Trimmed 76244 records to 53395 (keeping 200 days of data) [2025-10-17T19:49:30.260407] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-17T19:49:30.357470] [DEBUG] [LOCAL ] KNX: Primary data saved (53395 records). [2025-10-17T19:49:30.357594] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-17T19:49:30.357714] [INFO ] [MAIN ] Update Progress: 1207/2368 symbols completed. KNX took 36.3s. Estimated remaining: 2h 42m 59s. Rate: 7.1 symbols/min [2025-10-17T19:49:30.369259] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-17T19:49:30.532630] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:49:30.557524] [DEBUG] [LOCAL ] KOF: Loaded 26812 existing records from primary storage. [2025-10-17T19:49:30.557819] [INFO ] [MAIN ] KOF: Loaded 26812 existing records. [2025-10-17T19:49:30.743117] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:49:30.743348] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-17T19:49:30.743426] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-17T19:49:30.743996] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-17T19:49:30.744066] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-17T19:49:31.097432] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:49:31.123078] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T19:49:31.157985] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-17T19:49:31.958013] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-17T19:49:32.188553] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T19:49:32.195431] [INFO ] [REMOTE ] KNTK: Full fetch complete (65652 records). [2025-10-17T19:49:32.195557] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-17T19:49:32.578357] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T19:49:32.622555] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-17T19:49:32.622728] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-17T19:49:32.623732] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-17T19:49:32.623796] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-17T19:49:32.625281] [DEBUG] [LOCAL ] KNTK: Trimmed 65652 records to 47788 (keeping 200 days of data) [2025-10-17T19:49:32.798718] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-17T19:49:32.916768] [DEBUG] [LOCAL ] KNTK: Primary data saved (47788 records). [2025-10-17T19:49:32.916938] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-17T19:49:32.917513] [INFO ] [MAIN ] Update Progress: 1208/2368 symbols completed. KNTK took 43.4s. Estimated remaining: 2h 42m 45s. Rate: 7.1 symbols/min [2025-10-17T19:49:33.098531] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T19:49:33.100899] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:49:33.124230] [DEBUG] [LOCAL ] KOP: Loaded 17544 existing records from primary storage. [2025-10-17T19:49:33.124487] [INFO ] [MAIN ] KOP: Loaded 17544 existing records. [2025-10-17T19:49:33.298546] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:49:33.298773] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-17T19:49:33.298821] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-17T19:49:33.299233] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-17T19:49:33.299290] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-17T19:49:33.563109] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-17T19:49:33.650875] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:49:34.357994] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-17T19:49:34.393889] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T19:49:34.818281] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T19:49:35.158025] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-17T19:49:35.958038] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-17T19:49:36.207774] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T19:49:36.758038] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-17T19:49:36.860514] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-17T19:49:37.554346] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-17T19:49:37.563246] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-17T19:49:37.619183] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T19:49:38.358065] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-17T19:49:39.158030] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-17T19:49:39.397049] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T19:49:39.958095] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-17T19:49:40.338073] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-17T19:49:40.758009] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-17T19:49:40.806314] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T19:49:41.224575] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T19:49:41.558031] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-17T19:49:42.358074] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-17T19:49:42.856301] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-17T19:49:43.158057] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-17T19:49:43.319932] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-17T19:49:43.393171] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-17T19:49:43.958038] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-17T19:49:44.458465] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T19:49:44.758042] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-17T19:49:45.558045] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-17T19:49:45.978903] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-17T19:49:46.358077] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-17T19:49:46.710435] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-17T19:49:47.158055] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-17T19:49:47.393176] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-17T19:49:47.668721] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T19:49:47.958105] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-17T19:49:48.606700] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T19:49:48.758045] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-17T19:49:49.097910] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T19:49:49.249945] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-17T19:49:49.257561] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-17T19:49:49.257738] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-17T19:49:49.452925] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T19:49:49.453706] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:49:49.453782] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:49:49.453832] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-17T19:49:49.453910] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-17T19:49:49.453966] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-17T19:49:49.454009] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-17T19:49:49.454089] [INFO ] [MAIN ] Update Progress: 1209/2368 symbols completed. KO took 40.8s. Estimated remaining: 2h 42m 44s. Rate: 7.1 symbols/min [2025-10-17T19:49:49.558114] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-17T19:49:49.649096] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:49:49.653145] [DEBUG] [LOCAL ] KORE: Loaded 2182 existing records from primary storage. [2025-10-17T19:49:49.653312] [INFO ] [MAIN ] KORE: Loaded 2182 existing records. [2025-10-17T19:49:49.829060] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:49:49.829285] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-17T19:49:49.829333] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-17T19:49:49.829506] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-17T19:49:49.829584] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-17T19:49:50.207551] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:49:50.358111] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-17T19:49:50.911572] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:49:51.158289] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-17T19:49:51.678711] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-17T19:49:51.958025] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-17T19:49:52.532288] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T19:49:52.536843] [INFO ] [REMOTE ] KOF: Full fetch complete (38008 records). [2025-10-17T19:49:52.536964] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-17T19:49:52.763417] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-17T19:49:52.888296] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-17T19:49:52.985924] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-17T19:49:52.986050] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-17T19:49:52.987210] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-17T19:49:52.987277] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-17T19:49:52.988738] [DEBUG] [LOCAL ] KOF: Trimmed 38008 records to 26961 (keeping 200 days of data) [2025-10-17T19:49:53.158513] [DEBUG] [LOCAL ] KOF: Primary data saved (26961 records). [2025-10-17T19:49:53.158735] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-17T19:49:53.158918] [INFO ] [MAIN ] Update Progress: 1210/2368 symbols completed. KOF took 22.8s. Estimated remaining: 2h 42m 31s. Rate: 7.1 symbols/min [2025-10-17T19:49:53.331411] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:49:53.384799] [DEBUG] [LOCAL ] KOS: Loaded 53487 existing records from primary storage. [2025-10-17T19:49:53.385272] [INFO ] [MAIN ] KOS: Loaded 53487 existing records. [2025-10-17T19:49:53.564847] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-17T19:49:53.573260] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:49:53.574661] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-17T19:49:53.574744] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-17T19:49:53.575764] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-17T19:49:53.575828] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-17T19:49:53.910432] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T19:49:53.997118] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:49:54.358054] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-17T19:49:54.585358] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T19:49:54.842122] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-17T19:49:55.158070] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-17T19:49:55.958088] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-17T19:49:56.059708] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T19:49:56.332979] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-17T19:49:56.758091] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-17T19:49:57.558035] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-17T19:49:57.707458] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-17T19:49:57.980704] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-17T19:49:58.358096] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-17T19:49:58.789219] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-17T19:49:59.158068] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-17T19:49:59.958050] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-17T19:50:00.758031] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-17T19:50:01.492806] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T19:50:01.558084] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-17T19:50:01.856834] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-10-17T19:50:02.358049] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-17T19:50:03.158069] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-17T19:50:03.298946] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-17T19:50:03.626856] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T19:50:03.670276] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-17T19:50:03.958005] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-17T19:50:04.086371] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T19:50:04.401371] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T19:50:04.758038] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-17T19:50:05.558042] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-17T19:50:05.800829] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T19:50:05.803682] [INFO ] [REMOTE ] KOP: Full fetch complete (25427 records). [2025-10-17T19:50:05.803776] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-17T19:50:06.163819] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-17T19:50:06.163902] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-17T19:50:06.164418] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-17T19:50:06.164459] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-17T19:50:06.165142] [DEBUG] [LOCAL ] KOP: Trimmed 25427 records to 17674 (keeping 200 days of data) [2025-10-17T19:50:06.270896] [DEBUG] [LOCAL ] KOP: Primary data saved (17674 records). [2025-10-17T19:50:06.271041] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-17T19:50:06.271125] [INFO ] [MAIN ] Update Progress: 1211/2368 symbols completed. KOP took 33.4s. Estimated remaining: 2h 42m 27s. Rate: 7.1 symbols/min [2025-10-17T19:50:06.366391] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-17T19:50:06.448320] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:50:06.498224] [DEBUG] [LOCAL ] KR: Loaded 54070 existing records from primary storage. [2025-10-17T19:50:06.498565] [INFO ] [MAIN ] KR: Loaded 54070 existing records. [2025-10-17T19:50:06.672111] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:50:06.672311] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-17T19:50:06.672358] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-17T19:50:06.672629] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-17T19:50:06.672714] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-17T19:50:06.931668] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T19:50:07.025119] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:50:07.157999] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-17T19:50:07.224865] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T19:50:07.958049] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-17T19:50:08.400506] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-17T19:50:08.758062] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-17T19:50:08.946514] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T19:50:09.558067] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-17T19:50:10.358036] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-17T19:50:10.509876] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T19:50:10.722943] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-17T19:50:10.952620] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T19:50:11.158041] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-17T19:50:11.958076] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-17T19:50:12.758029] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-17T19:50:13.090830] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-17T19:50:13.558071] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-17T19:50:13.832811] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T19:50:13.839562] [INFO ] [REMOTE ] KODK: Full fetch complete (63422 records). [2025-10-17T19:50:13.839756] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-17T19:50:14.227176] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-17T19:50:14.227299] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-17T19:50:14.228417] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-17T19:50:14.228503] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-17T19:50:14.230076] [DEBUG] [LOCAL ] KODK: Trimmed 63422 records to 44414 (keeping 200 days of data) [2025-10-17T19:50:14.392908] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-17T19:50:14.489304] [DEBUG] [LOCAL ] KODK: Primary data saved (44414 records). [2025-10-17T19:50:14.489519] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-17T19:50:14.489682] [INFO ] [MAIN ] Update Progress: 1212/2368 symbols completed. KODK took 50.5s. Estimated remaining: 2h 42m 19s. Rate: 7.1 symbols/min [2025-10-17T19:50:14.725309] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T19:50:14.729177] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:50:14.792705] [DEBUG] [LOCAL ] KRC: Loaded 48625 existing records from primary storage. [2025-10-17T19:50:14.793083] [INFO ] [MAIN ] KRC: Loaded 48625 existing records. [2025-10-17T19:50:14.981424] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:50:14.981690] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-17T19:50:14.981751] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-17T19:50:14.982356] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-17T19:50:14.982443] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-17T19:50:15.086842] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-17T19:50:15.088773] [INFO ] [REMOTE ] KORE: Full fetch complete (4747 records). [2025-10-17T19:50:15.089227] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-17T19:50:15.190690] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-17T19:50:15.702368] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:50:15.766227] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-17T19:50:15.766432] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-17T19:50:15.766723] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-17T19:50:15.766826] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-17T19:50:15.767412] [DEBUG] [LOCAL ] KORE: Trimmed 4747 records to 2191 (keeping 200 days of data) [2025-10-17T19:50:15.808468] [DEBUG] [LOCAL ] KORE: Primary data saved (2191 records). [2025-10-17T19:50:15.808683] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-17T19:50:15.808993] [INFO ] [MAIN ] Update Progress: 1213/2368 symbols completed. KORE took 26.4s. Estimated remaining: 2h 42m 4s. Rate: 7.1 symbols/min [2025-10-17T19:50:15.842051] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-17T19:50:15.967084] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-17T19:50:15.993295] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:50:16.027433] [DEBUG] [LOCAL ] KREF: Loaded 38221 existing records from primary storage. [2025-10-17T19:50:16.027758] [INFO ] [MAIN ] KREF: Loaded 38221 existing records. [2025-10-17T19:50:16.203003] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:50:16.203188] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-17T19:50:16.203237] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-17T19:50:16.204016] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-17T19:50:16.204077] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-17T19:50:16.551460] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:50:16.757986] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-17T19:50:17.206723] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-17T19:50:17.558022] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-17T19:50:17.999826] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-17T19:50:18.070628] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T19:50:18.358017] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-17T19:50:19.082530] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T19:50:19.157985] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-17T19:50:19.913859] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:50:19.957980] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-17T19:50:20.284038] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T19:50:20.758022] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-17T19:50:21.558026] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-17T19:50:21.806613] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T19:50:22.135348] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T19:50:22.358101] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-17T19:50:23.158065] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-17T19:50:23.225088] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T19:50:23.863533] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T19:50:23.958022] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-17T19:50:24.758008] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-17T19:50:25.006866] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T19:50:25.558017] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-17T19:50:25.664931] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T19:50:26.358096] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-17T19:50:26.570560] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T19:50:26.879521] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T19:50:27.158139] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-17T19:50:27.958019] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-17T19:50:28.192432] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T19:50:28.758036] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-17T19:50:29.021356] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T19:50:29.558032] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-17T19:50:29.598202] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T19:50:30.358021] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-17T19:50:30.714864] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-17T19:50:31.158003] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-17T19:50:31.257566] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T19:50:31.958038] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-17T19:50:32.188426] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T19:50:32.264211] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T19:50:32.271610] [INFO ] [REMOTE ] KR: Full fetch complete (77843 records). [2025-10-17T19:50:32.271786] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-17T19:50:32.693232] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-17T19:50:32.693307] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-17T19:50:32.694322] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-17T19:50:32.694385] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-17T19:50:32.695766] [DEBUG] [LOCAL ] KR: Trimmed 77843 records to 54460 (keeping 200 days of data) [2025-10-17T19:50:32.759701] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-17T19:50:33.031522] [DEBUG] [LOCAL ] KR: Primary data saved (54460 records). [2025-10-17T19:50:33.031677] [INFO ] [MAIN ] KR: Full history saved. [2025-10-17T19:50:33.032352] [INFO ] [MAIN ] Update Progress: 1214/2368 symbols completed. KR took 26.8s. Estimated remaining: 2h 42m 4s. Rate: 7.1 symbols/min [2025-10-17T19:50:33.206871] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:50:33.250140] [DEBUG] [LOCAL ] KRG: Loaded 49661 existing records from primary storage. [2025-10-17T19:50:33.250432] [INFO ] [MAIN ] KRG: Loaded 49661 existing records. [2025-10-17T19:50:33.420462] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T19:50:33.457516] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:50:33.457956] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-17T19:50:33.458012] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-17T19:50:33.458892] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-17T19:50:33.458951] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-17T19:50:33.561713] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-17T19:50:33.814825] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:50:34.358010] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-17T19:50:34.541242] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T19:50:34.711360] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T19:50:35.158036] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-17T19:50:35.810514] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T19:50:35.958003] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-17T19:50:36.758018] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-17T19:50:36.908576] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T19:50:37.365732] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T19:50:37.558001] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-17T19:50:38.358032] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-17T19:50:38.624298] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T19:50:38.631725] [INFO ] [REMOTE ] KOS: Full fetch complete (77038 records). [2025-10-17T19:50:38.631864] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-17T19:50:39.017917] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-17T19:50:39.018025] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-17T19:50:39.019181] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-17T19:50:39.019269] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-17T19:50:39.020956] [DEBUG] [LOCAL ] KOS: Trimmed 77038 records to 53875 (keeping 200 days of data) [2025-10-17T19:50:39.182552] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-17T19:50:39.357041] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T19:50:39.387315] [DEBUG] [LOCAL ] KOS: Primary data saved (53875 records). [2025-10-17T19:50:39.387484] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-17T19:50:39.387567] [INFO ] [MAIN ] Update Progress: 1215/2368 symbols completed. KOS took 46.2s. Estimated remaining: 2h 41m 53s. Rate: 7.1 symbols/min [2025-10-17T19:50:39.553325] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:50:39.553579] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-17T19:50:39.553669] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-17T19:50:39.553871] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-17T19:50:39.553920] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-17T19:50:39.553965] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-17T19:50:39.553997] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-17T19:50:39.860245] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T19:50:39.935516] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:50:39.958002] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-17T19:50:40.157148] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:50:40.157405] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-17T19:50:40.157497] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:50:40.157543] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-17T19:50:40.157576] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:50:40.157612] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-17T19:50:40.157698] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-17T19:50:40.157754] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-17T19:50:40.157796] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-17T19:50:40.157842] [INFO ] [MAIN ] Update Progress: 1216/2368 symbols completed. KRMN took 0.8s. Estimated remaining: 2h 41m 37s. Rate: 7.1 symbols/min [2025-10-17T19:50:40.332637] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:50:40.357753] [DEBUG] [LOCAL ] KRO: Loaded 26679 existing records from primary storage. [2025-10-17T19:50:40.358036] [INFO ] [MAIN ] KRO: Loaded 26679 existing records. [2025-10-17T19:50:40.534487] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:50:40.534741] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-17T19:50:40.534795] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-17T19:50:40.535265] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-17T19:50:40.535322] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-17T19:50:40.773056] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-17T19:50:40.909541] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:50:40.942552] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T19:50:41.558048] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-17T19:50:42.320157] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-17T19:50:42.358057] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-17T19:50:42.387038] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-17T19:50:43.158107] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-17T19:50:43.939111] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T19:50:43.958015] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-17T19:50:44.000996] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T19:50:44.758065] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-17T19:50:45.509273] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T19:50:45.557994] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-17T19:50:46.358030] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-17T19:50:46.390168] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T19:50:47.158059] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-17T19:50:47.270008] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T19:50:47.295379] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T19:50:47.958084] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-17T19:50:48.758072] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-17T19:50:48.796125] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T19:50:48.803343] [INFO ] [REMOTE ] KRC: Full fetch complete (70075 records). [2025-10-17T19:50:48.803511] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-17T19:50:49.202877] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-17T19:50:49.203011] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-17T19:50:49.204026] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-17T19:50:49.204178] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-17T19:50:49.205684] [DEBUG] [LOCAL ] KRC: Trimmed 70075 records to 48982 (keeping 200 days of data) [2025-10-17T19:50:49.334839] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T19:50:49.534805] [DEBUG] [LOCAL ] KRC: Primary data saved (48982 records). [2025-10-17T19:50:49.534940] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-17T19:50:49.535022] [INFO ] [MAIN ] Update Progress: 1217/2368 symbols completed. KRC took 35.0s. Estimated remaining: 2h 41m 30s. Rate: 7.1 symbols/min [2025-10-17T19:50:49.564078] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-17T19:50:49.706291] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:50:49.740356] [DEBUG] [LOCAL ] KRP: Loaded 36597 existing records from primary storage. [2025-10-17T19:50:49.740625] [INFO ] [MAIN ] KRP: Loaded 36597 existing records. [2025-10-17T19:50:49.914917] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:50:49.915116] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-17T19:50:49.915162] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-17T19:50:49.915835] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-17T19:50:49.915893] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-17T19:50:50.273716] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:50:50.357985] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-17T19:50:50.481678] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T19:50:50.612467] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T19:50:51.158041] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-17T19:50:51.663846] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T19:50:51.958012] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-17T19:50:52.336352] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T19:50:52.342167] [INFO ] [REMOTE ] KREF: Full fetch complete (52837 records). [2025-10-17T19:50:52.342263] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-17T19:50:52.713150] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-17T19:50:52.713227] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-17T19:50:52.714074] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-17T19:50:52.714135] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-17T19:50:52.715214] [DEBUG] [LOCAL ] KREF: Trimmed 52837 records to 38479 (keeping 200 days of data) [2025-10-17T19:50:52.765214] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-17T19:50:52.948917] [DEBUG] [LOCAL ] KREF: Primary data saved (38479 records). [2025-10-17T19:50:52.949045] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-17T19:50:52.949128] [INFO ] [MAIN ] Update Progress: 1218/2368 symbols completed. KREF took 37.1s. Estimated remaining: 2h 41m 17s. Rate: 7.1 symbols/min [2025-10-17T19:50:53.120045] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:50:53.133203] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-17T19:50:53.183737] [DEBUG] [LOCAL ] KSS: Loaded 53983 existing records from primary storage. [2025-10-17T19:50:53.184069] [INFO ] [MAIN ] KSS: Loaded 53983 existing records. [2025-10-17T19:50:53.357285] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:50:53.357536] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-17T19:50:53.357594] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-17T19:50:53.358407] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-17T19:50:53.358464] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-17T19:50:53.564416] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-17T19:50:53.712255] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:50:54.183468] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T19:50:54.358020] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-17T19:50:54.773880] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-17T19:50:55.158022] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-17T19:50:55.508755] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T19:50:55.958026] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-17T19:50:56.759032] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-17T19:50:56.764768] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T19:50:57.558045] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-17T19:50:57.602033] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T19:50:57.997948] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-17T19:50:58.357999] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-17T19:50:59.158024] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-17T19:50:59.391922] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T19:50:59.958021] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-17T19:51:00.056986] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T19:51:00.330830] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-17T19:51:00.758079] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-17T19:51:01.558043] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-17T19:51:01.996604] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-17T19:51:02.358034] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-17T19:51:02.543463] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T19:51:03.007384] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-17T19:51:03.158068] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-17T19:51:03.855083] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T19:51:03.958003] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-17T19:51:04.757995] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-17T19:51:05.226953] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-17T19:51:05.389390] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T19:51:05.558026] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-17T19:51:06.370434] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-17T19:51:06.373392] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T19:51:07.158001] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-17T19:51:07.246689] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T19:51:07.253800] [INFO ] [REMOTE ] KRG: Full fetch complete (71325 records). [2025-10-17T19:51:07.253923] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-17T19:51:07.660385] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-17T19:51:07.660493] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-17T19:51:07.661707] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-17T19:51:07.661796] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-17T19:51:07.663345] [DEBUG] [LOCAL ] KRG: Trimmed 71325 records to 50023 (keeping 200 days of data) [2025-10-17T19:51:07.775182] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T19:51:07.969158] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-17T19:51:08.008299] [DEBUG] [LOCAL ] KRG: Primary data saved (50023 records). [2025-10-17T19:51:08.008487] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-17T19:51:08.009206] [INFO ] [MAIN ] Update Progress: 1219/2368 symbols completed. KRG took 35.0s. Estimated remaining: 2h 41m 15s. Rate: 7.1 symbols/min [2025-10-17T19:51:08.183084] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:51:08.227860] [DEBUG] [LOCAL ] KT: Loaded 45863 existing records from primary storage. [2025-10-17T19:51:08.228208] [INFO ] [MAIN ] KT: Loaded 45863 existing records. [2025-10-17T19:51:08.408501] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:51:08.408748] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-17T19:51:08.408801] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-17T19:51:08.409509] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-17T19:51:08.409567] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-17T19:51:08.758966] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-17T19:51:08.772900] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:51:09.222257] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T19:51:09.489849] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T19:51:09.557997] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-17T19:51:09.958362] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-17T19:51:10.358011] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-17T19:51:10.772315] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T19:51:11.158029] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-17T19:51:11.570577] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T19:51:11.574497] [INFO ] [REMOTE ] KRO: Full fetch complete (35304 records). [2025-10-17T19:51:11.574577] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-17T19:51:11.947957] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-17T19:51:11.948266] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-17T19:51:11.948962] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-17T19:51:11.949023] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-17T19:51:11.949868] [DEBUG] [LOCAL ] KRO: Trimmed 35304 records to 26887 (keeping 200 days of data) [2025-10-17T19:51:11.997546] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-17T19:51:12.109906] [DEBUG] [LOCAL ] KRO: Primary data saved (26887 records). [2025-10-17T19:51:12.110047] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-17T19:51:12.110134] [INFO ] [MAIN ] Update Progress: 1220/2368 symbols completed. KRO took 32.0s. Estimated remaining: 2h 41m 2s. Rate: 7.1 symbols/min [2025-10-17T19:51:12.303528] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:51:12.341414] [DEBUG] [LOCAL ] KTB: Loaded 40757 existing records from primary storage. [2025-10-17T19:51:12.341739] [INFO ] [MAIN ] KTB: Loaded 40757 existing records. [2025-10-17T19:51:12.531927] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:51:12.532202] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-17T19:51:12.532250] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-17T19:51:12.533186] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-17T19:51:12.533247] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-17T19:51:12.779294] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-17T19:51:12.901528] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:51:13.044559] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T19:51:13.491520] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T19:51:13.558010] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-17T19:51:14.033475] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T19:51:14.358033] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-17T19:51:15.158027] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-17T19:51:15.456900] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T19:51:15.963739] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-17T19:51:15.981034] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T19:51:16.244235] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T19:51:16.758045] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-17T19:51:17.273538] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T19:51:17.558046] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-17T19:51:18.154983] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T19:51:18.358020] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-17T19:51:18.756311] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T19:51:19.158006] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-17T19:51:19.683045] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T19:51:19.958069] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-17T19:51:20.170002] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T19:51:20.758138] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-17T19:51:21.295527] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T19:51:21.300462] [INFO ] [REMOTE ] KRP: Full fetch complete (55054 records). [2025-10-17T19:51:21.300590] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-17T19:51:21.567201] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-17T19:51:21.687038] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-17T19:51:21.687136] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-17T19:51:21.688158] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-17T19:51:21.688226] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-17T19:51:21.689618] [DEBUG] [LOCAL ] KRP: Trimmed 55054 records to 36833 (keeping 200 days of data) [2025-10-17T19:51:21.917135] [DEBUG] [LOCAL ] KRP: Primary data saved (36833 records). [2025-10-17T19:51:21.917310] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-17T19:51:21.917490] [INFO ] [MAIN ] Update Progress: 1221/2368 symbols completed. KRP took 32.4s. Estimated remaining: 2h 40m 55s. Rate: 7.1 symbols/min [2025-10-17T19:51:22.114708] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:51:22.129602] [DEBUG] [LOCAL ] KTF: Loaded 11841 existing records from primary storage. [2025-10-17T19:51:22.129920] [INFO ] [MAIN ] KTF: Loaded 11841 existing records. [2025-10-17T19:51:22.335812] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:51:22.336212] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-17T19:51:22.336340] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-17T19:51:22.336784] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-17T19:51:22.336936] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-17T19:51:22.368934] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-17T19:51:22.477047] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T19:51:22.741387] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:51:23.099806] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T19:51:23.157985] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-17T19:51:23.957998] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-17T19:51:24.145876] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T19:51:24.276172] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T19:51:24.488775] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-17T19:51:24.758157] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-17T19:51:25.558023] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-17T19:51:26.358781] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-17T19:51:26.364250] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T19:51:26.390904] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T19:51:27.158143] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-17T19:51:27.958061] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-17T19:51:28.453217] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-17T19:51:28.519903] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T19:51:28.758134] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-17T19:51:29.563093] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-17T19:51:29.577992] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T19:51:29.964973] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T19:51:30.317926] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T19:51:30.357989] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-17T19:51:31.158034] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-17T19:51:31.307327] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-17T19:51:31.958064] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-17T19:51:32.758092] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-17T19:51:32.818500] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T19:51:33.540900] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T19:51:33.557974] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-17T19:51:34.358022] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-17T19:51:34.687180] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-17T19:51:35.067845] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T19:51:35.158044] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-17T19:51:35.713302] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T19:51:35.958067] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-17T19:51:36.758054] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-17T19:51:36.876999] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T19:51:36.924135] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T19:51:37.558027] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-17T19:51:38.358031] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-17T19:51:38.453577] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-17T19:51:38.513344] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T19:51:38.520733] [INFO ] [REMOTE ] KSS: Full fetch complete (77754 records). [2025-10-17T19:51:38.520912] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-17T19:51:38.966727] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-17T19:51:38.966819] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-17T19:51:38.967880] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-17T19:51:38.967947] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-17T19:51:38.969449] [DEBUG] [LOCAL ] KSS: Trimmed 77754 records to 54372 (keeping 200 days of data) [2025-10-17T19:51:39.179324] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-17T19:51:39.298741] [DEBUG] [LOCAL ] KSS: Primary data saved (54372 records). [2025-10-17T19:51:39.298874] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-17T19:51:39.298953] [INFO ] [MAIN ] Update Progress: 1222/2368 symbols completed. KSS took 46.3s. Estimated remaining: 2h 40m 55s. Rate: 7.1 symbols/min [2025-10-17T19:51:39.468779] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:51:39.468977] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-17T19:51:39.469028] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-17T19:51:39.469158] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-17T19:51:39.469228] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-17T19:51:39.469297] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-17T19:51:39.469341] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-17T19:51:39.845572] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:51:39.942558] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T19:51:39.957974] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-17T19:51:40.758030] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-17T19:51:41.137872] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-17T19:51:41.144029] [INFO ] [REMOTE ] KT: Full fetch complete (66872 records). [2025-10-17T19:51:41.144152] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-17T19:51:41.538579] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-17T19:51:41.538841] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-17T19:51:41.538939] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-17T19:51:41.540002] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-17T19:51:41.542023] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-17T19:51:41.543576] [DEBUG] [LOCAL ] KT: Trimmed 66872 records to 46205 (keeping 200 days of data) [2025-10-17T19:51:41.620858] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-17T19:51:41.663056] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T19:51:41.864395] [DEBUG] [LOCAL ] KT: Primary data saved (46205 records). [2025-10-17T19:51:41.864532] [INFO ] [MAIN ] KT: Full history saved. [2025-10-17T19:51:41.865257] [INFO ] [MAIN ] Update Progress: 1223/2368 symbols completed. KT took 33.9s. Estimated remaining: 2h 40m 41s. Rate: 7.1 symbols/min [2025-10-17T19:51:42.031754] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:51:42.087537] [DEBUG] [LOCAL ] KVUE: Loaded 54057 existing records from primary storage. [2025-10-17T19:51:42.087926] [INFO ] [MAIN ] KVUE: Loaded 54057 existing records. [2025-10-17T19:51:42.298747] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:51:42.298966] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-17T19:51:42.299015] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-17T19:51:42.300268] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-17T19:51:42.300328] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-17T19:51:42.363366] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-17T19:51:42.619139] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T19:51:42.702095] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:51:43.158078] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-17T19:51:43.965869] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-17T19:51:43.971591] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T19:51:43.996124] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-17T19:51:44.758052] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-17T19:51:45.557998] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-17T19:51:45.667756] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T19:51:46.247948] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T19:51:46.253096] [INFO ] [REMOTE ] KTB: Full fetch complete (58271 records). [2025-10-17T19:51:46.253250] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-17T19:51:46.359208] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-17T19:51:46.656529] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T19:51:46.679715] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-17T19:51:46.679790] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-17T19:51:46.680845] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-17T19:51:46.680911] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-17T19:51:46.682284] [DEBUG] [LOCAL ] KTB: Trimmed 58271 records to 41064 (keeping 200 days of data) [2025-10-17T19:51:46.931314] [DEBUG] [LOCAL ] KTB: Primary data saved (41064 records). [2025-10-17T19:51:46.931444] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-17T19:51:46.931528] [INFO ] [MAIN ] Update Progress: 1224/2368 symbols completed. KTB took 34.8s. Estimated remaining: 2h 40m 30s. Rate: 7.1 symbols/min [2025-10-17T19:51:47.101788] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:51:47.156743] [DEBUG] [LOCAL ] KVYO: Loaded 51171 existing records from primary storage. [2025-10-17T19:51:47.157187] [INFO ] [MAIN ] KVYO: Loaded 51171 existing records. [2025-10-17T19:51:47.168506] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-17T19:51:47.345239] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:51:47.345511] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-17T19:51:47.345580] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-17T19:51:47.346393] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-17T19:51:47.346454] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-17T19:51:47.695892] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:51:47.958002] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-17T19:51:48.075735] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T19:51:48.134694] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T19:51:48.758094] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-17T19:51:49.534558] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T19:51:49.557981] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-17T19:51:50.097365] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T19:51:50.358041] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-17T19:51:51.149100] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T19:51:51.158034] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-17T19:51:51.958023] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-17T19:51:51.983225] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-17T19:51:52.176935] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T19:51:52.583026] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T19:51:52.758014] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-17T19:51:53.483715] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T19:51:53.485423] [INFO ] [REMOTE ] KTF: Full fetch complete (17366 records). [2025-10-17T19:51:53.485495] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-17T19:51:53.563150] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-17T19:51:53.864705] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-17T19:51:53.864790] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-17T19:51:53.865221] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-17T19:51:53.865295] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-17T19:51:53.865935] [DEBUG] [LOCAL ] KTF: Trimmed 17366 records to 11900 (keeping 200 days of data) [2025-10-17T19:51:53.936724] [DEBUG] [LOCAL ] KTF: Primary data saved (11900 records). [2025-10-17T19:51:53.936850] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-17T19:51:53.936940] [INFO ] [MAIN ] Update Progress: 1225/2368 symbols completed. KTF took 32.0s. Estimated remaining: 2h 40m 20s. Rate: 7.1 symbols/min [2025-10-17T19:51:54.108001] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:51:54.146727] [DEBUG] [LOCAL ] KW: Loaded 40783 existing records from primary storage. [2025-10-17T19:51:54.147215] [INFO ] [MAIN ] KW: Loaded 40783 existing records. [2025-10-17T19:51:54.321887] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:51:54.322091] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-17T19:51:54.322138] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-17T19:51:54.322796] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-17T19:51:54.322853] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-17T19:51:54.365313] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-17T19:51:54.700750] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:51:55.158040] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-17T19:51:55.418289] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T19:51:55.694171] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-17T19:51:55.958026] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-17T19:51:56.766159] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-17T19:51:56.768769] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T19:51:57.279055] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T19:51:57.342553] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T19:51:57.558052] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-17T19:51:57.998340] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-17T19:51:58.358042] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-17T19:51:59.158087] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-17T19:51:59.826799] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T19:51:59.958042] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-17T19:52:00.758067] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-17T19:52:00.936174] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T19:52:01.558075] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-17T19:52:01.635324] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T19:52:02.358167] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-17T19:52:02.724242] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T19:52:03.158014] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-17T19:52:03.466573] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T19:52:03.582529] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T19:52:03.818294] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T19:52:03.958002] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-17T19:52:04.758044] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-17T19:52:05.186300] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-17T19:52:05.544814] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T19:52:05.557986] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-17T19:52:06.358056] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-17T19:52:07.021870] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T19:52:07.158050] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-17T19:52:07.363595] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T19:52:07.958047] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-17T19:52:08.001328] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T19:52:08.758042] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-17T19:52:09.558005] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-17T19:52:09.764362] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T19:52:09.823858] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T19:52:09.825903] [INFO ] [REMOTE ] KUKE: Full fetch complete (9008 records). [2025-10-17T19:52:09.826013] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-17T19:52:10.004500] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T19:52:10.004774] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T19:52:10.004846] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T19:52:10.004920] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-17T19:52:10.004986] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-17T19:52:10.005025] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-17T19:52:10.005066] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-17T19:52:10.005126] [INFO ] [MAIN ] Update Progress: 1226/2368 symbols completed. KUKE took 30.7s. Estimated remaining: 2h 40m 19s. Rate: 7.1 symbols/min [2025-10-17T19:52:10.174723] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:52:10.191394] [DEBUG] [LOCAL ] KWR: Loaded 16172 existing records from primary storage. [2025-10-17T19:52:10.191625] [INFO ] [MAIN ] KWR: Loaded 16172 existing records. [2025-10-17T19:52:10.370671] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-17T19:52:10.376451] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:52:10.377284] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-17T19:52:10.377367] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-17T19:52:10.377802] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-17T19:52:10.377860] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-17T19:52:10.734990] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:52:11.158011] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-17T19:52:11.326324] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T19:52:11.958024] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-17T19:52:12.225484] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T19:52:12.758024] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-17T19:52:13.040795] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T19:52:13.558032] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-17T19:52:13.596232] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T19:52:14.124696] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T19:52:14.358017] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-17T19:52:14.571833] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T19:52:15.158027] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-17T19:52:15.869313] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-17T19:52:15.957991] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-17T19:52:16.144022] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T19:52:16.758019] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-17T19:52:17.558003] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-17T19:52:17.722484] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T19:52:18.229713] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T19:52:18.259416] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-17T19:52:18.358028] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-17T19:52:19.158075] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-17T19:52:19.958041] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-17T19:52:20.613472] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-17T19:52:20.758042] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-17T19:52:20.910744] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T19:52:20.972812] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T19:52:21.558050] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-17T19:52:22.358041] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-17T19:52:22.918764] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T19:52:23.158043] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-17T19:52:23.201561] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-17T19:52:23.209096] [INFO ] [REMOTE ] KVUE: Full fetch complete (77842 records). [2025-10-17T19:52:23.209254] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-17T19:52:23.612213] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-17T19:52:23.612354] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-17T19:52:23.613418] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-17T19:52:23.613482] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-17T19:52:23.615010] [DEBUG] [LOCAL ] KVUE: Trimmed 77842 records to 54447 (keeping 200 days of data) [2025-10-17T19:52:23.959383] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-17T19:52:23.991933] [DEBUG] [LOCAL ] KVUE: Primary data saved (54447 records). [2025-10-17T19:52:23.992185] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-17T19:52:23.992919] [INFO ] [MAIN ] Update Progress: 1227/2368 symbols completed. KVUE took 42.1s. Estimated remaining: 2h 40m 15s. Rate: 7.1 symbols/min [2025-10-17T19:52:24.180194] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:52:24.214250] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-17T19:52:24.252721] [DEBUG] [LOCAL ] KYN: Loaded 30494 existing records from primary storage. [2025-10-17T19:52:24.253051] [INFO ] [MAIN ] KYN: Loaded 30494 existing records. [2025-10-17T19:52:24.453806] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:52:24.454008] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-17T19:52:24.454054] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-17T19:52:24.454693] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-17T19:52:24.454750] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-17T19:52:24.635688] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T19:52:24.722781] [INFO ] [REMOTE ] KW: Full fetch complete (57334 records). [2025-10-17T19:52:24.733681] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-17T19:52:24.772673] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-17T19:52:24.907432] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:52:25.227204] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T19:52:25.250690] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-17T19:52:25.251029] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-17T19:52:25.251943] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-17T19:52:25.252004] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-17T19:52:25.253059] [DEBUG] [LOCAL ] KW: Trimmed 57334 records to 41091 (keeping 200 days of data) [2025-10-17T19:52:25.490986] [DEBUG] [LOCAL ] KW: Primary data saved (41091 records). [2025-10-17T19:52:25.491106] [INFO ] [MAIN ] KW: Full history saved. [2025-10-17T19:52:25.491183] [INFO ] [MAIN ] Update Progress: 1228/2368 symbols completed. KW took 31.6s. Estimated remaining: 2h 40m 0s. Rate: 7.1 symbols/min [2025-10-17T19:52:25.566972] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-17T19:52:25.666699] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:52:25.704370] [DEBUG] [LOCAL ] L: Loaded 41525 existing records from primary storage. [2025-10-17T19:52:25.704674] [INFO ] [MAIN ] L: Loaded 41525 existing records. [2025-10-17T19:52:25.882039] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:52:25.882232] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-17T19:52:25.882279] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-17T19:52:25.882813] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-17T19:52:25.882871] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-17T19:52:26.240250] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:52:26.358054] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-17T19:52:26.785601] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-17T19:52:26.792834] [INFO ] [REMOTE ] KVYO: Full fetch complete (72101 records). [2025-10-17T19:52:26.792960] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-17T19:52:27.072102] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T19:52:27.164927] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-17T19:52:27.211716] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-17T19:52:27.211872] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-17T19:52:27.212928] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-17T19:52:27.212992] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-17T19:52:27.214356] [DEBUG] [LOCAL ] KVYO: Trimmed 72101 records to 51549 (keeping 200 days of data) [2025-10-17T19:52:27.435264] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T19:52:27.529337] [DEBUG] [LOCAL ] KVYO: Primary data saved (51549 records). [2025-10-17T19:52:27.529486] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-17T19:52:27.530028] [INFO ] [MAIN ] Update Progress: 1229/2368 symbols completed. KVYO took 40.6s. Estimated remaining: 2h 39m 46s. Rate: 7.1 symbols/min [2025-10-17T19:52:27.696502] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:52:27.746250] [DEBUG] [LOCAL ] LAC: Loaded 52900 existing records from primary storage. [2025-10-17T19:52:27.746625] [INFO ] [MAIN ] LAC: Loaded 52900 existing records. [2025-10-17T19:52:27.922896] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:52:27.923147] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-17T19:52:27.923194] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-17T19:52:27.923465] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-17T19:52:27.923502] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-17T19:52:27.966027] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-17T19:52:28.283427] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:52:28.731740] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T19:52:28.758007] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-17T19:52:28.997303] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T19:52:29.558043] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-17T19:52:29.893810] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T19:52:30.358085] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-17T19:52:31.157996] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-17T19:52:31.221787] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T19:52:31.589937] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-17T19:52:31.958012] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-17T19:52:32.758046] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-17T19:52:33.215611] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-17T19:52:33.254370] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-17T19:52:33.558019] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-17T19:52:33.799865] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T19:52:34.358045] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-17T19:52:35.158000] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-17T19:52:35.315994] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T19:52:35.479817] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-17T19:52:35.958024] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-17T19:52:36.397360] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T19:52:36.758037] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-17T19:52:37.371446] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T19:52:37.558029] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-17T19:52:38.190410] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T19:52:38.358000] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-17T19:52:38.751814] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T19:52:39.158011] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-17T19:52:39.183598] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-17T19:52:39.958084] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-17T19:52:40.708566] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T19:52:40.757999] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-17T19:52:41.374072] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T19:52:41.558028] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-17T19:52:42.298142] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T19:52:42.357994] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-17T19:52:43.158040] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-17T19:52:43.226170] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T19:52:43.228230] [INFO ] [REMOTE ] KWR: Full fetch complete (23366 records). [2025-10-17T19:52:43.228300] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-17T19:52:43.628985] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-17T19:52:43.649677] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-17T19:52:43.650030] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-17T19:52:43.650882] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-17T19:52:43.650950] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-17T19:52:43.651613] [DEBUG] [LOCAL ] KWR: Trimmed 23366 records to 16242 (keeping 200 days of data) [2025-10-17T19:52:43.752846] [DEBUG] [LOCAL ] KWR: Primary data saved (16242 records). [2025-10-17T19:52:43.752960] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-17T19:52:43.753042] [INFO ] [MAIN ] Update Progress: 1230/2368 symbols completed. KWR took 33.7s. Estimated remaining: 2h 39m 45s. Rate: 7.1 symbols/min [2025-10-17T19:52:43.931125] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:52:43.957100] [DEBUG] [LOCAL ] LAD: Loaded 23491 existing records from primary storage. [2025-10-17T19:52:43.957621] [INFO ] [MAIN ] LAD: Loaded 23491 existing records. [2025-10-17T19:52:43.969396] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-17T19:52:44.199960] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:52:44.200229] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-17T19:52:44.200305] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-17T19:52:44.200618] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-17T19:52:44.200720] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-17T19:52:44.705900] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:52:44.747243] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T19:52:44.758064] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-17T19:52:45.299947] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-17T19:52:45.558025] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-17T19:52:46.358130] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-17T19:52:46.698259] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T19:52:46.755682] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-17T19:52:47.125539] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T19:52:47.158040] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-17T19:52:47.958068] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-17T19:52:48.464254] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-17T19:52:48.758044] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-17T19:52:49.193803] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T19:52:49.200400] [INFO ] [REMOTE ] KYN: Full fetch complete (44569 records). [2025-10-17T19:52:49.200542] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-17T19:52:49.563176] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-17T19:52:49.606027] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-17T19:52:49.606115] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-17T19:52:49.606947] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-17T19:52:49.607012] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-17T19:52:49.608133] [DEBUG] [LOCAL ] KYN: Trimmed 44569 records to 30763 (keeping 200 days of data) [2025-10-17T19:52:49.798948] [DEBUG] [LOCAL ] KYN: Primary data saved (30763 records). [2025-10-17T19:52:49.799092] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-17T19:52:49.799626] [INFO ] [MAIN ] Update Progress: 1231/2368 symbols completed. KYN took 25.8s. Estimated remaining: 2h 39m 34s. Rate: 7.1 symbols/min [2025-10-17T19:52:49.966252] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:52:50.003105] [DEBUG] [LOCAL ] LADR: Loaded 39688 existing records from primary storage. [2025-10-17T19:52:50.003425] [INFO ] [MAIN ] LADR: Loaded 39688 existing records. [2025-10-17T19:52:50.179946] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:52:50.180610] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-17T19:52:50.180765] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-17T19:52:50.181581] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-17T19:52:50.181670] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-17T19:52:50.361546] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-17T19:52:50.489436] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T19:52:50.582911] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:52:50.598689] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T19:52:51.158043] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-17T19:52:51.958080] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-17T19:52:52.496170] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-17T19:52:52.748701] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T19:52:52.758000] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-17T19:52:53.071766] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T19:52:53.558041] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-17T19:52:54.358079] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-17T19:52:54.761727] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T19:52:54.857103] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T19:52:55.158062] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-17T19:52:55.881500] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T19:52:55.958044] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-17T19:52:56.522154] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T19:52:56.758090] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-17T19:52:57.558100] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-17T19:52:57.714396] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T19:52:58.046508] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T19:52:58.358064] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-17T19:52:58.890961] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-17T19:52:59.158107] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-17T19:52:59.958060] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-17T19:53:00.104372] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T19:53:00.271169] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T19:53:00.758071] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-17T19:53:01.558045] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-17T19:53:01.844556] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T19:53:02.358094] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-17T19:53:02.703630] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T19:53:03.158052] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-17T19:53:03.678819] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T19:53:03.684691] [INFO ] [REMOTE ] L: Full fetch complete (59466 records). [2025-10-17T19:53:03.684844] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-17T19:53:03.961506] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-17T19:53:04.085794] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-17T19:53:04.085985] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-17T19:53:04.086957] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-17T19:53:04.087102] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-17T19:53:04.116090] [DEBUG] [LOCAL ] L: Trimmed 59466 records to 41844 (keeping 200 days of data) [2025-10-17T19:53:04.118191] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (3.36 seconds). [2025-10-17T19:53:04.377546] [DEBUG] [LOCAL ] L: Primary data saved (41844 records). [2025-10-17T19:53:04.377698] [INFO ] [MAIN ] L: Full history saved. [2025-10-17T19:53:04.377789] [INFO ] [MAIN ] Update Progress: 1232/2368 symbols completed. L took 38.9s. Estimated remaining: 2h 39m 32s. Rate: 7.1 symbols/min [2025-10-17T19:53:04.546091] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:04.573807] [DEBUG] [LOCAL ] LANV: Loaded 2789 existing records from primary storage. [2025-10-17T19:53:04.574723] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T19:53:04.583795] [INFO ] [MAIN ] LANV: Loaded 2789 existing records. [2025-10-17T19:53:04.756243] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:53:04.756453] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-17T19:53:04.756500] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-17T19:53:04.756675] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-17T19:53:04.756748] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-17T19:53:04.767567] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-17T19:53:05.121086] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:05.240730] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-17T19:53:05.558039] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-17T19:53:06.141201] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-17T19:53:06.358021] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-17T19:53:06.886202] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-17T19:53:06.935853] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-17T19:53:07.158101] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-17T19:53:07.958053] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-17T19:53:08.500876] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T19:53:08.758073] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-17T19:53:09.558032] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-17T19:53:09.823200] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-17T19:53:10.216366] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-17T19:53:10.358012] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-17T19:53:10.925148] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T19:53:11.158038] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-17T19:53:11.958028] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-17T19:53:12.415272] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-17T19:53:12.741380] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T19:53:12.757984] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-17T19:53:13.284281] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.93 seconds). [2025-10-17T19:53:13.292746] [INFO ] [REMOTE ] LAC: Full fetch complete (76135 records). [2025-10-17T19:53:13.292929] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-17T19:53:13.563733] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-17T19:53:13.718995] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-17T19:53:13.719139] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-17T19:53:13.720612] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-17T19:53:13.720719] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-17T19:53:13.722824] [DEBUG] [LOCAL ] LAC: Trimmed 76135 records to 53290 (keeping 200 days of data) [2025-10-17T19:53:13.859161] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T19:53:14.091151] [DEBUG] [LOCAL ] LAC: Primary data saved (53290 records). [2025-10-17T19:53:14.091359] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-17T19:53:14.092055] [INFO ] [MAIN ] Update Progress: 1233/2368 symbols completed. LAC took 46.6s. Estimated remaining: 2h 39m 24s. Rate: 7.1 symbols/min [2025-10-17T19:53:14.270459] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:14.271018] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-17T19:53:14.271076] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-17T19:53:14.271297] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-17T19:53:14.271517] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-17T19:53:14.271590] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-17T19:53:14.271637] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-17T19:53:14.365330] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-17T19:53:14.645976] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:14.685270] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T19:53:14.877855] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-17T19:53:15.158022] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-17T19:53:15.354162] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:53:15.354442] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-17T19:53:15.354530] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:53:15.354577] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-17T19:53:15.354625] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:53:15.354734] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-17T19:53:15.354819] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-17T19:53:15.354868] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-17T19:53:15.354970] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-17T19:53:15.355039] [INFO ] [MAIN ] Update Progress: 1234/2368 symbols completed. LAR took 1.3s. Estimated remaining: 2h 39m 9s. Rate: 7.1 symbols/min [2025-10-17T19:53:15.520876] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:15.535670] [DEBUG] [LOCAL ] LAW: Loaded 14781 existing records from primary storage. [2025-10-17T19:53:15.535911] [INFO ] [MAIN ] LAW: Loaded 14781 existing records. [2025-10-17T19:53:15.709708] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:53:15.709918] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-17T19:53:15.709965] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-17T19:53:15.710560] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-17T19:53:15.710618] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-17T19:53:15.963203] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-17T19:53:16.058138] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:16.758035] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-17T19:53:17.217775] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T19:53:17.221582] [INFO ] [REMOTE ] LAD: Full fetch complete (35388 records). [2025-10-17T19:53:17.221757] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-17T19:53:17.436343] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-17T19:53:17.563119] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-17T19:53:17.627549] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-17T19:53:17.627628] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-17T19:53:17.628359] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-17T19:53:17.628410] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-17T19:53:17.629237] [DEBUG] [LOCAL ] LAD: Trimmed 35388 records to 23663 (keeping 200 days of data) [2025-10-17T19:53:17.775207] [DEBUG] [LOCAL ] LAD: Primary data saved (23663 records). [2025-10-17T19:53:17.775337] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-17T19:53:17.775417] [INFO ] [MAIN ] Update Progress: 1235/2368 symbols completed. LAD took 34.0s. Estimated remaining: 2h 38m 55s. Rate: 7.1 symbols/min [2025-10-17T19:53:17.942442] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:17.981588] [DEBUG] [LOCAL ] LAZ: Loaded 44986 existing records from primary storage. [2025-10-17T19:53:17.981910] [INFO ] [MAIN ] LAZ: Loaded 44986 existing records. [2025-10-17T19:53:18.153182] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:53:18.153433] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-17T19:53:18.153481] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-17T19:53:18.154292] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-17T19:53:18.154350] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-17T19:53:18.363186] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-17T19:53:18.513541] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:18.674320] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T19:53:19.158009] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-17T19:53:19.294703] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T19:53:19.958002] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-17T19:53:20.468223] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T19:53:20.474066] [INFO ] [REMOTE ] LADR: Full fetch complete (55676 records). [2025-10-17T19:53:20.474192] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-17T19:53:20.767063] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-17T19:53:20.869567] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T19:53:20.891782] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-17T19:53:20.891870] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-17T19:53:20.892793] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-17T19:53:20.892864] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-17T19:53:20.893977] [DEBUG] [LOCAL ] LADR: Trimmed 55676 records to 39947 (keeping 200 days of data) [2025-10-17T19:53:21.131491] [DEBUG] [LOCAL ] LADR: Primary data saved (39947 records). [2025-10-17T19:53:21.131638] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-17T19:53:21.132265] [INFO ] [MAIN ] Update Progress: 1236/2368 symbols completed. LADR took 31.3s. Estimated remaining: 2h 38m 42s. Rate: 7.1 symbols/min [2025-10-17T19:53:21.285097] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-17T19:53:21.306036] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:21.344460] [DEBUG] [LOCAL ] LB: Loaded 37609 existing records from primary storage. [2025-10-17T19:53:21.344807] [INFO ] [MAIN ] LB: Loaded 37609 existing records. [2025-10-17T19:53:21.523068] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:53:21.523292] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-17T19:53:21.523349] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-17T19:53:21.523979] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-17T19:53:21.524061] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-17T19:53:21.563219] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-17T19:53:21.875975] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:22.358056] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-17T19:53:22.411996] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T19:53:22.690150] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-17T19:53:23.158034] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-17T19:53:23.582490] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T19:53:23.958090] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-17T19:53:24.455001] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-17T19:53:24.758094] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-17T19:53:25.307461] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-17T19:53:25.558035] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-17T19:53:26.358009] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-17T19:53:26.927414] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T19:53:27.025738] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T19:53:27.158036] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-17T19:53:27.958087] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-17T19:53:28.745597] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T19:53:28.757984] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-17T19:53:29.469372] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T19:53:29.558017] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-17T19:53:29.746601] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-17T19:53:30.102743] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-17T19:53:30.103922] [INFO ] [REMOTE ] LANV: Full fetch complete (4253 records). [2025-10-17T19:53:30.104025] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-17T19:53:30.363281] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-17T19:53:30.479150] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-17T19:53:30.479242] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-17T19:53:30.479476] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-17T19:53:30.479542] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-17T19:53:30.479939] [DEBUG] [LOCAL ] LANV: Trimmed 4253 records to 2807 (keeping 200 days of data) [2025-10-17T19:53:30.496315] [DEBUG] [LOCAL ] LANV: Primary data saved (2807 records). [2025-10-17T19:53:30.496384] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-17T19:53:30.496500] [INFO ] [MAIN ] Update Progress: 1237/2368 symbols completed. LANV took 26.1s. Estimated remaining: 2h 38m 35s. Rate: 7.1 symbols/min [2025-10-17T19:53:31.158060] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-17T19:53:31.215740] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T19:53:31.958026] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-17T19:53:32.717187] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T19:53:32.757994] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-17T19:53:33.532401] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T19:53:33.557992] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-17T19:53:34.190936] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T19:53:34.358048] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-17T19:53:35.166090] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-17T19:53:35.184101] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T19:53:35.947857] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T19:53:35.957976] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-17T19:53:36.110234] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-17T19:53:36.758093] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-17T19:53:37.504567] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T19:53:37.558051] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-17T19:53:38.340516] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T19:53:38.357985] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-17T19:53:39.072857] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T19:53:39.158058] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-17T19:53:39.763010] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T19:53:39.794051] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T19:53:39.958057] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-17T19:53:40.758096] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-17T19:53:41.558551] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-17T19:53:41.558472] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T19:53:41.656819] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-17T19:53:42.358031] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-17T19:53:43.026615] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T19:53:43.158101] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-17T19:53:43.309083] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T19:53:43.958085] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-17T19:53:44.758052] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-17T19:53:44.795406] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T19:53:44.949773] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T19:53:45.558071] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-17T19:53:46.132790] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T19:53:46.358077] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-17T19:53:46.986186] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T19:53:47.158023] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-17T19:53:47.845364] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T19:53:47.958074] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-17T19:53:48.057675] [DEBUG] [REMOTE ] LB: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-17T19:53:48.057894] [WARN ] [REMOTE ] LB: No data returned for month 2025-09 [2025-10-17T19:53:48.057999] [FATAL] [REMOTE ] LB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:53:48.058110] [FATAL] [MAIN ] LB: Failed to fetch primary data. [2025-10-17T19:53:48.058217] [WARN ] [MAIN ] LB: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:53:48.058330] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-17T19:53:48.058409] [DEBUG] [LOCAL ] LB: No primary data file found to delete. [2025-10-17T19:53:48.058468] [INFO ] [LOCAL ] LB: Starting deletion of derivative data. [2025-10-17T19:53:48.058620] [DEBUG] [LOCAL ] LB: Deleted derivative data file. [2025-10-17T19:53:48.058770] [INFO ] [MAIN ] Update Progress: 1238/2368 symbols completed. LB took 26.9s. Estimated remaining: 2h 38m 35s. Rate: 7.1 symbols/min [2025-10-17T19:53:48.150895] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T19:53:48.153701] [INFO ] [REMOTE ] LAW: Full fetch complete (20903 records). [2025-10-17T19:53:48.153771] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-17T19:53:48.510778] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-17T19:53:48.510878] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-17T19:53:48.511316] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-17T19:53:48.511379] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-17T19:53:48.511965] [DEBUG] [LOCAL ] LAW: Trimmed 20903 records to 14898 (keeping 200 days of data) [2025-10-17T19:53:48.590853] [DEBUG] [LOCAL ] LAW: Primary data saved (14898 records). [2025-10-17T19:53:48.590981] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-17T19:53:48.591059] [INFO ] [MAIN ] Update Progress: 1239/2368 symbols completed. LAW took 33.2s. Estimated remaining: 2h 38m 19s. Rate: 7.1 symbols/min [2025-10-17T19:53:48.758053] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-17T19:53:50.207080] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T19:53:50.213017] [INFO ] [REMOTE ] LAZ: Full fetch complete (65551 records). [2025-10-17T19:53:50.213156] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-17T19:53:50.599567] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-17T19:53:50.599665] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-17T19:53:50.600575] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-17T19:53:50.600618] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-17T19:53:50.601845] [DEBUG] [LOCAL ] LAZ: Trimmed 65551 records to 45283 (keeping 200 days of data) [2025-10-17T19:53:50.886317] [DEBUG] [LOCAL ] LAZ: Primary data saved (45283 records). [2025-10-17T19:53:50.886504] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-17T19:53:50.886735] [INFO ] [MAIN ] Update Progress: 1240/2368 symbols completed. LAZ took 33.1s. Estimated remaining: 2h 38m 5s. Rate: 7.1 symbols/min [2025-10-17T19:53:51.549181] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:51.575713] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:51.550383] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:51.629050] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:53:51.672294] [DEBUG] [LOCAL ] LCII: Loaded 27611 existing records from primary storage. [2025-10-17T19:53:51.672607] [INFO ] [MAIN ] LCII: Loaded 27611 existing records. [2025-10-17T19:53:51.781852] [DEBUG] [LOCAL ] LDI: Loaded 45194 existing records from primary storage. [2025-10-17T19:53:51.800718] [INFO ] [MAIN ] LDI: Loaded 45194 existing records. [2025-10-17T19:53:52.044247] [DEBUG] [LOCAL ] LBRT: Loaded 53348 existing records from primary storage. [2025-10-17T19:53:52.043254] [DEBUG] [LOCAL ] LC: Loaded 48551 existing records from primary storage. [2025-10-17T19:53:52.059155] [INFO ] [MAIN ] LBRT: Loaded 53348 existing records. [2025-10-17T19:53:52.114260] [INFO ] [MAIN ] LC: Loaded 48551 existing records. [2025-10-17T19:53:52.157329] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:53:52.273785] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-17T19:53:52.372954] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-17T19:53:52.396480] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:53:52.421949] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-17T19:53:52.422130] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-17T19:53:52.428157] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-17T19:53:52.443843] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-17T19:53:52.529780] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-17T19:53:52.539537] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-17T19:53:52.642832] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:53:52.654210] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:53:52.716882] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-17T19:53:52.727592] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-17T19:53:52.717058] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-17T19:53:52.741842] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-17T19:53:52.753228] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-17T19:53:52.799188] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-17T19:53:52.799070] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-17T19:53:52.820165] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-17T19:53:53.735717] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:53.809999] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-17T19:53:54.031257] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:54.063523] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-17T19:53:54.101495] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:54.124462] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-17T19:53:54.171998] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:53:54.172345] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-17T19:53:55.026765] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T19:53:55.031326] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-17T19:53:55.698962] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T19:53:55.707239] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-17T19:53:55.766828] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-17T19:53:55.771682] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-17T19:53:55.843987] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T19:53:55.854101] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-17T19:53:55.893511] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T19:53:55.958051] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-17T19:53:56.939342] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T19:53:56.947124] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-17T19:53:56.988777] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T19:53:57.242318] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T19:53:57.552014] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T19:53:57.562052] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-17T19:53:57.895727] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T19:53:58.358044] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-17T19:53:58.868472] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T19:53:59.158049] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-17T19:53:59.899398] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T19:53:59.958056] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-17T19:54:00.758044] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-17T19:54:01.414132] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-17T19:54:01.558050] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-17T19:54:01.940797] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-17T19:54:02.358070] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-17T19:54:02.750168] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-17T19:54:03.158029] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-17T19:54:03.550541] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T19:54:03.643906] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T19:54:03.958059] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-17T19:54:04.766666] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-17T19:54:04.787455] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T19:54:05.558027] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-17T19:54:05.597145] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T19:54:06.358013] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-17T19:54:06.620368] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T19:54:07.157999] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-17T19:54:07.310960] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T19:54:07.489543] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T19:54:07.958029] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-17T19:54:08.575342] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T19:54:08.758004] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-17T19:54:09.543173] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T19:54:09.557979] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-17T19:54:10.055009] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-17T19:54:10.358026] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-17T19:54:10.948971] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T19:54:11.158052] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-17T19:54:11.844087] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T19:54:11.958043] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-17T19:54:12.758055] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-17T19:54:12.805016] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T19:54:13.557998] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-17T19:54:13.785531] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T19:54:14.358014] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-17T19:54:14.595855] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T19:54:14.757068] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-17T19:54:15.158071] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-17T19:54:15.958015] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-17T19:54:16.208520] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T19:54:16.758094] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-17T19:54:16.909043] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T19:54:17.558047] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-17T19:54:18.142318] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-17T19:54:18.217696] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T19:54:18.357993] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-17T19:54:19.158095] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-17T19:54:19.481054] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-17T19:54:19.703991] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-17T19:54:19.711813] [INFO ] [REMOTE ] LC: Full fetch complete (70694 records). [2025-10-17T19:54:19.711978] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-17T19:54:19.969018] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-17T19:54:20.107815] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-17T19:54:20.107901] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-17T19:54:20.108961] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-17T19:54:20.109029] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-17T19:54:20.110365] [DEBUG] [LOCAL ] LC: Trimmed 70694 records to 48927 (keeping 200 days of data) [2025-10-17T19:54:20.409596] [DEBUG] [LOCAL ] LC: Primary data saved (48927 records). [2025-10-17T19:54:20.410534] [INFO ] [MAIN ] LC: Full history saved. [2025-10-17T19:54:20.412476] [INFO ] [MAIN ] Update Progress: 1241/2368 symbols completed. LC took 29.5s. Estimated remaining: 2h 38m 16s. Rate: 7.1 symbols/min [2025-10-17T19:54:20.411813] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T19:54:20.585601] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:54:20.629554] [DEBUG] [LOCAL ] LDOS: Loaded 45271 existing records from primary storage. [2025-10-17T19:54:20.629866] [INFO ] [MAIN ] LDOS: Loaded 45271 existing records. [2025-10-17T19:54:20.764931] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-17T19:54:20.806117] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:54:20.806372] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-17T19:54:20.806438] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-17T19:54:20.806615] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-17T19:54:20.806698] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-17T19:54:21.161271] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:54:21.558041] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-17T19:54:21.936682] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T19:54:22.086794] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-17T19:54:22.094180] [INFO ] [REMOTE ] LDI: Full fetch complete (61881 records). [2025-10-17T19:54:22.094316] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-17T19:54:22.363125] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-17T19:54:22.477370] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-17T19:54:22.477502] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-17T19:54:22.478707] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-17T19:54:22.478790] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-17T19:54:22.480424] [DEBUG] [LOCAL ] LDI: Trimmed 61881 records to 45582 (keeping 200 days of data) [2025-10-17T19:54:22.728019] [DEBUG] [LOCAL ] LDI: Primary data saved (45582 records). [2025-10-17T19:54:22.728197] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-17T19:54:22.728307] [INFO ] [MAIN ] Update Progress: 1242/2368 symbols completed. LDI took 31.8s. Estimated remaining: 2h 38m 2s. Rate: 7.1 symbols/min [2025-10-17T19:54:22.895313] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:54:22.909385] [DEBUG] [LOCAL ] LDP: Loaded 12892 existing records from primary storage. [2025-10-17T19:54:22.909690] [INFO ] [MAIN ] LDP: Loaded 12892 existing records. [2025-10-17T19:54:23.083416] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:54:23.083690] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-17T19:54:23.083824] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-17T19:54:23.084034] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-17T19:54:23.084090] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-17T19:54:23.161944] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-17T19:54:23.444565] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:54:23.473742] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T19:54:23.519818] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T19:54:23.523053] [INFO ] [REMOTE ] LCII: Full fetch complete (39126 records). [2025-10-17T19:54:23.523130] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-17T19:54:23.884745] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-17T19:54:23.884829] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-17T19:54:23.885553] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-17T19:54:23.885594] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-17T19:54:23.886451] [DEBUG] [LOCAL ] LCII: Trimmed 39126 records to 27730 (keeping 200 days of data) [2025-10-17T19:54:23.974731] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-17T19:54:24.058693] [DEBUG] [LOCAL ] LCII: Primary data saved (27730 records). [2025-10-17T19:54:24.058841] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-17T19:54:24.058926] [INFO ] [MAIN ] Update Progress: 1243/2368 symbols completed. LCII took 33.2s. Estimated remaining: 2h 37m 47s. Rate: 7.1 symbols/min [2025-10-17T19:54:24.221182] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:54:24.259710] [DEBUG] [LOCAL ] LEA: Loaded 41612 existing records from primary storage. [2025-10-17T19:54:24.260005] [INFO ] [MAIN ] LEA: Loaded 41612 existing records. [2025-10-17T19:54:24.434132] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:54:24.434380] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-17T19:54:24.434433] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-17T19:54:24.434724] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-17T19:54:24.434782] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-17T19:54:24.765525] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-17T19:54:24.796910] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:54:24.895807] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T19:54:24.915929] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-17T19:54:25.558021] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-17T19:54:26.185674] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T19:54:26.358074] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-17T19:54:27.158546] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T19:54:27.158620] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-17T19:54:27.697455] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T19:54:27.958060] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-17T19:54:28.056746] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T19:54:28.758036] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-17T19:54:29.558060] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-17T19:54:29.667228] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T19:54:30.306628] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T19:54:30.358080] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-17T19:54:30.501090] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T19:54:31.158050] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-17T19:54:31.917392] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T19:54:31.957986] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-17T19:54:32.012940] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T19:54:32.758015] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-17T19:54:33.446568] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T19:54:33.557994] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-17T19:54:34.358005] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-17T19:54:34.478362] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T19:54:35.016634] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T19:54:35.025606] [INFO ] [REMOTE ] LBRT: Full fetch complete (76908 records). [2025-10-17T19:54:35.025893] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-17T19:54:35.170732] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-17T19:54:35.436531] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-17T19:54:35.436637] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-17T19:54:35.438180] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-17T19:54:35.438272] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-17T19:54:35.440044] [DEBUG] [LOCAL ] LBRT: Trimmed 76908 records to 53738 (keeping 200 days of data) [2025-10-17T19:54:35.782033] [DEBUG] [LOCAL ] LBRT: Primary data saved (53738 records). [2025-10-17T19:54:35.782185] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-17T19:54:35.782292] [INFO ] [MAIN ] Update Progress: 1244/2368 symbols completed. LBRT took 44.9s. Estimated remaining: 2h 37m 42s. Rate: 7.1 symbols/min [2025-10-17T19:54:35.955680] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:54:35.958011] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-17T19:54:35.986106] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T19:54:36.037017] [DEBUG] [LOCAL ] LEG: Loaded 50533 existing records from primary storage. [2025-10-17T19:54:36.037334] [INFO ] [MAIN ] LEG: Loaded 50533 existing records. [2025-10-17T19:54:36.215873] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:54:36.216076] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-17T19:54:36.216125] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-17T19:54:36.216367] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-17T19:54:36.216427] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-17T19:54:36.566728] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:54:36.758006] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-17T19:54:36.914100] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-17T19:54:37.012867] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T19:54:37.558036] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-17T19:54:38.288887] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T19:54:38.358017] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-17T19:54:39.165576] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-17T19:54:39.188836] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T19:54:39.958320] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-17T19:54:39.961777] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T19:54:40.758039] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-17T19:54:40.855331] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T19:54:40.931448] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T19:54:41.558049] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-17T19:54:42.192046] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T19:54:42.358162] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-17T19:54:43.075557] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T19:54:43.157995] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-17T19:54:43.207058] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T19:54:43.958049] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-17T19:54:44.758035] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-17T19:54:44.819440] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T19:54:45.520138] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T19:54:45.558006] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-17T19:54:45.679732] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-17T19:54:46.358100] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-17T19:54:46.922977] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T19:54:47.158071] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-17T19:54:47.957998] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-17T19:54:48.071282] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T19:54:48.735160] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T19:54:48.757986] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-17T19:54:48.832734] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T19:54:48.864395] [DEBUG] [REMOTE ] LEA: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-17T19:54:48.864770] [WARN ] [REMOTE ] LEA: No data returned for month 2025-09 [2025-10-17T19:54:48.864861] [FATAL] [REMOTE ] LEA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:54:48.864962] [FATAL] [MAIN ] LEA: Failed to fetch primary data. [2025-10-17T19:54:48.865043] [WARN ] [MAIN ] LEA: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:54:48.865128] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-17T19:54:48.865210] [DEBUG] [LOCAL ] LEA: No primary data file found to delete. [2025-10-17T19:54:48.865263] [INFO ] [LOCAL ] LEA: Starting deletion of derivative data. [2025-10-17T19:54:48.865725] [DEBUG] [LOCAL ] LEA: Deleted derivative data file. [2025-10-17T19:54:48.866505] [INFO ] [MAIN ] Update Progress: 1245/2368 symbols completed. LEA took 24.8s. Estimated remaining: 2h 37m 38s. Rate: 7.1 symbols/min [2025-10-17T19:54:49.064372] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:54:49.123851] [DEBUG] [LOCAL ] LEN: Loaded 53584 existing records from primary storage. [2025-10-17T19:54:49.124247] [INFO ] [MAIN ] LEN: Loaded 53584 existing records. [2025-10-17T19:54:49.317070] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:54:49.317272] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-17T19:54:49.317318] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-17T19:54:49.317560] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-17T19:54:49.317605] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-17T19:54:49.563169] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-17T19:54:49.662975] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:54:50.358060] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-17T19:54:50.413620] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T19:54:51.158035] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-17T19:54:51.950560] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T19:54:51.959596] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-17T19:54:51.998326] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T19:54:52.000263] [INFO ] [REMOTE ] LDP: Full fetch complete (18901 records). [2025-10-17T19:54:52.000351] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-17T19:54:52.351711] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-17T19:54:52.351792] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-17T19:54:52.352151] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-17T19:54:52.352190] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-17T19:54:52.352753] [DEBUG] [LOCAL ] LDP: Trimmed 18901 records to 12949 (keeping 200 days of data) [2025-10-17T19:54:52.432735] [DEBUG] [LOCAL ] LDP: Primary data saved (12949 records). [2025-10-17T19:54:52.432860] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-17T19:54:52.432938] [INFO ] [MAIN ] Update Progress: 1246/2368 symbols completed. LDP took 29.7s. Estimated remaining: 2h 37m 25s. Rate: 7.1 symbols/min [2025-10-17T19:54:52.596869] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:54:52.614364] [DEBUG] [LOCAL ] LEO: Loaded 16748 existing records from primary storage. [2025-10-17T19:54:52.614579] [INFO ] [MAIN ] LEO: Loaded 16748 existing records. [2025-10-17T19:54:52.762269] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-17T19:54:52.791264] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:54:52.792228] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-17T19:54:52.792303] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-17T19:54:52.792514] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-17T19:54:52.792579] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-17T19:54:53.137871] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:54:53.558048] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-17T19:54:53.801741] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T19:54:54.198129] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-17T19:54:54.357998] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-17T19:54:54.499678] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T19:54:55.158050] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-17T19:54:55.295627] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T19:54:55.958043] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-17T19:54:56.764742] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-17T19:54:56.767492] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T19:54:57.059939] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T19:54:57.558099] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-17T19:54:58.358053] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-17T19:54:58.505999] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T19:54:58.547463] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T19:54:59.158067] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-17T19:54:59.935291] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T19:54:59.958016] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-17T19:55:00.758042] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-17T19:55:01.558020] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-17T19:55:01.747048] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T19:55:02.194524] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (3.04 seconds). [2025-10-17T19:55:02.358075] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-17T19:55:03.158029] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-17T19:55:03.324075] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-17T19:55:03.654893] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-17T19:55:03.661291] [INFO ] [REMOTE ] LDOS: Full fetch complete (67022 records). [2025-10-17T19:55:03.661512] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-17T19:55:03.965734] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-17T19:55:04.090275] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-17T19:55:04.090420] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-17T19:55:04.091602] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-17T19:55:04.091878] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-17T19:55:04.093589] [DEBUG] [LOCAL ] LDOS: Trimmed 67022 records to 45546 (keeping 200 days of data) [2025-10-17T19:55:04.321237] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T19:55:04.405190] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-17T19:55:04.456781] [DEBUG] [LOCAL ] LDOS: Primary data saved (45546 records). [2025-10-17T19:55:04.456912] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-17T19:55:04.457558] [INFO ] [MAIN ] Update Progress: 1247/2368 symbols completed. LDOS took 44.0s. Estimated remaining: 2h 37m 20s. Rate: 7.1 symbols/min [2025-10-17T19:55:04.648776] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:55:04.698450] [DEBUG] [LOCAL ] LEVI: Loaded 52170 existing records from primary storage. [2025-10-17T19:55:04.698791] [INFO ] [MAIN ] LEVI: Loaded 52170 existing records. [2025-10-17T19:55:04.763201] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-17T19:55:04.879753] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:55:04.880039] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-17T19:55:04.880094] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-17T19:55:04.880365] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-17T19:55:04.880422] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-17T19:55:05.224194] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:55:05.558002] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-17T19:55:05.607730] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T19:55:06.358014] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-17T19:55:06.834554] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-17T19:55:07.151238] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T19:55:07.158002] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-17T19:55:07.958003] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-17T19:55:08.049754] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T19:55:08.185515] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T19:55:08.758024] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-17T19:55:09.558074] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-17T19:55:09.588723] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T19:55:10.358089] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-17T19:55:10.535924] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T19:55:10.542951] [INFO ] [REMOTE ] LEG: Full fetch complete (72979 records). [2025-10-17T19:55:10.543122] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-17T19:55:10.658101] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T19:55:10.949748] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-17T19:55:10.949843] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-17T19:55:10.950857] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-17T19:55:10.950964] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-17T19:55:10.952435] [DEBUG] [LOCAL ] LEG: Trimmed 72979 records to 50873 (keeping 200 days of data) [2025-10-17T19:55:11.161933] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-17T19:55:11.263919] [DEBUG] [LOCAL ] LEG: Primary data saved (50873 records). [2025-10-17T19:55:11.264068] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-17T19:55:11.264156] [INFO ] [MAIN ] Update Progress: 1248/2368 symbols completed. LEG took 35.5s. Estimated remaining: 2h 37m 10s. Rate: 7.1 symbols/min [2025-10-17T19:55:11.435017] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:55:11.453497] [DEBUG] [LOCAL ] LFT: Loaded 18440 existing records from primary storage. [2025-10-17T19:55:11.453759] [INFO ] [MAIN ] LFT: Loaded 18440 existing records. [2025-10-17T19:55:11.633263] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:55:11.633504] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-17T19:55:11.633553] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-17T19:55:11.633764] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-17T19:55:11.633822] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-17T19:55:11.963120] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-17T19:55:12.021518] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:55:12.057713] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T19:55:12.059215] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T19:55:12.758089] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-17T19:55:13.558044] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-17T19:55:13.687096] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T19:55:13.943913] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-17T19:55:14.358091] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-17T19:55:15.158003] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-17T19:55:15.234682] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T19:55:15.295038] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T19:55:15.297306] [INFO ] [REMOTE ] LEO: Full fetch complete (26460 records). [2025-10-17T19:55:15.297413] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-17T19:55:15.655332] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-17T19:55:15.655410] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-17T19:55:15.655972] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-17T19:55:15.656034] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-17T19:55:15.656915] [DEBUG] [LOCAL ] LEO: Trimmed 26460 records to 16814 (keeping 200 days of data) [2025-10-17T19:55:15.753009] [DEBUG] [LOCAL ] LEO: Primary data saved (16814 records). [2025-10-17T19:55:15.753151] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-17T19:55:15.753234] [INFO ] [MAIN ] Update Progress: 1249/2368 symbols completed. LEO took 23.3s. Estimated remaining: 2h 36m 58s. Rate: 7.1 symbols/min [2025-10-17T19:55:15.917052] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:55:15.928628] [DEBUG] [LOCAL ] LGI: Loaded 10147 existing records from primary storage. [2025-10-17T19:55:15.928851] [INFO ] [MAIN ] LGI: Loaded 10147 existing records. [2025-10-17T19:55:15.963191] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-17T19:55:16.108164] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:55:16.108347] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-17T19:55:16.108393] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-17T19:55:16.108629] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-17T19:55:16.108716] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-17T19:55:16.454245] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:55:16.758010] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-17T19:55:17.085468] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T19:55:17.086394] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T19:55:17.558052] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-17T19:55:17.569820] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T19:55:18.358053] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-17T19:55:18.552224] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T19:55:19.158023] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-17T19:55:19.926788] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T19:55:19.957980] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-17T19:55:20.758012] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-17T19:55:20.891491] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T19:55:21.558015] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-17T19:55:21.614140] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T19:55:21.950377] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-17T19:55:22.358093] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-17T19:55:23.091388] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T19:55:23.157998] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-17T19:55:23.296504] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T19:55:23.958012] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-17T19:55:23.968288] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T19:55:24.758110] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-17T19:55:25.523599] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-17T19:55:25.557982] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-17T19:55:25.947722] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-17T19:55:26.357999] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-17T19:55:26.525607] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T19:55:27.158093] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-17T19:55:27.958052] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-17T19:55:28.241035] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-17T19:55:28.643617] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-17T19:55:28.758050] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-17T19:55:29.475632] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T19:55:29.558002] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-17T19:55:29.638573] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T19:55:30.358060] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-17T19:55:30.686551] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T19:55:31.158052] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-17T19:55:31.953525] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-17T19:55:31.957976] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-17T19:55:32.656469] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-17T19:55:32.663782] [INFO ] [REMOTE ] LEN: Full fetch complete (77214 records). [2025-10-17T19:55:32.663909] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-17T19:55:32.758886] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-17T19:55:32.767126] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T19:55:33.062929] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-17T19:55:33.063021] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-17T19:55:33.064076] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-17T19:55:33.064144] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-17T19:55:33.065634] [DEBUG] [LOCAL ] LEN: Trimmed 77214 records to 53973 (keeping 200 days of data) [2025-10-17T19:55:33.396348] [DEBUG] [LOCAL ] LEN: Primary data saved (53973 records). [2025-10-17T19:55:33.396475] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-17T19:55:33.397063] [INFO ] [MAIN ] Update Progress: 1250/2368 symbols completed. LEN took 44.5s. Estimated remaining: 2h 36m 58s. Rate: 7.1 symbols/min [2025-10-17T19:55:33.562778] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:55:33.562878] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-17T19:55:33.600690] [DEBUG] [LOCAL ] LH: Loaded 37792 existing records from primary storage. [2025-10-17T19:55:33.600973] [INFO ] [MAIN ] LH: Loaded 37792 existing records. [2025-10-17T19:55:33.774394] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:55:33.774618] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-17T19:55:33.774696] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-17T19:55:33.774903] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-17T19:55:33.774958] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-17T19:55:34.013188] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T19:55:34.151110] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:55:34.173030] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-17T19:55:34.358050] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-17T19:55:35.158052] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-17T19:55:35.832188] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T19:55:35.957999] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-17T19:55:36.250529] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T19:55:36.758080] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-17T19:55:37.390597] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T19:55:37.558009] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-17T19:55:37.659688] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T19:55:38.358046] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-17T19:55:38.559023] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-17T19:55:39.158047] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-17T19:55:39.843844] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T19:55:39.865082] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-17T19:55:39.958080] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-17T19:55:40.758057] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-17T19:55:41.559390] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-17T19:55:41.561900] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T19:55:41.666165] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-17T19:55:41.668260] [INFO ] [REMOTE ] LGI: Full fetch complete (14492 records). [2025-10-17T19:55:41.668363] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-17T19:55:42.033331] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-17T19:55:42.033420] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-17T19:55:42.033786] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-17T19:55:42.033848] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-17T19:55:42.034372] [DEBUG] [LOCAL ] LGI: Trimmed 14492 records to 10171 (keeping 200 days of data) [2025-10-17T19:55:42.102417] [DEBUG] [LOCAL ] LGI: Primary data saved (10171 records). [2025-10-17T19:55:42.102546] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-17T19:55:42.102739] [INFO ] [MAIN ] Update Progress: 1251/2368 symbols completed. LGI took 26.3s. Estimated remaining: 2h 36m 49s. Rate: 7.1 symbols/min [2025-10-17T19:55:42.270406] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:55:42.320716] [DEBUG] [LOCAL ] LHX: Loaded 48970 existing records from primary storage. [2025-10-17T19:55:42.321076] [INFO ] [MAIN ] LHX: Loaded 48970 existing records. [2025-10-17T19:55:42.363132] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-17T19:55:42.506998] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:55:42.507363] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-17T19:55:42.507530] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-17T19:55:42.516854] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-17T19:55:42.517766] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-17T19:55:42.517385] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-17T19:55:42.881131] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:55:43.158042] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-17T19:55:43.958018] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-17T19:55:44.050336] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T19:55:44.758051] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-17T19:55:44.871729] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T19:55:44.917623] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T19:55:44.920683] [INFO ] [REMOTE ] LFT: Full fetch complete (23964 records). [2025-10-17T19:55:44.920787] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-17T19:55:45.295109] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-17T19:55:45.295226] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-17T19:55:45.295777] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-17T19:55:45.295839] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-17T19:55:45.296566] [DEBUG] [LOCAL ] LFT: Trimmed 23964 records to 18518 (keeping 200 days of data) [2025-10-17T19:55:45.406962] [DEBUG] [LOCAL ] LFT: Primary data saved (18518 records). [2025-10-17T19:55:45.407097] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-17T19:55:45.407200] [INFO ] [MAIN ] Update Progress: 1252/2368 symbols completed. LFT took 34.1s. Estimated remaining: 2h 36m 36s. Rate: 7.1 symbols/min [2025-10-17T19:55:45.585733] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:55:45.583121] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-17T19:55:45.614729] [DEBUG] [LOCAL ] LII: Loaded 28004 existing records from primary storage. [2025-10-17T19:55:45.614985] [INFO ] [MAIN ] LII: Loaded 28004 existing records. [2025-10-17T19:55:45.786269] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:55:45.786497] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-17T19:55:45.786567] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-17T19:55:45.786801] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-17T19:55:45.786868] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-17T19:55:46.138510] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:55:46.358026] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-17T19:55:46.649429] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T19:55:47.158046] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-17T19:55:47.279800] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T19:55:47.958004] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-17T19:55:48.062366] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T19:55:48.758077] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-17T19:55:48.833970] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T19:55:49.146359] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T19:55:49.558027] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-17T19:55:50.358007] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-17T19:55:50.427545] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T19:55:50.847246] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T19:55:51.158003] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-17T19:55:51.553009] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T19:55:51.958048] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-17T19:55:52.760502] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-17T19:55:52.765630] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T19:55:53.532347] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T19:55:53.541806] [INFO ] [REMOTE ] LEVI: Full fetch complete (74934 records). [2025-10-17T19:55:53.542009] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-17T19:55:53.563170] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-17T19:55:53.961692] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-17T19:55:53.961788] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-17T19:55:53.962848] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-17T19:55:53.962914] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-17T19:55:53.964349] [DEBUG] [LOCAL ] LEVI: Trimmed 74934 records to 52559 (keeping 200 days of data) [2025-10-17T19:55:54.286387] [DEBUG] [LOCAL ] LEVI: Primary data saved (52559 records). [2025-10-17T19:55:54.286679] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-17T19:55:54.287541] [INFO ] [MAIN ] Update Progress: 1253/2368 symbols completed. LEVI took 49.8s. Estimated remaining: 2h 36m 28s. Rate: 7.1 symbols/min [2025-10-17T19:55:54.363252] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-17T19:55:54.465363] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:55:54.499412] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T19:55:54.547545] [DEBUG] [LOCAL ] LION: Loaded 46694 existing records from primary storage. [2025-10-17T19:55:54.547917] [INFO ] [MAIN ] LION: Loaded 46694 existing records. [2025-10-17T19:55:54.723165] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:55:54.723365] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-17T19:55:54.723414] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-17T19:55:54.723629] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-17T19:55:54.723719] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-17T19:55:55.086455] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:55:55.108699] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T19:55:55.158011] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-17T19:55:55.770707] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-17T19:55:55.958044] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-17T19:55:56.239094] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T19:55:56.758033] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-17T19:55:57.437393] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T19:55:57.558006] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-17T19:55:57.862310] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T19:55:58.358090] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-17T19:55:58.906075] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T19:55:59.158077] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-17T19:55:59.569603] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-17T19:55:59.958049] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-17T19:56:00.758045] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-17T19:56:01.558076] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-17T19:56:01.578491] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T19:56:01.586105] [INFO ] [REMOTE ] LH: Full fetch complete (54960 records). [2025-10-17T19:56:01.586277] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-17T19:56:01.792358] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-17T19:56:02.047544] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-17T19:56:02.047697] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-17T19:56:02.048752] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-17T19:56:02.048912] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-17T19:56:02.050201] [DEBUG] [LOCAL ] LH: Trimmed 54960 records to 38017 (keeping 200 days of data) [2025-10-17T19:56:02.289025] [DEBUG] [LOCAL ] LH: Primary data saved (38017 records). [2025-10-17T19:56:02.289224] [INFO ] [MAIN ] LH: Full history saved. [2025-10-17T19:56:02.289359] [INFO ] [MAIN ] Update Progress: 1254/2368 symbols completed. LH took 28.9s. Estimated remaining: 2h 36m 20s. Rate: 7.1 symbols/min [2025-10-17T19:56:02.363026] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-17T19:56:02.437592] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T19:56:02.488309] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:56:02.495067] [DEBUG] [LOCAL ] LITB: Loaded 4203 existing records from primary storage. [2025-10-17T19:56:02.495261] [INFO ] [MAIN ] LITB: Loaded 4203 existing records. [2025-10-17T19:56:02.676618] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:56:02.684287] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-17T19:56:02.689311] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-17T19:56:02.689515] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-17T19:56:02.689923] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-17T19:56:02.721736] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T19:56:03.054556] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:56:03.157985] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-17T19:56:03.577388] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-17T19:56:03.958050] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-17T19:56:04.314512] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T19:56:04.429112] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-17T19:56:04.758027] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-17T19:56:05.558021] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-17T19:56:05.974300] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-17T19:56:06.358053] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-17T19:56:07.158019] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-17T19:56:07.389957] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T19:56:07.449280] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T19:56:07.611940] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-17T19:56:07.958043] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-17T19:56:08.758042] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-17T19:56:09.564040] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-17T19:56:09.576864] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T19:56:09.717239] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-17T19:56:10.358036] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-17T19:56:11.158073] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-17T19:56:11.442814] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T19:56:11.497450] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T19:56:11.811355] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-17T19:56:11.958049] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-17T19:56:12.758078] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-17T19:56:13.478861] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T19:56:13.558051] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-17T19:56:13.716019] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T19:56:14.358051] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-17T19:56:14.898028] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T19:56:15.158061] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-17T19:56:15.640303] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-17T19:56:15.751393] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T19:56:15.958077] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-17T19:56:16.758083] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-17T19:56:17.558006] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-17T19:56:17.783959] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T19:56:18.000349] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T19:56:18.015292] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-17T19:56:18.358094] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-17T19:56:19.158100] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-17T19:56:19.958034] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-17T19:56:20.145188] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T19:56:20.151805] [INFO ] [REMOTE ] LHX: Full fetch complete (70797 records). [2025-10-17T19:56:20.151954] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-17T19:56:20.486440] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-17T19:56:20.539151] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-17T19:56:20.539321] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-17T19:56:20.540370] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-17T19:56:20.540438] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-17T19:56:20.541835] [DEBUG] [LOCAL ] LHX: Trimmed 70797 records to 49301 (keeping 200 days of data) [2025-10-17T19:56:20.758792] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-17T19:56:20.808623] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T19:56:20.907465] [DEBUG] [LOCAL ] LHX: Primary data saved (49301 records). [2025-10-17T19:56:20.907607] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-17T19:56:20.907740] [INFO ] [MAIN ] Update Progress: 1255/2368 symbols completed. LHX took 38.8s. Estimated remaining: 2h 36m 20s. Rate: 7.1 symbols/min [2025-10-17T19:56:21.073716] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:56:21.126449] [DEBUG] [LOCAL ] LLY: Loaded 53635 existing records from primary storage. [2025-10-17T19:56:21.126799] [INFO ] [MAIN ] LLY: Loaded 53635 existing records. [2025-10-17T19:56:21.220698] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-17T19:56:21.313090] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:56:21.313356] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-17T19:56:21.313433] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-17T19:56:21.313744] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-17T19:56:21.313803] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-17T19:56:21.563180] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-17T19:56:21.682747] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:56:22.358025] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-17T19:56:22.826140] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T19:56:23.158036] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-17T19:56:23.958027] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-17T19:56:24.465921] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T19:56:24.470194] [INFO ] [REMOTE ] LII: Full fetch complete (41498 records). [2025-10-17T19:56:24.470284] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-17T19:56:24.761576] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-17T19:56:24.879535] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-17T19:56:24.879701] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-17T19:56:24.880624] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-17T19:56:24.880779] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-17T19:56:24.882194] [DEBUG] [LOCAL ] LII: Trimmed 41498 records to 28209 (keeping 200 days of data) [2025-10-17T19:56:24.997897] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-17T19:56:25.111886] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-10-17T19:56:25.196691] [DEBUG] [LOCAL ] LII: Primary data saved (28209 records). [2025-10-17T19:56:25.196847] [INFO ] [MAIN ] LII: Full history saved. [2025-10-17T19:56:25.196934] [INFO ] [MAIN ] Update Progress: 1256/2368 symbols completed. LII took 39.8s. Estimated remaining: 2h 36m 8s. Rate: 7.1 symbols/min [2025-10-17T19:56:25.361160] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:56:25.409744] [DEBUG] [LOCAL ] LMND: Loaded 52452 existing records from primary storage. [2025-10-17T19:56:25.410058] [INFO ] [MAIN ] LMND: Loaded 52452 existing records. [2025-10-17T19:56:25.569712] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-17T19:56:25.589062] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:56:25.590042] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-17T19:56:25.590100] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-17T19:56:25.590300] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-17T19:56:25.590357] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-17T19:56:25.960386] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:56:26.185734] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T19:56:26.248692] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T19:56:26.250047] [INFO ] [REMOTE ] LITB: Full fetch complete (5731 records). [2025-10-17T19:56:26.250121] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-17T19:56:26.363150] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-17T19:56:26.639520] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-17T19:56:26.639617] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-17T19:56:26.639845] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-17T19:56:26.639895] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-17T19:56:26.640280] [DEBUG] [LOCAL ] LITB: Trimmed 5731 records to 4239 (keeping 200 days of data) [2025-10-17T19:56:26.665005] [DEBUG] [LOCAL ] LITB: Primary data saved (4239 records). [2025-10-17T19:56:26.665171] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-17T19:56:26.665274] [INFO ] [MAIN ] Update Progress: 1257/2368 symbols completed. LITB took 24.4s. Estimated remaining: 2h 35m 54s. Rate: 7.1 symbols/min [2025-10-17T19:56:26.836406] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:56:26.881407] [DEBUG] [LOCAL ] LMT: Loaded 49981 existing records from primary storage. [2025-10-17T19:56:26.881765] [INFO ] [MAIN ] LMT: Loaded 49981 existing records. [2025-10-17T19:56:27.060128] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:56:27.060400] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-17T19:56:27.060453] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-17T19:56:27.060749] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-17T19:56:27.060805] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-17T19:56:27.160543] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-17T19:56:27.415954] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:56:27.958056] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-17T19:56:28.393083] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T19:56:28.758136] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-17T19:56:29.309472] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:56:29.558031] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-17T19:56:29.609334] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-17T19:56:30.370259] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-17T19:56:30.379676] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T19:56:31.158138] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-17T19:56:31.244715] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T19:56:31.254432] [INFO ] [REMOTE ] LION: Full fetch complete (57532 records). [2025-10-17T19:56:31.254791] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-17T19:56:31.704056] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-17T19:56:31.704149] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-17T19:56:31.705082] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-17T19:56:31.705148] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-17T19:56:31.706503] [DEBUG] [LOCAL ] LION: Trimmed 57532 records to 47066 (keeping 200 days of data) [2025-10-17T19:56:31.959511] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-17T19:56:31.973460] [DEBUG] [LOCAL ] LION: Primary data saved (47066 records). [2025-10-17T19:56:31.973612] [INFO ] [MAIN ] LION: Full history saved. [2025-10-17T19:56:31.974148] [INFO ] [MAIN ] Update Progress: 1258/2368 symbols completed. LION took 37.7s. Estimated remaining: 2h 35m 42s. Rate: 7.1 symbols/min [2025-10-17T19:56:32.143466] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:56:32.193363] [DEBUG] [LOCAL ] LNC: Loaded 51933 existing records from primary storage. [2025-10-17T19:56:32.193710] [INFO ] [MAIN ] LNC: Loaded 51933 existing records. [2025-10-17T19:56:32.374099] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:56:32.374376] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-17T19:56:32.374567] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-17T19:56:32.374874] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-17T19:56:32.374950] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-17T19:56:32.726968] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-17T19:56:32.768293] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:56:32.779175] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-17T19:56:33.008487] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T19:56:33.558025] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-17T19:56:34.333971] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-17T19:56:34.358064] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-17T19:56:34.895900] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-17T19:56:35.114691] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T19:56:35.158079] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-17T19:56:35.958051] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-17T19:56:36.758048] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-17T19:56:36.831437] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-17T19:56:37.043575] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T19:56:37.558010] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-17T19:56:38.031940] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-17T19:56:38.298008] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T19:56:38.358017] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-17T19:56:39.105283] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T19:56:39.158050] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-17T19:56:39.958055] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-17T19:56:40.038522] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T19:56:40.758056] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-17T19:56:41.311137] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-17T19:56:41.558038] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-17T19:56:42.360263] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-17T19:56:42.363540] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-17T19:56:42.427965] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T19:56:43.158085] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-17T19:56:43.671376] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-17T19:56:43.958047] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-17T19:56:44.242395] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-17T19:56:44.758098] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-17T19:56:45.558005] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-17T19:56:45.804009] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-17T19:56:45.994404] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-17T19:56:46.085518] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-17T19:56:46.358058] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-17T19:56:47.158069] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-17T19:56:47.340770] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T19:56:47.958084] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-17T19:56:48.756081] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-17T19:56:48.766521] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-17T19:56:48.828908] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-17T19:56:49.558103] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-17T19:56:50.128610] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-17T19:56:50.358052] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-17T19:56:50.468794] [DEBUG] [REMOTE ] LMT: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-17T19:56:50.469264] [WARN ] [REMOTE ] LMT: No data returned for month 2025-07 [2025-10-17T19:56:50.469367] [FATAL] [REMOTE ] LMT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:56:50.469465] [FATAL] [MAIN ] LMT: Failed to fetch primary data. [2025-10-17T19:56:50.469529] [WARN ] [MAIN ] LMT: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:56:50.469611] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-17T19:56:50.469715] [DEBUG] [LOCAL ] LMT: No primary data file found to delete. [2025-10-17T19:56:50.469765] [INFO ] [LOCAL ] LMT: Starting deletion of derivative data. [2025-10-17T19:56:50.470014] [DEBUG] [LOCAL ] LMT: Deleted derivative data file. [2025-10-17T19:56:50.470492] [INFO ] [MAIN ] Update Progress: 1259/2368 symbols completed. LMT took 23.8s. Estimated remaining: 2h 35m 43s. Rate: 7.1 symbols/min [2025-10-17T19:56:50.636806] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:56:50.645030] [DEBUG] [LOCAL ] LND: Loaded 4994 existing records from primary storage. [2025-10-17T19:56:50.645258] [INFO ] [MAIN ] LND: Loaded 4994 existing records. [2025-10-17T19:56:50.821021] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:56:50.821267] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-17T19:56:50.821342] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-17T19:56:50.821617] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-17T19:56:50.821709] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-17T19:56:51.180786] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-17T19:56:51.184502] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:56:51.218944] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-17T19:56:51.259327] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T19:56:51.958019] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-17T19:56:52.758035] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-17T19:56:53.558023] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-17T19:56:53.610284] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T19:56:53.713433] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-17T19:56:53.778399] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T19:56:54.358027] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-17T19:56:55.158005] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-17T19:56:55.308813] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T19:56:55.600706] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-17T19:56:55.958031] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-17T19:56:56.081423] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T19:56:56.758060] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-17T19:56:57.558028] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-17T19:56:58.358008] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-17T19:56:58.558453] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-17T19:56:58.765373] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-17T19:56:59.004526] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-17T19:56:59.011975] [INFO ] [REMOTE ] LMND: Full fetch complete (75466 records). [2025-10-17T19:56:59.012106] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-17T19:56:59.169416] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-17T19:56:59.454525] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-17T19:56:59.454630] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-17T19:56:59.455919] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-17T19:56:59.456001] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-17T19:56:59.458503] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T19:56:59.470499] [DEBUG] [LOCAL ] LMND: Trimmed 75466 records to 52841 (keeping 200 days of data) [2025-10-17T19:56:59.796660] [DEBUG] [LOCAL ] LMND: Primary data saved (52841 records). [2025-10-17T19:56:59.796793] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-17T19:56:59.797035] [INFO ] [MAIN ] Update Progress: 1260/2368 symbols completed. LMND took 34.6s. Estimated remaining: 2h 35m 35s. Rate: 7.1 symbols/min [2025-10-17T19:56:59.903288] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-17T19:56:59.958016] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-17T19:56:59.976019] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:57:00.024892] [DEBUG] [LOCAL ] LNG: Loaded 51601 existing records from primary storage. [2025-10-17T19:57:00.025202] [INFO ] [MAIN ] LNG: Loaded 51601 existing records. [2025-10-17T19:57:00.202367] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:57:00.202606] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-17T19:57:00.202681] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-17T19:57:00.202889] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-17T19:57:00.202947] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-17T19:57:00.556264] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:57:00.758025] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-17T19:57:01.558037] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-17T19:57:02.358065] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-17T19:57:02.387429] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-17T19:57:02.682706] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-10-17T19:57:02.763253] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-17T19:57:03.158063] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-17T19:57:03.728528] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-17T19:57:03.951405] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T19:57:03.961614] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-17T19:57:04.758029] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-17T19:57:05.558061] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-17T19:57:05.946063] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-17T19:57:06.189123] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-17T19:57:06.363092] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-17T19:57:06.374392] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T19:57:06.383365] [INFO ] [REMOTE ] LNC: Full fetch complete (74572 records). [2025-10-17T19:57:06.383512] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-17T19:57:06.789175] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-17T19:57:06.789250] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-17T19:57:06.790268] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-17T19:57:06.790447] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-17T19:57:06.792004] [DEBUG] [LOCAL ] LNC: Trimmed 74572 records to 52301 (keeping 200 days of data) [2025-10-17T19:57:07.027807] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-17T19:57:07.125252] [DEBUG] [LOCAL ] LNC: Primary data saved (52301 records). [2025-10-17T19:57:07.125382] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-17T19:57:07.125918] [INFO ] [MAIN ] Update Progress: 1261/2368 symbols completed. LNC took 35.2s. Estimated remaining: 2h 35m 26s. Rate: 7.1 symbols/min [2025-10-17T19:57:07.163276] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-17T19:57:07.295480] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:57:07.309589] [DEBUG] [LOCAL ] LNN: Loaded 11521 existing records from primary storage. [2025-10-17T19:57:07.309836] [INFO ] [MAIN ] LNN: Loaded 11521 existing records. [2025-10-17T19:57:07.486952] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:57:07.487452] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-17T19:57:07.487510] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-17T19:57:07.487810] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-17T19:57:07.487891] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-17T19:57:07.843847] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:57:07.838738] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-17T19:57:07.957979] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-17T19:57:08.761382] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-17T19:57:08.764151] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T19:57:09.321597] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-17T19:57:09.558010] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-17T19:57:10.358058] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-17T19:57:11.135771] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T19:57:11.137052] [INFO ] [REMOTE ] LND: Full fetch complete (7871 records). [2025-10-17T19:57:11.137123] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-17T19:57:11.165995] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-17T19:57:11.526472] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-17T19:57:11.526565] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-17T19:57:11.526821] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-17T19:57:11.526882] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-17T19:57:11.527281] [DEBUG] [LOCAL ] LND: Trimmed 7871 records to 5027 (keeping 200 days of data) [2025-10-17T19:57:11.556669] [DEBUG] [LOCAL ] LND: Primary data saved (5027 records). [2025-10-17T19:57:11.556880] [INFO ] [MAIN ] LND: Full history saved. [2025-10-17T19:57:11.557122] [INFO ] [MAIN ] Update Progress: 1262/2368 symbols completed. LND took 21.1s. Estimated remaining: 2h 35m 14s. Rate: 7.1 symbols/min [2025-10-17T19:57:11.689898] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-17T19:57:11.776331] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:57:11.821923] [DEBUG] [LOCAL ] LOAR: Loaded 42364 existing records from primary storage. [2025-10-17T19:57:11.822247] [INFO ] [MAIN ] LOAR: Loaded 42364 existing records. [2025-10-17T19:57:11.963172] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-17T19:57:12.004977] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:57:12.005272] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-17T19:57:12.005508] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-17T19:57:12.005823] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-17T19:57:12.005881] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-17T19:57:12.375561] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:57:12.388717] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T19:57:12.396283] [INFO ] [REMOTE ] LLY: Full fetch complete (77257 records). [2025-10-17T19:57:12.396415] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-17T19:57:12.767563] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-17T19:57:12.793124] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-17T19:57:12.793282] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-17T19:57:12.794858] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-17T19:57:12.795075] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-17T19:57:12.796867] [DEBUG] [LOCAL ] LLY: Trimmed 77257 records to 54022 (keeping 200 days of data) [2025-10-17T19:57:13.038504] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T19:57:13.165814] [DEBUG] [LOCAL ] LLY: Primary data saved (54022 records). [2025-10-17T19:57:13.165971] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-17T19:57:13.166055] [INFO ] [MAIN ] Update Progress: 1263/2368 symbols completed. LLY took 52.3s. Estimated remaining: 2h 34m 60s. Rate: 7.1 symbols/min [2025-10-17T19:57:13.337006] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:57:13.364933] [DEBUG] [LOCAL ] LOB: Loaded 26949 existing records from primary storage. [2025-10-17T19:57:13.365211] [INFO ] [MAIN ] LOB: Loaded 26949 existing records. [2025-10-17T19:57:13.552977] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:57:13.553340] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-17T19:57:13.553400] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-17T19:57:13.553969] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-17T19:57:13.554030] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-17T19:57:13.565411] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-17T19:57:13.962528] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:57:14.358004] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-17T19:57:14.652956] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T19:57:15.054271] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-17T19:57:15.157999] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-17T19:57:15.403896] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T19:57:15.958042] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-17T19:57:16.758059] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-17T19:57:17.096093] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T19:57:17.159926] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-17T19:57:17.316561] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-17T19:57:17.558040] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-17T19:57:18.358003] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-17T19:57:18.590110] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T19:57:19.158027] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-17T19:57:19.958039] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-17T19:57:20.244767] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T19:57:20.463809] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T19:57:20.757991] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-17T19:57:20.866216] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T19:57:21.558080] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-17T19:57:22.233341] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T19:57:22.357992] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-17T19:57:22.717226] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T19:57:23.158070] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-17T19:57:23.612451] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-17T19:57:23.958099] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-17T19:57:24.203466] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-17T19:57:24.758078] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-17T19:57:25.558080] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-17T19:57:25.766917] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T19:57:26.038479] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-17T19:57:26.321530] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T19:57:26.358064] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-17T19:57:27.158024] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-17T19:57:27.693745] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T19:57:27.958098] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-17T19:57:28.239055] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-17T19:57:28.758057] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-17T19:57:29.505082] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T19:57:29.558007] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-17T19:57:30.358012] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-17T19:57:30.547057] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T19:57:30.710364] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T19:57:31.158016] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-17T19:57:31.460836] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T19:57:31.958068] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-17T19:57:32.758006] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-17T19:57:33.036049] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-17T19:57:33.169935] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-17T19:57:33.558058] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-17T19:57:34.358040] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-17T19:57:34.527468] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-17T19:57:34.675625] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T19:57:35.158090] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-17T19:57:35.958018] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-17T19:57:36.139320] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T19:57:36.498308] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-17T19:57:36.612732] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T19:57:36.758018] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-17T19:57:37.563147] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-17T19:57:37.572507] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T19:57:37.579858] [INFO ] [REMOTE ] LNG: Full fetch complete (74785 records). [2025-10-17T19:57:37.580006] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-17T19:57:37.967190] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-17T19:57:37.967273] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-17T19:57:37.968338] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-17T19:57:37.968423] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-17T19:57:37.969899] [DEBUG] [LOCAL ] LNG: Trimmed 74785 records to 51953 (keeping 200 days of data) [2025-10-17T19:57:38.303763] [DEBUG] [LOCAL ] LNG: Primary data saved (51953 records). [2025-10-17T19:57:38.303918] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-17T19:57:38.304064] [INFO ] [MAIN ] Update Progress: 1264/2368 symbols completed. LNG took 38.5s. Estimated remaining: 2h 35m 6s. Rate: 7.1 symbols/min [2025-10-17T19:57:38.369695] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-17T19:57:38.483306] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:57:38.491045] [DEBUG] [LOCAL ] LOCL: Loaded 3809 existing records from primary storage. [2025-10-17T19:57:38.491268] [INFO ] [MAIN ] LOCL: Loaded 3809 existing records. [2025-10-17T19:57:38.683014] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:57:38.683256] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-17T19:57:38.683304] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-17T19:57:38.683438] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-17T19:57:38.683475] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-17T19:57:39.126562] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:57:39.158872] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T19:57:39.159002] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-17T19:57:39.186705] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T19:57:39.775992] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-17T19:57:39.958020] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-17T19:57:40.758036] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-17T19:57:40.780535] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T19:57:41.558057] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-17T19:57:41.994079] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T19:57:41.998135] [INFO ] [REMOTE ] LOB: Full fetch complete (38381 records). [2025-10-17T19:57:41.998276] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-17T19:57:42.344332] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T19:57:42.368855] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-17T19:57:42.388182] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-17T19:57:42.389527] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-17T19:57:42.385777] [INFO ] [REMOTE ] LNN: Full fetch complete (15817 records). [2025-10-17T19:57:42.390810] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-17T19:57:42.390425] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-17T19:57:42.391239] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-17T19:57:42.514588] [DEBUG] [LOCAL ] LOB: Trimmed 38381 records to 27202 (keeping 200 days of data) [2025-10-17T19:57:42.929391] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-17T19:57:42.929864] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-17T19:57:42.931725] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-17T19:57:42.932149] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-17T19:57:42.934806] [DEBUG] [LOCAL ] LNN: Trimmed 15817 records to 11624 (keeping 200 days of data) [2025-10-17T19:57:43.028599] [DEBUG] [LOCAL ] LNN: Primary data saved (11624 records). [2025-10-17T19:57:43.029678] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-17T19:57:43.030174] [INFO ] [MAIN ] Update Progress: 1265/2368 symbols completed. LNN took 35.9s. Estimated remaining: 2h 34m 54s. Rate: 7.1 symbols/min [2025-10-17T19:57:43.173755] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-17T19:57:43.270039] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:57:43.280411] [DEBUG] [LOCAL ] LOB: Primary data saved (27202 records). [2025-10-17T19:57:43.280696] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-17T19:57:43.280833] [INFO ] [MAIN ] Update Progress: 1266/2368 symbols completed. LOB took 30.1s. Estimated remaining: 2h 34m 39s. Rate: 7.1 symbols/min [2025-10-17T19:57:43.466996] [DEBUG] [LOCAL ] LOMA: Loaded 32954 existing records from primary storage. [2025-10-17T19:57:43.484879] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:57:43.485288] [INFO ] [MAIN ] LOMA: Loaded 32954 existing records. [2025-10-17T19:57:43.676523] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:57:43.677134] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-17T19:57:43.677196] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-17T19:57:43.677454] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-17T19:57:43.677522] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-17T19:57:43.789170] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T19:57:43.963139] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-17T19:57:44.030483] [DEBUG] [LOCAL ] LOW: Loaded 53379 existing records from primary storage. [2025-10-17T19:57:44.099475] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:57:44.067049] [INFO ] [MAIN ] LOW: Loaded 53379 existing records. [2025-10-17T19:57:44.238603] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T19:57:44.336945] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:57:44.337169] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-17T19:57:44.337218] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-17T19:57:44.337732] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-17T19:57:44.337790] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-17T19:57:44.425214] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-17T19:57:44.715758] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:57:44.758025] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-17T19:57:45.558036] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-17T19:57:45.994095] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-17T19:57:46.100571] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T19:57:46.358036] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-17T19:57:47.158034] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-17T19:57:47.930383] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-17T19:57:47.958078] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-17T19:57:48.198301] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T19:57:48.758081] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-17T19:57:49.521341] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T19:57:49.526515] [INFO ] [REMOTE ] LOAR: Full fetch complete (55946 records). [2025-10-17T19:57:49.526612] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-17T19:57:49.563249] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-17T19:57:49.911056] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-17T19:57:49.911139] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-17T19:57:49.912120] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-17T19:57:49.912183] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-17T19:57:49.913405] [DEBUG] [LOCAL ] LOAR: Trimmed 55946 records to 42593 (keeping 200 days of data) [2025-10-17T19:57:50.092683] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-17T19:57:50.169498] [DEBUG] [LOCAL ] LOAR: Primary data saved (42593 records). [2025-10-17T19:57:50.169626] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-17T19:57:50.169742] [INFO ] [MAIN ] Update Progress: 1267/2368 symbols completed. LOAR took 38.6s. Estimated remaining: 2h 34m 29s. Rate: 7.1 symbols/min [2025-10-17T19:57:50.365722] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:57:50.364388] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-17T19:57:50.405413] [DEBUG] [LOCAL ] LPG: Loaded 39877 existing records from primary storage. [2025-10-17T19:57:50.405742] [INFO ] [MAIN ] LPG: Loaded 39877 existing records. [2025-10-17T19:57:50.583561] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:57:50.584082] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-17T19:57:50.584249] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-17T19:57:50.584611] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-17T19:57:50.584714] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-17T19:57:50.891689] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-17T19:57:50.977315] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:57:50.981094] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T19:57:51.158045] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-17T19:57:51.958060] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-17T19:57:52.709342] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T19:57:52.758040] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-17T19:57:53.427048] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T19:57:53.558030] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-17T19:57:54.363207] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-17T19:57:54.381264] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T19:57:55.004094] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-17T19:57:55.009709] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T19:57:55.158006] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-17T19:57:55.958038] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-17T19:57:56.534528] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T19:57:56.556808] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T19:57:56.758023] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-17T19:57:57.558029] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-17T19:57:58.358019] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-17T19:57:58.656910] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T19:57:58.809130] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-17T19:57:59.158062] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-17T19:57:59.811777] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T19:57:59.957989] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-17T19:58:00.402951] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T19:58:00.620417] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-17T19:58:00.758034] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-17T19:58:01.485545] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T19:58:01.486698] [INFO ] [REMOTE ] LOCL: Full fetch complete (4549 records). [2025-10-17T19:58:01.486777] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-17T19:58:01.563128] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-17T19:58:01.844718] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-17T19:58:01.844999] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-17T19:58:01.845146] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-17T19:58:01.845185] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-17T19:58:01.845769] [DEBUG] [LOCAL ] LOCL: Trimmed 4549 records to 3843 (keeping 200 days of data) [2025-10-17T19:58:01.869282] [DEBUG] [LOCAL ] LOCL: Primary data saved (3843 records). [2025-10-17T19:58:01.869413] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-17T19:58:01.869510] [INFO ] [MAIN ] Update Progress: 1268/2368 symbols completed. LOCL took 23.6s. Estimated remaining: 2h 34m 23s. Rate: 7.1 symbols/min [2025-10-17T19:58:02.036704] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:58:02.066626] [DEBUG] [LOCAL ] LPL: Loaded 28587 existing records from primary storage. [2025-10-17T19:58:02.066925] [INFO ] [MAIN ] LPL: Loaded 28587 existing records. [2025-10-17T19:58:02.243464] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:58:02.243739] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-17T19:58:02.243795] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-17T19:58:02.243961] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-17T19:58:02.244000] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-17T19:58:02.363129] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-17T19:58:02.604212] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:58:03.158020] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-17T19:58:03.248893] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T19:58:03.705155] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T19:58:03.958032] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-17T19:58:04.011321] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T19:58:04.758063] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-17T19:58:05.456572] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T19:58:05.558031] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-17T19:58:06.357995] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-17T19:58:06.554044] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T19:58:06.870138] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T19:58:07.158007] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-17T19:58:07.430795] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T19:58:07.958009] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-17T19:58:08.349412] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T19:58:08.758044] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-17T19:58:09.558012] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-17T19:58:09.881630] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T19:58:10.292931] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T19:58:10.357992] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-17T19:58:10.815450] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T19:58:11.158033] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-17T19:58:11.401271] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T19:58:11.958015] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-17T19:58:12.598427] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T19:58:12.758053] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-17T19:58:13.272595] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T19:58:13.558081] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-17T19:58:13.769290] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T19:58:14.358033] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-17T19:58:15.158075] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-17T19:58:15.472595] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-17T19:58:15.534874] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T19:58:15.958112] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-17T19:58:16.445525] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T19:58:16.758112] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-17T19:58:17.385029] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T19:58:17.558043] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-17T19:58:17.782500] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T19:58:18.358039] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-17T19:58:19.158001] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-17T19:58:19.566702] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-17T19:58:19.594491] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T19:58:19.599917] [INFO ] [REMOTE ] LOMA: Full fetch complete (47840 records). [2025-10-17T19:58:19.600057] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-17T19:58:19.963278] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-17T19:58:20.050459] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-17T19:58:20.050563] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-17T19:58:20.051578] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-17T19:58:20.051668] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-17T19:58:20.052926] [DEBUG] [LOCAL ] LOMA: Trimmed 47840 records to 33150 (keeping 200 days of data) [2025-10-17T19:58:20.264019] [DEBUG] [LOCAL ] LOMA: Primary data saved (33150 records). [2025-10-17T19:58:20.269547] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-17T19:58:20.277423] [INFO ] [MAIN ] Update Progress: 1269/2368 symbols completed. LOMA took 37.2s. Estimated remaining: 2h 34m 23s. Rate: 7.1 symbols/min [2025-10-17T19:58:20.284515] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T19:58:20.459376] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:58:20.502613] [DEBUG] [LOCAL ] LPX: Loaded 40611 existing records from primary storage. [2025-10-17T19:58:20.503054] [INFO ] [MAIN ] LPX: Loaded 40611 existing records. [2025-10-17T19:58:20.686060] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:58:20.686348] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-17T19:58:20.686402] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-17T19:58:20.686919] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-17T19:58:20.686981] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-17T19:58:20.763188] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-17T19:58:21.054036] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:58:21.558034] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-17T19:58:21.699261] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T19:58:21.725673] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-17T19:58:22.358035] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-17T19:58:23.005800] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T19:58:23.158052] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-17T19:58:23.957876] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T19:58:23.958052] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-17T19:58:24.631943] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T19:58:24.758049] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-17T19:58:25.512542] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T19:58:25.558028] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-17T19:58:25.747413] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T19:58:26.358058] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-17T19:58:27.167781] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-17T19:58:27.172671] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T19:58:27.891062] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T19:58:27.958113] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-17T19:58:28.758040] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-17T19:58:29.001761] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T19:58:29.558031] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-17T19:58:29.587905] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T19:58:29.593491] [INFO ] [REMOTE ] LPL: Full fetch complete (37068 records). [2025-10-17T19:58:29.593629] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-17T19:58:29.962609] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-17T19:58:29.962920] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-17T19:58:29.963737] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-17T19:58:29.963826] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-17T19:58:29.964890] [DEBUG] [LOCAL ] LPL: Trimmed 37068 records to 28863 (keeping 200 days of data) [2025-10-17T19:58:30.069636] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T19:58:30.161790] [DEBUG] [LOCAL ] LPL: Primary data saved (28863 records). [2025-10-17T19:58:30.161915] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-17T19:58:30.162015] [INFO ] [MAIN ] Update Progress: 1270/2368 symbols completed. LPL took 28.3s. Estimated remaining: 2h 34m 16s. Rate: 7.1 symbols/min [2025-10-17T19:58:30.332501] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:58:30.358091] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-17T19:58:30.372233] [DEBUG] [LOCAL ] LRN: Loaded 39819 existing records from primary storage. [2025-10-17T19:58:30.372513] [INFO ] [MAIN ] LRN: Loaded 39819 existing records. [2025-10-17T19:58:30.506558] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T19:58:30.554239] [INFO ] [REMOTE ] LOW: Full fetch complete (76711 records). [2025-10-17T19:58:30.556597] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-17T19:58:30.575903] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:58:30.644050] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-17T19:58:30.649688] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-17T19:58:30.680913] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-17T19:58:30.691263] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-17T19:58:31.173729] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-17T19:58:31.327693] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-17T19:58:31.333018] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-17T19:58:31.339632] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-17T19:58:31.339742] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-17T19:58:31.338560] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:58:31.341120] [DEBUG] [LOCAL ] LOW: Trimmed 76711 records to 53762 (keeping 200 days of data) [2025-10-17T19:58:31.674615] [DEBUG] [LOCAL ] LOW: Primary data saved (53762 records). [2025-10-17T19:58:31.674768] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-17T19:58:31.674851] [INFO ] [MAIN ] Update Progress: 1271/2368 symbols completed. LOW took 48.4s. Estimated remaining: 2h 34m 2s. Rate: 7.1 symbols/min [2025-10-17T19:58:31.855179] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:58:31.870028] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T19:58:31.875741] [INFO ] [REMOTE ] LPG: Full fetch complete (59151 records). [2025-10-17T19:58:31.875849] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-17T19:58:31.961423] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-17T19:58:32.215449] [DEBUG] [LOCAL ] LSPD: Loaded 42885 existing records from primary storage. [2025-10-17T19:58:32.226482] [INFO ] [MAIN ] LSPD: Loaded 42885 existing records. [2025-10-17T19:58:32.413717] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-17T19:58:32.429307] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-17T19:58:32.440480] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-17T19:58:32.453100] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-17T19:58:32.493939] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:58:32.494375] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-17T19:58:32.494623] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-17T19:58:32.494923] [DEBUG] [LOCAL ] LPG: Trimmed 59151 records to 40105 (keeping 200 days of data) [2025-10-17T19:58:32.495764] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-17T19:58:32.495826] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-17T19:58:33.101269] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:58:33.105514] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-17T19:58:33.148575] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T19:58:33.174429] [DEBUG] [LOCAL ] LPG: Primary data saved (40105 records). [2025-10-17T19:58:33.174776] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-17T19:58:33.175509] [INFO ] [MAIN ] Update Progress: 1272/2368 symbols completed. LPG took 43.0s. Estimated remaining: 2h 33m 47s. Rate: 7.1 symbols/min [2025-10-17T19:58:33.267889] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T19:58:33.376729] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:58:33.406908] [DEBUG] [LOCAL ] LTC: Loaded 30810 existing records from primary storage. [2025-10-17T19:58:33.407154] [INFO ] [MAIN ] LTC: Loaded 30810 existing records. [2025-10-17T19:58:33.566667] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-17T19:58:33.589164] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:58:33.589395] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-17T19:58:33.589446] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-17T19:58:33.589954] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-17T19:58:33.590015] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-17T19:58:33.940205] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:58:34.358005] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-17T19:58:34.505868] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T19:58:35.158084] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-10-17T19:58:35.262266] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T19:58:35.794194] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T19:58:35.958075] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-17T19:58:36.348402] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T19:58:36.758047] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-17T19:58:37.471957] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T19:58:37.558049] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-17T19:58:38.272074] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T19:58:38.358065] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-17T19:58:38.990600] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T19:58:39.158064] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-17T19:58:39.708235] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T19:58:39.958034] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-17T19:58:40.687136] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T19:58:40.758084] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-17T19:58:41.273202] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T19:58:41.558085] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-17T19:58:42.175938] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T19:58:42.358101] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-17T19:58:43.113199] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T19:58:43.157986] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-17T19:58:43.595934] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T19:58:43.601909] [INFO ] [REMOTE ] LPX: Full fetch complete (58918 records). [2025-10-17T19:58:43.602059] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-17T19:58:43.965385] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-17T19:58:43.986174] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-17T19:58:43.986248] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-17T19:58:43.987173] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-17T19:58:43.987389] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-17T19:58:43.988699] [DEBUG] [LOCAL ] LPX: Trimmed 58918 records to 40820 (keeping 200 days of data) [2025-10-17T19:58:44.234917] [DEBUG] [LOCAL ] LPX: Primary data saved (40820 records). [2025-10-17T19:58:44.235044] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-17T19:58:44.235554] [INFO ] [MAIN ] Update Progress: 1273/2368 symbols completed. LPX took 24.0s. Estimated remaining: 2h 33m 41s. Rate: 7.1 symbols/min [2025-10-17T19:58:44.401402] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:58:44.449018] [DEBUG] [LOCAL ] LTH: Loaded 52110 existing records from primary storage. [2025-10-17T19:58:44.449318] [INFO ] [MAIN ] LTH: Loaded 52110 existing records. [2025-10-17T19:58:44.624446] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:58:44.624695] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-17T19:58:44.624753] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-17T19:58:44.625546] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-17T19:58:44.625604] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-17T19:58:44.763333] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-17T19:58:44.998123] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:58:45.025263] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T19:58:45.412166] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T19:58:45.558048] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-17T19:58:46.265787] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T19:58:46.358050] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-10-17T19:58:46.804805] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-17T19:58:47.158089] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-17T19:58:47.838792] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T19:58:47.958075] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-17T19:58:48.457247] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T19:58:48.758053] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-17T19:58:49.452460] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T19:58:49.558034] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-17T19:58:49.958130] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T19:58:50.358088] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-17T19:58:50.967010] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T19:58:51.158065] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-17T19:58:51.958031] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-17T19:58:52.055528] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T19:58:52.643567] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T19:58:52.758045] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-17T19:58:53.558032] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-17T19:58:53.704345] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T19:58:54.323696] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T19:58:54.358036] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-17T19:58:55.119398] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T19:58:55.158042] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-17T19:58:55.866984] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T19:58:55.872229] [INFO ] [REMOTE ] LRN: Full fetch complete (58467 records). [2025-10-17T19:58:55.872361] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-17T19:58:55.964263] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-17T19:58:56.256312] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-17T19:58:56.256391] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-17T19:58:56.257432] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-17T19:58:56.257521] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-17T19:58:56.258731] [DEBUG] [LOCAL ] LRN: Trimmed 58467 records to 40127 (keeping 200 days of data) [2025-10-17T19:58:56.499899] [DEBUG] [LOCAL ] LRN: Primary data saved (40127 records). [2025-10-17T19:58:56.500030] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-17T19:58:56.500154] [INFO ] [MAIN ] Update Progress: 1274/2368 symbols completed. LRN took 26.3s. Estimated remaining: 2h 33m 36s. Rate: 7.1 symbols/min [2025-10-17T19:58:56.675321] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:58:56.710286] [DEBUG] [LOCAL ] LTM: Loaded 39065 existing records from primary storage. [2025-10-17T19:58:56.710568] [INFO ] [MAIN ] LTM: Loaded 39065 existing records. [2025-10-17T19:58:56.763540] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-17T19:58:56.849553] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T19:58:56.932736] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:58:56.933270] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-17T19:58:56.933344] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-17T19:58:56.934243] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-17T19:58:56.934303] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-17T19:58:57.304432] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:58:57.364292] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T19:58:57.558030] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-10-17T19:58:58.357999] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-17T19:58:58.567094] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T19:58:58.593042] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T19:58:59.158026] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-17T19:58:59.301915] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-17T19:58:59.958013] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-17T19:58:59.973735] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T19:59:00.758025] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-17T19:59:01.558006] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-17T19:59:01.685913] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T19:59:02.358091] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-17T19:59:02.554603] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T19:59:03.141765] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T19:59:03.157999] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-17T19:59:03.501667] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T19:59:03.958027] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-17T19:59:04.519845] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-17T19:59:04.758068] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-17T19:59:05.318776] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T19:59:05.558021] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-17T19:59:06.203103] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T19:59:06.358031] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-17T19:59:06.961052] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T19:59:07.158013] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-17T19:59:07.793171] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T19:59:07.958030] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-17T19:59:08.154918] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T19:59:08.159441] [INFO ] [REMOTE ] LTC: Full fetch complete (43802 records). [2025-10-17T19:59:08.159550] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-17T19:59:08.540135] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-17T19:59:08.540242] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-17T19:59:08.541285] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-17T19:59:08.541359] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-17T19:59:08.542560] [DEBUG] [LOCAL ] LTC: Trimmed 43802 records to 31063 (keeping 200 days of data) [2025-10-17T19:59:08.758612] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-17T19:59:08.769142] [DEBUG] [LOCAL ] LTC: Primary data saved (31063 records). [2025-10-17T19:59:08.769280] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-17T19:59:08.769400] [INFO ] [MAIN ] Update Progress: 1275/2368 symbols completed. LTC took 35.6s. Estimated remaining: 2h 33m 31s. Rate: 7.1 symbols/min [2025-10-17T19:59:09.037227] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:59:09.101023] [DEBUG] [LOCAL ] LU: Loaded 49412 existing records from primary storage. [2025-10-17T19:59:09.101512] [INFO ] [MAIN ] LU: Loaded 49412 existing records. [2025-10-17T19:59:09.396340] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:59:09.396809] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-17T19:59:09.397032] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-17T19:59:09.397935] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-17T19:59:09.398005] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-17T19:59:09.558388] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-17T19:59:09.896111] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:59:09.898958] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-17T19:59:10.108366] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-17T19:59:10.358034] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-17T19:59:11.000188] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-17T19:59:11.158017] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-17T19:59:11.926718] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T19:59:11.958065] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-17T19:59:12.563157] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T19:59:12.758070] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-17T19:59:13.267450] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T19:59:13.558010] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-17T19:59:14.264260] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T19:59:14.270397] [INFO ] [REMOTE ] LSPD: Full fetch complete (62063 records). [2025-10-17T19:59:14.270508] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-17T19:59:14.365903] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-17T19:59:14.646437] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-17T19:59:14.646517] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-17T19:59:14.647476] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-17T19:59:14.647541] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-17T19:59:14.648786] [DEBUG] [LOCAL ] LSPD: Trimmed 62063 records to 43208 (keeping 200 days of data) [2025-10-17T19:59:14.894671] [DEBUG] [LOCAL ] LSPD: Primary data saved (43208 records). [2025-10-17T19:59:14.894820] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-17T19:59:14.894916] [INFO ] [MAIN ] Update Progress: 1276/2368 symbols completed. LSPD took 43.2s. Estimated remaining: 2h 33m 21s. Rate: 7.1 symbols/min [2025-10-17T19:59:15.059692] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:59:15.081004] [DEBUG] [LOCAL ] LUCK: Loaded 24314 existing records from primary storage. [2025-10-17T19:59:15.081282] [INFO ] [MAIN ] LUCK: Loaded 24314 existing records. [2025-10-17T19:59:15.158541] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-10-17T19:59:15.259786] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:59:15.260105] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-17T19:59:15.260286] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-17T19:59:15.260851] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-17T19:59:15.260912] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-17T19:59:15.569824] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-17T19:59:15.664668] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:59:15.828507] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T19:59:15.958054] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-10-17T19:59:16.758087] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-17T19:59:16.801914] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T19:59:17.050682] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T19:59:17.558051] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-17T19:59:18.358086] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-17T19:59:18.454441] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T19:59:18.996315] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T19:59:19.158067] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-17T19:59:19.442921] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T19:59:19.958050] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-17T19:59:20.374195] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T19:59:20.758092] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-17T19:59:21.253168] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T19:59:21.558035] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-17T19:59:22.351972] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T19:59:22.361224] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-17T19:59:22.757314] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-17T19:59:23.158045] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-17T19:59:23.903091] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T19:59:23.958099] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-17T19:59:24.406259] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T19:59:24.758078] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-17T19:59:25.557994] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-17T19:59:25.676514] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T19:59:25.683774] [INFO ] [REMOTE ] LTH: Full fetch complete (74769 records). [2025-10-17T19:59:25.683895] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-17T19:59:26.075325] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-17T19:59:26.075401] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-17T19:59:26.076416] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-17T19:59:26.076479] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-17T19:59:26.077830] [DEBUG] [LOCAL ] LTH: Trimmed 74769 records to 52497 (keeping 200 days of data) [2025-10-17T19:59:26.366809] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-17T19:59:26.400988] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T19:59:26.423662] [DEBUG] [LOCAL ] LTH: Primary data saved (52497 records). [2025-10-17T19:59:26.423768] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-17T19:59:26.424254] [INFO ] [MAIN ] Update Progress: 1277/2368 symbols completed. LTH took 42.2s. Estimated remaining: 2h 33m 15s. Rate: 7.1 symbols/min [2025-10-17T19:59:26.865001] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T19:59:27.158113] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-17T19:59:27.713021] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:59:27.958077] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-17T19:59:28.492329] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-17T19:59:28.758059] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-17T19:59:29.558079] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-17T19:59:29.696583] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T19:59:29.703898] [INFO ] [REMOTE ] LTM: Full fetch complete (50825 records). [2025-10-17T19:59:29.704091] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-17T19:59:29.966969] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T19:59:30.115816] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-17T19:59:30.115893] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-17T19:59:30.116726] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-17T19:59:30.116788] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-17T19:59:30.117878] [DEBUG] [LOCAL ] LTM: Trimmed 50825 records to 39389 (keeping 200 days of data) [2025-10-17T19:59:30.335800] [DEBUG] [LOCAL ] LTM: Primary data saved (39389 records). [2025-10-17T19:59:30.335929] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-17T19:59:30.336008] [INFO ] [MAIN ] Update Progress: 1278/2368 symbols completed. LTM took 33.8s. Estimated remaining: 2h 33m 3s. Rate: 7.1 symbols/min [2025-10-17T19:59:30.358069] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-17T19:59:31.120022] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T19:59:31.158074] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-17T19:59:31.537044] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T19:59:31.958012] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-17T19:59:32.814106] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T19:59:32.824726] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-17T19:59:33.028804] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T19:59:33.558030] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-17T19:59:34.459508] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T19:59:34.470368] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-17T19:59:34.603270] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T19:59:35.158043] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-17T19:59:36.077419] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T19:59:36.087488] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-17T19:59:36.140181] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-17T19:59:36.758143] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-17T19:59:37.438110] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T19:59:37.558017] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-17T19:59:37.870387] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T19:59:37.873368] [INFO ] [REMOTE ] LUCK: Full fetch complete (39726 records). [2025-10-17T19:59:37.873442] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-17T19:59:38.246145] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-17T19:59:38.246221] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-17T19:59:38.246962] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-17T19:59:38.247023] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-17T19:59:38.247921] [DEBUG] [LOCAL ] LUCK: Trimmed 39726 records to 24521 (keeping 200 days of data) [2025-10-17T19:59:38.391474] [DEBUG] [LOCAL ] LUCK: Primary data saved (24521 records). [2025-10-17T19:59:38.391600] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-17T19:59:38.391709] [INFO ] [MAIN ] Update Progress: 1279/2368 symbols completed. LUCK took 23.5s. Estimated remaining: 2h 32m 54s. Rate: 7.1 symbols/min [2025-10-17T19:59:39.343483] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T19:59:39.351901] [INFO ] [REMOTE ] LU: Full fetch complete (70891 records). [2025-10-17T19:59:39.352063] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-17T19:59:39.733009] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-17T19:59:39.733088] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-17T19:59:39.734071] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-17T19:59:39.734132] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-17T19:59:39.735439] [DEBUG] [LOCAL ] LU: Trimmed 70891 records to 49804 (keeping 200 days of data) [2025-10-17T19:59:40.007073] [DEBUG] [LOCAL ] LU: Primary data saved (49804 records). [2025-10-17T19:59:40.007207] [INFO ] [MAIN ] LU: Full history saved. [2025-10-17T19:59:40.007826] [INFO ] [MAIN ] Update Progress: 1280/2368 symbols completed. LU took 31.2s. Estimated remaining: 2h 32m 40s. Rate: 7.1 symbols/min [2025-10-17T19:59:40.632850] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:59:40.777452] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:59:40.775923] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:59:40.779570] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:59:40.780458] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-17T19:59:40.780952] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-17T19:59:40.781575] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-17T19:59:40.781624] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-17T19:59:40.781720] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-17T19:59:40.781842] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-17T19:59:41.151637] [DEBUG] [LOCAL ] LVS: Loaded 53960 existing records from primary storage. [2025-10-17T19:59:41.193248] [INFO ] [MAIN ] LVS: Loaded 53960 existing records. [2025-10-17T19:59:41.209693] [DEBUG] [LOCAL ] LUMN: Loaded 54036 existing records from primary storage. [2025-10-17T19:59:41.240587] [DEBUG] [LOCAL ] LUV: Loaded 54079 existing records from primary storage. [2025-10-17T19:59:41.277073] [INFO ] [MAIN ] LUV: Loaded 54079 existing records. [2025-10-17T19:59:41.271586] [INFO ] [MAIN ] LUMN: Loaded 54036 existing records. [2025-10-17T19:59:41.316446] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:59:41.412343] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-10-17T19:59:41.716275] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T19:59:41.777183] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:59:41.783278] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-10-17T19:59:41.777824] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-17T19:59:41.768296] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:59:41.804667] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-17T19:59:41.823321] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-17T19:59:41.825906] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-17T19:59:41.825752] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-17T19:59:41.847773] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-17T19:59:41.818544] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T19:59:41.905936] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-17T19:59:41.905765] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-17T19:59:41.941552] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:59:41.941848] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T19:59:41.942399] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-17T19:59:41.942544] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-17T19:59:41.964474] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-17T19:59:41.958955] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-17T19:59:41.982320] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-17T19:59:42.011474] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-17T19:59:42.021963] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-17T19:59:42.103755] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-17T19:59:42.151279] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-17T19:59:42.301537] [INFO ] [MAIN ] Update Progress: 1281/2368 symbols completed. LUXE took 2.3s. Estimated remaining: 2h 32m 26s. Rate: 7.1 symbols/min [2025-10-17T19:59:42.735792] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:59:42.774927] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-10-17T19:59:43.038238] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T19:59:43.241300] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:59:43.249327] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:59:43.250303] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-10-17T19:59:43.258076] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-10-17T19:59:43.261692] [DEBUG] [LOCAL ] LVWR: Loaded 18520 existing records from primary storage. [2025-10-17T19:59:43.262418] [INFO ] [MAIN ] LVWR: Loaded 18520 existing records. [2025-10-17T19:59:43.463325] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T19:59:43.463880] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-17T19:59:43.463949] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-17T19:59:43.464378] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-17T19:59:43.464479] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-17T19:59:43.839067] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T19:59:43.839573] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-10-17T19:59:44.409471] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-17T19:59:44.411818] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-17T19:59:44.956085] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-17T19:59:44.967069] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-17T19:59:45.034617] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T19:59:45.045738] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-17T19:59:45.052532] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-17T19:59:45.056048] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-17T19:59:45.282801] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T19:59:45.558008] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-17T19:59:45.701530] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-17T19:59:46.358022] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-17T19:59:46.781287] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T19:59:46.953896] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-17T19:59:46.958848] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-17T19:59:47.158000] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-17T19:59:47.435375] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T19:59:47.958142] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-17T19:59:48.758078] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-17T19:59:49.276414] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-17T19:59:49.558061] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-17T19:59:49.894347] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-17T19:59:50.248745] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T19:59:50.358038] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-17T19:59:51.158076] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-17T19:59:51.785689] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-17T19:59:51.843203] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-17T19:59:51.949486] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T19:59:51.964012] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-17T19:59:52.758010] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-17T19:59:53.051551] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T19:59:53.558047] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-17T19:59:54.358027] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-17T19:59:54.617134] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T19:59:55.158026] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-17T19:59:55.354244] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T19:59:55.958031] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-17T19:59:56.189278] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T19:59:56.743841] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T19:59:56.757977] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-17T19:59:57.558073] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-17T19:59:58.157105] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-17T19:59:58.358024] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-17T19:59:58.580588] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-17T19:59:58.613280] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T19:59:59.158033] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-17T19:59:59.958037] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-17T20:00:00.208468] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T20:00:00.758028] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-17T20:00:00.870084] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T20:00:01.069499] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T20:00:01.558043] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-17T20:00:02.358151] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-17T20:00:03.158041] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-17T20:00:04.022756] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (3.26 seconds). [2025-10-17T20:00:04.034733] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-17T20:00:04.095764] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T20:00:04.758089] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-17T20:00:04.820393] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (3.26 seconds). [2025-10-17T20:00:05.503107] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-17T20:00:05.558020] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-17T20:00:05.769868] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T20:00:05.772504] [INFO ] [REMOTE ] LVWR: Full fetch complete (20599 records). [2025-10-17T20:00:05.772687] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-17T20:00:06.203541] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-17T20:00:06.203994] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-17T20:00:06.205049] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-17T20:00:06.207228] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-17T20:00:06.218463] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-17T20:00:06.220701] [DEBUG] [LOCAL ] LVWR: Trimmed 20599 records to 18573 (keeping 200 days of data) [2025-10-17T20:00:06.328000] [DEBUG] [LOCAL ] LVWR: Primary data saved (18573 records). [2025-10-17T20:00:06.328161] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-17T20:00:06.328251] [INFO ] [MAIN ] Update Progress: 1282/2368 symbols completed. LVWR took 24.0s. Estimated remaining: 2h 32m 31s. Rate: 7.1 symbols/min [2025-10-17T20:00:06.360335] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-17T20:00:06.510229] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:00:06.559124] [DEBUG] [LOCAL ] LW: Loaded 51587 existing records from primary storage. [2025-10-17T20:00:06.559471] [INFO ] [MAIN ] LW: Loaded 51587 existing records. [2025-10-17T20:00:06.742956] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:00:06.743183] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-17T20:00:06.743245] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-17T20:00:06.744245] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-17T20:00:06.744325] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-17T20:00:07.120727] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:00:07.158088] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-10-17T20:00:07.802242] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-17T20:00:07.958025] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-17T20:00:08.679216] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-17T20:00:08.758024] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-17T20:00:09.444089] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-17T20:00:09.558045] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-17T20:00:10.054467] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-17T20:00:10.358056] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-17T20:00:10.891721] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-17T20:00:11.028671] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T20:00:11.158061] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-17T20:00:11.671378] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T20:00:11.958050] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-17T20:00:12.758063] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-17T20:00:12.879486] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-17T20:00:12.887786] [INFO ] [REMOTE ] LUV: Full fetch complete (77865 records). [2025-10-17T20:00:12.888050] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-17T20:00:13.319294] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-17T20:00:13.353954] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-17T20:00:13.354131] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-17T20:00:13.355955] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-17T20:00:13.356031] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-17T20:00:13.357850] [DEBUG] [LOCAL ] LUV: Trimmed 77865 records to 54469 (keeping 200 days of data) [2025-10-17T20:00:13.578178] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-17T20:00:13.704958] [DEBUG] [LOCAL ] LUV: Primary data saved (54469 records). [2025-10-17T20:00:13.705115] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-17T20:00:13.705227] [INFO ] [MAIN ] Update Progress: 1283/2368 symbols completed. LUV took 33.7s. Estimated remaining: 2h 32m 22s. Rate: 7.1 symbols/min [2025-10-17T20:00:13.886184] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:00:13.903944] [DEBUG] [LOCAL ] LXFR: Loaded 16731 existing records from primary storage. [2025-10-17T20:00:13.904216] [INFO ] [MAIN ] LXFR: Loaded 16731 existing records. [2025-10-17T20:00:14.080245] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:00:14.080552] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-17T20:00:14.080612] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-17T20:00:14.080991] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-17T20:00:14.081050] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-17T20:00:14.361130] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-17T20:00:14.445636] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:00:15.169731] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-10-17T20:00:15.204311] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-17T20:00:15.958096] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-17T20:00:16.109348] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T20:00:16.237440] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T20:00:16.606536] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (3.03 seconds). [2025-10-17T20:00:16.614036] [INFO ] [REMOTE ] LUMN: Full fetch complete (77779 records). [2025-10-17T20:00:16.614197] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-17T20:00:16.763247] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-17T20:00:17.027210] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-17T20:00:17.027387] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-17T20:00:17.029347] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-17T20:00:17.029436] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-17T20:00:17.031723] [DEBUG] [LOCAL ] LUMN: Trimmed 77779 records to 54426 (keeping 200 days of data) [2025-10-17T20:00:17.374582] [DEBUG] [LOCAL ] LUMN: Primary data saved (54426 records). [2025-10-17T20:00:17.374771] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-17T20:00:17.375537] [INFO ] [MAIN ] Update Progress: 1284/2368 symbols completed. LUMN took 37.4s. Estimated remaining: 2h 32m 9s. Rate: 7.1 symbols/min [2025-10-17T20:00:17.580159] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-17T20:00:17.604278] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:00:17.683980] [DEBUG] [LOCAL ] LXP: Loaded 51132 existing records from primary storage. [2025-10-17T20:00:17.684514] [INFO ] [MAIN ] LXP: Loaded 51132 existing records. [2025-10-17T20:00:17.928871] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-17T20:00:17.973152] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:00:17.973526] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-17T20:00:17.973609] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-17T20:00:17.974830] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-17T20:00:17.974907] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-17T20:00:18.135526] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-17T20:00:18.367062] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-17T20:00:18.462144] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:00:19.158068] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-17T20:00:19.444030] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T20:00:19.902399] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T20:00:19.958042] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-10-17T20:00:20.134159] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T20:00:20.758036] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-17T20:00:21.558006] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-17T20:00:21.648564] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T20:00:22.358056] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-17T20:00:22.509022] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T20:00:22.570374] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T20:00:23.158067] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-17T20:00:23.914573] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T20:00:23.958144] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-17T20:00:23.980068] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-17T20:00:24.758064] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-17T20:00:25.494679] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T20:00:25.558034] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-17T20:00:26.358021] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-17T20:00:26.700600] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T20:00:26.707896] [INFO ] [REMOTE ] LVS: Full fetch complete (77706 records). [2025-10-17T20:00:26.708039] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-17T20:00:27.101282] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-17T20:00:27.101467] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-17T20:00:27.102552] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-17T20:00:27.102663] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-17T20:00:27.104229] [DEBUG] [LOCAL ] LVS: Trimmed 77706 records to 54350 (keeping 200 days of data) [2025-10-17T20:00:27.159449] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-17T20:00:27.241877] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T20:00:27.470123] [DEBUG] [LOCAL ] LVS: Primary data saved (54350 records). [2025-10-17T20:00:27.470234] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-17T20:00:27.470337] [INFO ] [MAIN ] Update Progress: 1285/2368 symbols completed. LVS took 47.5s. Estimated remaining: 2h 32m 2s. Rate: 7.1 symbols/min [2025-10-17T20:00:27.638057] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:00:27.665950] [DEBUG] [LOCAL ] LXU: Loaded 31987 existing records from primary storage. [2025-10-17T20:00:27.666207] [INFO ] [MAIN ] LXU: Loaded 31987 existing records. [2025-10-17T20:00:27.847683] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:00:27.848005] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-17T20:00:27.848115] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-17T20:00:27.848792] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-17T20:00:27.871016] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-17T20:00:27.945235] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T20:00:27.968303] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-17T20:00:28.281876] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:00:28.292290] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T20:00:28.758000] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-17T20:00:29.558003] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-10-17T20:00:29.711344] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T20:00:29.862975] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T20:00:30.358007] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-17T20:00:30.487540] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T20:00:31.158030] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-17T20:00:31.330628] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-17T20:00:31.958043] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-17T20:00:32.767600] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-17T20:00:32.773961] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T20:00:33.267844] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-17T20:00:33.558038] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-17T20:00:34.358009] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-17T20:00:34.565739] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T20:00:34.679967] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T20:00:35.016508] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T20:00:35.158025] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-17T20:00:35.958033] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-17T20:00:36.070177] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T20:00:36.758097] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-17T20:00:37.557999] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-17T20:00:37.588216] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T20:00:38.358041] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-17T20:00:38.499146] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T20:00:38.525576] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-17T20:00:38.527998] [INFO ] [REMOTE ] LXFR: Full fetch complete (24746 records). [2025-10-17T20:00:38.528085] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-17T20:00:38.899800] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-17T20:00:38.899876] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-17T20:00:38.900434] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-17T20:00:38.900478] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-17T20:00:38.901131] [DEBUG] [LOCAL ] LXFR: Trimmed 24746 records to 16810 (keeping 200 days of data) [2025-10-17T20:00:39.006831] [DEBUG] [LOCAL ] LXFR: Primary data saved (16810 records). [2025-10-17T20:00:39.006981] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-17T20:00:39.007093] [INFO ] [MAIN ] Update Progress: 1286/2368 symbols completed. LXFR took 25.3s. Estimated remaining: 2h 31m 56s. Rate: 7.1 symbols/min [2025-10-17T20:00:39.179020] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-17T20:00:39.183688] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:00:39.235101] [DEBUG] [LOCAL ] LYB: Loaded 54008 existing records from primary storage. [2025-10-17T20:00:39.235513] [INFO ] [MAIN ] LYB: Loaded 54008 existing records. [2025-10-17T20:00:39.409189] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:00:39.409588] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-17T20:00:39.409696] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-17T20:00:39.411065] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-17T20:00:39.411164] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-17T20:00:39.767617] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T20:00:39.794828] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:00:39.958039] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-10-17T20:00:40.734258] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T20:00:40.758048] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-17T20:00:41.557995] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-17T20:00:41.851167] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T20:00:42.019617] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T20:00:42.358030] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-17T20:00:43.158082] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-17T20:00:43.383205] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-17T20:00:43.390309] [INFO ] [REMOTE ] LW: Full fetch complete (74752 records). [2025-10-17T20:00:43.390427] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-17T20:00:43.779557] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-17T20:00:43.779636] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-17T20:00:43.780782] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-17T20:00:43.780846] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-17T20:00:43.782205] [DEBUG] [LOCAL ] LW: Trimmed 74752 records to 51966 (keeping 200 days of data) [2025-10-17T20:00:43.914200] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T20:00:43.984453] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-17T20:00:44.131767] [DEBUG] [LOCAL ] LW: Primary data saved (51966 records). [2025-10-17T20:00:44.131879] [INFO ] [MAIN ] LW: Full history saved. [2025-10-17T20:00:44.131963] [INFO ] [MAIN ] Update Progress: 1287/2368 symbols completed. LW took 37.8s. Estimated remaining: 2h 31m 45s. Rate: 7.1 symbols/min [2025-10-17T20:00:44.297107] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:00:44.345760] [DEBUG] [LOCAL ] LYG: Loaded 53078 existing records from primary storage. [2025-10-17T20:00:44.346082] [INFO ] [MAIN ] LYG: Loaded 53078 existing records. [2025-10-17T20:00:44.535972] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:00:44.536217] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-17T20:00:44.536286] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-17T20:00:44.537244] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-17T20:00:44.537306] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-17T20:00:44.758449] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-17T20:00:44.901535] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:00:44.931987] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T20:00:45.453370] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T20:00:45.557999] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-17T20:00:46.358005] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-17T20:00:46.460871] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T20:00:46.547704] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T20:00:47.158051] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-17T20:00:47.958074] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-17T20:00:48.139122] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T20:00:48.546049] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T20:00:48.758092] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-17T20:00:49.563150] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-10-17T20:00:49.583383] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T20:00:50.309392] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T20:00:50.358012] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-17T20:00:51.158024] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-17T20:00:51.373708] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T20:00:51.924106] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T20:00:51.958016] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-17T20:00:52.758027] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-17T20:00:52.805258] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T20:00:52.812397] [INFO ] [REMOTE ] LXP: Full fetch complete (72845 records). [2025-10-17T20:00:52.812572] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-17T20:00:53.202375] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T20:00:53.249264] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-17T20:00:53.249797] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-17T20:00:53.250885] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-17T20:00:53.250958] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-17T20:00:53.252426] [DEBUG] [LOCAL ] LXP: Trimmed 72845 records to 51460 (keeping 200 days of data) [2025-10-17T20:00:53.560700] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-17T20:00:53.571281] [DEBUG] [LOCAL ] LXP: Primary data saved (51460 records). [2025-10-17T20:00:53.571560] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-17T20:00:53.572350] [INFO ] [MAIN ] Update Progress: 1288/2368 symbols completed. LXP took 36.2s. Estimated remaining: 2h 31m 38s. Rate: 7.1 symbols/min [2025-10-17T20:00:53.759970] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:00:53.809955] [DEBUG] [LOCAL ] LYV: Loaded 51498 existing records from primary storage. [2025-10-17T20:00:53.810313] [INFO ] [MAIN ] LYV: Loaded 51498 existing records. [2025-10-17T20:00:53.987378] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:00:53.987624] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-17T20:00:53.987704] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-17T20:00:53.988445] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-17T20:00:53.988502] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-17T20:00:54.350139] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:00:54.357989] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-10-17T20:00:54.419950] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T20:00:55.158031] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-17T20:00:55.505847] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T20:00:55.958021] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-17T20:00:56.125259] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T20:00:56.322465] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T20:00:56.758030] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-17T20:00:57.558025] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-17T20:00:57.710306] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T20:00:58.358000] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-17T20:00:58.556920] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T20:00:59.158074] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-17T20:00:59.310907] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T20:00:59.931387] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T20:00:59.957995] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-17T20:01:00.758055] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-17T20:01:01.558079] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-17T20:01:01.711247] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-17T20:01:02.136302] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-17T20:01:02.358035] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-17T20:01:02.526018] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-17T20:01:02.987503] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T20:01:02.991751] [INFO ] [REMOTE ] LXU: Full fetch complete (45331 records). [2025-10-17T20:01:02.991840] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-17T20:01:03.164148] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-17T20:01:03.370720] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-17T20:01:03.370821] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-17T20:01:03.371700] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-17T20:01:03.371766] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-17T20:01:03.372885] [DEBUG] [LOCAL ] LXU: Trimmed 45331 records to 32174 (keeping 200 days of data) [2025-10-17T20:01:03.551074] [DEBUG] [LOCAL ] LXU: Primary data saved (32174 records). [2025-10-17T20:01:03.551225] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-17T20:01:03.551314] [INFO ] [MAIN ] Update Progress: 1289/2368 symbols completed. LXU took 36.1s. Estimated remaining: 2h 31m 30s. Rate: 7.1 symbols/min [2025-10-17T20:01:03.723264] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:01:03.756120] [DEBUG] [LOCAL ] LZB: Loaded 35417 existing records from primary storage. [2025-10-17T20:01:03.756405] [INFO ] [MAIN ] LZB: Loaded 35417 existing records. [2025-10-17T20:01:03.939477] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:01:03.939711] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-17T20:01:03.939809] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-17T20:01:03.940421] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-17T20:01:03.940479] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-17T20:01:03.971637] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-17T20:01:04.325330] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:01:04.355849] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T20:01:04.758089] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-17T20:01:05.236449] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-17T20:01:05.558005] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-17T20:01:05.884861] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T20:01:06.358028] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-17T20:01:06.611157] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T20:01:07.158065] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-17T20:01:07.392673] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T20:01:07.958001] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-10-17T20:01:08.138389] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T20:01:08.578123] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T20:01:08.758033] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-17T20:01:08.840110] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-17T20:01:09.558040] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-17T20:01:10.288418] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T20:01:10.358066] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-17T20:01:10.836178] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T20:01:11.158085] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-17T20:01:11.963113] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-17T20:01:11.982938] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T20:01:12.583719] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T20:01:12.758041] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-17T20:01:13.558037] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-17T20:01:13.717516] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T20:01:14.150928] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-17T20:01:14.238350] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T20:01:14.246062] [INFO ] [REMOTE ] LYB: Full fetch complete (77631 records). [2025-10-17T20:01:14.246241] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-17T20:01:14.363140] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-17T20:01:14.647811] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-17T20:01:14.647910] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-17T20:01:14.648997] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-17T20:01:14.649066] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-17T20:01:14.650699] [DEBUG] [LOCAL ] LYB: Trimmed 77631 records to 54398 (keeping 200 days of data) [2025-10-17T20:01:14.994918] [DEBUG] [LOCAL ] LYB: Primary data saved (54398 records). [2025-10-17T20:01:14.995073] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-17T20:01:14.995168] [INFO ] [MAIN ] Update Progress: 1290/2368 symbols completed. LYB took 36.0s. Estimated remaining: 2h 31m 25s. Rate: 7.1 symbols/min [2025-10-17T20:01:15.163489] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-17T20:01:15.165701] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:01:15.180926] [DEBUG] [LOCAL ] LZM: Loaded 14661 existing records from primary storage. [2025-10-17T20:01:15.181164] [INFO ] [MAIN ] LZM: Loaded 14661 existing records. [2025-10-17T20:01:15.360177] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:01:15.360397] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-17T20:01:15.360444] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-17T20:01:15.360815] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-17T20:01:15.360874] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-17T20:01:15.717619] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:01:15.958036] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-10-17T20:01:16.282945] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-17T20:01:16.635504] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T20:01:16.693332] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-17T20:01:16.758056] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-17T20:01:17.558015] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-17T20:01:18.072853] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T20:01:18.358037] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-17T20:01:19.157999] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-17T20:01:19.348499] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T20:01:19.365475] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T20:01:19.958084] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-17T20:01:20.669856] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-17T20:01:20.758071] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-17T20:01:21.056434] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T20:01:21.558074] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-17T20:01:22.357999] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-17T20:01:22.594775] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T20:01:22.602055] [INFO ] [REMOTE ] LYG: Full fetch complete (76188 records). [2025-10-17T20:01:22.602180] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-17T20:01:22.984234] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-17T20:01:22.984312] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-17T20:01:22.985330] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-17T20:01:22.985394] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-17T20:01:22.986796] [DEBUG] [LOCAL ] LYG: Trimmed 76188 records to 53435 (keeping 200 days of data) [2025-10-17T20:01:23.159723] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-17T20:01:23.300851] [DEBUG] [LOCAL ] LYG: Primary data saved (53435 records). [2025-10-17T20:01:23.301077] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-17T20:01:23.301192] [INFO ] [MAIN ] Update Progress: 1291/2368 symbols completed. LYG took 39.2s. Estimated remaining: 2h 31m 16s. Rate: 7.1 symbols/min [2025-10-17T20:01:23.471556] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:01:23.500214] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T20:01:23.558218] [DEBUG] [LOCAL ] M: Loaded 53935 existing records from primary storage. [2025-10-17T20:01:23.558525] [INFO ] [MAIN ] M: Loaded 53935 existing records. [2025-10-17T20:01:23.735965] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:01:23.736371] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-17T20:01:23.736593] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-17T20:01:23.737744] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-17T20:01:23.737805] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-17T20:01:23.962343] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-17T20:01:23.975414] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T20:01:24.172323] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:01:24.234461] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-17T20:01:24.758107] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-17T20:01:25.557991] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-17T20:01:25.720177] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T20:01:26.322952] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T20:01:26.357990] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-17T20:01:26.586564] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T20:01:27.158025] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-17T20:01:27.589239] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-17T20:01:27.617415] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-17T20:01:27.624759] [INFO ] [REMOTE ] LYV: Full fetch complete (74152 records). [2025-10-17T20:01:27.624878] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-17T20:01:27.973067] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-17T20:01:28.034786] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-17T20:01:28.034884] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-17T20:01:28.036067] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-17T20:01:28.036131] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-17T20:01:28.037867] [DEBUG] [LOCAL ] LYV: Trimmed 74152 records to 51878 (keeping 200 days of data) [2025-10-17T20:01:28.339977] [DEBUG] [LOCAL ] LYV: Primary data saved (51878 records). [2025-10-17T20:01:28.340128] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-17T20:01:28.340698] [INFO ] [MAIN ] Update Progress: 1292/2368 symbols completed. LYV took 34.8s. Estimated remaining: 2h 31m 5s. Rate: 7.1 symbols/min [2025-10-17T20:01:28.508818] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:01:28.557865] [DEBUG] [LOCAL ] MA: Loaded 52869 existing records from primary storage. [2025-10-17T20:01:28.558164] [INFO ] [MAIN ] MA: Loaded 52869 existing records. [2025-10-17T20:01:28.731200] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:01:28.731410] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-17T20:01:28.731482] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-17T20:01:28.732439] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-17T20:01:28.732497] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-17T20:01:28.763306] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-17T20:01:29.091639] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:01:29.471009] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T20:01:29.475865] [INFO ] [REMOTE ] LZB: Full fetch complete (50923 records). [2025-10-17T20:01:29.475961] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-17T20:01:29.565614] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-10-17T20:01:29.781240] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T20:01:29.870903] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-17T20:01:29.870975] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-17T20:01:29.871832] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-17T20:01:29.871894] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-17T20:01:29.872949] [DEBUG] [LOCAL ] LZB: Trimmed 50923 records to 35693 (keeping 200 days of data) [2025-10-17T20:01:30.085973] [DEBUG] [LOCAL ] LZB: Primary data saved (35693 records). [2025-10-17T20:01:30.086109] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-17T20:01:30.086191] [INFO ] [MAIN ] Update Progress: 1293/2368 symbols completed. LZB took 26.5s. Estimated remaining: 2h 30m 51s. Rate: 7.1 symbols/min [2025-10-17T20:01:30.251219] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:01:30.290311] [DEBUG] [LOCAL ] MAA: Loaded 43214 existing records from primary storage. [2025-10-17T20:01:30.290617] [INFO ] [MAIN ] MAA: Loaded 43214 existing records. [2025-10-17T20:01:30.363134] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-17T20:01:30.464022] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:01:30.464249] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-17T20:01:30.464296] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-17T20:01:30.465196] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-17T20:01:30.465256] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-17T20:01:30.818732] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:01:31.157998] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-10-17T20:01:31.200012] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T20:01:31.565799] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-17T20:01:31.958048] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-10-17T20:01:32.758037] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-17T20:01:32.831732] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T20:01:33.527542] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T20:01:33.558004] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-17T20:01:34.358002] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-17T20:01:34.760552] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-17T20:01:34.989430] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T20:01:35.158047] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-17T20:01:35.958019] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-17T20:01:36.248315] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-17T20:01:36.323105] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T20:01:36.758029] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-17T20:01:37.558057] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-17T20:01:37.793175] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-17T20:01:38.046541] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T20:01:38.358016] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-17T20:01:39.158042] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-17T20:01:39.234291] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T20:01:39.954951] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-17T20:01:39.958055] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-17T20:01:40.349478] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T20:01:40.758056] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-17T20:01:41.512724] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T20:01:41.557993] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-17T20:01:41.757328] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T20:01:42.358020] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-17T20:01:42.732711] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T20:01:43.158091] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-17T20:01:43.959357] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-17T20:01:43.961753] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-17T20:01:44.758029] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-17T20:01:45.189180] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-17T20:01:45.193516] [INFO ] [REMOTE ] LZM: Full fetch complete (19656 records). [2025-10-17T20:01:45.193719] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-17T20:01:45.407412] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-17T20:01:45.565342] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-17T20:01:45.612048] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-17T20:01:45.612511] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-17T20:01:45.613026] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-17T20:01:45.613209] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-17T20:01:45.614092] [DEBUG] [LOCAL ] LZM: Trimmed 19656 records to 14886 (keeping 200 days of data) [2025-10-17T20:01:45.693799] [DEBUG] [LOCAL ] LZM: Primary data saved (14886 records). [2025-10-17T20:01:45.693977] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-17T20:01:45.694085] [INFO ] [MAIN ] Update Progress: 1294/2368 symbols completed. LZM took 30.7s. Estimated remaining: 2h 30m 48s. Rate: 7.1 symbols/min [2025-10-17T20:01:45.859567] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:01:45.905505] [DEBUG] [LOCAL ] MAC: Loaded 50114 existing records from primary storage. [2025-10-17T20:01:45.905849] [INFO ] [MAIN ] MAC: Loaded 50114 existing records. [2025-10-17T20:01:46.077232] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:01:46.077474] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-17T20:01:46.077547] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-17T20:01:46.078428] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-17T20:01:46.078485] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-17T20:01:46.363412] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-17T20:01:46.438988] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:01:46.722724] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-17T20:01:47.158057] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-10-17T20:01:47.690502] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-17T20:01:47.739713] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T20:01:47.958059] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-17T20:01:48.469754] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T20:01:48.758030] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-17T20:01:49.540407] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T20:01:49.558012] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-17T20:01:50.358033] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-17T20:01:50.757969] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-17T20:01:51.158190] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-17T20:01:51.257711] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T20:01:51.919193] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T20:01:51.958034] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-17T20:01:52.758043] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-17T20:01:53.219117] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T20:01:53.558019] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-17T20:01:53.593552] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T20:01:54.325684] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T20:01:54.358016] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-17T20:01:55.158068] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-17T20:01:55.549919] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T20:01:55.958079] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-17T20:01:56.114000] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T20:01:56.119992] [INFO ] [REMOTE ] MAA: Full fetch complete (61666 records). [2025-10-17T20:01:56.120179] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-17T20:01:56.508723] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-17T20:01:56.508823] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-17T20:01:56.509938] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-17T20:01:56.510019] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-17T20:01:56.511482] [DEBUG] [LOCAL ] MAA: Trimmed 61666 records to 43519 (keeping 200 days of data) [2025-10-17T20:01:56.761760] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-17T20:01:56.789295] [DEBUG] [LOCAL ] MAA: Primary data saved (43519 records). [2025-10-17T20:01:56.789398] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-17T20:01:56.790025] [INFO ] [MAIN ] Update Progress: 1295/2368 symbols completed. MAA took 26.7s. Estimated remaining: 2h 30m 42s. Rate: 7.1 symbols/min [2025-10-17T20:01:56.965829] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:01:57.006186] [DEBUG] [LOCAL ] MAGN: Loaded 36411 existing records from primary storage. [2025-10-17T20:01:57.006503] [INFO ] [MAIN ] MAGN: Loaded 36411 existing records. [2025-10-17T20:01:57.257010] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:01:57.257876] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-17T20:01:57.258164] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-17T20:01:57.258932] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-17T20:01:57.259086] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-17T20:01:57.482315] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-17T20:01:57.598069] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-17T20:01:57.708176] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:01:57.709402] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T20:01:58.358024] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-10-17T20:01:58.569931] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T20:01:59.158010] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-17T20:01:59.621886] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-17T20:01:59.705161] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T20:01:59.958087] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-17T20:02:00.758086] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-17T20:02:01.558054] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-17T20:02:01.823505] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-10-17T20:02:02.011054] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T20:02:02.358112] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-17T20:02:02.988246] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-17T20:02:03.158104] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-17T20:02:03.761278] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-17T20:02:03.958065] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-17T20:02:04.388032] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-17T20:02:04.461406] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-17T20:02:04.469073] [INFO ] [REMOTE ] MA: Full fetch complete (76410 records). [2025-10-17T20:02:04.469231] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-17T20:02:04.765973] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-17T20:02:04.863324] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-17T20:02:04.863405] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-17T20:02:04.864459] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-17T20:02:04.864523] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-17T20:02:04.866099] [DEBUG] [LOCAL ] MA: Trimmed 76410 records to 53252 (keeping 200 days of data) [2025-10-17T20:02:05.205718] [DEBUG] [LOCAL ] MA: Primary data saved (53252 records). [2025-10-17T20:02:05.205968] [INFO ] [MAIN ] MA: Full history saved. [2025-10-17T20:02:05.206701] [INFO ] [MAIN ] Update Progress: 1296/2368 symbols completed. MA took 36.9s. Estimated remaining: 2h 30m 34s. Rate: 7.1 symbols/min [2025-10-17T20:02:05.394222] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:02:05.418319] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T20:02:05.462340] [DEBUG] [LOCAL ] MAIN: Loaded 42123 existing records from primary storage. [2025-10-17T20:02:05.462673] [INFO ] [MAIN ] MAIN: Loaded 42123 existing records. [2025-10-17T20:02:05.563150] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-17T20:02:05.659098] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:02:05.659314] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-17T20:02:05.659375] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-17T20:02:05.660099] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-17T20:02:05.660182] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-17T20:02:06.011555] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:02:06.370281] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-10-17T20:02:06.376786] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T20:02:06.992283] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T20:02:07.158050] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-17T20:02:07.958023] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-17T20:02:07.997071] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T20:02:08.758048] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-17T20:02:09.074293] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T20:02:09.568853] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-17T20:02:09.574861] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T20:02:10.358059] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-17T20:02:10.480219] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T20:02:10.938419] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-17T20:02:11.158067] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-17T20:02:11.728575] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T20:02:11.958076] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-17T20:02:12.758024] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-17T20:02:12.834815] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T20:02:13.502355] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T20:02:13.558038] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-17T20:02:14.358013] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-17T20:02:14.680604] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T20:02:14.976034] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T20:02:15.158066] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-17T20:02:15.958115] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-17T20:02:16.237241] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T20:02:16.758114] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-17T20:02:16.908757] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T20:02:17.558051] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-17T20:02:17.917852] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-17T20:02:17.925679] [INFO ] [REMOTE ] M: Full fetch complete (77658 records). [2025-10-17T20:02:17.925826] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-17T20:02:18.334939] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-17T20:02:18.335104] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-17T20:02:18.336336] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-17T20:02:18.336406] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-17T20:02:18.338112] [DEBUG] [LOCAL ] M: Trimmed 77658 records to 54325 (keeping 200 days of data) [2025-10-17T20:02:18.391170] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-17T20:02:18.695818] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T20:02:18.726922] [DEBUG] [LOCAL ] M: Primary data saved (54325 records). [2025-10-17T20:02:18.727062] [INFO ] [MAIN ] M: Full history saved. [2025-10-17T20:02:18.727144] [INFO ] [MAIN ] Update Progress: 1297/2368 symbols completed. M took 55.4s. Estimated remaining: 2h 30m 29s. Rate: 7.1 symbols/min [2025-10-17T20:02:18.930139] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:02:18.970870] [DEBUG] [LOCAL ] MAN: Loaded 44417 existing records from primary storage. [2025-10-17T20:02:18.971207] [INFO ] [MAIN ] MAN: Loaded 44417 existing records. [2025-10-17T20:02:19.173674] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-17T20:02:19.194835] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:02:19.196958] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T20:02:19.197162] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-17T20:02:19.197543] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-17T20:02:19.206798] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-17T20:02:19.206897] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-17T20:02:19.575478] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:02:19.958015] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-17T20:02:20.014121] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T20:02:20.020903] [INFO ] [REMOTE ] MAC: Full fetch complete (71597 records). [2025-10-17T20:02:20.021093] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-17T20:02:20.412665] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-17T20:02:20.412760] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-17T20:02:20.413772] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-17T20:02:20.413836] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-17T20:02:20.415217] [DEBUG] [LOCAL ] MAC: Trimmed 71597 records to 50453 (keeping 200 days of data) [2025-10-17T20:02:20.729177] [DEBUG] [LOCAL ] MAC: Primary data saved (50453 records). [2025-10-17T20:02:20.729321] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-17T20:02:20.729446] [INFO ] [MAIN ] Update Progress: 1298/2368 symbols completed. MAC took 35.0s. Estimated remaining: 2h 30m 16s. Rate: 7.1 symbols/min [2025-10-17T20:02:20.773035] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-10-17T20:02:20.907154] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:02:20.935580] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T20:02:20.967292] [DEBUG] [LOCAL ] MANU: Loaded 27328 existing records from primary storage. [2025-10-17T20:02:20.967733] [INFO ] [MAIN ] MANU: Loaded 27328 existing records. [2025-10-17T20:02:21.147021] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:02:21.147277] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-17T20:02:21.147395] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-17T20:02:21.148020] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-17T20:02:21.148078] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-17T20:02:21.317863] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T20:02:21.536165] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:02:21.558002] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-10-17T20:02:22.244050] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T20:02:22.358050] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-17T20:02:22.643593] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T20:02:23.158065] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-17T20:02:23.947316] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T20:02:23.957980] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-17T20:02:24.010527] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-17T20:02:24.758086] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-17T20:02:25.558135] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-17T20:02:25.637703] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T20:02:26.195493] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T20:02:26.358049] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-17T20:02:26.485242] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T20:02:27.158135] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-17T20:02:27.506337] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T20:02:27.958108] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-17T20:02:28.264905] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T20:02:28.758086] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-17T20:02:29.334315] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T20:02:29.558050] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-17T20:02:30.330997] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T20:02:30.358015] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-17T20:02:31.157999] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-17T20:02:31.205604] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T20:02:31.212006] [INFO ] [REMOTE ] MAGN: Full fetch complete (51886 records). [2025-10-17T20:02:31.212154] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-17T20:02:31.656170] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-17T20:02:31.656292] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-17T20:02:31.657380] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-17T20:02:31.657470] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-17T20:02:31.658776] [DEBUG] [LOCAL ] MAGN: Trimmed 51886 records to 36703 (keeping 200 days of data) [2025-10-17T20:02:31.878723] [DEBUG] [LOCAL ] MAGN: Primary data saved (36703 records). [2025-10-17T20:02:31.878894] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-17T20:02:31.879015] [INFO ] [MAIN ] Update Progress: 1299/2368 symbols completed. MAGN took 35.1s. Estimated remaining: 2h 30m 10s. Rate: 7.1 symbols/min [2025-10-17T20:02:31.964906] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-17T20:02:32.062214] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:02:32.092500] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T20:02:32.145680] [DEBUG] [LOCAL ] MAS: Loaded 52671 existing records from primary storage. [2025-10-17T20:02:32.146008] [INFO ] [MAIN ] MAS: Loaded 52671 existing records. [2025-10-17T20:02:32.327882] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:02:32.328107] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-17T20:02:32.328159] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-17T20:02:32.328993] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-17T20:02:32.329052] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-17T20:02:32.721592] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:02:32.758011] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-17T20:02:32.843435] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T20:02:33.244629] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T20:02:33.558055] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-17T20:02:34.363663] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-17T20:02:34.378364] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T20:02:35.158009] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-10-17T20:02:35.259082] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T20:02:35.496197] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T20:02:35.958043] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-17T20:02:36.758067] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-17T20:02:36.821558] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T20:02:37.394363] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T20:02:37.558050] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-17T20:02:38.358021] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-17T20:02:38.742271] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-17T20:02:38.748858] [INFO ] [REMOTE ] MAIN: Full fetch complete (60437 records). [2025-10-17T20:02:38.749000] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-17T20:02:39.003470] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T20:02:39.163485] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-17T20:02:39.184421] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-17T20:02:39.184497] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-17T20:02:39.185497] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-17T20:02:39.185685] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-17T20:02:39.187054] [DEBUG] [LOCAL ] MAIN: Trimmed 60437 records to 42467 (keeping 200 days of data) [2025-10-17T20:02:39.460216] [DEBUG] [LOCAL ] MAIN: Primary data saved (42467 records). [2025-10-17T20:02:39.460377] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-17T20:02:39.461017] [INFO ] [MAIN ] Update Progress: 1300/2368 symbols completed. MAIN took 34.3s. Estimated remaining: 2h 30m 0s. Rate: 7.1 symbols/min [2025-10-17T20:02:39.640670] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:02:39.676381] [DEBUG] [LOCAL ] MATV: Loaded 35854 existing records from primary storage. [2025-10-17T20:02:39.676703] [INFO ] [MAIN ] MATV: Loaded 35854 existing records. [2025-10-17T20:02:39.862232] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:02:39.862568] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-17T20:02:39.862692] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-17T20:02:39.863339] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-17T20:02:39.863399] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-17T20:02:39.960483] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-17T20:02:40.159123] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T20:02:40.266117] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:02:40.359684] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-17T20:02:40.758084] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-17T20:02:41.514871] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T20:02:41.558037] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-17T20:02:42.358021] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-10-17T20:02:42.416944] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T20:02:43.132078] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T20:02:43.158040] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-17T20:02:43.236735] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-17T20:02:43.958095] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-17T20:02:44.695027] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T20:02:44.758066] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-17T20:02:45.424892] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T20:02:45.558039] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-17T20:02:46.356568] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T20:02:46.365345] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-17T20:02:46.931754] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T20:02:47.158030] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-17T20:02:47.958000] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-17T20:02:48.217895] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T20:02:48.413887] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T20:02:48.758113] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-17T20:02:49.294133] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T20:02:49.299280] [INFO ] [REMOTE ] MANU: Full fetch complete (39115 records). [2025-10-17T20:02:49.299475] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-17T20:02:49.568238] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-17T20:02:49.741989] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-17T20:02:49.742089] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-17T20:02:49.742939] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-17T20:02:49.743003] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-17T20:02:49.744143] [DEBUG] [LOCAL ] MANU: Trimmed 39115 records to 27565 (keeping 200 days of data) [2025-10-17T20:02:49.904113] [DEBUG] [LOCAL ] MANU: Primary data saved (27565 records). [2025-10-17T20:02:49.904266] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-17T20:02:49.904353] [INFO ] [MAIN ] Update Progress: 1301/2368 symbols completed. MANU took 29.2s. Estimated remaining: 2h 29m 54s. Rate: 7.1 symbols/min [2025-10-17T20:02:50.079071] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:02:50.112250] [DEBUG] [LOCAL ] MATX: Loaded 32188 existing records from primary storage. [2025-10-17T20:02:50.112878] [INFO ] [MAIN ] MATX: Loaded 32188 existing records. [2025-10-17T20:02:50.305255] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:02:50.305628] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-17T20:02:50.305730] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-17T20:02:50.306695] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-17T20:02:50.306762] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-17T20:02:50.364093] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-17T20:02:50.620861] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-17T20:02:50.648067] [INFO ] [REMOTE ] MAN: Full fetch complete (62690 records). [2025-10-17T20:02:50.668097] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-17T20:02:50.778765] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:02:51.098707] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-17T20:02:51.098842] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-17T20:02:51.099997] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-17T20:02:51.100075] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-17T20:02:51.101683] [DEBUG] [LOCAL ] MAN: Trimmed 62690 records to 44786 (keeping 200 days of data) [2025-10-17T20:02:51.161139] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-10-17T20:02:51.372198] [DEBUG] [LOCAL ] MAN: Primary data saved (44786 records). [2025-10-17T20:02:51.372348] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-17T20:02:51.372437] [INFO ] [MAIN ] Update Progress: 1302/2368 symbols completed. MAN took 32.6s. Estimated remaining: 2h 29m 39s. Rate: 7.1 symbols/min [2025-10-17T20:02:51.553932] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:02:51.584798] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-17T20:02:51.617988] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-17T20:02:51.648101] [DEBUG] [LOCAL ] MAX: Loaded 31247 existing records from primary storage. [2025-10-17T20:02:51.648392] [INFO ] [MAIN ] MAX: Loaded 31247 existing records. [2025-10-17T20:02:51.823704] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:02:51.823975] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-17T20:02:51.824024] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-17T20:02:51.824202] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-17T20:02:51.824241] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-17T20:02:51.963283] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-17T20:02:52.187053] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:02:52.200466] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T20:02:52.758049] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-17T20:02:53.558079] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-10-17T20:02:53.878402] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-17T20:02:54.362077] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-17T20:02:54.367864] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T20:02:54.908504] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T20:02:55.158237] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-17T20:02:55.522154] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T20:02:55.958107] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-17T20:02:56.467562] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-17T20:02:56.758104] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-17T20:02:57.210567] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-17T20:02:57.558043] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-17T20:02:58.053375] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T20:02:58.358061] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-17T20:02:58.869577] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T20:02:59.158062] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-17T20:02:59.958054] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-17T20:03:00.187260] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T20:03:00.738299] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T20:03:00.758047] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-17T20:03:01.202621] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T20:03:01.558069] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-17T20:03:02.358089] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-17T20:03:02.409229] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T20:03:03.158074] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-17T20:03:03.222981] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T20:03:03.842128] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T20:03:03.958071] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-17T20:03:04.658845] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T20:03:04.758036] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-17T20:03:05.279491] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T20:03:05.558036] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-17T20:03:06.358027] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-17T20:03:06.586450] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T20:03:06.939229] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T20:03:07.158026] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-17T20:03:07.866831] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T20:03:07.958055] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-17T20:03:08.603296] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T20:03:08.758126] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-17T20:03:08.933205] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-17T20:03:09.558030] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-17T20:03:09.845241] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T20:03:10.358095] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-17T20:03:11.041182] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T20:03:11.158087] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-17T20:03:11.682249] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-17T20:03:11.958080] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-17T20:03:12.081583] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T20:03:12.758134] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-17T20:03:13.344111] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T20:03:13.558072] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-17T20:03:14.045058] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T20:03:14.049607] [INFO ] [REMOTE ] MATV: Full fetch complete (52328 records). [2025-10-17T20:03:14.049804] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-17T20:03:14.363137] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-17T20:03:14.444588] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-17T20:03:14.444853] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-17T20:03:14.445802] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-17T20:03:14.445885] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-17T20:03:14.447048] [DEBUG] [LOCAL ] MATV: Trimmed 52328 records to 36069 (keeping 200 days of data) [2025-10-17T20:03:14.660106] [DEBUG] [LOCAL ] MATV: Primary data saved (36069 records). [2025-10-17T20:03:14.660238] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-17T20:03:14.660920] [INFO ] [MAIN ] Update Progress: 1303/2368 symbols completed. MATV took 35.2s. Estimated remaining: 2h 29m 43s. Rate: 7.1 symbols/min [2025-10-17T20:03:14.849264] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:03:14.846092] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T20:03:14.907893] [DEBUG] [LOCAL ] MBC: Loaded 44249 existing records from primary storage. [2025-10-17T20:03:14.908175] [INFO ] [MAIN ] MBC: Loaded 44249 existing records. [2025-10-17T20:03:15.083626] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:03:15.083844] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-17T20:03:15.083892] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-17T20:03:15.084075] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-17T20:03:15.084114] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-17T20:03:15.163173] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-17T20:03:15.444734] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:03:15.958049] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-17T20:03:16.328184] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-17T20:03:16.335564] [INFO ] [REMOTE ] MAS: Full fetch complete (75281 records). [2025-10-17T20:03:16.335759] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-17T20:03:16.638467] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T20:03:16.760360] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-17T20:03:16.759972] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-17T20:03:16.760495] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-17T20:03:16.761671] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-17T20:03:16.762488] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-17T20:03:16.764512] [DEBUG] [LOCAL ] MAS: Trimmed 75281 records to 53044 (keeping 200 days of data) [2025-10-17T20:03:17.093474] [DEBUG] [LOCAL ] MAS: Primary data saved (53044 records). [2025-10-17T20:03:17.093612] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-17T20:03:17.094212] [INFO ] [MAIN ] Update Progress: 1304/2368 symbols completed. MAS took 45.2s. Estimated remaining: 2h 29m 30s. Rate: 7.1 symbols/min [2025-10-17T20:03:17.268628] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:03:17.294216] [DEBUG] [LOCAL ] MBI: Loaded 24511 existing records from primary storage. [2025-10-17T20:03:17.294469] [INFO ] [MAIN ] MBI: Loaded 24511 existing records. [2025-10-17T20:03:17.431171] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T20:03:17.471948] [INFO ] [REMOTE ] MATX: Full fetch complete (43832 records). [2025-10-17T20:03:17.481699] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-17T20:03:17.566355] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-10-17T20:03:17.533434] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:03:17.580640] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-17T20:03:17.586174] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-17T20:03:17.610167] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-17T20:03:17.610329] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-17T20:03:18.273003] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-17T20:03:18.281507] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-17T20:03:18.298180] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-17T20:03:18.313627] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-17T20:03:18.296822] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:03:18.318386] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T20:03:18.326317] [DEBUG] [LOCAL ] MATX: Trimmed 43832 records to 32418 (keeping 200 days of data) [2025-10-17T20:03:18.385255] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-10-17T20:03:18.545122] [DEBUG] [LOCAL ] MATX: Primary data saved (32418 records). [2025-10-17T20:03:18.545280] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-17T20:03:18.546094] [INFO ] [MAIN ] Update Progress: 1305/2368 symbols completed. MATX took 28.6s. Estimated remaining: 2h 29m 16s. Rate: 7.1 symbols/min [2025-10-17T20:03:18.735712] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:03:18.784301] [DEBUG] [LOCAL ] MC: Loaded 44275 existing records from primary storage. [2025-10-17T20:03:18.784604] [INFO ] [MAIN ] MC: Loaded 44275 existing records. [2025-10-17T20:03:18.972897] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:03:18.973350] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-17T20:03:18.973413] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-17T20:03:18.973587] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-17T20:03:18.973628] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-17T20:03:19.161261] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-17T20:03:19.366483] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T20:03:19.407378] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:03:19.653833] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T20:03:19.958028] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-10-17T20:03:20.659595] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T20:03:20.758011] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-17T20:03:21.164943] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-17T20:03:21.558017] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-17T20:03:21.926762] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-17T20:03:22.358033] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-17T20:03:22.970481] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T20:03:22.975733] [INFO ] [REMOTE ] MAX: Full fetch complete (45454 records). [2025-10-17T20:03:22.975845] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-17T20:03:23.167296] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-17T20:03:23.388038] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-17T20:03:23.388118] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-17T20:03:23.388917] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-17T20:03:23.388978] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-17T20:03:23.389924] [DEBUG] [LOCAL ] MAX: Trimmed 45454 records to 31450 (keeping 200 days of data) [2025-10-17T20:03:23.487081] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T20:03:23.586095] [DEBUG] [LOCAL ] MAX: Primary data saved (31450 records). [2025-10-17T20:03:23.586227] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-17T20:03:23.586308] [INFO ] [MAIN ] Update Progress: 1306/2368 symbols completed. MAX took 32.2s. Estimated remaining: 2h 29m 5s. Rate: 7.1 symbols/min [2025-10-17T20:03:23.755614] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:03:23.768053] [DEBUG] [LOCAL ] MCB: Loaded 11454 existing records from primary storage. [2025-10-17T20:03:23.768243] [INFO ] [MAIN ] MCB: Loaded 11454 existing records. [2025-10-17T20:03:23.947887] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:03:23.948130] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-17T20:03:23.948196] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-17T20:03:23.948419] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-17T20:03:23.948479] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-17T20:03:23.963164] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-17T20:03:24.304164] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:03:24.723902] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T20:03:24.758024] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-10-17T20:03:25.239285] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T20:03:25.515560] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-17T20:03:25.558015] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-17T20:03:26.358096] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-17T20:03:26.968773] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T20:03:27.158018] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-17T20:03:27.267204] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T20:03:27.958087] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-17T20:03:28.708943] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T20:03:28.758048] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-17T20:03:28.870080] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-17T20:03:29.558045] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-17T20:03:29.883004] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T20:03:30.284972] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-17T20:03:30.358053] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-17T20:03:31.158057] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-17T20:03:31.464055] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T20:03:31.958091] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-17T20:03:32.705728] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T20:03:32.732482] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T20:03:32.758000] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-17T20:03:33.558021] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-17T20:03:34.259158] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T20:03:34.358021] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-17T20:03:35.116989] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T20:03:35.158012] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-17T20:03:35.427147] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T20:03:35.958071] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-17T20:03:36.763114] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-17T20:03:36.766988] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T20:03:36.998410] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T20:03:37.558067] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-17T20:03:38.293879] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T20:03:38.358036] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-17T20:03:39.127326] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T20:03:39.158035] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-17T20:03:39.798735] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T20:03:39.957989] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-17T20:03:40.226488] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T20:03:40.758060] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-17T20:03:41.431913] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T20:03:41.558026] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-17T20:03:41.888919] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T20:03:42.358023] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-17T20:03:43.158043] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-17T20:03:43.196295] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T20:03:43.893581] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T20:03:43.957994] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-17T20:03:44.339221] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T20:03:44.343046] [INFO ] [REMOTE ] MBI: Full fetch complete (36322 records). [2025-10-17T20:03:44.343186] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-17T20:03:44.720376] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-17T20:03:44.720475] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-17T20:03:44.721392] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-17T20:03:44.721462] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-17T20:03:44.722499] [DEBUG] [LOCAL ] MBI: Trimmed 36322 records to 24689 (keeping 200 days of data) [2025-10-17T20:03:44.767061] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-17T20:03:44.864060] [DEBUG] [LOCAL ] MBI: Primary data saved (24689 records). [2025-10-17T20:03:44.864200] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-17T20:03:44.864283] [INFO ] [MAIN ] Update Progress: 1307/2368 symbols completed. MBI took 27.8s. Estimated remaining: 2h 29m 7s. Rate: 7.1 symbols/min [2025-10-17T20:03:45.035908] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:03:45.036083] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-17T20:03:45.036120] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-17T20:03:45.036237] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-17T20:03:45.036279] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-17T20:03:45.036319] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-17T20:03:45.036353] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-17T20:03:45.419885] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:03:45.472898] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T20:03:45.558034] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-17T20:03:46.358035] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-10-17T20:03:46.485863] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T20:03:47.094978] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T20:03:47.158007] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-17T20:03:47.958037] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-17T20:03:48.477719] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-17T20:03:48.607459] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T20:03:48.613258] [INFO ] [REMOTE ] MC: Full fetch complete (63031 records). [2025-10-17T20:03:48.613374] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-17T20:03:48.765589] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-17T20:03:49.007988] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-17T20:03:49.008104] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-17T20:03:49.009096] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-17T20:03:49.009162] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-17T20:03:49.010559] [DEBUG] [LOCAL ] MC: Trimmed 63031 records to 44544 (keeping 200 days of data) [2025-10-17T20:03:49.282041] [DEBUG] [LOCAL ] MC: Primary data saved (44544 records). [2025-10-17T20:03:49.282193] [INFO ] [MAIN ] MC: Full history saved. [2025-10-17T20:03:49.282397] [INFO ] [MAIN ] Update Progress: 1308/2368 symbols completed. MC took 30.7s. Estimated remaining: 2h 28m 55s. Rate: 7.1 symbols/min [2025-10-17T20:03:49.464330] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:03:49.473342] [DEBUG] [LOCAL ] MCI: Loaded 6436 existing records from primary storage. [2025-10-17T20:03:49.473579] [INFO ] [MAIN ] MCI: Loaded 6436 existing records. [2025-10-17T20:03:49.563224] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-17T20:03:49.669753] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:03:49.670288] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-17T20:03:49.670484] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-17T20:03:49.687525] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-17T20:03:49.687955] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-17T20:03:49.721737] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T20:03:49.800274] [INFO ] [REMOTE ] MBC: Full fetch complete (63170 records). [2025-10-17T20:03:49.803664] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-17T20:03:50.392917] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:03:50.409793] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-10-17T20:03:50.494985] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-17T20:03:50.495152] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-17T20:03:50.496466] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-17T20:03:50.496535] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-17T20:03:50.498061] [DEBUG] [LOCAL ] MBC: Trimmed 63170 records to 44551 (keeping 200 days of data) [2025-10-17T20:03:50.756808] [DEBUG] [LOCAL ] MBC: Primary data saved (44551 records). [2025-10-17T20:03:50.756946] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-17T20:03:50.757920] [INFO ] [MAIN ] Update Progress: 1309/2368 symbols completed. MBC took 36.1s. Estimated remaining: 2h 28m 41s. Rate: 7.1 symbols/min [2025-10-17T20:03:50.864586] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T20:03:50.952137] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:03:50.989758] [DEBUG] [LOCAL ] MCK: Loaded 38825 existing records from primary storage. [2025-10-17T20:03:50.990162] [INFO ] [MAIN ] MCK: Loaded 38825 existing records. [2025-10-17T20:03:51.171475] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:03:51.165287] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-17T20:03:51.172159] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-17T20:03:51.173439] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-17T20:03:51.173767] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-17T20:03:51.173887] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-17T20:03:51.283565] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-17T20:03:51.351241] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-17T20:03:51.583956] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:03:51.958075] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-10-17T20:03:52.374869] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-17T20:03:52.758038] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-17T20:03:53.251401] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-17T20:03:53.558047] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-17T20:03:53.574146] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T20:03:54.336088] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T20:03:54.358001] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-17T20:03:55.158098] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-17T20:03:55.181728] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-17T20:03:55.958100] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-17T20:03:55.966826] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T20:03:56.702809] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-17T20:03:56.758013] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-17T20:03:57.558012] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-17T20:03:57.687268] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T20:03:58.159564] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-17T20:03:58.358022] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-17T20:03:59.158032] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-17T20:03:59.744602] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-17T20:03:59.810460] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T20:03:59.958029] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-17T20:04:00.758039] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-17T20:04:01.558041] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-17T20:04:01.773881] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T20:04:02.037566] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-17T20:04:02.358040] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-17T20:04:03.072967] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-17T20:04:03.163085] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-17T20:04:03.177140] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T20:04:03.958042] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-17T20:04:04.591910] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-17T20:04:04.758057] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-17T20:04:05.120158] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-17T20:04:05.558049] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-17T20:04:06.358143] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-17T20:04:06.483570] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T20:04:07.148324] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T20:04:07.157989] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-17T20:04:07.594740] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T20:04:07.958049] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-17T20:04:08.128792] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-17T20:04:08.130805] [INFO ] [REMOTE ] MCB: Full fetch complete (16616 records). [2025-10-17T20:04:08.130900] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-17T20:04:08.508974] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-17T20:04:08.509058] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-17T20:04:08.509401] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-17T20:04:08.509440] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-17T20:04:08.510018] [DEBUG] [LOCAL ] MCB: Trimmed 16616 records to 11549 (keeping 200 days of data) [2025-10-17T20:04:08.583638] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-17T20:04:08.591861] [DEBUG] [LOCAL ] MCB: Primary data saved (11549 records). [2025-10-17T20:04:08.591960] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-17T20:04:08.592064] [INFO ] [MAIN ] Update Progress: 1310/2368 symbols completed. MCB took 45.0s. Estimated remaining: 2h 28m 40s. Rate: 7.1 symbols/min [2025-10-17T20:04:08.756982] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:04:08.757984] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-17T20:04:08.767973] [DEBUG] [LOCAL ] MCN: Loaded 8214 existing records from primary storage. [2025-10-17T20:04:08.768189] [INFO ] [MAIN ] MCN: Loaded 8214 existing records. [2025-10-17T20:04:08.942179] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:04:08.942385] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-17T20:04:08.942443] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-17T20:04:08.942613] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-17T20:04:08.942714] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-17T20:04:09.292700] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:04:09.473147] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-17T20:04:09.558040] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-10-17T20:04:10.344020] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-17T20:04:10.358046] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-17T20:04:11.081101] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T20:04:11.082730] [INFO ] [REMOTE ] MCI: Full fetch complete (9891 records). [2025-10-17T20:04:11.082815] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-17T20:04:11.163147] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-17T20:04:11.447570] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-17T20:04:11.447689] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-17T20:04:11.448035] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-17T20:04:11.448097] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-17T20:04:11.448626] [DEBUG] [LOCAL ] MCI: Trimmed 9891 records to 6457 (keeping 200 days of data) [2025-10-17T20:04:11.489365] [DEBUG] [LOCAL ] MCI: Primary data saved (6457 records). [2025-10-17T20:04:11.489532] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-17T20:04:11.489681] [INFO ] [MAIN ] Update Progress: 1311/2368 symbols completed. MCI took 22.2s. Estimated remaining: 2h 28m 27s. Rate: 7.1 symbols/min [2025-10-17T20:04:11.656903] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:04:11.699702] [DEBUG] [LOCAL ] MCO: Loaded 39795 existing records from primary storage. [2025-10-17T20:04:11.700048] [INFO ] [MAIN ] MCO: Loaded 39795 existing records. [2025-10-17T20:04:11.887209] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:04:11.887482] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-17T20:04:11.887542] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-17T20:04:11.887774] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-17T20:04:11.887872] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-17T20:04:11.963246] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-17T20:04:12.270255] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:04:12.758050] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-10-17T20:04:13.558089] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-17T20:04:13.685531] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-17T20:04:13.755184] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T20:04:13.828532] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T20:04:14.275865] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T20:04:14.358084] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-17T20:04:15.158078] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-17T20:04:15.965071] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-17T20:04:15.990092] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T20:04:16.629979] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-17T20:04:16.653216] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T20:04:16.757996] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-17T20:04:17.558039] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-17T20:04:18.363182] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-17T20:04:18.381273] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T20:04:19.095451] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-17T20:04:19.158001] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-17T20:04:19.364807] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T20:04:19.924280] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-17T20:04:19.957988] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-17T20:04:20.712631] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T20:04:20.758045] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-17T20:04:21.495341] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-17T20:04:21.558035] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-17T20:04:22.358044] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-17T20:04:23.053035] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T20:04:23.085219] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-17T20:04:23.158032] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-17T20:04:23.815801] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T20:04:23.958032] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-17T20:04:24.662230] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-17T20:04:24.758016] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-17T20:04:25.475926] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T20:04:25.477479] [INFO ] [REMOTE ] MCN: Full fetch complete (11625 records). [2025-10-17T20:04:25.477551] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-17T20:04:25.563237] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-17T20:04:25.839998] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-17T20:04:25.840079] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-17T20:04:25.840391] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-17T20:04:25.840430] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-17T20:04:25.840930] [DEBUG] [LOCAL ] MCN: Trimmed 11625 records to 8247 (keeping 200 days of data) [2025-10-17T20:04:25.891288] [DEBUG] [LOCAL ] MCN: Primary data saved (8247 records). [2025-10-17T20:04:25.891469] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-17T20:04:25.891574] [INFO ] [MAIN ] Update Progress: 1312/2368 symbols completed. MCN took 17.3s. Estimated remaining: 2h 28m 24s. Rate: 7.1 symbols/min [2025-10-17T20:04:26.057491] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:04:26.067882] [DEBUG] [LOCAL ] MCR: Loaded 8958 existing records from primary storage. [2025-10-17T20:04:26.068096] [INFO ] [MAIN ] MCR: Loaded 8958 existing records. [2025-10-17T20:04:26.242071] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:04:26.242306] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-17T20:04:26.242353] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-17T20:04:26.242495] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-17T20:04:26.242534] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-17T20:04:26.363186] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-17T20:04:26.614757] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:04:27.158050] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-10-17T20:04:27.835093] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-17T20:04:27.855575] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-17T20:04:27.958032] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-17T20:04:28.127715] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T20:04:28.758049] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-17T20:04:29.558047] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-17T20:04:30.007325] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-17T20:04:30.254837] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T20:04:30.357993] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-17T20:04:31.158001] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-17T20:04:31.366583] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T20:04:31.998714] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-17T20:04:32.017446] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T20:04:32.758030] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-17T20:04:32.882868] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-17T20:04:33.355827] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-17T20:04:33.558042] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-17T20:04:34.366170] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-17T20:04:34.385742] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T20:04:35.158048] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-17T20:04:35.179335] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T20:04:35.744437] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-17T20:04:35.751887] [INFO ] [REMOTE ] MCD: Full fetch complete (77142 records). [2025-10-17T20:04:35.752012] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-17T20:04:35.947977] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T20:04:35.948753] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:04:35.948827] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:04:35.948901] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-17T20:04:35.948979] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-17T20:04:35.949034] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-17T20:04:35.949077] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-17T20:04:35.949136] [INFO ] [MAIN ] Update Progress: 1313/2368 symbols completed. MCD took 51.1s. Estimated remaining: 2h 28m 16s. Rate: 7.1 symbols/min [2025-10-17T20:04:35.963320] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-17T20:04:36.121495] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:04:36.142583] [DEBUG] [LOCAL ] MCS: Loaded 21302 existing records from primary storage. [2025-10-17T20:04:36.142906] [INFO ] [MAIN ] MCS: Loaded 21302 existing records. [2025-10-17T20:04:36.315884] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:04:36.316111] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-17T20:04:36.316159] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-17T20:04:36.316324] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-17T20:04:36.316362] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-17T20:04:36.662568] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T20:04:36.693216] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:04:36.698085] [INFO ] [REMOTE ] MCK: Full fetch complete (56786 records). [2025-10-17T20:04:36.698173] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-17T20:04:36.763671] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-17T20:04:37.104689] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-17T20:04:37.104812] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-17T20:04:37.106326] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-17T20:04:37.106399] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-17T20:04:37.108170] [DEBUG] [LOCAL ] MCK: Trimmed 56786 records to 39064 (keeping 200 days of data) [2025-10-17T20:04:37.340907] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T20:04:37.419107] [DEBUG] [LOCAL ] MCK: Primary data saved (39064 records). [2025-10-17T20:04:37.419344] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-17T20:04:37.420297] [INFO ] [MAIN ] Update Progress: 1314/2368 symbols completed. MCK took 46.7s. Estimated remaining: 2h 28m 2s. Rate: 7.1 symbols/min [2025-10-17T20:04:37.570414] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-10-17T20:04:37.611966] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:04:37.621324] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T20:04:37.651041] [DEBUG] [LOCAL ] MCY: Loaded 24134 existing records from primary storage. [2025-10-17T20:04:37.651436] [INFO ] [MAIN ] MCY: Loaded 24134 existing records. [2025-10-17T20:04:37.834262] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:04:37.834612] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-17T20:04:37.834698] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-17T20:04:37.834953] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-17T20:04:37.834994] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-17T20:04:38.195208] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:04:38.358004] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-10-17T20:04:38.823799] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T20:04:39.158148] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-17T20:04:39.595899] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T20:04:39.958014] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-17T20:04:40.595518] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T20:04:40.758041] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-17T20:04:41.197668] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T20:04:41.558054] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-17T20:04:42.358024] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-17T20:04:42.402008] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T20:04:42.437496] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-17T20:04:43.158070] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-17T20:04:43.863143] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T20:04:43.958051] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-17T20:04:44.126866] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T20:04:44.758035] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-17T20:04:44.925225] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T20:04:45.558055] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-17T20:04:46.094127] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T20:04:46.358003] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-17T20:04:46.539886] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T20:04:47.082796] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T20:04:47.158005] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-17T20:04:47.958061] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-17T20:04:48.435067] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T20:04:48.758000] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-17T20:04:49.137237] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-17T20:04:49.200752] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T20:04:49.558041] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-17T20:04:50.358072] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-17T20:04:50.779814] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-17T20:04:51.158057] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-17T20:04:51.431406] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T20:04:51.958064] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-17T20:04:52.713452] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T20:04:52.758004] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-17T20:04:52.779023] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T20:04:53.452040] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-17T20:04:53.557980] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-17T20:04:54.358008] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-17T20:04:55.158012] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-17T20:04:55.345881] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T20:04:55.352218] [INFO ] [REMOTE ] MCO: Full fetch complete (57932 records). [2025-10-17T20:04:55.352344] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-17T20:04:55.745276] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T20:04:55.770353] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-17T20:04:55.770446] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-17T20:04:55.771610] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-17T20:04:55.771701] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-17T20:04:55.772919] [DEBUG] [LOCAL ] MCO: Trimmed 57932 records to 40089 (keeping 200 days of data) [2025-10-17T20:04:55.877081] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-17T20:04:55.961774] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-17T20:04:56.035393] [DEBUG] [LOCAL ] MCO: Primary data saved (40089 records). [2025-10-17T20:04:56.035529] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-17T20:04:56.036309] [INFO ] [MAIN ] Update Progress: 1315/2368 symbols completed. MCO took 44.5s. Estimated remaining: 2h 28m 2s. Rate: 7.1 symbols/min [2025-10-17T20:04:56.200696] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:04:56.239200] [DEBUG] [LOCAL ] MD: Loaded 38831 existing records from primary storage. [2025-10-17T20:04:56.239488] [INFO ] [MAIN ] MD: Loaded 38831 existing records. [2025-10-17T20:04:56.418781] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:04:56.419040] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-17T20:04:56.419091] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-17T20:04:56.419273] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-17T20:04:56.419314] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-17T20:04:56.696844] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-17T20:04:56.761443] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-17T20:04:56.790584] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:04:57.558010] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-17T20:04:57.906383] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-17T20:04:58.358053] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-10-17T20:04:58.631952] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-17T20:04:59.158069] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-17T20:04:59.724223] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T20:04:59.958037] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-17T20:05:00.068490] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-17T20:05:00.070578] [INFO ] [REMOTE ] MCR: Full fetch complete (13784 records). [2025-10-17T20:05:00.070696] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-17T20:05:00.462482] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-17T20:05:00.462561] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-17T20:05:00.462921] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-17T20:05:00.462985] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-17T20:05:00.463466] [DEBUG] [LOCAL ] MCR: Trimmed 13784 records to 9061 (keeping 200 days of data) [2025-10-17T20:05:00.518662] [DEBUG] [LOCAL ] MCR: Primary data saved (9061 records). [2025-10-17T20:05:00.518839] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-17T20:05:00.518982] [INFO ] [MAIN ] Update Progress: 1316/2368 symbols completed. MCR took 34.6s. Estimated remaining: 2h 27m 51s. Rate: 7.1 symbols/min [2025-10-17T20:05:00.689014] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:05:00.697289] [DEBUG] [LOCAL ] MDST: Loaded 6060 existing records from primary storage. [2025-10-17T20:05:00.697547] [INFO ] [MAIN ] MDST: Loaded 6060 existing records. [2025-10-17T20:05:00.763233] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-17T20:05:00.872943] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:05:00.873156] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-17T20:05:00.873202] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-17T20:05:00.873367] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-17T20:05:00.873425] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-17T20:05:01.223874] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:05:01.362369] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T20:05:01.558029] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-10-17T20:05:02.358040] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-17T20:05:02.645604] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T20:05:03.158055] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-17T20:05:03.232295] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T20:05:03.958053] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-17T20:05:04.270633] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-17T20:05:04.375372] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T20:05:04.758060] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-17T20:05:04.816695] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T20:05:04.820955] [INFO ] [REMOTE ] MCY: Full fetch complete (41040 records). [2025-10-17T20:05:04.821190] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-17T20:05:05.227603] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-17T20:05:05.227827] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-17T20:05:05.229211] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-17T20:05:05.229282] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-17T20:05:05.230839] [DEBUG] [LOCAL ] MCY: Trimmed 41040 records to 24248 (keeping 200 days of data) [2025-10-17T20:05:05.391599] [DEBUG] [LOCAL ] MCY: Primary data saved (24248 records). [2025-10-17T20:05:05.391849] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-17T20:05:05.391968] [INFO ] [MAIN ] Update Progress: 1317/2368 symbols completed. MCY took 28.0s. Estimated remaining: 2h 27m 39s. Rate: 7.1 symbols/min [2025-10-17T20:05:05.558039] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-17T20:05:06.158034] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T20:05:06.182562] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T20:05:06.358015] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-17T20:05:07.158029] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-17T20:05:07.857111] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T20:05:07.958001] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-17T20:05:08.298635] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T20:05:08.758049] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-17T20:05:09.421137] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T20:05:09.557991] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-17T20:05:09.908464] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T20:05:10.358065] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-17T20:05:10.884981] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T20:05:11.109774] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-17T20:05:11.157989] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-17T20:05:11.958002] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-17T20:05:12.317953] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T20:05:12.321610] [INFO ] [REMOTE ] MCS: Full fetch complete (30705 records). [2025-10-17T20:05:12.321746] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-17T20:05:12.683206] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-17T20:05:12.683282] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-17T20:05:12.683902] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-17T20:05:12.683962] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-17T20:05:12.684639] [DEBUG] [LOCAL ] MCS: Trimmed 30705 records to 21467 (keeping 200 days of data) [2025-10-17T20:05:12.769685] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-17T20:05:12.813708] [DEBUG] [LOCAL ] MCS: Primary data saved (21467 records). [2025-10-17T20:05:12.813825] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-17T20:05:12.813903] [INFO ] [MAIN ] Update Progress: 1318/2368 symbols completed. MCS took 36.9s. Estimated remaining: 2h 27m 30s. Rate: 7.1 symbols/min [2025-10-17T20:05:13.348087] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T20:05:13.362947] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T20:05:13.558020] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-17T20:05:14.358066] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-17T20:05:14.977834] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-17T20:05:15.115693] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T20:05:15.157976] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-17T20:05:15.958113] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-17T20:05:16.539018] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T20:05:16.660223] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T20:05:16.758005] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-17T20:05:17.558033] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-17T20:05:18.120879] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-17T20:05:18.163784] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-17T20:05:18.169209] [INFO ] [REMOTE ] MD: Full fetch complete (55172 records). [2025-10-17T20:05:18.169305] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-17T20:05:18.385414] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-17T20:05:18.544413] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-17T20:05:18.544490] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-17T20:05:18.545367] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-17T20:05:18.545429] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-17T20:05:18.546499] [DEBUG] [LOCAL ] MD: Trimmed 55172 records to 39102 (keeping 200 days of data) [2025-10-17T20:05:18.773963] [DEBUG] [LOCAL ] MD: Primary data saved (39102 records). [2025-10-17T20:05:18.774124] [INFO ] [MAIN ] MD: Full history saved. [2025-10-17T20:05:18.774220] [INFO ] [MAIN ] Update Progress: 1319/2368 symbols completed. MD took 22.7s. Estimated remaining: 2h 27m 20s. Rate: 7.1 symbols/min [2025-10-17T20:05:19.012779] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-17T20:05:19.158067] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-17T20:05:19.780301] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-17T20:05:19.958087] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-17T20:05:20.543861] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-17T20:05:20.758053] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-17T20:05:21.520954] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T20:05:21.557989] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-17T20:05:22.443024] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T20:05:22.444777] [INFO ] [REMOTE ] MDST: Full fetch complete (8810 records). [2025-10-17T20:05:22.444848] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-17T20:05:22.818095] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-17T20:05:22.818176] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-17T20:05:22.818418] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-17T20:05:22.818491] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-17T20:05:22.818956] [DEBUG] [LOCAL ] MDST: Trimmed 8810 records to 6124 (keeping 200 days of data) [2025-10-17T20:05:22.855636] [DEBUG] [LOCAL ] MDST: Primary data saved (6124 records). [2025-10-17T20:05:22.855786] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-17T20:05:22.855865] [INFO ] [MAIN ] Update Progress: 1320/2368 symbols completed. MDST took 22.3s. Estimated remaining: 2h 27m 8s. Rate: 7.1 symbols/min [2025-10-17T20:05:23.435305] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:05:23.466343] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:05:23.587413] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:05:23.615327] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:05:23.624823] [DEBUG] [LOCAL ] MDV: Loaded 8490 existing records from primary storage. [2025-10-17T20:05:23.625221] [INFO ] [MAIN ] MDV: Loaded 8490 existing records. [2025-10-17T20:05:23.748455] [DEBUG] [LOCAL ] MEC: Loaded 16519 existing records from primary storage. [2025-10-17T20:05:23.765034] [INFO ] [MAIN ] MEC: Loaded 16519 existing records. [2025-10-17T20:05:23.942627] [DEBUG] [LOCAL ] MDU: Loaded 48446 existing records from primary storage. [2025-10-17T20:05:23.941282] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:05:23.953472] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-17T20:05:23.953635] [INFO ] [MAIN ] MDU: Loaded 48446 existing records. [2025-10-17T20:05:23.953759] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-17T20:05:24.023681] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-17T20:05:24.054635] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-17T20:05:24.170185] [DEBUG] [LOCAL ] MDT: Loaded 54068 existing records from primary storage. [2025-10-17T20:05:24.237331] [INFO ] [MAIN ] MDT: Loaded 54068 existing records. [2025-10-17T20:05:24.300793] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:05:24.453518] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:05:24.475051] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-17T20:05:24.519158] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-17T20:05:24.495963] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-17T20:05:24.542677] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-17T20:05:24.551457] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-17T20:05:24.562525] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-17T20:05:24.562623] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-17T20:05:24.592231] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-17T20:05:24.961941] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:05:25.014534] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-17T20:05:25.068541] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-17T20:05:25.248459] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-17T20:05:25.248816] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-17T20:05:25.282379] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:05:25.383514] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-10-17T20:05:25.761982] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:05:25.767491] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-10-17T20:05:25.906214] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:05:25.911908] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-10-17T20:05:26.015223] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:05:26.015548] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-10-17T20:05:26.371469] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T20:05:26.373399] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-17T20:05:26.880464] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T20:05:26.884354] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-17T20:05:26.889619] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-17T20:05:27.158039] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-17T20:05:27.674915] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T20:05:27.756488] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T20:05:27.857515] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-17T20:05:27.904502] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T20:05:27.957988] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-17T20:05:28.758082] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-17T20:05:29.516469] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-17T20:05:29.558028] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-17T20:05:29.830717] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T20:05:30.358033] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-17T20:05:30.372884] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T20:05:31.101850] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-17T20:05:31.158014] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-17T20:05:31.958017] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-17T20:05:32.180495] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T20:05:32.758040] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-17T20:05:33.558017] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-17T20:05:33.651980] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T20:05:33.769802] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T20:05:34.358049] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-17T20:05:35.154007] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T20:05:35.163183] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-17T20:05:35.390371] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T20:05:35.958033] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-17T20:05:36.758036] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-17T20:05:36.910989] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T20:05:37.164924] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-17T20:05:37.558040] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-17T20:05:37.585874] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-17T20:05:38.358028] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-17T20:05:39.158032] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-17T20:05:39.385943] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T20:05:39.421677] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T20:05:39.958042] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-17T20:05:40.509248] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T20:05:40.758010] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-17T20:05:40.971739] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T20:05:41.558026] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-17T20:05:42.358028] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-17T20:05:42.733353] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-17T20:05:42.808239] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T20:05:43.148855] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-17T20:05:43.157972] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-17T20:05:43.900986] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T20:05:43.957978] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-17T20:05:44.684153] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-17T20:05:44.758033] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-17T20:05:45.558010] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-17T20:05:45.715846] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-17T20:05:46.234809] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-17T20:05:46.358029] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-17T20:05:47.157999] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-17T20:05:47.314503] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T20:05:47.317077] [INFO ] [REMOTE ] MEC: Full fetch complete (22766 records). [2025-10-17T20:05:47.317152] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-17T20:05:47.735187] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-17T20:05:47.735279] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-17T20:05:47.735852] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-17T20:05:47.735938] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-17T20:05:47.736715] [DEBUG] [LOCAL ] MEC: Trimmed 22766 records to 16672 (keeping 200 days of data) [2025-10-17T20:05:47.850902] [DEBUG] [LOCAL ] MEC: Primary data saved (16672 records). [2025-10-17T20:05:47.851061] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-17T20:05:47.851164] [INFO ] [MAIN ] Update Progress: 1321/2368 symbols completed. MEC took 25.0s. Estimated remaining: 2h 27m 12s. Rate: 7.1 symbols/min [2025-10-17T20:05:47.963148] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-17T20:05:48.038169] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:05:48.035298] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-17T20:05:48.039996] [INFO ] [REMOTE ] MDV: Full fetch complete (11692 records). [2025-10-17T20:05:48.040071] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-17T20:05:48.219217] [DEBUG] [LOCAL ] MED: Loaded 21369 existing records from primary storage. [2025-10-17T20:05:48.299537] [INFO ] [MAIN ] MED: Loaded 21369 existing records. [2025-10-17T20:05:48.605224] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-17T20:05:48.605000] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:05:48.605347] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-17T20:05:48.605698] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-17T20:05:48.605932] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-17T20:05:48.605776] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-17T20:05:48.606037] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-17T20:05:48.606467] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-17T20:05:48.606890] [DEBUG] [LOCAL ] MDV: Trimmed 11692 records to 8524 (keeping 200 days of data) [2025-10-17T20:05:48.606799] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-17T20:05:48.759590] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-17T20:05:48.923414] [DEBUG] [LOCAL ] MDV: Primary data saved (8524 records). [2025-10-17T20:05:48.934275] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-17T20:05:48.934387] [INFO ] [MAIN ] Update Progress: 1322/2368 symbols completed. MDV took 26.1s. Estimated remaining: 2h 26m 58s. Rate: 7.1 symbols/min [2025-10-17T20:05:49.169915] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:05:49.200971] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:05:49.235154] [DEBUG] [LOCAL ] MEG: Loaded 31847 existing records from primary storage. [2025-10-17T20:05:49.235431] [INFO ] [MAIN ] MEG: Loaded 31847 existing records. [2025-10-17T20:05:49.411554] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:05:49.411883] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-17T20:05:49.411958] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-17T20:05:49.412320] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-17T20:05:49.412435] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-17T20:05:49.560730] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-10-17T20:05:49.789998] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T20:05:49.861822] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:05:50.358051] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-10-17T20:05:50.572398] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T20:05:50.812868] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T20:05:51.158084] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-17T20:05:51.865640] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T20:05:51.958044] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-17T20:05:52.758019] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-17T20:05:52.840909] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T20:05:53.382937] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T20:05:53.542619] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T20:05:53.557994] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-17T20:05:54.358043] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-17T20:05:54.647312] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T20:05:55.158083] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-17T20:05:55.958034] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-17T20:05:56.280418] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T20:05:56.449171] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T20:05:56.712228] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-17T20:05:56.758040] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-17T20:05:57.558029] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-17T20:05:58.358020] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-17T20:05:58.612528] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T20:05:58.751343] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-17T20:05:59.158074] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-17T20:05:59.729358] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-17T20:05:59.738052] [INFO ] [REMOTE ] MDT: Full fetch complete (77857 records). [2025-10-17T20:05:59.738241] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-17T20:05:59.958481] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-17T20:06:00.173735] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T20:06:00.202243] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-17T20:06:00.202677] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-17T20:06:00.204004] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-17T20:06:00.204124] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-17T20:06:00.205776] [DEBUG] [LOCAL ] MDT: Trimmed 77857 records to 54458 (keeping 200 days of data) [2025-10-17T20:06:00.546275] [DEBUG] [LOCAL ] MDT: Primary data saved (54458 records). [2025-10-17T20:06:00.546451] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-17T20:06:00.547203] [INFO ] [MAIN ] Update Progress: 1323/2368 symbols completed. MDT took 37.7s. Estimated remaining: 2h 26m 52s. Rate: 7.1 symbols/min [2025-10-17T20:06:00.713213] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:06:00.733768] [DEBUG] [LOCAL ] MEGI: Loaded 19957 existing records from primary storage. [2025-10-17T20:06:00.734019] [INFO ] [MAIN ] MEGI: Loaded 19957 existing records. [2025-10-17T20:06:00.763432] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-17T20:06:00.921180] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:06:00.921449] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-17T20:06:00.921521] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-17T20:06:00.921861] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-17T20:06:00.921949] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-17T20:06:01.290111] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:06:01.298472] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T20:06:01.558013] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-17T20:06:02.249901] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T20:06:02.357981] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-17T20:06:02.615161] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T20:06:03.158082] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-17T20:06:03.925895] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T20:06:03.957988] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-17T20:06:04.315488] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-17T20:06:04.757999] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-17T20:06:05.349078] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-17T20:06:05.558025] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-17T20:06:06.358023] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-10-17T20:06:06.409162] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T20:06:06.591406] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-17T20:06:07.158054] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-17T20:06:07.776083] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T20:06:07.958042] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-17T20:06:08.758018] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-17T20:06:08.892276] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T20:06:09.025490] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T20:06:09.558024] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-17T20:06:09.830940] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T20:06:10.358035] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-17T20:06:10.769943] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T20:06:10.772764] [INFO ] [REMOTE ] MED: Full fetch complete (31941 records). [2025-10-17T20:06:10.772886] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-17T20:06:11.157584] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-17T20:06:11.157696] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-17T20:06:11.158384] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-17T20:06:11.158479] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-17T20:06:11.158611] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-17T20:06:11.160493] [DEBUG] [LOCAL ] MED: Trimmed 31941 records to 21503 (keeping 200 days of data) [2025-10-17T20:06:11.282711] [DEBUG] [LOCAL ] MED: Primary data saved (21503 records). [2025-10-17T20:06:11.282832] [INFO ] [MAIN ] MED: Full history saved. [2025-10-17T20:06:11.282910] [INFO ] [MAIN ] Update Progress: 1324/2368 symbols completed. MED took 23.4s. Estimated remaining: 2h 26m 46s. Rate: 7.1 symbols/min [2025-10-17T20:06:11.446893] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:06:11.477554] [DEBUG] [LOCAL ] MEI: Loaded 31898 existing records from primary storage. [2025-10-17T20:06:11.477852] [INFO ] [MAIN ] MEI: Loaded 31898 existing records. [2025-10-17T20:06:11.662238] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:06:11.662507] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-17T20:06:11.662625] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-17T20:06:11.663093] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-17T20:06:11.663163] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-17T20:06:11.961831] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-17T20:06:12.025763] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:06:12.057167] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T20:06:12.193704] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T20:06:12.758031] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-10-17T20:06:13.484246] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T20:06:13.558037] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-17T20:06:14.111668] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T20:06:14.357995] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-17T20:06:14.756227] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-17T20:06:15.158038] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-17T20:06:15.724730] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T20:06:15.958008] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-17T20:06:16.193510] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T20:06:16.758021] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-17T20:06:17.568608] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-17T20:06:17.571042] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T20:06:18.358055] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-17T20:06:18.584248] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-17T20:06:18.591710] [INFO ] [REMOTE ] MDU: Full fetch complete (70629 records). [2025-10-17T20:06:18.591900] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-17T20:06:18.976753] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T20:06:19.028444] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-17T20:06:19.028536] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-17T20:06:19.029674] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-17T20:06:19.029742] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-17T20:06:19.031184] [DEBUG] [LOCAL ] MDU: Trimmed 70629 records to 48794 (keeping 200 days of data) [2025-10-17T20:06:19.203218] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-17T20:06:19.334760] [DEBUG] [LOCAL ] MDU: Primary data saved (48794 records). [2025-10-17T20:06:19.335019] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-17T20:06:19.335173] [INFO ] [MAIN ] Update Progress: 1325/2368 symbols completed. MDU took 56.5s. Estimated remaining: 2h 26m 37s. Rate: 7.1 symbols/min [2025-10-17T20:06:19.431595] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T20:06:19.532786] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:06:19.582160] [DEBUG] [LOCAL ] MET: Loaded 53706 existing records from primary storage. [2025-10-17T20:06:19.582487] [INFO ] [MAIN ] MET: Loaded 53706 existing records. [2025-10-17T20:06:19.761884] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:06:19.762131] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-17T20:06:19.762179] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-17T20:06:19.762360] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-17T20:06:19.762398] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-17T20:06:19.963166] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-17T20:06:20.129809] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:06:20.422969] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T20:06:20.758050] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-17T20:06:21.055217] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T20:06:21.558037] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-17T20:06:22.170484] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T20:06:22.358069] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-17T20:06:22.480957] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T20:06:23.158043] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-10-17T20:06:23.787053] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T20:06:23.958030] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-17T20:06:24.758063] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-17T20:06:24.886893] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T20:06:25.317253] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T20:06:25.322865] [INFO ] [REMOTE ] MEG: Full fetch complete (47489 records). [2025-10-17T20:06:25.323052] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-17T20:06:25.568737] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-17T20:06:25.749529] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-17T20:06:25.749685] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-17T20:06:25.751286] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-17T20:06:25.751358] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-17T20:06:25.752928] [DEBUG] [LOCAL ] MEG: Trimmed 47489 records to 32094 (keeping 200 days of data) [2025-10-17T20:06:25.886567] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T20:06:25.987014] [DEBUG] [LOCAL ] MEG: Primary data saved (32094 records). [2025-10-17T20:06:25.987172] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-17T20:06:25.987261] [INFO ] [MAIN ] Update Progress: 1326/2368 symbols completed. MEG took 37.0s. Estimated remaining: 2h 26m 27s. Rate: 7.1 symbols/min [2025-10-17T20:06:26.155247] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:06:26.197766] [DEBUG] [LOCAL ] MFA: Loaded 46093 existing records from primary storage. [2025-10-17T20:06:26.198112] [INFO ] [MAIN ] MFA: Loaded 46093 existing records. [2025-10-17T20:06:26.376439] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-17T20:06:26.382826] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:06:26.384202] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-17T20:06:26.384259] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-17T20:06:26.384443] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-17T20:06:26.384530] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-17T20:06:26.767201] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:06:26.782973] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-17T20:06:27.158073] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-17T20:06:27.704960] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-17T20:06:27.958096] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-17T20:06:28.653416] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T20:06:28.758001] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-17T20:06:29.097107] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T20:06:29.558052] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-17T20:06:30.155424] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T20:06:30.358032] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-17T20:06:30.951959] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T20:06:31.158086] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-10-17T20:06:31.958004] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-17T20:06:32.235348] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T20:06:32.758012] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-17T20:06:32.791040] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T20:06:33.306224] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-17T20:06:33.558034] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-17T20:06:33.920161] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T20:06:34.358083] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-17T20:06:34.875573] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-17T20:06:35.158052] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-17T20:06:35.369537] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T20:06:35.958023] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-17T20:06:36.248757] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-17T20:06:36.253218] [INFO ] [REMOTE ] MEI: Full fetch complete (45429 records). [2025-10-17T20:06:36.253382] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-17T20:06:36.623486] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-17T20:06:36.623570] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-17T20:06:36.624431] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-17T20:06:36.624497] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-17T20:06:36.625441] [DEBUG] [LOCAL ] MEI: Trimmed 45429 records to 32083 (keeping 200 days of data) [2025-10-17T20:06:36.763544] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-17T20:06:36.804539] [DEBUG] [LOCAL ] MEI: Primary data saved (32083 records). [2025-10-17T20:06:36.804699] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-17T20:06:36.804795] [INFO ] [MAIN ] Update Progress: 1327/2368 symbols completed. MEI took 25.5s. Estimated remaining: 2h 26m 21s. Rate: 7.1 symbols/min [2025-10-17T20:06:36.969905] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:06:36.976459] [DEBUG] [LOCAL ] MFAN: Loaded 4392 existing records from primary storage. [2025-10-17T20:06:36.976621] [INFO ] [MAIN ] MFAN: Loaded 4392 existing records. [2025-10-17T20:06:37.151075] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:06:37.151286] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-17T20:06:37.151333] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-17T20:06:37.152139] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-17T20:06:37.152196] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-17T20:06:37.501152] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:06:37.557983] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-10-17T20:06:37.582405] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T20:06:37.841165] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T20:06:37.843994] [INFO ] [REMOTE ] MEGI: Full fetch complete (29320 records). [2025-10-17T20:06:37.844069] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-17T20:06:37.947445] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-17T20:06:38.214938] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-17T20:06:38.215014] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-17T20:06:38.215576] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-17T20:06:38.215615] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-17T20:06:38.216307] [DEBUG] [LOCAL ] MEGI: Trimmed 29320 records to 20099 (keeping 200 days of data) [2025-10-17T20:06:38.333208] [DEBUG] [LOCAL ] MEGI: Primary data saved (20099 records). [2025-10-17T20:06:38.333328] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-17T20:06:38.333402] [INFO ] [MAIN ] Update Progress: 1328/2368 symbols completed. MEGI took 37.8s. Estimated remaining: 2h 26m 7s. Rate: 7.1 symbols/min [2025-10-17T20:06:38.363198] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-17T20:06:38.499998] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:06:38.506066] [DEBUG] [LOCAL ] MFAO: Loaded 3992 existing records from primary storage. [2025-10-17T20:06:38.506208] [INFO ] [MAIN ] MFAO: Loaded 3992 existing records. [2025-10-17T20:06:38.681668] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:06:38.681907] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-17T20:06:38.681954] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-17T20:06:38.682106] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-17T20:06:38.682162] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-17T20:06:39.020225] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:06:39.158007] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-10-17T20:06:39.958072] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-17T20:06:39.993338] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-17T20:06:40.020459] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T20:06:40.279194] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-17T20:06:40.758024] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-17T20:06:41.558034] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-17T20:06:42.021160] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-17T20:06:42.357994] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-17T20:06:42.387866] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T20:06:42.918963] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T20:06:43.158026] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-17T20:06:43.687422] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-17T20:06:43.958024] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-17T20:06:44.608488] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-17T20:06:44.758029] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-17T20:06:45.189157] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-17T20:06:45.558037] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-17T20:06:46.358047] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-17T20:06:47.012083] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-17T20:06:47.158085] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-17T20:06:47.262271] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T20:06:47.729749] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-17T20:06:47.958042] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-17T20:06:48.758043] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-17T20:06:49.312300] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-17T20:06:49.558060] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-17T20:06:49.774996] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T20:06:50.157097] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-17T20:06:50.358128] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-17T20:06:51.158100] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-17T20:06:51.958012] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-17T20:06:52.201395] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T20:06:52.540076] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-17T20:06:52.761523] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-17T20:06:52.768665] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T20:06:53.331156] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T20:06:53.558034] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-17T20:06:54.358050] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-17T20:06:54.895636] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-17T20:06:55.125210] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T20:06:55.158006] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-17T20:06:55.681590] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-17T20:06:55.958053] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-17T20:06:56.520504] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-17T20:06:56.758039] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-17T20:06:57.360993] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T20:06:57.362511] [INFO ] [REMOTE ] MFAN: Full fetch complete (5900 records). [2025-10-17T20:06:57.362590] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-17T20:06:57.563293] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-17T20:06:57.752758] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-17T20:06:57.752843] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-17T20:06:57.753026] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-17T20:06:57.753066] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-17T20:06:57.753434] [DEBUG] [LOCAL ] MFAN: Trimmed 5900 records to 4421 (keeping 200 days of data) [2025-10-17T20:06:57.779160] [DEBUG] [LOCAL ] MFAN: Primary data saved (4421 records). [2025-10-17T20:06:57.779245] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-17T20:06:57.779321] [INFO ] [MAIN ] Update Progress: 1329/2368 symbols completed. MFAN took 21.0s. Estimated remaining: 2h 26m 7s. Rate: 7.1 symbols/min [2025-10-17T20:06:57.942223] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:06:57.990339] [DEBUG] [LOCAL ] MFC: Loaded 51434 existing records from primary storage. [2025-10-17T20:06:57.990690] [INFO ] [MAIN ] MFC: Loaded 51434 existing records. [2025-10-17T20:06:58.160616] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:06:58.160845] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-17T20:06:58.160891] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-17T20:06:58.161096] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-17T20:06:58.161150] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-17T20:06:58.363366] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-17T20:06:58.506834] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:06:59.158074] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-10-17T20:06:59.364923] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T20:06:59.958040] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-17T20:07:00.758069] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-17T20:07:00.882182] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-17T20:07:01.087229] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-17T20:07:01.515390] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T20:07:01.558052] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-17T20:07:02.358093] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-17T20:07:02.418686] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-17T20:07:03.158044] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-17T20:07:03.677631] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-17T20:07:03.958006] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-17T20:07:04.246520] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-17T20:07:04.558572] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T20:07:04.559685] [INFO ] [REMOTE ] MFAO: Full fetch complete (5467 records). [2025-10-17T20:07:04.559755] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-17T20:07:04.763229] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-17T20:07:04.907987] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-17T20:07:04.908053] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-17T20:07:04.908206] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-17T20:07:04.908253] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-17T20:07:04.908608] [DEBUG] [LOCAL ] MFAO: Trimmed 5467 records to 4021 (keeping 200 days of data) [2025-10-17T20:07:04.931906] [DEBUG] [LOCAL ] MFAO: Primary data saved (4021 records). [2025-10-17T20:07:04.931967] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-17T20:07:04.932048] [INFO ] [MAIN ] Update Progress: 1330/2368 symbols completed. MFAO took 26.6s. Estimated remaining: 2h 25m 57s. Rate: 7.1 symbols/min [2025-10-17T20:07:05.094768] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:07:05.136629] [DEBUG] [LOCAL ] MFG: Loaded 49867 existing records from primary storage. [2025-10-17T20:07:05.136971] [INFO ] [MAIN ] MFG: Loaded 49867 existing records. [2025-10-17T20:07:05.349101] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:07:05.349322] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-17T20:07:05.349368] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-17T20:07:05.349536] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-17T20:07:05.349573] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-17T20:07:05.582283] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-17T20:07:05.695592] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:07:06.358056] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-10-17T20:07:07.244404] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T20:07:07.254059] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-17T20:07:09.481517] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-17T20:07:09.492450] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-17T20:07:11.220892] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T20:07:11.235343] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-17T20:07:12.956817] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T20:07:12.967884] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-17T20:07:14.625757] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T20:07:14.635979] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-17T20:07:16.308638] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T20:07:16.320160] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-17T20:07:18.106829] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T20:07:18.117890] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-17T20:07:19.794667] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T20:07:19.805618] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-17T20:07:21.553687] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T20:07:21.560626] [INFO ] [REMOTE ] MFC: Full fetch complete (74416 records). [2025-10-17T20:07:21.560772] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-17T20:07:21.950843] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-17T20:07:21.950929] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-17T20:07:21.951946] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-17T20:07:21.952008] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-17T20:07:21.953366] [DEBUG] [LOCAL ] MFC: Trimmed 74416 records to 51852 (keeping 200 days of data) [2025-10-17T20:07:22.261761] [DEBUG] [LOCAL ] MFC: Primary data saved (51852 records). [2025-10-17T20:07:22.261893] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-17T20:07:22.261974] [INFO ] [MAIN ] Update Progress: 1331/2368 symbols completed. MFC took 24.5s. Estimated remaining: 2h 25m 56s. Rate: 7.1 symbols/min [2025-10-17T20:07:22.431929] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:07:22.447385] [DEBUG] [LOCAL ] MFM: Loaded 14665 existing records from primary storage. [2025-10-17T20:07:22.447620] [INFO ] [MAIN ] MFM: Loaded 14665 existing records. [2025-10-17T20:07:22.621769] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:07:22.621963] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-17T20:07:22.622008] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-17T20:07:22.622200] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-17T20:07:22.622256] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-17T20:07:22.968449] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:07:22.968839] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-10-17T20:07:23.827318] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-17T20:07:23.830296] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-17T20:07:24.553318] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T20:07:24.555463] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-17T20:07:25.052705] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-17T20:07:25.055773] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-17T20:07:25.844215] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T20:07:25.847722] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-17T20:07:27.071148] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T20:07:27.076460] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-17T20:07:27.925620] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-17T20:07:27.928961] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-17T20:07:32.779100] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (34.42 seconds). [2025-10-17T20:07:32.790571] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-17T20:07:36.099327] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (31.34 seconds). [2025-10-17T20:07:36.111539] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-17T20:07:37.569811] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (31.21 seconds). [2025-10-17T20:07:37.578734] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-17T20:07:37.811237] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T20:07:37.824310] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-17T20:07:37.901490] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (9.97 seconds). [2025-10-17T20:07:37.906721] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-17T20:07:38.702465] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-17T20:07:38.711583] [INFO ] [REMOTE ] MET: Full fetch complete (77363 records). [2025-10-17T20:07:38.711883] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-17T20:07:38.862814] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (6.07 seconds). [2025-10-17T20:07:38.925746] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-17T20:07:39.145314] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T20:07:39.190996] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-17T20:07:39.250088] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-17T20:07:39.277985] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-17T20:07:39.279399] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-17T20:07:39.279489] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-17T20:07:39.282131] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T20:07:39.292575] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-17T20:07:39.293846] [DEBUG] [LOCAL ] MET: Trimmed 77363 records to 54096 (keeping 200 days of data) [2025-10-17T20:07:39.616503] [DEBUG] [LOCAL ] MET: Primary data saved (54096 records). [2025-10-17T20:07:39.616684] [INFO ] [MAIN ] MET: Full history saved. [2025-10-17T20:07:39.616779] [INFO ] [MAIN ] Update Progress: 1332/2368 symbols completed. MET took 1m 20s. Estimated remaining: 2h 25m 54s. Rate: 7.1 symbols/min [2025-10-17T20:07:39.781173] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:07:39.781332] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-17T20:07:39.781368] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-17T20:07:39.781478] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-17T20:07:39.781519] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-17T20:07:39.781559] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-17T20:07:39.781591] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-17T20:07:40.058635] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T20:07:40.082477] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-17T20:07:40.140980] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:07:40.141316] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-10-17T20:07:40.569701] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-17T20:07:40.570675] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-17T20:07:40.645310] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T20:07:40.655359] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-17T20:07:40.823053] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-17T20:07:40.824069] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-17T20:07:40.924255] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T20:07:40.932984] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-17T20:07:41.111830] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-17T20:07:41.112839] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-17T20:07:41.293559] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-17T20:07:41.296976] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-17T20:07:41.441763] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-17T20:07:41.442891] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-17T20:07:41.829705] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-17T20:07:41.830554] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-17T20:07:42.073578] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-17T20:07:42.074445] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-17T20:07:42.242242] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T20:07:42.245085] [INFO ] [REMOTE ] MFM: Full fetch complete (19349 records). [2025-10-17T20:07:42.245280] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-17T20:07:42.424461] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-17T20:07:42.459994] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-17T20:07:42.481079] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-17T20:07:42.550322] [INFO ] [REMOTE ] MFA: Full fetch complete (65385 records). [2025-10-17T20:07:42.560885] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-17T20:07:42.845042] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T20:07:42.867609] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-17T20:07:42.894326] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-17T20:07:42.900033] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-17T20:07:42.920234] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-17T20:07:42.920399] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-17T20:07:42.930670] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-17T20:07:42.921554] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-17T20:07:43.008162] [DEBUG] [LOCAL ] MFM: Trimmed 19349 records to 14700 (keeping 200 days of data) [2025-10-17T20:07:43.170146] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-17T20:07:43.170787] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-17T20:07:43.171563] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-17T20:07:43.172674] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-17T20:07:43.181823] [DEBUG] [LOCAL ] MFA: Trimmed 65385 records to 46378 (keeping 200 days of data) [2025-10-17T20:07:43.237946] [DEBUG] [LOCAL ] MFM: Primary data saved (14700 records). [2025-10-17T20:07:43.246870] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-17T20:07:43.273725] [INFO ] [MAIN ] Update Progress: 1333/2368 symbols completed. MFM took 21.0s. Estimated remaining: 2h 25m 42s. Rate: 7.1 symbols/min [2025-10-17T20:07:43.460354] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:07:43.482896] [DEBUG] [LOCAL ] MFSG: Loaded 5852 existing records from primary storage. [2025-10-17T20:07:43.483850] [INFO ] [MAIN ] MFSG: Loaded 5852 existing records. [2025-10-17T20:07:43.545497] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-17T20:07:43.555558] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-17T20:07:43.778622] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:07:43.782994] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-17T20:07:43.783308] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-17T20:07:43.783930] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-17T20:07:43.785109] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-17T20:07:44.183606] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-17T20:07:44.204537] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-17T20:07:44.212380] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:07:44.213735] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-10-17T20:07:44.237502] [DEBUG] [LOCAL ] MFA: Primary data saved (46378 records). [2025-10-17T20:07:44.237627] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-17T20:07:44.237764] [INFO ] [MAIN ] Update Progress: 1334/2368 symbols completed. MFA took 1m 18s. Estimated remaining: 2h 25m 28s. Rate: 7.1 symbols/min [2025-10-17T20:07:44.420811] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:07:44.436408] [DEBUG] [LOCAL ] MFSI: Loaded 12301 existing records from primary storage. [2025-10-17T20:07:44.436745] [INFO ] [MAIN ] MFSI: Loaded 12301 existing records. [2025-10-17T20:07:44.621334] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-17T20:07:44.627060] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:07:44.627699] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-17T20:07:44.627998] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-17T20:07:44.629150] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-17T20:07:44.630137] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-17T20:07:44.630273] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-17T20:07:44.896153] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T20:07:44.984785] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-17T20:07:44.984998] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T20:07:45.015602] [INFO ] [REMOTE ] MFSB: Full fetch complete (1953 records). [2025-10-17T20:07:45.053687] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-17T20:07:45.063603] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:07:45.075921] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-10-17T20:07:45.168469] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-17T20:07:45.169734] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-17T20:07:45.253861] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-17T20:07:45.254095] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:07:45.254168] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:07:45.254244] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-17T20:07:45.254309] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-17T20:07:45.254347] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-17T20:07:45.254385] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-17T20:07:45.254457] [INFO ] [MAIN ] Update Progress: 1335/2368 symbols completed. MFSB took 5.6s. Estimated remaining: 2h 25m 14s. Rate: 7.1 symbols/min [2025-10-17T20:07:45.418994] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:07:45.424406] [DEBUG] [LOCAL ] MFSV: Loaded 2875 existing records from primary storage. [2025-10-17T20:07:45.424593] [INFO ] [MAIN ] MFSV: Loaded 2875 existing records. [2025-10-17T20:07:45.554909] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-17T20:07:45.609388] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-17T20:07:45.610876] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-17T20:07:45.616907] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:07:45.619444] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-17T20:07:45.621509] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-17T20:07:45.621726] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-17T20:07:45.621877] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-17T20:07:45.622051] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-17T20:07:45.986617] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:07:45.986916] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-17T20:07:45.988908] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-17T20:07:45.989281] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-10-17T20:07:46.245860] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-17T20:07:46.247901] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-17T20:07:46.265674] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-17T20:07:46.358055] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-17T20:07:46.687840] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-17T20:07:46.709763] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T20:07:46.712784] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T20:07:46.796718] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-17T20:07:47.158038] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-17T20:07:47.785561] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T20:07:47.958119] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-17T20:07:48.639073] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-17T20:07:48.758096] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-17T20:07:49.169575] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-17T20:07:49.558023] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-17T20:07:49.982835] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-17T20:07:50.358032] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-17T20:07:50.948582] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-17T20:07:51.158036] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-17T20:07:51.907266] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T20:07:51.957988] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-17T20:07:52.671832] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-17T20:07:52.758006] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-17T20:07:53.409937] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-17T20:07:53.558001] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-17T20:07:54.262764] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-17T20:07:54.358096] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-17T20:07:55.158043] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-17T20:07:55.869146] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T20:07:55.871166] [INFO ] [REMOTE ] MFSG: Full fetch complete (6663 records). [2025-10-17T20:07:55.871241] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-17T20:07:55.963225] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-17T20:07:56.263833] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-17T20:07:56.264034] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-17T20:07:56.272972] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-17T20:07:56.273375] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-17T20:07:56.273452] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-17T20:07:56.274332] [DEBUG] [LOCAL ] MFSG: Trimmed 6663 records to 5881 (keeping 200 days of data) [2025-10-17T20:07:56.308071] [DEBUG] [LOCAL ] MFSG: Primary data saved (5881 records). [2025-10-17T20:07:56.308142] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-17T20:07:56.308216] [INFO ] [MAIN ] Update Progress: 1336/2368 symbols completed. MFSG took 13.0s. Estimated remaining: 2h 25m 7s. Rate: 7.1 symbols/min [2025-10-17T20:07:56.471891] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:07:56.488057] [DEBUG] [LOCAL ] MG: Loaded 15959 existing records from primary storage. [2025-10-17T20:07:56.488262] [INFO ] [MAIN ] MG: Loaded 15959 existing records. [2025-10-17T20:07:56.669469] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:07:56.669795] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-17T20:07:56.669860] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-17T20:07:56.670032] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-17T20:07:56.670090] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-17T20:07:56.758677] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-17T20:07:56.782129] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T20:07:57.034279] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:07:57.232876] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-17T20:07:57.558089] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-17T20:07:58.358096] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-17T20:07:58.761076] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-17T20:07:59.158041] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-10-17T20:07:59.204908] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T20:07:59.958017] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-17T20:08:00.157521] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T20:08:00.736581] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-17T20:08:00.758013] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-17T20:08:01.558033] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-17T20:08:01.683738] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T20:08:02.358046] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-17T20:08:02.547064] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T20:08:03.158038] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-17T20:08:03.958043] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-17T20:08:04.165895] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-17T20:08:04.167506] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T20:08:04.645932] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-17T20:08:04.758039] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-17T20:08:05.558057] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-17T20:08:05.692255] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T20:08:06.358061] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-17T20:08:07.157991] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-17T20:08:07.213867] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T20:08:07.395092] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T20:08:07.958069] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-17T20:08:08.177222] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T20:08:08.179915] [INFO ] [REMOTE ] MFSI: Full fetch complete (14704 records). [2025-10-17T20:08:08.179987] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-17T20:08:08.532878] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-17T20:08:08.532950] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-17T20:08:08.533252] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-17T20:08:08.533290] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-17T20:08:08.533800] [DEBUG] [LOCAL ] MFSI: Trimmed 14704 records to 12436 (keeping 200 days of data) [2025-10-17T20:08:08.607061] [DEBUG] [LOCAL ] MFSI: Primary data saved (12436 records). [2025-10-17T20:08:08.607179] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-17T20:08:08.607256] [INFO ] [MAIN ] Update Progress: 1337/2368 symbols completed. MFSI took 24.4s. Estimated remaining: 2h 25m 2s. Rate: 7.1 symbols/min [2025-10-17T20:08:08.776794] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-17T20:08:08.779328] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:08:08.829239] [DEBUG] [LOCAL ] MGA: Loaded 50889 existing records from primary storage. [2025-10-17T20:08:08.829557] [INFO ] [MAIN ] MGA: Loaded 50889 existing records. [2025-10-17T20:08:09.007786] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:08:09.019817] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-17T20:08:09.020419] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-17T20:08:09.020886] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T20:08:09.025214] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-17T20:08:09.025821] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-17T20:08:09.372620] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:08:09.558023] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-10-17T20:08:10.268817] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T20:08:10.275884] [INFO ] [REMOTE ] MFG: Full fetch complete (69654 records). [2025-10-17T20:08:10.276051] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-17T20:08:10.365532] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-17T20:08:10.667801] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-17T20:08:10.668128] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-17T20:08:10.669167] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-17T20:08:10.669230] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-17T20:08:10.670566] [DEBUG] [LOCAL ] MFG: Trimmed 69654 records to 50230 (keeping 200 days of data) [2025-10-17T20:08:10.968841] [DEBUG] [LOCAL ] MFG: Primary data saved (50230 records). [2025-10-17T20:08:10.968957] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-17T20:08:10.969898] [INFO ] [MAIN ] Update Progress: 1338/2368 symbols completed. MFG took 1m 6s. Estimated remaining: 2h 24m 49s. Rate: 7.1 symbols/min [2025-10-17T20:08:11.142122] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:08:11.150093] [DEBUG] [LOCAL ] MGF: Loaded 4176 existing records from primary storage. [2025-10-17T20:08:11.150310] [INFO ] [MAIN ] MGF: Loaded 4176 existing records. [2025-10-17T20:08:11.179091] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-17T20:08:11.337604] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:08:11.338120] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-17T20:08:11.338344] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-17T20:08:11.348424] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-17T20:08:11.364716] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-17T20:08:11.433398] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T20:08:11.519831] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T20:08:11.786309] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:08:11.873860] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-17T20:08:11.958023] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-10-17T20:08:12.584918] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-17T20:08:12.758059] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-17T20:08:13.185112] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-17T20:08:13.558034] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-17T20:08:14.114444] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T20:08:14.358063] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-17T20:08:15.158002] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-17T20:08:15.320506] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T20:08:15.557727] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-17T20:08:15.958021] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-17T20:08:16.758034] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-17T20:08:17.558023] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-17T20:08:17.808545] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T20:08:17.814132] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T20:08:18.358004] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-17T20:08:18.459216] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-17T20:08:18.921772] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T20:08:19.158036] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-17T20:08:19.789554] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T20:08:19.958052] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-17T20:08:20.580238] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T20:08:20.758015] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-17T20:08:21.333354] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T20:08:21.558051] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-17T20:08:22.134030] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-17T20:08:22.358041] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-17T20:08:23.158079] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-17T20:08:23.463694] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T20:08:23.532271] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-17T20:08:23.958050] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-17T20:08:24.298301] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-17T20:08:24.758059] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-17T20:08:25.350960] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T20:08:25.352130] [INFO ] [REMOTE ] MGF: Full fetch complete (5776 records). [2025-10-17T20:08:25.352235] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-17T20:08:25.563239] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-17T20:08:25.708198] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-17T20:08:25.708291] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-17T20:08:25.708484] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-17T20:08:25.708523] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-17T20:08:25.708932] [DEBUG] [LOCAL ] MGF: Trimmed 5776 records to 4196 (keeping 200 days of data) [2025-10-17T20:08:25.733271] [DEBUG] [LOCAL ] MGF: Primary data saved (4196 records). [2025-10-17T20:08:25.733361] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-17T20:08:25.733442] [INFO ] [MAIN ] Update Progress: 1339/2368 symbols completed. MGF took 14.8s. Estimated remaining: 2h 24m 45s. Rate: 7.1 symbols/min [2025-10-17T20:08:25.898495] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:08:25.947304] [DEBUG] [LOCAL ] MGM: Loaded 53997 existing records from primary storage. [2025-10-17T20:08:25.947689] [INFO ] [MAIN ] MGM: Loaded 53997 existing records. [2025-10-17T20:08:26.126694] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:08:26.126901] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-17T20:08:26.126999] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-17T20:08:26.127231] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-17T20:08:26.127296] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-17T20:08:26.363445] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-17T20:08:26.488892] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:08:26.489133] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T20:08:26.491266] [INFO ] [REMOTE ] MFSV: Full fetch complete (3569 records). [2025-10-17T20:08:26.491361] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-17T20:08:26.876908] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-17T20:08:26.877016] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-17T20:08:26.877206] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-17T20:08:26.877249] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-17T20:08:26.877787] [DEBUG] [LOCAL ] MFSV: Trimmed 3569 records to 2916 (keeping 200 days of data) [2025-10-17T20:08:26.898307] [DEBUG] [LOCAL ] MFSV: Primary data saved (2916 records). [2025-10-17T20:08:26.898465] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-17T20:08:26.898563] [INFO ] [MAIN ] Update Progress: 1340/2368 symbols completed. MFSV took 41.6s. Estimated remaining: 2h 24m 31s. Rate: 7.1 symbols/min [2025-10-17T20:08:27.089978] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:08:27.100437] [DEBUG] [LOCAL ] MGR: Loaded 5641 existing records from primary storage. [2025-10-17T20:08:27.100748] [INFO ] [MAIN ] MGR: Loaded 5641 existing records. [2025-10-17T20:08:27.165137] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-10-17T20:08:27.300693] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:08:27.300983] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-17T20:08:27.301035] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-17T20:08:27.301234] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-17T20:08:27.301314] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-17T20:08:27.670173] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:08:27.958078] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-10-17T20:08:28.111982] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T20:08:28.758055] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-17T20:08:28.773995] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-17T20:08:29.118200] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-17T20:08:29.558037] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-17T20:08:29.660144] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T20:08:30.358078] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-17T20:08:31.158084] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-17T20:08:31.393047] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T20:08:31.439388] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T20:08:31.581473] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-17T20:08:31.958101] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-17T20:08:32.670586] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-17T20:08:32.758066] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-17T20:08:33.360566] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-17T20:08:33.558038] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-17T20:08:34.358035] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-17T20:08:35.158059] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-17T20:08:35.366363] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T20:08:35.409730] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T20:08:35.412087] [INFO ] [REMOTE ] MG: Full fetch complete (23467 records). [2025-10-17T20:08:35.412183] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-17T20:08:35.782447] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-17T20:08:35.782523] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-17T20:08:35.783011] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-17T20:08:35.783072] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-17T20:08:35.783729] [DEBUG] [LOCAL ] MG: Trimmed 23467 records to 16048 (keeping 200 days of data) [2025-10-17T20:08:35.881237] [DEBUG] [LOCAL ] MG: Primary data saved (16048 records). [2025-10-17T20:08:35.881426] [INFO ] [MAIN ] MG: Full history saved. [2025-10-17T20:08:35.881619] [INFO ] [MAIN ] Update Progress: 1341/2368 symbols completed. MG took 39.6s. Estimated remaining: 2h 24m 23s. Rate: 7.1 symbols/min [2025-10-17T20:08:35.967405] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-17T20:08:36.068687] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:08:36.075664] [DEBUG] [LOCAL ] MGRB: Loaded 4045 existing records from primary storage. [2025-10-17T20:08:36.075856] [INFO ] [MAIN ] MGRB: Loaded 4045 existing records. [2025-10-17T20:08:36.251934] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:08:36.252162] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-17T20:08:36.252209] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-17T20:08:36.252365] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-17T20:08:36.252419] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-17T20:08:36.622587] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:08:36.758037] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-10-17T20:08:36.823456] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T20:08:37.515190] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-17T20:08:37.557989] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-17T20:08:37.840672] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-17T20:08:38.118725] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T20:08:38.358052] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-17T20:08:39.007299] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-17T20:08:39.158062] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-17T20:08:39.794081] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-17T20:08:39.958030] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-17T20:08:40.486814] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-17T20:08:40.758029] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-17T20:08:41.237425] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-17T20:08:41.558029] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-17T20:08:42.358096] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-17T20:08:43.158027] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-17T20:08:43.526503] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T20:08:43.553158] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-17T20:08:43.629205] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T20:08:43.958026] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-17T20:08:44.680765] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-17T20:08:44.758008] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-17T20:08:45.418298] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T20:08:45.558016] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-17T20:08:46.169238] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T20:08:46.358032] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-17T20:08:46.959454] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-17T20:08:47.158089] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-17T20:08:47.958094] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-17T20:08:48.642833] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-17T20:08:48.758037] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-17T20:08:48.909482] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T20:08:49.316428] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-17T20:08:49.558061] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-17T20:08:50.358043] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-17T20:08:50.973336] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-17T20:08:51.158000] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-17T20:08:51.477242] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T20:08:51.711898] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-17T20:08:51.958050] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-17T20:08:52.415398] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-17T20:08:52.758052] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-17T20:08:53.470869] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T20:08:53.472244] [INFO ] [REMOTE ] MGR: Full fetch complete (7913 records). [2025-10-17T20:08:53.472329] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-17T20:08:53.566560] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-17T20:08:53.844298] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-17T20:08:53.844410] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-17T20:08:53.844668] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-17T20:08:53.844732] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-17T20:08:53.845395] [DEBUG] [LOCAL ] MGR: Trimmed 7913 records to 5666 (keeping 200 days of data) [2025-10-17T20:08:53.890174] [DEBUG] [LOCAL ] MGR: Primary data saved (5666 records). [2025-10-17T20:08:53.890332] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-17T20:08:53.890425] [INFO ] [MAIN ] Update Progress: 1342/2368 symbols completed. MGR took 27.0s. Estimated remaining: 2h 24m 22s. Rate: 7.1 symbols/min [2025-10-17T20:08:54.080138] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:08:54.084988] [DEBUG] [LOCAL ] MGRD: Loaded 2246 existing records from primary storage. [2025-10-17T20:08:54.085156] [INFO ] [MAIN ] MGRD: Loaded 2246 existing records. [2025-10-17T20:08:54.257038] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:08:54.257237] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-17T20:08:54.257316] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-17T20:08:54.257535] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-17T20:08:54.257615] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-17T20:08:54.363178] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-17T20:08:54.615796] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:08:54.966246] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T20:08:54.967227] [INFO ] [REMOTE ] MGRB: Full fetch complete (5612 records). [2025-10-17T20:08:54.967298] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-17T20:08:55.164882] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-10-17T20:08:55.338634] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-17T20:08:55.338793] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-17T20:08:55.339138] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-17T20:08:55.339249] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-17T20:08:55.339798] [DEBUG] [LOCAL ] MGRB: Trimmed 5612 records to 4058 (keeping 200 days of data) [2025-10-17T20:08:55.364164] [DEBUG] [LOCAL ] MGRB: Primary data saved (4058 records). [2025-10-17T20:08:55.364246] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-17T20:08:55.364355] [INFO ] [MAIN ] Update Progress: 1343/2368 symbols completed. MGRB took 19.5s. Estimated remaining: 2h 24m 8s. Rate: 7.1 symbols/min [2025-10-17T20:08:55.542210] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:08:55.576321] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-17T20:08:55.590731] [DEBUG] [LOCAL ] MGRE: Loaded 6594 existing records from primary storage. [2025-10-17T20:08:55.591362] [INFO ] [MAIN ] MGRE: Loaded 6594 existing records. [2025-10-17T20:08:55.693749] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-17T20:08:55.770406] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:08:55.770677] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-17T20:08:55.770737] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-17T20:08:55.770892] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-17T20:08:55.770948] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-17T20:08:55.967082] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-17T20:08:56.125086] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:08:56.758074] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-10-17T20:08:57.558005] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-17T20:08:57.565376] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T20:08:57.814137] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T20:08:58.054062] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-17T20:08:58.358048] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-17T20:08:58.945383] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T20:08:59.158049] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-17T20:08:59.610121] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-17T20:08:59.958019] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-17T20:09:00.592739] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T20:09:00.758038] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-17T20:09:01.558042] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-17T20:09:02.152192] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T20:09:02.358074] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-17T20:09:02.686556] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T20:09:03.158005] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-17T20:09:03.811369] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T20:09:03.850107] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-17T20:09:03.957983] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-17T20:09:04.573176] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-17T20:09:04.758102] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-17T20:09:05.558036] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-17T20:09:06.309997] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-17T20:09:06.358003] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-17T20:09:06.598683] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T20:09:06.605600] [INFO ] [REMOTE ] MGA: Full fetch complete (73703 records). [2025-10-17T20:09:06.605740] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-17T20:09:06.836497] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-17T20:09:06.999720] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-17T20:09:06.999811] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-17T20:09:07.000944] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-17T20:09:07.001010] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-17T20:09:07.002512] [DEBUG] [LOCAL ] MGA: Trimmed 73703 records to 51244 (keeping 200 days of data) [2025-10-17T20:09:07.177415] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-17T20:09:07.313535] [DEBUG] [LOCAL ] MGA: Primary data saved (51244 records). [2025-10-17T20:09:07.313693] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-17T20:09:07.313791] [INFO ] [MAIN ] Update Progress: 1344/2368 symbols completed. MGA took 58.7s. Estimated remaining: 2h 24m 3s. Rate: 7.1 symbols/min [2025-10-17T20:09:07.483395] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:09:07.530585] [DEBUG] [LOCAL ] MGY: Loaded 52803 existing records from primary storage. [2025-10-17T20:09:07.530943] [INFO ] [MAIN ] MGY: Loaded 52803 existing records. [2025-10-17T20:09:07.705972] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:09:07.706193] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-17T20:09:07.706241] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-17T20:09:07.706454] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-17T20:09:07.706511] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-17T20:09:07.963279] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-17T20:09:08.067043] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:09:08.555066] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-17T20:09:08.757994] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-17T20:09:09.162941] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-17T20:09:09.221691] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-17T20:09:09.558069] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-17T20:09:10.358013] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-17T20:09:10.412424] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-17T20:09:10.838639] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-17T20:09:11.158027] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-17T20:09:11.675454] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-17T20:09:11.958030] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-10-17T20:09:12.758086] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-17T20:09:13.191745] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-17T20:09:13.558010] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-17T20:09:13.838303] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T20:09:14.233301] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-17T20:09:14.358052] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-17T20:09:14.849952] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-17T20:09:15.158060] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-17T20:09:15.958049] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-17T20:09:16.405110] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-17T20:09:16.405964] [INFO ] [REMOTE ] MGRD: Full fetch complete (3338 records). [2025-10-17T20:09:16.406032] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-17T20:09:16.763673] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-17T20:09:16.788348] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-17T20:09:16.788590] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-17T20:09:16.788747] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-17T20:09:16.788863] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-17T20:09:16.789338] [DEBUG] [LOCAL ] MGRD: Trimmed 3338 records to 2248 (keeping 200 days of data) [2025-10-17T20:09:16.803888] [DEBUG] [LOCAL ] MGRD: Primary data saved (2248 records). [2025-10-17T20:09:16.803959] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-17T20:09:16.804038] [INFO ] [MAIN ] Update Progress: 1345/2368 symbols completed. MGRD took 22.9s. Estimated remaining: 2h 23m 55s. Rate: 7.1 symbols/min [2025-10-17T20:09:16.985197] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:09:16.985382] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-17T20:09:16.985528] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-17T20:09:16.985686] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-17T20:09:16.985830] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-17T20:09:16.985915] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-17T20:09:16.985964] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-17T20:09:17.202606] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T20:09:17.442406] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:09:17.533040] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T20:09:17.558043] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-10-17T20:09:17.768146] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T20:09:17.768833] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-10-17T20:09:17.768979] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:09:17.769061] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-17T20:09:17.769144] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:09:17.769248] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-17T20:09:17.769377] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-17T20:09:17.769433] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-17T20:09:17.769478] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-17T20:09:17.769533] [INFO ] [MAIN ] Update Progress: 1346/2368 symbols completed. MH took 1.0s. Estimated remaining: 2h 23m 41s. Rate: 7.1 symbols/min [2025-10-17T20:09:17.954268] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:09:17.967918] [DEBUG] [LOCAL ] MHD: Loaded 12286 existing records from primary storage. [2025-10-17T20:09:17.968146] [INFO ] [MAIN ] MHD: Loaded 12286 existing records. [2025-10-17T20:09:18.148966] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:09:18.149188] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-17T20:09:18.149269] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-17T20:09:18.149462] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-17T20:09:18.149517] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-17T20:09:18.363205] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-17T20:09:18.508892] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:09:19.158040] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-10-17T20:09:19.958006] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-17T20:09:20.069304] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T20:09:20.260787] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T20:09:20.599243] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-17T20:09:20.600565] [INFO ] [REMOTE ] MGRE: Full fetch complete (9233 records). [2025-10-17T20:09:20.600638] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-17T20:09:20.763154] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-17T20:09:20.983103] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-17T20:09:20.983182] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-17T20:09:20.983406] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-17T20:09:20.983444] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-17T20:09:20.983876] [DEBUG] [LOCAL ] MGRE: Trimmed 9233 records to 6619 (keeping 200 days of data) [2025-10-17T20:09:21.023568] [DEBUG] [LOCAL ] MGRE: Primary data saved (6619 records). [2025-10-17T20:09:21.023684] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-17T20:09:21.023790] [INFO ] [MAIN ] Update Progress: 1347/2368 symbols completed. MGRE took 25.7s. Estimated remaining: 2h 23m 28s. Rate: 7.1 symbols/min [2025-10-17T20:09:21.194316] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:09:21.204486] [DEBUG] [LOCAL ] MHF: Loaded 9009 existing records from primary storage. [2025-10-17T20:09:21.204743] [INFO ] [MAIN ] MHF: Loaded 9009 existing records. [2025-10-17T20:09:21.384865] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:09:21.385057] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-17T20:09:21.385106] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-17T20:09:21.385253] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-17T20:09:21.385293] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-17T20:09:21.563609] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-17T20:09:21.753301] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:09:22.358042] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-17T20:09:22.490351] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T20:09:22.525968] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-17T20:09:23.158075] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-17T20:09:23.958028] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-17T20:09:24.317629] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-17T20:09:24.450083] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T20:09:24.758083] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-17T20:09:24.792383] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T20:09:25.567732] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-10-17T20:09:25.570332] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T20:09:25.578367] [INFO ] [REMOTE ] MGM: Full fetch complete (77761 records). [2025-10-17T20:09:25.578480] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-17T20:09:25.966230] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-17T20:09:25.966312] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-17T20:09:25.967505] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-17T20:09:25.967569] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-17T20:09:25.969060] [DEBUG] [LOCAL ] MGM: Trimmed 77761 records to 54387 (keeping 200 days of data) [2025-10-17T20:09:26.289513] [DEBUG] [LOCAL ] MGM: Primary data saved (54387 records). [2025-10-17T20:09:26.289749] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-17T20:09:26.290530] [INFO ] [MAIN ] Update Progress: 1348/2368 symbols completed. MGM took 1m 1s. Estimated remaining: 2h 23m 18s. Rate: 7.1 symbols/min [2025-10-17T20:09:26.359687] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-17T20:09:26.401917] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-17T20:09:26.475751] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:09:26.515697] [DEBUG] [LOCAL ] MHK: Loaded 42422 existing records from primary storage. [2025-10-17T20:09:26.516064] [INFO ] [MAIN ] MHK: Loaded 42422 existing records. [2025-10-17T20:09:26.687792] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:09:26.688009] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-17T20:09:26.688057] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-17T20:09:26.688235] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-17T20:09:26.688273] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-17T20:09:27.081822] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:09:27.158007] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-10-17T20:09:27.958046] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-17T20:09:28.128342] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T20:09:28.595532] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T20:09:28.719155] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-17T20:09:28.758047] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-17T20:09:29.558064] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-17T20:09:30.231987] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T20:09:30.358059] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-17T20:09:30.370470] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T20:09:31.158059] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-17T20:09:31.933969] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T20:09:31.958038] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-17T20:09:31.979702] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T20:09:32.758068] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-17T20:09:33.558054] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-17T20:09:33.786349] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T20:09:34.358065] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-17T20:09:35.135268] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (3.18 seconds). [2025-10-17T20:09:35.157977] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-17T20:09:35.292545] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-17T20:09:35.292362] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T20:09:35.958092] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-17T20:09:36.736825] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T20:09:36.757990] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-17T20:09:37.295686] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T20:09:37.558048] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-17T20:09:38.260446] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-17T20:09:38.288732] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T20:09:38.358015] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-17T20:09:38.990819] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T20:09:39.158021] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-17T20:09:39.960353] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-17T20:09:39.963763] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T20:09:40.758050] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-17T20:09:41.514963] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T20:09:41.558016] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-17T20:09:41.627053] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T20:09:42.296288] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-17T20:09:42.357999] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-17T20:09:43.158036] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-17T20:09:43.958112] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-17T20:09:43.986039] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T20:09:44.758100] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-17T20:09:44.850247] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T20:09:44.925206] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T20:09:45.558033] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-17T20:09:46.304205] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-17T20:09:46.344498] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T20:09:46.357983] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-17T20:09:47.158073] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-17T20:09:47.856621] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T20:09:47.958002] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-17T20:09:47.994785] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T20:09:48.758076] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-17T20:09:49.515469] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T20:09:49.520980] [INFO ] [REMOTE ] MHK: Full fetch complete (61175 records). [2025-10-17T20:09:49.521082] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-17T20:09:49.563158] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-17T20:09:49.904226] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-17T20:09:49.904324] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-17T20:09:49.905340] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-17T20:09:49.905444] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-17T20:09:49.906837] [DEBUG] [LOCAL ] MHK: Trimmed 61175 records to 42681 (keeping 200 days of data) [2025-10-17T20:09:50.156767] [DEBUG] [LOCAL ] MHK: Primary data saved (42681 records). [2025-10-17T20:09:50.156896] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-17T20:09:50.156976] [INFO ] [MAIN ] Update Progress: 1349/2368 symbols completed. MHK took 23.9s. Estimated remaining: 2h 23m 21s. Rate: 7.1 symbols/min [2025-10-17T20:09:50.329779] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:09:50.329926] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-17T20:09:50.329979] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-17T20:09:50.330085] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-17T20:09:50.330126] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-17T20:09:50.330167] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-17T20:09:50.330199] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-17T20:09:50.360633] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-17T20:09:50.586003] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-17T20:09:50.703705] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:09:50.738029] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-17T20:09:51.158075] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-17T20:09:51.259789] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-17T20:09:51.261779] [INFO ] [REMOTE ] MHF: Full fetch complete (12867 records). [2025-10-17T20:09:51.261851] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-17T20:09:51.624545] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-17T20:09:51.624620] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-17T20:09:51.624922] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-17T20:09:51.624974] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-17T20:09:51.625415] [DEBUG] [LOCAL ] MHF: Trimmed 12867 records to 9100 (keeping 200 days of data) [2025-10-17T20:09:51.675493] [DEBUG] [LOCAL ] MHF: Primary data saved (9100 records). [2025-10-17T20:09:51.675598] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-17T20:09:51.675697] [INFO ] [MAIN ] Update Progress: 1350/2368 symbols completed. MHF took 30.7s. Estimated remaining: 2h 23m 7s. Rate: 7.1 symbols/min [2025-10-17T20:09:51.842772] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:09:51.851568] [DEBUG] [LOCAL ] MHN: Loaded 7527 existing records from primary storage. [2025-10-17T20:09:51.851770] [INFO ] [MAIN ] MHN: Loaded 7527 existing records. [2025-10-17T20:09:51.963145] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-10-17T20:09:52.029763] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:09:52.029949] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-17T20:09:52.030013] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-17T20:09:52.030205] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-17T20:09:52.030303] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-17T20:09:52.380158] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-17T20:09:52.385380] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:09:52.758000] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-17T20:09:52.876440] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T20:09:53.010410] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-17T20:09:53.558022] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-17T20:09:54.358057] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-17T20:09:54.687436] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-17T20:09:55.158050] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-17T20:09:55.279949] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T20:09:55.963573] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-17T20:09:55.965590] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-17T20:09:56.303607] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-17T20:09:56.758084] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-17T20:09:57.558032] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-10-17T20:09:58.358056] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-17T20:09:58.386442] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-17T20:09:58.487276] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T20:09:58.494754] [INFO ] [REMOTE ] MGY: Full fetch complete (75950 records). [2025-10-17T20:09:58.494901] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-17T20:09:58.650842] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-17T20:09:58.883303] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-17T20:09:58.883381] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-17T20:09:58.884411] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-17T20:09:58.884475] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-17T20:09:58.885984] [DEBUG] [LOCAL ] MGY: Trimmed 75950 records to 53185 (keeping 200 days of data) [2025-10-17T20:09:59.161338] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-17T20:09:59.203563] [DEBUG] [LOCAL ] MGY: Primary data saved (53185 records). [2025-10-17T20:09:59.203702] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-17T20:09:59.203798] [INFO ] [MAIN ] Update Progress: 1351/2368 symbols completed. MGY took 51.9s. Estimated remaining: 2h 22m 58s. Rate: 7.1 symbols/min [2025-10-17T20:09:59.369680] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:09:59.393311] [DEBUG] [LOCAL ] MHO: Loaded 23951 existing records from primary storage. [2025-10-17T20:09:59.393559] [INFO ] [MAIN ] MHO: Loaded 23951 existing records. [2025-10-17T20:09:59.565426] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:09:59.565693] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-17T20:09:59.565753] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-17T20:09:59.565925] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-17T20:09:59.565963] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-17T20:09:59.668430] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-17T20:09:59.915666] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:09:59.957996] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-10-17T20:10:00.758052] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-17T20:10:01.268456] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-17T20:10:01.303038] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T20:10:01.558019] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-17T20:10:02.358047] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-17T20:10:03.158041] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-17T20:10:03.278462] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T20:10:03.658411] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-17T20:10:03.958035] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-17T20:10:04.654480] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (3.10 seconds). [2025-10-17T20:10:04.716099] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T20:10:04.757999] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-17T20:10:05.530175] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-17T20:10:05.557991] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-17T20:10:06.330127] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-17T20:10:06.357982] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-17T20:10:06.706067] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-17T20:10:07.158034] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-17T20:10:07.913968] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T20:10:07.957983] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-17T20:10:08.565685] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-17T20:10:08.758028] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-17T20:10:09.558491] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-17T20:10:09.560475] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-17T20:10:10.358052] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-17T20:10:11.026788] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T20:10:11.133493] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T20:10:11.157983] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-17T20:10:11.958039] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-17T20:10:11.975031] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T20:10:12.758071] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-17T20:10:13.111887] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-17T20:10:13.243269] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T20:10:13.558030] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-17T20:10:13.923049] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-17T20:10:13.923750] [INFO ] [REMOTE ] MHLA: Full fetch complete (1505 records). [2025-10-17T20:10:13.923819] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-17T20:10:14.095808] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-17T20:10:14.095995] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:10:14.096061] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:10:14.096109] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-17T20:10:14.096163] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-17T20:10:14.096200] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-17T20:10:14.096239] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-17T20:10:14.096293] [INFO ] [MAIN ] Update Progress: 1352/2368 symbols completed. MHLA took 23.9s. Estimated remaining: 2h 22m 55s. Rate: 7.1 symbols/min [2025-10-17T20:10:14.262996] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:10:14.263137] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-17T20:10:14.263173] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-17T20:10:14.263280] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-17T20:10:14.263321] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-17T20:10:14.263361] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-17T20:10:14.263393] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-17T20:10:14.361157] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-17T20:10:14.611132] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:10:15.158055] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-10-17T20:10:15.387832] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T20:10:15.388048] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-10-17T20:10:15.388137] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:10:15.388183] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-17T20:10:15.388216] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:10:15.388263] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-17T20:10:15.388315] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-17T20:10:15.388357] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-17T20:10:15.388397] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-17T20:10:15.388442] [INFO ] [MAIN ] Update Progress: 1353/2368 symbols completed. MIAX took 1.3s. Estimated remaining: 2h 22m 41s. Rate: 7.1 symbols/min [2025-10-17T20:10:15.568451] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:10:15.583360] [DEBUG] [LOCAL ] MIN: Loaded 14021 existing records from primary storage. [2025-10-17T20:10:15.583553] [INFO ] [MAIN ] MIN: Loaded 14021 existing records. [2025-10-17T20:10:15.772188] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:10:15.782376] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-17T20:10:15.783063] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-17T20:10:15.782973] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T20:10:15.789285] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-17T20:10:15.789361] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-17T20:10:15.962432] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-17T20:10:16.137900] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:10:16.758070] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-10-17T20:10:17.336212] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-17T20:10:17.558075] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-17T20:10:17.748558] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T20:10:18.358010] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-17T20:10:18.628356] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-17T20:10:19.077015] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T20:10:19.078465] [INFO ] [REMOTE ] MHN: Full fetch complete (11459 records). [2025-10-17T20:10:19.078533] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-17T20:10:19.163181] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-17T20:10:19.430341] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-17T20:10:19.430417] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-17T20:10:19.430725] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-17T20:10:19.430786] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-17T20:10:19.431232] [DEBUG] [LOCAL ] MHN: Trimmed 11459 records to 7574 (keeping 200 days of data) [2025-10-17T20:10:19.475088] [DEBUG] [LOCAL ] MHN: Primary data saved (7574 records). [2025-10-17T20:10:19.475194] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-17T20:10:19.475274] [INFO ] [MAIN ] Update Progress: 1354/2368 symbols completed. MHN took 27.8s. Estimated remaining: 2h 22m 29s. Rate: 7.1 symbols/min [2025-10-17T20:10:19.640177] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:10:19.649015] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T20:10:19.698334] [DEBUG] [LOCAL ] MIR: Loaded 51674 existing records from primary storage. [2025-10-17T20:10:19.698741] [INFO ] [MAIN ] MIR: Loaded 51674 existing records. [2025-10-17T20:10:19.871246] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:10:19.871464] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-17T20:10:19.871512] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-17T20:10:19.871780] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-17T20:10:19.871836] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-17T20:10:19.965802] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-17T20:10:20.217921] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:10:20.674346] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-17T20:10:20.758024] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-17T20:10:21.558005] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-17T20:10:21.571712] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-17T20:10:22.358000] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-17T20:10:22.600396] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T20:10:22.896279] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-17T20:10:23.158029] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-17T20:10:23.958005] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-10-17T20:10:24.010987] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T20:10:24.013011] [INFO ] [REMOTE ] MHD: Full fetch complete (18169 records). [2025-10-17T20:10:24.013083] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-17T20:10:24.373991] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-17T20:10:24.374066] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-17T20:10:24.374450] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-17T20:10:24.374488] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-17T20:10:24.375024] [DEBUG] [LOCAL ] MHD: Trimmed 18169 records to 12323 (keeping 200 days of data) [2025-10-17T20:10:24.449699] [DEBUG] [LOCAL ] MHD: Primary data saved (12323 records). [2025-10-17T20:10:24.449846] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-17T20:10:24.449929] [INFO ] [MAIN ] Update Progress: 1355/2368 symbols completed. MHD took 1m 7s. Estimated remaining: 2h 22m 18s. Rate: 7.1 symbols/min [2025-10-17T20:10:24.619399] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:10:24.619513] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-17T20:10:24.619550] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-17T20:10:24.619685] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-17T20:10:24.619738] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-17T20:10:24.619780] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-17T20:10:24.619814] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-17T20:10:24.766934] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-17T20:10:24.974192] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:10:25.554777] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T20:10:25.564425] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-10-17T20:10:25.894327] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-17T20:10:25.963614] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-17T20:10:26.358041] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-17T20:10:27.158035] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-17T20:10:27.173195] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T20:10:27.502388] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-17T20:10:27.958076] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-17T20:10:28.371738] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-17T20:10:28.758067] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-17T20:10:29.284070] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-17T20:10:29.557993] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-17T20:10:30.357997] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-17T20:10:30.750239] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-17T20:10:30.752854] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-17T20:10:31.158038] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-17T20:10:31.958006] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-17T20:10:32.263435] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T20:10:32.758091] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-17T20:10:33.213460] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-17T20:10:33.563149] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-17T20:10:33.589404] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T20:10:34.358080] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-17T20:10:34.708277] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T20:10:34.711505] [INFO ] [REMOTE ] MHO: Full fetch complete (36611 records). [2025-10-17T20:10:34.711622] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-17T20:10:35.088359] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-17T20:10:35.088459] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-17T20:10:35.089296] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-17T20:10:35.089360] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-17T20:10:35.090175] [DEBUG] [LOCAL ] MHO: Trimmed 36611 records to 24095 (keeping 200 days of data) [2025-10-17T20:10:35.178186] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-17T20:10:35.192800] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T20:10:35.250578] [DEBUG] [LOCAL ] MHO: Primary data saved (24095 records). [2025-10-17T20:10:35.250730] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-17T20:10:35.250817] [INFO ] [MAIN ] Update Progress: 1356/2368 symbols completed. MHO took 36.0s. Estimated remaining: 2h 22m 11s. Rate: 7.1 symbols/min [2025-10-17T20:10:35.417379] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:10:35.422110] [DEBUG] [LOCAL ] MITP: Loaded 2328 existing records from primary storage. [2025-10-17T20:10:35.422274] [INFO ] [MAIN ] MITP: Loaded 2328 existing records. [2025-10-17T20:10:35.531755] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-17T20:10:35.603972] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:10:35.604163] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-17T20:10:35.604211] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-17T20:10:35.604347] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-17T20:10:35.604412] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-17T20:10:35.948381] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:10:35.957984] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-10-17T20:10:36.475465] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-17T20:10:36.758040] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-17T20:10:37.179857] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-17T20:10:37.558039] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-17T20:10:38.358022] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-17T20:10:38.683659] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-17T20:10:39.158013] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-17T20:10:39.635990] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-17T20:10:39.958039] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-17T20:10:40.267774] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T20:10:40.758072] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-17T20:10:41.563320] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-17T20:10:41.568894] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T20:10:41.607523] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T20:10:41.978456] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-17T20:10:42.358030] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-17T20:10:42.678291] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-17T20:10:43.158074] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-17T20:10:43.905205] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-17T20:10:43.957991] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-17T20:10:44.392575] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-17T20:10:44.758062] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-17T20:10:45.189389] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-17T20:10:45.558026] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-17T20:10:46.357995] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-17T20:10:46.438510] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-17T20:10:46.441336] [INFO ] [REMOTE ] MIN: Full fetch complete (17904 records). [2025-10-17T20:10:46.441410] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-17T20:10:46.802477] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-17T20:10:46.802557] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-17T20:10:46.803023] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-17T20:10:46.803089] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-17T20:10:46.803703] [DEBUG] [LOCAL ] MIN: Trimmed 17904 records to 14068 (keeping 200 days of data) [2025-10-17T20:10:46.884302] [DEBUG] [LOCAL ] MIN: Primary data saved (14068 records). [2025-10-17T20:10:46.884443] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-17T20:10:46.884522] [INFO ] [MAIN ] Update Progress: 1357/2368 symbols completed. MIN took 31.5s. Estimated remaining: 2h 22m 5s. Rate: 7.1 symbols/min [2025-10-17T20:10:46.903678] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-17T20:10:47.158008] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-17T20:10:47.958093] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-17T20:10:48.382423] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-17T20:10:48.383243] [INFO ] [REMOTE ] MITN: Full fetch complete (2360 records). [2025-10-17T20:10:48.383310] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-17T20:10:48.561491] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T20:10:48.561715] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:10:48.561788] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:10:48.561861] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-17T20:10:48.561927] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-17T20:10:48.561966] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-17T20:10:48.562006] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-17T20:10:48.562063] [INFO ] [MAIN ] Update Progress: 1358/2368 symbols completed. MITN took 24.1s. Estimated remaining: 2h 21m 52s. Rate: 7.1 symbols/min [2025-10-17T20:10:48.712891] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T20:10:48.758042] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-17T20:10:49.558119] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-17T20:10:50.098312] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-17T20:10:50.358060] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-17T20:10:50.721429] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T20:10:50.774418] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T20:10:51.158046] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-17T20:10:51.961313] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-17T20:10:52.378708] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-17T20:10:52.736935] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T20:10:52.757986] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-17T20:10:53.558070] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-17T20:10:53.971535] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-17T20:10:54.358015] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-17T20:10:54.486971] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T20:10:54.620724] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-17T20:10:55.158059] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-17T20:10:55.958041] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-17T20:10:56.501453] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-17T20:10:56.502471] [INFO ] [REMOTE ] MITP: Full fetch complete (3261 records). [2025-10-17T20:10:56.502544] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-17T20:10:56.858510] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-17T20:10:56.858727] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-17T20:10:56.858873] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-17T20:10:56.858949] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-17T20:10:56.859470] [DEBUG] [LOCAL ] MITP: Trimmed 3261 records to 2336 (keeping 200 days of data) [2025-10-17T20:10:56.907794] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T20:10:56.906298] [DEBUG] [LOCAL ] MITP: Primary data saved (2336 records). [2025-10-17T20:10:56.919131] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-17T20:10:56.919725] [INFO ] [MAIN ] Update Progress: 1359/2368 symbols completed. MITP took 21.7s. Estimated remaining: 2h 21m 43s. Rate: 7.1 symbols/min [2025-10-17T20:10:56.920216] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-17T20:10:58.757719] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T20:10:58.770988] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-17T20:11:00.530875] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T20:11:00.539097] [INFO ] [REMOTE ] MIR: Full fetch complete (73895 records). [2025-10-17T20:11:00.539294] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-17T20:11:01.009708] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-17T20:11:01.009841] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-17T20:11:01.011946] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-17T20:11:01.012027] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-17T20:11:01.014433] [DEBUG] [LOCAL ] MIR: Trimmed 73895 records to 52051 (keeping 200 days of data) [2025-10-17T20:11:01.346684] [DEBUG] [LOCAL ] MIR: Primary data saved (52051 records). [2025-10-17T20:11:01.346903] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-17T20:11:01.347008] [INFO ] [MAIN ] Update Progress: 1360/2368 symbols completed. MIR took 41.9s. Estimated remaining: 2h 21m 32s. Rate: 7.1 symbols/min [2025-10-17T20:11:02.044053] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:11:02.100073] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:11:02.126613] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:11:02.122417] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:11:02.147622] [DEBUG] [LOCAL ] MIY: Loaded 6309 existing records from primary storage. [2025-10-17T20:11:02.148866] [INFO ] [MAIN ] MIY: Loaded 6309 existing records. [2025-10-17T20:11:02.246400] [DEBUG] [LOCAL ] MITT: Loaded 22805 existing records from primary storage. [2025-10-17T20:11:02.278236] [INFO ] [MAIN ] MITT: Loaded 22805 existing records. [2025-10-17T20:11:02.356711] [DEBUG] [LOCAL ] MKL: Loaded 34376 existing records from primary storage. [2025-10-17T20:11:02.398130] [INFO ] [MAIN ] MKL: Loaded 34376 existing records. [2025-10-17T20:11:02.527274] [DEBUG] [LOCAL ] MKC: Loaded 52909 existing records from primary storage. [2025-10-17T20:11:02.564793] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:11:02.570223] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-17T20:11:02.586175] [INFO ] [MAIN ] MKC: Loaded 52909 existing records. [2025-10-17T20:11:02.596928] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-17T20:11:02.767993] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-17T20:11:02.787813] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-17T20:11:02.849005] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:11:02.893074] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-17T20:11:02.930027] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-17T20:11:03.090095] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:11:03.105174] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-17T20:11:03.100941] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-17T20:11:03.106934] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:11:03.121839] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-17T20:11:03.121601] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-17T20:11:03.127817] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-17T20:11:03.127332] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-17T20:11:03.158824] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-17T20:11:03.164559] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-17T20:11:03.184719] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-17T20:11:03.164488] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-17T20:11:04.186783] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:11:04.255855] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-10-17T20:11:04.537946] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:11:04.563127] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-10-17T20:11:04.562680] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:11:04.581156] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-10-17T20:11:04.627189] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:11:04.627890] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-10-17T20:11:05.105497] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T20:11:05.108435] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-17T20:11:05.736318] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-17T20:11:05.738288] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-17T20:11:05.945382] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T20:11:05.952834] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-17T20:11:06.029128] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T20:11:06.035975] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-17T20:11:06.223823] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T20:11:06.225506] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-17T20:11:06.333875] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T20:11:06.344213] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-17T20:11:06.782974] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T20:11:06.788843] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-17T20:11:06.869130] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-17T20:11:07.158003] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-17T20:11:07.402327] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T20:11:07.872521] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T20:11:07.948559] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-17T20:11:07.957976] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-17T20:11:08.050696] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T20:11:08.482481] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-17T20:11:08.758050] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-17T20:11:09.558050] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-17T20:11:09.916982] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T20:11:10.302557] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-17T20:11:10.358076] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-17T20:11:11.158081] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-17T20:11:11.958077] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-17T20:11:11.992930] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T20:11:12.676765] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T20:11:12.758050] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-17T20:11:13.090634] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T20:11:13.558036] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-17T20:11:14.358005] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-17T20:11:14.402816] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T20:11:14.501610] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T20:11:15.052232] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-17T20:11:15.158021] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-17T20:11:15.958022] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-17T20:11:16.334363] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T20:11:16.479118] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-17T20:11:16.758054] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-17T20:11:17.558042] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-17T20:11:18.136976] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-17T20:11:18.176112] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-17T20:11:18.358039] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-17T20:11:19.158016] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-17T20:11:19.958220] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-17T20:11:20.195516] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T20:11:20.319836] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T20:11:20.758018] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-17T20:11:21.168483] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-17T20:11:21.558000] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-17T20:11:21.856511] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T20:11:22.358019] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-17T20:11:23.158038] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-17T20:11:23.227876] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T20:11:23.769211] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T20:11:23.873107] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T20:11:23.874763] [INFO ] [REMOTE ] MIY: Full fetch complete (8730 records). [2025-10-17T20:11:23.874858] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-17T20:11:23.963217] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-17T20:11:24.237770] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-17T20:11:24.237850] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-17T20:11:24.238067] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-17T20:11:24.238107] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-17T20:11:24.238518] [DEBUG] [LOCAL ] MIY: Trimmed 8730 records to 6335 (keeping 200 days of data) [2025-10-17T20:11:24.276203] [DEBUG] [LOCAL ] MIY: Primary data saved (6335 records). [2025-10-17T20:11:24.276300] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-17T20:11:24.276399] [INFO ] [MAIN ] Update Progress: 1361/2368 symbols completed. MIY took 22.9s. Estimated remaining: 2h 21m 34s. Rate: 7.1 symbols/min [2025-10-17T20:11:24.442006] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:11:24.480891] [DEBUG] [LOCAL ] MLI: Loaded 43798 existing records from primary storage. [2025-10-17T20:11:24.481195] [INFO ] [MAIN ] MLI: Loaded 43798 existing records. [2025-10-17T20:11:24.658965] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:11:24.659210] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-17T20:11:24.659338] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-17T20:11:24.659584] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-17T20:11:24.659744] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-17T20:11:24.763272] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-17T20:11:25.030933] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:11:25.319086] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T20:11:25.558012] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-17T20:11:26.113759] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-17T20:11:26.358036] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-17T20:11:27.158017] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-10-17T20:11:27.588153] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-17T20:11:27.670085] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T20:11:27.958074] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-17T20:11:28.599722] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T20:11:28.758047] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-17T20:11:29.270525] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T20:11:29.558051] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-17T20:11:30.358026] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-17T20:11:30.569464] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T20:11:31.151284] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T20:11:31.159675] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-17T20:11:31.574549] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T20:11:31.958053] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-17T20:11:32.758052] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-17T20:11:32.897330] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T20:11:33.196436] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T20:11:33.199780] [INFO ] [REMOTE ] MITT: Full fetch complete (33876 records). [2025-10-17T20:11:33.199855] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-17T20:11:33.557045] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-17T20:11:33.557125] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-17T20:11:33.557705] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-17T20:11:33.557772] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-17T20:11:33.558413] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-17T20:11:33.560314] [DEBUG] [LOCAL ] MITT: Trimmed 33876 records to 22934 (keeping 200 days of data) [2025-10-17T20:11:33.689537] [DEBUG] [LOCAL ] MITT: Primary data saved (22934 records). [2025-10-17T20:11:33.689698] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-17T20:11:33.689808] [INFO ] [MAIN ] Update Progress: 1362/2368 symbols completed. MITT took 32.3s. Estimated remaining: 2h 21m 27s. Rate: 7.1 symbols/min [2025-10-17T20:11:33.853151] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:11:33.884798] [DEBUG] [LOCAL ] MLM: Loaded 29440 existing records from primary storage. [2025-10-17T20:11:33.885087] [INFO ] [MAIN ] MLM: Loaded 29440 existing records. [2025-10-17T20:11:34.060042] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:11:34.060351] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-17T20:11:34.060403] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-17T20:11:34.060583] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-17T20:11:34.060638] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-17T20:11:34.364577] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-17T20:11:34.435335] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:11:34.437041] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T20:11:35.158024] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-17T20:11:35.340714] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T20:11:35.347968] [INFO ] [REMOTE ] MKC: Full fetch complete (75918 records). [2025-10-17T20:11:35.348084] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-17T20:11:35.736549] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-17T20:11:35.736756] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-17T20:11:35.737835] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-17T20:11:35.737917] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-17T20:11:35.757319] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-17T20:11:35.756503] [DEBUG] [LOCAL ] MKC: Trimmed 75918 records to 53279 (keeping 200 days of data) [2025-10-17T20:11:35.979000] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-17T20:11:36.095308] [DEBUG] [LOCAL ] MKC: Primary data saved (53279 records). [2025-10-17T20:11:36.095442] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-17T20:11:36.095569] [INFO ] [MAIN ] Update Progress: 1363/2368 symbols completed. MKC took 34.7s. Estimated remaining: 2h 21m 14s. Rate: 7.1 symbols/min [2025-10-17T20:11:36.261870] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:11:36.288545] [DEBUG] [LOCAL ] MLNK: Loaded 27069 existing records from primary storage. [2025-10-17T20:11:36.288878] [INFO ] [MAIN ] MLNK: Loaded 27069 existing records. [2025-10-17T20:11:36.462255] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:11:36.462503] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-10-17T20:11:36.462558] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-10-17T20:11:36.462752] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-10-17T20:11:36.462808] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-10-17T20:11:36.759492] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-10-17T20:11:36.825183] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:11:36.872755] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T20:11:37.258421] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T20:11:37.265764] [INFO ] [REMOTE ] MKL: Full fetch complete (49967 records). [2025-10-17T20:11:37.265898] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-17T20:11:37.563248] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-10-17T20:11:37.672007] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-17T20:11:37.672116] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-17T20:11:37.673181] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-17T20:11:37.673267] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-17T20:11:37.674474] [DEBUG] [LOCAL ] MKL: Trimmed 49967 records to 34581 (keeping 200 days of data) [2025-10-17T20:11:37.898823] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T20:11:37.920401] [DEBUG] [LOCAL ] MKL: Primary data saved (34581 records). [2025-10-17T20:11:37.920559] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-17T20:11:37.920761] [INFO ] [MAIN ] Update Progress: 1364/2368 symbols completed. MKL took 36.6s. Estimated remaining: 2h 21m 0s. Rate: 7.1 symbols/min [2025-10-17T20:11:38.085755] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:11:38.091201] [DEBUG] [LOCAL ] MLP: Loaded 3090 existing records from primary storage. [2025-10-17T20:11:38.091360] [INFO ] [MAIN ] MLP: Loaded 3090 existing records. [2025-10-17T20:11:38.274991] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:11:38.275310] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-17T20:11:38.275443] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-17T20:11:38.275701] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-17T20:11:38.275764] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-17T20:11:38.371756] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-17T20:11:38.394075] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-17T20:11:38.652951] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:11:39.158086] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-10-17T20:11:39.743308] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-17T20:11:39.958055] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-10-17T20:11:40.115669] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T20:11:40.758032] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-17T20:11:41.058996] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T20:11:41.344359] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T20:11:41.558111] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-17T20:11:42.058627] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-17T20:11:42.358048] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-17T20:11:42.808614] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-17T20:11:43.158055] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-10-17T20:11:43.958028] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-17T20:11:44.097193] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T20:11:44.582117] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-17T20:11:44.758100] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-17T20:11:45.426852] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-17T20:11:45.558029] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-17T20:11:46.358028] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-17T20:11:46.937987] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T20:11:46.999450] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T20:11:47.158050] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-17T20:11:47.958042] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-10-17T20:11:48.610903] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T20:11:48.758063] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-17T20:11:49.189362] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-17T20:11:49.558074] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-17T20:11:50.000437] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-17T20:11:50.358033] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-10-17T20:11:51.158051] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-17T20:11:51.515375] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-17T20:11:51.538231] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T20:11:51.957993] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-10-17T20:11:52.536192] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T20:11:52.758017] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-17T20:11:53.029803] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-17T20:11:53.558017] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-17T20:11:54.098724] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-17T20:11:54.242868] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T20:11:54.358035] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-17T20:11:55.158023] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-10-17T20:11:55.935431] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T20:11:55.959570] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-17T20:11:55.961957] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-17T20:11:56.422913] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-17T20:11:56.758029] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-10-17T20:11:57.558003] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-17T20:11:57.783872] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T20:11:58.358050] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-10-17T20:11:58.882796] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T20:11:59.158092] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-17T20:11:59.652517] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T20:11:59.958003] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-10-17T20:12:00.758063] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-17T20:12:01.077060] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T20:12:01.405416] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T20:12:01.558020] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-17T20:12:02.358081] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-10. [2025-10-17T20:12:02.435003] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T20:12:03.122408] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T20:12:03.128249] [INFO ] [REMOTE ] MLI: Full fetch complete (63183 records). [2025-10-17T20:12:03.128364] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-17T20:12:03.163201] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-17T20:12:03.512360] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-17T20:12:03.512484] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-17T20:12:03.513505] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-17T20:12:03.513571] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-17T20:12:03.514845] [DEBUG] [LOCAL ] MLI: Trimmed 63183 records to 44088 (keeping 200 days of data) [2025-10-17T20:12:03.758208] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T20:12:03.773812] [INFO ] [REMOTE ] MLNK: Full fetch complete (37366 records). [2025-10-17T20:12:03.775271] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-10-17T20:12:03.868818] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-17T20:12:03.980593] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-17T20:12:04.122592] [DEBUG] [LOCAL ] MLI: Primary data saved (44088 records). [2025-10-17T20:12:04.132982] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-17T20:12:04.138803] [INFO ] [MAIN ] Update Progress: 1365/2368 symbols completed. MLI took 39.9s. Estimated remaining: 2h 21m 5s. Rate: 7.1 symbols/min [2025-10-17T20:12:04.291467] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-10-17T20:12:04.307346] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-10-17T20:12:04.320396] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-10-17T20:12:04.320522] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-10-17T20:12:04.366789] [DEBUG] [LOCAL ] MLNK: Trimmed 37366 records to 27410 (keeping 200 days of data) [2025-10-17T20:12:04.393522] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:12:04.499590] [DEBUG] [LOCAL ] MLR: Loaded 12546 existing records from primary storage. [2025-10-17T20:12:04.510302] [INFO ] [MAIN ] MLR: Loaded 12546 existing records. [2025-10-17T20:12:04.684923] [DEBUG] [LOCAL ] MLNK: Primary data saved (27410 records). [2025-10-17T20:12:04.695490] [INFO ] [MAIN ] MLNK: Full history saved. [2025-10-17T20:12:04.719232] [INFO ] [MAIN ] Update Progress: 1366/2368 symbols completed. MLNK took 28.6s. Estimated remaining: 2h 20m 51s. Rate: 7.1 symbols/min [2025-10-17T20:12:04.756749] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:12:04.767590] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-17T20:12:04.788114] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-17T20:12:04.813705] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-17T20:12:04.860633] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-17T20:12:04.865373] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-17T20:12:05.070992] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:12:05.086582] [DEBUG] [LOCAL ] MMC: No existing data file found in primary storage. [2025-10-17T20:12:05.100971] [WARN ] [MAIN ] MMC: No existing data found, performing full refresh instead. [2025-10-17T20:12:05.123438] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-17T20:12:05.138059] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-17T20:12:05.179839] [DEBUG] [LOCAL ] MMC: No primary data file found to delete. [2025-10-17T20:12:05.211772] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-17T20:12:05.430703] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:12:05.509567] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-17T20:12:05.551890] [INFO ] [REMOTE ] MLP: Full fetch complete (4426 records). [2025-10-17T20:12:05.552006] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-17T20:12:05.559076] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-10-17T20:12:05.780013] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T20:12:05.846839] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:12:06.095805] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-17T20:12:06.095888] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-17T20:12:06.096098] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-17T20:12:06.096139] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-17T20:12:06.096490] [DEBUG] [LOCAL ] MLP: Trimmed 4426 records to 3109 (keeping 200 days of data) [2025-10-17T20:12:06.114127] [DEBUG] [LOCAL ] MLP: Primary data saved (3109 records). [2025-10-17T20:12:06.114194] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-17T20:12:06.114276] [INFO ] [MAIN ] Update Progress: 1367/2368 symbols completed. MLP took 28.2s. Estimated remaining: 2h 20m 37s. Rate: 7.1 symbols/min [2025-10-17T20:12:06.290680] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:12:06.303590] [DEBUG] [LOCAL ] MMD: Loaded 10974 existing records from primary storage. [2025-10-17T20:12:06.303831] [INFO ] [MAIN ] MMD: Loaded 10974 existing records. [2025-10-17T20:12:06.361353] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-17T20:12:06.494242] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:12:06.494570] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-17T20:12:06.494684] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-17T20:12:06.502360] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-17T20:12:06.504332] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T20:12:06.507776] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-17T20:12:06.885160] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:12:07.158109] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-10-17T20:12:07.687346] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-17T20:12:07.958013] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-10-17T20:12:08.138727] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T20:12:08.758059] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-17T20:12:09.558065] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-17T20:12:09.693465] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T20:12:09.814178] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-17T20:12:10.358048] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-17T20:12:10.868106] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T20:12:11.138973] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T20:12:11.157985] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-17T20:12:11.958066] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-17T20:12:11.987925] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-17T20:12:12.758063] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-17T20:12:13.137136] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T20:12:13.558044] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-17T20:12:14.358085] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-17T20:12:14.474395] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-17T20:12:14.589820] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T20:12:15.158081] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-17T20:12:15.179158] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T20:12:15.958094] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-17T20:12:16.758040] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-17T20:12:16.899664] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T20:12:17.291000] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T20:12:17.294975] [INFO ] [REMOTE ] MLM: Full fetch complete (45304 records). [2025-10-17T20:12:17.295074] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-17T20:12:17.562623] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-17T20:12:17.622410] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-17T20:12:17.690945] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-17T20:12:17.691029] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-17T20:12:17.691903] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-17T20:12:17.691967] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-17T20:12:17.693165] [DEBUG] [LOCAL ] MLM: Trimmed 45304 records to 29602 (keeping 200 days of data) [2025-10-17T20:12:17.883956] [DEBUG] [LOCAL ] MLM: Primary data saved (29602 records). [2025-10-17T20:12:17.884099] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-17T20:12:17.884184] [INFO ] [MAIN ] Update Progress: 1368/2368 symbols completed. MLM took 44.2s. Estimated remaining: 2h 20m 31s. Rate: 7.1 symbols/min [2025-10-17T20:12:18.062336] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:12:18.077813] [DEBUG] [LOCAL ] MMI: Loaded 15671 existing records from primary storage. [2025-10-17T20:12:18.078012] [INFO ] [MAIN ] MMI: Loaded 15671 existing records. [2025-10-17T20:12:18.256426] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:12:18.256661] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-17T20:12:18.256723] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-17T20:12:18.256882] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-17T20:12:18.256920] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-17T20:12:18.363178] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-17T20:12:18.614900] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:12:19.158036] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-17T20:12:19.274370] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T20:12:19.582824] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T20:12:19.654344] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-17T20:12:19.958034] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-17T20:12:20.758053] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-10-17T20:12:21.554976] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-17T20:12:21.557971] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-17T20:12:21.862796] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T20:12:22.358062] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-17T20:12:22.363024] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T20:12:23.037797] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-17T20:12:23.158073] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-17T20:12:23.958030] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-17T20:12:24.244442] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T20:12:24.695441] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T20:12:24.758017] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-17T20:12:25.558008] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-17T20:12:25.673430] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T20:12:26.246525] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-17T20:12:26.358070] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-17T20:12:27.158041] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-17T20:12:27.369176] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T20:12:27.958038] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-17T20:12:27.996748] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T20:12:28.758043] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-17T20:12:28.976263] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T20:12:29.558008] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-17T20:12:29.575826] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T20:12:29.577580] [INFO ] [REMOTE ] MMD: Full fetch complete (17112 records). [2025-10-17T20:12:29.577673] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-17T20:12:29.928534] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-17T20:12:29.928606] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-17T20:12:29.928988] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-17T20:12:29.929048] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-17T20:12:29.929568] [DEBUG] [LOCAL ] MMD: Trimmed 17112 records to 11032 (keeping 200 days of data) [2025-10-17T20:12:29.995283] [DEBUG] [LOCAL ] MMD: Primary data saved (11032 records). [2025-10-17T20:12:29.995416] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-17T20:12:29.995495] [INFO ] [MAIN ] Update Progress: 1369/2368 symbols completed. MMD took 23.9s. Estimated remaining: 2h 20m 26s. Rate: 7.1 symbols/min [2025-10-17T20:12:30.165175] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:12:30.165336] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-17T20:12:30.165380] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-17T20:12:30.165490] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-17T20:12:30.165531] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-17T20:12:30.165572] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-17T20:12:30.165606] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-17T20:12:30.369972] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-17T20:12:30.519702] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:12:30.617164] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T20:12:31.158031] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-10-17T20:12:31.372713] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T20:12:31.373043] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-10-17T20:12:31.373131] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:12:31.373180] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-17T20:12:31.373239] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:12:31.373312] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-17T20:12:31.373376] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-17T20:12:31.373411] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-17T20:12:31.373451] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-17T20:12:31.373497] [INFO ] [MAIN ] Update Progress: 1370/2368 symbols completed. MMID took 1.4s. Estimated remaining: 2h 20m 12s. Rate: 7.1 symbols/min [2025-10-17T20:12:31.536748] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:12:31.536897] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-17T20:12:31.536934] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-17T20:12:31.537043] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-17T20:12:31.537084] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-17T20:12:31.537124] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-17T20:12:31.537155] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-17T20:12:31.896730] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:12:31.957988] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-17T20:12:32.190510] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T20:12:32.758021] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-10-17T20:12:32.905861] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-17T20:12:33.197481] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-17T20:12:33.558041] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-17T20:12:33.989473] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-17T20:12:34.358043] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-17T20:12:35.158026] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-17T20:12:35.923002] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-17T20:12:35.965367] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-17T20:12:35.971885] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T20:12:36.758000] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-17T20:12:36.923693] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T20:12:37.193302] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-17T20:12:37.558035] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-17T20:12:38.362201] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-17T20:12:38.365538] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T20:12:39.158096] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-17T20:12:39.269010] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T20:12:39.582686] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-17T20:12:39.958054] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-17T20:12:40.385244] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-17T20:12:40.758050] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-17T20:12:41.183542] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-17T20:12:41.558027] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-17T20:12:41.910090] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-17T20:12:42.358055] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-17T20:12:42.700688] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-17T20:12:43.158066] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-17T20:12:43.958016] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-17T20:12:44.257208] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T20:12:44.758035] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-17T20:12:45.558064] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-17T20:12:45.575637] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T20:12:45.772665] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T20:12:46.358052] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-17T20:12:46.536023] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-17T20:12:47.158019] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-17T20:12:47.381099] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T20:12:47.383991] [INFO ] [REMOTE ] MMI: Full fetch complete (21764 records). [2025-10-17T20:12:47.384065] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-17T20:12:47.647737] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-17T20:12:47.759341] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-17T20:12:47.759434] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-17T20:12:47.760022] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-17T20:12:47.760086] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-17T20:12:47.760795] [DEBUG] [LOCAL ] MMI: Trimmed 21764 records to 15785 (keeping 200 days of data) [2025-10-17T20:12:47.859329] [DEBUG] [LOCAL ] MMI: Primary data saved (15785 records). [2025-10-17T20:12:47.859496] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-17T20:12:47.859608] [INFO ] [MAIN ] Update Progress: 1371/2368 symbols completed. MMI took 30.0s. Estimated remaining: 2h 20m 9s. Rate: 7.1 symbols/min [2025-10-17T20:12:47.961221] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-17T20:12:48.033639] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:12:48.088904] [DEBUG] [LOCAL ] MMM: Loaded 53503 existing records from primary storage. [2025-10-17T20:12:48.089275] [INFO ] [MAIN ] MMM: Loaded 53503 existing records. [2025-10-17T20:12:48.284685] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:12:48.284914] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-17T20:12:48.284964] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-17T20:12:48.285225] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-17T20:12:48.285294] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-17T20:12:48.440625] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-17T20:12:48.660878] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:12:48.758055] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-17T20:12:49.203267] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-17T20:12:49.204130] [INFO ] [REMOTE ] MMKT: Full fetch complete (2124 records). [2025-10-17T20:12:49.204199] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-17T20:12:49.375867] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T20:12:49.376069] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:12:49.376138] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:12:49.376208] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-17T20:12:49.376272] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-17T20:12:49.376308] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-17T20:12:49.376347] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-17T20:12:49.376400] [INFO ] [MAIN ] Update Progress: 1372/2368 symbols completed. MMKT took 18.0s. Estimated remaining: 2h 19m 56s. Rate: 7.1 symbols/min [2025-10-17T20:12:49.542209] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:12:49.561471] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-17T20:12:49.575529] [DEBUG] [LOCAL ] MMS: Loaded 34018 existing records from primary storage. [2025-10-17T20:12:49.575816] [INFO ] [MAIN ] MMS: Loaded 34018 existing records. [2025-10-17T20:12:49.753013] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:12:49.753207] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-17T20:12:49.753261] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-17T20:12:49.753600] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-17T20:12:49.753705] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-17T20:12:50.102804] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:12:50.358042] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-10-17T20:12:51.157995] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-17T20:12:51.403862] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T20:12:51.951379] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T20:12:51.960171] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-17T20:12:52.003613] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T20:12:52.758041] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-10-17T20:12:53.509040] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T20:12:53.557986] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-17T20:12:54.358036] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-17T20:12:54.634846] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T20:12:55.039593] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T20:12:55.158012] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-17T20:12:55.899774] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T20:12:55.957995] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-17T20:12:56.599357] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T20:12:56.757988] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-17T20:12:56.971816] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T20:12:56.979155] [INFO ] [REMOTE ] MMC: Full fetch complete (75150 records). [2025-10-17T20:12:56.979271] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-17T20:12:57.370476] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-17T20:12:57.370572] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-17T20:12:57.371815] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-17T20:12:57.371883] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-17T20:12:57.373537] [DEBUG] [LOCAL ] MMC: Trimmed 75150 records to 52707 (keeping 200 days of data) [2025-10-17T20:12:57.485796] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T20:12:57.490698] [INFO ] [REMOTE ] MLR: Full fetch complete (19026 records). [2025-10-17T20:12:57.491119] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-17T20:12:57.562847] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-17T20:12:57.884550] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-17T20:12:57.885894] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-17T20:12:57.887403] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-17T20:12:57.887488] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-17T20:12:57.891614] [DEBUG] [LOCAL ] MLR: Trimmed 19026 records to 12610 (keeping 200 days of data) [2025-10-17T20:12:58.085326] [DEBUG] [LOCAL ] MLR: Primary data saved (12610 records). [2025-10-17T20:12:58.087850] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-17T20:12:58.088966] [INFO ] [MAIN ] Update Progress: 1373/2368 symbols completed. MLR took 53.9s. Estimated remaining: 2h 19m 48s. Rate: 7.1 symbols/min [2025-10-17T20:12:58.335853] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:12:58.358765] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-17T20:12:58.358947] [DEBUG] [LOCAL ] MMC: Primary data saved (52707 records). [2025-10-17T20:12:58.359380] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-17T20:12:58.360469] [INFO ] [MAIN ] Update Progress: 1374/2368 symbols completed. MMC took 53.6s. Estimated remaining: 2h 19m 33s. Rate: 7.1 symbols/min [2025-10-17T20:12:58.413004] [DEBUG] [LOCAL ] MMT: Loaded 10392 existing records from primary storage. [2025-10-17T20:12:58.446468] [INFO ] [MAIN ] MMT: Loaded 10392 existing records. [2025-10-17T20:12:58.664548] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:12:58.756239] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:12:58.763050] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-17T20:12:58.763140] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-17T20:12:58.764980] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-17T20:12:58.765056] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-17T20:12:58.837876] [DEBUG] [LOCAL ] MMU: Loaded 16691 existing records from primary storage. [2025-10-17T20:12:58.860554] [INFO ] [MAIN ] MMU: Loaded 16691 existing records. [2025-10-17T20:12:59.233120] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:12:59.250415] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-17T20:12:59.257940] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-17T20:12:59.272339] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-17T20:12:59.282634] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-17T20:12:59.418993] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:12:59.419444] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-10-17T20:12:59.698446] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:12:59.729825] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-17T20:12:59.964052] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-10-17T20:12:59.966779] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T20:13:00.254664] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-17T20:13:00.758014] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-17T20:13:01.095193] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T20:13:01.558066] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-17T20:13:02.358067] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-17T20:13:02.466019] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T20:13:02.779179] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-17T20:13:03.158021] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-17T20:13:03.430190] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-17T20:13:03.958062] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-17T20:13:04.758015] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-17T20:13:05.172461] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-17T20:13:05.379997] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T20:13:05.558015] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-17T20:13:05.796901] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T20:13:06.358026] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-17T20:13:06.970442] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T20:13:07.117252] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-17T20:13:07.158001] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-17T20:13:07.920366] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T20:13:07.957977] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-17T20:13:08.758014] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-17T20:13:08.886975] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-17T20:13:09.558006] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-17T20:13:10.003520] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T20:13:10.358004] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-17T20:13:10.524070] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T20:13:11.158031] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-17T20:13:11.958044] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-17T20:13:12.003799] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T20:13:12.142293] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-17T20:13:12.739673] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-17T20:13:12.758027] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-17T20:13:13.558024] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-17T20:13:14.188766] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T20:13:14.193622] [INFO ] [REMOTE ] MMS: Full fetch complete (51434 records). [2025-10-17T20:13:14.193736] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-17T20:13:14.366673] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-17T20:13:14.523134] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T20:13:14.591039] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-17T20:13:14.591121] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-17T20:13:14.592036] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-17T20:13:14.592098] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-17T20:13:14.593151] [DEBUG] [LOCAL ] MMS: Trimmed 51434 records to 34279 (keeping 200 days of data) [2025-10-17T20:13:14.798637] [DEBUG] [LOCAL ] MMS: Primary data saved (34279 records). [2025-10-17T20:13:14.798822] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-17T20:13:14.798909] [INFO ] [MAIN ] Update Progress: 1375/2368 symbols completed. MMS took 25.4s. Estimated remaining: 2h 19m 31s. Rate: 7.1 symbols/min [2025-10-17T20:13:14.970166] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:13:14.994719] [DEBUG] [LOCAL ] MNR: Loaded 25091 existing records from primary storage. [2025-10-17T20:13:14.995005] [INFO ] [MAIN ] MNR: Loaded 25091 existing records. [2025-10-17T20:13:15.163275] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-17T20:13:15.167271] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:13:15.168677] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-17T20:13:15.168739] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-17T20:13:15.168926] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-17T20:13:15.168982] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-17T20:13:15.514815] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:13:15.958074] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-17T20:13:16.003355] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T20:13:16.483117] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-17T20:13:16.758021] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-17T20:13:16.881094] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T20:13:17.491789] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-17T20:13:17.558008] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-17T20:13:18.358034] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-17T20:13:19.158038] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-17T20:13:19.302858] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-17T20:13:19.554103] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T20:13:19.957999] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-17T20:13:20.054192] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-17T20:13:20.477138] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-17T20:13:20.758045] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-17T20:13:21.494080] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-17T20:13:21.558044] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-17T20:13:22.340006] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-17T20:13:22.357976] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-17T20:13:23.153637] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T20:13:23.155369] [INFO ] [REMOTE ] MMT: Full fetch complete (15980 records). [2025-10-17T20:13:23.155460] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-17T20:13:23.166770] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-17T20:13:23.535042] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-17T20:13:23.535140] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-17T20:13:23.535543] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-17T20:13:23.535605] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-17T20:13:23.536125] [DEBUG] [LOCAL ] MMT: Trimmed 15980 records to 10420 (keeping 200 days of data) [2025-10-17T20:13:23.595146] [DEBUG] [LOCAL ] MMT: Primary data saved (10420 records). [2025-10-17T20:13:23.595276] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-17T20:13:23.595387] [INFO ] [MAIN ] Update Progress: 1376/2368 symbols completed. MMT took 25.5s. Estimated remaining: 2h 19m 23s. Rate: 7.1 symbols/min [2025-10-17T20:13:23.762891] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:13:23.805385] [DEBUG] [LOCAL ] MNSO: Loaded 44550 existing records from primary storage. [2025-10-17T20:13:23.805692] [INFO ] [MAIN ] MNSO: Loaded 44550 existing records. [2025-10-17T20:13:23.963172] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-10-17T20:13:23.993405] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:13:23.993772] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-17T20:13:23.993829] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-17T20:13:23.994021] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-17T20:13:23.994083] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-17T20:13:24.352750] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:13:24.758041] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-17T20:13:25.198056] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-17T20:13:25.296563] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T20:13:25.558021] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-10-17T20:13:25.707618] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-17T20:13:26.358087] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-17T20:13:27.158097] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-17T20:13:27.286241] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T20:13:27.955683] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-17T20:13:27.960249] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-17T20:13:28.496901] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-17T20:13:28.758001] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-17T20:13:28.825169] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T20:13:28.827978] [INFO ] [REMOTE ] MMU: Full fetch complete (25005 records). [2025-10-17T20:13:28.828054] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-17T20:13:29.193269] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-17T20:13:29.193346] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-17T20:13:29.193864] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-17T20:13:29.193927] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-17T20:13:29.194531] [DEBUG] [LOCAL ] MMU: Trimmed 25005 records to 16787 (keeping 200 days of data) [2025-10-17T20:13:29.293847] [DEBUG] [LOCAL ] MMU: Primary data saved (16787 records). [2025-10-17T20:13:29.293989] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-17T20:13:29.294069] [INFO ] [MAIN ] Update Progress: 1377/2368 symbols completed. MMU took 30.9s. Estimated remaining: 2h 19m 12s. Rate: 7.1 symbols/min [2025-10-17T20:13:29.467857] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:13:29.468053] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-17T20:13:29.468092] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-17T20:13:29.468227] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-17T20:13:29.468298] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-17T20:13:29.468367] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-17T20:13:29.468414] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-17T20:13:29.564373] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-17T20:13:29.835775] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:13:30.358044] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-17T20:13:30.550541] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T20:13:30.811095] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-17T20:13:31.158039] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-17T20:13:31.944493] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T20:13:31.957979] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-17T20:13:32.003823] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T20:13:32.758029] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-10-17T20:13:32.952748] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T20:13:32.953166] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-10-17T20:13:32.953262] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:13:32.953359] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-17T20:13:32.953447] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:13:32.953544] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-17T20:13:32.953631] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-17T20:13:32.953711] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-17T20:13:32.953765] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-17T20:13:32.953814] [INFO ] [MAIN ] Update Progress: 1378/2368 symbols completed. MNTN took 3.7s. Estimated remaining: 2h 19m 0s. Rate: 7.1 symbols/min [2025-10-17T20:13:33.124907] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:13:33.125124] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-17T20:13:33.125209] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-17T20:13:33.125516] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-17T20:13:33.125588] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-17T20:13:33.125689] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-17T20:13:33.125744] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-17T20:13:33.389814] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T20:13:33.509697] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:13:33.557979] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-10-17T20:13:34.358030] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-17T20:13:35.158022] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-17T20:13:35.862184] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T20:13:35.962158] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-17T20:13:35.968538] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-17T20:13:36.758007] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-17T20:13:36.906359] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T20:13:37.079961] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T20:13:37.558029] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-17T20:13:37.828785] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T20:13:37.985712] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-17T20:13:37.993076] [INFO ] [REMOTE ] MMM: Full fetch complete (77213 records). [2025-10-17T20:13:37.993223] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-17T20:13:38.374157] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-17T20:13:38.399794] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-17T20:13:38.399882] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-17T20:13:38.401036] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-17T20:13:38.401227] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-17T20:13:38.402849] [DEBUG] [LOCAL ] MMM: Trimmed 77213 records to 53890 (keeping 200 days of data) [2025-10-17T20:13:38.735704] [DEBUG] [LOCAL ] MMM: Primary data saved (53890 records). [2025-10-17T20:13:38.735852] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-17T20:13:38.736628] [INFO ] [MAIN ] Update Progress: 1379/2368 symbols completed. MMM took 50.9s. Estimated remaining: 2h 18m 50s. Rate: 7.1 symbols/min [2025-10-17T20:13:38.902286] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:13:38.945915] [DEBUG] [LOCAL ] MOD: Loaded 45085 existing records from primary storage. [2025-10-17T20:13:38.946208] [INFO ] [MAIN ] MOD: Loaded 45085 existing records. [2025-10-17T20:13:39.123234] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:13:39.123525] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-17T20:13:39.123584] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-17T20:13:39.123793] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-17T20:13:39.123849] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-17T20:13:39.165315] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-17T20:13:39.473882] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:13:39.958022] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-17T20:13:40.016462] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T20:13:40.758039] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-10-17T20:13:41.141572] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T20:13:41.558011] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-17T20:13:41.635376] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-17T20:13:42.358000] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-17T20:13:42.449855] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T20:13:43.158044] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-17T20:13:43.274261] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T20:13:43.579394] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T20:13:43.958017] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-17T20:13:44.758036] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-17T20:13:45.227990] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-17T20:13:45.472387] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T20:13:45.558006] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-17T20:13:45.957691] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-17T20:13:46.358069] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-17T20:13:47.157993] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-17T20:13:47.188211] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T20:13:47.250687] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T20:13:47.958035] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-17T20:13:48.758072] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-17T20:13:48.885069] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T20:13:49.558052] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-17T20:13:49.960497] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-17T20:13:50.334229] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T20:13:50.358013] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-17T20:13:50.394533] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T20:13:51.158086] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-17T20:13:51.912498] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T20:13:51.958001] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-17T20:13:52.408416] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T20:13:52.412181] [INFO ] [REMOTE ] MNR: Full fetch complete (36859 records). [2025-10-17T20:13:52.412259] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-17T20:13:52.760535] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-17T20:13:52.781489] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-17T20:13:52.781552] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-17T20:13:52.782380] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-17T20:13:52.782446] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-17T20:13:52.783372] [DEBUG] [LOCAL ] MNR: Trimmed 36859 records to 25302 (keeping 200 days of data) [2025-10-17T20:13:52.929864] [DEBUG] [LOCAL ] MNR: Primary data saved (25302 records). [2025-10-17T20:13:52.929991] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-17T20:13:52.930067] [INFO ] [MAIN ] Update Progress: 1380/2368 symbols completed. MNR took 38.1s. Estimated remaining: 2h 18m 46s. Rate: 7.1 symbols/min [2025-10-17T20:13:53.094526] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:13:53.143791] [DEBUG] [LOCAL ] MODG: Loaded 51962 existing records from primary storage. [2025-10-17T20:13:53.144196] [INFO ] [MAIN ] MODG: Loaded 51962 existing records. [2025-10-17T20:13:53.332964] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:13:53.333178] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-17T20:13:53.333233] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-17T20:13:53.333431] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-17T20:13:53.333487] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-17T20:13:53.572938] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-17T20:13:53.693919] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:13:53.728445] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T20:13:53.734736] [INFO ] [REMOTE ] MNSO: Full fetch complete (64800 records). [2025-10-17T20:13:53.734836] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-17T20:13:54.115951] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-17T20:13:54.116026] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-17T20:13:54.116978] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-17T20:13:54.117040] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-17T20:13:54.118283] [DEBUG] [LOCAL ] MNSO: Trimmed 64800 records to 44819 (keeping 200 days of data) [2025-10-17T20:13:54.369270] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-10-17T20:13:54.386229] [DEBUG] [LOCAL ] MNSO: Primary data saved (44819 records). [2025-10-17T20:13:54.386303] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-17T20:13:54.386946] [INFO ] [MAIN ] Update Progress: 1381/2368 symbols completed. MNSO took 30.8s. Estimated remaining: 2h 18m 32s. Rate: 7.1 symbols/min [2025-10-17T20:13:54.562736] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:13:54.604431] [DEBUG] [LOCAL ] MOH: Loaded 42970 existing records from primary storage. [2025-10-17T20:13:54.604754] [INFO ] [MAIN ] MOH: Loaded 42970 existing records. [2025-10-17T20:13:54.785412] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:13:54.785693] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-17T20:13:54.785766] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-17T20:13:54.786029] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-10-17T20:13:54.786086] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-17T20:13:55.195950] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:13:55.196695] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-10-17T20:13:55.231189] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-17T20:13:55.354999] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T20:13:55.736029] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T20:13:55.958041] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-17T20:13:56.626557] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T20:13:56.758060] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-17T20:13:57.558076] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-17T20:13:58.076444] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-17T20:13:58.358112] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-17T20:13:58.394070] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T20:13:59.158065] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-17T20:13:59.189006] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T20:13:59.958109] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-17T20:14:00.446024] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-17T20:14:00.758091] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-17T20:14:00.809574] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T20:14:01.402757] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T20:14:01.558044] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-17T20:14:02.358024] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-17T20:14:03.114576] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T20:14:03.158028] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-17T20:14:03.223179] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-17T20:14:03.826264] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T20:14:03.958022] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-17T20:14:04.758031] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-17T20:14:04.866905] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T20:14:05.454343] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T20:14:05.558048] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-17T20:14:06.358059] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-17T20:14:06.575474] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T20:14:07.082517] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T20:14:07.157991] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-17T20:14:07.958070] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-17T20:14:08.463714] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-17T20:14:08.758032] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-17T20:14:08.850830] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T20:14:09.497727] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T20:14:09.558043] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-17T20:14:10.358087] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-17T20:14:10.929085] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-17T20:14:11.158098] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-17T20:14:11.333041] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-17T20:14:11.837257] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T20:14:11.958038] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-17T20:14:12.757114] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T20:14:12.765531] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-17T20:14:13.380265] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T20:14:13.558085] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-17T20:14:13.589097] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T20:14:13.597262] [INFO ] [REMOTE ] MO: Full fetch complete (77541 records). [2025-10-17T20:14:13.597522] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-17T20:14:13.801688] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T20:14:13.802597] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:14:13.802699] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:14:13.802781] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-17T20:14:13.802865] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-17T20:14:13.802906] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-17T20:14:13.802947] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-17T20:14:13.803028] [INFO ] [MAIN ] Update Progress: 1382/2368 symbols completed. MO took 40.8s. Estimated remaining: 2h 18m 32s. Rate: 7.1 symbols/min [2025-10-17T20:14:14.002863] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:14:14.064248] [DEBUG] [LOCAL ] MOS: Loaded 53898 existing records from primary storage. [2025-10-17T20:14:14.064815] [INFO ] [MAIN ] MOS: Loaded 53898 existing records. [2025-10-17T20:14:14.258399] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:14:14.258781] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-17T20:14:14.258852] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-17T20:14:14.259153] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-17T20:14:14.259217] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-17T20:14:14.363195] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-17T20:14:14.656734] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:14:15.158002] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-10-17T20:14:15.252160] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T20:14:15.958026] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-17T20:14:16.071617] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T20:14:16.077492] [INFO ] [REMOTE ] MOD: Full fetch complete (66420 records). [2025-10-17T20:14:16.077635] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-17T20:14:16.463374] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-17T20:14:16.463464] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-17T20:14:16.464558] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-17T20:14:16.464624] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-17T20:14:16.466037] [DEBUG] [LOCAL ] MOD: Trimmed 66420 records to 45405 (keeping 200 days of data) [2025-10-17T20:14:16.747193] [DEBUG] [LOCAL ] MOD: Primary data saved (45405 records). [2025-10-17T20:14:16.747423] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-17T20:14:16.748162] [INFO ] [MAIN ] Update Progress: 1383/2368 symbols completed. MOD took 38.0s. Estimated remaining: 2h 18m 19s. Rate: 7.1 symbols/min [2025-10-17T20:14:16.763212] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-17T20:14:16.952958] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:14:16.955530] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T20:14:16.989386] [DEBUG] [LOCAL ] MOV: Loaded 21798 existing records from primary storage. [2025-10-17T20:14:16.989677] [INFO ] [MAIN ] MOV: Loaded 21798 existing records. [2025-10-17T20:14:17.186701] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:14:17.186976] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-17T20:14:17.187025] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-17T20:14:17.187289] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-10-17T20:14:17.187350] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-17T20:14:17.600962] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:14:17.575086] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-17T20:14:17.603057] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T20:14:18.358023] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-10-17T20:14:18.754918] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-17T20:14:19.158050] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-17T20:14:19.344493] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T20:14:19.448208] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T20:14:19.958097] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-17T20:14:20.758022] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-17T20:14:20.925940] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T20:14:21.558015] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-17T20:14:21.743190] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T20:14:22.358001] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-17T20:14:22.418385] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T20:14:22.535529] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-17T20:14:23.158030] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-17T20:14:23.958074] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-17T20:14:24.014910] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T20:14:24.758103] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-17T20:14:24.852188] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T20:14:25.013561] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T20:14:25.558087] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-17T20:14:26.121194] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T20:14:26.127322] [INFO ] [REMOTE ] MOH: Full fetch complete (59420 records). [2025-10-17T20:14:26.127464] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-17T20:14:26.366189] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-17T20:14:26.503020] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-17T20:14:26.503087] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-17T20:14:26.504014] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-17T20:14:26.504077] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-17T20:14:26.505279] [DEBUG] [LOCAL ] MOH: Trimmed 59420 records to 43308 (keeping 200 days of data) [2025-10-17T20:14:26.760275] [DEBUG] [LOCAL ] MOH: Primary data saved (43308 records). [2025-10-17T20:14:26.760401] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-17T20:14:26.761112] [INFO ] [MAIN ] Update Progress: 1384/2368 symbols completed. MOH took 32.4s. Estimated remaining: 2h 18m 12s. Rate: 7.1 symbols/min [2025-10-17T20:14:26.929619] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:14:26.929816] [DEBUG] [LOCAL ] MP: No existing data file found in primary storage. [2025-10-17T20:14:26.929859] [WARN ] [MAIN ] MP: No existing data found, performing full refresh instead. [2025-10-17T20:14:26.930001] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-17T20:14:26.930077] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-17T20:14:26.930137] [DEBUG] [LOCAL ] MP: No primary data file found to delete. [2025-10-17T20:14:26.930172] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-17T20:14:27.160372] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-17T20:14:27.308716] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:14:27.337738] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T20:14:27.513492] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-17T20:14:27.958045] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-10-17T20:14:28.758008] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-17T20:14:28.937702] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T20:14:29.558040] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-17T20:14:29.769067] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T20:14:29.916889] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T20:14:30.358102] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-17T20:14:31.158034] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-17T20:14:31.365245] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T20:14:31.372460] [INFO ] [REMOTE ] MODG: Full fetch complete (74871 records). [2025-10-17T20:14:31.372610] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-17T20:14:31.804300] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-17T20:14:31.804391] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-17T20:14:31.805456] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-17T20:14:31.805519] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-17T20:14:31.807426] [DEBUG] [LOCAL ] MODG: Trimmed 74871 records to 52312 (keeping 200 days of data) [2025-10-17T20:14:31.971444] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-17T20:14:32.110668] [DEBUG] [LOCAL ] MODG: Primary data saved (52312 records). [2025-10-17T20:14:32.110821] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-17T20:14:32.110974] [INFO ] [MAIN ] Update Progress: 1385/2368 symbols completed. MODG took 39.2s. Estimated remaining: 2h 18m 1s. Rate: 7.1 symbols/min [2025-10-17T20:14:32.284348] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:14:32.332596] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T20:14:32.340755] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-17T20:14:32.343789] [DEBUG] [LOCAL ] MPA: Loaded 5378 existing records from primary storage. [2025-10-17T20:14:32.354753] [INFO ] [MAIN ] MPA: Loaded 5378 existing records. [2025-10-17T20:14:32.524431] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:14:32.524574] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-17T20:14:32.524619] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-17T20:14:32.524810] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-17T20:14:32.524866] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-17T20:14:32.765680] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-17T20:14:32.867551] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:14:33.558028] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-17T20:14:33.583471] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T20:14:33.903734] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T20:14:34.358029] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-17T20:14:35.158003] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-17T20:14:35.448067] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T20:14:35.638835] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-17T20:14:35.958039] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-17T20:14:36.758045] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-17T20:14:37.017222] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T20:14:37.114743] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T20:14:37.558035] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-17T20:14:38.358058] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-17T20:14:38.743111] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T20:14:39.157999] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-17T20:14:39.356703] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T20:14:39.395032] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-17T20:14:39.958047] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-17T20:14:40.758044] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-17T20:14:41.558008] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-10-17T20:14:41.614585] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-17T20:14:41.792504] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T20:14:41.862494] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T20:14:41.865514] [INFO ] [REMOTE ] MOV: Full fetch complete (30526 records). [2025-10-17T20:14:41.865627] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-17T20:14:42.238742] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-17T20:14:42.243942] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-17T20:14:42.244933] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-17T20:14:42.244151] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-17T20:14:42.245128] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-17T20:14:42.247772] [DEBUG] [LOCAL ] MOV: Trimmed 30526 records to 21884 (keeping 200 days of data) [2025-10-17T20:14:42.358105] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-17T20:14:42.379948] [DEBUG] [LOCAL ] MOV: Primary data saved (21884 records). [2025-10-17T20:14:42.380070] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-17T20:14:42.380154] [INFO ] [MAIN ] Update Progress: 1386/2368 symbols completed. MOV took 25.6s. Estimated remaining: 2h 17m 54s. Rate: 7.1 symbols/min [2025-10-17T20:14:42.554560] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:14:42.554795] [DEBUG] [LOCAL ] MPC: No existing data file found in primary storage. [2025-10-17T20:14:42.554841] [WARN ] [MAIN ] MPC: No existing data found, performing full refresh instead. [2025-10-17T20:14:42.554966] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-17T20:14:42.555009] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-17T20:14:42.555052] [DEBUG] [LOCAL ] MPC: No primary data file found to delete. [2025-10-17T20:14:42.555085] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-17T20:14:42.850412] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T20:14:42.931083] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:14:43.158086] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-17T20:14:43.789736] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T20:14:43.958033] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-17T20:14:44.758042] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-10-17T20:14:45.558035] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-17T20:14:45.851976] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T20:14:46.118620] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-17T20:14:46.358017] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-17T20:14:46.637515] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T20:14:47.158045] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-17T20:14:47.958006] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-17T20:14:48.517104] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-17T20:14:48.758000] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-17T20:14:48.852348] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-17T20:14:48.931040] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T20:14:49.558009] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-17T20:14:50.210751] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-17T20:14:50.358044] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-17T20:14:50.949565] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-17T20:14:51.158078] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-17T20:14:51.841011] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-17T20:14:51.958091] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-17T20:14:52.269904] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T20:14:52.758086] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-17T20:14:53.558046] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-17T20:14:54.253114] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-17T20:14:54.358007] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-17T20:14:54.639422] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T20:14:54.641326] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-17T20:14:54.660465] [INFO ] [REMOTE ] MOS: Full fetch complete (77628 records). [2025-10-17T20:14:54.660932] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-17T20:14:55.030407] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-17T20:14:55.056557] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-17T20:14:55.056662] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-17T20:14:55.057803] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-17T20:14:55.057868] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-17T20:14:55.059354] [DEBUG] [LOCAL ] MOS: Trimmed 77628 records to 54288 (keeping 200 days of data) [2025-10-17T20:14:55.158413] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-17T20:14:55.388741] [DEBUG] [LOCAL ] MOS: Primary data saved (54288 records). [2025-10-17T20:14:55.388890] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-17T20:14:55.388972] [INFO ] [MAIN ] Update Progress: 1387/2368 symbols completed. MOS took 41.6s. Estimated remaining: 2h 17m 49s. Rate: 7.1 symbols/min [2025-10-17T20:14:55.557008] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:14:55.557332] [DEBUG] [LOCAL ] MPLX: No existing data file found in primary storage. [2025-10-17T20:14:55.557407] [WARN ] [MAIN ] MPLX: No existing data found, performing full refresh instead. [2025-10-17T20:14:55.557575] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-17T20:14:55.557628] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-17T20:14:55.557720] [DEBUG] [LOCAL ] MPLX: No primary data file found to delete. [2025-10-17T20:14:55.557763] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-17T20:14:55.900153] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:14:55.958040] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-10-17T20:14:56.758049] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-17T20:14:56.828021] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T20:14:57.341006] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-17T20:14:57.558097] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-17T20:14:57.618428] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T20:14:58.201175] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-17T20:14:58.202623] [INFO ] [REMOTE ] MPA: Full fetch complete (7052 records). [2025-10-17T20:14:58.202735] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-17T20:14:58.366891] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-17T20:14:58.585566] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-17T20:14:58.585693] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-17T20:14:58.585990] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-17T20:14:58.586035] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-17T20:14:58.586481] [DEBUG] [LOCAL ] MPA: Trimmed 7052 records to 5405 (keeping 200 days of data) [2025-10-17T20:14:58.620677] [DEBUG] [LOCAL ] MPA: Primary data saved (5405 records). [2025-10-17T20:14:58.620842] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-17T20:14:58.620940] [INFO ] [MAIN ] Update Progress: 1388/2368 symbols completed. MPA took 26.5s. Estimated remaining: 2h 17m 37s. Rate: 7.1 symbols/min [2025-10-17T20:14:58.794070] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:14:58.802467] [DEBUG] [LOCAL ] MPV: Loaded 4676 existing records from primary storage. [2025-10-17T20:14:58.802725] [INFO ] [MAIN ] MPV: Loaded 4676 existing records. [2025-10-17T20:14:58.983585] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:14:58.983906] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-17T20:14:58.983964] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-17T20:14:58.984263] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-10-17T20:14:58.984324] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-17T20:14:59.168317] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-17T20:14:59.351867] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:14:59.958091] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-10-17T20:15:00.286513] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-17T20:15:00.595891] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-17T20:15:00.758083] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-17T20:15:01.329151] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-17T20:15:01.558050] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-17T20:15:02.258567] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (3.09 seconds). [2025-10-17T20:15:02.358044] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-17T20:15:03.158005] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-17T20:15:03.560715] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-17T20:15:03.958083] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-17T20:15:04.758048] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-17T20:15:05.041017] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T20:15:05.089420] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-10-17T20:15:05.439626] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T20:15:05.558034] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-17T20:15:05.860637] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-17T20:15:06.316744] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-17T20:15:06.357994] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-17T20:15:06.955789] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-17T20:15:07.158051] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-17T20:15:07.958029] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-17T20:15:08.758006] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-17T20:15:09.558086] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-17T20:15:09.790213] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T20:15:09.865631] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (2.71 seconds). [2025-10-17T20:15:09.873923] [INFO ] [REMOTE ] MP: Full fetch complete (77562 records). [2025-10-17T20:15:09.874173] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-17T20:15:09.994953] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-17T20:15:10.315725] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-10-17T20:15:10.316107] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-10-17T20:15:10.318074] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-10-17T20:15:10.318148] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-10-17T20:15:10.320828] [DEBUG] [LOCAL ] MP: Trimmed 77562 records to 54502 (keeping 200 days of data) [2025-10-17T20:15:10.375092] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-17T20:15:10.463073] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T20:15:10.722662] [DEBUG] [LOCAL ] MP: Primary data saved (54502 records). [2025-10-17T20:15:10.722881] [INFO ] [MAIN ] MP: Full history saved. [2025-10-17T20:15:10.722982] [INFO ] [MAIN ] Update Progress: 1389/2368 symbols completed. MP took 44.0s. Estimated remaining: 2h 17m 31s. Rate: 7.1 symbols/min [2025-10-17T20:15:10.914681] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:15:10.965832] [DEBUG] [LOCAL ] MPW: Loaded 53886 existing records from primary storage. [2025-10-17T20:15:10.966252] [INFO ] [MAIN ] MPW: Loaded 53886 existing records. [2025-10-17T20:15:11.143516] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:15:11.143795] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-17T20:15:11.143845] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-17T20:15:11.144259] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-10-17T20:15:11.144326] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-17T20:15:11.164236] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-17T20:15:11.493209] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:15:11.958020] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-17T20:15:12.447875] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-17T20:15:12.579589] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T20:15:12.758044] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-17T20:15:13.099991] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T20:15:13.558031] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-10-17T20:15:14.205336] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T20:15:14.358058] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-17T20:15:15.158042] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-17T20:15:15.620504] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-17T20:15:15.730269] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T20:15:15.958022] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-17T20:15:16.221515] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T20:15:16.758056] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-17T20:15:17.433843] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T20:15:17.558017] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-17T20:15:18.111375] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-17T20:15:18.358010] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-17T20:15:18.548141] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-17T20:15:19.158039] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-17T20:15:19.958019] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-17T20:15:20.229360] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T20:15:20.236564] [INFO ] [REMOTE ] MPC: Full fetch complete (75834 records). [2025-10-17T20:15:20.236726] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-17T20:15:20.634846] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-10-17T20:15:20.635024] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-10-17T20:15:20.636275] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-10-17T20:15:20.636356] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-10-17T20:15:20.637890] [DEBUG] [LOCAL ] MPC: Trimmed 75834 records to 52777 (keeping 200 days of data) [2025-10-17T20:15:20.768078] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-17T20:15:20.776301] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T20:15:21.013508] [DEBUG] [LOCAL ] MPC: Primary data saved (52777 records). [2025-10-17T20:15:21.013674] [INFO ] [MAIN ] MPC: Full history saved. [2025-10-17T20:15:21.013791] [INFO ] [MAIN ] Update Progress: 1390/2368 symbols completed. MPC took 38.6s. Estimated remaining: 2h 17m 24s. Rate: 7.1 symbols/min [2025-10-17T20:15:21.183405] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:15:21.189526] [DEBUG] [LOCAL ] MPX: Loaded 4074 existing records from primary storage. [2025-10-17T20:15:21.189701] [INFO ] [MAIN ] MPX: Loaded 4074 existing records. [2025-10-17T20:15:21.370676] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:15:21.371129] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-17T20:15:21.371178] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-17T20:15:21.371306] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-10-17T20:15:21.371346] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-17T20:15:21.468781] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-17T20:15:21.558265] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-17T20:15:21.742045] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:15:21.768489] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T20:15:22.358025] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-10-17T20:15:22.814453] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-17T20:15:23.157984] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-17T20:15:23.415276] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-17T20:15:23.825376] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-17T20:15:23.958008] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-17T20:15:24.599124] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-17T20:15:24.600281] [INFO ] [REMOTE ] MPV: Full fetch complete (7675 records). [2025-10-17T20:15:24.600388] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-17T20:15:24.761370] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-17T20:15:24.959455] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-17T20:15:24.959541] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-17T20:15:24.959768] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-17T20:15:24.959829] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-17T20:15:24.960297] [DEBUG] [LOCAL ] MPV: Trimmed 7675 records to 4696 (keeping 200 days of data) [2025-10-17T20:15:24.987911] [DEBUG] [LOCAL ] MPV: Primary data saved (4696 records). [2025-10-17T20:15:24.987989] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-17T20:15:24.988064] [INFO ] [MAIN ] Update Progress: 1391/2368 symbols completed. MPV took 26.4s. Estimated remaining: 2h 17m 13s. Rate: 7.1 symbols/min [2025-10-17T20:15:25.153287] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:15:25.163165] [DEBUG] [LOCAL ] MQT: Loaded 8377 existing records from primary storage. [2025-10-17T20:15:25.163351] [INFO ] [MAIN ] MQT: Loaded 8377 existing records. [2025-10-17T20:15:25.338870] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:15:25.339110] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-17T20:15:25.339159] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-17T20:15:25.339304] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-10-17T20:15:25.339367] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-17T20:15:25.563729] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-17T20:15:25.699257] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:15:26.257724] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-17T20:15:26.357996] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-17T20:15:26.516543] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T20:15:26.958739] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-17T20:15:27.158046] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-17T20:15:27.958025] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-10-17T20:15:28.738829] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-17T20:15:28.758103] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-17T20:15:28.946500] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T20:15:29.476832] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T20:15:29.557989] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-17T20:15:30.358873] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-17T20:15:30.361320] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T20:15:31.012441] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-17T20:15:31.158057] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-17T20:15:31.958036] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-17T20:15:32.575171] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-17T20:15:32.758005] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-17T20:15:32.841812] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T20:15:33.538967] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-17T20:15:33.557991] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-17T20:15:34.358026] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-17T20:15:34.736985] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T20:15:35.158021] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-17T20:15:35.323880] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T20:15:35.757030] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T20:15:35.958009] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-17T20:15:36.596055] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-17T20:15:36.758051] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-17T20:15:37.558049] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-17T20:15:38.358012] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-17T20:15:38.548345] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T20:15:38.605206] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T20:15:38.735358] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-17T20:15:39.158030] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-17T20:15:39.771565] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-17T20:15:39.958032] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-17T20:15:40.758033] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-17T20:15:41.558059] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-17T20:15:41.950562] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T20:15:42.265025] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-17T20:15:42.358047] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-17T20:15:42.534914] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T20:15:42.542430] [INFO ] [REMOTE ] MPLX: Full fetch complete (74319 records). [2025-10-17T20:15:42.542610] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-17T20:15:42.969176] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-10-17T20:15:42.969262] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-10-17T20:15:42.970480] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-10-17T20:15:42.970561] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-10-17T20:15:42.972147] [DEBUG] [LOCAL ] MPLX: Trimmed 74319 records to 51524 (keeping 200 days of data) [2025-10-17T20:15:43.043930] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-17T20:15:43.045697] [INFO ] [REMOTE ] MPX: Full fetch complete (6527 records). [2025-10-17T20:15:43.075994] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-17T20:15:43.162328] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-17T20:15:43.576079] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-10-17T20:15:43.576426] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-10-17T20:15:43.577263] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-10-17T20:15:43.577345] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-10-17T20:15:43.581954] [DEBUG] [LOCAL ] MPX: Trimmed 6527 records to 4090 (keeping 200 days of data) [2025-10-17T20:15:43.616725] [DEBUG] [LOCAL ] MPX: Primary data saved (4090 records). [2025-10-17T20:15:43.619694] [INFO ] [MAIN ] MPX: Full history saved. [2025-10-17T20:15:43.620912] [INFO ] [MAIN ] Update Progress: 1392/2368 symbols completed. MPX took 22.6s. Estimated remaining: 2h 17m 11s. Rate: 7.1 symbols/min [2025-10-17T20:15:43.858847] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:15:43.861794] [DEBUG] [LOCAL ] MQY: No existing data file found in primary storage. [2025-10-17T20:15:43.862947] [WARN ] [MAIN ] MQY: No existing data found, performing full refresh instead. [2025-10-17T20:15:43.866963] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-17T20:15:43.868513] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-17T20:15:43.870592] [DEBUG] [LOCAL ] MQY: No primary data file found to delete. [2025-10-17T20:15:43.870966] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-17T20:15:43.963599] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-17T20:15:43.989363] [DEBUG] [LOCAL ] MPLX: Primary data saved (51524 records). [2025-10-17T20:15:44.019572] [INFO ] [MAIN ] MPLX: Full history saved. [2025-10-17T20:15:44.094116] [INFO ] [MAIN ] Update Progress: 1393/2368 symbols completed. MPLX took 48.7s. Estimated remaining: 2h 16m 57s. Rate: 7.1 symbols/min [2025-10-17T20:15:44.402210] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:15:44.430363] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:15:44.430754] [DEBUG] [LOCAL ] MRC: No existing data file found in primary storage. [2025-10-17T20:15:44.430800] [WARN ] [MAIN ] MRC: No existing data found, performing full refresh instead. [2025-10-17T20:15:44.430913] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-17T20:15:44.430955] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-17T20:15:44.430997] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-17T20:15:44.431031] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-17T20:15:44.728588] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-17T20:15:44.763078] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-10-17T20:15:44.825963] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:15:44.923377] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T20:15:45.558122] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-17T20:15:45.929173] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T20:15:46.115116] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-17T20:15:46.358072] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-17T20:15:47.158042] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-17T20:15:47.436057] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T20:15:47.946255] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T20:15:47.948013] [INFO ] [REMOTE ] MQT: Full fetch complete (13077 records). [2025-10-17T20:15:47.948083] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-17T20:15:47.971059] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-17T20:15:48.305817] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-17T20:15:48.305898] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-17T20:15:48.306171] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-17T20:15:48.306211] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-17T20:15:48.306741] [DEBUG] [LOCAL ] MQT: Trimmed 13077 records to 8424 (keeping 200 days of data) [2025-10-17T20:15:48.374184] [DEBUG] [LOCAL ] MQT: Primary data saved (8424 records). [2025-10-17T20:15:48.374332] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-17T20:15:48.374448] [INFO ] [MAIN ] Update Progress: 1394/2368 symbols completed. MQT took 23.4s. Estimated remaining: 2h 16m 46s. Rate: 7.1 symbols/min [2025-10-17T20:15:48.571502] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:15:48.571714] [DEBUG] [LOCAL ] MRK: No existing data file found in primary storage. [2025-10-17T20:15:48.571793] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-10-17T20:15:48.571918] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-17T20:15:48.571978] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-17T20:15:48.572027] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-17T20:15:48.572061] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-17T20:15:48.766733] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-10-17T20:15:48.981949] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:15:49.558035] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-10-17T20:15:49.845285] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-17T20:15:49.907878] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T20:15:50.358070] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-17T20:15:51.157986] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-17T20:15:51.680548] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-17T20:15:51.958037] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-17T20:15:52.191269] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T20:15:52.323452] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-17T20:15:52.758078] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-17T20:15:53.558029] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-17T20:15:54.047602] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-17T20:15:54.157734] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T20:15:54.358021] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-17T20:15:54.564832] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T20:15:55.158038] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-17T20:15:55.958007] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-17T20:15:56.282773] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T20:15:56.399967] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-17T20:15:56.758028] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-17T20:15:57.558012] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-17T20:15:57.769069] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T20:15:58.170882] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T20:15:58.358057] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-17T20:15:58.384846] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-17T20:15:59.158044] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-17T20:15:59.958022] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-17T20:16:00.417549] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T20:16:00.561958] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T20:16:00.758003] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-17T20:16:00.999437] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T20:16:01.558020] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-17T20:16:02.245923] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T20:16:02.358071] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-17T20:16:03.158032] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-17T20:16:03.409740] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T20:16:03.939891] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-17T20:16:03.957985] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-17T20:16:04.758013] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-17T20:16:04.802235] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T20:16:05.558024] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-17T20:16:06.358048] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-17T20:16:06.470681] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-17T20:16:06.495291] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-17T20:16:06.702455] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T20:16:06.710089] [INFO ] [REMOTE ] MPW: Full fetch complete (77596 records). [2025-10-17T20:16:06.710254] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-17T20:16:07.098071] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-10-17T20:16:07.098165] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-10-17T20:16:07.099374] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-10-17T20:16:07.099450] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-10-17T20:16:07.100874] [DEBUG] [LOCAL ] MPW: Trimmed 77596 records to 54274 (keeping 200 days of data) [2025-10-17T20:16:07.182925] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-17T20:16:07.412199] [DEBUG] [LOCAL ] MPW: Primary data saved (54274 records). [2025-10-17T20:16:07.412356] [INFO ] [MAIN ] MPW: Full history saved. [2025-10-17T20:16:07.412984] [INFO ] [MAIN ] Update Progress: 1395/2368 symbols completed. MPW took 56.7s. Estimated remaining: 2h 16m 45s. Rate: 7.1 symbols/min [2025-10-17T20:16:07.588434] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:16:07.588762] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-17T20:16:07.588818] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-17T20:16:07.588939] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-17T20:16:07.588982] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-17T20:16:07.589025] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-17T20:16:07.589058] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-17T20:16:07.973406] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-17T20:16:07.978913] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:16:07.981675] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T20:16:08.758043] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-10-17T20:16:09.186237] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T20:16:09.186561] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-10-17T20:16:09.186674] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:16:09.186748] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-17T20:16:09.186818] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:16:09.186890] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-17T20:16:09.186956] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-17T20:16:09.186994] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-17T20:16:09.187033] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-17T20:16:09.187081] [INFO ] [MAIN ] Update Progress: 1396/2368 symbols completed. MRP took 1.8s. Estimated remaining: 2h 16m 32s. Rate: 7.1 symbols/min [2025-10-17T20:16:09.306173] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T20:16:09.379731] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:16:09.379871] [DEBUG] [LOCAL ] MS: No existing data file found in primary storage. [2025-10-17T20:16:09.379907] [WARN ] [MAIN ] MS: No existing data found, performing full refresh instead. [2025-10-17T20:16:09.380014] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-17T20:16:09.380055] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-17T20:16:09.380094] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-17T20:16:09.380126] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-17T20:16:09.563803] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-17T20:16:09.736287] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:16:09.765628] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-17T20:16:10.357998] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-17T20:16:10.431625] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T20:16:10.434817] [INFO ] [REMOTE ] MQY: Full fetch complete (26405 records). [2025-10-17T20:16:10.434911] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-17T20:16:10.801287] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-10-17T20:16:10.801389] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-10-17T20:16:10.801952] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-10-17T20:16:10.802013] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-10-17T20:16:10.802753] [DEBUG] [LOCAL ] MQY: Trimmed 26405 records to 17099 (keeping 200 days of data) [2025-10-17T20:16:10.909683] [DEBUG] [LOCAL ] MQY: Primary data saved (17099 records). [2025-10-17T20:16:10.909837] [INFO ] [MAIN ] MQY: Full history saved. [2025-10-17T20:16:10.909939] [INFO ] [MAIN ] Update Progress: 1397/2368 symbols completed. MQY took 27.3s. Estimated remaining: 2h 16m 19s. Rate: 7.1 symbols/min [2025-10-17T20:16:11.158064] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-10-17T20:16:11.958061] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-17T20:16:12.917636] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-17T20:16:12.930580] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-17T20:16:13.219130] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-17T20:16:13.406438] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T20:16:13.525455] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-17T20:16:13.558036] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-17T20:16:14.358050] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-17T20:16:15.158039] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-17T20:16:15.287051] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T20:16:15.350963] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T20:16:15.958024] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-17T20:16:16.758076] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-17T20:16:16.881984] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-17T20:16:16.889468] [INFO ] [REMOTE ] MRK: Full fetch complete (77578 records). [2025-10-17T20:16:16.889691] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-17T20:16:16.890608] [FATAL] [VALIDATOR ] MRK: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T20:16:16.890747] [FATAL] [MAIN ] MRK: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:16:16.890847] [WARN ] [MAIN ] MRK: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:16:16.890935] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-17T20:16:16.891019] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-17T20:16:16.891075] [INFO ] [LOCAL ] MRK: Starting deletion of derivative data. [2025-10-17T20:16:16.891150] [DEBUG] [LOCAL ] MRK: No derivative data file found to delete. [2025-10-17T20:16:16.891250] [INFO ] [MAIN ] Update Progress: 1398/2368 symbols completed. MRK took 28.5s. Estimated remaining: 2h 16m 9s. Rate: 7.1 symbols/min [2025-10-17T20:16:16.992829] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T20:16:17.558070] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-17T20:16:18.295678] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T20:16:18.358012] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-17T20:16:19.510749] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-17T20:16:19.521502] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-17T20:16:19.919742] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T20:16:19.958066] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-17T20:16:21.351862] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T20:16:21.360722] [INFO ] [REMOTE ] MRC: Full fetch complete (55181 records). [2025-10-17T20:16:21.360877] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-17T20:16:21.969793] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-10-17T20:16:21.969934] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-10-17T20:16:21.971105] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-10-17T20:16:21.971184] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-10-17T20:16:21.973080] [DEBUG] [LOCAL ] MRC: Trimmed 55181 records to 37839 (keeping 200 days of data) [2025-10-17T20:16:22.077047] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-17T20:16:22.129264] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-17T20:16:22.260892] [DEBUG] [LOCAL ] MRC: Primary data saved (37839 records). [2025-10-17T20:16:22.261044] [INFO ] [MAIN ] MRC: Full history saved. [2025-10-17T20:16:22.261120] [INFO ] [MAIN ] Update Progress: 1399/2368 symbols completed. MRC took 38.1s. Estimated remaining: 2h 15m 58s. Rate: 7.1 symbols/min [2025-10-17T20:16:24.395687] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-17T20:16:24.407252] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-17T20:16:26.548712] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-17T20:16:26.559869] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-17T20:16:28.597335] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-17T20:16:28.608148] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-17T20:16:30.769698] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-17T20:16:30.781560] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-17T20:16:31.682536] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T20:16:31.694245] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-17T20:16:32.556241] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-17T20:16:32.568026] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-17T20:16:33.460694] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T20:16:33.467723] [INFO ] [REMOTE ] MS: Full fetch complete (77467 records). [2025-10-17T20:16:33.467839] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-17T20:16:33.468621] [FATAL] [VALIDATOR ] MS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T20:16:33.468742] [FATAL] [MAIN ] MS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:16:33.468810] [WARN ] [MAIN ] MS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:16:33.468882] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-17T20:16:33.468948] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-17T20:16:33.468984] [INFO ] [LOCAL ] MS: Starting deletion of derivative data. [2025-10-17T20:16:33.469023] [DEBUG] [LOCAL ] MS: No derivative data file found to delete. [2025-10-17T20:16:33.469081] [INFO ] [MAIN ] Update Progress: 1400/2368 symbols completed. MS took 24.3s. Estimated remaining: 2h 15m 52s. Rate: 7.1 symbols/min [2025-10-17T20:16:34.133398] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:16:34.118760] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:16:34.090516] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:16:34.146210] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-17T20:16:34.162912] [DEBUG] [LOCAL ] MSA: No existing data file found in primary storage. [2025-10-17T20:16:34.166719] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:16:34.162970] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-17T20:16:34.167239] [DEBUG] [LOCAL ] MSCI: No existing data file found in primary storage. [2025-10-17T20:16:34.167181] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-17T20:16:34.167585] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-17T20:16:34.167310] [WARN ] [MAIN ] MSA: No existing data found, performing full refresh instead. [2025-10-17T20:16:34.167817] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-17T20:16:34.167713] [WARN ] [MAIN ] MSCI: No existing data found, performing full refresh instead. [2025-10-17T20:16:34.168001] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-17T20:16:34.168135] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-17T20:16:34.168304] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-17T20:16:34.168586] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-17T20:16:34.168699] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-17T20:16:34.173743] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-17T20:16:34.182077] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-17T20:16:34.197293] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-17T20:16:34.211743] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-17T20:16:34.248959] [DEBUG] [LOCAL ] MSB: Loaded 7883 existing records from primary storage. [2025-10-17T20:16:34.368801] [INFO ] [MAIN ] MSB: Loaded 7883 existing records. [2025-10-17T20:16:35.175861] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:16:35.211682] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-17T20:16:35.285219] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-17T20:16:35.395813] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-10-17T20:16:35.427204] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:16:35.424328] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:16:35.435626] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-10-17T20:16:35.436393] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-10-17T20:16:35.435753] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-17T20:16:35.457808] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:16:35.481407] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-10-17T20:16:35.812207] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:16:35.812519] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-10-17T20:16:35.946886] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-17T20:16:35.947950] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-17T20:16:36.480143] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-17T20:16:36.482229] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-17T20:16:36.631819] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-17T20:16:36.633830] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-17T20:16:36.675492] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T20:16:36.679556] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-17T20:16:36.899490] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-17T20:16:36.901177] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-17T20:16:37.039914] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T20:16:37.046149] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-17T20:16:37.351831] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-17T20:16:37.355275] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-17T20:16:37.592376] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-17T20:16:37.593989] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-17T20:16:37.751966] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T20:16:37.755542] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-17T20:16:38.012614] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-17T20:16:38.013570] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-17T20:16:38.180324] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-17T20:16:38.184577] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-17T20:16:38.639861] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T20:16:38.646802] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-17T20:16:38.702267] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T20:16:38.710665] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T20:16:39.158037] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-17T20:16:39.276153] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T20:16:39.681104] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-17T20:16:39.958010] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-17T20:16:40.290962] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T20:16:40.348454] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-17T20:16:40.758048] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-17T20:16:41.290056] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-17T20:16:41.558013] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-17T20:16:42.071761] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-17T20:16:42.358027] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-17T20:16:43.002387] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-17T20:16:43.158044] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-17T20:16:43.958073] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-17T20:16:44.516699] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T20:16:44.758055] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-17T20:16:45.558003] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-17T20:16:45.597315] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T20:16:45.876742] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T20:16:46.358040] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-17T20:16:46.383070] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-17T20:16:46.814345] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-17T20:16:46.815142] [INFO ] [REMOTE ] MSC: Full fetch complete (2533 records). [2025-10-17T20:16:46.815211] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-17T20:16:46.989783] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-17T20:16:46.989992] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:16:46.990040] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:16:46.990078] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-17T20:16:46.990134] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-17T20:16:46.990177] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-17T20:16:46.990215] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-17T20:16:46.990271] [INFO ] [MAIN ] Update Progress: 1401/2368 symbols completed. MSC took 13.5s. Estimated remaining: 2h 15m 47s. Rate: 7.1 symbols/min [2025-10-17T20:16:47.154094] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:16:47.158055] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-17T20:16:47.171166] [DEBUG] [LOCAL ] MSD: Loaded 16669 existing records from primary storage. [2025-10-17T20:16:47.171378] [INFO ] [MAIN ] MSD: Loaded 16669 existing records. [2025-10-17T20:16:47.347950] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:16:47.348165] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-17T20:16:47.348215] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-17T20:16:47.348397] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-10-17T20:16:47.348454] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-17T20:16:47.701593] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:16:47.958029] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-17T20:16:48.100024] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-17T20:16:48.758006] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-17T20:16:48.801938] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T20:16:49.558034] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-17T20:16:50.364685] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-10-17T20:16:50.379598] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T20:16:50.393830] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T20:16:51.157998] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-17T20:16:51.323580] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-17T20:16:51.958083] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-17T20:16:52.025405] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T20:16:52.758085] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-17T20:16:53.426879] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T20:16:53.558010] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-17T20:16:53.587019] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T20:16:54.358001] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-17T20:16:54.669432] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-17T20:16:55.158007] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-17T20:16:55.283727] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T20:16:55.940800] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-17T20:16:55.957997] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-17T20:16:56.734372] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T20:16:56.736058] [INFO ] [REMOTE ] MSB: Full fetch complete (13031 records). [2025-10-17T20:16:56.736227] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-17T20:16:56.765308] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-17T20:16:57.114163] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-10-17T20:16:57.114272] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-10-17T20:16:57.114872] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-10-17T20:16:57.114937] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-10-17T20:16:57.115537] [DEBUG] [LOCAL ] MSB: Trimmed 13031 records to 7917 (keeping 200 days of data) [2025-10-17T20:16:57.170163] [DEBUG] [LOCAL ] MSB: Primary data saved (7917 records). [2025-10-17T20:16:57.170364] [INFO ] [MAIN ] MSB: Full history saved. [2025-10-17T20:16:57.170468] [INFO ] [MAIN ] Update Progress: 1402/2368 symbols completed. MSB took 23.7s. Estimated remaining: 2h 15m 40s. Rate: 7.1 symbols/min [2025-10-17T20:16:57.349366] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:16:57.349701] [DEBUG] [LOCAL ] MSDL: No existing data file found in primary storage. [2025-10-17T20:16:57.349756] [WARN ] [MAIN ] MSDL: No existing data found, performing full refresh instead. [2025-10-17T20:16:57.349888] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-17T20:16:57.349931] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-17T20:16:57.349972] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-17T20:16:57.350006] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-17T20:16:57.568826] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-17T20:16:57.725018] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:16:57.865344] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T20:16:58.358064] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-17T20:16:58.987148] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T20:16:59.158042] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-10-17T20:16:59.391911] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-17T20:16:59.958023] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-17T20:17:00.655525] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T20:17:00.757989] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-17T20:17:01.558032] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-17T20:17:01.711622] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T20:17:02.139095] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T20:17:02.358050] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-17T20:17:02.708189] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T20:17:03.158010] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-17T20:17:03.355028] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T20:17:03.958027] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-17T20:17:04.369240] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-17T20:17:04.758030] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-17T20:17:05.558015] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-17T20:17:05.664194] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T20:17:06.318982] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T20:17:06.357990] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-17T20:17:06.628505] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T20:17:06.631165] [INFO ] [REMOTE ] MSA: Full fetch complete (25738 records). [2025-10-17T20:17:06.631240] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-17T20:17:06.992308] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-10-17T20:17:06.992386] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-10-17T20:17:06.992929] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-10-17T20:17:06.992993] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-10-17T20:17:06.993805] [DEBUG] [LOCAL ] MSA: Trimmed 25738 records to 19108 (keeping 200 days of data) [2025-10-17T20:17:07.113153] [DEBUG] [LOCAL ] MSA: Primary data saved (19108 records). [2025-10-17T20:17:07.113298] [INFO ] [MAIN ] MSA: Full history saved. [2025-10-17T20:17:07.113371] [INFO ] [MAIN ] Update Progress: 1403/2368 symbols completed. MSA took 33.6s. Estimated remaining: 2h 15m 32s. Rate: 7.1 symbols/min [2025-10-17T20:17:07.166585] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-17T20:17:07.304476] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:17:07.304671] [DEBUG] [LOCAL ] MSGE: No existing data file found in primary storage. [2025-10-17T20:17:07.304728] [WARN ] [MAIN ] MSGE: No existing data found, performing full refresh instead. [2025-10-17T20:17:07.304849] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-17T20:17:07.304892] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-17T20:17:07.305050] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-17T20:17:07.305100] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-17T20:17:07.453427] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-17T20:17:07.734531] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:17:07.958040] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-17T20:17:08.758016] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-10-17T20:17:08.877427] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T20:17:09.192046] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-17T20:17:09.558023] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-17T20:17:09.683487] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T20:17:10.358061] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-17T20:17:10.404781] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T20:17:11.158095] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-17T20:17:11.795070] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T20:17:11.958041] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-17T20:17:12.326338] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T20:17:12.330854] [INFO ] [REMOTE ] MSCI: Full fetch complete (50542 records). [2025-10-17T20:17:12.330958] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-17T20:17:12.710486] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-10-17T20:17:12.710572] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-10-17T20:17:12.711699] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-10-17T20:17:12.711778] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-10-17T20:17:12.713119] [DEBUG] [LOCAL ] MSCI: Trimmed 50542 records to 34965 (keeping 200 days of data) [2025-10-17T20:17:12.772232] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-17T20:17:12.940833] [DEBUG] [LOCAL ] MSCI: Primary data saved (34965 records). [2025-10-17T20:17:12.940973] [INFO ] [MAIN ] MSCI: Full history saved. [2025-10-17T20:17:12.941047] [INFO ] [MAIN ] Update Progress: 1404/2368 symbols completed. MSCI took 39.4s. Estimated remaining: 2h 15m 22s. Rate: 7.1 symbols/min [2025-10-17T20:17:13.112779] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:17:13.113008] [DEBUG] [LOCAL ] MSGS: No existing data file found in primary storage. [2025-10-17T20:17:13.113107] [WARN ] [MAIN ] MSGS: No existing data found, performing full refresh instead. [2025-10-17T20:17:13.113238] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-17T20:17:13.113301] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-17T20:17:13.113358] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-17T20:17:13.113405] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-17T20:17:13.423967] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T20:17:13.507923] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:17:13.558069] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-10-17T20:17:13.902744] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T20:17:14.358115] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-17T20:17:14.451537] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-17T20:17:15.158021] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-17T20:17:15.958031] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-17T20:17:16.001260] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T20:17:16.087418] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T20:17:16.758028] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-17T20:17:17.240131] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T20:17:17.558058] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-17T20:17:18.226838] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T20:17:18.358056] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-17T20:17:18.681814] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T20:17:19.158029] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-17T20:17:19.779020] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T20:17:19.958009] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-17T20:17:20.199230] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-17T20:17:20.758048] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-17T20:17:20.942482] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-17T20:17:21.558022] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-17T20:17:21.846497] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T20:17:22.358043] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-17T20:17:22.694210] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T20:17:23.158072] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-17T20:17:23.958039] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-17T20:17:23.992188] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T20:17:24.338291] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T20:17:24.758003] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-17T20:17:25.006064] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-17T20:17:25.557998] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-17T20:17:25.952665] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-17T20:17:26.357988] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-17T20:17:26.631386] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T20:17:26.634766] [INFO ] [REMOTE ] MSD: Full fetch complete (23232 records). [2025-10-17T20:17:26.634836] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-17T20:17:26.996629] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-10-17T20:17:26.996760] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-10-17T20:17:26.997199] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-10-17T20:17:26.997259] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-10-17T20:17:26.997920] [DEBUG] [LOCAL ] MSD: Trimmed 23232 records to 16810 (keeping 200 days of data) [2025-10-17T20:17:27.090674] [DEBUG] [LOCAL ] MSD: Primary data saved (16810 records). [2025-10-17T20:17:27.090809] [INFO ] [MAIN ] MSD: Full history saved. [2025-10-17T20:17:27.090886] [INFO ] [MAIN ] Update Progress: 1405/2368 symbols completed. MSD took 40.1s. Estimated remaining: 2h 15m 17s. Rate: 7.1 symbols/min [2025-10-17T20:17:27.163716] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-17T20:17:27.285812] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:17:27.285995] [DEBUG] [LOCAL ] MSI: No existing data file found in primary storage. [2025-10-17T20:17:27.286032] [WARN ] [MAIN ] MSI: No existing data found, performing full refresh instead. [2025-10-17T20:17:27.286198] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-17T20:17:27.286238] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-17T20:17:27.286278] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-17T20:17:27.286310] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-17T20:17:27.631527] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:17:27.716126] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T20:17:27.958037] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-10-17T20:17:28.300238] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T20:17:28.758030] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-17T20:17:29.558138] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-17T20:17:29.661107] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T20:17:30.094699] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T20:17:30.358020] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-17T20:17:31.091831] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T20:17:31.157995] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-17T20:17:31.709198] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-17T20:17:31.713811] [INFO ] [REMOTE ] MSGE: Full fetch complete (40281 records). [2025-10-17T20:17:31.713900] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-17T20:17:31.963182] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-17T20:17:32.079717] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-10-17T20:17:32.079800] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-10-17T20:17:32.080518] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-10-17T20:17:32.080559] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-10-17T20:17:32.081398] [DEBUG] [LOCAL ] MSGE: Trimmed 40281 records to 27423 (keeping 200 days of data) [2025-10-17T20:17:32.233256] [DEBUG] [LOCAL ] MSGE: Primary data saved (27423 records). [2025-10-17T20:17:32.233393] [INFO ] [MAIN ] MSGE: Full history saved. [2025-10-17T20:17:32.233465] [INFO ] [MAIN ] Update Progress: 1406/2368 symbols completed. MSGE took 25.1s. Estimated remaining: 2h 15m 7s. Rate: 7.1 symbols/min [2025-10-17T20:17:32.398004] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:17:32.398161] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-17T20:17:32.398197] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-17T20:17:32.398304] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-17T20:17:32.398344] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-17T20:17:32.398386] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-17T20:17:32.398417] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-17T20:17:32.748395] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:17:32.757984] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-10-17T20:17:32.811000] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T20:17:33.040983] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T20:17:33.041366] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-10-17T20:17:33.041450] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:17:33.041497] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-10-17T20:17:33.041554] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:17:33.041628] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-17T20:17:33.041734] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-17T20:17:33.041777] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-17T20:17:33.041818] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-17T20:17:33.041868] [INFO ] [MAIN ] Update Progress: 1407/2368 symbols completed. MSIF took 0.8s. Estimated remaining: 2h 14m 53s. Rate: 7.1 symbols/min [2025-10-17T20:17:33.208992] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:17:33.209199] [DEBUG] [LOCAL ] MSM: No existing data file found in primary storage. [2025-10-17T20:17:33.209236] [WARN ] [MAIN ] MSM: No existing data found, performing full refresh instead. [2025-10-17T20:17:33.209361] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-17T20:17:33.209402] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-17T20:17:33.209442] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-17T20:17:33.209475] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-17T20:17:33.562006] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:17:33.558922] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-17T20:17:33.595437] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T20:17:33.601844] [INFO ] [REMOTE ] MSDL: Full fetch complete (56203 records). [2025-10-17T20:17:33.601973] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-17T20:17:33.984942] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-10-17T20:17:33.985027] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-10-17T20:17:33.985924] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-10-17T20:17:33.985986] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-10-17T20:17:33.987160] [DEBUG] [LOCAL ] MSDL: Trimmed 56203 records to 39331 (keeping 200 days of data) [2025-10-17T20:17:34.220761] [DEBUG] [LOCAL ] MSDL: Primary data saved (39331 records). [2025-10-17T20:17:34.220916] [INFO ] [MAIN ] MSDL: Full history saved. [2025-10-17T20:17:34.220991] [INFO ] [MAIN ] Update Progress: 1408/2368 symbols completed. MSDL took 37.1s. Estimated remaining: 2h 14m 40s. Rate: 7.1 symbols/min [2025-10-17T20:17:34.364920] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-17T20:17:34.400193] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:17:34.400597] [DEBUG] [LOCAL ] MT: No existing data file found in primary storage. [2025-10-17T20:17:34.400679] [WARN ] [MAIN ] MT: No existing data found, performing full refresh instead. [2025-10-17T20:17:34.400800] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-17T20:17:34.400848] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-17T20:17:34.400891] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-17T20:17:34.400924] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-17T20:17:34.761809] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T20:17:34.775500] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:17:35.158023] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-10-17T20:17:35.958095] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-17T20:17:36.648079] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-17T20:17:36.733403] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T20:17:36.757992] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-17T20:17:36.776333] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T20:17:37.558019] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-10-17T20:17:38.358035] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-17T20:17:38.393200] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T20:17:39.158028] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-17T20:17:39.416852] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-17T20:17:39.563055] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T20:17:39.958022] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-17T20:17:40.525357] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T20:17:40.758015] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-17T20:17:41.558020] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-17T20:17:42.042386] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-17T20:17:42.358051] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-17T20:17:42.452868] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T20:17:42.714792] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T20:17:43.117908] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T20:17:43.158039] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-17T20:17:43.958038] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-17T20:17:44.758049] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-17T20:17:45.013393] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T20:17:45.035800] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T20:17:45.558019] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-17T20:17:46.358045] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-17T20:17:46.501055] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T20:17:47.158005] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-17T20:17:47.188962] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T20:17:47.248020] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T20:17:47.958090] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-17T20:17:48.683444] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T20:17:48.757994] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-17T20:17:49.331310] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-17T20:17:49.558017] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-17T20:17:50.358009] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-17T20:17:50.388898] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T20:17:50.968834] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T20:17:51.158026] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-17T20:17:51.180752] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T20:17:51.183922] [INFO ] [REMOTE ] MSGS: Full fetch complete (23752 records). [2025-10-17T20:17:51.184016] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-17T20:17:51.546502] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-10-17T20:17:51.546602] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-10-17T20:17:51.547126] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-10-17T20:17:51.547190] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-10-17T20:17:51.548075] [DEBUG] [LOCAL ] MSGS: Trimmed 23752 records to 17627 (keeping 200 days of data) [2025-10-17T20:17:51.650965] [DEBUG] [LOCAL ] MSGS: Primary data saved (17627 records). [2025-10-17T20:17:51.651108] [INFO ] [MAIN ] MSGS: Full history saved. [2025-10-17T20:17:51.651194] [INFO ] [MAIN ] Update Progress: 1409/2368 symbols completed. MSGS took 38.7s. Estimated remaining: 2h 14m 37s. Rate: 7.1 symbols/min [2025-10-17T20:17:51.819039] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:17:51.819240] [DEBUG] [LOCAL ] MTB: No existing data file found in primary storage. [2025-10-17T20:17:51.819278] [WARN ] [MAIN ] MTB: No existing data found, performing full refresh instead. [2025-10-17T20:17:51.819393] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-17T20:17:51.819615] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-17T20:17:51.819687] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-17T20:17:51.819735] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-17T20:17:51.965572] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-17T20:17:52.173395] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:17:52.716713] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T20:17:52.757988] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-17T20:17:53.558037] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-17T20:17:53.753629] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T20:17:53.815030] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T20:17:54.358053] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-17T20:17:55.158026] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-17T20:17:55.310693] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T20:17:55.593255] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-17T20:17:55.958072] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-10-17T20:17:56.626556] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-17T20:17:56.758012] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-17T20:17:57.558053] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-17T20:17:57.794801] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T20:17:58.138177] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T20:17:58.144713] [INFO ] [REMOTE ] MSM: Full fetch complete (52111 records). [2025-10-17T20:17:58.144882] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-17T20:17:58.366011] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-17T20:17:58.535556] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-10-17T20:17:58.535635] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-10-17T20:17:58.536543] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-10-17T20:17:58.536605] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-10-17T20:17:58.537814] [DEBUG] [LOCAL ] MSM: Trimmed 52111 records to 36195 (keeping 200 days of data) [2025-10-17T20:17:58.752534] [DEBUG] [LOCAL ] MSM: Primary data saved (36195 records). [2025-10-17T20:17:58.752726] [INFO ] [MAIN ] MSM: Full history saved. [2025-10-17T20:17:58.752813] [INFO ] [MAIN ] Update Progress: 1410/2368 symbols completed. MSM took 25.7s. Estimated remaining: 2h 14m 28s. Rate: 7.1 symbols/min [2025-10-17T20:17:58.918906] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:17:58.940782] [DEBUG] [LOCAL ] MTD: Loaded 15539 existing records from primary storage. [2025-10-17T20:17:58.941107] [INFO ] [MAIN ] MTD: Loaded 15539 existing records. [2025-10-17T20:17:59.116713] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:17:59.116974] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-17T20:17:59.117033] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-17T20:17:59.117252] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-10-17T20:17:59.117435] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-17T20:17:59.171238] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-17T20:17:59.478730] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:17:59.513548] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T20:17:59.958000] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-10-17T20:18:00.018288] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T20:18:00.181321] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T20:18:00.758070] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-17T20:18:01.013840] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-17T20:18:01.558040] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-17T20:18:02.358001] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-17T20:18:02.869946] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-17T20:18:03.129348] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-17T20:18:03.134314] [INFO ] [REMOTE ] MSI: Full fetch complete (57917 records). [2025-10-17T20:18:03.134452] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-17T20:18:03.135213] [FATAL] [VALIDATOR ] MSI: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T20:18:03.135304] [FATAL] [MAIN ] MSI: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:18:03.135348] [WARN ] [MAIN ] MSI: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:18:03.135415] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-17T20:18:03.135483] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-17T20:18:03.135519] [INFO ] [LOCAL ] MSI: Starting deletion of derivative data. [2025-10-17T20:18:03.135558] [DEBUG] [LOCAL ] MSI: No derivative data file found to delete. [2025-10-17T20:18:03.135616] [INFO ] [MAIN ] Update Progress: 1411/2368 symbols completed. MSI took 36.0s. Estimated remaining: 2h 14m 17s. Rate: 7.1 symbols/min [2025-10-17T20:18:03.167716] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-17T20:18:03.347343] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:18:03.347715] [DEBUG] [LOCAL ] MTDR: No existing data file found in primary storage. [2025-10-17T20:18:03.347857] [WARN ] [MAIN ] MTDR: No existing data found, performing full refresh instead. [2025-10-17T20:18:03.348055] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-17T20:18:03.348232] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-17T20:18:03.348324] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-17T20:18:03.348495] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-17T20:18:03.535915] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-17T20:18:03.794996] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:18:03.958005] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-17T20:18:04.758005] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-17T20:18:05.069983] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T20:18:05.389087] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T20:18:05.557994] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-17T20:18:05.808744] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-17T20:18:06.358047] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-17T20:18:07.158123] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-17T20:18:07.608122] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-17T20:18:07.958006] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-17T20:18:08.235403] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T20:18:08.369518] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-17T20:18:08.758131] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-17T20:18:09.558014] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-17T20:18:09.876440] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-17T20:18:10.357996] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-17T20:18:10.515956] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T20:18:10.638637] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T20:18:11.158053] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-17T20:18:11.958002] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-17T20:18:12.192286] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T20:18:12.758012] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-17T20:18:12.958488] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T20:18:13.299876] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T20:18:13.558027] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-17T20:18:14.242710] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T20:18:14.249962] [INFO ] [REMOTE ] MT: Full fetch complete (73784 records). [2025-10-17T20:18:14.250093] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-17T20:18:14.363167] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-17T20:18:14.643726] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-10-17T20:18:14.643820] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-10-17T20:18:14.644958] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-10-17T20:18:14.645021] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-10-17T20:18:14.646392] [DEBUG] [LOCAL ] MT: Trimmed 73784 records to 51241 (keeping 200 days of data) [2025-10-17T20:18:14.962744] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T20:18:14.965044] [DEBUG] [LOCAL ] MT: Primary data saved (51241 records). [2025-10-17T20:18:14.973238] [INFO ] [MAIN ] MT: Full history saved. [2025-10-17T20:18:14.973869] [INFO ] [MAIN ] Update Progress: 1412/2368 symbols completed. MT took 40.8s. Estimated remaining: 2h 14m 11s. Rate: 7.1 symbols/min [2025-10-17T20:18:15.139141] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:18:15.139353] [DEBUG] [LOCAL ] MTG: No existing data file found in primary storage. [2025-10-17T20:18:15.139392] [WARN ] [MAIN ] MTG: No existing data found, performing full refresh instead. [2025-10-17T20:18:15.139556] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-17T20:18:15.139627] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-17T20:18:15.139714] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-17T20:18:15.139756] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-17T20:18:15.169770] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-17T20:18:15.490077] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:18:15.958006] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-10-17T20:18:15.994565] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T20:18:16.377492] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T20:18:16.758034] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-17T20:18:17.557999] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-17T20:18:17.808141] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T20:18:17.839052] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T20:18:18.358052] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-10-17T20:18:19.161223] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-17T20:18:19.466883] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T20:18:19.958002] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-17T20:18:20.132489] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T20:18:20.758012] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-17T20:18:20.847977] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T20:18:21.558012] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-17T20:18:21.690242] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T20:18:21.724606] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T20:18:22.358037] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-17T20:18:22.942372] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T20:18:23.158034] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-17T20:18:23.958016] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-17T20:18:24.081159] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T20:18:24.758027] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-17T20:18:24.811717] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T20:18:24.820754] [INFO ] [REMOTE ] MTB: Full fetch complete (68304 records). [2025-10-17T20:18:24.820971] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-17T20:18:25.073331] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T20:18:25.232187] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-10-17T20:18:25.232291] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-10-17T20:18:25.233399] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-10-17T20:18:25.233463] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-10-17T20:18:25.234870] [DEBUG] [LOCAL ] MTB: Trimmed 68304 records to 47322 (keeping 200 days of data) [2025-10-17T20:18:25.532072] [DEBUG] [LOCAL ] MTB: Primary data saved (47322 records). [2025-10-17T20:18:25.532285] [INFO ] [MAIN ] MTB: Full history saved. [2025-10-17T20:18:25.532404] [INFO ] [MAIN ] Update Progress: 1413/2368 symbols completed. MTB took 33.9s. Estimated remaining: 2h 14m 4s. Rate: 7.1 symbols/min [2025-10-17T20:18:25.563204] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-17T20:18:25.710721] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:18:25.710927] [DEBUG] [LOCAL ] MTH: No existing data file found in primary storage. [2025-10-17T20:18:25.710967] [WARN ] [MAIN ] MTH: No existing data found, performing full refresh instead. [2025-10-17T20:18:25.711093] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-17T20:18:25.711136] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-17T20:18:25.711179] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-17T20:18:25.711214] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-17T20:18:26.064377] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:18:26.358076] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-10-17T20:18:26.444348] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T20:18:27.040825] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T20:18:27.158097] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-17T20:18:27.482459] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T20:18:27.958074] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-17T20:18:28.758054] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-17T20:18:29.017592] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T20:18:29.558001] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-17T20:18:29.670484] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T20:18:30.358040] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-17T20:18:30.686041] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T20:18:31.102983] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T20:18:31.158010] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-17T20:18:31.958003] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-17T20:18:32.066133] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T20:18:32.758000] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-17T20:18:32.969879] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T20:18:32.972375] [INFO ] [REMOTE ] MTD: Full fetch complete (21431 records). [2025-10-17T20:18:32.972476] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-17T20:18:33.316572] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-17T20:18:33.400782] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-10-17T20:18:33.400914] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-10-17T20:18:33.401386] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-10-17T20:18:33.401449] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-10-17T20:18:33.402069] [DEBUG] [LOCAL ] MTD: Trimmed 21431 records to 15618 (keeping 200 days of data) [2025-10-17T20:18:33.503298] [DEBUG] [LOCAL ] MTD: Primary data saved (15618 records). [2025-10-17T20:18:33.503450] [INFO ] [MAIN ] MTD: Full history saved. [2025-10-17T20:18:33.503530] [INFO ] [MAIN ] Update Progress: 1414/2368 symbols completed. MTD took 34.8s. Estimated remaining: 2h 13m 55s. Rate: 7.1 symbols/min [2025-10-17T20:18:33.565029] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-17T20:18:33.674428] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:18:33.674607] [DEBUG] [LOCAL ] MTN: No existing data file found in primary storage. [2025-10-17T20:18:33.674667] [WARN ] [MAIN ] MTN: No existing data found, performing full refresh instead. [2025-10-17T20:18:33.674790] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-17T20:18:33.674831] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-17T20:18:33.674872] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-17T20:18:33.674904] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-17T20:18:34.024598] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:18:34.358001] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-10-17T20:18:34.400720] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T20:18:35.158068] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-17T20:18:35.320748] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T20:18:35.899055] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T20:18:35.957978] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-17T20:18:36.638520] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T20:18:36.758049] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-17T20:18:37.511995] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T20:18:37.558019] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-17T20:18:38.358005] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-17T20:18:38.601362] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T20:18:39.098968] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T20:18:39.158041] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-17T20:18:39.871329] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T20:18:39.958066] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-17T20:18:40.758049] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-17T20:18:41.050505] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-17T20:18:41.558013] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-17T20:18:41.791159] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T20:18:42.358005] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-17T20:18:42.424573] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T20:18:43.158010] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-17T20:18:43.627119] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-17T20:18:43.920556] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T20:18:43.958019] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-17T20:18:44.679276] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T20:18:44.758022] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-17T20:18:45.253976] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T20:18:45.558018] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-17T20:18:46.013045] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-17T20:18:46.358019] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-17T20:18:47.158049] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-17T20:18:47.347395] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T20:18:47.958037] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-17T20:18:48.195952] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T20:18:48.758063] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-17T20:18:48.827868] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T20:18:49.557997] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-17T20:18:49.680575] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T20:18:50.358025] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-17T20:18:50.598683] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T20:18:51.158016] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-17T20:18:51.221293] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T20:18:51.958061] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-17T20:18:52.010954] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T20:18:52.758046] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-17T20:18:52.904593] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T20:18:52.911876] [INFO ] [REMOTE ] MTDR: Full fetch complete (74193 records). [2025-10-17T20:18:52.911997] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-17T20:18:53.317634] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-10-17T20:18:53.317792] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-10-17T20:18:53.318889] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-10-17T20:18:53.318975] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-10-17T20:18:53.320685] [DEBUG] [LOCAL ] MTDR: Trimmed 74193 records to 52441 (keeping 200 days of data) [2025-10-17T20:18:53.475453] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T20:18:53.581083] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-17T20:18:53.697764] [DEBUG] [LOCAL ] MTDR: Primary data saved (52441 records). [2025-10-17T20:18:53.697916] [INFO ] [MAIN ] MTDR: Full history saved. [2025-10-17T20:18:53.697992] [INFO ] [MAIN ] Update Progress: 1415/2368 symbols completed. MTDR took 50.6s. Estimated remaining: 2h 13m 55s. Rate: 7.1 symbols/min [2025-10-17T20:18:53.887828] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:18:53.888055] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-17T20:18:53.888110] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-17T20:18:53.888223] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-17T20:18:53.888289] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-17T20:18:53.888332] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-17T20:18:53.888364] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-17T20:18:54.252619] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:18:54.272482] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T20:18:54.279957] [INFO ] [REMOTE ] MTG: Full fetch complete (74213 records). [2025-10-17T20:18:54.280123] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-17T20:18:54.363146] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-17T20:18:54.667414] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-10-17T20:18:54.667514] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-10-17T20:18:54.668710] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-10-17T20:18:54.668775] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-10-17T20:18:54.670229] [DEBUG] [LOCAL ] MTG: Trimmed 74213 records to 51857 (keeping 200 days of data) [2025-10-17T20:18:54.983809] [DEBUG] [LOCAL ] MTG: Primary data saved (51857 records). [2025-10-17T20:18:54.983979] [INFO ] [MAIN ] MTG: Full history saved. [2025-10-17T20:18:54.984059] [INFO ] [MAIN ] Update Progress: 1416/2368 symbols completed. MTG took 40.0s. Estimated remaining: 2h 13m 41s. Rate: 7.1 symbols/min [2025-10-17T20:18:55.155780] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:18:55.155979] [DEBUG] [LOCAL ] MTRN: No existing data file found in primary storage. [2025-10-17T20:18:55.156028] [WARN ] [MAIN ] MTRN: No existing data found, performing full refresh instead. [2025-10-17T20:18:55.156140] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-17T20:18:55.156182] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-17T20:18:55.156223] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-17T20:18:55.156255] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-17T20:18:55.186906] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-10-17T20:18:55.555269] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:18:55.557322] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T20:18:55.743264] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-17T20:18:55.958047] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-17T20:18:56.061051] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T20:18:56.758034] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-17T20:18:57.331740] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-17T20:18:57.558002] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-17T20:18:57.578413] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T20:18:57.584397] [INFO ] [REMOTE ] MTH: Full fetch complete (64011 records). [2025-10-17T20:18:57.584500] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-17T20:18:57.955798] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-10-17T20:18:57.955878] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-10-17T20:18:57.956760] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-10-17T20:18:57.956823] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-10-17T20:18:57.958054] [DEBUG] [LOCAL ] MTH: Trimmed 64011 records to 44523 (keeping 200 days of data) [2025-10-17T20:18:58.023284] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T20:18:58.240834] [DEBUG] [LOCAL ] MTH: Primary data saved (44523 records). [2025-10-17T20:18:58.240986] [INFO ] [MAIN ] MTH: Full history saved. [2025-10-17T20:18:58.241064] [INFO ] [MAIN ] Update Progress: 1417/2368 symbols completed. MTH took 32.7s. Estimated remaining: 2h 13m 30s. Rate: 7.1 symbols/min [2025-10-17T20:18:58.363147] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-17T20:18:58.434893] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:18:58.435033] [DEBUG] [LOCAL ] MTUS: No existing data file found in primary storage. [2025-10-17T20:18:58.435071] [WARN ] [MAIN ] MTUS: No existing data found, performing full refresh instead. [2025-10-17T20:18:58.435199] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-17T20:18:58.435252] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-17T20:18:58.435295] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-17T20:18:58.435329] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-17T20:18:58.780317] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:18:59.158045] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-10-17T20:18:59.876301] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T20:18:59.882330] [INFO ] [REMOTE ] MTN: Full fetch complete (56880 records). [2025-10-17T20:18:59.882467] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-17T20:18:59.963176] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-10-17T20:19:00.261631] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-10-17T20:19:00.261741] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-10-17T20:19:00.262709] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-10-17T20:19:00.262773] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-10-17T20:19:00.263911] [DEBUG] [LOCAL ] MTN: Trimmed 56880 records to 40099 (keeping 200 days of data) [2025-10-17T20:19:00.515757] [DEBUG] [LOCAL ] MTN: Primary data saved (40099 records). [2025-10-17T20:19:00.515885] [INFO ] [MAIN ] MTN: Full history saved. [2025-10-17T20:19:00.515977] [INFO ] [MAIN ] Update Progress: 1418/2368 symbols completed. MTN took 27.0s. Estimated remaining: 2h 13m 17s. Rate: 7.1 symbols/min [2025-10-17T20:19:00.684779] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:19:00.684949] [DEBUG] [LOCAL ] MTW: No existing data file found in primary storage. [2025-10-17T20:19:00.684985] [WARN ] [MAIN ] MTW: No existing data found, performing full refresh instead. [2025-10-17T20:19:00.685092] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-17T20:19:00.685134] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-17T20:19:00.685174] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-17T20:19:00.685205] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-17T20:19:00.759762] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-17T20:19:00.921132] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T20:19:01.051065] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T20:19:01.092379] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:19:01.315162] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-17T20:19:01.558052] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-17T20:19:02.358033] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-10-17T20:19:02.890087] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T20:19:03.158033] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-17T20:19:03.621503] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T20:19:03.958080] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-17T20:19:04.078127] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-17T20:19:04.758051] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-17T20:19:05.303006] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T20:19:05.558034] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-17T20:19:05.981347] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T20:19:06.192351] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T20:19:06.358014] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-17T20:19:07.158014] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-17T20:19:07.458589] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-17T20:19:07.632739] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-17T20:19:07.958040] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-17T20:19:08.063535] [DEBUG] [REMOTE ] MTUS: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-17T20:19:08.063868] [WARN ] [REMOTE ] MTUS: No data returned for month 2025-03 [2025-10-17T20:19:08.063956] [FATAL] [REMOTE ] MTUS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:19:08.064068] [FATAL] [MAIN ] MTUS: Failed to fetch primary data. [2025-10-17T20:19:08.064135] [WARN ] [MAIN ] MTUS: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:19:08.064206] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-17T20:19:08.064269] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-17T20:19:08.064305] [INFO ] [LOCAL ] MTUS: Starting deletion of derivative data. [2025-10-17T20:19:08.064344] [DEBUG] [LOCAL ] MTUS: No derivative data file found to delete. [2025-10-17T20:19:08.064387] [INFO ] [MAIN ] Update Progress: 1419/2368 symbols completed. MTUS took 9.8s. Estimated remaining: 2h 13m 8s. Rate: 7.1 symbols/min [2025-10-17T20:19:08.237939] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:19:08.238133] [DEBUG] [LOCAL ] MTX: No existing data file found in primary storage. [2025-10-17T20:19:08.238206] [WARN ] [MAIN ] MTX: No existing data found, performing full refresh instead. [2025-10-17T20:19:08.238332] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-17T20:19:08.238376] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-17T20:19:08.238419] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-17T20:19:08.238453] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-17T20:19:08.610525] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:19:08.758035] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-17T20:19:09.558017] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-10-17T20:19:10.088299] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T20:19:10.358038] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-17T20:19:10.640509] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T20:19:11.158083] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-17T20:19:11.623092] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T20:19:11.624296] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-17T20:19:11.958064] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-17T20:19:12.758028] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-17T20:19:12.989606] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T20:19:13.558005] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-17T20:19:13.865756] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T20:19:14.358061] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-17T20:19:14.762496] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T20:19:15.158068] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-17T20:19:15.630948] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-17T20:19:15.958109] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-17T20:19:16.259296] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-17T20:19:16.758019] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-17T20:19:16.802410] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T20:19:17.557985] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-17T20:19:17.957515] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T20:19:18.358090] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-17T20:19:18.809328] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-17T20:19:19.158073] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-17T20:19:19.381379] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-17T20:19:19.572955] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-17T20:19:19.958039] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-17T20:19:20.758039] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-17T20:19:21.056055] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T20:19:21.558025] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-17T20:19:21.975482] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T20:19:22.358036] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-17T20:19:22.806578] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-17T20:19:23.158029] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-17T20:19:23.572759] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-17T20:19:23.958039] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-17T20:19:24.331954] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-17T20:19:24.758034] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-17T20:19:25.239167] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T20:19:25.563301] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-17T20:19:25.570984] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T20:19:26.030439] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-17T20:19:26.358060] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-17T20:19:26.760530] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-17T20:19:27.158012] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-17T20:19:27.958013] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-17T20:19:28.214150] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-17T20:19:28.217198] [INFO ] [REMOTE ] MTRN: Full fetch complete (24066 records). [2025-10-17T20:19:28.217281] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-17T20:19:28.612388] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-10-17T20:19:28.612458] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-10-17T20:19:28.613043] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-10-17T20:19:28.613106] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-10-17T20:19:28.613970] [DEBUG] [LOCAL ] MTRN: Trimmed 24066 records to 18534 (keeping 200 days of data) [2025-10-17T20:19:28.736029] [DEBUG] [LOCAL ] MTRN: Primary data saved (18534 records). [2025-10-17T20:19:28.736173] [INFO ] [MAIN ] MTRN: Full history saved. [2025-10-17T20:19:28.736246] [INFO ] [MAIN ] Update Progress: 1420/2368 symbols completed. MTRN took 33.8s. Estimated remaining: 2h 13m 8s. Rate: 7.1 symbols/min [2025-10-17T20:19:28.759675] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-17T20:19:28.908034] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:19:28.908243] [DEBUG] [LOCAL ] MTZ: No existing data file found in primary storage. [2025-10-17T20:19:28.908299] [WARN ] [MAIN ] MTZ: No existing data found, performing full refresh instead. [2025-10-17T20:19:28.908443] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-17T20:19:28.908510] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-17T20:19:28.908564] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-17T20:19:28.908597] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-17T20:19:29.196042] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T20:19:29.215769] [INFO ] [REMOTE ] MTW: Full fetch complete (38150 records). [2025-10-17T20:19:29.249083] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-17T20:19:29.281328] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:19:29.363158] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T20:19:29.382374] [INFO ] [REMOTE ] MTR: Full fetch complete (2382 records). [2025-10-17T20:19:29.384611] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-17T20:19:29.566681] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-10-17T20:19:29.732904] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T20:19:29.745158] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:19:29.765831] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:19:29.768517] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-17T20:19:29.768920] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-17T20:19:29.779430] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-17T20:19:29.813502] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-17T20:19:29.825718] [INFO ] [MAIN ] Update Progress: 1421/2368 symbols completed. MTR took 36.1s. Estimated remaining: 2h 12m 54s. Rate: 7.1 symbols/min [2025-10-17T20:19:29.937882] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-10-17T20:19:29.948288] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-10-17T20:19:29.957068] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-10-17T20:19:29.959415] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-10-17T20:19:30.004625] [DEBUG] [LOCAL ] MTW: Trimmed 38150 records to 26834 (keeping 200 days of data) [2025-10-17T20:19:30.029742] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:19:30.123731] [DEBUG] [LOCAL ] MUA: Loaded 11602 existing records from primary storage. [2025-10-17T20:19:30.125928] [INFO ] [MAIN ] MUA: Loaded 11602 existing records. [2025-10-17T20:19:30.316228] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:19:30.318067] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-17T20:19:30.320100] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-17T20:19:30.323910] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-10-17T20:19:30.324268] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-17T20:19:30.367684] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-17T20:19:30.648876] [DEBUG] [LOCAL ] MTW: Primary data saved (26834 records). [2025-10-17T20:19:30.659495] [INFO ] [MAIN ] MTW: Full history saved. [2025-10-17T20:19:30.664736] [INFO ] [MAIN ] Update Progress: 1422/2368 symbols completed. MTW took 30.1s. Estimated remaining: 2h 12m 41s. Rate: 7.1 symbols/min [2025-10-17T20:19:30.839978] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:19:30.911247] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:19:30.911421] [DEBUG] [LOCAL ] MUC: No existing data file found in primary storage. [2025-10-17T20:19:30.911459] [WARN ] [MAIN ] MUC: No existing data found, performing full refresh instead. [2025-10-17T20:19:30.911576] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-17T20:19:30.911616] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-17T20:19:30.911689] [DEBUG] [LOCAL ] MUC: No primary data file found to delete. [2025-10-17T20:19:30.911738] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-17T20:19:31.163296] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-10-17T20:19:31.266534] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:19:31.349557] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T20:19:31.744094] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T20:19:31.889235] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T20:19:31.958022] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-10-17T20:19:32.758033] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-17T20:19:33.291753] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T20:19:33.558054] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-17T20:19:34.358051] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-17T20:19:34.392851] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T20:19:34.532447] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T20:19:35.158021] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-17T20:19:35.517487] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T20:19:35.958020] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-17T20:19:36.141943] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T20:19:36.758046] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-17T20:19:37.527393] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T20:19:37.558026] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-17T20:19:37.859486] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T20:19:38.358026] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-17T20:19:39.158014] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-17T20:19:39.269321] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T20:19:39.288602] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T20:19:39.957993] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-17T20:19:40.182179] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T20:19:40.758012] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-17T20:19:41.045312] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T20:19:41.496318] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-17T20:19:41.557990] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-17T20:19:42.358028] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-17T20:19:43.158084] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-17T20:19:43.250163] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T20:19:43.628919] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T20:19:43.958008] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-17T20:19:44.181924] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-17T20:19:44.758033] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-17T20:19:45.558010] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-17T20:19:45.616328] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T20:19:46.150457] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T20:19:46.358033] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-17T20:19:46.375505] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T20:19:47.158032] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-17T20:19:47.581962] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T20:19:47.958034] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-17T20:19:48.310042] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T20:19:48.757992] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-17T20:19:49.142605] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T20:19:49.558021] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-17T20:19:50.314390] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T20:19:50.358008] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-17T20:19:50.516737] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T20:19:51.151836] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T20:19:51.154727] [INFO ] [REMOTE ] MTX: Full fetch complete (31413 records). [2025-10-17T20:19:51.154812] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-17T20:19:51.166094] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-17T20:19:51.524207] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-10-17T20:19:51.524311] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-10-17T20:19:51.524956] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-10-17T20:19:51.525017] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-10-17T20:19:51.525817] [DEBUG] [LOCAL ] MTX: Trimmed 31413 records to 22982 (keeping 200 days of data) [2025-10-17T20:19:51.663203] [DEBUG] [LOCAL ] MTX: Primary data saved (22982 records). [2025-10-17T20:19:51.663339] [INFO ] [MAIN ] MTX: Full history saved. [2025-10-17T20:19:51.663414] [INFO ] [MAIN ] Update Progress: 1423/2368 symbols completed. MTX took 43.6s. Estimated remaining: 2h 12m 41s. Rate: 7.1 symbols/min [2025-10-17T20:19:51.829685] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:19:51.842620] [DEBUG] [LOCAL ] MUE: Loaded 12115 existing records from primary storage. [2025-10-17T20:19:51.842855] [INFO ] [MAIN ] MUE: Loaded 12115 existing records. [2025-10-17T20:19:51.963110] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-17T20:19:52.024816] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:19:52.025310] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-17T20:19:52.025404] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-17T20:19:52.025682] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-10-17T20:19:52.025741] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-17T20:19:52.133556] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-17T20:19:52.391271] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:19:52.758017] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-17T20:19:53.558054] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-10-17T20:19:53.625012] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T20:19:53.745983] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T20:19:54.358026] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-17T20:19:54.586906] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-17T20:19:55.158073] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-17T20:19:55.204089] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T20:19:55.958020] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-17T20:19:56.338144] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T20:19:56.758068] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-17T20:19:57.558072] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-17T20:19:57.718516] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T20:19:57.942172] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-17T20:19:58.130190] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-17T20:19:58.358112] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-17T20:19:59.158053] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-17T20:19:59.219302] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T20:19:59.958068] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-17T20:20:00.758019] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-17T20:20:00.837211] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T20:20:01.451965] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T20:20:01.558037] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-17T20:20:01.745167] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T20:20:02.358024] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-17T20:20:03.011740] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T20:20:03.158056] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-17T20:20:03.958045] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-17T20:20:04.079937] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T20:20:04.086073] [INFO ] [REMOTE ] MTZ: Full fetch complete (63888 records). [2025-10-17T20:20:04.086179] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-17T20:20:04.188889] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T20:20:04.209154] [INFO ] [REMOTE ] MUA: Full fetch complete (18461 records). [2025-10-17T20:20:04.219495] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-17T20:20:04.782071] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-10-17T20:20:04.758826] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-17T20:20:04.782247] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-10-17T20:20:04.784849] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-10-17T20:20:04.793758] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-10-17T20:20:04.802109] [DEBUG] [LOCAL ] MTZ: Trimmed 63888 records to 43615 (keeping 200 days of data) [2025-10-17T20:20:04.967150] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-10-17T20:20:04.971391] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-10-17T20:20:04.972734] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-10-17T20:20:04.975082] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-10-17T20:20:04.979629] [DEBUG] [LOCAL ] MUA: Trimmed 18461 records to 11702 (keeping 200 days of data) [2025-10-17T20:20:05.073384] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T20:20:05.078766] [INFO ] [REMOTE ] MUC: Full fetch complete (29582 records). [2025-10-17T20:20:05.080080] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-17T20:20:05.097457] [DEBUG] [LOCAL ] MUA: Primary data saved (11702 records). [2025-10-17T20:20:05.120027] [INFO ] [MAIN ] MUA: Full history saved. [2025-10-17T20:20:05.205422] [INFO ] [MAIN ] Update Progress: 1424/2368 symbols completed. MUA took 35.4s. Estimated remaining: 2h 12m 36s. Rate: 7.1 symbols/min [2025-10-17T20:20:05.649919] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:20:05.663409] [DEBUG] [LOCAL ] MUFG: No existing data file found in primary storage. [2025-10-17T20:20:05.667097] [WARN ] [MAIN ] MUFG: No existing data found, performing full refresh instead. [2025-10-17T20:20:05.674241] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-17T20:20:05.674339] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-17T20:20:05.687746] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-17T20:20:05.755612] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-17T20:20:05.770793] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-10-17T20:20:05.770992] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-10-17T20:20:05.801227] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-10-17T20:20:05.822726] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-10-17T20:20:05.824086] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T20:20:05.852606] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-17T20:20:05.904734] [DEBUG] [LOCAL ] MUC: Trimmed 29582 records to 21055 (keeping 200 days of data) [2025-10-17T20:20:05.932088] [DEBUG] [LOCAL ] MTZ: Primary data saved (43615 records). [2025-10-17T20:20:06.029371] [INFO ] [MAIN ] MTZ: Full history saved. [2025-10-17T20:20:06.073882] [INFO ] [MAIN ] Update Progress: 1425/2368 symbols completed. MTZ took 37.3s. Estimated remaining: 2h 12m 22s. Rate: 7.1 symbols/min [2025-10-17T20:20:06.449896] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:20:06.482481] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:20:06.483914] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-10-17T20:20:06.483988] [DEBUG] [LOCAL ] MUJ: No existing data file found in primary storage. [2025-10-17T20:20:06.488103] [WARN ] [MAIN ] MUJ: No existing data found, performing full refresh instead. [2025-10-17T20:20:06.489096] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-17T20:20:06.489170] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-17T20:20:06.489266] [DEBUG] [LOCAL ] MUJ: No primary data file found to delete. [2025-10-17T20:20:06.489948] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-17T20:20:06.578535] [DEBUG] [LOCAL ] MUC: Primary data saved (21055 records). [2025-10-17T20:20:06.594452] [INFO ] [MAIN ] MUC: Full history saved. [2025-10-17T20:20:06.602484] [INFO ] [MAIN ] Update Progress: 1426/2368 symbols completed. MUC took 35.9s. Estimated remaining: 2h 12m 9s. Rate: 7.1 symbols/min [2025-10-17T20:20:06.897756] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:20:06.960204] [DEBUG] [LOCAL ] MUR: No existing data file found in primary storage. [2025-10-17T20:20:06.976948] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T20:20:06.970711] [WARN ] [MAIN ] MUR: No existing data found, performing full refresh instead. [2025-10-17T20:20:07.001434] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-17T20:20:07.001979] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-17T20:20:07.034305] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-17T20:20:07.049551] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-17T20:20:07.060265] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:20:07.166009] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-17T20:20:07.450798] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:20:07.958064] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-10-17T20:20:08.244161] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-17T20:20:08.554973] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-17T20:20:08.758104] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-10-17T20:20:09.558056] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-17T20:20:09.695217] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T20:20:09.908495] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T20:20:10.358094] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-17T20:20:11.114877] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T20:20:11.157986] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-17T20:20:11.393139] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T20:20:11.958067] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-17T20:20:12.081186] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-17T20:20:12.758076] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-17T20:20:12.892703] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T20:20:13.558036] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-17T20:20:14.358058] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-17T20:20:14.435970] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-17T20:20:14.555572] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-17T20:20:15.158037] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-17T20:20:15.398777] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T20:20:15.958041] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-17T20:20:16.087630] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-17T20:20:16.758040] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-17T20:20:16.870663] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T20:20:17.558019] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-17T20:20:18.358045] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-17T20:20:18.769694] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-17T20:20:19.158055] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-17T20:20:19.354065] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T20:20:19.381408] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T20:20:19.958005] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-17T20:20:20.758003] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-17T20:20:21.002193] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T20:20:21.123618] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T20:20:21.558011] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-17T20:20:21.639782] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-17T20:20:21.642562] [INFO ] [REMOTE ] MUE: Full fetch complete (16030 records). [2025-10-17T20:20:21.642664] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-17T20:20:21.998788] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-17T20:20:21.998886] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-17T20:20:21.999147] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-17T20:20:21.999188] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-17T20:20:21.999768] [DEBUG] [LOCAL ] MUE: Trimmed 16030 records to 12287 (keeping 200 days of data) [2025-10-17T20:20:22.070460] [DEBUG] [LOCAL ] MUE: Primary data saved (12287 records). [2025-10-17T20:20:22.070585] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-17T20:20:22.070687] [INFO ] [MAIN ] Update Progress: 1427/2368 symbols completed. MUE took 30.4s. Estimated remaining: 2h 12m 5s. Rate: 7.1 symbols/min [2025-10-17T20:20:22.235470] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:20:22.235588] [DEBUG] [LOCAL ] MUSA: No existing data file found in primary storage. [2025-10-17T20:20:22.235625] [WARN ] [MAIN ] MUSA: No existing data found, performing full refresh instead. [2025-10-17T20:20:22.235750] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-17T20:20:22.235790] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-17T20:20:22.235830] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-17T20:20:22.235861] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-17T20:20:22.371231] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-17T20:20:22.587250] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:20:22.626333] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T20:20:23.158026] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-17T20:20:23.958040] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-17T20:20:24.264504] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T20:20:24.419071] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T20:20:24.758022] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-17T20:20:24.942084] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-17T20:20:25.558075] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-17T20:20:26.358014] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-17T20:20:26.550820] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T20:20:27.011621] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-17T20:20:27.158038] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-17T20:20:27.387080] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T20:20:27.958031] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-10-17T20:20:28.129073] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-17T20:20:28.131789] [INFO ] [REMOTE ] MUJ: Full fetch complete (19639 records). [2025-10-17T20:20:28.131864] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-17T20:20:28.510941] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-10-17T20:20:28.511040] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-10-17T20:20:28.511466] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-10-17T20:20:28.511527] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-10-17T20:20:28.512216] [DEBUG] [LOCAL ] MUJ: Trimmed 19639 records to 14061 (keeping 200 days of data) [2025-10-17T20:20:28.596160] [DEBUG] [LOCAL ] MUJ: Primary data saved (14061 records). [2025-10-17T20:20:28.596340] [INFO ] [MAIN ] MUJ: Full history saved. [2025-10-17T20:20:28.596419] [INFO ] [MAIN ] Update Progress: 1428/2368 symbols completed. MUJ took 22.5s. Estimated remaining: 2h 11m 55s. Rate: 7.1 symbols/min [2025-10-17T20:20:28.765213] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:20:28.763693] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-17T20:20:28.766373] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-17T20:20:28.766431] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-17T20:20:28.766546] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-17T20:20:28.766589] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-17T20:20:28.766630] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-17T20:20:28.766701] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-17T20:20:29.120063] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T20:20:29.144490] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:20:29.558032] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-10-17T20:20:29.831835] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-10-17T20:20:30.358070] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-17T20:20:30.676895] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T20:20:30.688150] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T20:20:30.689057] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-17T20:20:30.689151] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:20:30.689247] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-17T20:20:30.689326] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:20:30.689409] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-17T20:20:30.689489] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-17T20:20:30.689540] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-17T20:20:30.689604] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-17T20:20:30.689716] [INFO ] [MAIN ] Update Progress: 1429/2368 symbols completed. MUSE took 2.1s. Estimated remaining: 2h 11m 43s. Rate: 7.1 symbols/min [2025-10-17T20:20:30.864281] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:20:30.864493] [DEBUG] [LOCAL ] MUX: No existing data file found in primary storage. [2025-10-17T20:20:30.864557] [WARN ] [MAIN ] MUX: No existing data found, performing full refresh instead. [2025-10-17T20:20:30.864704] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-17T20:20:30.864776] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-17T20:20:30.864847] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-17T20:20:30.864905] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-17T20:20:31.163108] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-17T20:20:31.218532] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:20:31.958036] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-17T20:20:32.437809] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T20:20:32.758076] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-17T20:20:33.558009] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-17T20:20:33.669907] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T20:20:34.027498] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-17T20:20:34.358125] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-10-17T20:20:35.158009] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-17T20:20:35.540569] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-17T20:20:35.857255] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T20:20:35.958034] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-17T20:20:36.758051] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-17T20:20:37.110044] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-17T20:20:37.401088] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T20:20:37.558035] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-17T20:20:38.048032] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-17T20:20:38.358304] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-17T20:20:39.158078] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-17T20:20:39.442798] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-17T20:20:39.958014] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-17T20:20:40.155343] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T20:20:40.462889] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T20:20:40.758072] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-17T20:20:41.558122] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-17T20:20:41.706287] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T20:20:42.359833] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-17T20:20:42.362549] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T20:20:43.158031] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-17T20:20:43.354792] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T20:20:43.381066] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-17T20:20:43.958053] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-17T20:20:44.763244] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-17T20:20:44.774629] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T20:20:45.558000] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-17T20:20:45.711451] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T20:20:45.800453] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T20:20:46.358075] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-17T20:20:47.135278] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T20:20:47.157992] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-17T20:20:47.571688] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T20:20:47.958090] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-17T20:20:48.758006] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-17T20:20:48.802349] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T20:20:48.809944] [INFO ] [REMOTE ] MUR: Full fetch complete (76832 records). [2025-10-17T20:20:48.810091] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-17T20:20:49.204686] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-10-17T20:20:49.204812] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-10-17T20:20:49.205940] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-10-17T20:20:49.206009] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-10-17T20:20:49.208093] [DEBUG] [LOCAL ] MUR: Trimmed 76832 records to 53689 (keeping 200 days of data) [2025-10-17T20:20:49.448486] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T20:20:49.558716] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-17T20:20:49.563823] [DEBUG] [LOCAL ] MUR: Primary data saved (53689 records). [2025-10-17T20:20:49.563939] [INFO ] [MAIN ] MUR: Full history saved. [2025-10-17T20:20:49.564014] [INFO ] [MAIN ] Update Progress: 1430/2368 symbols completed. MUR took 43.0s. Estimated remaining: 2h 11m 41s. Rate: 7.1 symbols/min [2025-10-17T20:20:49.770701] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:20:49.800126] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T20:20:49.814141] [DEBUG] [LOCAL ] MVF: Loaded 12832 existing records from primary storage. [2025-10-17T20:20:49.814342] [INFO ] [MAIN ] MVF: Loaded 12832 existing records. [2025-10-17T20:20:49.984276] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:20:49.984510] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-17T20:20:49.984557] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-17T20:20:49.984826] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-10-17T20:20:49.984883] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-17T20:20:50.344241] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:20:50.357992] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-10-17T20:20:51.158029] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-17T20:20:51.206289] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T20:20:51.430992] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T20:20:51.958055] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-17T20:20:52.461564] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T20:20:52.758087] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-17T20:20:52.795939] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T20:20:53.558038] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-17T20:20:53.968265] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-17T20:20:54.358077] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-17T20:20:54.405278] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-17T20:20:55.158066] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-17T20:20:55.958055] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-17T20:20:55.996463] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T20:20:56.059806] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-17T20:20:56.758091] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-17T20:20:57.558066] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-17T20:20:57.813690] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-17T20:20:57.821172] [INFO ] [REMOTE ] MUFG: Full fetch complete (75847 records). [2025-10-17T20:20:57.821350] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-17T20:20:58.214162] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-10-17T20:20:58.214252] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-10-17T20:20:58.215313] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-10-17T20:20:58.215377] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-10-17T20:20:58.216962] [DEBUG] [LOCAL ] MUFG: Trimmed 75847 records to 53237 (keeping 200 days of data) [2025-10-17T20:20:58.402012] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-17T20:20:58.554817] [DEBUG] [LOCAL ] MUFG: Primary data saved (53237 records). [2025-10-17T20:20:58.555019] [INFO ] [MAIN ] MUFG: Full history saved. [2025-10-17T20:20:58.555269] [INFO ] [MAIN ] Update Progress: 1431/2368 symbols completed. MUFG took 53.3s. Estimated remaining: 2h 11m 33s. Rate: 7.1 symbols/min [2025-10-17T20:20:58.734149] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:20:58.739899] [DEBUG] [LOCAL ] MVO: No existing data file found in primary storage. [2025-10-17T20:20:58.745339] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-17T20:20:58.764986] [WARN ] [MAIN ] MVO: No existing data found, performing full refresh instead. [2025-10-17T20:20:58.766464] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-17T20:20:58.773467] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-17T20:20:58.776204] [DEBUG] [LOCAL ] MVO: No primary data file found to delete. [2025-10-17T20:20:58.776261] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-17T20:20:58.841634] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-17T20:20:59.136603] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:20:59.157981] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-10-17T20:20:59.542054] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T20:20:59.545313] [INFO ] [REMOTE ] MUSA: Full fetch complete (35361 records). [2025-10-17T20:20:59.545391] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-17T20:20:59.909945] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-10-17T20:20:59.910040] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-10-17T20:20:59.910768] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-10-17T20:20:59.910831] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-10-17T20:20:59.911785] [DEBUG] [LOCAL ] MUSA: Trimmed 35361 records to 24959 (keeping 200 days of data) [2025-10-17T20:20:59.965113] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-17T20:21:00.058724] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-17T20:21:00.076103] [DEBUG] [LOCAL ] MUSA: Primary data saved (24959 records). [2025-10-17T20:21:00.076198] [INFO ] [MAIN ] MUSA: Full history saved. [2025-10-17T20:21:00.076264] [INFO ] [MAIN ] Update Progress: 1432/2368 symbols completed. MUSA took 38.0s. Estimated remaining: 2h 11m 20s. Rate: 7.1 symbols/min [2025-10-17T20:21:00.243100] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:21:00.254760] [DEBUG] [LOCAL ] MVT: Loaded 10069 existing records from primary storage. [2025-10-17T20:21:00.254985] [INFO ] [MAIN ] MVT: Loaded 10069 existing records. [2025-10-17T20:21:00.430762] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:21:00.431020] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-17T20:21:00.431067] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-17T20:21:00.431234] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-10-17T20:21:00.431294] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-17T20:21:00.760245] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-17T20:21:00.796020] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:21:00.973273] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-17T20:21:01.558273] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-17T20:21:01.878011] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T20:21:02.358141] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-17T20:21:02.566919] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T20:21:03.158038] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-10-17T20:21:03.323358] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T20:21:03.958146] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-17T20:21:04.173296] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-17T20:21:04.758093] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-17T20:21:04.812085] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T20:21:05.558023] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-17T20:21:05.610903] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-17T20:21:06.336107] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-17T20:21:06.358099] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-17T20:21:07.158083] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-17T20:21:07.284489] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T20:21:07.783959] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T20:21:07.958053] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-17T20:21:08.758083] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-17T20:21:08.791212] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T20:21:08.869992] [DEBUG] [REMOTE ] MVF: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-17T20:21:08.870465] [WARN ] [REMOTE ] MVF: No data returned for month 2025-08 [2025-10-17T20:21:08.870592] [FATAL] [REMOTE ] MVF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:21:08.870778] [FATAL] [MAIN ] MVF: Failed to fetch primary data. [2025-10-17T20:21:08.870870] [WARN ] [MAIN ] MVF: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:21:08.870970] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-17T20:21:08.871062] [DEBUG] [LOCAL ] MVF: No primary data file found to delete. [2025-10-17T20:21:08.871104] [INFO ] [LOCAL ] MVF: Starting deletion of derivative data. [2025-10-17T20:21:08.871328] [DEBUG] [LOCAL ] MVF: Deleted derivative data file. [2025-10-17T20:21:08.871433] [INFO ] [MAIN ] Update Progress: 1433/2368 symbols completed. MVF took 19.3s. Estimated remaining: 2h 11m 12s. Rate: 7.1 symbols/min [2025-10-17T20:21:09.057532] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:21:09.057806] [DEBUG] [LOCAL ] MWA: No existing data file found in primary storage. [2025-10-17T20:21:09.057852] [WARN ] [MAIN ] MWA: No existing data found, performing full refresh instead. [2025-10-17T20:21:09.058023] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-17T20:21:09.058073] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-17T20:21:09.058116] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-17T20:21:09.058150] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-17T20:21:09.432581] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:21:09.558007] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-10-17T20:21:10.358064] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-17T20:21:10.995052] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T20:21:11.120593] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T20:21:11.158000] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-17T20:21:11.958073] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-17T20:21:12.537710] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T20:21:12.642317] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-17T20:21:12.758030] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-17T20:21:13.558015] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-17T20:21:13.621313] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-17T20:21:14.358055] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-17T20:21:14.464164] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T20:21:15.158027] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-17T20:21:15.957996] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-17T20:21:16.035818] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T20:21:16.232618] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T20:21:16.239953] [INFO ] [REMOTE ] MUX: Full fetch complete (61072 records). [2025-10-17T20:21:16.240103] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-17T20:21:16.614887] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-10-17T20:21:16.614967] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-10-17T20:21:16.615878] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-10-17T20:21:16.615941] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-10-17T20:21:16.617116] [DEBUG] [LOCAL ] MUX: Trimmed 61072 records to 44165 (keeping 200 days of data) [2025-10-17T20:21:16.773732] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-17T20:21:16.874602] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-17T20:21:16.880515] [DEBUG] [LOCAL ] MUX: Primary data saved (44165 records). [2025-10-17T20:21:16.880587] [INFO ] [MAIN ] MUX: Full history saved. [2025-10-17T20:21:16.880670] [INFO ] [MAIN ] Update Progress: 1434/2368 symbols completed. MUX took 46.2s. Estimated remaining: 2h 11m 3s. Rate: 7.1 symbols/min [2025-10-17T20:21:17.051016] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:21:17.073076] [DEBUG] [LOCAL ] MX: Loaded 22465 existing records from primary storage. [2025-10-17T20:21:17.073540] [INFO ] [MAIN ] MX: Loaded 22465 existing records. [2025-10-17T20:21:17.244106] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:21:17.244336] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-17T20:21:17.244443] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-17T20:21:17.244616] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-10-17T20:21:17.244689] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-17T20:21:17.567749] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-17T20:21:17.598521] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:21:18.358127] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-17T20:21:18.486030] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T20:21:18.589134] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-17T20:21:19.158125] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-17T20:21:19.208139] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T20:21:19.958060] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-10-17T20:21:20.027141] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T20:21:20.758041] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-17T20:21:21.171760] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-17T20:21:21.558023] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-17T20:21:22.358031] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-17T20:21:22.381956] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-17T20:21:22.647444] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T20:21:23.146603] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T20:21:23.148586] [INFO ] [REMOTE ] MVO: Full fetch complete (14593 records). [2025-10-17T20:21:23.148708] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-10-17T20:21:23.163158] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-17T20:21:23.536946] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-10-17T20:21:23.537039] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-10-17T20:21:23.537360] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-10-17T20:21:23.537622] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-10-17T20:21:23.538129] [DEBUG] [LOCAL ] MVO: Trimmed 14593 records to 9002 (keeping 200 days of data) [2025-10-17T20:21:23.593243] [DEBUG] [LOCAL ] MVO: Primary data saved (9002 records). [2025-10-17T20:21:23.593372] [INFO ] [MAIN ] MVO: Full history saved. [2025-10-17T20:21:23.593457] [INFO ] [MAIN ] Update Progress: 1435/2368 symbols completed. MVO took 25.0s. Estimated remaining: 2h 10m 54s. Rate: 7.1 symbols/min [2025-10-17T20:21:23.765612] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:21:23.765811] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-17T20:21:23.765854] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-17T20:21:23.765969] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-17T20:21:23.766011] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-17T20:21:23.766055] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-17T20:21:23.766088] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-17T20:21:23.968610] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-17T20:21:24.124521] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:21:24.211814] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T20:21:24.758039] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-17T20:21:25.464608] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T20:21:25.466214] [INFO ] [REMOTE ] MVT: Full fetch complete (13814 records). [2025-10-17T20:21:25.466283] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-17T20:21:25.563202] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-17T20:21:25.827842] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-17T20:21:25.827934] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-17T20:21:25.828276] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-17T20:21:25.828318] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-17T20:21:25.828838] [DEBUG] [LOCAL ] MVT: Trimmed 13814 records to 10095 (keeping 200 days of data) [2025-10-17T20:21:25.889063] [DEBUG] [LOCAL ] MVT: Primary data saved (10095 records). [2025-10-17T20:21:25.889189] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-17T20:21:25.889265] [INFO ] [MAIN ] Update Progress: 1436/2368 symbols completed. MVT took 25.8s. Estimated remaining: 2h 10m 42s. Rate: 7.1 symbols/min [2025-10-17T20:21:26.058767] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:21:26.066950] [DEBUG] [LOCAL ] MXF: Loaded 5645 existing records from primary storage. [2025-10-17T20:21:26.067155] [INFO ] [MAIN ] MXF: Loaded 5645 existing records. [2025-10-17T20:21:26.246529] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:21:26.269634] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-17T20:21:26.272345] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-17T20:21:26.272595] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-10-17T20:21:26.273962] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-17T20:21:26.273047] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-17T20:21:26.363167] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-10-17T20:21:26.644914] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:21:26.687856] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T20:21:27.090498] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T20:21:27.157994] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-17T20:21:27.958023] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-17T20:21:28.540454] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-17T20:21:28.758025] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-17T20:21:28.907212] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T20:21:29.557995] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-10-17T20:21:29.864480] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T20:21:30.358043] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-17T20:21:30.380250] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-17T20:21:31.158046] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-17T20:21:31.587806] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-17T20:21:31.958046] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-17T20:21:32.503123] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-17T20:21:32.758933] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-17T20:21:32.758812] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T20:21:33.340394] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-17T20:21:33.558007] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-17T20:21:34.358035] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-17T20:21:34.808058] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-17T20:21:35.158025] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-17T20:21:35.261230] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T20:21:35.958065] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-17T20:21:36.250141] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T20:21:36.758009] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-17T20:21:36.838544] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T20:21:37.295694] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-17T20:21:37.558031] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-17T20:21:38.358001] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-17T20:21:38.417541] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T20:21:39.158032] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-17T20:21:39.635785] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-17T20:21:39.958095] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-17T20:21:40.165685] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T20:21:40.446762] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-17T20:21:40.758024] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-17T20:21:41.558001] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-17T20:21:42.358034] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-17T20:21:42.541029] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T20:21:42.586765] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T20:21:42.883260] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-17T20:21:43.158040] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-17T20:21:43.958062] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-17T20:21:44.744839] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T20:21:44.757993] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-17T20:21:44.855958] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T20:21:45.558033] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-17T20:21:46.147943] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-17T20:21:46.149560] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T20:21:46.159175] [INFO ] [REMOTE ] MWA: Full fetch complete (68085 records). [2025-10-17T20:21:46.159379] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-17T20:21:46.366228] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-17T20:21:46.552106] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-10-17T20:21:46.552189] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-10-17T20:21:46.553209] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-10-17T20:21:46.553274] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-10-17T20:21:46.554566] [DEBUG] [LOCAL ] MWA: Trimmed 68085 records to 46654 (keeping 200 days of data) [2025-10-17T20:21:46.834632] [DEBUG] [LOCAL ] MWA: Primary data saved (46654 records). [2025-10-17T20:21:46.834828] [INFO ] [MAIN ] MWA: Full history saved. [2025-10-17T20:21:46.834938] [INFO ] [MAIN ] Update Progress: 1437/2368 symbols completed. MWA took 38.0s. Estimated remaining: 2h 10m 41s. Rate: 7.1 symbols/min [2025-10-17T20:21:46.970526] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T20:21:47.158023] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-17T20:21:47.678881] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-17T20:21:47.958040] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-17T20:21:48.758003] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-17T20:21:49.123935] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T20:21:49.255503] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-17T20:21:49.256389] [INFO ] [REMOTE ] MXE: Full fetch complete (2602 records). [2025-10-17T20:21:49.256485] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-17T20:21:49.433788] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T20:21:49.433980] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:21:49.434045] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:21:49.434095] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-17T20:21:49.434212] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-17T20:21:49.434262] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-17T20:21:49.434304] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-17T20:21:49.434358] [INFO ] [MAIN ] Update Progress: 1438/2368 symbols completed. MXE took 25.8s. Estimated remaining: 2h 10m 29s. Rate: 7.1 symbols/min [2025-10-17T20:21:49.558025] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-17T20:21:50.228501] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T20:21:50.357988] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-17T20:21:51.037326] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-17T20:21:51.158042] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-17T20:21:51.958035] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-17T20:21:52.511542] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-17T20:21:52.717057] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T20:21:52.757994] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-17T20:21:53.558051] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-17T20:21:53.809263] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T20:21:54.079989] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-17T20:21:54.358138] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-17T20:21:55.055207] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T20:21:55.056630] [INFO ] [REMOTE ] MXF: Full fetch complete (9864 records). [2025-10-17T20:21:55.056736] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-17T20:21:55.158580] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-17T20:21:55.415661] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-10-17T20:21:55.415750] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-10-17T20:21:55.416020] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-10-17T20:21:55.416061] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-10-17T20:21:55.416482] [DEBUG] [LOCAL ] MXF: Trimmed 9864 records to 5717 (keeping 200 days of data) [2025-10-17T20:21:55.450140] [DEBUG] [LOCAL ] MXF: Primary data saved (5717 records). [2025-10-17T20:21:55.450230] [INFO ] [MAIN ] MXF: Full history saved. [2025-10-17T20:21:55.450306] [INFO ] [MAIN ] Update Progress: 1439/2368 symbols completed. MXF took 29.6s. Estimated remaining: 2h 10m 19s. Rate: 7.1 symbols/min [2025-10-17T20:21:56.325878] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T20:21:56.328925] [INFO ] [REMOTE ] MX: Full fetch complete (31433 records). [2025-10-17T20:21:56.329023] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-17T20:21:56.694736] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-10-17T20:21:56.694821] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-10-17T20:21:56.695400] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-10-17T20:21:56.695460] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-10-17T20:21:56.696176] [DEBUG] [LOCAL ] MX: Trimmed 31433 records to 22627 (keeping 200 days of data) [2025-10-17T20:21:56.817199] [DEBUG] [LOCAL ] MX: Primary data saved (22627 records). [2025-10-17T20:21:56.817331] [INFO ] [MAIN ] MX: Full history saved. [2025-10-17T20:21:56.817456] [INFO ] [MAIN ] Update Progress: 1440/2368 symbols completed. MX took 39.9s. Estimated remaining: 2h 10m 6s. Rate: 7.1 symbols/min [2025-10-17T20:21:57.428076] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:21:57.492606] [DEBUG] [LOCAL ] MYD: No existing data file found in primary storage. [2025-10-17T20:21:57.494203] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:21:57.552070] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:21:57.520463] [WARN ] [MAIN ] MYD: No existing data found, performing full refresh instead. [2025-10-17T20:21:57.552349] [DEBUG] [LOCAL ] MYI: No existing data file found in primary storage. [2025-10-17T20:21:57.552540] [WARN ] [MAIN ] MYI: No existing data found, performing full refresh instead. [2025-10-17T20:21:57.552700] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-17T20:21:57.552763] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-17T20:21:57.551022] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:21:57.552992] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-17T20:21:57.552950] [DEBUG] [LOCAL ] MYE: No existing data file found in primary storage. [2025-10-17T20:21:57.553118] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-17T20:21:57.553178] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-10-17T20:21:57.553534] [DEBUG] [LOCAL ] MYD: No primary data file found to delete. [2025-10-17T20:21:57.553620] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-17T20:21:57.553794] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-17T20:21:57.553235] [WARN ] [MAIN ] MYE: No existing data found, performing full refresh instead. [2025-10-17T20:21:57.672131] [DEBUG] [LOCAL ] MYN: Loaded 9866 existing records from primary storage. [2025-10-17T20:21:57.666780] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-17T20:21:57.685390] [INFO ] [MAIN ] MYN: Loaded 9866 existing records. [2025-10-17T20:21:57.727537] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-17T20:21:57.746994] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-17T20:21:57.806876] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-17T20:21:58.472312] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:21:58.623868] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-17T20:21:58.667865] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-17T20:21:58.718996] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-10-17T20:21:58.719135] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-17T20:21:58.788847] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:21:58.835303] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-10-17T20:21:58.929225] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:21:58.960809] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-10-17T20:21:59.093726] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:21:59.095522] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-10-17T20:21:59.324983] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:21:59.325386] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-10-17T20:22:00.127803] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-17T20:22:00.135033] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-17T20:22:00.201607] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-17T20:22:00.204526] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-17T20:22:00.223982] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T20:22:00.542017] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T20:22:00.758057] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-17T20:22:00.795685] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-17T20:22:00.870713] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-17T20:22:01.558027] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-17T20:22:02.025485] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T20:22:02.358087] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-17T20:22:02.910931] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T20:22:03.158010] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-17T20:22:03.374617] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-17T20:22:03.958019] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-17T20:22:04.115524] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T20:22:04.757998] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-17T20:22:05.147297] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T20:22:05.558037] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-17T20:22:05.853792] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-17T20:22:06.357996] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-17T20:22:06.723968] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-17T20:22:07.158034] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-17T20:22:07.219185] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T20:22:07.958066] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-17T20:22:08.360706] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T20:22:08.543248] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-17T20:22:08.758054] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-17T20:22:09.557986] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-17T20:22:09.877741] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T20:22:10.358030] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-17T20:22:10.787057] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-17T20:22:11.158129] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-17T20:22:11.869569] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T20:22:11.961333] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-17T20:22:11.964497] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T20:22:12.758063] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-17T20:22:12.879856] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-17T20:22:13.558069] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-17T20:22:14.213776] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T20:22:14.358045] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-17T20:22:14.374192] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T20:22:15.158094] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-17T20:22:15.248081] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T20:22:15.958056] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-17T20:22:16.064570] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-17T20:22:16.758035] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-17T20:22:17.273750] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T20:22:17.558028] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-17T20:22:17.636275] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-17T20:22:18.358006] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-17T20:22:18.659763] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T20:22:19.158077] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-17T20:22:19.333603] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-17T20:22:19.958012] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-17T20:22:20.023302] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T20:22:20.758046] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-17T20:22:21.035101] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T20:22:21.558001] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-17T20:22:21.718483] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-17T20:22:22.358085] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-17T20:22:22.451860] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T20:22:23.158033] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-17T20:22:23.332723] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-17T20:22:23.958048] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-17T20:22:24.351779] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T20:22:24.479062] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-17T20:22:24.758039] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-17T20:22:25.558017] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-17T20:22:25.657332] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T20:22:26.358037] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-17T20:22:26.508862] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T20:22:26.513277] [INFO ] [REMOTE ] MYI: Full fetch complete (28486 records). [2025-10-17T20:22:26.513477] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-17T20:22:26.896052] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-10-17T20:22:26.896144] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-10-17T20:22:26.896747] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-10-17T20:22:26.896809] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-10-17T20:22:26.897541] [DEBUG] [LOCAL ] MYI: Trimmed 28486 records to 19288 (keeping 200 days of data) [2025-10-17T20:22:27.013525] [DEBUG] [LOCAL ] MYI: Primary data saved (19288 records). [2025-10-17T20:22:27.013710] [INFO ] [MAIN ] MYI: Full history saved. [2025-10-17T20:22:27.013797] [INFO ] [MAIN ] Update Progress: 1441/2368 symbols completed. MYI took 30.2s. Estimated remaining: 2h 10m 12s. Rate: 7.1 symbols/min [2025-10-17T20:22:27.163829] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-17T20:22:27.185331] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:22:27.186153] [DEBUG] [LOCAL ] NABL: No existing data file found in primary storage. [2025-10-17T20:22:27.186199] [WARN ] [MAIN ] NABL: No existing data found, performing full refresh instead. [2025-10-17T20:22:27.186308] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-17T20:22:27.186350] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-17T20:22:27.186391] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-17T20:22:27.186425] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-17T20:22:27.537934] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:22:27.563753] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-17T20:22:27.957996] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-17T20:22:28.051548] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T20:22:28.053436] [INFO ] [REMOTE ] MYN: Full fetch complete (15089 records). [2025-10-17T20:22:28.053512] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-17T20:22:28.409882] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-17T20:22:28.409968] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-17T20:22:28.410413] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-17T20:22:28.410475] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-17T20:22:28.411025] [DEBUG] [LOCAL ] MYN: Trimmed 15089 records to 10035 (keeping 200 days of data) [2025-10-17T20:22:28.470614] [DEBUG] [LOCAL ] MYN: Primary data saved (10035 records). [2025-10-17T20:22:28.470789] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-17T20:22:28.470889] [INFO ] [MAIN ] Update Progress: 1442/2368 symbols completed. MYN took 31.6s. Estimated remaining: 2h 9m 59s. Rate: 7.1 symbols/min [2025-10-17T20:22:28.644186] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:22:28.644389] [DEBUG] [LOCAL ] NAC: No existing data file found in primary storage. [2025-10-17T20:22:28.644426] [WARN ] [MAIN ] NAC: No existing data found, performing full refresh instead. [2025-10-17T20:22:28.644538] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-17T20:22:28.644578] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-17T20:22:28.644618] [DEBUG] [LOCAL ] NAC: No primary data file found to delete. [2025-10-17T20:22:28.644678] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-17T20:22:28.763166] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-17T20:22:29.012879] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:22:29.144473] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-17T20:22:29.558022] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-10-17T20:22:29.791450] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T20:22:29.794077] [INFO ] [REMOTE ] MYD: Full fetch complete (20258 records). [2025-10-17T20:22:29.794159] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-17T20:22:30.162951] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-10-17T20:22:30.163032] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-10-17T20:22:30.163520] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-10-17T20:22:30.163594] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-10-17T20:22:30.164234] [DEBUG] [LOCAL ] MYD: Trimmed 20258 records to 13587 (keeping 200 days of data) [2025-10-17T20:22:30.245790] [DEBUG] [LOCAL ] MYD: Primary data saved (13587 records). [2025-10-17T20:22:30.245941] [INFO ] [MAIN ] MYD: Full history saved. [2025-10-17T20:22:30.246013] [INFO ] [MAIN ] Update Progress: 1443/2368 symbols completed. MYD took 33.4s. Estimated remaining: 2h 9m 46s. Rate: 7.1 symbols/min [2025-10-17T20:22:30.363224] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-10-17T20:22:30.420357] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:22:30.420538] [DEBUG] [LOCAL ] NAD: No existing data file found in primary storage. [2025-10-17T20:22:30.420575] [WARN ] [MAIN ] NAD: No existing data found, performing full refresh instead. [2025-10-17T20:22:30.420732] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-17T20:22:30.420777] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-17T20:22:30.420818] [DEBUG] [LOCAL ] NAD: No primary data file found to delete. [2025-10-17T20:22:30.420854] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-17T20:22:30.800571] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:22:30.861852] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T20:22:31.158049] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-17T20:22:31.963176] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-10-17T20:22:31.976678] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T20:22:32.301257] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T20:22:32.758018] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-17T20:22:33.511751] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T20:22:33.558021] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-17T20:22:34.175632] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T20:22:34.358023] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-17T20:22:34.652587] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T20:22:35.158038] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-17T20:22:35.574265] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T20:22:35.958003] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-17T20:22:36.522878] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-17T20:22:36.758004] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-17T20:22:37.408551] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T20:22:37.557994] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-17T20:22:37.900783] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T20:22:38.358028] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-17T20:22:39.042297] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T20:22:39.158082] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-17T20:22:39.930085] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T20:22:39.957985] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-17T20:22:40.758010] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-17T20:22:40.864471] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T20:22:40.924624] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T20:22:41.485462] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T20:22:41.492684] [INFO ] [REMOTE ] MYE: Full fetch complete (36010 records). [2025-10-17T20:22:41.492803] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-17T20:22:41.563191] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-17T20:22:41.869320] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-10-17T20:22:41.869406] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-10-17T20:22:41.870292] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-10-17T20:22:41.870359] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-10-17T20:22:41.871242] [DEBUG] [LOCAL ] MYE: Trimmed 36010 records to 24710 (keeping 200 days of data) [2025-10-17T20:22:42.020677] [DEBUG] [LOCAL ] MYE: Primary data saved (24710 records). [2025-10-17T20:22:42.020835] [INFO ] [MAIN ] MYE: Full history saved. [2025-10-17T20:22:42.020916] [INFO ] [MAIN ] Update Progress: 1444/2368 symbols completed. MYE took 45.2s. Estimated remaining: 2h 9m 40s. Rate: 7.1 symbols/min [2025-10-17T20:22:42.195574] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:22:42.195803] [DEBUG] [LOCAL ] NAN: No existing data file found in primary storage. [2025-10-17T20:22:42.195854] [WARN ] [MAIN ] NAN: No existing data found, performing full refresh instead. [2025-10-17T20:22:42.195972] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-17T20:22:42.196014] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-17T20:22:42.196054] [DEBUG] [LOCAL ] NAN: No primary data file found to delete. [2025-10-17T20:22:42.196087] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-17T20:22:42.367633] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-17T20:22:42.547523] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:22:43.158018] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-17T20:22:43.189338] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T20:22:43.622953] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T20:22:43.958074] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-10-17T20:22:44.662524] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T20:22:44.758072] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-17T20:22:44.812930] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T20:22:45.558039] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-17T20:22:46.300543] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T20:22:46.357984] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-17T20:22:47.158082] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-17T20:22:47.204698] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T20:22:47.798749] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T20:22:47.953598] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-17T20:22:47.957973] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-17T20:22:48.758044] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-17T20:22:48.817758] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T20:22:49.558031] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-17T20:22:50.038883] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T20:22:50.358090] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-17T20:22:50.597845] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T20:22:51.158020] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-17T20:22:51.267722] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T20:22:51.958085] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-17T20:22:52.758070] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-17T20:22:53.558037] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-17T20:23:05.410041] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (13.45 seconds). [2025-10-17T20:23:05.413260] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-17T20:23:05.857524] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (12.30 seconds). [2025-10-17T20:23:05.862866] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-17T20:23:06.015690] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (14.86 seconds). [2025-10-17T20:23:06.046949] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (13.29 seconds). [2025-10-17T20:23:06.046114] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-17T20:23:06.056120] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-17T20:23:07.245174] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T20:23:07.248325] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-17T20:23:07.426326] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T20:23:07.434839] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-17T20:23:07.669027] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T20:23:07.677317] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-17T20:23:07.897978] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-17T20:23:07.904688] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-17T20:23:08.196553] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-17T20:23:08.199126] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-17T20:23:09.036300] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T20:23:09.048031] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T20:23:09.050417] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-17T20:23:09.051470] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-17T20:23:09.097838] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-17T20:23:09.101194] [INFO ] [REMOTE ] NAC: Full fetch complete (35439 records). [2025-10-17T20:23:09.101284] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-17T20:23:09.311724] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T20:23:09.437761] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-17T20:23:09.554435] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-10-17T20:23:09.554521] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-10-17T20:23:09.555380] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-10-17T20:23:09.555447] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-10-17T20:23:09.556355] [DEBUG] [LOCAL ] NAC: Trimmed 35439 records to 24827 (keeping 200 days of data) [2025-10-17T20:23:09.685915] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-17T20:23:09.690304] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-17T20:23:09.734911] [DEBUG] [LOCAL ] NAC: Primary data saved (24827 records). [2025-10-17T20:23:09.735067] [INFO ] [MAIN ] NAC: Full history saved. [2025-10-17T20:23:09.735144] [INFO ] [MAIN ] Update Progress: 1445/2368 symbols completed. NAC took 41.3s. Estimated remaining: 2h 9m 44s. Rate: 7.1 symbols/min [2025-10-17T20:23:09.910500] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:23:09.956413] [DEBUG] [LOCAL ] NAT: Loaded 49601 existing records from primary storage. [2025-10-17T20:23:09.957717] [INFO ] [MAIN ] NAT: Loaded 49601 existing records. [2025-10-17T20:23:10.139895] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:23:10.140104] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-17T20:23:10.140150] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-17T20:23:10.140407] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-10-17T20:23:10.140475] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-17T20:23:10.453214] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T20:23:10.499818] [INFO ] [REMOTE ] NAD: Full fetch complete (48818 records). [2025-10-17T20:23:10.508094] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-17T20:23:10.534843] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:23:10.535442] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-10-17T20:23:10.659769] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T20:23:10.692668] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-17T20:23:10.904571] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T20:23:10.981380] [INFO ] [REMOTE ] NABL: Full fetch complete (56974 records). [2025-10-17T20:23:10.984082] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-10-17T20:23:10.984287] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-17T20:23:10.984341] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-10-17T20:23:10.985576] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-10-17T20:23:10.985776] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-10-17T20:23:11.088759] [DEBUG] [LOCAL ] NAD: Trimmed 48818 records to 34190 (keeping 200 days of data) [2025-10-17T20:23:11.490561] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-10-17T20:23:11.491367] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-10-17T20:23:11.493931] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-10-17T20:23:11.494013] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-10-17T20:23:11.500758] [DEBUG] [LOCAL ] NABL: Trimmed 56974 records to 39737 (keeping 200 days of data) [2025-10-17T20:23:11.622326] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T20:23:11.632195] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-17T20:23:11.827383] [DEBUG] [LOCAL ] NAD: Primary data saved (34190 records). [2025-10-17T20:23:11.830093] [INFO ] [MAIN ] NAD: Full history saved. [2025-10-17T20:23:11.830733] [INFO ] [MAIN ] Update Progress: 1446/2368 symbols completed. NAD took 41.6s. Estimated remaining: 2h 9m 31s. Rate: 7.1 symbols/min [2025-10-17T20:23:12.024047] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:23:12.025812] [DEBUG] [LOCAL ] NATL: No existing data file found in primary storage. [2025-10-17T20:23:12.025878] [WARN ] [MAIN ] NATL: No existing data found, performing full refresh instead. [2025-10-17T20:23:12.027687] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-17T20:23:12.028692] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-17T20:23:12.029071] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-17T20:23:12.029737] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-17T20:23:12.104035] [DEBUG] [LOCAL ] NABL: Primary data saved (39737 records). [2025-10-17T20:23:12.135684] [INFO ] [MAIN ] NABL: Full history saved. [2025-10-17T20:23:12.139104] [INFO ] [MAIN ] Update Progress: 1447/2368 symbols completed. NABL took 45.1s. Estimated remaining: 2h 9m 18s. Rate: 7.1 symbols/min [2025-10-17T20:23:12.512793] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:23:12.574983] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T20:23:12.608901] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:23:12.611752] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-10-17T20:23:12.611893] [INFO ] [REMOTE ] NAN: Full fetch complete (13459 records). [2025-10-17T20:23:12.613115] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-17T20:23:12.702029] [DEBUG] [LOCAL ] NAZ: Loaded 2683 existing records from primary storage. [2025-10-17T20:23:12.721139] [INFO ] [MAIN ] NAZ: Loaded 2683 existing records. [2025-10-17T20:23:12.910869] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-17T20:23:12.958218] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-17T20:23:13.226338] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:23:13.259801] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-17T20:23:13.259929] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-10-17T20:23:13.260001] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-10-17T20:23:13.260057] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-17T20:23:13.260442] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-10-17T20:23:13.260543] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-10-17T20:23:13.260730] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-10-17T20:23:13.260957] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-17T20:23:13.304763] [DEBUG] [LOCAL ] NAN: Trimmed 13459 records to 8601 (keeping 200 days of data) [2025-10-17T20:23:13.735680] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:23:13.739751] [DEBUG] [LOCAL ] NAN: Primary data saved (8601 records). [2025-10-17T20:23:13.739633] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-10-17T20:23:13.741249] [INFO ] [MAIN ] NAN: Full history saved. [2025-10-17T20:23:13.741372] [INFO ] [MAIN ] Update Progress: 1448/2368 symbols completed. NAN took 31.7s. Estimated remaining: 2h 9m 5s. Rate: 7.1 symbols/min [2025-10-17T20:23:13.929035] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:23:13.942799] [DEBUG] [LOCAL ] NBB: Loaded 9114 existing records from primary storage. [2025-10-17T20:23:13.943037] [INFO ] [MAIN ] NBB: Loaded 9114 existing records. [2025-10-17T20:23:14.078340] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T20:23:14.101982] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-17T20:23:14.159268] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:23:14.159495] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-17T20:23:14.159544] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-17T20:23:14.159734] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-10-17T20:23:14.159792] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-17T20:23:14.572760] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:23:14.575276] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-10-17T20:23:14.578709] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-17T20:23:14.580507] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-17T20:23:14.776876] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-17T20:23:14.786954] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-17T20:23:15.138103] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T20:23:15.139629] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-17T20:23:15.393324] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T20:23:15.399022] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-17T20:23:15.516686] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-17T20:23:15.521190] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-17T20:23:15.593341] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-17T20:23:15.595054] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-17T20:23:16.248105] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-17T20:23:16.249774] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-17T20:23:16.363753] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T20:23:16.462826] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T20:23:16.572289] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T20:23:16.758030] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-17T20:23:16.805578] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T20:23:17.558037] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-17T20:23:18.307403] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T20:23:18.358017] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-17T20:23:18.500315] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T20:23:19.158068] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-17T20:23:19.935263] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T20:23:19.957994] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-17T20:23:20.660905] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T20:23:20.758027] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-17T20:23:21.558043] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-17T20:23:21.717663] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T20:23:21.991514] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-17T20:23:22.164310] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-17T20:23:22.358044] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-17T20:23:23.158025] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-17T20:23:23.740208] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-17T20:23:23.741669] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T20:23:23.958033] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-17T20:23:24.758031] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-17T20:23:25.281139] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T20:23:25.558026] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-17T20:23:25.808020] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-17T20:23:26.358029] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-17T20:23:26.568680] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-17T20:23:27.000630] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-17T20:23:27.158055] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-17T20:23:27.958043] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-17T20:23:28.760723] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-17T20:23:28.763462] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T20:23:29.290833] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-17T20:23:29.438056] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T20:23:29.558017] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-17T20:23:30.194061] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-17T20:23:30.358011] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-17T20:23:31.013446] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-17T20:23:31.158033] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-17T20:23:31.958045] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-17T20:23:32.614853] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T20:23:32.617898] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T20:23:32.758058] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-17T20:23:33.558029] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-17T20:23:33.685610] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T20:23:34.252432] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-17T20:23:34.358042] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-17T20:23:34.916755] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-17T20:23:34.917883] [INFO ] [REMOTE ] NAZ: Full fetch complete (4134 records). [2025-10-17T20:23:34.917966] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-17T20:23:35.163279] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-17T20:23:35.285198] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-17T20:23:35.285293] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-17T20:23:35.285444] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-17T20:23:35.285485] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-17T20:23:35.285980] [DEBUG] [LOCAL ] NAZ: Trimmed 4134 records to 2699 (keeping 200 days of data) [2025-10-17T20:23:35.305225] [DEBUG] [LOCAL ] NAZ: Primary data saved (2699 records). [2025-10-17T20:23:35.305397] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-17T20:23:35.305489] [INFO ] [MAIN ] Update Progress: 1449/2368 symbols completed. NAZ took 23.2s. Estimated remaining: 2h 9m 5s. Rate: 7.1 symbols/min [2025-10-17T20:23:35.491154] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:23:35.491370] [DEBUG] [LOCAL ] NBHC: No existing data file found in primary storage. [2025-10-17T20:23:35.491421] [WARN ] [MAIN ] NBHC: No existing data found, performing full refresh instead. [2025-10-17T20:23:35.491506] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-17T20:23:35.491586] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-17T20:23:35.491680] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-17T20:23:35.491733] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-17T20:23:35.887550] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:23:35.958045] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-17T20:23:36.460677] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T20:23:36.465408] [INFO ] [REMOTE ] NATL: Full fetch complete (45236 records). [2025-10-17T20:23:36.465498] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-17T20:23:36.763153] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-10-17T20:23:36.867868] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T20:23:36.906054] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-10-17T20:23:36.906156] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-10-17T20:23:36.907078] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-10-17T20:23:36.907145] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-10-17T20:23:36.908302] [DEBUG] [LOCAL ] NATL: Trimmed 45236 records to 33023 (keeping 200 days of data) [2025-10-17T20:23:37.116063] [DEBUG] [LOCAL ] NATL: Primary data saved (33023 records). [2025-10-17T20:23:37.116214] [INFO ] [MAIN ] NATL: Full history saved. [2025-10-17T20:23:37.116304] [INFO ] [MAIN ] Update Progress: 1450/2368 symbols completed. NATL took 25.3s. Estimated remaining: 2h 8m 52s. Rate: 7.1 symbols/min [2025-10-17T20:23:37.288446] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:23:37.288677] [DEBUG] [LOCAL ] NBR: No existing data file found in primary storage. [2025-10-17T20:23:37.288732] [WARN ] [MAIN ] NBR: No existing data found, performing full refresh instead. [2025-10-17T20:23:37.288844] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-17T20:23:37.288885] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-17T20:23:37.288925] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-17T20:23:37.288957] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-17T20:23:37.560088] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-17T20:23:37.638952] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:23:37.949499] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T20:23:38.358019] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-10-17T20:23:39.158095] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-17T20:23:39.272401] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T20:23:39.802467] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T20:23:39.958043] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-17T20:23:40.057855] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T20:23:40.758100] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-17T20:23:41.563136] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-17T20:23:41.579385] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T20:23:42.000961] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T20:23:42.358014] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-17T20:23:42.387559] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T20:23:42.389260] [INFO ] [REMOTE ] NBB: Full fetch complete (13374 records). [2025-10-17T20:23:42.389329] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-17T20:23:42.774000] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-17T20:23:42.774085] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-17T20:23:42.774432] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-17T20:23:42.774494] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-17T20:23:42.774999] [DEBUG] [LOCAL ] NBB: Trimmed 13374 records to 9173 (keeping 200 days of data) [2025-10-17T20:23:42.829463] [DEBUG] [LOCAL ] NBB: Primary data saved (9173 records). [2025-10-17T20:23:42.829591] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-17T20:23:42.829694] [INFO ] [MAIN ] Update Progress: 1451/2368 symbols completed. NBB took 29.1s. Estimated remaining: 2h 8m 42s. Rate: 7.1 symbols/min [2025-10-17T20:23:42.999068] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:23:42.999238] [DEBUG] [LOCAL ] NBXG: No existing data file found in primary storage. [2025-10-17T20:23:42.999275] [WARN ] [MAIN ] NBXG: No existing data found, performing full refresh instead. [2025-10-17T20:23:42.999386] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-17T20:23:42.999426] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-17T20:23:42.999468] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-17T20:23:42.999500] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-17T20:23:43.167302] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-17T20:23:43.350588] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:23:43.802363] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T20:23:43.958034] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-17T20:23:44.758031] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-17T20:23:45.148671] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T20:23:45.290398] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T20:23:45.558009] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-10-17T20:23:45.839729] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T20:23:46.358035] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-17T20:23:46.779127] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T20:23:47.157987] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-17T20:23:47.383031] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T20:23:47.958076] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-17T20:23:48.251192] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T20:23:48.758050] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-17T20:23:49.495418] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T20:23:49.558003] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-17T20:23:50.332382] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T20:23:50.339509] [INFO ] [REMOTE ] NAT: Full fetch complete (72227 records). [2025-10-17T20:23:50.339700] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-17T20:23:50.370185] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-17T20:23:50.748178] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-10-17T20:23:50.748306] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-10-17T20:23:50.749636] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-10-17T20:23:50.749744] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-10-17T20:23:50.772166] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-17T20:23:50.779793] [DEBUG] [LOCAL ] NAT: Trimmed 72227 records to 49970 (keeping 200 days of data) [2025-10-17T20:23:51.070702] [DEBUG] [LOCAL ] NAT: Primary data saved (49970 records). [2025-10-17T20:23:51.070842] [INFO ] [MAIN ] NAT: Full history saved. [2025-10-17T20:23:51.070937] [INFO ] [MAIN ] Update Progress: 1452/2368 symbols completed. NAT took 41.3s. Estimated remaining: 2h 8m 34s. Rate: 7.1 symbols/min [2025-10-17T20:23:51.166716] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-17T20:23:51.240415] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:23:51.245002] [DEBUG] [LOCAL ] NC: Loaded 1982 existing records from primary storage. [2025-10-17T20:23:51.245161] [INFO ] [MAIN ] NC: Loaded 1982 existing records. [2025-10-17T20:23:51.426195] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:23:51.426536] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-17T20:23:51.426760] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-17T20:23:51.426935] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-10-17T20:23:51.426991] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-17T20:23:51.664614] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T20:23:51.805714] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:23:51.958041] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-17T20:23:52.707150] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T20:23:52.757996] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-17T20:23:53.189836] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-17T20:23:53.558059] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-17T20:23:54.121070] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T20:23:54.358041] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-10-17T20:23:54.819529] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-17T20:23:54.832867] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-17T20:23:55.158040] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-17T20:23:55.958047] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-17T20:23:56.650692] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-17T20:23:56.711132] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T20:23:56.758080] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-17T20:23:57.354341] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T20:23:57.558073] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-17T20:23:58.358005] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-17T20:23:58.721813] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-17T20:23:59.158030] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-17T20:23:59.500756] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T20:23:59.958040] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-17T20:24:00.568525] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-17T20:24:00.662934] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T20:24:00.758119] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-17T20:24:01.558059] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-17T20:24:01.974343] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-17T20:24:02.104702] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-17T20:24:02.358048] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-17T20:24:03.045115] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-17T20:24:03.158104] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-17T20:24:03.958033] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-17T20:24:04.758025] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-17T20:24:04.835552] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T20:24:05.193083] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T20:24:05.557994] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-17T20:24:05.956374] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-17T20:24:06.150576] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-17T20:24:06.358023] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-17T20:24:06.867288] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-17T20:24:07.158042] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-17T20:24:07.958060] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-17T20:24:08.424174] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T20:24:08.758036] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-17T20:24:09.241416] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T20:24:09.558035] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-17T20:24:10.114053] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T20:24:10.118251] [INFO ] [REMOTE ] NBR: Full fetch complete (49154 records). [2025-10-17T20:24:10.118337] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-17T20:24:10.363201] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-17T20:24:10.496917] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-10-17T20:24:10.497139] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-10-17T20:24:10.498256] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-10-17T20:24:10.498438] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-10-17T20:24:10.514174] [DEBUG] [LOCAL ] NBR: Trimmed 49154 records to 34897 (keeping 200 days of data) [2025-10-17T20:24:10.515835] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-17T20:24:10.719514] [DEBUG] [LOCAL ] NBR: Primary data saved (34897 records). [2025-10-17T20:24:10.719696] [INFO ] [MAIN ] NBR: Full history saved. [2025-10-17T20:24:10.719788] [INFO ] [MAIN ] Update Progress: 1453/2368 symbols completed. NBR took 33.6s. Estimated remaining: 2h 8m 32s. Rate: 7.1 symbols/min [2025-10-17T20:24:10.885961] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:24:10.896913] [DEBUG] [LOCAL ] NCA: Loaded 10015 existing records from primary storage. [2025-10-17T20:24:10.897098] [INFO ] [MAIN ] NCA: Loaded 10015 existing records. [2025-10-17T20:24:10.975186] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-17T20:24:11.081926] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:24:11.082188] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-17T20:24:11.082236] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-17T20:24:11.082421] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-10-17T20:24:11.082478] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-17T20:24:11.163231] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-17T20:24:11.435367] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:24:11.958078] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-17T20:24:12.458132] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T20:24:12.462401] [INFO ] [REMOTE ] NBHC: Full fetch complete (33139 records). [2025-10-17T20:24:12.462495] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-17T20:24:12.763112] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-10-17T20:24:12.839373] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-10-17T20:24:12.839538] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-10-17T20:24:12.840440] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-10-17T20:24:12.840502] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-10-17T20:24:12.841302] [DEBUG] [LOCAL ] NBHC: Trimmed 33139 records to 24150 (keeping 200 days of data) [2025-10-17T20:24:12.982851] [DEBUG] [LOCAL ] NBHC: Primary data saved (24150 records). [2025-10-17T20:24:12.982990] [INFO ] [MAIN ] NBHC: Full history saved. [2025-10-17T20:24:12.983066] [INFO ] [MAIN ] Update Progress: 1454/2368 symbols completed. NBHC took 37.7s. Estimated remaining: 2h 8m 20s. Rate: 7.1 symbols/min [2025-10-17T20:24:13.153074] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:24:13.153350] [DEBUG] [LOCAL ] NCDL: No existing data file found in primary storage. [2025-10-17T20:24:13.153404] [WARN ] [MAIN ] NCDL: No existing data found, performing full refresh instead. [2025-10-17T20:24:13.153897] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-17T20:24:13.153986] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-17T20:24:13.154124] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-17T20:24:13.160851] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-17T20:24:13.216110] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-17T20:24:13.538828] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:24:13.557995] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-10-17T20:24:14.006680] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T20:24:14.358026] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-17T20:24:14.956248] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T20:24:15.158022] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-17T20:24:15.168908] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T20:24:15.524318] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-17T20:24:15.958081] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-17T20:24:16.758026] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-17T20:24:17.323164] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T20:24:17.558005] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-17T20:24:17.700333] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T20:24:18.358027] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-17T20:24:18.554517] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T20:24:18.557730] [INFO ] [REMOTE ] NBXG: Full fetch complete (32497 records). [2025-10-17T20:24:18.557810] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-10-17T20:24:18.937317] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-10-17T20:24:18.937416] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-10-17T20:24:18.938259] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-10-17T20:24:18.938323] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-10-17T20:24:18.939149] [DEBUG] [LOCAL ] NBXG: Trimmed 32497 records to 22256 (keeping 200 days of data) [2025-10-17T20:24:19.077067] [DEBUG] [LOCAL ] NBXG: Primary data saved (22256 records). [2025-10-17T20:24:19.077210] [INFO ] [MAIN ] NBXG: Full history saved. [2025-10-17T20:24:19.077291] [INFO ] [MAIN ] Update Progress: 1455/2368 symbols completed. NBXG took 36.2s. Estimated remaining: 2h 8m 10s. Rate: 7.1 symbols/min [2025-10-17T20:24:19.161749] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-17T20:24:19.266411] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:24:19.267571] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T20:24:19.267204] [DEBUG] [LOCAL ] NCLH: No existing data file found in primary storage. [2025-10-17T20:24:19.271265] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-10-17T20:24:19.271406] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-17T20:24:19.271447] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-17T20:24:19.271487] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-17T20:24:19.271519] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-17T20:24:19.619873] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:24:19.958056] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-17T20:24:20.445966] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T20:24:20.758039] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-17T20:24:20.932956] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T20:24:21.558014] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-17T20:24:21.870893] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T20:24:22.358002] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-17T20:24:22.391530] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-17T20:24:23.158034] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-17T20:24:23.713311] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-17T20:24:23.958030] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-17T20:24:24.051887] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T20:24:24.692430] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-17T20:24:24.758000] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-17T20:24:25.312875] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-17T20:24:25.313816] [INFO ] [REMOTE ] NC: Full fetch complete (2753 records). [2025-10-17T20:24:25.313885] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-17T20:24:25.563311] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-10-17T20:24:25.687295] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-10-17T20:24:25.687390] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-10-17T20:24:25.687517] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-10-17T20:24:25.687557] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-10-17T20:24:25.687916] [DEBUG] [LOCAL ] NC: Trimmed 2753 records to 2000 (keeping 200 days of data) [2025-10-17T20:24:25.700082] [DEBUG] [LOCAL ] NC: Primary data saved (2000 records). [2025-10-17T20:24:25.700158] [INFO ] [MAIN ] NC: Full history saved. [2025-10-17T20:24:25.700230] [INFO ] [MAIN ] Update Progress: 1456/2368 symbols completed. NC took 34.6s. Estimated remaining: 2h 8m 0s. Rate: 7.1 symbols/min [2025-10-17T20:24:25.867469] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:24:25.883074] [DEBUG] [LOCAL ] NCV: Loaded 14028 existing records from primary storage. [2025-10-17T20:24:25.883307] [INFO ] [MAIN ] NCV: Loaded 14028 existing records. [2025-10-17T20:24:26.072684] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:24:26.072925] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-17T20:24:26.072976] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-17T20:24:26.073156] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-10-17T20:24:26.073212] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-17T20:24:26.363172] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-17T20:24:26.425353] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:24:27.158028] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-10-17T20:24:27.270125] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T20:24:27.814772] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-17T20:24:27.957990] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-17T20:24:28.410743] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T20:24:28.758061] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-17T20:24:29.558065] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-17T20:24:30.034390] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-17T20:24:30.158075] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-17T20:24:30.345513] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-17T20:24:30.357976] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-17T20:24:31.158038] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-17T20:24:31.209038] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T20:24:31.958087] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-17T20:24:32.758068] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-17T20:24:33.145311] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T20:24:33.277967] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-17T20:24:33.558043] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-17T20:24:33.617069] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-17T20:24:34.322340] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-17T20:24:34.323775] [INFO ] [REMOTE ] NCA: Full fetch complete (14414 records). [2025-10-17T20:24:34.323844] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-17T20:24:34.363197] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-17T20:24:34.680592] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-17T20:24:34.680701] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-17T20:24:34.681099] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-17T20:24:34.681152] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-17T20:24:34.681668] [DEBUG] [LOCAL ] NCA: Trimmed 14414 records to 10059 (keeping 200 days of data) [2025-10-17T20:24:34.741156] [DEBUG] [LOCAL ] NCA: Primary data saved (10059 records). [2025-10-17T20:24:34.741276] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-17T20:24:34.741372] [INFO ] [MAIN ] Update Progress: 1457/2368 symbols completed. NCA took 24.0s. Estimated remaining: 2h 7m 52s. Rate: 7.1 symbols/min [2025-10-17T20:24:34.909382] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:24:34.922932] [DEBUG] [LOCAL ] NCZ: Loaded 12477 existing records from primary storage. [2025-10-17T20:24:34.923128] [INFO ] [MAIN ] NCZ: Loaded 12477 existing records. [2025-10-17T20:24:35.099423] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:24:35.099697] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-17T20:24:35.099765] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-17T20:24:35.099945] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-10-17T20:24:35.099999] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-17T20:24:35.163154] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-17T20:24:35.454433] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:24:35.958067] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-17T20:24:36.444833] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T20:24:36.660139] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-17T20:24:36.757992] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-17T20:24:37.108467] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T20:24:37.551471] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T20:24:37.557970] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-17T20:24:38.357996] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-17T20:24:38.478855] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T20:24:39.158069] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-10-17T20:24:39.958017] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-17T20:24:40.553159] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T20:24:40.758002] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-17T20:24:41.132994] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T20:24:41.558044] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-17T20:24:41.661864] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (3.30 seconds). [2025-10-17T20:24:42.104716] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T20:24:42.217634] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-17T20:24:42.358034] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-17T20:24:43.158069] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-17T20:24:43.400954] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T20:24:43.958022] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-17T20:24:44.158885] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T20:24:44.758018] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-17T20:24:45.558006] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-17T20:24:45.648436] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-17T20:24:46.289450] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-17T20:24:46.357986] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-17T20:24:46.451979] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-17T20:24:47.158082] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-17T20:24:47.958039] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-17T20:24:47.998406] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T20:24:48.550310] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-17T20:24:48.758043] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-17T20:24:48.996383] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T20:24:49.558062] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-17T20:24:49.918404] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T20:24:49.922808] [INFO ] [REMOTE ] NCDL: Full fetch complete (33054 records). [2025-10-17T20:24:49.922925] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-17T20:24:50.377212] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-17T20:24:50.396137] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-10-17T20:24:50.396225] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-10-17T20:24:50.397390] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-10-17T20:24:50.397620] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-10-17T20:24:50.398917] [DEBUG] [LOCAL ] NCDL: Trimmed 33054 records to 22009 (keeping 200 days of data) [2025-10-17T20:24:50.597539] [DEBUG] [LOCAL ] NCDL: Primary data saved (22009 records). [2025-10-17T20:24:50.597778] [INFO ] [MAIN ] NCDL: Full history saved. [2025-10-17T20:24:50.597899] [INFO ] [MAIN ] Update Progress: 1458/2368 symbols completed. NCDL took 37.6s. Estimated remaining: 2h 7m 49s. Rate: 7.1 symbols/min [2025-10-17T20:24:50.848742] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:24:50.848932] [DEBUG] [LOCAL ] NDMO: No existing data file found in primary storage. [2025-10-17T20:24:50.848970] [WARN ] [MAIN ] NDMO: No existing data found, performing full refresh instead. [2025-10-17T20:24:50.849089] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-17T20:24:50.849132] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-17T20:24:50.849173] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-17T20:24:50.849206] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-17T20:24:51.163113] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-17T20:24:51.222469] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:24:51.350733] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T20:24:51.920015] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-17T20:24:51.957997] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-17T20:24:52.240199] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T20:24:52.758024] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-17T20:24:52.815699] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-17T20:24:53.558043] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-17T20:24:53.807575] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T20:24:54.358004] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-17T20:24:54.583074] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T20:24:55.158014] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-17T20:24:55.320390] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T20:24:55.958052] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-17T20:24:55.982247] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-17T20:24:56.758096] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-17T20:24:56.926633] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-17T20:24:57.558001] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-17T20:24:57.665430] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T20:24:58.358009] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-17T20:24:58.485257] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T20:24:58.489159] [INFO ] [REMOTE ] NCV: Full fetch complete (22282 records). [2025-10-17T20:24:58.489367] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-17T20:24:58.846730] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-10-17T20:24:58.846825] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-10-17T20:24:58.847449] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-10-17T20:24:58.847515] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-10-17T20:24:58.848166] [DEBUG] [LOCAL ] NCV: Trimmed 22282 records to 14136 (keeping 200 days of data) [2025-10-17T20:24:58.934064] [DEBUG] [LOCAL ] NCV: Primary data saved (14136 records). [2025-10-17T20:24:58.934201] [INFO ] [MAIN ] NCV: Full history saved. [2025-10-17T20:24:58.934279] [INFO ] [MAIN ] Update Progress: 1459/2368 symbols completed. NCV took 33.2s. Estimated remaining: 2h 7m 40s. Rate: 7.1 symbols/min [2025-10-17T20:24:59.103849] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:24:59.104095] [DEBUG] [LOCAL ] NE: No existing data file found in primary storage. [2025-10-17T20:24:59.104148] [WARN ] [MAIN ] NE: No existing data found, performing full refresh instead. [2025-10-17T20:24:59.104258] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-17T20:24:59.104300] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-17T20:24:59.104342] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-17T20:24:59.104376] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-17T20:24:59.165698] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-17T20:24:59.410033] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T20:24:59.431006] [INFO ] [REMOTE ] NCLH: Full fetch complete (77543 records). [2025-10-17T20:24:59.441433] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-17T20:24:59.475270] [FATAL] [VALIDATOR ] NCLH: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T20:24:59.504574] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:24:59.504769] [FATAL] [MAIN ] NCLH: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:24:59.504893] [WARN ] [MAIN ] NCLH: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:24:59.505174] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-17T20:24:59.505246] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-17T20:24:59.505285] [INFO ] [LOCAL ] NCLH: Starting deletion of derivative data. [2025-10-17T20:24:59.505324] [DEBUG] [LOCAL ] NCLH: No derivative data file found to delete. [2025-10-17T20:24:59.505379] [INFO ] [MAIN ] Update Progress: 1460/2368 symbols completed. NCLH took 40.4s. Estimated remaining: 2h 7m 27s. Rate: 7.1 symbols/min [2025-10-17T20:24:59.666083] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:24:59.666221] [DEBUG] [LOCAL ] NEA: No existing data file found in primary storage. [2025-10-17T20:24:59.666257] [WARN ] [MAIN ] NEA: No existing data found, performing full refresh instead. [2025-10-17T20:24:59.666360] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-17T20:24:59.666400] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-17T20:24:59.666440] [DEBUG] [LOCAL ] NEA: No primary data file found to delete. [2025-10-17T20:24:59.666471] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-17T20:24:59.970151] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-10-17T20:25:00.008964] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:25:00.250503] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T20:25:00.758080] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-17T20:25:01.122777] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T20:25:01.558039] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-10-17T20:25:01.898600] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T20:25:01.903250] [INFO ] [REMOTE ] NCZ: Full fetch complete (21036 records). [2025-10-17T20:25:01.903473] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-17T20:25:02.349177] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-17T20:25:02.349304] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-17T20:25:02.349810] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-17T20:25:02.349876] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-17T20:25:02.350625] [DEBUG] [LOCAL ] NCZ: Trimmed 21036 records to 12580 (keeping 200 days of data) [2025-10-17T20:25:02.382616] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-17T20:25:02.428521] [DEBUG] [LOCAL ] NCZ: Primary data saved (12580 records). [2025-10-17T20:25:02.428664] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-17T20:25:02.428761] [INFO ] [MAIN ] Update Progress: 1461/2368 symbols completed. NCZ took 27.7s. Estimated remaining: 2h 7m 15s. Rate: 7.1 symbols/min [2025-10-17T20:25:02.593475] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:25:02.593661] [DEBUG] [LOCAL ] NEE: No existing data file found in primary storage. [2025-10-17T20:25:02.593717] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-10-17T20:25:02.593831] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-17T20:25:02.593873] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-17T20:25:02.593914] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-17T20:25:02.593946] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-17T20:25:02.947616] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:25:03.158053] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-10-17T20:25:03.531243] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T20:25:03.582270] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-17T20:25:03.958029] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-17T20:25:04.758026] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-17T20:25:05.277359] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-17T20:25:05.395442] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-17T20:25:05.558036] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-17T20:25:06.028948] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-17T20:25:06.358021] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-17T20:25:07.158034] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-10-17T20:25:07.320289] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T20:25:07.661775] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-17T20:25:07.958053] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-17T20:25:08.758000] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-17T20:25:08.872147] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T20:25:08.921173] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-17T20:25:09.558074] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-17T20:25:10.358062] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-17T20:25:10.891019] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-17T20:25:11.158110] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-17T20:25:11.352040] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T20:25:11.865029] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T20:25:11.958023] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-17T20:25:12.758046] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-17T20:25:13.385998] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-17T20:25:13.558084] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-17T20:25:13.966782] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-17T20:25:14.258455] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T20:25:14.358000] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-17T20:25:14.587554] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T20:25:15.158036] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-17T20:25:15.906196] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T20:25:15.957979] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-17T20:25:16.758057] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-17T20:25:17.518407] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-17T20:25:17.563176] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-17T20:25:17.584443] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T20:25:18.358053] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-17T20:25:18.578008] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T20:25:18.817886] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T20:25:19.158013] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-17T20:25:19.622982] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-17T20:25:19.958023] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-17T20:25:20.758025] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-17T20:25:21.031528] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T20:25:21.527453] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T20:25:21.555816] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-17T20:25:21.559869] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-17T20:25:22.358029] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-17T20:25:23.158034] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-17T20:25:23.781753] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-17T20:25:23.958021] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-17T20:25:24.370762] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-17T20:25:24.665418] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-17T20:25:24.758038] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-17T20:25:25.558013] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-17T20:25:25.945418] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-17T20:25:26.358028] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-17T20:25:26.510463] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T20:25:27.002060] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T20:25:27.084769] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-17T20:25:27.158007] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-17T20:25:27.958119] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-17T20:25:28.758040] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-17T20:25:28.954198] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T20:25:28.956737] [INFO ] [REMOTE ] NDMO: Full fetch complete (23545 records). [2025-10-17T20:25:28.956813] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-17T20:25:29.326365] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-10-17T20:25:29.326465] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-10-17T20:25:29.327146] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-10-17T20:25:29.327229] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-10-17T20:25:29.327996] [DEBUG] [LOCAL ] NDMO: Trimmed 23545 records to 17181 (keeping 200 days of data) [2025-10-17T20:25:29.431374] [DEBUG] [LOCAL ] NDMO: Primary data saved (17181 records). [2025-10-17T20:25:29.431521] [INFO ] [MAIN ] NDMO: Full history saved. [2025-10-17T20:25:29.431599] [INFO ] [MAIN ] Update Progress: 1462/2368 symbols completed. NDMO took 38.8s. Estimated remaining: 2h 7m 18s. Rate: 7.1 symbols/min [2025-10-17T20:25:29.571363] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-17T20:25:29.603900] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:25:29.604117] [DEBUG] [LOCAL ] NEM: No existing data file found in primary storage. [2025-10-17T20:25:29.604246] [WARN ] [MAIN ] NEM: No existing data found, performing full refresh instead. [2025-10-17T20:25:29.604380] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-17T20:25:29.604532] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-17T20:25:29.604816] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-17T20:25:29.605004] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-17T20:25:29.780004] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-17T20:25:29.996709] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:25:30.265769] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T20:25:30.358011] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-17T20:25:31.036608] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T20:25:31.158078] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-17T20:25:31.958092] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-17T20:25:32.313782] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-17T20:25:32.758051] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-17T20:25:33.214550] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T20:25:33.418985] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-17T20:25:33.557990] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-17T20:25:34.358057] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-10-17T20:25:34.593194] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T20:25:34.600789] [INFO ] [REMOTE ] NE: Full fetch complete (75765 records). [2025-10-17T20:25:34.600923] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-17T20:25:34.905855] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-17T20:25:34.936408] [INFO ] [REMOTE ] NEA: Full fetch complete (51016 records). [2025-10-17T20:25:34.962731] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-17T20:25:35.054284] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-10-17T20:25:35.074927] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-10-17T20:25:35.087346] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-10-17T20:25:35.092583] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-10-17T20:25:35.135395] [DEBUG] [LOCAL ] NE: Trimmed 75765 records to 53135 (keeping 200 days of data) [2025-10-17T20:25:35.163106] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-17T20:25:35.501685] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-10-17T20:25:35.502254] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-10-17T20:25:35.503193] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-10-17T20:25:35.503491] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-10-17T20:25:35.510812] [DEBUG] [LOCAL ] NEA: Trimmed 51016 records to 35712 (keeping 200 days of data) [2025-10-17T20:25:35.838281] [DEBUG] [LOCAL ] NE: Primary data saved (53135 records). [2025-10-17T20:25:35.838437] [INFO ] [MAIN ] NE: Full history saved. [2025-10-17T20:25:35.838518] [INFO ] [MAIN ] Update Progress: 1463/2368 symbols completed. NE took 36.9s. Estimated remaining: 2h 7m 8s. Rate: 7.1 symbols/min [2025-10-17T20:25:36.103392] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:25:36.104940] [DEBUG] [LOCAL ] NET: No existing data file found in primary storage. [2025-10-17T20:25:36.105249] [WARN ] [MAIN ] NET: No existing data found, performing full refresh instead. [2025-10-17T20:25:36.107446] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-17T20:25:36.107497] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-17T20:25:36.107541] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-17T20:25:36.111147] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-17T20:25:36.158628] [DEBUG] [LOCAL ] NEA: Primary data saved (35712 records). [2025-10-17T20:25:36.185249] [INFO ] [MAIN ] NEA: Full history saved. [2025-10-17T20:25:36.214369] [INFO ] [MAIN ] Update Progress: 1464/2368 symbols completed. NEA took 36.7s. Estimated remaining: 2h 6m 55s. Rate: 7.1 symbols/min [2025-10-17T20:25:36.535226] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:25:36.535569] [DEBUG] [LOCAL ] NEU: No existing data file found in primary storage. [2025-10-17T20:25:36.557548] [WARN ] [MAIN ] NEU: No existing data found, performing full refresh instead. [2025-10-17T20:25:36.574050] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-17T20:25:36.574271] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-17T20:25:36.574784] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-17T20:25:36.595764] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-17T20:25:36.698385] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:25:36.736355] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-10-17T20:25:36.977135] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-17T20:25:36.988748] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-17T20:25:37.075951] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:25:37.558065] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-10-17T20:25:37.594304] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-17T20:25:38.310875] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T20:25:38.358000] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-17T20:25:38.836104] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-17T20:25:39.119170] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-17T20:25:39.158000] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-17T20:25:39.958036] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-17T20:25:40.658949] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-17T20:25:40.689939] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-17T20:25:40.697892] [INFO ] [REMOTE ] NEE: Full fetch complete (77887 records). [2025-10-17T20:25:40.698069] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-17T20:25:40.765359] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-17T20:25:41.153794] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-10-17T20:25:41.153956] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-10-17T20:25:41.155234] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-10-17T20:25:41.155316] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-10-17T20:25:41.156819] [DEBUG] [LOCAL ] NEE: Trimmed 77887 records to 54487 (keeping 200 days of data) [2025-10-17T20:25:41.430086] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-17T20:25:41.532262] [DEBUG] [LOCAL ] NEE: Primary data saved (54487 records). [2025-10-17T20:25:41.532429] [INFO ] [MAIN ] NEE: Full history saved. [2025-10-17T20:25:41.532542] [INFO ] [MAIN ] Update Progress: 1465/2368 symbols completed. NEE took 39.1s. Estimated remaining: 2h 6m 45s. Rate: 7.1 symbols/min [2025-10-17T20:25:41.563126] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-17T20:25:41.699992] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:25:41.706894] [DEBUG] [LOCAL ] NEXA: Loaded 5326 existing records from primary storage. [2025-10-17T20:25:41.707044] [INFO ] [MAIN ] NEXA: Loaded 5326 existing records. [2025-10-17T20:25:41.879233] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:25:41.879450] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-17T20:25:41.879497] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-17T20:25:41.879729] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-10-17T20:25:41.879786] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-17T20:25:42.227984] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:25:42.358033] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-10-17T20:25:43.025249] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-17T20:25:43.158096] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-17T20:25:43.230762] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T20:25:43.637552] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-17T20:25:43.958019] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-17T20:25:44.758021] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-17T20:25:44.804293] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-17T20:25:45.430941] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-17T20:25:45.538072] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T20:25:45.558004] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-17T20:25:46.358055] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-17T20:25:47.059340] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-17T20:25:47.158000] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-17T20:25:47.806854] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-17T20:25:47.957990] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-17T20:25:48.758069] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-17T20:25:49.406960] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-17T20:25:49.427710] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-17T20:25:49.558016] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-17T20:25:49.911252] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T20:25:50.358039] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-17T20:25:50.930293] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-17T20:25:51.158096] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-17T20:25:51.732689] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-17T20:25:51.780066] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-17T20:25:51.958048] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-17T20:25:52.671699] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-17T20:25:52.758043] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-17T20:25:53.446874] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-17T20:25:53.558003] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-17T20:25:54.358054] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-17T20:25:55.158064] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-17T20:25:55.676503] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-17T20:25:55.764410] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-17T20:25:55.958085] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-17T20:25:56.651433] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-17T20:25:56.742573] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-17T20:25:56.757983] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-17T20:25:57.558052] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-17T20:25:57.690818] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T20:25:57.693371] [INFO ] [REMOTE ] NEXA: Full fetch complete (8181 records). [2025-10-17T20:25:57.693445] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-17T20:25:58.059946] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-10-17T20:25:58.060055] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-10-17T20:25:58.060326] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-10-17T20:25:58.060391] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-10-17T20:25:58.061046] [DEBUG] [LOCAL ] NEXA: Trimmed 8181 records to 5430 (keeping 200 days of data) [2025-10-17T20:25:58.091700] [DEBUG] [LOCAL ] NEXA: Primary data saved (5430 records). [2025-10-17T20:25:58.091807] [INFO ] [MAIN ] NEXA: Full history saved. [2025-10-17T20:25:58.091896] [INFO ] [MAIN ] Update Progress: 1466/2368 symbols completed. NEXA took 16.6s. Estimated remaining: 2h 6m 41s. Rate: 7.1 symbols/min [2025-10-17T20:25:58.259356] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:25:58.259545] [DEBUG] [LOCAL ] NFG: No existing data file found in primary storage. [2025-10-17T20:25:58.259582] [WARN ] [MAIN ] NFG: No existing data found, performing full refresh instead. [2025-10-17T20:25:58.259738] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-17T20:25:58.259794] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-17T20:25:58.259861] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-17T20:25:58.259907] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-17T20:25:58.363221] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-17T20:25:58.632204] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:25:59.158000] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-10-17T20:25:59.215158] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T20:25:59.756348] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-17T20:25:59.958078] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-17T20:26:00.706948] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T20:26:00.758077] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-17T20:26:01.558027] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-17T20:26:02.340479] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-17T20:26:02.357996] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-17T20:26:03.120095] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-17T20:26:03.158010] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-17T20:26:03.219097] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T20:26:03.958036] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-17T20:26:04.603745] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-17T20:26:04.758053] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-17T20:26:05.288142] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-17T20:26:05.516884] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T20:26:05.558005] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-17T20:26:06.358001] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-17T20:26:06.919615] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-17T20:26:06.957672] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-17T20:26:07.158038] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-17T20:26:07.958090] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-17T20:26:08.119079] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-17T20:26:08.556470] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T20:26:08.758047] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-17T20:26:09.492800] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-17T20:26:09.557988] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-17T20:26:10.019529] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-17T20:26:10.027096] [INFO ] [REMOTE ] NET: Full fetch complete (76928 records). [2025-10-17T20:26:10.027238] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-17T20:26:10.372698] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-17T20:26:10.436218] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-10-17T20:26:10.436296] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-10-17T20:26:10.437632] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-10-17T20:26:10.437718] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-10-17T20:26:10.439291] [DEBUG] [LOCAL ] NET: Trimmed 76928 records to 53652 (keeping 200 days of data) [2025-10-17T20:26:10.749758] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T20:26:10.777003] [DEBUG] [LOCAL ] NET: Primary data saved (53652 records). [2025-10-17T20:26:10.777158] [INFO ] [MAIN ] NET: Full history saved. [2025-10-17T20:26:10.777255] [INFO ] [MAIN ] Update Progress: 1467/2368 symbols completed. NET took 34.9s. Estimated remaining: 2h 6m 35s. Rate: 7.1 symbols/min [2025-10-17T20:26:10.943126] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:26:10.943327] [DEBUG] [LOCAL ] NFJ: No existing data file found in primary storage. [2025-10-17T20:26:10.943364] [WARN ] [MAIN ] NFJ: No existing data found, performing full refresh instead. [2025-10-17T20:26:10.943475] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-17T20:26:10.943515] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-17T20:26:10.943555] [DEBUG] [LOCAL ] NFJ: No primary data file found to delete. [2025-10-17T20:26:10.943586] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-17T20:26:11.169896] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-17T20:26:11.297128] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:26:11.958052] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-17T20:26:12.075630] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T20:26:12.159546] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T20:26:12.758040] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-17T20:26:13.558009] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-17T20:26:13.707967] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T20:26:14.230843] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-17T20:26:14.238973] [INFO ] [REMOTE ] NEM: Full fetch complete (77887 records). [2025-10-17T20:26:14.239156] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-17T20:26:14.363209] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-10-17T20:26:14.652738] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-10-17T20:26:14.652834] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-10-17T20:26:14.654011] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-10-17T20:26:14.654078] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-10-17T20:26:14.655534] [DEBUG] [LOCAL ] NEM: Trimmed 77887 records to 54488 (keeping 200 days of data) [2025-10-17T20:26:14.990192] [DEBUG] [LOCAL ] NEM: Primary data saved (54488 records). [2025-10-17T20:26:14.990425] [INFO ] [MAIN ] NEM: Full history saved. [2025-10-17T20:26:14.990612] [INFO ] [MAIN ] Update Progress: 1468/2368 symbols completed. NEM took 45.6s. Estimated remaining: 2h 6m 24s. Rate: 7.1 symbols/min [2025-10-17T20:26:15.129936] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T20:26:15.167628] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-17T20:26:15.187357] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:26:15.188807] [DEBUG] [LOCAL ] NGG: No existing data file found in primary storage. [2025-10-17T20:26:15.188861] [WARN ] [MAIN ] NGG: No existing data found, performing full refresh instead. [2025-10-17T20:26:15.188974] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-17T20:26:15.189016] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-17T20:26:15.189057] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-17T20:26:15.189091] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-17T20:26:15.545272] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:26:15.714169] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T20:26:15.958012] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-17T20:26:16.173486] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T20:26:16.758063] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-10-17T20:26:17.220425] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T20:26:17.558028] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-17T20:26:18.358003] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-17T20:26:18.386080] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-17T20:26:18.387751] [INFO ] [REMOTE ] NEU: Full fetch complete (10804 records). [2025-10-17T20:26:18.387820] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-17T20:26:18.700204] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-17T20:26:18.789845] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-10-17T20:26:18.789923] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-10-17T20:26:18.790212] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-10-17T20:26:18.790252] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-10-17T20:26:18.790755] [DEBUG] [LOCAL ] NEU: Trimmed 10804 records to 8654 (keeping 200 days of data) [2025-10-17T20:26:18.843537] [DEBUG] [LOCAL ] NEU: Primary data saved (8654 records). [2025-10-17T20:26:18.843685] [INFO ] [MAIN ] NEU: Full history saved. [2025-10-17T20:26:18.843771] [INFO ] [MAIN ] Update Progress: 1469/2368 symbols completed. NEU took 42.6s. Estimated remaining: 2h 6m 13s. Rate: 7.1 symbols/min [2025-10-17T20:26:19.024463] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:26:19.056491] [DEBUG] [LOCAL ] NGL: Loaded 30150 existing records from primary storage. [2025-10-17T20:26:19.056828] [INFO ] [MAIN ] NGL: Loaded 30150 existing records. [2025-10-17T20:26:19.164245] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-17T20:26:19.251678] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:26:19.251941] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-17T20:26:19.252019] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-17T20:26:19.252262] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-10-17T20:26:19.252323] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-17T20:26:19.618972] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:26:19.851945] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T20:26:19.958036] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-10-17T20:26:20.758072] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-17T20:26:20.876749] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T20:26:21.058740] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T20:26:21.558031] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-17T20:26:22.358011] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-17T20:26:22.436903] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T20:26:22.681817] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T20:26:23.158066] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-17T20:26:23.888671] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T20:26:23.958024] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-17T20:26:24.650443] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T20:26:24.702410] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-17T20:26:24.758087] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-17T20:26:25.558057] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-17T20:26:26.358053] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-17T20:26:26.414520] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T20:26:26.701052] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T20:26:27.158079] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-17T20:26:27.963109] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-17T20:26:27.974915] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T20:26:28.308585] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T20:26:28.758071] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-17T20:26:29.144336] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T20:26:29.558036] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-17T20:26:30.007812] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T20:26:30.013541] [INFO ] [REMOTE ] NFG: Full fetch complete (57309 records). [2025-10-17T20:26:30.013674] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-17T20:26:30.367610] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-17T20:26:30.387956] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-10-17T20:26:30.388051] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-10-17T20:26:30.389163] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-10-17T20:26:30.389347] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-10-17T20:26:30.390638] [DEBUG] [LOCAL ] NFG: Trimmed 57309 records to 39051 (keeping 200 days of data) [2025-10-17T20:26:30.630745] [DEBUG] [LOCAL ] NFG: Primary data saved (39051 records). [2025-10-17T20:26:30.630900] [INFO ] [MAIN ] NFG: Full history saved. [2025-10-17T20:26:30.630976] [INFO ] [MAIN ] Update Progress: 1470/2368 symbols completed. NFG took 32.5s. Estimated remaining: 2h 6m 7s. Rate: 7.1 symbols/min [2025-10-17T20:26:30.801380] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:26:30.813739] [DEBUG] [LOCAL ] NGS: Loaded 11249 existing records from primary storage. [2025-10-17T20:26:30.813962] [INFO ] [MAIN ] NGS: Loaded 11249 existing records. [2025-10-17T20:26:30.987995] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:26:30.988263] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-17T20:26:30.988322] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-17T20:26:30.988500] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-10-17T20:26:30.988556] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-17T20:26:31.158375] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-17T20:26:31.381239] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:26:31.463410] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T20:26:31.515930] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T20:26:31.958044] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-17T20:26:32.388854] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-17T20:26:32.758081] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-10-17T20:26:33.417221] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T20:26:33.557999] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-17T20:26:33.677119] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-17T20:26:34.358059] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-17T20:26:35.158089] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-17T20:26:35.216577] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T20:26:35.595944] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T20:26:35.958004] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-17T20:26:36.282604] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T20:26:36.758028] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-17T20:26:37.558014] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-17T20:26:37.624117] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T20:26:37.795965] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T20:26:38.358035] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-17T20:26:38.845766] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-17T20:26:39.158025] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-17T20:26:39.958063] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-17T20:26:39.993276] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T20:26:40.300497] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-17T20:26:40.758032] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-17T20:26:41.174249] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-17T20:26:41.558034] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-17T20:26:42.358013] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-17T20:26:42.557982] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T20:26:42.643441] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T20:26:43.158026] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-17T20:26:43.212477] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-17T20:26:43.958073] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-17T20:26:44.758010] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-17T20:26:44.788783] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T20:26:44.795296] [INFO ] [REMOTE ] NGG: Full fetch complete (66595 records). [2025-10-17T20:26:44.795424] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-17T20:26:45.108145] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T20:26:45.150054] [INFO ] [REMOTE ] NFJ: Full fetch complete (29907 records). [2025-10-17T20:26:45.175986] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-17T20:26:45.229250] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-10-17T20:26:45.257131] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-10-17T20:26:45.290169] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-10-17T20:26:45.317778] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-10-17T20:26:45.378973] [DEBUG] [LOCAL ] NGG: Trimmed 66595 records to 47373 (keeping 200 days of data) [2025-10-17T20:26:45.574235] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-17T20:26:45.699390] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-10-17T20:26:45.700932] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-10-17T20:26:45.703371] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-10-17T20:26:45.703969] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-10-17T20:26:45.714614] [DEBUG] [LOCAL ] NFJ: Trimmed 29907 records to 20526 (keeping 200 days of data) [2025-10-17T20:26:45.930892] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-17T20:26:46.031987] [DEBUG] [LOCAL ] NFJ: Primary data saved (20526 records). [2025-10-17T20:26:46.034232] [INFO ] [MAIN ] NFJ: Full history saved. [2025-10-17T20:26:46.034689] [INFO ] [MAIN ] Update Progress: 1471/2368 symbols completed. NFJ took 35.3s. Estimated remaining: 2h 6m 3s. Rate: 7.1 symbols/min [2025-10-17T20:26:46.036327] [DEBUG] [LOCAL ] NGG: Primary data saved (47373 records). [2025-10-17T20:26:46.079163] [INFO ] [MAIN ] NGG: Full history saved. [2025-10-17T20:26:46.111080] [INFO ] [MAIN ] Update Progress: 1472/2368 symbols completed. NGG took 31.1s. Estimated remaining: 2h 5m 49s. Rate: 7.1 symbols/min [2025-10-17T20:26:46.334997] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:26:46.365000] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-17T20:26:46.403902] [DEBUG] [LOCAL ] NGVC: No existing data file found in primary storage. [2025-10-17T20:26:46.405312] [WARN ] [MAIN ] NGVC: No existing data found, performing full refresh instead. [2025-10-17T20:26:46.403773] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:26:46.405518] [DEBUG] [LOCAL ] NGVT: No existing data file found in primary storage. [2025-10-17T20:26:46.405578] [WARN ] [MAIN ] NGVT: No existing data found, performing full refresh instead. [2025-10-17T20:26:46.405735] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-17T20:26:46.405788] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-17T20:26:46.405841] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-17T20:26:46.405877] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-17T20:26:46.418913] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-17T20:26:46.484836] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-17T20:26:46.523614] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-17T20:26:46.523791] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-17T20:26:47.120483] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:26:47.177234] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-10-17T20:26:47.176702] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:26:47.198979] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T20:26:47.219938] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T20:26:47.958038] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-10-17T20:26:48.425443] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T20:26:48.758015] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-17T20:26:49.002999] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T20:26:49.558059] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-17T20:26:49.958258] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-17T20:26:50.358014] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-17T20:26:50.538326] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-17T20:26:51.158070] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-17T20:26:51.749170] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T20:26:51.958018] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-17T20:26:52.203993] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-17T20:26:52.758011] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-17T20:26:53.485464] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T20:26:53.558048] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-17T20:26:53.858252] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T20:26:54.121721] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-17T20:26:54.358024] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-17T20:26:55.158104] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-17T20:26:55.594600] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T20:26:55.598162] [INFO ] [REMOTE ] NGL: Full fetch complete (41562 records). [2025-10-17T20:26:55.598266] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-17T20:26:55.964480] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-17T20:26:55.967008] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-10-17T20:26:55.967679] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-10-17T20:26:55.968537] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-10-17T20:26:55.968731] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-10-17T20:26:55.969735] [DEBUG] [LOCAL ] NGL: Trimmed 41562 records to 30303 (keeping 200 days of data) [2025-10-17T20:26:56.063572] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T20:26:56.151738] [DEBUG] [LOCAL ] NGL: Primary data saved (30303 records). [2025-10-17T20:26:56.151905] [INFO ] [MAIN ] NGL: Full history saved. [2025-10-17T20:26:56.151995] [INFO ] [MAIN ] Update Progress: 1473/2368 symbols completed. NGL took 37.3s. Estimated remaining: 2h 5m 42s. Rate: 7.1 symbols/min [2025-10-17T20:26:56.331506] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:26:56.331711] [DEBUG] [LOCAL ] NHI: No existing data file found in primary storage. [2025-10-17T20:26:56.331761] [WARN ] [MAIN ] NHI: No existing data found, performing full refresh instead. [2025-10-17T20:26:56.331875] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-17T20:26:56.331916] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-17T20:26:56.331956] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-17T20:26:56.331988] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-17T20:26:56.682385] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:26:56.758031] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-10-17T20:26:57.171389] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T20:26:57.558030] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-17T20:26:58.139396] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T20:26:58.358067] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-17T20:26:58.806735] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T20:26:59.158043] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-17T20:26:59.455955] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T20:26:59.958046] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-17T20:27:00.074844] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T20:27:00.758107] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-17T20:27:00.932475] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T20:27:01.558080] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-17T20:27:02.141378] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T20:27:02.358030] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-17T20:27:02.768731] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T20:27:03.158036] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-17T20:27:03.590986] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-17T20:27:03.958081] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-17T20:27:04.470522] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T20:27:04.758003] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-17T20:27:05.126031] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-17T20:27:05.558055] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-17T20:27:05.599784] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T20:27:06.358023] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-17T20:27:06.817503] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T20:27:07.158047] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-17T20:27:07.541672] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T20:27:07.958013] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-17T20:27:08.096472] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-17T20:27:08.758051] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-17T20:27:09.045389] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T20:27:09.291132] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-17T20:27:09.292816] [INFO ] [REMOTE ] NGS: Full fetch complete (16973 records). [2025-10-17T20:27:09.292885] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-17T20:27:09.563148] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-17T20:27:09.655423] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-10-17T20:27:09.655497] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-10-17T20:27:09.655931] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-10-17T20:27:09.656007] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-10-17T20:27:09.656529] [DEBUG] [LOCAL ] NGS: Trimmed 16973 records to 11294 (keeping 200 days of data) [2025-10-17T20:27:09.722199] [DEBUG] [LOCAL ] NGS: Primary data saved (11294 records). [2025-10-17T20:27:09.722318] [INFO ] [MAIN ] NGS: Full history saved. [2025-10-17T20:27:09.722395] [INFO ] [MAIN ] Update Progress: 1474/2368 symbols completed. NGS took 39.1s. Estimated remaining: 2h 5m 36s. Rate: 7.1 symbols/min [2025-10-17T20:27:09.887928] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:27:09.888134] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-10-17T20:27:09.888171] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-10-17T20:27:09.888286] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-17T20:27:09.888327] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-17T20:27:09.888367] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-17T20:27:09.888402] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-17T20:27:10.239705] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:27:10.357992] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-10-17T20:27:10.794709] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-17T20:27:11.158033] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-17T20:27:11.958050] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-17T20:27:12.290411] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-17T20:27:12.294349] [INFO ] [REMOTE ] NGVT: Full fetch complete (34489 records). [2025-10-17T20:27:12.294468] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-17T20:27:12.498589] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-17T20:27:12.711869] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-10-17T20:27:12.711946] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-10-17T20:27:12.712623] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-10-17T20:27:12.712714] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-10-17T20:27:12.713508] [DEBUG] [LOCAL ] NGVT: Trimmed 34489 records to 24418 (keeping 200 days of data) [2025-10-17T20:27:12.761187] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-17T20:27:12.856602] [DEBUG] [LOCAL ] NGVT: Primary data saved (24418 records). [2025-10-17T20:27:12.856756] [INFO ] [MAIN ] NGVT: Full history saved. [2025-10-17T20:27:12.856848] [INFO ] [MAIN ] Update Progress: 1475/2368 symbols completed. NGVT took 26.7s. Estimated remaining: 2h 5m 25s. Rate: 7.1 symbols/min [2025-10-17T20:27:13.023049] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:27:13.023197] [DEBUG] [LOCAL ] NIC: No existing data file found in primary storage. [2025-10-17T20:27:13.023233] [WARN ] [MAIN ] NIC: No existing data found, performing full refresh instead. [2025-10-17T20:27:13.023373] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-17T20:27:13.023443] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-17T20:27:13.023495] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-17T20:27:13.023528] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-17T20:27:13.226481] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T20:27:13.401052] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:27:13.558020] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-17T20:27:14.348469] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T20:27:14.358509] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-17T20:27:14.798709] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-17T20:27:15.158053] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-17T20:27:15.618397] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T20:27:15.958044] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-17T20:27:16.446029] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T20:27:16.758084] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-10-17T20:27:17.558057] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-17T20:27:17.588369] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-17T20:27:17.891097] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-17T20:27:18.358033] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-17T20:27:18.742855] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-17T20:27:19.158061] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-17T20:27:19.958004] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-17T20:27:20.024011] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T20:27:20.329055] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T20:27:20.758045] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-17T20:27:20.843745] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T20:27:21.558021] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-17T20:27:21.588010] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-17T20:27:22.358052] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-17T20:27:22.549336] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-17T20:27:22.923259] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-17T20:27:23.158051] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-17T20:27:23.958049] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-17T20:27:24.488310] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-17T20:27:24.758073] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-17T20:27:24.824798] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-17T20:27:25.558064] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-17T20:27:26.358050] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-17T20:27:26.383563] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-17T20:27:26.637062] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T20:27:27.158063] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-17T20:27:27.440881] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T20:27:27.958042] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-17T20:27:28.757998] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-17T20:27:29.030263] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T20:27:29.054515] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T20:27:29.057854] [INFO ] [REMOTE ] NHI: Full fetch complete (31445 records). [2025-10-17T20:27:29.057943] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-17T20:27:29.436217] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-10-17T20:27:29.436306] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-10-17T20:27:29.437022] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-10-17T20:27:29.437093] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-10-17T20:27:29.437957] [DEBUG] [LOCAL ] NHI: Trimmed 31445 records to 22366 (keeping 200 days of data) [2025-10-17T20:27:29.560594] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-17T20:27:29.581495] [DEBUG] [LOCAL ] NHI: Primary data saved (22366 records). [2025-10-17T20:27:29.581598] [INFO ] [MAIN ] NHI: Full history saved. [2025-10-17T20:27:29.581694] [INFO ] [MAIN ] Update Progress: 1476/2368 symbols completed. NHI took 33.4s. Estimated remaining: 2h 5m 21s. Rate: 7.1 symbols/min [2025-10-17T20:27:29.756473] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:27:29.769294] [DEBUG] [LOCAL ] NIE: Loaded 11965 existing records from primary storage. [2025-10-17T20:27:29.769569] [INFO ] [MAIN ] NIE: Loaded 11965 existing records. [2025-10-17T20:27:29.959257] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:27:29.973476] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-17T20:27:29.974037] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-17T20:27:29.974712] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-10-17T20:27:29.974685] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T20:27:29.976602] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-17T20:27:30.343786] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:27:30.357989] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-10-17T20:27:30.382167] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T20:27:31.089554] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T20:27:31.157987] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-17T20:27:31.958008] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-17T20:27:32.078985] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-17T20:27:32.758007] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-17T20:27:32.913145] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-17T20:27:33.558012] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-17T20:27:33.854952] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T20:27:34.358018] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-17T20:27:35.158003] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-17T20:27:35.381207] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-17T20:27:35.451754] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-17T20:27:35.455301] [INFO ] [REMOTE ] NGVC: Full fetch complete (31052 records). [2025-10-17T20:27:35.455386] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-17T20:27:35.786811] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T20:27:35.860587] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-10-17T20:27:35.860687] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-10-17T20:27:35.861320] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-10-17T20:27:35.861362] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-10-17T20:27:35.862128] [DEBUG] [LOCAL ] NGVC: Trimmed 31052 records to 23195 (keeping 200 days of data) [2025-10-17T20:27:35.958042] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-17T20:27:36.002258] [DEBUG] [LOCAL ] NGVC: Primary data saved (23195 records). [2025-10-17T20:27:36.002389] [INFO ] [MAIN ] NGVC: Full history saved. [2025-10-17T20:27:36.002460] [INFO ] [MAIN ] Update Progress: 1477/2368 symbols completed. NGVC took 50.0s. Estimated remaining: 2h 5m 12s. Rate: 7.1 symbols/min [2025-10-17T20:27:36.758021] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-17T20:27:37.558012] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-17T20:27:37.580434] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-17T20:27:38.033902] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-17T20:27:38.358019] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-17T20:27:38.468531] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T20:27:39.158045] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-17T20:27:39.958009] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-17T20:27:40.075052] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T20:27:40.249536] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T20:27:40.758002] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-17T20:27:40.966028] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T20:27:41.558038] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-17T20:27:42.333888] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T20:27:42.335873] [INFO ] [REMOTE ] NIC: Full fetch complete (12531 records). [2025-10-17T20:27:42.335955] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-17T20:27:42.370624] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-17T20:27:42.736799] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-10-17T20:27:42.742522] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-10-17T20:27:42.742913] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-10-17T20:27:42.742992] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-10-17T20:27:42.745382] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T20:27:42.756088] [DEBUG] [LOCAL ] NIC: Trimmed 12531 records to 9031 (keeping 200 days of data) [2025-10-17T20:27:42.815416] [DEBUG] [LOCAL ] NIC: Primary data saved (9031 records). [2025-10-17T20:27:42.815564] [INFO ] [MAIN ] NIC: Full history saved. [2025-10-17T20:27:42.815639] [INFO ] [MAIN ] Update Progress: 1478/2368 symbols completed. NIC took 30.0s. Estimated remaining: 2h 5m 2s. Rate: 7.1 symbols/min [2025-10-17T20:27:43.158066] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-17T20:27:43.324600] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-17T20:27:43.958140] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-17T20:27:44.723136] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T20:27:44.731985] [INFO ] [REMOTE ] NI: Full fetch complete (77488 records). [2025-10-17T20:27:44.732155] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-17T20:27:44.885846] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T20:27:44.930317] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-17T20:27:45.193448] [DEBUG] [VALIDATOR ] NI: All expected trading days are present. [2025-10-17T20:27:45.193547] [DEBUG] [VALIDATOR ] NI: Primary data validation passed. [2025-10-17T20:27:45.194917] [INFO ] [MAIN ] NI: Fetched primary data is valid. [2025-10-17T20:27:45.194999] [DEBUG] [LOCAL ] NI: Saving primary data. [2025-10-17T20:27:45.196748] [DEBUG] [LOCAL ] NI: Trimmed 77488 records to 54184 (keeping 200 days of data) [2025-10-17T20:27:45.682782] [DEBUG] [LOCAL ] NI: Primary data saved (54184 records). [2025-10-17T20:27:45.682951] [INFO ] [MAIN ] NI: Full history saved. [2025-10-17T20:27:45.683053] [INFO ] [MAIN ] Update Progress: 1479/2368 symbols completed. NI took 36.0s. Estimated remaining: 2h 4m 51s. Rate: 7.1 symbols/min [2025-10-17T20:27:46.018956] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T20:27:46.024933] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-17T20:27:46.932407] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T20:27:46.935463] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-17T20:27:47.936879] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T20:27:47.940035] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-17T20:27:48.802107] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T20:27:48.804491] [INFO ] [REMOTE ] NIE: Full fetch complete (16726 records). [2025-10-17T20:27:48.804566] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-17T20:27:49.162279] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-17T20:27:49.162355] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-17T20:27:49.162724] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-17T20:27:49.162785] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-17T20:27:49.163286] [DEBUG] [LOCAL ] NIE: Trimmed 16726 records to 12094 (keeping 200 days of data) [2025-10-17T20:27:49.235273] [DEBUG] [LOCAL ] NIE: Primary data saved (12094 records). [2025-10-17T20:27:49.235411] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-17T20:27:49.235496] [INFO ] [MAIN ] Update Progress: 1480/2368 symbols completed. NIE took 19.7s. Estimated remaining: 2h 4m 39s. Rate: 7.1 symbols/min [2025-10-17T20:27:49.880702] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:27:49.917717] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:27:49.974686] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-17T20:27:49.990432] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-17T20:27:49.982136] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:27:50.007920] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-17T20:27:50.010923] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-17T20:27:50.014703] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-17T20:27:50.014866] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-17T20:27:50.014183] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:27:50.042041] [DEBUG] [LOCAL ] NIM: Loaded 3564 existing records from primary storage. [2025-10-17T20:27:50.052864] [INFO ] [MAIN ] NIM: Loaded 3564 existing records. [2025-10-17T20:27:50.370305] [DEBUG] [LOCAL ] NINE: Loaded 28660 existing records from primary storage. [2025-10-17T20:27:50.427202] [INFO ] [MAIN ] NINE: Loaded 28660 existing records. [2025-10-17T20:27:50.502176] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:27:50.585469] [DEBUG] [LOCAL ] NIO: Loaded 54192 existing records from primary storage. [2025-10-17T20:27:50.601428] [INFO ] [MAIN ] NIO: Loaded 54192 existing records. [2025-10-17T20:27:50.658339] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-17T20:27:50.663696] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-17T20:27:50.739006] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-10-17T20:27:50.758519] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-17T20:27:51.012725] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:27:51.107726] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-10-17T20:27:51.102754] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:27:51.121158] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-17T20:27:51.162875] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-17T20:27:51.193846] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-10-17T20:27:51.193743] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:27:51.203563] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-17T20:27:51.204220] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-17T20:27:51.227717] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-10-17T20:27:51.204616] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-17T20:27:51.245371] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-17T20:27:51.682269] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T20:27:51.735831] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:27:51.770299] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-10-17T20:27:51.770009] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-10-17T20:27:51.843464] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:27:51.844853] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-17T20:27:51.878795] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:27:51.900969] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-17T20:27:51.954669] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-17T20:27:51.978023] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-17T20:27:51.999271] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-17T20:27:52.021136] [INFO ] [MAIN ] Update Progress: 1481/2368 symbols completed. NIQ took 2.8s. Estimated remaining: 2h 4m 27s. Rate: 7.1 symbols/min [2025-10-17T20:27:52.238837] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:27:52.268185] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-10-17T20:27:52.302206] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:27:52.303725] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-10-17T20:27:52.378062] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:27:52.378339] [DEBUG] [LOCAL ] NJR: No existing data file found in primary storage. [2025-10-17T20:27:52.378397] [WARN ] [MAIN ] NJR: No existing data found, performing full refresh instead. [2025-10-17T20:27:52.378530] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-17T20:27:52.378574] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-17T20:27:52.378615] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-17T20:27:52.378682] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-17T20:27:52.730444] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:27:52.730802] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-10-17T20:27:52.748840] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T20:27:52.751200] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-17T20:27:53.467140] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T20:27:53.468962] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-17T20:27:53.898309] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T20:27:53.905454] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-17T20:27:54.157755] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-17T20:27:54.204307] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T20:27:54.358034] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-17T20:27:54.733733] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-17T20:27:55.046804] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-17T20:27:55.158074] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-17T20:27:55.683740] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T20:27:55.958093] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-17T20:27:56.631617] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T20:27:56.758039] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-17T20:27:57.013990] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T20:27:57.558035] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-17T20:27:58.358055] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-17T20:27:58.980014] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T20:27:58.980638] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-17T20:27:59.158005] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-17T20:27:59.349334] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-17T20:27:59.958054] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-17T20:28:00.514354] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T20:28:00.758040] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-17T20:28:01.558064] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-17T20:28:02.242799] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-17T20:28:02.348037] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T20:28:02.357998] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-17T20:28:02.999926] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T20:28:03.158028] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-17T20:28:03.958041] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-17T20:28:04.581299] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-17T20:28:04.613464] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T20:28:04.758022] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-17T20:28:04.971334] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-17T20:28:05.558084] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-17T20:28:06.358022] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-17T20:28:06.508166] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T20:28:07.158044] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-17T20:28:07.958067] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-17T20:28:08.077161] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T20:28:08.245944] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-17T20:28:08.614635] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-17T20:28:08.702923] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T20:28:08.758028] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-17T20:28:09.558001] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-17T20:28:09.677197] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-17T20:28:10.358080] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-17T20:28:11.158054] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-17T20:28:11.813363] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T20:28:11.921000] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-17T20:28:11.957987] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-17T20:28:12.602696] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T20:28:12.758025] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-17T20:28:13.558008] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-17T20:28:13.633717] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T20:28:13.660443] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T20:28:14.358021] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-17T20:28:14.530929] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T20:28:14.829988] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-17T20:28:15.158059] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-17T20:28:15.958032] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-17T20:28:16.548685] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T20:28:16.549580] [INFO ] [REMOTE ] NIM: Full fetch complete (6306 records). [2025-10-17T20:28:16.549684] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-17T20:28:16.763228] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-17T20:28:16.946000] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-10-17T20:28:16.946220] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-10-17T20:28:16.948074] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T20:28:16.946799] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-10-17T20:28:16.948181] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-10-17T20:28:16.956924] [DEBUG] [LOCAL ] NIM: Trimmed 6306 records to 3590 (keeping 200 days of data) [2025-10-17T20:28:16.978038] [DEBUG] [LOCAL ] NIM: Primary data saved (3590 records). [2025-10-17T20:28:16.978101] [INFO ] [MAIN ] NIM: Full history saved. [2025-10-17T20:28:16.978199] [INFO ] [MAIN ] Update Progress: 1482/2368 symbols completed. NIM took 27.7s. Estimated remaining: 2h 4m 29s. Rate: 7.1 symbols/min [2025-10-17T20:28:17.143104] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:28:17.143277] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-17T20:28:17.143314] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-17T20:28:17.143428] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-17T20:28:17.143481] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-17T20:28:17.143549] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-17T20:28:17.143594] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-17T20:28:17.502074] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:28:17.557996] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-10-17T20:28:18.185043] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T20:28:18.358026] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-17T20:28:19.158031] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-17T20:28:19.958044] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-17T20:28:20.086582] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-17T20:28:20.166664] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T20:28:20.763130] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-17T20:28:20.775863] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T20:28:21.259309] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T20:28:21.265310] [INFO ] [REMOTE ] NINE: Full fetch complete (43359 records). [2025-10-17T20:28:21.265476] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-17T20:28:21.563175] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-17T20:28:21.637338] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-10-17T20:28:21.637482] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-10-17T20:28:21.638316] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-10-17T20:28:21.638412] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-10-17T20:28:21.639329] [DEBUG] [LOCAL ] NINE: Trimmed 43359 records to 28875 (keeping 200 days of data) [2025-10-17T20:28:21.799322] [DEBUG] [LOCAL ] NINE: Primary data saved (28875 records). [2025-10-17T20:28:21.799457] [INFO ] [MAIN ] NINE: Full history saved. [2025-10-17T20:28:21.799536] [INFO ] [MAIN ] Update Progress: 1483/2368 symbols completed. NINE took 32.6s. Estimated remaining: 2h 4m 18s. Rate: 7.1 symbols/min [2025-10-17T20:28:21.963834] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:28:21.984598] [DEBUG] [LOCAL ] NKX: Loaded 13736 existing records from primary storage. [2025-10-17T20:28:21.984934] [INFO ] [MAIN ] NKX: Loaded 13736 existing records. [2025-10-17T20:28:22.156624] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:28:22.156832] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-17T20:28:22.156878] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-17T20:28:22.157061] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-10-17T20:28:22.157117] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-17T20:28:22.363189] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-17T20:28:22.508358] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:28:23.158073] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-10-17T20:28:23.924429] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (3.16 seconds). [2025-10-17T20:28:23.957981] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-17T20:28:24.004932] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-17T20:28:24.048926] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T20:28:24.054191] [INFO ] [REMOTE ] NJR: Full fetch complete (54884 records). [2025-10-17T20:28:24.054291] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-17T20:28:24.326131] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T20:28:24.462365] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-10-17T20:28:24.462452] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-10-17T20:28:24.463417] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-10-17T20:28:24.463480] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-10-17T20:28:24.464711] [DEBUG] [LOCAL ] NJR: Trimmed 54884 records to 38726 (keeping 200 days of data) [2025-10-17T20:28:24.718910] [DEBUG] [LOCAL ] NJR: Primary data saved (38726 records). [2025-10-17T20:28:24.719069] [INFO ] [MAIN ] NJR: Full history saved. [2025-10-17T20:28:24.719172] [INFO ] [MAIN ] Update Progress: 1484/2368 symbols completed. NJR took 32.7s. Estimated remaining: 2h 4m 7s. Rate: 7.1 symbols/min [2025-10-17T20:28:24.763575] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-17T20:28:24.890844] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:28:24.891046] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-17T20:28:24.891084] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-17T20:28:24.891208] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-17T20:28:24.891250] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-17T20:28:24.891291] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-17T20:28:24.891323] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-17T20:28:25.237542] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:28:25.558028] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-10-17T20:28:26.160208] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-17T20:28:26.358037] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-17T20:28:26.475074] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-10-17T20:28:27.157998] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-17T20:28:27.312676] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T20:28:27.469989] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-17T20:28:27.819373] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-17T20:28:27.958083] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-17T20:28:28.695262] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-17T20:28:28.758030] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-17T20:28:29.432833] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-17T20:28:29.557996] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-17T20:28:30.358049] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-17T20:28:31.072376] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-17T20:28:31.158042] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-17T20:28:31.933154] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T20:28:31.957990] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-17T20:28:32.193021] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-17T20:28:32.483484] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-17T20:28:32.758061] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-17T20:28:33.558112] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-17T20:28:33.643179] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T20:28:34.358054] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-17T20:28:35.158059] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-17T20:28:35.860969] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-17T20:28:35.958063] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-17T20:28:36.225516] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-10-17T20:28:36.653730] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-17T20:28:36.757990] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-17T20:28:36.855033] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T20:28:37.558041] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-17T20:28:38.358105] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-17T20:28:38.469538] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T20:28:39.084068] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-17T20:28:39.158064] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-17T20:28:39.422454] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-17T20:28:39.967472] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-17T20:28:39.972441] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T20:28:39.980840] [INFO ] [REMOTE ] NIO: Full fetch complete (77982 records). [2025-10-17T20:28:39.981021] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-17T20:28:40.395287] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-10-17T20:28:40.395412] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-10-17T20:28:40.396704] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-10-17T20:28:40.396774] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-10-17T20:28:40.398523] [DEBUG] [LOCAL ] NIO: Trimmed 77982 records to 54582 (keeping 200 days of data) [2025-10-17T20:28:40.697338] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T20:28:40.699930] [INFO ] [REMOTE ] NL: Full fetch complete (6918 records). [2025-10-17T20:28:40.700580] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-17T20:28:40.766206] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-17T20:28:40.903107] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T20:28:40.904035] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:28:40.905054] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:28:40.905788] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-17T20:28:40.906546] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-17T20:28:40.907928] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-17T20:28:40.908383] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-17T20:28:40.909107] [INFO ] [MAIN ] Update Progress: 1485/2368 symbols completed. NL took 16.2s. Estimated remaining: 2h 4m 3s. Rate: 7.1 symbols/min [2025-10-17T20:28:41.053269] [DEBUG] [LOCAL ] NIO: Primary data saved (54582 records). [2025-10-17T20:28:41.086252] [INFO ] [MAIN ] NIO: Full history saved. [2025-10-17T20:28:41.148408] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:28:41.145943] [INFO ] [MAIN ] Update Progress: 1486/2368 symbols completed. NIO took 51.8s. Estimated remaining: 2h 3m 49s. Rate: 7.1 symbols/min [2025-10-17T20:28:41.159639] [DEBUG] [LOCAL ] NLOP: No existing data file found in primary storage. [2025-10-17T20:28:41.179790] [WARN ] [MAIN ] NLOP: No existing data found, performing full refresh instead. [2025-10-17T20:28:41.238600] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-17T20:28:41.248955] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-17T20:28:41.259804] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-17T20:28:41.264998] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-17T20:28:41.430075] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:28:41.430220] [DEBUG] [LOCAL ] NLY: No existing data file found in primary storage. [2025-10-17T20:28:41.430332] [WARN ] [MAIN ] NLY: No existing data found, performing full refresh instead. [2025-10-17T20:28:41.430439] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-17T20:28:41.436267] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-17T20:28:41.441512] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-17T20:28:41.451828] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-17T20:28:41.558163] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-17T20:28:41.983303] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:28:41.972634] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-17T20:28:42.072008] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:28:42.358051] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-17T20:28:43.158093] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-10-17T20:28:43.202178] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T20:28:43.957996] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-17T20:28:44.454332] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.90 seconds). [2025-10-17T20:28:44.677502] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T20:28:44.763160] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-17T20:28:44.777069] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T20:28:45.558009] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-17T20:28:45.860072] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T20:28:46.358039] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-17T20:28:47.158009] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-10-17T20:28:47.510023] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-17T20:28:47.958039] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-17T20:28:48.039971] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-17T20:28:48.758097] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-17T20:28:49.033307] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-17T20:28:49.558031] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-17T20:28:49.634300] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T20:28:49.940142] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-17T20:28:50.357999] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-17T20:28:50.580543] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-17T20:28:51.158034] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-17T20:28:51.958004] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-17T20:28:52.444336] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-17T20:28:52.758008] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-17T20:28:52.975364] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T20:28:53.217406] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-17T20:28:53.558021] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-17T20:28:54.358068] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-17T20:28:54.940621] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-17T20:28:55.158039] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-17T20:28:55.204222] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T20:28:55.206346] [INFO ] [REMOTE ] NKX: Full fetch complete (19152 records). [2025-10-17T20:28:55.206422] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-17T20:28:55.575468] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-10-17T20:28:55.575549] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-10-17T20:28:55.576020] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-10-17T20:28:55.576084] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-10-17T20:28:55.576903] [DEBUG] [LOCAL ] NKX: Trimmed 19152 records to 13862 (keeping 200 days of data) [2025-10-17T20:28:55.661244] [DEBUG] [LOCAL ] NKX: Primary data saved (13862 records). [2025-10-17T20:28:55.661383] [INFO ] [MAIN ] NKX: Full history saved. [2025-10-17T20:28:55.661472] [INFO ] [MAIN ] Update Progress: 1487/2368 symbols completed. NKX took 33.9s. Estimated remaining: 2h 3m 45s. Rate: 7.1 symbols/min [2025-10-17T20:28:55.837960] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:28:55.853218] [DEBUG] [LOCAL ] NMAI: Loaded 12951 existing records from primary storage. [2025-10-17T20:28:55.853474] [INFO ] [MAIN ] NMAI: Loaded 12951 existing records. [2025-10-17T20:28:55.958897] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-17T20:28:56.047224] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:28:56.047625] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-17T20:28:56.047722] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-17T20:28:56.048037] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-10-17T20:28:56.048170] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-17T20:28:56.246209] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-17T20:28:56.450153] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:28:56.757986] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-17T20:28:56.851046] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-17T20:28:57.243703] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-17T20:28:57.558011] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-10-17T20:28:58.358008] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-17T20:28:58.561164] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T20:28:59.158005] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-17T20:28:59.274624] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-17T20:28:59.322049] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-17T20:28:59.329965] [INFO ] [REMOTE ] NKE: Full fetch complete (77217 records). [2025-10-17T20:28:59.330114] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-17T20:28:59.523247] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T20:28:59.524065] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:28:59.524139] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:28:59.524215] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-17T20:28:59.524306] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-17T20:28:59.524363] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-17T20:28:59.524421] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-17T20:28:59.524508] [INFO ] [MAIN ] Update Progress: 1488/2368 symbols completed. NKE took 42.5s. Estimated remaining: 2h 3m 34s. Rate: 7.1 symbols/min [2025-10-17T20:28:59.713510] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:28:59.713696] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-17T20:28:59.713747] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-17T20:28:59.713857] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-17T20:28:59.713897] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-17T20:28:59.713938] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-17T20:28:59.713988] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-17T20:28:59.963142] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-17T20:29:00.058073] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:29:00.758076] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-10-17T20:29:01.097585] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T20:29:01.097987] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-10-17T20:29:01.098098] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:29:01.098182] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-17T20:29:01.098265] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:29:01.098359] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-17T20:29:01.098441] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-17T20:29:01.098480] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-17T20:29:01.098520] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-17T20:29:01.098567] [INFO ] [MAIN ] Update Progress: 1489/2368 symbols completed. NMAX took 1.6s. Estimated remaining: 2h 3m 21s. Rate: 7.1 symbols/min [2025-10-17T20:29:01.232456] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T20:29:01.295728] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:29:01.295929] [DEBUG] [LOCAL ] NMCO: No existing data file found in primary storage. [2025-10-17T20:29:01.295982] [WARN ] [MAIN ] NMCO: No existing data found, performing full refresh instead. [2025-10-17T20:29:01.296129] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-17T20:29:01.296188] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-17T20:29:01.296235] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-17T20:29:01.296270] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-17T20:29:01.560412] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-17T20:29:01.679499] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:29:01.708581] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-17T20:29:02.358039] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-10-17T20:29:02.472075] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T20:29:03.158076] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-17T20:29:03.603163] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T20:29:03.958058] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-17T20:29:04.244020] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T20:29:04.758047] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-17T20:29:05.010878] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-17T20:29:05.558015] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-17T20:29:05.836540] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T20:29:06.358033] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-17T20:29:07.158023] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-17T20:29:07.267007] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-17T20:29:07.421844] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T20:29:07.958047] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-17T20:29:08.165470] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-17T20:29:08.758072] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-17T20:29:09.557997] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-17T20:29:09.595421] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T20:29:10.034590] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-17T20:29:10.358009] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-17T20:29:10.458154] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-17T20:29:11.158009] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-17T20:29:11.308390] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-17T20:29:11.958038] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-17T20:29:12.758054] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-17T20:29:12.949299] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T20:29:13.142206] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T20:29:13.557994] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-17T20:29:13.658808] [DEBUG] [REMOTE ] NLY: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-17T20:29:13.659119] [WARN ] [REMOTE ] NLY: No data returned for month 2025-10 [2025-10-17T20:29:13.659206] [FATAL] [REMOTE ] NLY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:29:13.659295] [FATAL] [MAIN ] NLY: Failed to fetch primary data. [2025-10-17T20:29:13.659359] [WARN ] [MAIN ] NLY: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:29:13.659429] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-17T20:29:13.659491] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-17T20:29:13.659527] [INFO ] [LOCAL ] NLY: Starting deletion of derivative data. [2025-10-17T20:29:13.659565] [DEBUG] [LOCAL ] NLY: No derivative data file found to delete. [2025-10-17T20:29:13.659609] [INFO ] [MAIN ] Update Progress: 1490/2368 symbols completed. NLY took 32.5s. Estimated remaining: 2h 3m 15s. Rate: 7.1 symbols/min [2025-10-17T20:29:13.841076] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:29:13.860569] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T20:29:13.870724] [DEBUG] [LOCAL ] NMG: Loaded 11020 existing records from primary storage. [2025-10-17T20:29:13.870968] [INFO ] [MAIN ] NMG: Loaded 11020 existing records. [2025-10-17T20:29:14.062249] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:29:14.062497] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-17T20:29:14.062547] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-17T20:29:14.062765] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-10-17T20:29:14.062825] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-17T20:29:14.361580] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-17T20:29:14.448424] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:29:15.158012] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-17T20:29:15.477499] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T20:29:15.958153] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-17T20:29:15.959885] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-17T20:29:16.758023] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-17T20:29:17.044944] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T20:29:17.455872] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-17T20:29:17.557997] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-17T20:29:18.358039] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-10-17T20:29:18.552308] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T20:29:19.158022] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-17T20:29:19.360547] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T20:29:19.886914] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-17T20:29:19.958031] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-17T20:29:20.757998] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-17T20:29:21.001867] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T20:29:21.557999] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-17T20:29:21.851335] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T20:29:22.358025] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-17T20:29:22.394837] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T20:29:22.397034] [INFO ] [REMOTE ] NMAI: Full fetch complete (19541 records). [2025-10-17T20:29:22.397105] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-17T20:29:22.752384] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-10-17T20:29:22.752471] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-10-17T20:29:22.752981] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-10-17T20:29:22.753045] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-10-17T20:29:22.753630] [DEBUG] [LOCAL ] NMAI: Trimmed 19541 records to 13002 (keeping 200 days of data) [2025-10-17T20:29:22.833609] [DEBUG] [LOCAL ] NMAI: Primary data saved (13002 records). [2025-10-17T20:29:22.833775] [INFO ] [MAIN ] NMAI: Full history saved. [2025-10-17T20:29:22.833864] [INFO ] [MAIN ] Update Progress: 1491/2368 symbols completed. NMAI took 27.2s. Estimated remaining: 2h 3m 7s. Rate: 7.1 symbols/min [2025-10-17T20:29:23.001843] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:29:23.009501] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-17T20:29:23.016940] [DEBUG] [LOCAL ] NMI: Loaded 4065 existing records from primary storage. [2025-10-17T20:29:23.017172] [INFO ] [MAIN ] NMI: Loaded 4065 existing records. [2025-10-17T20:29:23.165100] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-17T20:29:23.198156] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:29:23.198381] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-17T20:29:23.198429] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-17T20:29:23.198571] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-10-17T20:29:23.198610] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-17T20:29:23.575617] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:29:23.958016] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-17T20:29:24.215501] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T20:29:24.725462] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T20:29:24.758036] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-17T20:29:25.558003] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-10-17T20:29:25.606573] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T20:29:25.609010] [INFO ] [REMOTE ] NMCO: Full fetch complete (23027 records). [2025-10-17T20:29:25.609108] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-17T20:29:26.010710] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-10-17T20:29:26.010801] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-10-17T20:29:26.011343] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-10-17T20:29:26.011424] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-10-17T20:29:26.012309] [DEBUG] [LOCAL ] NMCO: Trimmed 23027 records to 16861 (keeping 200 days of data) [2025-10-17T20:29:26.133793] [DEBUG] [LOCAL ] NMCO: Primary data saved (16861 records). [2025-10-17T20:29:26.133946] [INFO ] [MAIN ] NMCO: Full history saved. [2025-10-17T20:29:26.134024] [INFO ] [MAIN ] Update Progress: 1492/2368 symbols completed. NMCO took 25.0s. Estimated remaining: 2h 2m 56s. Rate: 7.1 symbols/min [2025-10-17T20:29:26.261305] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-17T20:29:26.313427] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:29:26.313603] [DEBUG] [LOCAL ] NMM: No existing data file found in primary storage. [2025-10-17T20:29:26.313677] [WARN ] [MAIN ] NMM: No existing data found, performing full refresh instead. [2025-10-17T20:29:26.313796] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-17T20:29:26.313838] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-17T20:29:26.313879] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-17T20:29:26.313913] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-17T20:29:26.364840] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-17T20:29:26.663481] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:29:27.040835] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T20:29:27.158045] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-17T20:29:27.863049] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-17T20:29:27.958107] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-17T20:29:28.486804] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-17T20:29:28.758042] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-17T20:29:29.558011] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-17T20:29:29.654472] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T20:29:30.358113] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-17T20:29:30.606238] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-17T20:29:31.115975] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-17T20:29:31.118466] [INFO ] [REMOTE ] NLOP: Full fetch complete (17773 records). [2025-10-17T20:29:31.118564] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-17T20:29:31.163263] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-17T20:29:31.510498] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-10-17T20:29:31.510631] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-10-17T20:29:31.511107] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-10-17T20:29:31.511155] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-10-17T20:29:31.511736] [DEBUG] [LOCAL ] NLOP: Trimmed 17773 records to 11880 (keeping 200 days of data) [2025-10-17T20:29:31.585532] [DEBUG] [LOCAL ] NLOP: Primary data saved (11880 records). [2025-10-17T20:29:31.585713] [INFO ] [MAIN ] NLOP: Full history saved. [2025-10-17T20:29:31.585805] [INFO ] [MAIN ] Update Progress: 1493/2368 symbols completed. NLOP took 50.7s. Estimated remaining: 2h 2m 46s. Rate: 7.1 symbols/min [2025-10-17T20:29:31.749255] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:29:31.783508] [DEBUG] [LOCAL ] NMR: Loaded 35856 existing records from primary storage. [2025-10-17T20:29:31.783814] [INFO ] [MAIN ] NMR: Loaded 35856 existing records. [2025-10-17T20:29:31.965870] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:29:31.961718] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-10-17T20:29:31.966881] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-17T20:29:31.966938] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-17T20:29:31.967127] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-10-17T20:29:31.967184] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-17T20:29:32.230985] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T20:29:32.332989] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:29:32.757999] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-10-17T20:29:33.171943] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-17T20:29:33.558057] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-17T20:29:34.189560] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T20:29:34.358011] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-17T20:29:34.439833] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-17T20:29:35.158000] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-17T20:29:35.444997] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T20:29:35.958042] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-17T20:29:36.649910] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T20:29:36.758048] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-17T20:29:37.021818] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T20:29:37.405758] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-17T20:29:37.558059] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-17T20:29:38.234243] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-17T20:29:38.358071] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-17T20:29:39.158049] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-17T20:29:39.854199] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-17T20:29:39.892422] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T20:29:39.957996] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-17T20:29:40.758022] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-17T20:29:41.416133] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-17T20:29:41.482968] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T20:29:41.558069] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-17T20:29:42.357999] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-17T20:29:42.365917] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T20:29:43.158037] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-17T20:29:43.958052] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-17T20:29:43.996708] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T20:29:44.022616] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T20:29:44.663113] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T20:29:44.758043] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-17T20:29:45.558078] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-17T20:29:46.292438] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T20:29:46.293055] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-17T20:29:46.357986] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-17T20:29:47.158046] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-17T20:29:47.674554] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-17T20:29:47.675505] [INFO ] [REMOTE ] NMI: Full fetch complete (5718 records). [2025-10-17T20:29:47.675576] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-17T20:29:47.793992] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T20:29:47.963113] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-17T20:29:48.073987] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-17T20:29:48.074066] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-17T20:29:48.074256] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-17T20:29:48.074318] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-17T20:29:48.074729] [DEBUG] [LOCAL ] NMI: Trimmed 5718 records to 4080 (keeping 200 days of data) [2025-10-17T20:29:48.099498] [DEBUG] [LOCAL ] NMI: Primary data saved (4080 records). [2025-10-17T20:29:48.099674] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-17T20:29:48.099782] [INFO ] [MAIN ] Update Progress: 1494/2368 symbols completed. NMI took 25.3s. Estimated remaining: 2h 2m 42s. Rate: 7.1 symbols/min [2025-10-17T20:29:48.269598] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:29:48.274690] [DEBUG] [LOCAL ] NMS: Loaded 2924 existing records from primary storage. [2025-10-17T20:29:48.274854] [INFO ] [MAIN ] NMS: Loaded 2924 existing records. [2025-10-17T20:29:48.446727] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:29:48.446960] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-17T20:29:48.447032] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-17T20:29:48.447195] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-10-17T20:29:48.447250] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-17T20:29:48.763204] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-17T20:29:48.802106] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:29:48.958844] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-17T20:29:49.213703] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-17T20:29:49.558043] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-10-17T20:29:50.102919] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-17T20:29:50.358028] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-17T20:29:51.158014] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-17T20:29:51.212676] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-17T20:29:51.958051] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-17T20:29:52.730950] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T20:29:52.758012] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-17T20:29:52.793783] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-17T20:29:53.558027] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-17T20:29:54.257685] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T20:29:54.357986] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-17T20:29:54.569133] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T20:29:55.158046] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-17T20:29:55.750382] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-17T20:29:55.958068] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-17T20:29:56.413277] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T20:29:56.418808] [INFO ] [REMOTE ] NMG: Full fetch complete (15583 records). [2025-10-17T20:29:56.418888] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-17T20:29:56.766466] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-17T20:29:56.776690] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-10-17T20:29:56.776783] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-10-17T20:29:56.777240] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-10-17T20:29:56.777485] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-10-17T20:29:56.778081] [DEBUG] [LOCAL ] NMG: Trimmed 15583 records to 11397 (keeping 200 days of data) [2025-10-17T20:29:56.842075] [DEBUG] [LOCAL ] NMG: Primary data saved (11397 records). [2025-10-17T20:29:56.842216] [INFO ] [MAIN ] NMG: Full history saved. [2025-10-17T20:29:56.842297] [INFO ] [MAIN ] Update Progress: 1495/2368 symbols completed. NMG took 43.2s. Estimated remaining: 2h 2m 34s. Rate: 7.1 symbols/min [2025-10-17T20:29:57.013062] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:29:57.018202] [DEBUG] [LOCAL ] NMT: Loaded 2854 existing records from primary storage. [2025-10-17T20:29:57.018353] [INFO ] [MAIN ] NMT: Loaded 2854 existing records. [2025-10-17T20:29:57.207712] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:29:57.208967] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-17T20:29:57.209060] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-17T20:29:57.213434] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-17T20:29:57.214322] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-10-17T20:29:57.214384] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-17T20:29:57.423567] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-17T20:29:57.563411] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-17T20:29:57.592825] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:29:58.288098] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-17T20:29:58.358047] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-17T20:29:58.907098] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-17T20:29:59.158018] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-17T20:29:59.958079] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-17T20:30:00.574202] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-17T20:30:00.591076] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T20:30:00.596940] [INFO ] [REMOTE ] NMR: Full fetch complete (51220 records). [2025-10-17T20:30:00.597090] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-17T20:30:00.758717] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-17T20:30:00.994281] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-10-17T20:30:00.994375] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-10-17T20:30:00.995356] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-10-17T20:30:00.995429] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-10-17T20:30:00.996634] [DEBUG] [LOCAL ] NMR: Trimmed 51220 records to 36138 (keeping 200 days of data) [2025-10-17T20:30:01.210751] [DEBUG] [LOCAL ] NMR: Primary data saved (36138 records). [2025-10-17T20:30:01.210907] [INFO ] [MAIN ] NMR: Full history saved. [2025-10-17T20:30:01.210993] [INFO ] [MAIN ] Update Progress: 1496/2368 symbols completed. NMR took 29.6s. Estimated remaining: 2h 2m 23s. Rate: 7.1 symbols/min [2025-10-17T20:30:01.382254] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:30:01.382449] [DEBUG] [LOCAL ] NMZ: No existing data file found in primary storage. [2025-10-17T20:30:01.382488] [WARN ] [MAIN ] NMZ: No existing data found, performing full refresh instead. [2025-10-17T20:30:01.382611] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-17T20:30:01.382684] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-17T20:30:01.382749] [DEBUG] [LOCAL ] NMZ: No primary data file found to delete. [2025-10-17T20:30:01.382784] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-17T20:30:01.563490] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-17T20:30:01.757421] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:30:01.969051] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T20:30:02.324874] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T20:30:02.358038] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-17T20:30:03.158046] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-17T20:30:03.409390] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T20:30:03.804679] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-17T20:30:03.958065] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-17T20:30:04.758012] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-10-17T20:30:04.957674] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-17T20:30:05.558067] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-17T20:30:05.976755] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T20:30:06.208514] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-17T20:30:06.358027] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-17T20:30:06.909854] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-17T20:30:07.158053] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-10-17T20:30:07.913583] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-17T20:30:07.958051] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-17T20:30:08.758048] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-17T20:30:09.038405] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T20:30:09.286501] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-17T20:30:09.558035] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-17T20:30:10.357997] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-17T20:30:10.732128] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-17T20:30:10.902541] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-17T20:30:11.158029] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-17T20:30:11.958076] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-17T20:30:12.541076] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-17T20:30:12.542161] [INFO ] [REMOTE ] NMS: Full fetch complete (4066 records). [2025-10-17T20:30:12.542232] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-17T20:30:12.764552] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-17T20:30:12.934508] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T20:30:12.960000] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-17T20:30:12.963316] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-17T20:30:12.963548] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-17T20:30:12.963637] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-17T20:30:12.964156] [DEBUG] [LOCAL ] NMS: Trimmed 4066 records to 2936 (keeping 200 days of data) [2025-10-17T20:30:12.984028] [DEBUG] [LOCAL ] NMS: Primary data saved (2936 records). [2025-10-17T20:30:12.984097] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-17T20:30:12.984186] [INFO ] [MAIN ] Update Progress: 1497/2368 symbols completed. NMS took 24.9s. Estimated remaining: 2h 2m 16s. Rate: 7.1 symbols/min [2025-10-17T20:30:13.176262] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:30:13.190016] [DEBUG] [LOCAL ] NNI: Loaded 10533 existing records from primary storage. [2025-10-17T20:30:13.190269] [INFO ] [MAIN ] NNI: Loaded 10533 existing records. [2025-10-17T20:30:13.384882] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:30:13.385106] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-17T20:30:13.385159] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-17T20:30:13.385459] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-10-17T20:30:13.385516] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-17T20:30:13.465201] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-17T20:30:13.563126] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-17T20:30:13.755131] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:30:14.358076] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-17T20:30:14.796838] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T20:30:14.861862] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-17T20:30:15.158002] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-17T20:30:15.814941] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-17T20:30:15.958033] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-17T20:30:16.664079] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-17T20:30:16.758038] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-17T20:30:17.400543] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-17T20:30:17.558019] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-10-17T20:30:18.358005] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-17T20:30:18.400339] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-17T20:30:19.158008] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-17T20:30:19.505027] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-17T20:30:19.565468] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-17T20:30:19.958025] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-17T20:30:20.592056] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-17T20:30:20.758031] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-17T20:30:21.558055] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-17T20:30:22.127212] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T20:30:22.207798] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T20:30:22.358007] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-17T20:30:23.158073] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-17T20:30:23.485365] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T20:30:23.958008] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-17T20:30:23.964731] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T20:30:24.410701] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-17T20:30:24.411562] [INFO ] [REMOTE ] NMT: Full fetch complete (3912 records). [2025-10-17T20:30:24.411628] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-17T20:30:24.752814] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-17T20:30:24.752895] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-17T20:30:24.753023] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-17T20:30:24.753062] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-17T20:30:24.753415] [DEBUG] [LOCAL ] NMT: Trimmed 3912 records to 2867 (keeping 200 days of data) [2025-10-17T20:30:24.771249] [DEBUG] [LOCAL ] NMT: Primary data saved (2867 records). [2025-10-17T20:30:24.766394] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-17T20:30:24.772196] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-17T20:30:24.772289] [INFO ] [MAIN ] Update Progress: 1498/2368 symbols completed. NMT took 27.9s. Estimated remaining: 2h 2m 10s. Rate: 7.1 symbols/min [2025-10-17T20:30:24.947001] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:30:24.947226] [DEBUG] [LOCAL ] NNN: No existing data file found in primary storage. [2025-10-17T20:30:24.947279] [WARN ] [MAIN ] NNN: No existing data found, performing full refresh instead. [2025-10-17T20:30:24.947433] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-17T20:30:24.947485] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-17T20:30:24.947527] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-17T20:30:24.947559] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-17T20:30:25.288976] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:30:25.558014] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-17T20:30:25.607890] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-17T20:30:26.358000] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-17T20:30:26.712881] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T20:30:27.015046] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-17T20:30:27.017989] [INFO ] [REMOTE ] NMM: Full fetch complete (21621 records). [2025-10-17T20:30:27.018089] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-17T20:30:27.166815] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-17T20:30:27.398695] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-10-17T20:30:27.398783] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-10-17T20:30:27.399257] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-10-17T20:30:27.399297] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-10-17T20:30:27.399910] [DEBUG] [LOCAL ] NMM: Trimmed 21621 records to 14552 (keeping 200 days of data) [2025-10-17T20:30:27.487308] [DEBUG] [LOCAL ] NMM: Primary data saved (14552 records). [2025-10-17T20:30:27.487474] [INFO ] [MAIN ] NMM: Full history saved. [2025-10-17T20:30:27.487600] [INFO ] [MAIN ] Update Progress: 1499/2368 symbols completed. NMM took 1m 1s. Estimated remaining: 2h 1m 58s. Rate: 7.1 symbols/min [2025-10-17T20:30:27.653893] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:30:27.662208] [DEBUG] [LOCAL ] NNY: Loaded 5723 existing records from primary storage. [2025-10-17T20:30:27.662409] [INFO ] [MAIN ] NNY: Loaded 5723 existing records. [2025-10-17T20:30:27.835388] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:30:27.835602] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-17T20:30:27.835672] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-17T20:30:27.835840] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-10-17T20:30:27.835897] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-17T20:30:27.963082] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-10-17T20:30:28.191118] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:30:28.417311] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-17T20:30:28.758072] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-17T20:30:29.558055] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-10-17T20:30:29.610333] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T20:30:29.637529] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-17T20:30:30.358060] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-17T20:30:30.452439] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-17T20:30:31.158061] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-17T20:30:31.836870] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T20:30:31.957991] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-17T20:30:31.988348] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T20:30:32.678633] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-17T20:30:32.758011] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-17T20:30:33.558028] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-17T20:30:34.358005] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-17T20:30:34.468401] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T20:30:34.693333] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-17T20:30:34.827068] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-17T20:30:35.158038] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-17T20:30:35.958057] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-17T20:30:36.392867] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-17T20:30:36.758053] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-17T20:30:37.558043] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-17T20:30:37.637058] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T20:30:37.712297] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T20:30:37.715354] [INFO ] [REMOTE ] NMZ: Full fetch complete (31242 records). [2025-10-17T20:30:37.715492] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-17T20:30:38.073666] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-10-17T20:30:38.073754] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-10-17T20:30:38.074288] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-10-17T20:30:38.074326] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-10-17T20:30:38.075034] [DEBUG] [LOCAL ] NMZ: Trimmed 31242 records to 21897 (keeping 200 days of data) [2025-10-17T20:30:38.202394] [DEBUG] [LOCAL ] NMZ: Primary data saved (21897 records). [2025-10-17T20:30:38.202525] [INFO ] [MAIN ] NMZ: Full history saved. [2025-10-17T20:30:38.202594] [INFO ] [MAIN ] Update Progress: 1500/2368 symbols completed. NMZ took 37.0s. Estimated remaining: 2h 1m 51s. Rate: 7.1 symbols/min [2025-10-17T20:30:38.365429] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-17T20:30:38.372270] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:30:38.372838] [DEBUG] [LOCAL ] NOA: No existing data file found in primary storage. [2025-10-17T20:30:38.373206] [WARN ] [MAIN ] NOA: No existing data found, performing full refresh instead. [2025-10-17T20:30:38.374299] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-17T20:30:38.374348] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-17T20:30:38.374392] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-17T20:30:38.374438] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-17T20:30:38.585338] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T20:30:38.822168] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:30:39.015155] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-17T20:30:39.158093] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-17T20:30:39.958059] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-17T20:30:40.702724] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T20:30:40.757985] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-17T20:30:41.045235] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T20:30:41.482513] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T20:30:41.558020] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-17T20:30:42.358048] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-10-17T20:30:43.158017] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-17T20:30:43.257001] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T20:30:43.275571] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-17T20:30:43.958035] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-17T20:30:44.042462] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-17T20:30:44.758039] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-17T20:30:45.558031] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-17T20:30:45.672004] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T20:30:45.692529] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T20:30:46.354549] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-17T20:30:46.357973] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-17T20:30:47.153618] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T20:30:47.157976] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-17T20:30:47.943610] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T20:30:47.957986] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-17T20:30:48.629570] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-17T20:30:48.630812] [INFO ] [REMOTE ] NNY: Full fetch complete (8334 records). [2025-10-17T20:30:48.630879] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-17T20:30:48.769815] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-17T20:30:48.985961] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-17T20:30:48.986032] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-17T20:30:48.986209] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-17T20:30:48.986247] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-17T20:30:48.986633] [DEBUG] [LOCAL ] NNY: Trimmed 8334 records to 5778 (keeping 200 days of data) [2025-10-17T20:30:49.019472] [DEBUG] [LOCAL ] NNY: Primary data saved (5778 records). [2025-10-17T20:30:49.019542] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-17T20:30:49.019626] [INFO ] [MAIN ] Update Progress: 1501/2368 symbols completed. NNY took 21.5s. Estimated remaining: 2h 1m 44s. Rate: 7.1 symbols/min [2025-10-17T20:30:49.183971] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:30:49.184095] [DEBUG] [LOCAL ] NOAH: No existing data file found in primary storage. [2025-10-17T20:30:49.184132] [WARN ] [MAIN ] NOAH: No existing data found, performing full refresh instead. [2025-10-17T20:30:49.184238] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-17T20:30:49.184291] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-17T20:30:49.184358] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-17T20:30:49.184411] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-17T20:30:49.522885] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:30:49.557979] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-10-17T20:30:50.358047] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-17T20:30:50.607204] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T20:30:50.947866] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-17T20:30:50.979092] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-17T20:30:51.158042] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-17T20:30:51.958028] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-17T20:30:52.757992] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-17T20:30:52.792483] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T20:30:52.848285] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T20:30:53.558003] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-17T20:30:53.776826] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-17T20:30:54.358035] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-17T20:30:55.158029] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-17T20:30:55.306256] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-17T20:30:55.337914] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T20:30:55.958039] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-17T20:30:56.114526] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-17T20:30:56.572055] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T20:30:56.573832] [INFO ] [REMOTE ] NNI: Full fetch complete (13035 records). [2025-10-17T20:30:56.573934] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-17T20:30:56.763130] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-17T20:30:56.942576] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-10-17T20:30:56.942684] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-10-17T20:30:56.943021] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-10-17T20:30:56.943065] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-10-17T20:30:56.943532] [DEBUG] [LOCAL ] NNI: Trimmed 13035 records to 10605 (keeping 200 days of data) [2025-10-17T20:30:57.009615] [DEBUG] [LOCAL ] NNI: Primary data saved (10605 records). [2025-10-17T20:30:57.009781] [INFO ] [MAIN ] NNI: Full history saved. [2025-10-17T20:30:57.009867] [INFO ] [MAIN ] Update Progress: 1502/2368 symbols completed. NNI took 44.0s. Estimated remaining: 2h 1m 35s. Rate: 7.1 symbols/min [2025-10-17T20:30:57.179989] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:30:57.180179] [DEBUG] [LOCAL ] NOC: No existing data file found in primary storage. [2025-10-17T20:30:57.180219] [WARN ] [MAIN ] NOC: No existing data found, performing full refresh instead. [2025-10-17T20:30:57.180334] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-17T20:30:57.180377] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-17T20:30:57.180420] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-17T20:30:57.180453] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-17T20:30:57.530192] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:30:57.557996] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-10-17T20:30:57.874021] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T20:30:58.358059] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-17T20:30:59.158042] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-17T20:30:59.257405] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T20:30:59.514836] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T20:30:59.958044] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-17T20:31:00.758038] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-17T20:31:01.139107] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-17T20:31:01.145592] [INFO ] [REMOTE ] NNN: Full fetch complete (70331 records). [2025-10-17T20:31:01.145747] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-17T20:31:01.516461] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T20:31:01.565344] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-17T20:31:01.566170] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-10-17T20:31:01.566244] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-10-17T20:31:01.571479] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-10-17T20:31:01.572750] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-10-17T20:31:01.574718] [DEBUG] [LOCAL ] NNN: Trimmed 70331 records to 48962 (keeping 200 days of data) [2025-10-17T20:31:01.870540] [DEBUG] [LOCAL ] NNN: Primary data saved (48962 records). [2025-10-17T20:31:01.870696] [INFO ] [MAIN ] NNN: Full history saved. [2025-10-17T20:31:01.870778] [INFO ] [MAIN ] Update Progress: 1503/2368 symbols completed. NNN took 37.1s. Estimated remaining: 2h 1m 25s. Rate: 7.1 symbols/min [2025-10-17T20:31:02.043275] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:31:02.043559] [DEBUG] [LOCAL ] NOG: No existing data file found in primary storage. [2025-10-17T20:31:02.043681] [WARN ] [MAIN ] NOG: No existing data found, performing full refresh instead. [2025-10-17T20:31:02.043922] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-17T20:31:02.043988] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-17T20:31:02.044086] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-17T20:31:02.044172] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-17T20:31:02.225537] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-17T20:31:02.363131] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-17T20:31:02.448294] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:31:02.805215] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T20:31:03.158029] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-10-17T20:31:03.871773] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T20:31:03.958063] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-17T20:31:04.758004] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-17T20:31:05.115181] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T20:31:05.353023] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-17T20:31:05.557987] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-17T20:31:05.755911] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-17T20:31:06.358024] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-17T20:31:07.158026] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-17T20:31:07.622544] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T20:31:07.821497] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-17T20:31:07.958011] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-17T20:31:08.281407] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T20:31:08.758009] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-17T20:31:09.002754] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T20:31:09.558027] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-17T20:31:10.358046] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-17T20:31:10.424273] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T20:31:10.601899] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T20:31:11.158033] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-17T20:31:11.501615] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T20:31:11.958030] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-17T20:31:12.758019] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-17T20:31:12.855902] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T20:31:12.887232] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T20:31:13.558031] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-17T20:31:14.358036] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-17T20:31:14.510792] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T20:31:15.158038] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-17T20:31:15.509190] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T20:31:15.604850] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-17T20:31:15.958024] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-17T20:31:16.031757] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-17T20:31:16.758031] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-17T20:31:17.558006] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-17T20:31:17.848851] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T20:31:17.985880] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-17T20:31:18.315224] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-17T20:31:18.318248] [INFO ] [REMOTE ] NOAH: Full fetch complete (27576 records). [2025-10-17T20:31:18.318328] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-17T20:31:18.366232] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-17T20:31:18.694801] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-10-17T20:31:18.694872] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-10-17T20:31:18.695488] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-10-17T20:31:18.695530] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-10-17T20:31:18.696612] [DEBUG] [LOCAL ] NOAH: Trimmed 27576 records to 20519 (keeping 200 days of data) [2025-10-17T20:31:18.817030] [DEBUG] [LOCAL ] NOAH: Primary data saved (20519 records). [2025-10-17T20:31:18.817164] [INFO ] [MAIN ] NOAH: Full history saved. [2025-10-17T20:31:18.817240] [INFO ] [MAIN ] Update Progress: 1504/2368 symbols completed. NOAH took 29.8s. Estimated remaining: 2h 1m 21s. Rate: 7.1 symbols/min [2025-10-17T20:31:18.983079] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:31:19.031461] [DEBUG] [LOCAL ] NOK: Loaded 54012 existing records from primary storage. [2025-10-17T20:31:19.031825] [INFO ] [MAIN ] NOK: Loaded 54012 existing records. [2025-10-17T20:31:19.170436] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-17T20:31:19.212112] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:31:19.212352] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-17T20:31:19.212446] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-17T20:31:19.212703] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-10-17T20:31:19.212782] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-17T20:31:19.561523] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:31:19.958040] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-10-17T20:31:20.277166] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T20:31:20.758033] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-17T20:31:21.156888] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T20:31:21.558042] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-17T20:31:22.096097] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-17T20:31:22.358127] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-17T20:31:22.540407] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T20:31:23.158006] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-17T20:31:23.427452] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-17T20:31:23.958130] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-17T20:31:24.242948] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T20:31:24.758003] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-17T20:31:24.904034] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T20:31:25.558052] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-17T20:31:25.850984] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T20:31:26.258230] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T20:31:26.261302] [INFO ] [REMOTE ] NOA: Full fetch complete (22580 records). [2025-10-17T20:31:26.261399] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-17T20:31:26.362318] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-17T20:31:26.639367] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-10-17T20:31:26.639466] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-10-17T20:31:26.639980] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-10-17T20:31:26.640060] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-10-17T20:31:26.640776] [DEBUG] [LOCAL ] NOA: Trimmed 22580 records to 16210 (keeping 200 days of data) [2025-10-17T20:31:26.751991] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-17T20:31:26.792142] [DEBUG] [LOCAL ] NOA: Primary data saved (16210 records). [2025-10-17T20:31:26.792331] [INFO ] [MAIN ] NOA: Full history saved. [2025-10-17T20:31:26.792432] [INFO ] [MAIN ] Update Progress: 1505/2368 symbols completed. NOA took 48.6s. Estimated remaining: 2h 1m 13s. Rate: 7.1 symbols/min [2025-10-17T20:31:26.962035] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:31:26.962204] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-17T20:31:26.962240] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-17T20:31:26.962357] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-17T20:31:26.962397] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-17T20:31:26.962438] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-17T20:31:26.962469] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-17T20:31:27.168504] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-17T20:31:27.316243] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:31:27.958095] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-10-17T20:31:28.027464] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T20:31:28.476542] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-17T20:31:28.758030] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-17T20:31:29.185896] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-17T20:31:29.504219] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-17T20:31:29.557982] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-17T20:31:30.358085] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-17T20:31:31.158040] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-17T20:31:31.899471] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-17T20:31:31.955085] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T20:31:31.966207] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-17T20:31:32.386697] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-17T20:31:32.758037] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-17T20:31:33.150873] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-17T20:31:33.558026] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-17T20:31:34.244940] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T20:31:34.250114] [INFO ] [REMOTE ] NOC: Full fetch complete (61839 records). [2025-10-17T20:31:34.250265] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-17T20:31:34.363187] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-17T20:31:34.634346] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-10-17T20:31:34.634427] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-10-17T20:31:34.635413] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-10-17T20:31:34.635478] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-10-17T20:31:34.636750] [DEBUG] [LOCAL ] NOC: Trimmed 61839 records to 42214 (keeping 200 days of data) [2025-10-17T20:31:34.859380] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-17T20:31:34.909913] [DEBUG] [LOCAL ] NOC: Primary data saved (42214 records). [2025-10-17T20:31:34.910046] [INFO ] [MAIN ] NOC: Full history saved. [2025-10-17T20:31:34.910119] [INFO ] [MAIN ] Update Progress: 1506/2368 symbols completed. NOC took 37.9s. Estimated remaining: 2h 1m 4s. Rate: 7.1 symbols/min [2025-10-17T20:31:35.086719] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:31:35.087052] [DEBUG] [LOCAL ] NOMD: No existing data file found in primary storage. [2025-10-17T20:31:35.087111] [WARN ] [MAIN ] NOMD: No existing data found, performing full refresh instead. [2025-10-17T20:31:35.087253] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-17T20:31:35.087322] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-17T20:31:35.087438] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-17T20:31:35.087516] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-17T20:31:35.159799] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-17T20:31:35.450845] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:31:35.480305] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T20:31:35.958021] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-17T20:31:36.758006] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-10-17T20:31:36.921353] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T20:31:37.558034] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-17T20:31:37.914449] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-17T20:31:37.993398] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T20:31:38.358060] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-17T20:31:39.158081] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-17T20:31:39.214879] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T20:31:39.893549] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T20:31:39.958029] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-17T20:31:40.370932] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-17T20:31:40.758022] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-17T20:31:41.204742] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-17T20:31:41.426172] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-17T20:31:41.557989] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-17T20:31:42.358032] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-17T20:31:43.158006] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-17T20:31:43.615474] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-17T20:31:43.958049] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-17T20:31:44.072450] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T20:31:44.083532] [INFO ] [REMOTE ] NOG: Full fetch complete (74244 records). [2025-10-17T20:31:44.083757] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-17T20:31:44.483798] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-10-17T20:31:44.484053] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-10-17T20:31:44.485204] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-10-17T20:31:44.485291] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-10-17T20:31:44.508418] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T20:31:44.516265] [DEBUG] [LOCAL ] NOG: Trimmed 74244 records to 52110 (keeping 200 days of data) [2025-10-17T20:31:44.786998] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-17T20:31:44.831116] [DEBUG] [LOCAL ] NOG: Primary data saved (52110 records). [2025-10-17T20:31:44.831246] [INFO ] [MAIN ] NOG: Full history saved. [2025-10-17T20:31:44.831319] [INFO ] [MAIN ] Update Progress: 1507/2368 symbols completed. NOG took 43.0s. Estimated remaining: 2h 0m 56s. Rate: 7.1 symbols/min [2025-10-17T20:31:44.995755] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:31:45.030627] [DEBUG] [LOCAL ] NOTE: Loaded 40633 existing records from primary storage. [2025-10-17T20:31:45.030949] [INFO ] [MAIN ] NOTE: Loaded 40633 existing records. [2025-10-17T20:31:45.206576] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:31:45.206879] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-17T20:31:45.206938] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-17T20:31:45.207113] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-10-17T20:31:45.207166] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-17T20:31:45.563426] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:31:45.559819] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-17T20:31:46.029386] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-17T20:31:46.219711] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-17T20:31:46.357997] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-10-17T20:31:46.432132] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T20:31:47.158041] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-17T20:31:47.652920] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-17T20:31:47.958017] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-17T20:31:48.201494] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T20:31:48.758051] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-17T20:31:49.186776] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-17T20:31:49.558032] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-17T20:31:50.117561] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T20:31:50.358001] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-17T20:31:50.536734] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T20:31:50.716131] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-17T20:31:51.158048] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-17T20:31:51.580434] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-17T20:31:51.581262] [INFO ] [REMOTE ] NOM: Full fetch complete (1560 records). [2025-10-17T20:31:51.581334] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-17T20:31:51.763359] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-17T20:31:51.763540] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:31:51.763610] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:31:51.763686] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-17T20:31:51.763757] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-17T20:31:51.763806] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-17T20:31:51.763845] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-17T20:31:51.763900] [INFO ] [MAIN ] Update Progress: 1508/2368 symbols completed. NOM took 25.0s. Estimated remaining: 2h 0m 47s. Rate: 7.1 symbols/min [2025-10-17T20:31:51.931190] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:31:51.931301] [DEBUG] [LOCAL ] NOV: No existing data file found in primary storage. [2025-10-17T20:31:51.931337] [WARN ] [MAIN ] NOV: No existing data found, performing full refresh instead. [2025-10-17T20:31:51.931446] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-17T20:31:51.931486] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-17T20:31:51.931527] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-17T20:31:51.931559] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-17T20:31:51.963116] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-17T20:31:52.277275] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:31:52.758051] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-17T20:31:53.558043] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-10-17T20:31:53.643036] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T20:31:54.357995] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-17T20:31:54.694213] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-17T20:31:55.158039] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-17T20:31:55.413250] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-17T20:31:55.958086] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-17T20:31:56.149242] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T20:31:56.157046] [INFO ] [REMOTE ] NOK: Full fetch complete (77770 records). [2025-10-17T20:31:56.157195] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-17T20:31:56.549237] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-10-17T20:31:56.549321] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-10-17T20:31:56.550420] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-10-17T20:31:56.550588] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-10-17T20:31:56.552183] [DEBUG] [LOCAL ] NOK: Trimmed 77770 records to 54402 (keeping 200 days of data) [2025-10-17T20:31:56.759926] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-17T20:31:56.865003] [DEBUG] [LOCAL ] NOK: Primary data saved (54402 records). [2025-10-17T20:31:56.865253] [INFO ] [MAIN ] NOK: Full history saved. [2025-10-17T20:31:56.865428] [INFO ] [MAIN ] Update Progress: 1509/2368 symbols completed. NOK took 38.0s. Estimated remaining: 2h 0m 37s. Rate: 7.1 symbols/min [2025-10-17T20:31:57.036630] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:31:57.036822] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-10-17T20:31:57.036929] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-10-17T20:31:57.037208] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-17T20:31:57.037275] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-17T20:31:57.045939] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-17T20:31:57.060545] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-17T20:31:57.137445] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-17T20:31:57.430197] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:31:57.518721] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T20:31:57.557990] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-17T20:31:58.358098] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-17T20:31:58.650638] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-17T20:31:59.086276] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T20:31:59.158040] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-17T20:31:59.714026] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T20:31:59.958055] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-10-17T20:32:00.758082] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-17T20:32:01.219152] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-17T20:32:01.558056] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-17T20:32:02.186535] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-17T20:32:02.350764] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T20:32:02.362890] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-17T20:32:03.023882] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T20:32:03.158067] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-17T20:32:03.958002] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-17T20:32:04.285235] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-17T20:32:04.758033] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-17T20:32:04.864076] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T20:32:05.558015] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-17T20:32:06.049763] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-17T20:32:06.358044] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-17T20:32:06.796241] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T20:32:07.158032] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-17T20:32:07.358541] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T20:32:07.958022] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-17T20:32:08.479868] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-17T20:32:08.758048] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-17T20:32:08.906314] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T20:32:08.913244] [INFO ] [REMOTE ] NOMD: Full fetch complete (60435 records). [2025-10-17T20:32:08.913351] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-17T20:32:09.291324] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-10-17T20:32:09.291404] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-10-17T20:32:09.292369] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-10-17T20:32:09.292432] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-10-17T20:32:09.293683] [DEBUG] [LOCAL ] NOMD: Trimmed 60435 records to 43553 (keeping 200 days of data) [2025-10-17T20:32:09.556100] [DEBUG] [LOCAL ] NOMD: Primary data saved (43553 records). [2025-10-17T20:32:09.556240] [INFO ] [MAIN ] NOMD: Full history saved. [2025-10-17T20:32:09.556337] [INFO ] [MAIN ] Update Progress: 1510/2368 symbols completed. NOMD took 34.6s. Estimated remaining: 2h 0m 31s. Rate: 7.1 symbols/min [2025-10-17T20:32:09.588352] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-17T20:32:09.733304] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:32:09.733567] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-17T20:32:09.733735] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-17T20:32:09.733854] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-17T20:32:09.733918] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-17T20:32:09.733988] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-17T20:32:09.734035] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-17T20:32:10.055822] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-17T20:32:10.142939] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:32:10.358002] [INFO ] [REMOTE ] NP: Fetching primary data for 2024-12. [2025-10-17T20:32:10.538872] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T20:32:10.627830] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T20:32:10.628142] [WARN ] [REMOTE ] NP: No data returned for month 2024-12 [2025-10-17T20:32:10.628232] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:32:10.628280] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-17T20:32:10.628329] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:32:10.628419] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-17T20:32:10.628497] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-17T20:32:10.628535] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-17T20:32:10.628577] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-17T20:32:10.628625] [INFO ] [MAIN ] Update Progress: 1511/2368 symbols completed. NP took 1.1s. Estimated remaining: 2h 0m 18s. Rate: 7.1 symbols/min [2025-10-17T20:32:10.795383] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:32:10.795572] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-17T20:32:10.795611] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-17T20:32:10.795745] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-17T20:32:10.795788] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-17T20:32:10.795830] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-17T20:32:10.795872] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-17T20:32:11.144769] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:32:11.157982] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-10-17T20:32:11.958040] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-17T20:32:11.962468] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T20:32:11.995837] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-10-17T20:32:12.002426] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:32:12.002745] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-17T20:32:12.004486] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-17T20:32:12.004535] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:32:12.014834] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-17T20:32:12.015312] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-17T20:32:12.015734] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-17T20:32:12.015801] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-17T20:32:12.015851] [INFO ] [MAIN ] Update Progress: 1512/2368 symbols completed. NPB took 1.4s. Estimated remaining: 2h 0m 6s. Rate: 7.1 symbols/min [2025-10-17T20:32:12.179621] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:32:12.179810] [DEBUG] [LOCAL ] NPCT: No existing data file found in primary storage. [2025-10-17T20:32:12.179852] [WARN ] [MAIN ] NPCT: No existing data found, performing full refresh instead. [2025-10-17T20:32:12.179965] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-17T20:32:12.180006] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-17T20:32:12.180087] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-17T20:32:12.180135] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-17T20:32:12.518250] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:32:12.758011] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-10-17T20:32:13.558018] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-17T20:32:13.840130] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-17T20:32:13.841128] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T20:32:14.358033] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-17T20:32:15.158014] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-17T20:32:15.392789] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T20:32:15.453282] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T20:32:15.958009] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-17T20:32:16.758031] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-17T20:32:17.420892] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T20:32:17.426824] [INFO ] [REMOTE ] NOTE: Full fetch complete (61708 records). [2025-10-17T20:32:17.427015] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-17T20:32:17.566306] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-17T20:32:17.838836] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-17T20:32:17.865629] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-10-17T20:32:17.865893] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-10-17T20:32:17.866946] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-10-17T20:32:17.867362] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-10-17T20:32:17.873065] [DEBUG] [LOCAL ] NOTE: Trimmed 61708 records to 40766 (keeping 200 days of data) [2025-10-17T20:32:18.107526] [DEBUG] [LOCAL ] NOTE: Primary data saved (40766 records). [2025-10-17T20:32:18.107684] [INFO ] [MAIN ] NOTE: Full history saved. [2025-10-17T20:32:18.108555] [INFO ] [MAIN ] Update Progress: 1513/2368 symbols completed. NOTE took 33.3s. Estimated remaining: 1h 59m 56s. Rate: 7.1 symbols/min [2025-10-17T20:32:18.279492] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:32:18.293420] [DEBUG] [LOCAL ] NPFD: Loaded 10130 existing records from primary storage. [2025-10-17T20:32:18.293688] [INFO ] [MAIN ] NPFD: Loaded 10130 existing records. [2025-10-17T20:32:18.368577] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-17T20:32:18.473548] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:32:18.474057] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-17T20:32:18.474201] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-17T20:32:18.474402] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-10-17T20:32:18.474459] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-17T20:32:18.853784] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:32:18.868724] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T20:32:18.907244] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-17T20:32:19.158040] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-17T20:32:19.958081] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-10-17T20:32:20.756845] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-17T20:32:20.766604] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-17T20:32:21.194544] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T20:32:21.196330] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-17T20:32:21.558032] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-17T20:32:21.648176] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T20:32:22.358012] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-17T20:32:22.388214] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T20:32:23.158040] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-17T20:32:23.958032] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-17T20:32:24.308357] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T20:32:24.758165] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-17T20:32:24.961876] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T20:32:24.998261] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T20:32:25.558054] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-17T20:32:26.358002] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-17T20:32:26.677967] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T20:32:26.685428] [INFO ] [REMOTE ] NOV: Full fetch complete (77161 records). [2025-10-17T20:32:26.685558] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-17T20:32:27.080001] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-10-17T20:32:27.080161] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-10-17T20:32:27.082186] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-10-17T20:32:27.082572] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-10-17T20:32:27.082490] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-17T20:32:27.086629] [DEBUG] [LOCAL ] NOV: Trimmed 77161 records to 53950 (keeping 200 days of data) [2025-10-17T20:32:27.173981] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-17T20:32:27.408375] [DEBUG] [LOCAL ] NOV: Primary data saved (53950 records). [2025-10-17T20:32:27.408519] [INFO ] [MAIN ] NOV: Full history saved. [2025-10-17T20:32:27.408590] [INFO ] [MAIN ] Update Progress: 1514/2368 symbols completed. NOV took 35.6s. Estimated remaining: 1h 59m 48s. Rate: 7.1 symbols/min [2025-10-17T20:32:27.576394] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:32:27.586401] [DEBUG] [LOCAL ] NPK: Loaded 8494 existing records from primary storage. [2025-10-17T20:32:27.586575] [INFO ] [MAIN ] NPK: Loaded 8494 existing records. [2025-10-17T20:32:27.768023] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:32:27.768340] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-17T20:32:27.768409] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-17T20:32:27.768680] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-10-17T20:32:27.768741] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-17T20:32:27.983840] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-17T20:32:28.086325] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T20:32:28.133818] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-17T20:32:28.231801] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:32:28.758020] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-17T20:32:29.102547] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T20:32:29.478631] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T20:32:29.557992] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-17T20:32:30.358017] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-17T20:32:30.649953] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T20:32:31.024043] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-17T20:32:31.157998] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-17T20:32:31.958024] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-10-17T20:32:32.082038] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T20:32:32.758038] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-17T20:32:32.798277] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-17T20:32:33.558019] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-17T20:32:33.808589] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T20:32:34.358300] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-17T20:32:34.358707] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-17T20:32:35.158044] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-17T20:32:35.462218] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T20:32:35.958039] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-17T20:32:36.758004] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-17T20:32:36.952703] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-17T20:32:37.099147] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T20:32:37.557992] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-17T20:32:37.586923] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-17T20:32:38.358084] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-17T20:32:38.430441] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T20:32:39.158071] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-17T20:32:39.341030] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-17T20:32:39.723630] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-17T20:32:39.958028] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-17T20:32:40.758063] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-17T20:32:40.906377] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-17T20:32:41.453911] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-17T20:32:41.558015] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-17T20:32:42.358045] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-17T20:32:42.459306] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-17T20:32:42.461341] [INFO ] [REMOTE ] NPFD: Full fetch complete (14636 records). [2025-10-17T20:32:42.461410] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-17T20:32:42.822633] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-10-17T20:32:42.823148] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-10-17T20:32:42.823668] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-10-17T20:32:42.823747] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-10-17T20:32:42.824347] [DEBUG] [LOCAL ] NPFD: Trimmed 14636 records to 10224 (keeping 200 days of data) [2025-10-17T20:32:42.886460] [DEBUG] [LOCAL ] NPFD: Primary data saved (10224 records). [2025-10-17T20:32:42.886578] [INFO ] [MAIN ] NPFD: Full history saved. [2025-10-17T20:32:42.886673] [INFO ] [MAIN ] Update Progress: 1515/2368 symbols completed. NPFD took 24.8s. Estimated remaining: 1h 59m 44s. Rate: 7.1 symbols/min [2025-10-17T20:32:43.003514] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-17T20:32:43.063801] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:32:43.063985] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-10-17T20:32:43.064029] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-10-17T20:32:43.064166] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-17T20:32:43.064234] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-17T20:32:43.064289] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-17T20:32:43.064324] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-17T20:32:43.162187] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-17T20:32:43.414956] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:32:43.958066] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-17T20:32:44.047574] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T20:32:44.049732] [INFO ] [REMOTE ] NPCT: Full fetch complete (24575 records). [2025-10-17T20:32:44.049807] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-17T20:32:44.409675] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-10-17T20:32:44.409760] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-10-17T20:32:44.410229] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-10-17T20:32:44.410268] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-10-17T20:32:44.410901] [DEBUG] [LOCAL ] NPCT: Trimmed 24575 records to 16917 (keeping 200 days of data) [2025-10-17T20:32:44.504290] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-17T20:32:44.519425] [DEBUG] [LOCAL ] NPCT: Primary data saved (16917 records). [2025-10-17T20:32:44.519531] [INFO ] [MAIN ] NPCT: Full history saved. [2025-10-17T20:32:44.519596] [INFO ] [MAIN ] Update Progress: 1516/2368 symbols completed. NPCT took 32.5s. Estimated remaining: 1h 59m 32s. Rate: 7.1 symbols/min [2025-10-17T20:32:44.683855] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:32:44.684047] [DEBUG] [LOCAL ] NPO: No existing data file found in primary storage. [2025-10-17T20:32:44.684084] [WARN ] [MAIN ] NPO: No existing data found, performing full refresh instead. [2025-10-17T20:32:44.684194] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-17T20:32:44.684234] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-17T20:32:44.684298] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-17T20:32:44.684365] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-17T20:32:44.763218] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-10-17T20:32:45.037915] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:32:45.558006] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-17T20:32:45.637683] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T20:32:46.358033] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-10-17T20:32:46.443752] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T20:32:47.158004] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-17T20:32:47.355419] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T20:32:47.958071] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-17T20:32:48.548085] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T20:32:48.758030] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-17T20:32:49.558057] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-17T20:32:49.620277] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-17T20:32:49.802278] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T20:32:50.358065] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-17T20:32:50.521769] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-17T20:32:51.167133] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-17T20:32:51.169221] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T20:32:51.175777] [INFO ] [REMOTE ] NOW: Full fetch complete (70725 records). [2025-10-17T20:32:51.175889] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-17T20:32:51.556666] [DEBUG] [VALIDATOR ] NOW: All expected trading days are present. [2025-10-17T20:32:51.556750] [DEBUG] [VALIDATOR ] NOW: Primary data validation passed. [2025-10-17T20:32:51.557811] [INFO ] [MAIN ] NOW: Fetched primary data is valid. [2025-10-17T20:32:51.557875] [DEBUG] [LOCAL ] NOW: Saving primary data. [2025-10-17T20:32:51.559252] [DEBUG] [LOCAL ] NOW: Trimmed 70725 records to 48724 (keeping 200 days of data) [2025-10-17T20:32:51.854728] [DEBUG] [LOCAL ] NOW: Primary data saved (48724 records). [2025-10-17T20:32:51.854862] [INFO ] [MAIN ] NOW: Full history saved. [2025-10-17T20:32:51.854952] [INFO ] [MAIN ] Update Progress: 1517/2368 symbols completed. NOW took 55.0s. Estimated remaining: 1h 59m 22s. Rate: 7.1 symbols/min [2025-10-17T20:32:51.958004] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-17T20:32:52.606470] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T20:32:52.758071] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-17T20:32:52.804789] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T20:32:53.558043] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-17T20:32:54.224268] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-17T20:32:54.309273] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T20:32:54.357998] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-17T20:32:55.158072] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-17T20:32:55.921947] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T20:32:55.957981] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-17T20:32:56.166430] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-17T20:32:56.758017] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-17T20:32:57.397815] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T20:32:57.558021] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-17T20:32:57.626422] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T20:32:57.628829] [INFO ] [REMOTE ] NPK: Full fetch complete (11151 records). [2025-10-17T20:32:57.628991] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-17T20:32:58.011373] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-10-17T20:32:58.011463] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-10-17T20:32:58.011755] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-10-17T20:32:58.011817] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-10-17T20:32:58.012775] [DEBUG] [LOCAL ] NPK: Trimmed 11151 records to 8568 (keeping 200 days of data) [2025-10-17T20:32:58.064195] [DEBUG] [LOCAL ] NPK: Primary data saved (8568 records). [2025-10-17T20:32:58.064328] [INFO ] [MAIN ] NPK: Full history saved. [2025-10-17T20:32:58.064407] [INFO ] [MAIN ] Update Progress: 1518/2368 symbols completed. NPK took 30.7s. Estimated remaining: 1h 59m 13s. Rate: 7.1 symbols/min [2025-10-17T20:32:58.357996] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-17T20:32:58.505893] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-17T20:32:59.158082] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-17T20:32:59.588106] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-17T20:32:59.930862] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-17T20:32:59.958003] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-17T20:33:00.758117] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-17T20:33:01.156152] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-17T20:33:01.558087] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-17T20:33:02.400170] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T20:33:02.414375] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-17T20:33:02.556266] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-17T20:33:03.158075] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-17T20:33:03.753801] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-17T20:33:03.958020] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-17T20:33:04.155895] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-17T20:33:04.758067] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-17T20:33:05.179276] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T20:33:05.558044] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-17T20:33:05.647865] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T20:33:06.358015] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-17T20:33:06.991536] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T20:33:06.997534] [INFO ] [REMOTE ] NPKI: Full fetch complete (56162 records). [2025-10-17T20:33:06.997764] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-17T20:33:07.394700] [DEBUG] [VALIDATOR ] NPKI: All expected trading days are present. [2025-10-17T20:33:07.394854] [DEBUG] [VALIDATOR ] NPKI: Primary data validation passed. [2025-10-17T20:33:07.395926] [INFO ] [MAIN ] NPKI: Fetched primary data is valid. [2025-10-17T20:33:07.396021] [DEBUG] [LOCAL ] NPKI: Saving primary data. [2025-10-17T20:33:07.402708] [DEBUG] [LOCAL ] NPKI: Trimmed 56162 records to 40905 (keeping 200 days of data) [2025-10-17T20:33:07.406549] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T20:33:07.410694] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-17T20:33:07.650222] [DEBUG] [LOCAL ] NPKI: Primary data saved (40905 records). [2025-10-17T20:33:07.650406] [INFO ] [MAIN ] NPKI: Full history saved. [2025-10-17T20:33:07.650539] [INFO ] [MAIN ] Update Progress: 1519/2368 symbols completed. NPKI took 24.8s. Estimated remaining: 1h 59m 5s. Rate: 7.1 symbols/min [2025-10-17T20:33:08.553617] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T20:33:08.556726] [INFO ] [REMOTE ] NPO: Full fetch complete (18810 records). [2025-10-17T20:33:08.556803] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-17T20:33:08.935089] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-10-17T20:33:08.935187] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-10-17T20:33:08.935632] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-10-17T20:33:08.935715] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-10-17T20:33:08.936272] [DEBUG] [LOCAL ] NPO: Trimmed 18810 records to 13896 (keeping 200 days of data) [2025-10-17T20:33:09.022377] [DEBUG] [LOCAL ] NPO: Primary data saved (13896 records). [2025-10-17T20:33:09.022519] [INFO ] [MAIN ] NPO: Full history saved. [2025-10-17T20:33:09.022593] [INFO ] [MAIN ] Update Progress: 1520/2368 symbols completed. NPO took 24.5s. Estimated remaining: 1h 58m 53s. Rate: 7.1 symbols/min [2025-10-17T20:33:09.567977] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:33:09.709400] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:33:09.738567] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:33:09.763233] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:33:09.767016] [DEBUG] [LOCAL ] NPV: Loaded 5385 existing records from primary storage. [2025-10-17T20:33:09.767711] [DEBUG] [LOCAL ] NPWR: No existing data file found in primary storage. [2025-10-17T20:33:09.768172] [WARN ] [MAIN ] NPWR: No existing data found, performing full refresh instead. [2025-10-17T20:33:09.767987] [INFO ] [MAIN ] NPV: Loaded 5385 existing records. [2025-10-17T20:33:09.782048] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-17T20:33:09.782341] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-17T20:33:09.807270] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-17T20:33:09.827956] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-17T20:33:09.863889] [DEBUG] [LOCAL ] NQP: Loaded 9287 existing records from primary storage. [2025-10-17T20:33:09.928148] [INFO ] [MAIN ] NQP: Loaded 9287 existing records. [2025-10-17T20:33:10.237534] [DEBUG] [LOCAL ] NRDY: Loaded 32903 existing records from primary storage. [2025-10-17T20:33:10.253684] [INFO ] [MAIN ] NRDY: Loaded 32903 existing records. [2025-10-17T20:33:10.316761] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:33:10.382274] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-17T20:33:10.411311] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-17T20:33:10.416665] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-10-17T20:33:10.455097] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-17T20:33:10.466895] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:33:10.545854] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-17T20:33:10.570194] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-17T20:33:10.677939] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-10-17T20:33:10.732200] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-17T20:33:10.872921] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:33:10.866638] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:33:10.889719] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-10-17T20:33:10.916534] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-17T20:33:10.923619] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-17T20:33:10.934084] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-10-17T20:33:10.969376] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-17T20:33:11.627982] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:33:11.640876] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-10-17T20:33:11.807606] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:33:11.833308] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-10-17T20:33:11.861833] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:33:11.862124] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-10-17T20:33:12.383756] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-17T20:33:12.385265] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-17T20:33:12.498268] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-17T20:33:12.499546] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T20:33:12.502723] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-17T20:33:12.758032] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-17T20:33:13.131951] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T20:33:13.381023] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-17T20:33:13.553057] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T20:33:13.563118] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-17T20:33:14.358027] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-17T20:33:14.431737] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T20:33:14.532673] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T20:33:15.158035] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-17T20:33:15.834332] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T20:33:15.957139] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T20:33:15.965303] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-17T20:33:16.647689] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-17T20:33:16.757960] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-17T20:33:17.432765] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-17T20:33:17.558079] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-17T20:33:18.195735] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-17T20:33:18.358086] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-17T20:33:19.158064] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-17T20:33:19.267557] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-17T20:33:19.834430] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-17T20:33:19.957990] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-17T20:33:20.745315] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-17T20:33:20.757979] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-17T20:33:21.427625] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-17T20:33:21.557999] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-17T20:33:22.324608] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T20:33:22.358034] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-17T20:33:23.074424] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-17T20:33:23.158026] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-17T20:33:23.908047] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-17T20:33:23.909601] [INFO ] [REMOTE ] NPV: Full fetch complete (7152 records). [2025-10-17T20:33:23.909734] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-17T20:33:23.966727] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-17T20:33:24.296382] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-17T20:33:24.296463] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-17T20:33:24.296636] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-17T20:33:24.296715] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-17T20:33:24.297096] [DEBUG] [LOCAL ] NPV: Trimmed 7152 records to 5437 (keeping 200 days of data) [2025-10-17T20:33:24.329683] [DEBUG] [LOCAL ] NPV: Primary data saved (5437 records). [2025-10-17T20:33:24.329781] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-17T20:33:24.329871] [INFO ] [MAIN ] Update Progress: 1521/2368 symbols completed. NPV took 15.3s. Estimated remaining: 1h 58m 48s. Rate: 7.1 symbols/min [2025-10-17T20:33:24.500864] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:33:24.511025] [DEBUG] [LOCAL ] NREF: Loaded 7915 existing records from primary storage. [2025-10-17T20:33:24.511220] [INFO ] [MAIN ] NREF: Loaded 7915 existing records. [2025-10-17T20:33:24.693778] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:33:24.694046] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-17T20:33:24.694124] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-17T20:33:24.694304] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-10-17T20:33:24.694373] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-17T20:33:24.767890] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-17T20:33:25.057527] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:33:25.307229] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T20:33:25.558017] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-10-17T20:33:26.358041] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-17T20:33:26.421913] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T20:33:26.450283] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-17T20:33:27.158045] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-17T20:33:27.958061] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-17T20:33:28.012320] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-17T20:33:28.042517] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T20:33:28.751325] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T20:33:28.757972] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-17T20:33:29.455204] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-17T20:33:29.558027] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-17T20:33:30.358002] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-17T20:33:30.424525] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-17T20:33:31.158033] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-17T20:33:31.207857] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T20:33:31.958011] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-17T20:33:32.060604] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T20:33:32.758059] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-17T20:33:33.530617] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T20:33:33.558035] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-17T20:33:33.650529] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-17T20:33:34.358055] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-17T20:33:35.011076] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-17T20:33:35.133415] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T20:33:35.157997] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-17T20:33:35.958028] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-17T20:33:36.076237] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T20:33:36.758000] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-17T20:33:36.818857] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-17T20:33:37.558016] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-17T20:33:37.585197] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-17T20:33:38.358067] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-17T20:33:39.107936] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T20:33:39.158065] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-17T20:33:39.958044] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-17T20:33:40.047172] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T20:33:40.645626] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T20:33:40.758000] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-17T20:33:40.860599] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-17T20:33:41.558036] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-17T20:33:42.077334] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-17T20:33:42.288665] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T20:33:42.290309] [INFO ] [REMOTE ] NQP: Full fetch complete (12913 records). [2025-10-17T20:33:42.290383] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-17T20:33:42.363287] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-17T20:33:42.657462] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-10-17T20:33:42.657551] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-10-17T20:33:42.657891] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-10-17T20:33:42.657952] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-10-17T20:33:42.658437] [DEBUG] [LOCAL ] NQP: Trimmed 12913 records to 9363 (keeping 200 days of data) [2025-10-17T20:33:42.715104] [DEBUG] [LOCAL ] NQP: Primary data saved (9363 records). [2025-10-17T20:33:42.715235] [INFO ] [MAIN ] NQP: Full history saved. [2025-10-17T20:33:42.715332] [INFO ] [MAIN ] Update Progress: 1522/2368 symbols completed. NQP took 33.7s. Estimated remaining: 1h 58m 45s. Rate: 7.1 symbols/min [2025-10-17T20:33:42.881432] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:33:42.881607] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-10-17T20:33:42.881668] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-10-17T20:33:42.881791] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-17T20:33:42.881831] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-17T20:33:42.881872] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-17T20:33:42.881903] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-17T20:33:43.163179] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-17T20:33:43.234515] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:33:43.957999] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-10-17T20:33:44.075136] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T20:33:44.590962] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T20:33:44.758045] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-17T20:33:45.558030] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-17T20:33:46.218492] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-17T20:33:46.358155] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-17T20:33:46.450076] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T20:33:46.652832] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-17T20:33:47.158065] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-17T20:33:47.933144] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T20:33:47.957983] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-17T20:33:47.977851] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T20:33:48.758061] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-17T20:33:49.399487] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T20:33:49.404388] [INFO ] [REMOTE ] NRDY: Full fetch complete (50443 records). [2025-10-17T20:33:49.404520] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-17T20:33:49.501741] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-17T20:33:49.514759] [INFO ] [REMOTE ] NREF: Full fetch complete (10890 records). [2025-10-17T20:33:49.514916] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-17T20:33:49.563235] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-17T20:33:50.160745] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-10-17T20:33:50.160878] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-10-17T20:33:50.166980] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-10-17T20:33:50.167064] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-10-17T20:33:50.231853] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-10-17T20:33:50.232067] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-10-17T20:33:50.232269] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-10-17T20:33:50.232347] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-10-17T20:33:50.232432] [DEBUG] [LOCAL ] NRDY: Trimmed 50443 records to 33086 (keeping 200 days of data) [2025-10-17T20:33:50.233438] [DEBUG] [LOCAL ] NREF: Trimmed 10890 records to 7969 (keeping 200 days of data) [2025-10-17T20:33:50.359494] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-17T20:33:50.378034] [DEBUG] [LOCAL ] NREF: Primary data saved (7969 records). [2025-10-17T20:33:50.379442] [INFO ] [MAIN ] NREF: Full history saved. [2025-10-17T20:33:50.380587] [INFO ] [MAIN ] Update Progress: 1523/2368 symbols completed. NREF took 26.1s. Estimated remaining: 1h 58m 36s. Rate: 7.1 symbols/min [2025-10-17T20:33:50.634131] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:33:50.650914] [DEBUG] [LOCAL ] NRDY: Primary data saved (33086 records). [2025-10-17T20:33:50.651083] [INFO ] [MAIN ] NRDY: Full history saved. [2025-10-17T20:33:50.651192] [INFO ] [MAIN ] Update Progress: 1524/2368 symbols completed. NRDY took 41.6s. Estimated remaining: 1h 58m 24s. Rate: 7.1 symbols/min [2025-10-17T20:33:50.856222] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:33:50.854242] [DEBUG] [LOCAL ] NRGV: Loaded 44137 existing records from primary storage. [2025-10-17T20:33:50.856408] [DEBUG] [LOCAL ] NRK: No existing data file found in primary storage. [2025-10-17T20:33:50.856752] [INFO ] [MAIN ] NRGV: Loaded 44137 existing records. [2025-10-17T20:33:50.856611] [WARN ] [MAIN ] NRK: No existing data found, performing full refresh instead. [2025-10-17T20:33:50.901219] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-17T20:33:50.914152] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-17T20:33:50.935299] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-10-17T20:33:50.951604] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-17T20:33:51.174450] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:33:51.231147] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-17T20:33:51.255933] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-17T20:33:51.290987] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-10-17T20:33:51.322183] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-17T20:33:51.521750] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:33:51.525614] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-10-17T20:33:51.780335] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-17T20:33:51.824379] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:33:51.958003] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-10-17T20:33:52.313176] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-17T20:33:52.758015] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-17T20:33:52.946930] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T20:33:53.558013] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-17T20:33:53.794698] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T20:33:54.072432] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T20:33:54.358035] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-17T20:33:55.158008] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-17T20:33:55.417535] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-17T20:33:55.958016] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-17T20:33:56.035880] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T20:33:56.093873] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T20:33:56.758044] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-17T20:33:57.558040] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-17T20:33:57.785052] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T20:33:57.785444] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T20:33:58.358070] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-17T20:33:58.965694] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T20:33:59.158002] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-17T20:33:59.958003] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-17T20:34:00.356794] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T20:34:00.436158] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-17T20:34:00.758045] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-17T20:34:01.438735] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T20:34:01.445926] [INFO ] [REMOTE ] NPWR: Full fetch complete (60558 records). [2025-10-17T20:34:01.446115] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-17T20:34:01.563155] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-17T20:34:01.847240] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-10-17T20:34:01.847325] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-10-17T20:34:01.848444] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-10-17T20:34:01.848511] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-10-17T20:34:01.849824] [DEBUG] [LOCAL ] NPWR: Trimmed 60558 records to 44112 (keeping 200 days of data) [2025-10-17T20:34:02.100329] [DEBUG] [LOCAL ] NPWR: Primary data saved (44112 records). [2025-10-17T20:34:02.100548] [INFO ] [MAIN ] NPWR: Full history saved. [2025-10-17T20:34:02.100634] [INFO ] [MAIN ] Update Progress: 1525/2368 symbols completed. NPWR took 53.1s. Estimated remaining: 1h 58m 17s. Rate: 7.1 symbols/min [2025-10-17T20:34:02.275979] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:34:02.282830] [DEBUG] [LOCAL ] NRP: Loaded 4218 existing records from primary storage. [2025-10-17T20:34:02.283048] [INFO ] [MAIN ] NRP: Loaded 4218 existing records. [2025-10-17T20:34:02.360764] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-17T20:34:02.400094] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-17T20:34:02.487065] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:34:02.487342] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-17T20:34:02.487563] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-17T20:34:02.487785] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-10-17T20:34:02.487877] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-17T20:34:02.858181] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:34:02.886825] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-17T20:34:03.158006] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-17T20:34:03.958013] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-17T20:34:04.099351] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T20:34:04.297675] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T20:34:04.758030] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-17T20:34:05.558013] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-17T20:34:05.848862] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-17T20:34:06.132840] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-17T20:34:06.357997] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-17T20:34:06.609037] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T20:34:07.158012] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-17T20:34:07.958001] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-17T20:34:08.222052] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T20:34:08.565520] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-17T20:34:08.758019] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-10-17T20:34:09.558015] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-17T20:34:09.699026] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T20:34:09.834776] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T20:34:10.358032] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-17T20:34:11.158001] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-17T20:34:11.559575] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-17T20:34:11.958055] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-17T20:34:12.014261] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T20:34:12.455153] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-17T20:34:12.758020] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-17T20:34:13.558031] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-17T20:34:13.980475] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-17T20:34:14.009062] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T20:34:14.358060] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-17T20:34:15.158044] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-17T20:34:15.222421] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T20:34:15.286071] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T20:34:15.881319] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T20:34:15.958022] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-17T20:34:16.758034] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-17T20:34:17.103014] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T20:34:17.106138] [INFO ] [REMOTE ] NRK: Full fetch complete (27581 records). [2025-10-17T20:34:17.106209] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-17T20:34:17.474549] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-10-17T20:34:17.474623] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-10-17T20:34:17.475230] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-10-17T20:34:17.475291] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-10-17T20:34:17.475988] [DEBUG] [LOCAL ] NRK: Trimmed 27581 records to 20563 (keeping 200 days of data) [2025-10-17T20:34:17.561413] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-17T20:34:17.603815] [DEBUG] [LOCAL ] NRK: Primary data saved (20563 records). [2025-10-17T20:34:17.603959] [INFO ] [MAIN ] NRK: Full history saved. [2025-10-17T20:34:17.604042] [INFO ] [MAIN ] Update Progress: 1526/2368 symbols completed. NRK took 27.0s. Estimated remaining: 1h 58m 12s. Rate: 7.1 symbols/min [2025-10-17T20:34:17.775828] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:34:17.783309] [DEBUG] [LOCAL ] NRT: Loaded 4958 existing records from primary storage. [2025-10-17T20:34:17.783521] [INFO ] [MAIN ] NRT: Loaded 4958 existing records. [2025-10-17T20:34:17.957270] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:34:17.957487] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-17T20:34:17.957539] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-17T20:34:17.957753] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-10-17T20:34:17.957810] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-17T20:34:18.308959] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:34:18.358002] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-10-17T20:34:18.548855] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T20:34:19.158001] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-17T20:34:19.174598] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-17T20:34:19.454329] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T20:34:19.461561] [INFO ] [REMOTE ] NRG: Full fetch complete (76801 records). [2025-10-17T20:34:19.461731] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-17T20:34:19.848165] [DEBUG] [VALIDATOR ] NRG: All expected trading days are present. [2025-10-17T20:34:19.849979] [DEBUG] [VALIDATOR ] NRG: Primary data validation passed. [2025-10-17T20:34:19.851105] [INFO ] [MAIN ] NRG: Fetched primary data is valid. [2025-10-17T20:34:19.853612] [DEBUG] [LOCAL ] NRG: Saving primary data. [2025-10-17T20:34:19.853914] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-17T20:34:19.856609] [DEBUG] [LOCAL ] NRG: Trimmed 76801 records to 53621 (keeping 200 days of data) [2025-10-17T20:34:19.960069] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-17T20:34:20.187848] [DEBUG] [LOCAL ] NRG: Primary data saved (53621 records). [2025-10-17T20:34:20.187987] [INFO ] [MAIN ] NRG: Full history saved. [2025-10-17T20:34:20.188075] [INFO ] [MAIN ] Update Progress: 1527/2368 symbols completed. NRG took 37.5s. Estimated remaining: 1h 58m 1s. Rate: 7.1 symbols/min [2025-10-17T20:34:20.353222] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:34:20.353407] [DEBUG] [LOCAL ] NRUC: No existing data file found in primary storage. [2025-10-17T20:34:20.353462] [WARN ] [MAIN ] NRUC: No existing data found, performing full refresh instead. [2025-10-17T20:34:20.353572] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-17T20:34:20.353613] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-17T20:34:20.353682] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-17T20:34:20.353734] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-17T20:34:20.698169] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:34:20.757983] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-10-17T20:34:21.558001] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-17T20:34:21.685925] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T20:34:21.922680] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-17T20:34:22.149891] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-17T20:34:22.358021] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-17T20:34:22.994356] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-17T20:34:23.158083] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-17T20:34:23.858011] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-17T20:34:23.958003] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-17T20:34:24.628448] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-17T20:34:24.758060] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-17T20:34:25.475919] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T20:34:25.558033] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-17T20:34:26.258602] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-17T20:34:26.358096] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-17T20:34:26.970621] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-17T20:34:27.158079] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-17T20:34:27.958011] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-17T20:34:28.096313] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T20:34:28.650129] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T20:34:28.758026] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-17T20:34:29.428895] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T20:34:29.558073] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-17T20:34:30.024591] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-17T20:34:30.358085] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-17T20:34:31.014674] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-17T20:34:31.158068] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-17T20:34:31.888272] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-17T20:34:31.958023] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-17T20:34:32.637148] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-17T20:34:32.757997] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-17T20:34:33.326586] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-17T20:34:33.558000] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-17T20:34:34.165356] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-17T20:34:34.358053] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-17T20:34:35.158024] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-17T20:34:35.858241] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-17T20:34:35.957991] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-17T20:34:36.178298] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T20:34:36.185313] [INFO ] [REMOTE ] NRGV: Full fetch complete (62462 records). [2025-10-17T20:34:36.185438] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-17T20:34:36.460504] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-17T20:34:36.574128] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-10-17T20:34:36.574207] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-10-17T20:34:36.575193] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-10-17T20:34:36.575259] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-10-17T20:34:36.576481] [DEBUG] [LOCAL ] NRGV: Trimmed 62462 records to 44503 (keeping 200 days of data) [2025-10-17T20:34:36.781681] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-17T20:34:36.840973] [DEBUG] [LOCAL ] NRGV: Primary data saved (44503 records). [2025-10-17T20:34:36.841109] [INFO ] [MAIN ] NRGV: Full history saved. [2025-10-17T20:34:36.841191] [INFO ] [MAIN ] Update Progress: 1528/2368 symbols completed. NRGV took 46.5s. Estimated remaining: 1h 57m 57s. Rate: 7.1 symbols/min [2025-10-17T20:34:37.004244] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:34:37.004430] [DEBUG] [LOCAL ] NSA: No existing data file found in primary storage. [2025-10-17T20:34:37.004468] [WARN ] [MAIN ] NSA: No existing data found, performing full refresh instead. [2025-10-17T20:34:37.004575] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-17T20:34:37.004616] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-17T20:34:37.004687] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-17T20:34:37.004737] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-17T20:34:37.355633] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:34:37.403268] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-17T20:34:37.558010] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-10-17T20:34:38.358021] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-17T20:34:39.041193] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-17T20:34:39.158036] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-17T20:34:39.220564] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T20:34:39.614963] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-17T20:34:39.958061] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-17T20:34:40.585926] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-17T20:34:40.758037] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-17T20:34:41.375395] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-17T20:34:41.376489] [INFO ] [REMOTE ] NRUC: Full fetch complete (5250 records). [2025-10-17T20:34:41.376558] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-17T20:34:41.563365] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-17T20:34:41.731599] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-10-17T20:34:41.731698] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-10-17T20:34:41.731872] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-10-17T20:34:41.731915] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-10-17T20:34:41.732291] [DEBUG] [LOCAL ] NRUC: Trimmed 5250 records to 3185 (keeping 200 days of data) [2025-10-17T20:34:41.751285] [DEBUG] [LOCAL ] NRUC: Primary data saved (3185 records). [2025-10-17T20:34:41.751361] [INFO ] [MAIN ] NRUC: Full history saved. [2025-10-17T20:34:41.751423] [INFO ] [MAIN ] Update Progress: 1529/2368 symbols completed. NRUC took 21.6s. Estimated remaining: 1h 57m 46s. Rate: 7.1 symbols/min [2025-10-17T20:34:41.920018] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:34:41.920183] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-10-17T20:34:41.920220] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-10-17T20:34:41.920329] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-17T20:34:41.920370] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-17T20:34:41.920410] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-17T20:34:41.920441] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-17T20:34:42.268176] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:34:42.357997] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-10-17T20:34:43.127022] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T20:34:43.157987] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-17T20:34:43.958030] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-17T20:34:44.483701] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-17T20:34:44.555727] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T20:34:44.692899] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-17T20:34:44.758060] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-17T20:34:45.355786] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T20:34:45.558029] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-17T20:34:46.358040] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-17T20:34:47.158040] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-17T20:34:47.752742] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T20:34:47.754636] [INFO ] [REMOTE ] NRT: Full fetch complete (7926 records). [2025-10-17T20:34:47.754775] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-17T20:34:47.964301] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-17T20:34:48.149377] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-17T20:34:48.229090] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-10-17T20:34:48.229223] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-10-17T20:34:48.229541] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-10-17T20:34:48.229796] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-10-17T20:34:48.244787] [DEBUG] [LOCAL ] NRT: Trimmed 7926 records to 4988 (keeping 200 days of data) [2025-10-17T20:34:48.256311] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T20:34:48.296477] [DEBUG] [LOCAL ] NRT: Primary data saved (4988 records). [2025-10-17T20:34:48.296624] [INFO ] [MAIN ] NRT: Full history saved. [2025-10-17T20:34:48.296757] [INFO ] [MAIN ] Update Progress: 1530/2368 symbols completed. NRT took 30.7s. Estimated remaining: 1h 57m 37s. Rate: 7.1 symbols/min [2025-10-17T20:34:48.484801] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:34:48.485001] [DEBUG] [LOCAL ] NSP: No existing data file found in primary storage. [2025-10-17T20:34:48.485059] [WARN ] [MAIN ] NSP: No existing data found, performing full refresh instead. [2025-10-17T20:34:48.485201] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-17T20:34:48.485263] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-17T20:34:48.485308] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-17T20:34:48.485340] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-17T20:34:48.762105] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-17T20:34:48.864615] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T20:34:48.868615] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:34:49.558025] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-17T20:34:50.358051] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-17T20:34:50.564710] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-17T20:34:50.974810] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-17T20:34:50.975977] [INFO ] [REMOTE ] NRP: Full fetch complete (6356 records). [2025-10-17T20:34:50.976045] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-17T20:34:51.162491] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-10-17T20:34:51.348698] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-10-17T20:34:51.348832] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-10-17T20:34:51.349091] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-10-17T20:34:51.349270] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-10-17T20:34:51.349921] [DEBUG] [LOCAL ] NRP: Trimmed 6356 records to 4238 (keeping 200 days of data) [2025-10-17T20:34:51.395927] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T20:34:51.411922] [DEBUG] [LOCAL ] NRP: Primary data saved (4238 records). [2025-10-17T20:34:51.412017] [INFO ] [MAIN ] NRP: Full history saved. [2025-10-17T20:34:51.412090] [INFO ] [MAIN ] Update Progress: 1531/2368 symbols completed. NRP took 49.3s. Estimated remaining: 1h 57m 26s. Rate: 7.1 symbols/min [2025-10-17T20:34:51.575586] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:34:51.575807] [DEBUG] [LOCAL ] NTB: No existing data file found in primary storage. [2025-10-17T20:34:51.575850] [WARN ] [MAIN ] NTB: No existing data found, performing full refresh instead. [2025-10-17T20:34:51.575957] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-17T20:34:51.575998] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-17T20:34:51.576038] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-17T20:34:51.576068] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-17T20:34:51.921323] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:34:51.957987] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-10-17T20:34:52.758000] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-17T20:34:52.983978] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T20:34:53.410576] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T20:34:53.557995] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-17T20:34:54.358036] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-17T20:34:54.524819] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T20:34:54.713186] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T20:34:55.158026] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-17T20:34:55.957995] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-17T20:34:56.258843] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T20:34:56.339765] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-17T20:34:56.758019] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-17T20:34:57.297184] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T20:34:57.558077] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-17T20:34:57.676508] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-17T20:34:58.358028] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-17T20:34:59.158032] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-17T20:34:59.875243] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-17T20:34:59.957990] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-17T20:35:00.599314] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T20:35:00.757995] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-17T20:35:00.924086] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-17T20:35:01.558079] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-17T20:35:02.119931] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-17T20:35:02.358029] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-17T20:35:02.527277] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T20:35:02.820305] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-17T20:35:03.158045] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-17T20:35:03.958010] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-17T20:35:04.191972] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T20:35:04.338435] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T20:35:04.758064] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-17T20:35:05.558017] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-17T20:35:05.657626] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T20:35:06.358088] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-17T20:35:06.569783] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T20:35:07.158020] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-17T20:35:07.272563] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T20:35:07.958073] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-17T20:35:08.486828] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-17T20:35:08.758052] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-17T20:35:08.781805] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T20:35:08.788169] [INFO ] [REMOTE ] NSA: Full fetch complete (62665 records). [2025-10-17T20:35:08.788281] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-17T20:35:09.182893] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-10-17T20:35:09.183078] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-10-17T20:35:09.184185] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-10-17T20:35:09.184266] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-10-17T20:35:09.185631] [DEBUG] [LOCAL ] NSA: Trimmed 62665 records to 45821 (keeping 200 days of data) [2025-10-17T20:35:09.289042] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T20:35:09.474821] [DEBUG] [LOCAL ] NSA: Primary data saved (45821 records). [2025-10-17T20:35:09.474966] [INFO ] [MAIN ] NSA: Full history saved. [2025-10-17T20:35:09.475037] [INFO ] [MAIN ] Update Progress: 1532/2368 symbols completed. NSA took 32.6s. Estimated remaining: 1h 57m 22s. Rate: 7.1 symbols/min [2025-10-17T20:35:09.563316] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-17T20:35:09.654229] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:35:09.654419] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-17T20:35:09.654486] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-17T20:35:09.654606] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-17T20:35:09.654675] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-17T20:35:09.654741] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-17T20:35:09.654781] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-17T20:35:10.009538] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:35:10.315963] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T20:35:10.357983] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-17T20:35:11.158009] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-17T20:35:11.507258] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-17T20:35:11.596673] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T20:35:11.958006] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-17T20:35:12.341210] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-17T20:35:12.758023] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-17T20:35:13.550886] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T20:35:13.558228] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-10-17T20:35:14.061409] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T20:35:14.282177] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-17T20:35:14.358053] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-17T20:35:15.089918] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T20:35:15.157981] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-17T20:35:15.791059] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T20:35:15.957983] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-17T20:35:16.758022] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-17T20:35:17.341522] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-17T20:35:17.558028] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-17T20:35:17.819707] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T20:35:18.044406] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-17T20:35:18.358028] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-17T20:35:19.158061] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-17T20:35:19.462872] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T20:35:19.958008] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-17T20:35:20.113411] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-17T20:35:20.758052] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-17T20:35:21.565220] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-17T20:35:21.582368] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T20:35:22.278990] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-17T20:35:22.358012] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-17T20:35:22.485265] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T20:35:23.082228] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-17T20:35:23.158053] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-17T20:35:23.958060] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-17T20:35:24.700063] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T20:35:24.758043] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-17T20:35:24.899551] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T20:35:24.902898] [INFO ] [REMOTE ] NTB: Full fetch complete (30736 records). [2025-10-17T20:35:24.902973] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-17T20:35:25.272380] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-10-17T20:35:25.272472] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-10-17T20:35:25.273179] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-10-17T20:35:25.273245] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-10-17T20:35:25.274225] [DEBUG] [LOCAL ] NTB: Trimmed 30736 records to 20647 (keeping 200 days of data) [2025-10-17T20:35:25.396623] [DEBUG] [LOCAL ] NTB: Primary data saved (20647 records). [2025-10-17T20:35:25.396777] [INFO ] [MAIN ] NTB: Full history saved. [2025-10-17T20:35:25.396850] [INFO ] [MAIN ] Update Progress: 1533/2368 symbols completed. NTB took 34.0s. Estimated remaining: 1h 57m 18s. Rate: 7.1 symbols/min [2025-10-17T20:35:25.563443] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-17T20:35:25.567153] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:35:25.568219] [DEBUG] [LOCAL ] NTR: No existing data file found in primary storage. [2025-10-17T20:35:25.568284] [WARN ] [MAIN ] NTR: No existing data found, performing full refresh instead. [2025-10-17T20:35:25.568431] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-17T20:35:25.568487] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-17T20:35:25.568534] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-17T20:35:25.568581] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-17T20:35:25.941153] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:35:25.956005] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T20:35:25.961315] [INFO ] [REMOTE ] NSP: Full fetch complete (50173 records). [2025-10-17T20:35:25.961435] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-17T20:35:26.339304] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-10-17T20:35:26.339407] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-10-17T20:35:26.340484] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-10-17T20:35:26.340551] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-10-17T20:35:26.341750] [DEBUG] [LOCAL ] NSP: Trimmed 50173 records to 36092 (keeping 200 days of data) [2025-10-17T20:35:26.396030] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-17T20:35:26.566179] [DEBUG] [LOCAL ] NSP: Primary data saved (36092 records). [2025-10-17T20:35:26.566332] [INFO ] [MAIN ] NSP: Full history saved. [2025-10-17T20:35:26.566406] [INFO ] [MAIN ] Update Progress: 1534/2368 symbols completed. NSP took 38.3s. Estimated remaining: 1h 57m 6s. Rate: 7.1 symbols/min [2025-10-17T20:35:26.753412] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:35:26.753609] [DEBUG] [LOCAL ] NTST: No existing data file found in primary storage. [2025-10-17T20:35:26.753678] [WARN ] [MAIN ] NTST: No existing data found, performing full refresh instead. [2025-10-17T20:35:26.753802] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-17T20:35:26.753845] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-17T20:35:26.753886] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-17T20:35:26.753920] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-17T20:35:26.865799] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T20:35:27.133416] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:35:27.158043] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-17T20:35:27.643573] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-17T20:35:27.958026] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-10-17T20:35:28.187199] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T20:35:28.193788] [INFO ] [REMOTE ] NSC: Full fetch complete (70933 records). [2025-10-17T20:35:28.193915] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-17T20:35:28.581047] [DEBUG] [VALIDATOR ] NSC: All expected trading days are present. [2025-10-17T20:35:28.581149] [DEBUG] [VALIDATOR ] NSC: Primary data validation passed. [2025-10-17T20:35:28.582220] [INFO ] [MAIN ] NSC: Fetched primary data is valid. [2025-10-17T20:35:28.582302] [DEBUG] [LOCAL ] NSC: Saving primary data. [2025-10-17T20:35:28.583759] [DEBUG] [LOCAL ] NSC: Trimmed 70933 records to 49475 (keeping 200 days of data) [2025-10-17T20:35:28.759918] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-17T20:35:28.890681] [DEBUG] [LOCAL ] NSC: Primary data saved (49475 records). [2025-10-17T20:35:28.890822] [INFO ] [MAIN ] NSC: Full history saved. [2025-10-17T20:35:28.890895] [INFO ] [MAIN ] Update Progress: 1535/2368 symbols completed. NSC took 47.1s. Estimated remaining: 1h 56m 54s. Rate: 7.1 symbols/min [2025-10-17T20:35:29.058294] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:35:29.058488] [DEBUG] [LOCAL ] NU: No existing data file found in primary storage. [2025-10-17T20:35:29.058525] [WARN ] [MAIN ] NU: No existing data found, performing full refresh instead. [2025-10-17T20:35:29.058693] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-17T20:35:29.058760] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-17T20:35:29.058812] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-17T20:35:29.058846] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-17T20:35:29.350872] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T20:35:29.354182] [INFO ] [REMOTE ] NTEST: Full fetch complete (1965 records). [2025-10-17T20:35:29.354277] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-17T20:35:29.563586] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:35:29.559976] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-10-17T20:35:29.618896] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 176 unique days, need 200 days [2025-10-17T20:35:29.619252] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:35:29.619324] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:35:29.619406] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-17T20:35:29.619487] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-17T20:35:29.619549] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-17T20:35:29.619617] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-17T20:35:29.619723] [INFO ] [MAIN ] Update Progress: 1536/2368 symbols completed. NTEST took 20.1s. Estimated remaining: 1h 56m 41s. Rate: 7.1 symbols/min [2025-10-17T20:35:29.791247] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:35:29.791406] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-17T20:35:29.791442] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-17T20:35:29.791552] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-17T20:35:29.791593] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-17T20:35:29.791633] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-17T20:35:29.791727] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-17T20:35:30.150934] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:35:30.183755] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-17T20:35:30.358042] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-10-17T20:35:31.158065] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-17T20:35:31.316717] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T20:35:31.958068] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-10-17T20:35:32.758007] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-17T20:35:32.796340] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T20:35:32.950053] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-10-17T20:35:33.558027] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-17T20:35:34.256574] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-17T20:35:34.293874] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T20:35:34.358014] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-17T20:35:35.158032] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-17T20:35:35.923183] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-17T20:35:35.958000] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-17T20:35:36.752829] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-17T20:35:36.762965] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-17T20:35:36.931321] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-17T20:35:37.558005] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-17T20:35:38.234757] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T20:35:38.358006] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-17T20:35:38.692975] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.73 seconds). [2025-10-17T20:35:39.158125] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-17T20:35:39.448010] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T20:35:39.958012] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-17T20:35:40.058679] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T20:35:40.758054] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-17T20:35:41.478024] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-17T20:35:41.557997] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-17T20:35:41.875597] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-17T20:35:42.358097] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-17T20:35:42.837481] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-17T20:35:43.158047] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-17T20:35:43.860615] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-17T20:35:43.958004] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-17T20:35:44.523542] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-17T20:35:44.758060] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-17T20:35:45.008202] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T20:35:45.558044] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-17T20:35:46.358104] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-17T20:35:46.397097] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-17T20:35:46.948481] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-17T20:35:47.158036] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-17T20:35:47.438320] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-17T20:35:47.958061] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-17T20:35:48.073598] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T20:35:48.758031] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-17T20:35:49.218387] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-17T20:35:49.462125] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T20:35:49.557990] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-17T20:35:50.321004] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T20:35:50.357990] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-17T20:35:51.158007] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-17T20:35:51.570349] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-17T20:35:51.958008] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-17T20:35:52.039117] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T20:35:52.758101] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-17T20:35:52.981284] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-17T20:35:53.557996] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-17T20:35:53.722479] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T20:35:54.358020] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-17T20:35:54.439518] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T20:35:55.158054] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-17T20:35:55.660026] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-17T20:35:55.958102] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-17T20:35:56.759996] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-17T20:35:56.762921] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-17T20:35:56.971192] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T20:35:57.571463] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-17T20:35:57.604357] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T20:35:58.358048] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-17T20:35:58.773928] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-17T20:35:59.149499] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-17T20:35:59.155901] [INFO ] [REMOTE ] NTST: Full fetch complete (61786 records). [2025-10-17T20:35:59.156040] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-17T20:35:59.168175] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-17T20:35:59.544562] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-10-17T20:35:59.544677] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-10-17T20:35:59.545748] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-10-17T20:35:59.545816] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-10-17T20:35:59.547305] [DEBUG] [LOCAL ] NTST: Trimmed 61786 records to 44754 (keeping 200 days of data) [2025-10-17T20:35:59.815453] [DEBUG] [LOCAL ] NTST: Primary data saved (44754 records). [2025-10-17T20:35:59.815586] [INFO ] [MAIN ] NTST: Full history saved. [2025-10-17T20:35:59.815687] [INFO ] [MAIN ] Update Progress: 1537/2368 symbols completed. NTST took 33.2s. Estimated remaining: 1h 56m 45s. Rate: 7.1 symbols/min [2025-10-17T20:35:59.963745] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-17T20:35:59.983340] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:35:59.983451] [DEBUG] [LOCAL ] NUS: No existing data file found in primary storage. [2025-10-17T20:35:59.983493] [WARN ] [MAIN ] NUS: No existing data found, performing full refresh instead. [2025-10-17T20:35:59.983608] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-17T20:35:59.983700] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-17T20:35:59.983769] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-17T20:35:59.983817] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-17T20:36:00.338847] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:36:00.644575] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-17T20:36:00.757987] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-17T20:36:01.488211] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-17T20:36:01.563110] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-17T20:36:01.579240] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T20:36:02.358027] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-17T20:36:03.118782] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-17T20:36:03.157989] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-17T20:36:03.796775] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-17T20:36:03.803710] [INFO ] [REMOTE ] NUE: Full fetch complete (74829 records). [2025-10-17T20:36:03.803839] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-17T20:36:03.999074] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T20:36:03.981722] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-10-17T20:36:03.999953] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:36:04.000862] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:36:04.000949] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-17T20:36:04.001040] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-17T20:36:04.001106] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-17T20:36:04.001160] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-17T20:36:04.001231] [INFO ] [MAIN ] Update Progress: 1538/2368 symbols completed. NUE took 34.4s. Estimated remaining: 1h 56m 34s. Rate: 7.1 symbols/min [2025-10-17T20:36:04.174637] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:36:04.194078] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T20:36:04.201493] [INFO ] [REMOTE ] NTR: Full fetch complete (76514 records). [2025-10-17T20:36:04.201752] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-17T20:36:04.374971] [DEBUG] [LOCAL ] NUV: Loaded 23972 existing records from primary storage. [2025-10-17T20:36:04.392369] [INFO ] [MAIN ] NUV: Loaded 23972 existing records. [2025-10-17T20:36:04.761011] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:36:04.779383] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-17T20:36:04.779534] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-10-17T20:36:04.779608] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-10-17T20:36:04.780711] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-10-17T20:36:04.780791] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-10-17T20:36:04.780874] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-17T20:36:04.781264] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-10-17T20:36:04.781324] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-17T20:36:04.881358] [DEBUG] [LOCAL ] NTR: Trimmed 76514 records to 53379 (keeping 200 days of data) [2025-10-17T20:36:05.253666] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:36:05.254576] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-10-17T20:36:05.465279] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-17T20:36:05.476716] [INFO ] [REMOTE ] NU: Full fetch complete (77925 records). [2025-10-17T20:36:05.477363] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-17T20:36:05.616865] [DEBUG] [LOCAL ] NTR: Primary data saved (53379 records). [2025-10-17T20:36:05.634921] [INFO ] [MAIN ] NTR: Full history saved. [2025-10-17T20:36:05.648936] [INFO ] [MAIN ] Update Progress: 1539/2368 symbols completed. NTR took 40.3s. Estimated remaining: 1h 56m 22s. Rate: 7.1 symbols/min [2025-10-17T20:36:06.013328] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:36:06.061122] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-10-17T20:36:06.061224] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-10-17T20:36:06.062381] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-10-17T20:36:06.062715] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-10-17T20:36:06.085752] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-17T20:36:06.093716] [DEBUG] [LOCAL ] NU: Trimmed 77925 records to 54526 (keeping 200 days of data) [2025-10-17T20:36:06.094287] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-17T20:36:06.237057] [DEBUG] [LOCAL ] NUVB: Loaded 51956 existing records from primary storage. [2025-10-17T20:36:06.238148] [INFO ] [MAIN ] NUVB: Loaded 51956 existing records. [2025-10-17T20:36:06.510771] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:36:06.520206] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-17T20:36:06.522148] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-17T20:36:06.522791] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-10-17T20:36:06.523083] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-17T20:36:06.965862] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:36:06.968611] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-10-17T20:36:07.009009] [DEBUG] [LOCAL ] NU: Primary data saved (54526 records). [2025-10-17T20:36:07.010952] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T20:36:07.010329] [INFO ] [MAIN ] NU: Full history saved. [2025-10-17T20:36:07.017779] [INFO ] [MAIN ] Update Progress: 1540/2368 symbols completed. NU took 38.1s. Estimated remaining: 1h 56m 10s. Rate: 7.1 symbols/min [2025-10-17T20:36:07.163886] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-17T20:36:07.183719] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:36:07.193419] [DEBUG] [LOCAL ] NUW: Loaded 6785 existing records from primary storage. [2025-10-17T20:36:07.193741] [INFO ] [MAIN ] NUW: Loaded 6785 existing records. [2025-10-17T20:36:07.399866] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:36:07.400085] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-17T20:36:07.400130] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-17T20:36:07.400300] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-10-17T20:36:07.400355] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-17T20:36:07.754811] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:36:07.834533] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T20:36:07.957980] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-17T20:36:08.357858] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T20:36:08.757995] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-17T20:36:08.949122] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-17T20:36:09.557984] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-10-17T20:36:09.587478] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T20:36:09.897795] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T20:36:10.357999] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-17T20:36:10.669396] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T20:36:11.158022] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-17T20:36:11.963239] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-17T20:36:11.979361] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T20:36:12.068024] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T20:36:12.758048] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-17T20:36:13.558060] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-17T20:36:13.682852] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-17T20:36:13.818359] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T20:36:14.358037] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-17T20:36:14.774874] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-17T20:36:15.158029] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-17T20:36:15.963109] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-17T20:36:15.976053] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T20:36:16.004288] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T20:36:16.758032] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-17T20:36:17.558032] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-17T20:36:17.630690] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T20:36:18.358061] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-17T20:36:18.394717] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T20:36:18.403257] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T20:36:19.158031] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-17T20:36:19.951752] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-17T20:36:19.957987] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-17T20:36:20.095709] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T20:36:20.729375] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-17T20:36:20.758009] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-17T20:36:21.493102] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T20:36:21.558004] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-17T20:36:22.358040] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-17T20:36:22.938815] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T20:36:23.047899] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-17T20:36:23.158033] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-17T20:36:23.958068] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-17T20:36:24.310757] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T20:36:24.758034] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-17T20:36:25.335734] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T20:36:25.454976] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-17T20:36:25.558028] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-17T20:36:26.357999] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-17T20:36:26.759289] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-17T20:36:27.158028] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-17T20:36:27.271585] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T20:36:27.958022] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-17T20:36:28.566497] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T20:36:28.567692] [INFO ] [REMOTE ] NUW: Full fetch complete (10854 records). [2025-10-17T20:36:28.567763] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-17T20:36:28.770458] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-17T20:36:28.913772] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T20:36:28.963454] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-10-17T20:36:28.963581] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-10-17T20:36:28.963891] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-10-17T20:36:28.963955] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-10-17T20:36:28.964396] [DEBUG] [LOCAL ] NUW: Trimmed 10854 records to 6809 (keeping 200 days of data) [2025-10-17T20:36:29.005549] [DEBUG] [LOCAL ] NUW: Primary data saved (6809 records). [2025-10-17T20:36:29.005689] [INFO ] [MAIN ] NUW: Full history saved. [2025-10-17T20:36:29.005788] [INFO ] [MAIN ] Update Progress: 1541/2368 symbols completed. NUW took 22.0s. Estimated remaining: 1h 56m 9s. Rate: 7.1 symbols/min [2025-10-17T20:36:29.172468] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:36:29.172634] [DEBUG] [LOCAL ] NVG: No existing data file found in primary storage. [2025-10-17T20:36:29.172707] [WARN ] [MAIN ] NVG: No existing data found, performing full refresh instead. [2025-10-17T20:36:29.172822] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-17T20:36:29.172864] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-17T20:36:29.172904] [DEBUG] [LOCAL ] NVG: No primary data file found to delete. [2025-10-17T20:36:29.172936] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-17T20:36:29.523222] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:36:29.557988] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-17T20:36:30.358006] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-17T20:36:30.701264] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T20:36:31.157994] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-17T20:36:31.237026] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T20:36:31.531098] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-17T20:36:31.958059] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-17T20:36:32.758013] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-10-17T20:36:32.969240] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T20:36:33.306478] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T20:36:33.558031] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-17T20:36:34.358017] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-17T20:36:34.386367] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T20:36:34.992964] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T20:36:35.158054] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-17T20:36:35.621174] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T20:36:35.625588] [INFO ] [REMOTE ] NUV: Full fetch complete (33920 records). [2025-10-17T20:36:35.625766] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-17T20:36:35.971557] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-17T20:36:36.019340] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-17T20:36:36.019423] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-17T20:36:36.020133] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-17T20:36:36.020198] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-17T20:36:36.020953] [DEBUG] [LOCAL ] NUV: Trimmed 33920 records to 24144 (keeping 200 days of data) [2025-10-17T20:36:36.160450] [DEBUG] [LOCAL ] NUV: Primary data saved (24144 records). [2025-10-17T20:36:36.160583] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-17T20:36:36.160738] [INFO ] [MAIN ] Update Progress: 1542/2368 symbols completed. NUV took 32.2s. Estimated remaining: 1h 55m 60s. Rate: 7.1 symbols/min [2025-10-17T20:36:36.324675] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:36:36.324791] [DEBUG] [LOCAL ] NVGS: No existing data file found in primary storage. [2025-10-17T20:36:36.324827] [WARN ] [MAIN ] NVGS: No existing data found, performing full refresh instead. [2025-10-17T20:36:36.324929] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-17T20:36:36.324968] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-17T20:36:36.325008] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-17T20:36:36.325039] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-17T20:36:36.662825] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:36:36.757980] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-10-17T20:36:37.095504] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-17T20:36:37.557993] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-17T20:36:37.628127] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T20:36:37.633086] [INFO ] [REMOTE ] NUS: Full fetch complete (53655 records). [2025-10-17T20:36:37.633176] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-17T20:36:37.944160] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T20:36:38.034754] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-10-17T20:36:38.034823] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-10-17T20:36:38.035725] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-10-17T20:36:38.035790] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-10-17T20:36:38.036798] [DEBUG] [LOCAL ] NUS: Trimmed 53655 records to 36728 (keeping 200 days of data) [2025-10-17T20:36:38.244389] [DEBUG] [LOCAL ] NUS: Primary data saved (36728 records). [2025-10-17T20:36:38.244529] [INFO ] [MAIN ] NUS: Full history saved. [2025-10-17T20:36:38.244601] [INFO ] [MAIN ] Update Progress: 1543/2368 symbols completed. NUS took 38.4s. Estimated remaining: 1h 55m 48s. Rate: 7.1 symbols/min [2025-10-17T20:36:38.363200] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-17T20:36:38.410860] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:36:38.410967] [DEBUG] [LOCAL ] NVO: No existing data file found in primary storage. [2025-10-17T20:36:38.411004] [WARN ] [MAIN ] NVO: No existing data found, performing full refresh instead. [2025-10-17T20:36:38.411109] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-17T20:36:38.411149] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-17T20:36:38.411192] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-17T20:36:38.411223] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-17T20:36:38.756561] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:36:39.158068] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-10-17T20:36:39.660522] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T20:36:39.745504] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-17T20:36:39.958044] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-17T20:36:40.758045] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-17T20:36:41.190680] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T20:36:41.557989] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-17T20:36:41.604055] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-17T20:36:41.628343] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T20:36:42.358067] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-17T20:36:42.797870] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T20:36:43.158031] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-17T20:36:43.958081] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-17T20:36:44.646154] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-17T20:36:44.757986] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-17T20:36:45.108996] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T20:36:45.142792] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-17T20:36:45.558024] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-17T20:36:46.358100] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-17T20:36:46.854737] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-17T20:36:47.158040] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-17T20:36:47.872972] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-17T20:36:47.874405] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T20:36:47.958011] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-17T20:36:48.758043] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-17T20:36:49.558105] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-17T20:36:49.600407] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-17T20:36:49.827741] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T20:36:49.999886] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-17T20:36:50.007151] [INFO ] [REMOTE ] NUVB: Full fetch complete (73350 records). [2025-10-17T20:36:50.007294] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-17T20:36:50.366787] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-17T20:36:50.391041] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-10-17T20:36:50.391108] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-10-17T20:36:50.392311] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-10-17T20:36:50.392485] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-10-17T20:36:50.393932] [DEBUG] [LOCAL ] NUVB: Trimmed 73350 records to 52343 (keeping 200 days of data) [2025-10-17T20:36:50.677050] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T20:36:50.720312] [DEBUG] [LOCAL ] NUVB: Primary data saved (52343 records). [2025-10-17T20:36:50.720465] [INFO ] [MAIN ] NUVB: Full history saved. [2025-10-17T20:36:50.720549] [INFO ] [MAIN ] Update Progress: 1544/2368 symbols completed. NUVB took 45.0s. Estimated remaining: 1h 55m 41s. Rate: 7.1 symbols/min [2025-10-17T20:36:50.891089] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:36:50.910063] [DEBUG] [LOCAL ] NVR: Loaded 18674 existing records from primary storage. [2025-10-17T20:36:50.910392] [INFO ] [MAIN ] NVR: Loaded 18674 existing records. [2025-10-17T20:36:51.082124] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:36:51.082334] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-17T20:36:51.082398] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-17T20:36:51.082553] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-10-17T20:36:51.082590] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-17T20:36:51.163125] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-17T20:36:51.432017] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:36:51.885610] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-17T20:36:51.958048] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-17T20:36:52.418124] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-17T20:36:52.758019] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-17T20:36:53.366815] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T20:36:53.558055] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-17T20:36:54.358005] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-10-17T20:36:54.749772] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T20:36:55.158018] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-17T20:36:55.434354] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-17T20:36:55.882278] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T20:36:55.958000] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-17T20:36:56.396230] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T20:36:56.758050] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-17T20:36:57.210618] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T20:36:57.558018] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-17T20:36:58.358033] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-17T20:36:59.135184] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T20:36:59.157984] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-17T20:36:59.247805] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-17T20:36:59.606811] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T20:36:59.958028] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-17T20:37:00.509477] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-17T20:37:00.758006] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-17T20:37:01.460361] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T20:37:01.558022] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-17T20:37:02.358064] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-17T20:37:02.932947] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T20:37:03.169002] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-17T20:37:03.192862] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-17T20:37:03.605334] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-17T20:37:03.958035] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-17T20:37:04.436742] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T20:37:04.758055] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-17T20:37:05.101907] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T20:37:05.107725] [INFO ] [REMOTE ] NVGS: Full fetch complete (42071 records). [2025-10-17T20:37:05.108010] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-17T20:37:05.563912] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-17T20:37:05.564826] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-10-17T20:37:05.564902] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-10-17T20:37:05.565931] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-10-17T20:37:05.566181] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-10-17T20:37:05.568092] [DEBUG] [LOCAL ] NVGS: Trimmed 42071 records to 30546 (keeping 200 days of data) [2025-10-17T20:37:05.760031] [DEBUG] [LOCAL ] NVGS: Primary data saved (30546 records). [2025-10-17T20:37:05.760181] [INFO ] [MAIN ] NVGS: Full history saved. [2025-10-17T20:37:05.760257] [INFO ] [MAIN ] Update Progress: 1545/2368 symbols completed. NVGS took 29.6s. Estimated remaining: 1h 55m 37s. Rate: 7.1 symbols/min [2025-10-17T20:37:05.930019] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:37:05.930201] [DEBUG] [LOCAL ] NVRI: No existing data file found in primary storage. [2025-10-17T20:37:05.930239] [WARN ] [MAIN ] NVRI: No existing data found, performing full refresh instead. [2025-10-17T20:37:05.930357] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-17T20:37:05.930400] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-17T20:37:05.930442] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-17T20:37:05.930474] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-17T20:37:06.285192] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:37:06.358103] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-10-17T20:37:06.824967] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-17T20:37:07.158118] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-10-17T20:37:07.571302] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-10-17T20:37:07.958008] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-17T20:37:08.063618] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T20:37:08.260031] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T20:37:08.758016] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-10-17T20:37:09.558047] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-17T20:37:09.749269] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T20:37:10.358027] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-17T20:37:10.893898] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-10-17T20:37:10.952490] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T20:37:11.158036] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-17T20:37:11.738602] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T20:37:11.958011] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-17T20:37:12.521213] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-17T20:37:12.758040] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-10-17T20:37:13.167120] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T20:37:13.171340] [INFO ] [REMOTE ] NVG: Full fetch complete (39844 records). [2025-10-17T20:37:13.171425] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-17T20:37:13.536115] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-10-17T20:37:13.536236] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-10-17T20:37:13.537155] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-10-17T20:37:13.537220] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-10-17T20:37:13.538342] [DEBUG] [LOCAL ] NVG: Trimmed 39844 records to 27878 (keeping 200 days of data) [2025-10-17T20:37:13.591059] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-17T20:37:13.711540] [DEBUG] [LOCAL ] NVG: Primary data saved (27878 records). [2025-10-17T20:37:13.711717] [INFO ] [MAIN ] NVG: Full history saved. [2025-10-17T20:37:13.711803] [INFO ] [MAIN ] Update Progress: 1546/2368 symbols completed. NVG took 44.7s. Estimated remaining: 1h 55m 28s. Rate: 7.1 symbols/min [2025-10-17T20:37:13.871753] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-17T20:37:13.898793] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:37:13.902250] [DEBUG] [LOCAL ] NVS: No existing data file found in primary storage. [2025-10-17T20:37:13.902345] [WARN ] [MAIN ] NVS: No existing data found, performing full refresh instead. [2025-10-17T20:37:13.902867] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-17T20:37:13.902915] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-17T20:37:13.902959] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-17T20:37:13.902991] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-17T20:37:14.264199] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:37:14.358017] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-10-17T20:37:15.157998] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-10-17T20:37:15.462980] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T20:37:15.958002] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-17T20:37:16.062817] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-17T20:37:16.758020] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-10. [2025-10-17T20:37:17.181051] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-17T20:37:17.300179] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T20:37:17.558036] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-17T20:37:17.877859] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T20:37:17.881300] [INFO ] [REMOTE ] NVR: Full fetch complete (29142 records). [2025-10-17T20:37:17.881416] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-10-17T20:37:18.278111] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-10-17T20:37:18.278190] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-10-17T20:37:18.278857] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-10-17T20:37:18.278920] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-10-17T20:37:18.279609] [DEBUG] [LOCAL ] NVR: Trimmed 29142 records to 18842 (keeping 200 days of data) [2025-10-17T20:37:18.370743] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-17T20:37:18.396211] [DEBUG] [LOCAL ] NVR: Primary data saved (18842 records). [2025-10-17T20:37:18.396356] [INFO ] [MAIN ] NVR: Full history saved. [2025-10-17T20:37:18.396433] [INFO ] [MAIN ] Update Progress: 1547/2368 symbols completed. NVR took 27.7s. Estimated remaining: 1h 55m 17s. Rate: 7.1 symbols/min [2025-10-17T20:37:18.567526] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:37:18.567735] [DEBUG] [LOCAL ] NVST: No existing data file found in primary storage. [2025-10-17T20:37:18.567785] [WARN ] [MAIN ] NVST: No existing data found, performing full refresh instead. [2025-10-17T20:37:18.567921] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-17T20:37:18.567963] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-17T20:37:18.568004] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-17T20:37:18.568037] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-17T20:37:18.951742] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:37:19.158008] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-10-17T20:37:19.230098] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T20:37:19.929194] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T20:37:19.958000] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-17T20:37:20.551619] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-17T20:37:20.758068] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-17T20:37:21.312836] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T20:37:21.558033] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-17T20:37:22.358072] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-17T20:37:22.601506] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-17T20:37:22.959208] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T20:37:23.158065] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-17T20:37:23.966985] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-17T20:37:23.972168] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T20:37:24.630504] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T20:37:24.757983] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-17T20:37:25.558044] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-17T20:37:26.363270] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-17T20:37:26.375962] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T20:37:26.469371] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-17T20:37:26.476677] [INFO ] [REMOTE ] NVO: Full fetch complete (77964 records). [2025-10-17T20:37:26.476818] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-17T20:37:26.869779] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-10-17T20:37:26.869916] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-10-17T20:37:26.871123] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-10-17T20:37:26.871190] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-10-17T20:37:26.872709] [DEBUG] [LOCAL ] NVO: Trimmed 77964 records to 54564 (keeping 200 days of data) [2025-10-17T20:37:27.159830] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-17T20:37:27.240369] [DEBUG] [LOCAL ] NVO: Primary data saved (54564 records). [2025-10-17T20:37:27.240535] [INFO ] [MAIN ] NVO: Full history saved. [2025-10-17T20:37:27.240823] [INFO ] [MAIN ] Update Progress: 1548/2368 symbols completed. NVO took 49.0s. Estimated remaining: 1h 55m 9s. Rate: 7.1 symbols/min [2025-10-17T20:37:27.242234] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T20:37:27.420045] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:37:27.420237] [DEBUG] [LOCAL ] NVT: No existing data file found in primary storage. [2025-10-17T20:37:27.420276] [WARN ] [MAIN ] NVT: No existing data found, performing full refresh instead. [2025-10-17T20:37:27.420411] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-17T20:37:27.420454] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-17T20:37:27.420497] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-17T20:37:27.420532] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-17T20:37:27.779574] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:37:27.965339] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-10-17T20:37:27.970691] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T20:37:28.676893] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T20:37:28.758034] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-17T20:37:29.557992] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-17T20:37:29.651464] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T20:37:30.358028] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-17T20:37:30.842084] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-17T20:37:30.872168] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T20:37:30.878273] [INFO ] [REMOTE ] NVRI: Full fetch complete (56119 records). [2025-10-17T20:37:30.878373] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-17T20:37:31.162984] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-17T20:37:31.253893] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-10-17T20:37:31.253970] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-10-17T20:37:31.254902] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-10-17T20:37:31.254988] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-10-17T20:37:31.256081] [DEBUG] [LOCAL ] NVRI: Trimmed 56119 records to 39555 (keeping 200 days of data) [2025-10-17T20:37:31.473300] [DEBUG] [LOCAL ] NVRI: Primary data saved (39555 records). [2025-10-17T20:37:31.473435] [INFO ] [MAIN ] NVRI: Full history saved. [2025-10-17T20:37:31.473507] [INFO ] [MAIN ] Update Progress: 1549/2368 symbols completed. NVRI took 25.7s. Estimated remaining: 1h 54m 59s. Rate: 7.1 symbols/min [2025-10-17T20:37:31.642203] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:37:31.642394] [DEBUG] [LOCAL ] NWG: No existing data file found in primary storage. [2025-10-17T20:37:31.642569] [WARN ] [MAIN ] NWG: No existing data found, performing full refresh instead. [2025-10-17T20:37:31.642877] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-17T20:37:31.643140] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-17T20:37:31.643270] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-17T20:37:31.643450] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-17T20:37:31.964476] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-17T20:37:32.004407] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:37:32.036905] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T20:37:32.758008] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-17T20:37:33.114049] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T20:37:33.558035] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-17T20:37:33.812768] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T20:37:34.358058] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-17T20:37:34.734571] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-17T20:37:35.158039] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-17T20:37:35.460988] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T20:37:35.958002] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-17T20:37:36.129006] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-17T20:37:36.758038] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-17T20:37:37.056593] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T20:37:37.558001] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-10-17T20:37:37.872391] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T20:37:38.358031] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-17T20:37:38.562050] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-17T20:37:39.158028] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-17T20:37:39.406947] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T20:37:39.958094] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-17T20:37:40.014899] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T20:37:40.750331] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T20:37:40.760365] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-17T20:37:41.558016] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-17T20:37:41.647636] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T20:37:42.358006] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-17T20:37:42.477059] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T20:37:43.158070] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-17T20:37:43.882138] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-17T20:37:43.958012] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-17T20:37:44.329543] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-17T20:37:44.757991] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-17T20:37:45.100921] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T20:37:45.238539] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T20:37:45.558085] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-17T20:37:46.225745] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T20:37:46.358015] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-17T20:37:47.158079] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-17T20:37:47.313267] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T20:37:47.958023] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-17T20:37:48.196559] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T20:37:48.758049] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-17T20:37:49.099740] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T20:37:49.106666] [INFO ] [REMOTE ] NVS: Full fetch complete (75066 records). [2025-10-17T20:37:49.106797] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-17T20:37:49.498333] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-10-17T20:37:49.498443] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-10-17T20:37:49.499784] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-10-17T20:37:49.499859] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-10-17T20:37:49.501837] [DEBUG] [LOCAL ] NVS: Trimmed 75066 records to 52190 (keeping 200 days of data) [2025-10-17T20:37:49.563235] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-17T20:37:49.844274] [DEBUG] [LOCAL ] NVS: Primary data saved (52190 records). [2025-10-17T20:37:49.844755] [INFO ] [MAIN ] NVS: Full history saved. [2025-10-17T20:37:49.846142] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T20:37:49.845115] [INFO ] [MAIN ] Update Progress: 1550/2368 symbols completed. NVS took 36.1s. Estimated remaining: 1h 54m 55s. Rate: 7.1 symbols/min [2025-10-17T20:37:50.024827] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:37:50.025012] [DEBUG] [LOCAL ] NWN: No existing data file found in primary storage. [2025-10-17T20:37:50.025050] [WARN ] [MAIN ] NWN: No existing data found, performing full refresh instead. [2025-10-17T20:37:50.025158] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-17T20:37:50.025198] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-17T20:37:50.025238] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-17T20:37:50.025269] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-17T20:37:50.358936] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-17T20:37:50.390625] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:37:50.425487] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T20:37:51.158047] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-17T20:37:51.302790] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T20:37:51.315859] [INFO ] [REMOTE ] NVST: Full fetch complete (74396 records). [2025-10-17T20:37:51.316101] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-17T20:37:51.721275] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-10-17T20:37:51.721355] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-10-17T20:37:51.722418] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-10-17T20:37:51.722479] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-10-17T20:37:51.724433] [DEBUG] [LOCAL ] NVST: Trimmed 74396 records to 52300 (keeping 200 days of data) [2025-10-17T20:37:51.983817] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-10-17T20:37:52.030179] [DEBUG] [LOCAL ] NVST: Primary data saved (52300 records). [2025-10-17T20:37:52.030370] [INFO ] [MAIN ] NVST: Full history saved. [2025-10-17T20:37:52.030472] [INFO ] [MAIN ] Update Progress: 1551/2368 symbols completed. NVST took 33.6s. Estimated remaining: 1h 54m 44s. Rate: 7.1 symbols/min [2025-10-17T20:37:52.209037] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:37:52.209418] [DEBUG] [LOCAL ] NX: No existing data file found in primary storage. [2025-10-17T20:37:52.209527] [WARN ] [MAIN ] NX: No existing data found, performing full refresh instead. [2025-10-17T20:37:52.209773] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-17T20:37:52.209947] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-17T20:37:52.210037] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-17T20:37:52.210091] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-17T20:37:52.597988] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:37:52.613959] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-17T20:37:52.757991] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-17T20:37:52.924979] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T20:37:53.467504] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T20:37:53.557993] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-17T20:37:54.358012] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-17T20:37:54.419098] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T20:37:54.858178] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T20:37:55.158054] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-17T20:37:55.958040] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-10-17T20:37:56.233886] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T20:37:56.758042] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-17T20:37:57.014975] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-17T20:37:57.051212] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T20:37:57.558022] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-17T20:37:58.358055] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-17T20:37:58.572137] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T20:37:58.579413] [INFO ] [REMOTE ] NVT: Full fetch complete (74826 records). [2025-10-17T20:37:58.579540] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-17T20:37:58.899003] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T20:37:58.998796] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-10-17T20:37:58.998880] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-10-17T20:37:59.000279] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-10-17T20:37:59.000345] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-10-17T20:37:59.001755] [DEBUG] [LOCAL ] NVT: Trimmed 74826 records to 52222 (keeping 200 days of data) [2025-10-17T20:37:59.176935] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-17T20:37:59.323848] [DEBUG] [LOCAL ] NVT: Primary data saved (52222 records). [2025-10-17T20:37:59.323990] [INFO ] [MAIN ] NVT: Full history saved. [2025-10-17T20:37:59.324083] [INFO ] [MAIN ] Update Progress: 1552/2368 symbols completed. NVT took 32.1s. Estimated remaining: 1h 54m 35s. Rate: 7.1 symbols/min [2025-10-17T20:37:59.491965] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:37:59.499381] [DEBUG] [LOCAL ] NXC: Loaded 4147 existing records from primary storage. [2025-10-17T20:37:59.499583] [INFO ] [MAIN ] NXC: Loaded 4147 existing records. [2025-10-17T20:37:59.677036] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:37:59.677398] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-17T20:37:59.677503] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-17T20:37:59.677830] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-10-17T20:37:59.693034] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-17T20:37:59.701199] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T20:37:59.963265] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-17T20:38:00.051060] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:38:00.478151] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T20:38:00.758030] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-17T20:38:01.558008] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-17T20:38:01.992801] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-17T20:38:02.358085] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-17T20:38:02.443584] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T20:38:03.158025] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-10-17T20:38:03.366785] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-17T20:38:03.958084] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-17T20:38:04.067024] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T20:38:04.304066] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-17T20:38:04.758031] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-17T20:38:05.481636] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T20:38:05.557991] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-17T20:38:06.358043] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-17T20:38:06.631290] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T20:38:07.136961] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T20:38:07.157989] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-17T20:38:07.690623] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-17T20:38:07.737748] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T20:38:07.958076] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-17T20:38:08.758060] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-17T20:38:09.558013] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-17T20:38:09.726968] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T20:38:09.734060] [INFO ] [REMOTE ] NWG: Full fetch complete (73998 records). [2025-10-17T20:38:09.734211] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-17T20:38:10.152541] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-10-17T20:38:10.153265] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-10-17T20:38:10.153879] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T20:38:10.155174] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-10-17T20:38:10.161532] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-10-17T20:38:10.163328] [DEBUG] [LOCAL ] NWG: Trimmed 73998 records to 52188 (keeping 200 days of data) [2025-10-17T20:38:10.368060] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-17T20:38:10.475629] [DEBUG] [LOCAL ] NWG: Primary data saved (52188 records). [2025-10-17T20:38:10.475794] [INFO ] [MAIN ] NWG: Full history saved. [2025-10-17T20:38:10.475905] [INFO ] [MAIN ] Update Progress: 1553/2368 symbols completed. NWG took 39.0s. Estimated remaining: 1h 54m 28s. Rate: 7.1 symbols/min [2025-10-17T20:38:10.642561] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:38:10.642793] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-17T20:38:10.642846] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-17T20:38:10.642956] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-17T20:38:10.643022] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-17T20:38:10.643088] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-17T20:38:10.643155] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-17T20:38:11.017546] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:38:11.019081] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T20:38:11.157988] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-17T20:38:11.810943] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T20:38:11.957973] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-17T20:38:12.723943] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T20:38:12.758003] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-17T20:38:13.321318] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T20:38:13.558057] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-17T20:38:14.187698] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T20:38:14.261573] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T20:38:14.358014] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-17T20:38:15.048024] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-17T20:38:15.158025] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-10-17T20:38:15.463681] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T20:38:15.464080] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-10-17T20:38:15.464155] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:38:15.464235] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-17T20:38:15.464305] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:38:15.464387] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-17T20:38:15.464468] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-17T20:38:15.464506] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-17T20:38:15.464562] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-17T20:38:15.464633] [INFO ] [MAIN ] Update Progress: 1554/2368 symbols completed. NXDR took 5.0s. Estimated remaining: 1h 54m 17s. Rate: 7.1 symbols/min [2025-10-17T20:38:15.640265] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:38:15.657608] [DEBUG] [LOCAL ] NXDT: Loaded 15151 existing records from primary storage. [2025-10-17T20:38:15.657986] [INFO ] [MAIN ] NXDT: Loaded 15151 existing records. [2025-10-17T20:38:15.844694] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:38:15.844989] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-17T20:38:15.845044] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-17T20:38:15.845223] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-10-17T20:38:15.845278] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-17T20:38:15.963131] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-17T20:38:16.204207] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:38:16.758044] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-17T20:38:17.500741] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T20:38:17.557994] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-17T20:38:18.055773] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-17T20:38:18.358077] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-17T20:38:19.051520] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-17T20:38:19.151290] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T20:38:19.159531] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-17T20:38:19.958010] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-17T20:38:20.299405] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T20:38:20.302873] [INFO ] [REMOTE ] NWN: Full fetch complete (37298 records). [2025-10-17T20:38:20.302956] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-17T20:38:20.649560] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T20:38:20.682269] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-10-17T20:38:20.682352] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-10-17T20:38:20.683238] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-10-17T20:38:20.683303] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-10-17T20:38:20.684193] [DEBUG] [LOCAL ] NWN: Trimmed 37298 records to 27037 (keeping 200 days of data) [2025-10-17T20:38:20.769553] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-17T20:38:20.849727] [DEBUG] [LOCAL ] NWN: Primary data saved (27037 records). [2025-10-17T20:38:20.849889] [INFO ] [MAIN ] NWN: Full history saved. [2025-10-17T20:38:20.849967] [INFO ] [MAIN ] Update Progress: 1555/2368 symbols completed. NWN took 31.0s. Estimated remaining: 1h 54m 7s. Rate: 7.1 symbols/min [2025-10-17T20:38:21.015480] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:38:21.062722] [DEBUG] [LOCAL ] NXE: Loaded 53434 existing records from primary storage. [2025-10-17T20:38:21.063036] [INFO ] [MAIN ] NXE: Loaded 53434 existing records. [2025-10-17T20:38:21.236955] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:38:21.237192] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-17T20:38:21.237239] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-17T20:38:21.237420] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-10-17T20:38:21.241786] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-17T20:38:21.516040] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-17T20:38:21.563110] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-17T20:38:21.599108] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:38:22.358103] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-10-17T20:38:23.158007] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-17T20:38:23.226009] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T20:38:23.231161] [INFO ] [REMOTE ] NX: Full fetch complete (48131 records). [2025-10-17T20:38:23.231284] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-17T20:38:23.611001] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-10-17T20:38:23.611090] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-10-17T20:38:23.612018] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-10-17T20:38:23.612088] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-10-17T20:38:23.613148] [DEBUG] [LOCAL ] NX: Trimmed 48131 records to 33799 (keeping 200 days of data) [2025-10-17T20:38:23.822620] [DEBUG] [LOCAL ] NX: Primary data saved (33799 records). [2025-10-17T20:38:23.827359] [INFO ] [MAIN ] NX: Full history saved. [2025-10-17T20:38:23.827530] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-17T20:38:23.829668] [INFO ] [MAIN ] Update Progress: 1556/2368 symbols completed. NX took 31.8s. Estimated remaining: 1h 53m 56s. Rate: 7.1 symbols/min [2025-10-17T20:38:23.971701] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-10-17T20:38:24.004670] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:38:24.017023] [DEBUG] [LOCAL ] NXG: Loaded 10561 existing records from primary storage. [2025-10-17T20:38:24.017247] [INFO ] [MAIN ] NXG: Loaded 10561 existing records. [2025-10-17T20:38:24.195497] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:38:24.195801] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-17T20:38:24.195860] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-17T20:38:24.196176] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-10-17T20:38:24.196233] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-17T20:38:24.521617] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-17T20:38:24.600121] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:38:24.758035] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-17T20:38:25.361397] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-17T20:38:25.558058] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-17T20:38:26.357996] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-10-17T20:38:26.715926] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T20:38:26.717061] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T20:38:27.158066] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-17T20:38:27.409110] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T20:38:27.958046] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-17T20:38:28.021911] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T20:38:28.758081] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-17T20:38:29.267132] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-17T20:38:29.558023] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-17T20:38:29.844374] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T20:38:30.219803] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-17T20:38:30.358031] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-17T20:38:31.158086] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-17T20:38:31.551129] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-17T20:38:31.958022] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-17T20:38:32.758011] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-17T20:38:32.923577] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T20:38:33.047965] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T20:38:33.558001] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-17T20:38:33.631690] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T20:38:34.358044] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-17T20:38:34.746686] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-17T20:38:35.158062] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-17T20:38:35.165234] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T20:38:35.768088] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T20:38:35.769097] [INFO ] [REMOTE ] NXC: Full fetch complete (5661 records). [2025-10-17T20:38:35.769169] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-17T20:38:35.963099] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-17T20:38:36.170930] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-17T20:38:36.171010] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-17T20:38:36.171221] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-17T20:38:36.171285] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-17T20:38:36.171710] [DEBUG] [LOCAL ] NXC: Trimmed 5661 records to 4164 (keeping 200 days of data) [2025-10-17T20:38:36.196815] [DEBUG] [LOCAL ] NXC: Primary data saved (4164 records). [2025-10-17T20:38:36.196903] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-17T20:38:36.196980] [INFO ] [MAIN ] Update Progress: 1557/2368 symbols completed. NXC took 36.9s. Estimated remaining: 1h 53m 50s. Rate: 7.1 symbols/min [2025-10-17T20:38:36.757995] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-17T20:38:36.929776] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T20:38:37.558028] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-17T20:38:38.358054] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-17T20:38:38.612409] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T20:38:38.631299] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T20:38:39.158048] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-17T20:38:39.344556] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T20:38:39.958095] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-17T20:38:40.758055] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-17T20:38:41.063303] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-17T20:38:41.241484] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-17T20:38:41.558024] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-17T20:38:41.633369] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-17T20:38:42.358065] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-17T20:38:43.143792] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-17T20:38:43.157981] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-17T20:38:43.528744] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T20:38:43.935489] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-17T20:38:43.958087] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-17T20:38:44.758116] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-17T20:38:44.884804] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T20:38:45.558079] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-17T20:38:46.358081] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-17T20:38:46.381494] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-17T20:38:46.746912] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-17T20:38:46.940711] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-17T20:38:46.943066] [INFO ] [REMOTE ] NXDT: Full fetch complete (24366 records). [2025-10-17T20:38:46.943145] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-17T20:38:47.166107] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-17T20:38:47.306915] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-10-17T20:38:47.306994] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-10-17T20:38:47.307498] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-10-17T20:38:47.307556] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-10-17T20:38:47.308178] [DEBUG] [LOCAL ] NXDT: Trimmed 24366 records to 15223 (keeping 200 days of data) [2025-10-17T20:38:47.391955] [DEBUG] [LOCAL ] NXDT: Primary data saved (15223 records). [2025-10-17T20:38:47.392085] [INFO ] [MAIN ] NXDT: Full history saved. [2025-10-17T20:38:47.392165] [INFO ] [MAIN ] Update Progress: 1558/2368 symbols completed. NXDT took 31.9s. Estimated remaining: 1h 53m 43s. Rate: 7.1 symbols/min [2025-10-17T20:38:47.958038] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-17T20:38:48.107985] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-17T20:38:48.758001] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-17T20:38:49.620306] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-17T20:38:49.623325] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-17T20:38:49.939274] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-17T20:38:50.358052] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-17T20:38:50.626781] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T20:38:50.628810] [INFO ] [REMOTE ] NXG: Full fetch complete (14632 records). [2025-10-17T20:38:50.628883] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-17T20:38:51.017293] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-10-17T20:38:51.017374] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-10-17T20:38:51.017722] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-10-17T20:38:51.017782] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-10-17T20:38:51.018263] [DEBUG] [LOCAL ] NXG: Trimmed 14632 records to 10631 (keeping 200 days of data) [2025-10-17T20:38:51.083210] [DEBUG] [LOCAL ] NXG: Primary data saved (10631 records). [2025-10-17T20:38:51.083360] [INFO ] [MAIN ] NXG: Full history saved. [2025-10-17T20:38:51.083441] [INFO ] [MAIN ] Update Progress: 1559/2368 symbols completed. NXG took 27.3s. Estimated remaining: 1h 53m 32s. Rate: 7.1 symbols/min [2025-10-17T20:38:52.203450] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T20:38:52.215722] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-17T20:38:54.200258] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-17T20:38:54.208199] [INFO ] [REMOTE ] NXE: Full fetch complete (76946 records). [2025-10-17T20:38:54.208383] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-17T20:38:54.647284] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-10-17T20:38:54.647401] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-10-17T20:38:54.648906] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-10-17T20:38:54.648978] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-10-17T20:38:54.650610] [DEBUG] [LOCAL ] NXE: Trimmed 76946 records to 53824 (keeping 200 days of data) [2025-10-17T20:38:54.971050] [DEBUG] [LOCAL ] NXE: Primary data saved (53824 records). [2025-10-17T20:38:54.971239] [INFO ] [MAIN ] NXE: Full history saved. [2025-10-17T20:38:54.972244] [INFO ] [MAIN ] Update Progress: 1560/2368 symbols completed. NXE took 34.1s. Estimated remaining: 1h 53m 21s. Rate: 7.1 symbols/min [2025-10-17T20:38:55.577213] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:38:55.634169] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:38:55.663170] [DEBUG] [LOCAL ] NXRT: No existing data file found in primary storage. [2025-10-17T20:38:55.666632] [WARN ] [MAIN ] NXRT: No existing data found, performing full refresh instead. [2025-10-17T20:38:55.679816] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:38:55.688600] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-17T20:38:55.708782] [DEBUG] [LOCAL ] NXJ: No existing data file found in primary storage. [2025-10-17T20:38:55.708908] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-17T20:38:55.715390] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:38:55.714249] [WARN ] [MAIN ] NXJ: No existing data found, performing full refresh instead. [2025-10-17T20:38:55.716187] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-17T20:38:55.716118] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-17T20:38:55.716595] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-17T20:38:55.716521] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-17T20:38:55.716768] [DEBUG] [LOCAL ] NXJ: No primary data file found to delete. [2025-10-17T20:38:55.728328] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-17T20:38:55.763949] [DEBUG] [LOCAL ] NXP: Loaded 12378 existing records from primary storage. [2025-10-17T20:38:55.847552] [DEBUG] [LOCAL ] NXN: Loaded 2271 existing records from primary storage. [2025-10-17T20:38:55.876951] [INFO ] [MAIN ] NXN: Loaded 2271 existing records. [2025-10-17T20:38:55.833675] [INFO ] [MAIN ] NXP: Loaded 12378 existing records. [2025-10-17T20:38:56.674831] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:38:56.686636] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-17T20:38:56.697143] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-17T20:38:56.701071] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:38:56.733983] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-10-17T20:38:56.739312] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-17T20:38:56.753583] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-17T20:38:56.789335] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-17T20:38:56.832344] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:38:56.843525] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-10-17T20:38:56.867618] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-17T20:38:56.868188] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-10-17T20:38:57.032023] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:38:57.056735] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-10-17T20:38:57.543236] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:38:57.554347] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-10-17T20:38:57.642030] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:38:57.642395] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-10-17T20:38:57.818577] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T20:38:57.821520] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-17T20:38:58.125337] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T20:38:58.129335] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-17T20:38:58.523724] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-17T20:38:58.525171] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-17T20:38:58.679390] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-17T20:38:58.682702] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-17T20:38:58.961566] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T20:38:58.964735] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-17T20:38:59.039490] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T20:38:59.075024] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-17T20:38:59.158095] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-17T20:38:59.353258] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T20:38:59.706907] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-17T20:38:59.760329] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-17T20:38:59.958046] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-17T20:39:00.758068] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-17T20:39:00.868009] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T20:39:01.558033] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-17T20:39:01.784505] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T20:39:02.358032] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-17T20:39:02.451027] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-17T20:39:03.158046] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-17T20:39:03.242033] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-17T20:39:03.958004] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-17T20:39:04.343538] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-17T20:39:04.758061] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-17T20:39:04.960947] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T20:39:05.558036] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-17T20:39:05.899831] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T20:39:06.358006] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-17T20:39:06.591181] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T20:39:06.847948] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-17T20:39:07.158053] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-17T20:39:07.906829] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-17T20:39:07.958036] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-17T20:39:08.758035] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-17T20:39:09.185306] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-17T20:39:09.558044] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-17T20:39:09.891372] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T20:39:10.272163] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T20:39:10.357986] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-17T20:39:11.157993] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-17T20:39:11.520207] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T20:39:11.958065] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-17T20:39:12.076391] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T20:39:12.758081] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-17T20:39:13.083981] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T20:39:13.473260] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T20:39:13.475283] [INFO ] [REMOTE ] NXJ: Full fetch complete (20393 records). [2025-10-17T20:39:13.475363] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-17T20:39:13.563204] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-17T20:39:13.858111] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-10-17T20:39:13.858202] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-10-17T20:39:13.858717] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-10-17T20:39:13.858779] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-10-17T20:39:13.859323] [DEBUG] [LOCAL ] NXJ: Trimmed 20393 records to 15122 (keeping 200 days of data) [2025-10-17T20:39:13.948245] [DEBUG] [LOCAL ] NXJ: Primary data saved (15122 records). [2025-10-17T20:39:13.948385] [INFO ] [MAIN ] NXJ: Full history saved. [2025-10-17T20:39:13.948460] [INFO ] [MAIN ] Update Progress: 1561/2368 symbols completed. NXJ took 19.0s. Estimated remaining: 1h 53m 18s. Rate: 7.1 symbols/min [2025-10-17T20:39:14.115132] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:39:14.115283] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-17T20:39:14.115321] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-17T20:39:14.115434] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-17T20:39:14.115474] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-17T20:39:14.115514] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-17T20:39:14.115547] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-17T20:39:14.209051] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-17T20:39:14.363266] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-17T20:39:14.474275] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:39:15.157998] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-17T20:39:15.428050] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-17T20:39:15.958020] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-10-17T20:39:16.036860] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-17T20:39:16.628080] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-17T20:39:16.758043] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-17T20:39:17.286149] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-17T20:39:17.558043] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-17T20:39:18.358030] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-17T20:39:18.412513] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-17T20:39:19.158041] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-17T20:39:19.504373] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T20:39:19.958083] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-17T20:39:20.053212] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T20:39:20.572163] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-17T20:39:20.758094] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-17T20:39:21.558023] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-17T20:39:21.746169] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T20:39:22.358057] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-17T20:39:22.692040] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T20:39:22.917055] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T20:39:23.158044] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-17T20:39:23.670054] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-17T20:39:23.958026] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-17T20:39:24.434471] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-17T20:39:24.758070] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-17T20:39:25.267928] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T20:39:25.558073] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-17T20:39:26.358001] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-17T20:39:26.564807] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T20:39:26.567780] [INFO ] [REMOTE ] NXRT: Full fetch complete (25964 records). [2025-10-17T20:39:26.567852] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-17T20:39:26.933196] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-17T20:39:26.949175] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-10-17T20:39:26.949269] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-10-17T20:39:26.949967] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-10-17T20:39:26.950041] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-10-17T20:39:26.951102] [DEBUG] [LOCAL ] NXRT: Trimmed 25964 records to 19213 (keeping 200 days of data) [2025-10-17T20:39:27.070928] [DEBUG] [LOCAL ] NXRT: Primary data saved (19213 records). [2025-10-17T20:39:27.071084] [INFO ] [MAIN ] NXRT: Full history saved. [2025-10-17T20:39:27.071159] [INFO ] [MAIN ] Update Progress: 1562/2368 symbols completed. NXRT took 32.1s. Estimated remaining: 1h 53m 12s. Rate: 7.1 symbols/min [2025-10-17T20:39:27.163300] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-17T20:39:27.248665] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:39:27.248848] [DEBUG] [LOCAL ] NYT: No existing data file found in primary storage. [2025-10-17T20:39:27.248886] [WARN ] [MAIN ] NYT: No existing data found, performing full refresh instead. [2025-10-17T20:39:27.248997] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-17T20:39:27.249038] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-17T20:39:27.249080] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-17T20:39:27.249164] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-17T20:39:27.593756] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:39:27.747777] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T20:39:27.958024] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-10-17T20:39:28.758046] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-17T20:39:29.322216] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-17T20:39:29.558012] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-17T20:39:29.717699] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T20:39:29.962704] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-17T20:39:29.963605] [INFO ] [REMOTE ] NXN: Full fetch complete (3489 records). [2025-10-17T20:39:29.963721] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-17T20:39:30.307141] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-17T20:39:30.307222] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-17T20:39:30.307337] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-17T20:39:30.307374] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-17T20:39:30.307776] [DEBUG] [LOCAL ] NXN: Trimmed 3489 records to 2305 (keeping 200 days of data) [2025-10-17T20:39:30.321838] [DEBUG] [LOCAL ] NXN: Primary data saved (2305 records). [2025-10-17T20:39:30.321899] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-17T20:39:30.321968] [INFO ] [MAIN ] Update Progress: 1563/2368 symbols completed. NXN took 35.3s. Estimated remaining: 1h 53m 1s. Rate: 7.1 symbols/min [2025-10-17T20:39:30.363132] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-17T20:39:30.496843] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:39:30.497248] [DEBUG] [LOCAL ] NZF: No existing data file found in primary storage. [2025-10-17T20:39:30.497304] [WARN ] [MAIN ] NZF: No existing data found, performing full refresh instead. [2025-10-17T20:39:30.497476] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-17T20:39:30.497531] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-17T20:39:30.497578] [DEBUG] [LOCAL ] NZF: No primary data file found to delete. [2025-10-17T20:39:30.497612] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-17T20:39:30.841250] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:39:31.158010] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-10-17T20:39:31.958036] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-17T20:39:32.004126] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T20:39:32.758067] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-17T20:39:32.862322] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T20:39:32.878306] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T20:39:33.558037] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-17T20:39:33.983487] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-17T20:39:34.363132] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-17T20:39:34.379622] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T20:39:35.158079] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-17T20:39:35.259357] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-17T20:39:35.261757] [INFO ] [REMOTE ] NXP: Full fetch complete (16859 records). [2025-10-17T20:39:35.261849] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-17T20:39:35.663207] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-17T20:39:35.663323] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-17T20:39:35.663772] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-17T20:39:35.663835] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-17T20:39:35.664436] [DEBUG] [LOCAL ] NXP: Trimmed 16859 records to 12478 (keeping 200 days of data) [2025-10-17T20:39:35.725055] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-17T20:39:35.748396] [DEBUG] [LOCAL ] NXP: Primary data saved (12478 records). [2025-10-17T20:39:35.748548] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-17T20:39:35.748636] [INFO ] [MAIN ] Update Progress: 1564/2368 symbols completed. NXP took 40.8s. Estimated remaining: 1h 52m 51s. Rate: 7.1 symbols/min [2025-10-17T20:39:35.941433] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:39:35.941638] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-17T20:39:35.941734] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-17T20:39:35.941853] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-17T20:39:35.941896] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-17T20:39:35.941940] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-17T20:39:35.941973] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-17T20:39:35.963783] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-17T20:39:36.310225] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:39:36.758115] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-17T20:39:37.179307] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-17T20:39:37.446712] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-17T20:39:37.558065] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-10-17T20:39:38.358064] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-17T20:39:38.808126] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T20:39:39.158056] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-17T20:39:39.688219] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-17T20:39:39.958081] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-17T20:39:40.411952] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-17T20:39:40.416333] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.86 seconds). [2025-10-17T20:39:40.416444] [INFO ] [REMOTE ] NYC: Full fetch complete (1864 records). [2025-10-17T20:39:40.420811] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-17T20:39:40.619232] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-17T20:39:40.619994] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:39:40.620077] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:39:40.620161] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-17T20:39:40.620255] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-17T20:39:40.620316] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-17T20:39:40.620365] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-17T20:39:40.620441] [INFO ] [MAIN ] Update Progress: 1565/2368 symbols completed. NYC took 26.7s. Estimated remaining: 1h 52m 41s. Rate: 7.1 symbols/min [2025-10-17T20:39:40.765829] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-17T20:39:40.796066] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:39:40.797223] [DEBUG] [LOCAL ] OBDC: No existing data file found in primary storage. [2025-10-17T20:39:40.797272] [WARN ] [MAIN ] OBDC: No existing data found, performing full refresh instead. [2025-10-17T20:39:40.797400] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-17T20:39:40.797464] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-17T20:39:40.797532] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-17T20:39:40.797569] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-17T20:39:41.145628] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:39:41.558047] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-10-17T20:39:42.358046] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-17T20:39:43.158033] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-17T20:39:43.319078] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T20:39:43.537560] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.77 seconds). [2025-10-17T20:39:43.958026] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-17T20:39:44.257128] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T20:39:44.307567] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T20:39:44.758051] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-17T20:39:45.558030] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-17T20:39:46.231824] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-17T20:39:46.358025] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-17T20:39:46.597891] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T20:39:46.650154] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T20:39:47.158027] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-17T20:39:47.958092] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-17T20:39:48.595986] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-17T20:39:48.629358] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T20:39:48.758049] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-17T20:39:49.563234] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-17T20:39:49.589466] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T20:39:50.358054] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-17T20:39:50.917892] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T20:39:51.158032] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-17T20:39:51.427852] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-10-17T20:39:51.958009] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-17T20:39:52.076739] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T20:39:52.125935] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T20:39:52.758048] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-17T20:39:53.558092] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-17T20:39:54.102459] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T20:39:54.358039] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-17T20:39:54.550299] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-17T20:39:54.981235] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T20:39:55.158050] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-17T20:39:55.718012] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T20:39:55.958032] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-17T20:39:56.758010] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-17T20:39:56.928538] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-17T20:39:57.103588] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-17T20:39:57.558041] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-17T20:39:58.122924] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T20:39:58.358139] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-17T20:39:59.158082] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-17T20:39:59.473250] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T20:39:59.958037] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-17T20:39:59.985279] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-17T20:39:59.989563] [INFO ] [REMOTE ] NZF: Full fetch complete (42363 records). [2025-10-17T20:39:59.989690] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-17T20:40:00.403903] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-10-17T20:40:00.403990] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-10-17T20:40:00.404829] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-10-17T20:40:00.404892] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-10-17T20:40:00.405785] [DEBUG] [LOCAL ] NZF: Trimmed 42363 records to 29261 (keeping 200 days of data) [2025-10-17T20:40:00.592684] [DEBUG] [LOCAL ] NZF: Primary data saved (29261 records). [2025-10-17T20:40:00.592847] [INFO ] [MAIN ] NZF: Full history saved. [2025-10-17T20:40:00.592945] [INFO ] [MAIN ] Update Progress: 1566/2368 symbols completed. NZF took 30.3s. Estimated remaining: 1h 52m 38s. Rate: 7.1 symbols/min [2025-10-17T20:40:00.761476] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-17T20:40:00.800389] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:40:00.800602] [DEBUG] [LOCAL ] OBK: No existing data file found in primary storage. [2025-10-17T20:40:00.800719] [WARN ] [MAIN ] OBK: No existing data found, performing full refresh instead. [2025-10-17T20:40:00.800955] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-17T20:40:00.801132] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-17T20:40:00.801214] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-17T20:40:00.801271] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-17T20:40:01.098989] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-10-17T20:40:01.227994] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:40:01.538734] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T20:40:01.558080] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-10-17T20:40:02.358000] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-17T20:40:02.748630] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T20:40:02.785133] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-17T20:40:03.158059] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-17T20:40:03.958066] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-17T20:40:04.308024] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T20:40:04.435632] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-17T20:40:04.758066] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-17T20:40:05.558022] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-17T20:40:05.805978] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T20:40:06.228829] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-17T20:40:06.358017] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-17T20:40:07.158027] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-17T20:40:07.958059] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-17T20:40:08.652137] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-17T20:40:08.659087] [INFO ] [REMOTE ] NYT: Full fetch complete (72268 records). [2025-10-17T20:40:08.659231] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-17T20:40:09.107049] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-10-17T20:40:09.107411] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-10-17T20:40:09.112499] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-10-17T20:40:09.112662] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-10-17T20:40:09.122936] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T20:40:09.129196] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (3.57 seconds). [2025-10-17T20:40:09.130045] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-17T20:40:09.142587] [DEBUG] [LOCAL ] NYT: Trimmed 72268 records to 50375 (keeping 200 days of data) [2025-10-17T20:40:09.259411] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-17T20:40:09.478003] [DEBUG] [LOCAL ] NYT: Primary data saved (50375 records). [2025-10-17T20:40:09.478140] [INFO ] [MAIN ] NYT: Full history saved. [2025-10-17T20:40:09.478227] [INFO ] [MAIN ] Update Progress: 1567/2368 symbols completed. NYT took 42.4s. Estimated remaining: 1h 52m 30s. Rate: 7.1 symbols/min [2025-10-17T20:40:09.563237] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-17T20:40:09.650599] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:40:09.650772] [DEBUG] [LOCAL ] OC: No existing data file found in primary storage. [2025-10-17T20:40:09.650817] [WARN ] [MAIN ] OC: No existing data found, performing full refresh instead. [2025-10-17T20:40:09.650929] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-17T20:40:09.650970] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-17T20:40:09.651012] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-17T20:40:09.651057] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-17T20:40:10.017787] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:40:10.027403] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-17T20:40:10.357991] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-17T20:40:11.158054] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-17T20:40:11.958037] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-10-17T20:40:12.118148] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-17T20:40:12.188161] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T20:40:12.310736] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T20:40:12.758078] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-17T20:40:13.558007] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-17T20:40:13.704342] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T20:40:13.848979] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T20:40:14.358079] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-17T20:40:15.158083] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-17T20:40:15.951313] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-17T20:40:15.961415] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-17T20:40:16.022705] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T20:40:16.226298] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T20:40:16.758018] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-17T20:40:17.558017] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-17T20:40:17.871248] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T20:40:17.894250] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T20:40:18.358047] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-17T20:40:19.158077] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-17T20:40:19.958008] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-17T20:40:20.009573] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T20:40:20.116008] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T20:40:20.153519] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-17T20:40:20.160834] [INFO ] [REMOTE ] O: Full fetch complete (77572 records). [2025-10-17T20:40:20.160969] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-17T20:40:20.351518] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T20:40:20.352265] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:40:20.352334] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:40:20.352393] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-17T20:40:20.352455] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-17T20:40:20.352490] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-17T20:40:20.352528] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-17T20:40:20.352585] [INFO ] [MAIN ] Update Progress: 1568/2368 symbols completed. O took 44.6s. Estimated remaining: 1h 52m 23s. Rate: 7.1 symbols/min [2025-10-17T20:40:20.521731] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:40:20.531394] [DEBUG] [LOCAL ] OCFT: Loaded 7370 existing records from primary storage. [2025-10-17T20:40:20.531566] [INFO ] [MAIN ] OCFT: Loaded 7370 existing records. [2025-10-17T20:40:20.703113] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:40:20.703328] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-17T20:40:20.703407] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-17T20:40:20.703636] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-10-17T20:40:20.703751] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-17T20:40:20.764334] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-17T20:40:21.048842] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:40:21.558001] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-10-17T20:40:21.806441] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T20:40:21.813861] [INFO ] [REMOTE ] OBDC: Full fetch complete (75350 records). [2025-10-17T20:40:21.814017] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-17T20:40:22.000060] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-17T20:40:22.224393] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-10-17T20:40:22.224499] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-10-17T20:40:22.225593] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-10-17T20:40:22.225680] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-10-17T20:40:22.227120] [DEBUG] [LOCAL ] OBDC: Trimmed 75350 records to 52457 (keeping 200 days of data) [2025-10-17T20:40:22.326731] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T20:40:22.406181] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-17T20:40:22.551376] [DEBUG] [LOCAL ] OBDC: Primary data saved (52457 records). [2025-10-17T20:40:22.551521] [INFO ] [MAIN ] OBDC: Full history saved. [2025-10-17T20:40:22.551594] [INFO ] [MAIN ] Update Progress: 1569/2368 symbols completed. OBDC took 41.9s. Estimated remaining: 1h 52m 11s. Rate: 7.1 symbols/min [2025-10-17T20:40:22.716594] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:40:22.726613] [DEBUG] [LOCAL ] ODC: Loaded 8619 existing records from primary storage. [2025-10-17T20:40:22.726837] [INFO ] [MAIN ] ODC: Loaded 8619 existing records. [2025-10-17T20:40:22.899962] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:40:22.900156] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-17T20:40:22.900202] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-17T20:40:22.900375] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-10-17T20:40:22.900429] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-17T20:40:23.165737] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-17T20:40:23.254778] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:40:23.897938] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T20:40:23.957988] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-17T20:40:24.176573] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T20:40:24.758126] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-10-17T20:40:24.790043] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-17T20:40:25.553528] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-17T20:40:25.557970] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-17T20:40:26.358020] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-17T20:40:26.411885] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-17T20:40:27.158089] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-17T20:40:27.352293] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T20:40:27.355748] [INFO ] [REMOTE ] OBK: Full fetch complete (23976 records). [2025-10-17T20:40:27.355950] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-17T20:40:27.756400] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-10-17T20:40:27.756552] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-10-17T20:40:27.757177] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-10-17T20:40:27.757240] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-10-17T20:40:27.758331] [DEBUG] [LOCAL ] OBK: Trimmed 23976 records to 16702 (keeping 200 days of data) [2025-10-17T20:40:27.857217] [DEBUG] [LOCAL ] OBK: Primary data saved (16702 records). [2025-10-17T20:40:27.857361] [INFO ] [MAIN ] OBK: Full history saved. [2025-10-17T20:40:27.857465] [INFO ] [MAIN ] Update Progress: 1570/2368 symbols completed. OBK took 27.3s. Estimated remaining: 1h 52m 1s. Rate: 7.1 symbols/min [2025-10-17T20:40:27.960540] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-17T20:40:27.961548] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T20:40:28.035875] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:40:28.065437] [DEBUG] [LOCAL ] ODV: Loaded 29311 existing records from primary storage. [2025-10-17T20:40:28.065739] [INFO ] [MAIN ] ODV: Loaded 29311 existing records. [2025-10-17T20:40:28.239932] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:40:28.240150] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-17T20:40:28.240197] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-17T20:40:28.240373] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-10-17T20:40:28.240411] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-17T20:40:28.587083] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:40:28.758034] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-17T20:40:29.558010] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-17T20:40:29.664880] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T20:40:29.860175] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T20:40:30.358010] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-17T20:40:30.678676] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T20:40:31.158076] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-10-17T20:40:31.200567] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-17T20:40:31.958071] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-17T20:40:32.415515] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T20:40:32.758014] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-17T20:40:33.558012] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-17T20:40:33.589684] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T20:40:33.719427] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T20:40:34.358029] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-17T20:40:34.452534] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-17T20:40:35.158011] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-17T20:40:35.241298] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T20:40:35.931602] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-17T20:40:35.957994] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-17T20:40:36.758033] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-17T20:40:36.850307] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T20:40:37.332587] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-17T20:40:37.558040] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-17T20:40:38.358035] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-17T20:40:38.596722] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T20:40:39.158040] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-17T20:40:39.210745] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-17T20:40:39.958040] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-17T20:40:40.763167] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-17T20:40:40.774567] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T20:40:40.809021] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T20:40:41.559810] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-17T20:40:41.562445] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-17T20:40:42.302439] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-17T20:40:42.358023] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-17T20:40:43.158051] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-17T20:40:43.522979] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-17T20:40:43.958048] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-17T20:40:44.138772] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-17T20:40:44.758051] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-17T20:40:45.036731] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T20:40:45.422999] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T20:40:45.558049] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-17T20:40:46.293426] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-17T20:40:46.295199] [INFO ] [REMOTE ] ODC: Full fetch complete (11278 records). [2025-10-17T20:40:46.295269] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-17T20:40:46.363167] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-17T20:40:46.648464] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-10-17T20:40:46.648549] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-10-17T20:40:46.648812] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-10-17T20:40:46.648873] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-10-17T20:40:46.649307] [DEBUG] [LOCAL ] ODC: Trimmed 11278 records to 8687 (keeping 200 days of data) [2025-10-17T20:40:46.701055] [DEBUG] [LOCAL ] ODC: Primary data saved (8687 records). [2025-10-17T20:40:46.701165] [INFO ] [MAIN ] ODC: Full history saved. [2025-10-17T20:40:46.701241] [INFO ] [MAIN ] Update Progress: 1571/2368 symbols completed. ODC took 24.1s. Estimated remaining: 1h 51m 58s. Rate: 7.1 symbols/min [2025-10-17T20:40:46.869881] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:40:46.870064] [DEBUG] [LOCAL ] OEC: No existing data file found in primary storage. [2025-10-17T20:40:46.870156] [WARN ] [MAIN ] OEC: No existing data found, performing full refresh instead. [2025-10-17T20:40:46.870255] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-17T20:40:46.870295] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-17T20:40:46.870354] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-17T20:40:46.870388] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-17T20:40:47.163182] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-17T20:40:47.235444] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:40:47.958067] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-10-17T20:40:48.134617] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T20:40:48.394896] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-17T20:40:48.758029] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-17T20:40:49.514302] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T20:40:49.557984] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-17T20:40:50.372633] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-17T20:40:50.375228] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T20:40:50.466755] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T20:40:51.010099] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-17T20:40:51.158082] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-17T20:40:51.958059] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-17T20:40:52.758091] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-17T20:40:52.840870] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T20:40:53.372987] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T20:40:53.558058] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-17T20:40:54.097181] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T20:40:54.358037] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-17T20:40:55.158004] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-17T20:40:55.273256] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T20:40:55.279841] [INFO ] [REMOTE ] OC: Full fetch complete (64637 records). [2025-10-17T20:40:55.279957] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-17T20:40:55.665155] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-10-17T20:40:55.665276] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-10-17T20:40:55.666304] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-10-17T20:40:55.666380] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-10-17T20:40:55.667838] [DEBUG] [LOCAL ] OC: Trimmed 64637 records to 45614 (keeping 200 days of data) [2025-10-17T20:40:55.733566] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-17T20:40:55.764250] [INFO ] [REMOTE ] OCFT: Full fetch complete (11660 records). [2025-10-17T20:40:55.771816] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-17T20:40:55.920598] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T20:40:55.958296] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-17T20:40:56.294098] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-10-17T20:40:56.295230] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-10-17T20:40:56.295997] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-10-17T20:40:56.296344] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-10-17T20:40:56.301325] [DEBUG] [LOCAL ] OCFT: Trimmed 11660 records to 7392 (keeping 200 days of data) [2025-10-17T20:40:56.346806] [DEBUG] [LOCAL ] OCFT: Primary data saved (7392 records). [2025-10-17T20:40:56.348684] [INFO ] [MAIN ] OCFT: Full history saved. [2025-10-17T20:40:56.349611] [INFO ] [MAIN ] Update Progress: 1572/2368 symbols completed. OCFT took 36.0s. Estimated remaining: 1h 51m 51s. Rate: 7.1 symbols/min [2025-10-17T20:40:56.556867] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:40:56.558551] [DEBUG] [LOCAL ] OFG: No existing data file found in primary storage. [2025-10-17T20:40:56.558868] [WARN ] [MAIN ] OFG: No existing data found, performing full refresh instead. [2025-10-17T20:40:56.562490] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-17T20:40:56.563583] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-17T20:40:56.563707] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-17T20:40:56.563772] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-17T20:40:56.665873] [DEBUG] [LOCAL ] OC: Primary data saved (45614 records). [2025-10-17T20:40:56.665971] [INFO ] [MAIN ] OC: Full history saved. [2025-10-17T20:40:56.666321] [INFO ] [MAIN ] Update Progress: 1573/2368 symbols completed. OC took 47.2s. Estimated remaining: 1h 51m 38s. Rate: 7.1 symbols/min [2025-10-17T20:40:56.773943] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-17T20:40:57.030311] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:40:57.045886] [DEBUG] [LOCAL ] OGE: No existing data file found in primary storage. [2025-10-17T20:40:57.051077] [WARN ] [MAIN ] OGE: No existing data found, performing full refresh instead. [2025-10-17T20:40:57.073529] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-17T20:40:57.088558] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-17T20:40:57.109224] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-17T20:40:57.109172] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:40:57.109357] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-17T20:40:57.454221] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:40:57.557991] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-10-17T20:40:57.656896] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T20:40:57.888998] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T20:40:58.358027] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-17T20:40:59.158011] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-10-17T20:40:59.201206] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T20:40:59.958023] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-17T20:40:59.996271] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T20:41:00.430727] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T20:41:00.758027] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-17T20:41:01.558028] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-17T20:41:01.634683] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T20:41:01.641315] [INFO ] [REMOTE ] ODV: Full fetch complete (35347 records). [2025-10-17T20:41:01.641439] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-17T20:41:02.060465] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-10-17T20:41:02.060670] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-10-17T20:41:02.061511] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-10-17T20:41:02.061786] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-10-17T20:41:02.062857] [DEBUG] [LOCAL ] ODV: Trimmed 35347 records to 29656 (keeping 200 days of data) [2025-10-17T20:41:02.251849] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-17T20:41:02.277893] [DEBUG] [LOCAL ] ODV: Primary data saved (29656 records). [2025-10-17T20:41:02.278044] [INFO ] [MAIN ] ODV: Full history saved. [2025-10-17T20:41:02.278132] [INFO ] [MAIN ] Update Progress: 1574/2368 symbols completed. ODV took 34.4s. Estimated remaining: 1h 51m 28s. Rate: 7.1 symbols/min [2025-10-17T20:41:02.363193] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-17T20:41:02.460928] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:41:02.461085] [DEBUG] [LOCAL ] OGN: No existing data file found in primary storage. [2025-10-17T20:41:02.461123] [WARN ] [MAIN ] OGN: No existing data found, performing full refresh instead. [2025-10-17T20:41:02.461233] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-17T20:41:02.461275] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-17T20:41:02.461315] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-17T20:41:02.461346] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-17T20:41:02.817300] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:41:02.933298] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T20:41:03.158067] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-17T20:41:03.958033] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-17T20:41:04.098376] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T20:41:04.477364] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T20:41:04.758022] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-17T20:41:05.558038] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-10-17T20:41:05.730964] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T20:41:06.093980] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T20:41:06.358065] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-17T20:41:07.157995] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-17T20:41:07.489678] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-17T20:41:07.954679] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T20:41:07.962864] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-17T20:41:08.689161] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T20:41:08.758092] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-17T20:41:09.557997] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-17T20:41:09.823178] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T20:41:10.358067] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-17T20:41:10.613093] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T20:41:10.820826] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-17T20:41:11.158059] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-17T20:41:11.843280] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T20:41:11.958048] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-17T20:41:11.986903] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-17T20:41:12.758072] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-17T20:41:13.558036] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-17T20:41:13.868157] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-17T20:41:13.936543] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T20:41:14.358094] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-17T20:41:14.719745] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T20:41:15.158095] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-17T20:41:15.958061] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-17T20:41:16.124843] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-17T20:41:16.178912] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T20:41:16.184275] [INFO ] [REMOTE ] OEC: Full fetch complete (53422 records). [2025-10-17T20:41:16.184403] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-17T20:41:16.557568] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-10-17T20:41:16.557672] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-10-17T20:41:16.558667] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-10-17T20:41:16.558730] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-10-17T20:41:16.559826] [DEBUG] [LOCAL ] OEC: Trimmed 53422 records to 37875 (keeping 200 days of data) [2025-10-17T20:41:16.759598] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-17T20:41:16.782290] [DEBUG] [LOCAL ] OEC: Primary data saved (37875 records). [2025-10-17T20:41:16.782403] [INFO ] [MAIN ] OEC: Full history saved. [2025-10-17T20:41:16.782475] [INFO ] [MAIN ] Update Progress: 1575/2368 symbols completed. OEC took 30.1s. Estimated remaining: 1h 51m 23s. Rate: 7.1 symbols/min [2025-10-17T20:41:16.947484] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:41:16.947618] [DEBUG] [LOCAL ] OGS: No existing data file found in primary storage. [2025-10-17T20:41:16.947686] [WARN ] [MAIN ] OGS: No existing data found, performing full refresh instead. [2025-10-17T20:41:16.947802] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-17T20:41:16.947843] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-17T20:41:16.947887] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-17T20:41:16.947919] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-17T20:41:17.277781] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-17T20:41:17.360260] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:41:17.558027] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-10-17T20:41:18.358038] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-17T20:41:18.632326] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T20:41:18.924309] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T20:41:19.158090] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-17T20:41:19.958052] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-17T20:41:20.076271] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T20:41:20.275900] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T20:41:20.758081] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-17T20:41:21.381835] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T20:41:21.558065] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-17T20:41:22.033399] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T20:41:22.358066] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-17T20:41:22.667069] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T20:41:23.158145] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-17T20:41:23.958027] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-17T20:41:24.203194] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T20:41:24.704292] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T20:41:24.757991] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-17T20:41:25.558063] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-17T20:41:25.783224] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-17T20:41:26.170730] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T20:41:26.358044] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-17T20:41:27.158103] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-17T20:41:27.269140] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T20:41:27.927259] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T20:41:27.958029] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-17T20:41:28.129970] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-17T20:41:28.134746] [INFO ] [REMOTE ] OFG: Full fetch complete (33766 records). [2025-10-17T20:41:28.134926] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-17T20:41:28.506011] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-10-17T20:41:28.506088] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-10-17T20:41:28.506775] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-10-17T20:41:28.506837] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-10-17T20:41:28.507597] [DEBUG] [LOCAL ] OFG: Trimmed 33766 records to 21171 (keeping 200 days of data) [2025-10-17T20:41:28.634021] [DEBUG] [LOCAL ] OFG: Primary data saved (21171 records). [2025-10-17T20:41:28.634142] [INFO ] [MAIN ] OFG: Full history saved. [2025-10-17T20:41:28.634210] [INFO ] [MAIN ] Update Progress: 1576/2368 symbols completed. OFG took 32.3s. Estimated remaining: 1h 51m 16s. Rate: 7.1 symbols/min [2025-10-17T20:41:28.769490] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-17T20:41:28.800563] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:41:28.800704] [DEBUG] [LOCAL ] OHI: No existing data file found in primary storage. [2025-10-17T20:41:28.800752] [WARN ] [MAIN ] OHI: No existing data found, performing full refresh instead. [2025-10-17T20:41:28.800860] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-17T20:41:28.800904] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-17T20:41:28.800946] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-17T20:41:28.800978] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-17T20:41:29.148673] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:41:29.558030] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-10-17T20:41:29.586632] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T20:41:30.358014] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-17T20:41:30.670096] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T20:41:31.158102] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-17T20:41:31.457346] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T20:41:31.508191] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-17T20:41:31.958131] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-17T20:41:32.728014] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T20:41:32.734040] [INFO ] [REMOTE ] OGE: Full fetch complete (66819 records). [2025-10-17T20:41:32.734157] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-17T20:41:32.770146] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-17T20:41:33.124154] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-10-17T20:41:33.124235] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-10-17T20:41:33.125306] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-10-17T20:41:33.125379] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-10-17T20:41:33.126633] [DEBUG] [LOCAL ] OGE: Trimmed 66819 records to 46620 (keeping 200 days of data) [2025-10-17T20:41:33.420849] [DEBUG] [LOCAL ] OGE: Primary data saved (46620 records). [2025-10-17T20:41:33.421004] [INFO ] [MAIN ] OGE: Full history saved. [2025-10-17T20:41:33.421082] [INFO ] [MAIN ] Update Progress: 1577/2368 symbols completed. OGE took 36.7s. Estimated remaining: 1h 51m 6s. Rate: 7.1 symbols/min [2025-10-17T20:41:33.565515] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-17T20:41:33.591964] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:41:33.592181] [DEBUG] [LOCAL ] OI: No existing data file found in primary storage. [2025-10-17T20:41:33.592225] [WARN ] [MAIN ] OI: No existing data found, performing full refresh instead. [2025-10-17T20:41:33.592363] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-17T20:41:33.592426] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-17T20:41:33.592492] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-17T20:41:33.592538] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-17T20:41:33.957554] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:41:33.988805] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-17T20:41:34.358038] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-17T20:41:34.662450] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-17T20:41:34.905276] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T20:41:35.158015] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-17T20:41:35.958065] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-10-17T20:41:36.187880] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T20:41:36.610342] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T20:41:36.758027] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-17T20:41:37.261563] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T20:41:37.558035] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-17T20:41:38.171110] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T20:41:38.358042] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-17T20:41:39.158016] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-17T20:41:39.335684] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T20:41:39.807226] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T20:41:39.958061] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-17T20:41:40.710414] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T20:41:40.758034] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-17T20:41:40.900788] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T20:41:41.558056] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-17T20:41:42.358100] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-17T20:41:42.470763] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T20:41:42.478586] [INFO ] [REMOTE ] OGN: Full fetch complete (76962 records). [2025-10-17T20:41:42.478831] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-17T20:41:42.866219] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-10-17T20:41:42.866299] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-10-17T20:41:42.867408] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-10-17T20:41:42.867507] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-10-17T20:41:42.868978] [DEBUG] [LOCAL ] OGN: Trimmed 76962 records to 53908 (keeping 200 days of data) [2025-10-17T20:41:43.169237] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-17T20:41:43.194025] [DEBUG] [LOCAL ] OGN: Primary data saved (53908 records). [2025-10-17T20:41:43.194167] [INFO ] [MAIN ] OGN: Full history saved. [2025-10-17T20:41:43.194239] [INFO ] [MAIN ] Update Progress: 1578/2368 symbols completed. OGN took 40.9s. Estimated remaining: 1h 50m 58s. Rate: 7.1 symbols/min [2025-10-17T20:41:43.367413] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:41:43.367725] [DEBUG] [LOCAL ] OIA: No existing data file found in primary storage. [2025-10-17T20:41:43.367826] [WARN ] [MAIN ] OIA: No existing data found, performing full refresh instead. [2025-10-17T20:41:43.367953] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-17T20:41:43.368140] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-17T20:41:43.368260] [DEBUG] [LOCAL ] OIA: No primary data file found to delete. [2025-10-17T20:41:43.368448] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-17T20:41:43.467697] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-17T20:41:43.713440] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T20:41:43.788069] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:41:43.788664] [INFO ] [REMOTE ] OGS: Full fetch complete (47817 records). [2025-10-17T20:41:43.788805] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-17T20:41:43.964183] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-17T20:41:44.163570] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-10-17T20:41:44.163662] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-10-17T20:41:44.164601] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-10-17T20:41:44.164671] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-10-17T20:41:44.165881] [DEBUG] [LOCAL ] OGS: Trimmed 47817 records to 34532 (keeping 200 days of data) [2025-10-17T20:41:44.377810] [DEBUG] [LOCAL ] OGS: Primary data saved (34532 records). [2025-10-17T20:41:44.377958] [INFO ] [MAIN ] OGS: Full history saved. [2025-10-17T20:41:44.378034] [INFO ] [MAIN ] Update Progress: 1579/2368 symbols completed. OGS took 27.6s. Estimated remaining: 1h 50m 46s. Rate: 7.1 symbols/min [2025-10-17T20:41:44.546060] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:41:44.546253] [DEBUG] [LOCAL ] OII: No existing data file found in primary storage. [2025-10-17T20:41:44.546339] [WARN ] [MAIN ] OII: No existing data found, performing full refresh instead. [2025-10-17T20:41:44.546460] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-17T20:41:44.546501] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-17T20:41:44.546541] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-17T20:41:44.546572] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-17T20:41:44.764996] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-10-17T20:41:44.903312] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:41:45.092139] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-17T20:41:45.260539] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T20:41:45.558040] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-17T20:41:45.890503] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T20:41:46.358053] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-17T20:41:47.158083] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-10-17T20:41:47.482057] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T20:41:47.958056] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-17T20:41:48.124930] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T20:41:48.497894] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-17T20:41:48.758065] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-17T20:41:49.565601] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-17T20:41:49.604335] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T20:41:49.605208] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-17T20:41:50.358048] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-17T20:41:51.158043] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-17T20:41:51.209563] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T20:41:51.958067] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-17T20:41:52.259128] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T20:41:52.758013] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-17T20:41:52.937686] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T20:41:53.057833] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T20:41:53.558039] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-17T20:41:54.281220] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T20:41:54.357999] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-17T20:41:55.158039] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-17T20:41:55.541092] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-17T20:41:55.958102] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-17T20:41:56.043341] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T20:41:56.141388] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-17T20:41:56.758020] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-17T20:41:57.557995] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-17T20:41:57.749606] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T20:41:58.341723] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T20:41:58.357983] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-17T20:41:59.157996] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-17T20:41:59.289405] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T20:41:59.958069] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-17T20:42:00.153168] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T20:42:00.758032] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-17T20:42:00.965215] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T20:42:01.204153] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-17T20:42:01.558022] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-17T20:42:02.357998] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-17T20:42:02.414152] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-17T20:42:02.551703] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T20:42:03.158063] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-17T20:42:03.861544] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T20:42:03.958056] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-17T20:42:04.032102] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-17T20:42:04.758026] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-17T20:42:05.558042] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-17T20:42:05.794261] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T20:42:06.358013] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-17T20:42:06.522266] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T20:42:06.547216] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T20:42:07.158096] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-17T20:42:07.809455] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T20:42:07.958041] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-17T20:42:08.758056] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-17T20:42:08.898581] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T20:42:08.905931] [INFO ] [REMOTE ] OHI: Full fetch complete (75335 records). [2025-10-17T20:42:08.906100] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-17T20:42:09.293531] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-10-17T20:42:09.293692] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-10-17T20:42:09.294952] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-10-17T20:42:09.295019] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-10-17T20:42:09.296549] [DEBUG] [LOCAL ] OHI: Trimmed 75335 records to 52674 (keeping 200 days of data) [2025-10-17T20:42:09.577697] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-17T20:42:09.640205] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T20:42:09.664049] [DEBUG] [LOCAL ] OHI: Primary data saved (52674 records). [2025-10-17T20:42:09.664172] [INFO ] [MAIN ] OHI: Full history saved. [2025-10-17T20:42:09.664241] [INFO ] [MAIN ] Update Progress: 1580/2368 symbols completed. OHI took 41.0s. Estimated remaining: 1h 50m 46s. Rate: 7.1 symbols/min [2025-10-17T20:42:09.833065] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:42:09.867224] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-17T20:42:09.893126] [DEBUG] [LOCAL ] OIS: Loaded 40306 existing records from primary storage. [2025-10-17T20:42:09.893625] [INFO ] [MAIN ] OIS: Loaded 40306 existing records. [2025-10-17T20:42:10.085715] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:42:10.086004] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-17T20:42:10.086052] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-17T20:42:10.086366] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-10-17T20:42:10.086423] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-17T20:42:10.358961] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-17T20:42:10.441457] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:42:11.158042] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-17T20:42:11.315977] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T20:42:11.322784] [INFO ] [REMOTE ] OI: Full fetch complete (68302 records). [2025-10-17T20:42:11.322899] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-17T20:42:11.704822] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-10-17T20:42:11.704921] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-10-17T20:42:11.706086] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-10-17T20:42:11.706197] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-10-17T20:42:11.707796] [DEBUG] [LOCAL ] OI: Trimmed 68302 records to 47958 (keeping 200 days of data) [2025-10-17T20:42:11.732870] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T20:42:11.958527] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-17T20:42:12.034990] [DEBUG] [LOCAL ] OI: Primary data saved (47958 records). [2025-10-17T20:42:12.035179] [INFO ] [MAIN ] OI: Full history saved. [2025-10-17T20:42:12.035306] [INFO ] [MAIN ] Update Progress: 1581/2368 symbols completed. OI took 38.6s. Estimated remaining: 1h 50m 35s. Rate: 7.1 symbols/min [2025-10-17T20:42:12.146635] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T20:42:12.224615] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:42:12.224872] [DEBUG] [LOCAL ] OKE: No existing data file found in primary storage. [2025-10-17T20:42:12.224922] [WARN ] [MAIN ] OKE: No existing data found, performing full refresh instead. [2025-10-17T20:42:12.225035] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-17T20:42:12.225076] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-17T20:42:12.225116] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-17T20:42:12.225148] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-17T20:42:12.573195] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:42:12.758031] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-10-17T20:42:13.558049] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-10-17T20:42:13.629558] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T20:42:14.358019] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-17T20:42:14.677182] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T20:42:15.158069] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-17T20:42:15.211905] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T20:42:15.427396] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T20:42:15.433218] [INFO ] [REMOTE ] OII: Full fetch complete (61719 records). [2025-10-17T20:42:15.433350] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-17T20:42:15.824841] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-10-17T20:42:15.824942] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-10-17T20:42:15.825966] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-10-17T20:42:15.826029] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-10-17T20:42:15.827244] [DEBUG] [LOCAL ] OII: Trimmed 61719 records to 42618 (keeping 200 days of data) [2025-10-17T20:42:15.992982] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-17T20:42:16.039123] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-17T20:42:16.044288] [INFO ] [REMOTE ] OIA: Full fetch complete (20213 records). [2025-10-17T20:42:16.044811] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-17T20:42:16.481383] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-10-17T20:42:16.481754] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-10-17T20:42:16.482992] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-10-17T20:42:16.483312] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-10-17T20:42:16.486041] [DEBUG] [LOCAL ] OIA: Trimmed 20213 records to 13271 (keeping 200 days of data) [2025-10-17T20:42:16.565627] [DEBUG] [LOCAL ] OII: Primary data saved (42618 records). [2025-10-17T20:42:16.566623] [INFO ] [MAIN ] OII: Full history saved. [2025-10-17T20:42:16.567309] [INFO ] [MAIN ] Update Progress: 1582/2368 symbols completed. OII took 32.2s. Estimated remaining: 1h 50m 24s. Rate: 7.1 symbols/min [2025-10-17T20:42:16.755734] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:42:16.758035] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-17T20:42:16.760590] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-10-17T20:42:16.762380] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-10-17T20:42:16.765679] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-17T20:42:16.766495] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-17T20:42:16.766883] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-17T20:42:16.767452] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-17T20:42:16.770258] [DEBUG] [LOCAL ] OIA: Primary data saved (13271 records). [2025-10-17T20:42:16.770558] [INFO ] [MAIN ] OIA: Full history saved. [2025-10-17T20:42:16.783881] [INFO ] [MAIN ] Update Progress: 1583/2368 symbols completed. OIA took 33.6s. Estimated remaining: 1h 50m 12s. Rate: 7.1 symbols/min [2025-10-17T20:42:17.147450] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:42:17.183728] [DEBUG] [LOCAL ] OLN: No existing data file found in primary storage. [2025-10-17T20:42:17.215963] [WARN ] [MAIN ] OLN: No existing data found, performing full refresh instead. [2025-10-17T20:42:17.238573] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-17T20:42:17.252475] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-17T20:42:17.254841] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-17T20:42:17.254897] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-17T20:42:17.459098] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:42:17.577433] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-10-17T20:42:17.638476] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T20:42:17.754826] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:42:18.358081] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-17T20:42:18.813901] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-17T20:42:19.158089] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-10-17T20:42:19.858411] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T20:42:19.958017] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-17T20:42:20.052604] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-17T20:42:20.566269] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T20:42:20.758061] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-17T20:42:21.558036] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-17T20:42:21.855062] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-17T20:42:22.358086] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-17T20:42:23.158051] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-17T20:42:23.277815] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T20:42:23.452260] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-10-17T20:42:23.488978] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-17T20:42:23.958023] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-17T20:42:24.758060] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-17T20:42:24.924954] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T20:42:25.558032] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-17T20:42:26.358009] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-17T20:42:26.536692] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T20:42:26.579557] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-10-17T20:42:26.794483] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-17T20:42:27.158034] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-17T20:42:27.958000] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-17T20:42:28.460244] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-17T20:42:28.731984] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T20:42:28.758044] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-17T20:42:29.558044] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-17T20:42:30.167753] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T20:42:30.358010] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-17T20:42:30.864563] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.91 seconds). [2025-10-17T20:42:31.158050] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-17T20:42:31.544233] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T20:42:31.958072] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-17T20:42:32.252359] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T20:42:32.328985] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T20:42:32.758033] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-17T20:42:33.558010] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-17T20:42:34.002242] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-17T20:42:34.242541] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T20:42:34.357990] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-17T20:42:35.158071] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-17T20:42:35.958004] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-17T20:42:36.102575] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T20:42:36.286756] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-10-17T20:42:36.758063] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-17T20:42:36.799764] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T20:42:37.467879] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T20:42:37.558002] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-17T20:42:38.358107] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-17T20:42:38.473635] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T20:42:38.970689] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T20:42:39.158014] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-17T20:42:39.958058] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-17T20:42:40.120623] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T20:42:40.466876] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T20:42:40.472314] [INFO ] [REMOTE ] OIS: Full fetch complete (57208 records). [2025-10-17T20:42:40.472468] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-17T20:42:40.764054] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-17T20:42:40.866895] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-10-17T20:42:40.866980] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-10-17T20:42:40.868030] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-10-17T20:42:40.868097] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-10-17T20:42:40.869410] [DEBUG] [LOCAL ] OIS: Trimmed 57208 records to 40550 (keeping 200 days of data) [2025-10-17T20:42:41.092199] [DEBUG] [LOCAL ] OIS: Primary data saved (40550 records). [2025-10-17T20:42:41.092331] [INFO ] [MAIN ] OIS: Full history saved. [2025-10-17T20:42:41.092407] [INFO ] [MAIN ] Update Progress: 1584/2368 symbols completed. OIS took 31.4s. Estimated remaining: 1h 50m 11s. Rate: 7.1 symbols/min [2025-10-17T20:42:41.257337] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:42:41.269160] [DEBUG] [LOCAL ] OLP: Loaded 10204 existing records from primary storage. [2025-10-17T20:42:41.269399] [INFO ] [MAIN ] OLP: Loaded 10204 existing records. [2025-10-17T20:42:41.446963] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:42:41.447223] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-17T20:42:41.447281] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-17T20:42:41.447516] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-10-17T20:42:41.447573] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-17T20:42:41.563122] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-17T20:42:41.806535] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:42:42.358059] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-10-17T20:42:42.775035] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-17T20:42:43.052125] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (3.09 seconds). [2025-10-17T20:42:43.158043] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-17T20:42:43.590000] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-17T20:42:43.654577] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-17T20:42:43.958046] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-17T20:42:44.758060] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-17T20:42:44.802035] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T20:42:45.558078] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-17T20:42:45.762780] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-17T20:42:46.358010] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-17T20:42:46.526366] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T20:42:46.613597] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T20:42:47.158061] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-17T20:42:47.958043] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-17T20:42:48.088920] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-17T20:42:48.314538] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-17T20:42:48.326812] [INFO ] [REMOTE ] OKE: Full fetch complete (77672 records). [2025-10-17T20:42:48.327015] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-17T20:42:48.722865] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-10-17T20:42:48.722958] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-10-17T20:42:48.724068] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-10-17T20:42:48.724133] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-10-17T20:42:48.725531] [DEBUG] [LOCAL ] OKE: Trimmed 77672 records to 54350 (keeping 200 days of data) [2025-10-17T20:42:48.779068] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-17T20:42:49.058264] [DEBUG] [LOCAL ] OKE: Primary data saved (54350 records). [2025-10-17T20:42:49.058406] [INFO ] [MAIN ] OKE: Full history saved. [2025-10-17T20:42:49.058494] [INFO ] [MAIN ] Update Progress: 1585/2368 symbols completed. OKE took 37.0s. Estimated remaining: 1h 50m 2s. Rate: 7.1 symbols/min [2025-10-17T20:42:49.230357] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:42:49.230533] [DEBUG] [LOCAL ] OMC: No existing data file found in primary storage. [2025-10-17T20:42:49.230601] [WARN ] [MAIN ] OMC: No existing data found, performing full refresh instead. [2025-10-17T20:42:49.230741] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-17T20:42:49.230787] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-17T20:42:49.230830] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-17T20:42:49.230876] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-17T20:42:49.559763] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-17T20:42:49.580797] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:42:50.357991] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-10-17T20:42:50.443781] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-17T20:42:50.850049] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-17T20:42:50.934827] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-10-17T20:42:51.158005] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-17T20:42:51.844540] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-17T20:42:51.958001] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-17T20:42:52.758077] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-17T20:42:53.558052] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-17T20:42:53.838589] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T20:42:54.075516] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.92 seconds). [2025-10-17T20:42:54.172725] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-17T20:42:54.357989] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-17T20:42:54.490533] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T20:42:54.497706] [INFO ] [REMOTE ] OLN: Full fetch complete (74788 records). [2025-10-17T20:42:54.497826] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-17T20:42:54.881933] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-10-17T20:42:54.882040] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-10-17T20:42:54.883170] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-10-17T20:42:54.883254] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-10-17T20:42:54.884727] [DEBUG] [LOCAL ] OLN: Trimmed 74788 records to 52723 (keeping 200 days of data) [2025-10-17T20:42:55.162307] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-17T20:42:55.204194] [DEBUG] [LOCAL ] OLN: Primary data saved (52723 records). [2025-10-17T20:42:55.204326] [INFO ] [MAIN ] OLN: Full history saved. [2025-10-17T20:42:55.204398] [INFO ] [MAIN ] Update Progress: 1586/2368 symbols completed. OLN took 38.4s. Estimated remaining: 1h 49m 53s. Rate: 7.1 symbols/min [2025-10-17T20:42:55.308174] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T20:42:55.397051] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:42:55.397262] [DEBUG] [LOCAL ] OMF: No existing data file found in primary storage. [2025-10-17T20:42:55.397302] [WARN ] [MAIN ] OMF: No existing data found, performing full refresh instead. [2025-10-17T20:42:55.397433] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-17T20:42:55.397561] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-17T20:42:55.397632] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-17T20:42:55.397719] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-17T20:42:55.812294] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:42:55.958091] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-17T20:42:56.758029] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-17T20:42:56.810695] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-17T20:42:57.558033] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-17T20:42:57.804664] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-17T20:42:58.358059] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-10-17T20:42:58.425338] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T20:42:58.500214] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T20:42:59.158027] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-17T20:42:59.819335] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-17T20:42:59.866016] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-17T20:42:59.957985] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-17T20:43:00.757999] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-17T20:43:01.025442] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T20:43:01.027802] [INFO ] [REMOTE ] OLP: Full fetch complete (14265 records). [2025-10-17T20:43:01.027902] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-17T20:43:01.405229] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-10-17T20:43:01.405336] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-10-17T20:43:01.406030] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-10-17T20:43:01.406110] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-10-17T20:43:01.406855] [DEBUG] [LOCAL ] OLP: Trimmed 14265 records to 10256 (keeping 200 days of data) [2025-10-17T20:43:01.470695] [DEBUG] [LOCAL ] OLP: Primary data saved (10256 records). [2025-10-17T20:43:01.470821] [INFO ] [MAIN ] OLP: Full history saved. [2025-10-17T20:43:01.470921] [INFO ] [MAIN ] Update Progress: 1587/2368 symbols completed. OLP took 20.4s. Estimated remaining: 1h 49m 43s. Rate: 7.1 symbols/min [2025-10-17T20:43:01.558958] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-17T20:43:01.644080] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:43:01.644500] [DEBUG] [LOCAL ] OMI: No existing data file found in primary storage. [2025-10-17T20:43:01.644598] [WARN ] [MAIN ] OMI: No existing data found, performing full refresh instead. [2025-10-17T20:43:01.644843] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-17T20:43:01.644926] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-17T20:43:01.645080] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-17T20:43:01.645203] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-17T20:43:01.819354] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-17T20:43:01.899386] [INFO ] [REMOTE ] OKLO: Full fetch complete (77609 records). [2025-10-17T20:43:01.920852] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-17T20:43:01.949762] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T20:43:01.961552] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:43:01.967454] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:43:01.972762] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-17T20:43:01.983168] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-17T20:43:01.988408] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-10-17T20:43:02.000879] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-10-17T20:43:02.019990] [INFO ] [MAIN ] Update Progress: 1588/2368 symbols completed. OKLO took 45.5s. Estimated remaining: 1h 49m 31s. Rate: 7.1 symbols/min [2025-10-17T20:43:02.043929] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:43:02.210718] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:43:02.220398] [DEBUG] [LOCAL ] ONIT: Loaded 7694 existing records from primary storage. [2025-10-17T20:43:02.220579] [INFO ] [MAIN ] ONIT: Loaded 7694 existing records. [2025-10-17T20:43:02.366627] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-17T20:43:02.397505] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:43:02.397762] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-17T20:43:02.397817] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-17T20:43:02.397954] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-10-17T20:43:02.397992] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-17T20:43:02.760030] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:43:03.158018] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-10-17T20:43:03.313844] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T20:43:03.958026] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-10-17T20:43:04.307388] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T20:43:04.389330] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T20:43:04.758071] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-17T20:43:05.539572] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T20:43:05.558000] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-17T20:43:05.615398] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-17T20:43:06.358056] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-17T20:43:07.001333] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T20:43:07.163946] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-17T20:43:07.165919] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T20:43:07.958050] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-10-17T20:43:08.758037] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-17T20:43:08.811928] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T20:43:08.933154] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-17T20:43:09.558024] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-17T20:43:10.358009] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-10-17T20:43:10.827735] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-17T20:43:11.158006] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-17T20:43:11.271370] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-17T20:43:11.308241] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T20:43:11.958028] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-10-17T20:43:12.758021] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-17T20:43:13.016422] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T20:43:13.052284] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T20:43:13.558039] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-17T20:43:14.358051] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-10-17T20:43:15.005889] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-17T20:43:15.090535] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T20:43:15.157998] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-17T20:43:15.210003] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T20:43:15.958030] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-10-17T20:43:16.758086] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-17T20:43:16.879678] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-17T20:43:17.289579] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-17T20:43:17.558034] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-17T20:43:18.358010] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-17T20:43:18.602328] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T20:43:19.158032] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-17T20:43:19.463806] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T20:43:19.945853] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T20:43:19.957977] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-17T20:43:20.726206] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T20:43:20.758006] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-10-17T20:43:21.558013] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-17T20:43:21.582688] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-17T20:43:21.826930] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T20:43:22.358101] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-17T20:43:23.158100] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-17T20:43:23.412593] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T20:43:23.794248] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T20:43:23.958045] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-10-17T20:43:24.736873] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-17T20:43:24.758020] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-10. [2025-10-17T20:43:24.938940] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T20:43:25.556207] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T20:43:25.557678] [INFO ] [REMOTE ] ONIT: Full fetch complete (11070 records). [2025-10-17T20:43:25.557753] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-10-17T20:43:25.563318] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-17T20:43:25.923464] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-10-17T20:43:25.923546] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-10-17T20:43:25.923829] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-10-17T20:43:25.923889] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-10-17T20:43:25.924312] [DEBUG] [LOCAL ] ONIT: Trimmed 11070 records to 7728 (keeping 200 days of data) [2025-10-17T20:43:25.968194] [DEBUG] [LOCAL ] ONIT: Primary data saved (7728 records). [2025-10-17T20:43:25.968313] [INFO ] [MAIN ] ONIT: Full history saved. [2025-10-17T20:43:25.968390] [INFO ] [MAIN ] Update Progress: 1589/2368 symbols completed. ONIT took 23.9s. Estimated remaining: 1h 49m 30s. Rate: 7.1 symbols/min [2025-10-17T20:43:26.140601] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:43:26.176005] [DEBUG] [LOCAL ] ONL: Loaded 29741 existing records from primary storage. [2025-10-17T20:43:26.176327] [INFO ] [MAIN ] ONL: Loaded 29741 existing records. [2025-10-17T20:43:26.382634] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-17T20:43:26.387255] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:43:26.388207] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-17T20:43:26.388296] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-17T20:43:26.388486] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-10-17T20:43:26.388525] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-17T20:43:26.734051] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:43:27.158002] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-10-17T20:43:27.416782] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T20:43:27.424088] [INFO ] [REMOTE ] OMC: Full fetch complete (77216 records). [2025-10-17T20:43:27.424214] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-17T20:43:27.819224] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-10-17T20:43:27.819311] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-10-17T20:43:27.820529] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-10-17T20:43:27.820595] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-10-17T20:43:27.822186] [DEBUG] [LOCAL ] OMC: Trimmed 77216 records to 54070 (keeping 200 days of data) [2025-10-17T20:43:28.001525] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-17T20:43:28.159736] [DEBUG] [LOCAL ] OMC: Primary data saved (54070 records). [2025-10-17T20:43:28.159882] [INFO ] [MAIN ] OMC: Full history saved. [2025-10-17T20:43:28.159957] [INFO ] [MAIN ] Update Progress: 1590/2368 symbols completed. OMC took 39.1s. Estimated remaining: 1h 49m 19s. Rate: 7.1 symbols/min [2025-10-17T20:43:28.337809] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:43:28.338164] [DEBUG] [LOCAL ] ONON: No existing data file found in primary storage. [2025-10-17T20:43:28.338320] [WARN ] [MAIN ] ONON: No existing data found, performing full refresh instead. [2025-10-17T20:43:28.338442] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-17T20:43:28.338490] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-17T20:43:28.352954] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-17T20:43:28.362758] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-17T20:43:28.407524] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-17T20:43:28.734602] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:43:28.757984] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-10-17T20:43:28.783540] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T20:43:29.399555] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T20:43:29.558032] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-17T20:43:30.358048] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-17T20:43:30.829139] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-17T20:43:30.841478] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-17T20:43:31.158085] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-17T20:43:31.958008] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-17T20:43:31.959916] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T20:43:32.758089] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-17T20:43:33.294967] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-17T20:43:33.535906] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T20:43:33.557977] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-17T20:43:33.860073] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T20:43:34.358029] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-17T20:43:35.154988] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T20:43:35.163316] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-17T20:43:35.684509] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T20:43:35.691549] [INFO ] [REMOTE ] OMF: Full fetch complete (67714 records). [2025-10-17T20:43:35.691698] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-17T20:43:35.966873] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-17T20:43:36.069348] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-10-17T20:43:36.069428] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-10-17T20:43:36.070440] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-10-17T20:43:36.070504] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-10-17T20:43:36.071802] [DEBUG] [LOCAL ] OMF: Trimmed 67714 records to 47130 (keeping 200 days of data) [2025-10-17T20:43:36.347627] [DEBUG] [LOCAL ] OMF: Primary data saved (47130 records). [2025-10-17T20:43:36.347822] [INFO ] [MAIN ] OMF: Full history saved. [2025-10-17T20:43:36.347928] [INFO ] [MAIN ] Update Progress: 1591/2368 symbols completed. OMF took 41.1s. Estimated remaining: 1h 49m 10s. Rate: 7.1 symbols/min [2025-10-17T20:43:36.513843] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:43:36.535208] [DEBUG] [LOCAL ] ONTF: Loaded 22800 existing records from primary storage. [2025-10-17T20:43:36.535465] [INFO ] [MAIN ] ONTF: Loaded 22800 existing records. [2025-10-17T20:43:36.712281] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:43:36.712515] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-17T20:43:36.712562] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-17T20:43:36.712766] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-10-17T20:43:36.712828] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-17T20:43:36.767059] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-17T20:43:37.091302] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:43:37.170387] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-17T20:43:37.245680] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T20:43:37.558043] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-17T20:43:38.358066] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-17T20:43:38.614188] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T20:43:39.084616] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T20:43:39.158027] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-17T20:43:39.958064] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-10-17T20:43:40.452939] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-17T20:43:40.582537] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T20:43:40.757997] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-17T20:43:41.234339] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T20:43:41.558031] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-17T20:43:42.358003] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-17T20:43:42.517175] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T20:43:42.551260] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T20:43:43.158063] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-17T20:43:43.861816] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T20:43:43.958023] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-17T20:43:44.191143] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T20:43:44.758063] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-17T20:43:45.557994] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-17T20:43:46.136192] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-17T20:43:46.150787] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T20:43:46.358047] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-17T20:43:47.158008] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-17T20:43:47.186935] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T20:43:47.193582] [INFO ] [REMOTE ] OMI: Full fetch complete (65516 records). [2025-10-17T20:43:47.193719] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-17T20:43:47.584386] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-10-17T20:43:47.584486] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-10-17T20:43:47.585703] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-10-17T20:43:47.585767] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-10-17T20:43:47.587356] [DEBUG] [LOCAL ] OMI: Trimmed 65516 records to 46830 (keeping 200 days of data) [2025-10-17T20:43:47.691072] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-17T20:43:47.890344] [DEBUG] [LOCAL ] OMI: Primary data saved (46830 records). [2025-10-17T20:43:47.890498] [INFO ] [MAIN ] OMI: Full history saved. [2025-10-17T20:43:47.890575] [INFO ] [MAIN ] Update Progress: 1592/2368 symbols completed. OMI took 46.4s. Estimated remaining: 1h 49m 3s. Rate: 7.1 symbols/min [2025-10-17T20:43:47.965243] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-17T20:43:48.085146] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:43:48.085365] [DEBUG] [LOCAL ] ONTO: No existing data file found in primary storage. [2025-10-17T20:43:48.085416] [WARN ] [MAIN ] ONTO: No existing data found, performing full refresh instead. [2025-10-17T20:43:48.085554] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-17T20:43:48.085603] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-17T20:43:48.085687] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-17T20:43:48.085752] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-17T20:43:48.520520] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:43:48.758076] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-17T20:43:49.235484] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-17T20:43:49.271200] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-17T20:43:49.557994] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-17T20:43:49.885122] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T20:43:50.358035] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-17T20:43:51.158020] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-10-17T20:43:51.498701] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T20:43:51.502781] [INFO ] [REMOTE ] ONL: Full fetch complete (42797 records). [2025-10-17T20:43:51.502937] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-17T20:43:51.750110] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-17T20:43:51.957355] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-10-17T20:43:51.957436] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-10-17T20:43:51.958342] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-10-17T20:43:51.958405] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-17T20:43:51.958619] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-10-17T20:43:51.960437] [DEBUG] [LOCAL ] ONL: Trimmed 42797 records to 29936 (keeping 200 days of data) [2025-10-17T20:43:52.134331] [DEBUG] [LOCAL ] ONL: Primary data saved (29936 records). [2025-10-17T20:43:52.134479] [INFO ] [MAIN ] ONL: Full history saved. [2025-10-17T20:43:52.134561] [INFO ] [MAIN ] Update Progress: 1593/2368 symbols completed. ONL took 26.2s. Estimated remaining: 1h 48m 53s. Rate: 7.1 symbols/min [2025-10-17T20:43:52.304297] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:43:52.304464] [DEBUG] [LOCAL ] OOMA: No existing data file found in primary storage. [2025-10-17T20:43:52.304502] [WARN ] [MAIN ] OOMA: No existing data found, performing full refresh instead. [2025-10-17T20:43:52.304628] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-17T20:43:52.304706] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-17T20:43:52.304759] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-17T20:43:52.304796] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-17T20:43:52.667300] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:43:52.695445] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T20:43:52.715766] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T20:43:52.757990] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-17T20:43:53.558034] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-10-17T20:43:54.358014] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-17T20:43:54.467380] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T20:43:54.736971] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T20:43:55.158076] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-17T20:43:55.958077] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-17T20:43:56.298856] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-17T20:43:56.758020] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-17T20:43:56.877640] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-17T20:43:56.949042] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T20:43:57.558018] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-17T20:43:57.626728] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-17T20:43:58.358085] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-17T20:43:59.158059] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-17T20:43:59.830217] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-17T20:43:59.902414] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T20:43:59.958002] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-17T20:44:00.389523] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T20:44:00.758040] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-17T20:44:00.982127] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-17T20:44:01.558021] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-17T20:44:02.358055] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-17T20:44:02.654298] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T20:44:02.860012] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T20:44:03.158011] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-17T20:44:03.958037] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-17T20:44:04.424011] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T20:44:04.507604] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-17T20:44:04.758001] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-17T20:44:05.076061] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T20:44:05.558013] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-17T20:44:05.863329] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T20:44:06.358025] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-17T20:44:06.838931] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-17T20:44:07.158040] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-17T20:44:07.958042] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-17T20:44:08.241514] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T20:44:08.245576] [INFO ] [REMOTE ] ONTF: Full fetch complete (31594 records). [2025-10-17T20:44:08.245735] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-17T20:44:08.505365] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-17T20:44:08.569702] [INFO ] [REMOTE ] ONON: Full fetch complete (77768 records). [2025-10-17T20:44:08.569879] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-17T20:44:08.768586] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-10-17T20:44:08.768324] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-17T20:44:08.798179] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-10-17T20:44:08.817904] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-10-17T20:44:08.850116] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-10-17T20:44:08.971913] [DEBUG] [LOCAL ] ONTF: Trimmed 31594 records to 22973 (keeping 200 days of data) [2025-10-17T20:44:09.158508] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-10-17T20:44:09.159089] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-10-17T20:44:09.162954] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-10-17T20:44:09.163398] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-10-17T20:44:09.181828] [DEBUG] [LOCAL ] ONON: Trimmed 77768 records to 54394 (keeping 200 days of data) [2025-10-17T20:44:09.307906] [DEBUG] [LOCAL ] ONTF: Primary data saved (22973 records). [2025-10-17T20:44:09.312933] [INFO ] [MAIN ] ONTF: Full history saved. [2025-10-17T20:44:09.320627] [INFO ] [MAIN ] Update Progress: 1594/2368 symbols completed. ONTF took 33.0s. Estimated remaining: 1h 48m 49s. Rate: 7.1 symbols/min [2025-10-17T20:44:09.528396] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:44:09.666344] [DEBUG] [LOCAL ] OPAD: Loaded 25408 existing records from primary storage. [2025-10-17T20:44:09.671835] [INFO ] [MAIN ] OPAD: Loaded 25408 existing records. [2025-10-17T20:44:09.940314] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:44:09.960001] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-17T20:44:09.980777] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-17T20:44:09.985520] [DEBUG] [LOCAL ] ONON: Primary data saved (54394 records). [2025-10-17T20:44:09.985633] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-10-17T20:44:09.985811] [INFO ] [MAIN ] ONON: Full history saved. [2025-10-17T20:44:09.989992] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-17T20:44:09.995266] [INFO ] [MAIN ] Update Progress: 1595/2368 symbols completed. ONON took 41.8s. Estimated remaining: 1h 48m 36s. Rate: 7.1 symbols/min [2025-10-17T20:44:10.083930] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-17T20:44:10.073959] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T20:44:10.173815] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-17T20:44:10.376257] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-17T20:44:10.423935] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:44:10.434891] [DEBUG] [LOCAL ] OPFI: No existing data file found in primary storage. [2025-10-17T20:44:10.446629] [WARN ] [MAIN ] OPFI: No existing data found, performing full refresh instead. [2025-10-17T20:44:10.487773] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-17T20:44:10.493456] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-17T20:44:10.493791] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-17T20:44:10.500588] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-17T20:44:10.726164] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:44:10.971171] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:44:11.158044] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-10-17T20:44:11.457459] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-17T20:44:11.943279] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-17T20:44:11.958018] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-17T20:44:12.346498] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T20:44:12.758043] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-10-17T20:44:12.788029] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T20:44:13.558038] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-17T20:44:14.336403] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T20:44:14.358015] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-17T20:44:14.402982] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T20:44:15.158034] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-17T20:44:15.958063] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-17T20:44:16.207283] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T20:44:16.210447] [INFO ] [REMOTE ] OOMA: Full fetch complete (25834 records). [2025-10-17T20:44:16.210545] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-17T20:44:16.625343] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-10-17T20:44:16.625608] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-10-17T20:44:16.626279] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-10-17T20:44:16.626389] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-10-17T20:44:16.627684] [DEBUG] [LOCAL ] OOMA: Trimmed 25834 records to 18820 (keeping 200 days of data) [2025-10-17T20:44:16.738567] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T20:44:16.738015] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-17T20:44:16.758025] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-17T20:44:16.782871] [DEBUG] [LOCAL ] OOMA: Primary data saved (18820 records). [2025-10-17T20:44:16.783037] [INFO ] [MAIN ] OOMA: Full history saved. [2025-10-17T20:44:16.783119] [INFO ] [MAIN ] Update Progress: 1596/2368 symbols completed. OOMA took 24.6s. Estimated remaining: 1h 48m 27s. Rate: 7.1 symbols/min [2025-10-17T20:44:16.960248] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:44:16.974560] [DEBUG] [LOCAL ] OPP: Loaded 12432 existing records from primary storage. [2025-10-17T20:44:16.974837] [INFO ] [MAIN ] OPP: Loaded 12432 existing records. [2025-10-17T20:44:17.180290] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:44:17.180550] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-17T20:44:17.180599] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-17T20:44:17.180786] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-10-17T20:44:17.180842] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-17T20:44:17.561714] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-17T20:44:17.564890] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:44:18.211998] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-17T20:44:18.358012] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-17T20:44:18.461100] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T20:44:19.158055] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-10-17T20:44:19.958051] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-17T20:44:20.480132] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-17T20:44:20.571617] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T20:44:20.758053] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-17T20:44:21.503250] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-17T20:44:21.558049] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-17T20:44:21.759434] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T20:44:22.323911] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-17T20:44:22.358119] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-17T20:44:23.158063] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-17T20:44:23.958009] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-17T20:44:24.012863] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-17T20:44:24.180790] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T20:44:24.758032] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-17T20:44:25.558041] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-17T20:44:25.710208] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T20:44:25.771317] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T20:44:26.245691] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T20:44:26.358074] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-17T20:44:27.158093] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-17T20:44:27.958007] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-17T20:44:28.155295] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T20:44:28.758019] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-17T20:44:28.812863] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T20:44:28.887267] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T20:44:29.558035] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-17T20:44:30.363710] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-17T20:44:30.377218] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T20:44:30.384465] [INFO ] [REMOTE ] ONTO: Full fetch complete (67207 records). [2025-10-17T20:44:30.384638] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-17T20:44:30.792109] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-10-17T20:44:30.792193] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-10-17T20:44:30.793259] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-10-17T20:44:30.793323] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-10-17T20:44:30.794662] [DEBUG] [LOCAL ] ONTO: Trimmed 67207 records to 47950 (keeping 200 days of data) [2025-10-17T20:44:31.084541] [DEBUG] [LOCAL ] ONTO: Primary data saved (47950 records). [2025-10-17T20:44:31.084716] [INFO ] [MAIN ] ONTO: Full history saved. [2025-10-17T20:44:31.084807] [INFO ] [MAIN ] Update Progress: 1597/2368 symbols completed. ONTO took 43.2s. Estimated remaining: 1h 48m 22s. Rate: 7.1 symbols/min [2025-10-17T20:44:31.158039] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-17T20:44:31.309443] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-17T20:44:31.407782] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T20:44:31.957999] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-17T20:44:32.118686] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T20:44:32.758124] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-17T20:44:33.558049] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-17T20:44:33.762119] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T20:44:33.773235] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T20:44:34.358087] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-17T20:44:35.009678] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T20:44:35.158076] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-17T20:44:35.958042] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-17T20:44:36.080356] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T20:44:36.758014] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-17T20:44:36.829053] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-17T20:44:37.011481] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T20:44:37.558044] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-17T20:44:38.358070] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-17T20:44:38.401829] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-17T20:44:38.628625] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T20:44:39.158070] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-17T20:44:39.958015] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-17T20:44:40.876068] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-17T20:44:40.894317] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-17T20:44:40.982010] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T20:44:41.011870] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T20:44:41.558049] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-17T20:44:42.358029] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-17T20:44:42.401388] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T20:44:43.011140] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-17T20:44:43.017764] [INFO ] [REMOTE ] OPAD: Full fetch complete (28167 records). [2025-10-17T20:44:43.017909] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-17T20:44:43.165433] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-17T20:44:43.386153] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-10-17T20:44:43.386271] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-10-17T20:44:43.386891] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-10-17T20:44:43.386953] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-10-17T20:44:43.387797] [DEBUG] [LOCAL ] OPAD: Trimmed 28167 records to 25646 (keeping 200 days of data) [2025-10-17T20:44:43.532447] [DEBUG] [LOCAL ] OPAD: Primary data saved (25646 records). [2025-10-17T20:44:43.532594] [INFO ] [MAIN ] OPAD: Full history saved. [2025-10-17T20:44:43.532698] [INFO ] [MAIN ] Update Progress: 1598/2368 symbols completed. OPAD took 34.2s. Estimated remaining: 1h 48m 15s. Rate: 7.1 symbols/min [2025-10-17T20:44:44.028318] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T20:44:44.034858] [INFO ] [REMOTE ] OPFI: Full fetch complete (68763 records). [2025-10-17T20:44:44.035030] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-17T20:44:44.333299] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T20:44:44.368444] [INFO ] [REMOTE ] OPP: Full fetch complete (17537 records). [2025-10-17T20:44:44.379150] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-17T20:44:44.570069] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-10-17T20:44:44.570490] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-10-17T20:44:44.577132] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-10-17T20:44:44.582345] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-10-17T20:44:44.699476] [DEBUG] [LOCAL ] OPFI: Trimmed 68763 records to 46886 (keeping 200 days of data) [2025-10-17T20:44:44.958051] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-17T20:44:44.958159] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-17T20:44:44.958715] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-17T20:44:44.958787] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-17T20:44:45.039869] [DEBUG] [LOCAL ] OPP: Trimmed 17537 records to 12536 (keeping 200 days of data) [2025-10-17T20:44:45.191054] [DEBUG] [LOCAL ] OPP: Primary data saved (12536 records). [2025-10-17T20:44:45.190920] [DEBUG] [LOCAL ] OPFI: Primary data saved (46886 records). [2025-10-17T20:44:45.191315] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-17T20:44:45.191436] [INFO ] [MAIN ] OPFI: Full history saved. [2025-10-17T20:44:45.191563] [INFO ] [MAIN ] Update Progress: 1599/2368 symbols completed. OPFI took 35.2s. Estimated remaining: 1h 48m 3s. Rate: 7.1 symbols/min [2025-10-17T20:44:45.191894] [INFO ] [MAIN ] Update Progress: 1600/2368 symbols completed. OPP took 28.4s. Estimated remaining: 1h 47m 51s. Rate: 7.1 symbols/min [2025-10-17T20:44:45.841217] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:44:45.930049] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:44:45.936027] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-17T20:44:45.926475] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:44:45.937186] [DEBUG] [LOCAL ] OR: No existing data file found in primary storage. [2025-10-17T20:44:45.955058] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:44:45.936376] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-17T20:44:45.955801] [DEBUG] [LOCAL ] ORA: No existing data file found in primary storage. [2025-10-17T20:44:45.955961] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-17T20:44:45.956252] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-17T20:44:45.956078] [WARN ] [MAIN ] ORA: No existing data found, performing full refresh instead. [2025-10-17T20:44:45.956580] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-17T20:44:45.955690] [WARN ] [MAIN ] OR: No existing data found, performing full refresh instead. [2025-10-17T20:44:45.956880] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-17T20:44:45.957057] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-17T20:44:45.962387] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-17T20:44:45.970836] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-17T20:44:45.976112] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-17T20:44:45.970730] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-17T20:44:46.015443] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-17T20:44:46.072891] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-17T20:44:46.131601] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-17T20:44:46.622488] [DEBUG] [LOCAL ] ORC: Loaded 52895 existing records from primary storage. [2025-10-17T20:44:46.686944] [INFO ] [MAIN ] ORC: Loaded 52895 existing records. [2025-10-17T20:44:47.294800] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:44:47.289800] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:44:47.317757] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-10-17T20:44:47.318045] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-10-17T20:44:47.322239] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:44:47.331994] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-10-17T20:44:47.413145] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:44:47.413367] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-17T20:44:47.413426] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-17T20:44:47.413849] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-10-17T20:44:47.413925] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-17T20:44:47.756127] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:44:47.756447] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-10-17T20:44:48.129715] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T20:44:48.131796] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-17T20:44:48.982030] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T20:44:48.990253] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-17T20:44:48.995105] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-17T20:44:48.996797] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-17T20:44:49.019387] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T20:44:49.557996] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-17T20:44:49.853510] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T20:44:49.884340] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-17T20:44:50.136376] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T20:44:50.358041] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-17T20:44:51.122167] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-17T20:44:51.164583] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-17T20:44:51.182324] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T20:44:51.958025] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-17T20:44:52.722121] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T20:44:52.757986] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-17T20:44:53.512204] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T20:44:53.557998] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-17T20:44:54.358022] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-17T20:44:54.445932] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T20:44:55.021724] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T20:44:55.158060] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-17T20:44:55.958071] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-17T20:44:56.241089] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T20:44:56.694742] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T20:44:56.758001] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-17T20:44:56.830239] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-17T20:44:57.558033] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-17T20:44:58.268909] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T20:44:58.358039] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-17T20:44:59.158027] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-17T20:44:59.317616] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T20:44:59.879073] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T20:44:59.958033] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-17T20:44:59.998155] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T20:45:00.758039] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-17T20:45:01.558053] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-17T20:45:02.063526] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T20:45:02.335880] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-17T20:45:02.357998] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-17T20:45:03.158062] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-17T20:45:03.376270] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T20:45:03.958029] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-17T20:45:04.602024] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-17T20:45:04.645284] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T20:45:04.758002] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-17T20:45:05.240269] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T20:45:05.558046] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-17T20:45:06.358031] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-17T20:45:06.385248] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T20:45:07.158089] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-17T20:45:07.319572] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T20:45:07.958030] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-17T20:45:08.545760] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-17T20:45:08.750404] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T20:45:08.758265] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-17T20:45:09.558025] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-17T20:45:09.641327] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T20:45:09.672635] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T20:45:10.358045] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-17T20:45:11.158076] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-17T20:45:11.669344] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-17T20:45:11.900321] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T20:45:11.958038] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-17T20:45:12.020672] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-17T20:45:12.758042] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-17T20:45:13.558065] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-17T20:45:13.587540] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T20:45:13.892054] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T20:45:14.358111] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-17T20:45:15.158083] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-17T20:45:15.382531] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T20:45:15.389693] [INFO ] [REMOTE ] OR: Full fetch complete (66638 records). [2025-10-17T20:45:15.389875] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-17T20:45:15.787713] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-10-17T20:45:15.787848] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-10-17T20:45:15.789240] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-10-17T20:45:15.789355] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-10-17T20:45:15.790961] [DEBUG] [LOCAL ] OR: Trimmed 66638 records to 47473 (keeping 200 days of data) [2025-10-17T20:45:15.973082] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-17T20:45:15.994502] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T20:45:16.026764] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T20:45:16.040489] [INFO ] [REMOTE ] OPY: Full fetch complete (10184 records). [2025-10-17T20:45:16.040670] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-17T20:45:16.042240] [INFO ] [REMOTE ] ORA: Full fetch complete (49076 records). [2025-10-17T20:45:16.086718] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-17T20:45:16.339968] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T20:45:16.345723] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:45:16.386803] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:45:16.398463] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-17T20:45:16.425063] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-17T20:45:16.440261] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-17T20:45:16.473445] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-17T20:45:16.479025] [INFO ] [MAIN ] Update Progress: 1601/2368 symbols completed. OPY took 31.3s. Estimated remaining: 1h 47m 54s. Rate: 7.1 symbols/min [2025-10-17T20:45:16.757235] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-10-17T20:45:16.787802] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-10-17T20:45:16.865851] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:45:16.822633] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-10-17T20:45:16.867205] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-17T20:45:16.870680] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-17T20:45:16.871353] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-17T20:45:16.871264] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-10-17T20:45:16.871668] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-17T20:45:16.878290] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-17T20:45:16.878932] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-17T20:45:16.880003] [DEBUG] [LOCAL ] ORA: Trimmed 49076 records to 33548 (keeping 200 days of data) [2025-10-17T20:45:16.993627] [DEBUG] [LOCAL ] OR: Primary data saved (47473 records). [2025-10-17T20:45:17.055255] [INFO ] [MAIN ] OR: Full history saved. [2025-10-17T20:45:17.060569] [INFO ] [MAIN ] Update Progress: 1602/2368 symbols completed. OR took 31.9s. Estimated remaining: 1h 47m 41s. Rate: 7.1 symbols/min [2025-10-17T20:45:17.398743] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:45:17.420138] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-17T20:45:17.420228] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-17T20:45:17.426150] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-17T20:45:17.432790] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-17T20:45:17.466087] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-17T20:45:17.471825] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-17T20:45:17.689838] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:45:17.715394] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-10-17T20:45:18.045575] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:45:18.048573] [DEBUG] [LOCAL ] ORA: Primary data saved (33548 records). [2025-10-17T20:45:18.048743] [INFO ] [MAIN ] ORA: Full history saved. [2025-10-17T20:45:18.048841] [INFO ] [MAIN ] Update Progress: 1603/2368 symbols completed. ORA took 32.8s. Estimated remaining: 1h 47m 29s. Rate: 7.1 symbols/min [2025-10-17T20:45:18.060108] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-10-17T20:45:18.227579] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:45:18.257347] [DEBUG] [LOCAL ] ORN: Loaded 31147 existing records from primary storage. [2025-10-17T20:45:18.257843] [INFO ] [MAIN ] ORN: Loaded 31147 existing records. [2025-10-17T20:45:18.471353] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:45:18.473043] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-17T20:45:18.483952] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-17T20:45:18.484355] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-17T20:45:18.484870] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-10-17T20:45:18.484822] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-17T20:45:18.485023] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-17T20:45:18.835102] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:45:19.158087] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-10-17T20:45:19.914631] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T20:45:19.958029] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-17T20:45:20.043117] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-17T20:45:20.431289] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-10-17T20:45:20.665734] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-17T20:45:20.758006] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-17T20:45:21.372195] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T20:45:21.558017] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-17T20:45:22.172534] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T20:45:22.358041] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-17T20:45:23.158062] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-17T20:45:23.265801] [DEBUG] [REMOTE ] ORC: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-17T20:45:23.266130] [WARN ] [REMOTE ] ORC: No data returned for month 2025-09 [2025-10-17T20:45:23.266219] [FATAL] [REMOTE ] ORC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:45:23.266301] [FATAL] [MAIN ] ORC: Failed to fetch primary data. [2025-10-17T20:45:23.266362] [WARN ] [MAIN ] ORC: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:45:23.266436] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-17T20:45:23.266499] [DEBUG] [LOCAL ] ORC: No primary data file found to delete. [2025-10-17T20:45:23.266535] [INFO ] [LOCAL ] ORC: Starting deletion of derivative data. [2025-10-17T20:45:23.266689] [DEBUG] [LOCAL ] ORC: Deleted derivative data file. [2025-10-17T20:45:23.266787] [INFO ] [MAIN ] Update Progress: 1604/2368 symbols completed. ORC took 38.1s. Estimated remaining: 1h 47m 19s. Rate: 7.1 symbols/min [2025-10-17T20:45:23.436764] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:45:23.436927] [DEBUG] [LOCAL ] OSCR: No existing data file found in primary storage. [2025-10-17T20:45:23.436965] [WARN ] [MAIN ] OSCR: No existing data found, performing full refresh instead. [2025-10-17T20:45:23.437077] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-17T20:45:23.437117] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-17T20:45:23.437158] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-17T20:45:23.437191] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-17T20:45:23.806537] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:45:23.807882] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T20:45:23.957992] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-10-17T20:45:24.016624] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-17T20:45:24.758019] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-17T20:45:25.558043] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-17T20:45:25.996347] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-17T20:45:26.065808] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T20:45:26.358043] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-17T20:45:26.838892] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T20:45:27.158045] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-17T20:45:27.958020] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-17T20:45:28.140953] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T20:45:28.453350] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T20:45:28.758037] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-17T20:45:29.558038] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-17T20:45:29.617756] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T20:45:30.271926] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T20:45:30.358039] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-17T20:45:31.158024] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-17T20:45:31.586369] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-17T20:45:31.958085] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-17T20:45:32.083244] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-17T20:45:32.758023] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-17T20:45:32.954673] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T20:45:33.017984] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T20:45:33.558049] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-17T20:45:34.358053] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-17T20:45:34.957755] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-17T20:45:35.036556] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T20:45:35.158058] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-17T20:45:35.958044] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-17T20:45:36.758008] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-17T20:45:36.913309] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T20:45:36.979318] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-17T20:45:37.557985] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-17T20:45:38.080861] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-17T20:45:38.125750] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T20:45:38.358043] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-17T20:45:39.158033] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-17T20:45:39.958081] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-17T20:45:40.356295] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.80 seconds). [2025-10-17T20:45:40.457370] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T20:45:40.461529] [INFO ] [REMOTE ] ORN: Full fetch complete (45614 records). [2025-10-17T20:45:40.461626] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-17T20:45:40.760022] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-17T20:45:40.793512] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-17T20:45:40.895456] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-10-17T20:45:40.895541] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-10-17T20:45:40.896415] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-10-17T20:45:40.896478] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-10-17T20:45:40.897467] [DEBUG] [LOCAL ] ORN: Trimmed 45614 records to 31321 (keeping 200 days of data) [2025-10-17T20:45:41.065719] [DEBUG] [LOCAL ] ORN: Primary data saved (31321 records). [2025-10-17T20:45:41.065850] [INFO ] [MAIN ] ORN: Full history saved. [2025-10-17T20:45:41.066503] [INFO ] [MAIN ] Update Progress: 1605/2368 symbols completed. ORN took 23.0s. Estimated remaining: 1h 47m 15s. Rate: 7.1 symbols/min [2025-10-17T20:45:41.233291] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:45:41.233468] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-17T20:45:41.233505] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-17T20:45:41.233612] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-17T20:45:41.233681] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-17T20:45:41.233741] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-17T20:45:41.233775] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-17T20:45:41.558031] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-17T20:45:41.621975] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:45:41.650394] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T20:45:42.358047] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-17T20:45:43.158014] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-10-17T20:45:43.407223] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-17T20:45:43.958819] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-17T20:45:43.958903] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-17T20:45:44.171471] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T20:45:44.646723] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-17T20:45:44.758049] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-17T20:45:45.558066] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-17T20:45:46.202954] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T20:45:46.358034] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-17T20:45:46.626400] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-10-17T20:45:47.158088] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-17T20:45:47.914700] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T20:45:47.957992] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-17T20:45:48.365190] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-10-17T20:45:48.758005] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-17T20:45:48.850852] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T20:45:49.558011] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-17T20:45:49.765290] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T20:45:50.358178] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-17T20:45:51.158069] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-17T20:45:51.296779] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T20:45:51.789899] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (3.03 seconds). [2025-10-17T20:45:51.958018] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-17T20:45:52.758074] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-17T20:45:52.885527] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T20:45:53.327588] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T20:45:53.334417] [INFO ] [REMOTE ] ORI: Full fetch complete (70544 records). [2025-10-17T20:45:53.334535] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-17T20:45:53.529401] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T20:45:53.530282] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:45:53.530356] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:45:53.530430] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-17T20:45:53.530533] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-17T20:45:53.530579] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-17T20:45:53.530621] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-17T20:45:53.530721] [INFO ] [MAIN ] Update Progress: 1606/2368 symbols completed. ORI took 36.5s. Estimated remaining: 1h 47m 9s. Rate: 7.1 symbols/min [2025-10-17T20:45:53.566701] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-17T20:45:53.682015] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (3.32 seconds). [2025-10-17T20:45:53.760169] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:45:53.760361] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-17T20:45:53.760399] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-17T20:45:53.760520] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-17T20:45:53.760562] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-17T20:45:53.760602] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-17T20:45:53.760634] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-17T20:45:54.119199] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:45:54.358058] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-17T20:45:55.158091] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-10-17T20:45:55.345031] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T20:45:55.450199] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T20:45:55.450483] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-10-17T20:45:55.450575] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:45:55.450684] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-17T20:45:55.450762] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:45:55.450849] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-17T20:45:55.450932] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-17T20:45:55.450984] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-17T20:45:55.451051] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-17T20:45:55.451128] [INFO ] [MAIN ] Update Progress: 1607/2368 symbols completed. OTF took 1.9s. Estimated remaining: 1h 46m 57s. Rate: 7.1 symbols/min [2025-10-17T20:45:55.595898] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-10-17T20:45:55.676060] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:45:55.676229] [DEBUG] [LOCAL ] OTIS: No existing data file found in primary storage. [2025-10-17T20:45:55.676266] [WARN ] [MAIN ] OTIS: No existing data found, performing full refresh instead. [2025-10-17T20:45:55.676385] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-17T20:45:55.676426] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-17T20:45:55.676465] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-17T20:45:55.676496] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-17T20:45:55.963190] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-17T20:45:56.028283] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:45:56.758037] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-17T20:45:56.990805] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-17T20:45:57.558006] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-17T20:45:57.606485] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T20:45:58.358044] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-10-17T20:45:59.158004] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-17T20:45:59.594199] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-10-17T20:45:59.685822] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T20:45:59.958099] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-17T20:46:00.158838] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-17T20:46:00.757996] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-17T20:46:01.114490] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T20:46:01.122420] [INFO ] [REMOTE ] ORCL: Full fetch complete (77213 records). [2025-10-17T20:46:01.122721] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-17T20:46:01.123925] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T20:46:01.124037] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:46:01.124133] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:46:01.124450] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-17T20:46:01.124565] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-17T20:46:01.124753] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-17T20:46:01.124878] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-17T20:46:01.124964] [INFO ] [MAIN ] Update Progress: 1608/2368 symbols completed. ORCL took 44.6s. Estimated remaining: 1h 46m 48s. Rate: 7.1 symbols/min [2025-10-17T20:46:01.305407] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:46:01.305626] [DEBUG] [LOCAL ] OUT: No existing data file found in primary storage. [2025-10-17T20:46:01.305753] [WARN ] [MAIN ] OUT: No existing data found, performing full refresh instead. [2025-10-17T20:46:01.305929] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-17T20:46:01.306066] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-17T20:46:01.306138] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-17T20:46:01.306190] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-17T20:46:01.405932] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-17T20:46:01.563121] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-17T20:46:01.694746] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:46:02.358051] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-17T20:46:03.158013] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-10-17T20:46:03.195877] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T20:46:03.621860] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (2.86 seconds). [2025-10-17T20:46:03.629242] [INFO ] [REMOTE ] OSCR: Full fetch complete (77729 records). [2025-10-17T20:46:03.629360] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-17T20:46:03.986449] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-17T20:46:04.065490] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T20:46:04.063805] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-10-17T20:46:04.065732] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-10-17T20:46:04.077222] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-10-17T20:46:04.077621] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-10-17T20:46:04.079011] [DEBUG] [LOCAL ] OSCR: Trimmed 77729 records to 54539 (keeping 200 days of data) [2025-10-17T20:46:04.409609] [DEBUG] [LOCAL ] OSCR: Primary data saved (54539 records). [2025-10-17T20:46:04.409908] [INFO ] [MAIN ] OSCR: Full history saved. [2025-10-17T20:46:04.410008] [INFO ] [MAIN ] Update Progress: 1609/2368 symbols completed. OSCR took 41.1s. Estimated remaining: 1h 46m 37s. Rate: 7.1 symbols/min [2025-10-17T20:46:04.579246] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:46:04.579404] [DEBUG] [LOCAL ] OVV: No existing data file found in primary storage. [2025-10-17T20:46:04.579440] [WARN ] [MAIN ] OVV: No existing data found, performing full refresh instead. [2025-10-17T20:46:04.579549] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-17T20:46:04.579630] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-17T20:46:04.579718] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-17T20:46:04.579759] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-17T20:46:04.762598] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-17T20:46:04.976542] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:46:04.978956] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T20:46:05.558002] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-10-17T20:46:05.674858] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T20:46:06.358055] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-17T20:46:06.619427] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-17T20:46:07.158052] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-17T20:46:07.485113] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-17T20:46:07.958052] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-17T20:46:08.162519] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T20:46:08.730822] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T20:46:08.736833] [INFO ] [REMOTE ] OSK: Full fetch complete (61274 records). [2025-10-17T20:46:08.736942] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-17T20:46:08.767550] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-17T20:46:08.926934] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T20:46:08.927583] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:46:08.927679] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:46:08.927746] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-17T20:46:08.927805] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-17T20:46:08.927842] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-17T20:46:08.927881] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-17T20:46:08.927938] [INFO ] [MAIN ] Update Progress: 1610/2368 symbols completed. OSK took 27.9s. Estimated remaining: 1h 46m 27s. Rate: 7.1 symbols/min [2025-10-17T20:46:09.092819] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:46:09.093030] [DEBUG] [LOCAL ] OWL: No existing data file found in primary storage. [2025-10-17T20:46:09.093079] [WARN ] [MAIN ] OWL: No existing data found, performing full refresh instead. [2025-10-17T20:46:09.093199] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-17T20:46:09.093239] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-17T20:46:09.093280] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-17T20:46:09.093311] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-17T20:46:09.441390] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:46:09.558026] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-10-17T20:46:09.677237] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T20:46:10.358022] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-17T20:46:10.589710] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T20:46:11.158040] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-17T20:46:11.439098] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T20:46:11.831702] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T20:46:11.958037] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-17T20:46:12.758018] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-17T20:46:12.805575] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T20:46:13.558007] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-17T20:46:13.832611] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T20:46:14.358068] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-17T20:46:14.669784] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T20:46:15.158051] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-17T20:46:15.556532] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-17T20:46:15.958014] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-17T20:46:16.122331] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T20:46:16.758045] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-17T20:46:17.116450] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T20:46:17.558014] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-17T20:46:17.868826] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T20:46:18.358072] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-17T20:46:18.585686] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T20:46:19.043847] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T20:46:19.158022] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-17T20:46:19.958052] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-17T20:46:20.261114] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-17T20:46:20.758050] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-17T20:46:21.070465] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T20:46:21.558030] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-17T20:46:21.692601] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T20:46:22.358065] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-17T20:46:22.581480] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-17T20:46:23.143515] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T20:46:23.157983] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-17T20:46:23.958038] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-17T20:46:24.315168] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-17T20:46:24.758070] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-17T20:46:24.882109] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T20:46:25.501147] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T20:46:25.558027] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-17T20:46:26.358070] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-17T20:46:26.482820] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T20:46:27.158097] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-17T20:46:27.302361] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T20:46:27.958020] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-17T20:46:28.355400] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-17T20:46:28.663906] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T20:46:28.758023] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-17T20:46:29.558035] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-17T20:46:29.663907] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T20:46:30.054459] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-17T20:46:30.358038] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-17T20:46:31.158001] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-17T20:46:31.554466] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T20:46:31.958143] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-17T20:46:32.045565] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T20:46:32.052833] [INFO ] [REMOTE ] OTIS: Full fetch complete (76337 records). [2025-10-17T20:46:32.052985] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-17T20:46:32.443001] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-10-17T20:46:32.443082] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-10-17T20:46:32.444185] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-10-17T20:46:32.444250] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-10-17T20:46:32.445680] [DEBUG] [LOCAL ] OTIS: Trimmed 76337 records to 53507 (keeping 200 days of data) [2025-10-17T20:46:32.761854] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-17T20:46:32.776265] [DEBUG] [LOCAL ] OTIS: Primary data saved (53507 records). [2025-10-17T20:46:32.776465] [INFO ] [MAIN ] OTIS: Full history saved. [2025-10-17T20:46:32.776548] [INFO ] [MAIN ] Update Progress: 1611/2368 symbols completed. OTIS took 37.3s. Estimated remaining: 1h 46m 25s. Rate: 7.1 symbols/min [2025-10-17T20:46:32.947491] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:46:32.958304] [DEBUG] [LOCAL ] OWLT: Loaded 9470 existing records from primary storage. [2025-10-17T20:46:32.958499] [INFO ] [MAIN ] OWLT: Loaded 9470 existing records. [2025-10-17T20:46:33.137193] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:46:33.137593] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-17T20:46:33.137753] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-17T20:46:33.138003] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-10-17T20:46:33.138075] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-17T20:46:33.260527] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-17T20:46:33.543102] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:46:33.558034] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-10-17T20:46:33.655451] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T20:46:33.661970] [INFO ] [REMOTE ] OUT: Full fetch complete (69135 records). [2025-10-17T20:46:33.662114] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-10-17T20:46:34.070129] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-10-17T20:46:34.070213] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-10-17T20:46:34.071298] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-10-17T20:46:34.071411] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-10-17T20:46:34.072780] [DEBUG] [LOCAL ] OUT: Trimmed 69135 records to 48459 (keeping 200 days of data) [2025-10-17T20:46:34.358682] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-17T20:46:34.378337] [DEBUG] [LOCAL ] OUT: Primary data saved (48459 records). [2025-10-17T20:46:34.378505] [INFO ] [MAIN ] OUT: Full history saved. [2025-10-17T20:46:34.378590] [INFO ] [MAIN ] Update Progress: 1612/2368 symbols completed. OUT took 33.3s. Estimated remaining: 1h 46m 14s. Rate: 7.1 symbols/min [2025-10-17T20:46:34.488016] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T20:46:34.565218] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:46:34.565534] [DEBUG] [LOCAL ] OXM: No existing data file found in primary storage. [2025-10-17T20:46:34.565589] [WARN ] [MAIN ] OXM: No existing data found, performing full refresh instead. [2025-10-17T20:46:34.566230] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-17T20:46:34.576062] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-17T20:46:34.589755] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-17T20:46:34.592485] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-17T20:46:34.662663] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T20:46:34.952600] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:46:35.158035] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-17T20:46:35.958044] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-10-17T20:46:36.158792] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T20:46:36.758070] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-17T20:46:37.173364] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T20:46:37.175343] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T20:46:37.558069] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-17T20:46:38.302676] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T20:46:38.309956] [INFO ] [REMOTE ] OVV: Full fetch complete (77526 records). [2025-10-17T20:46:38.310092] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-17T20:46:38.364527] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-17T20:46:38.732571] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-10-17T20:46:38.733168] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-10-17T20:46:38.733600] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T20:46:38.739617] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-10-17T20:46:38.739970] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-10-17T20:46:38.741549] [DEBUG] [LOCAL ] OVV: Trimmed 77526 records to 54291 (keeping 200 days of data) [2025-10-17T20:46:39.065626] [DEBUG] [LOCAL ] OVV: Primary data saved (54291 records). [2025-10-17T20:46:39.065782] [INFO ] [MAIN ] OVV: Full history saved. [2025-10-17T20:46:39.065856] [INFO ] [MAIN ] Update Progress: 1613/2368 symbols completed. OVV took 34.7s. Estimated remaining: 1h 46m 4s. Rate: 7.1 symbols/min [2025-10-17T20:46:39.163317] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-17T20:46:39.240408] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:46:39.240553] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-17T20:46:39.240592] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-17T20:46:39.240754] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-17T20:46:39.240801] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-17T20:46:39.240844] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-17T20:46:39.240877] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-17T20:46:39.599189] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:46:39.958000] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-10-17T20:46:40.005626] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T20:46:40.365721] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-17T20:46:40.758068] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-17T20:46:41.558069] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-17T20:46:42.358114] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-17T20:46:42.566434] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-10-17T20:46:42.641741] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T20:46:42.822827] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-17T20:46:42.933812] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T20:46:43.158089] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-17T20:46:43.958027] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-17T20:46:44.758053] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-17T20:46:45.513121] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T20:46:45.558078] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-17T20:46:45.855982] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-10-17T20:46:46.113259] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T20:46:46.120775] [INFO ] [REMOTE ] OWL: Full fetch complete (77710 records). [2025-10-17T20:46:46.120906] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-17T20:46:46.363161] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-17T20:46:46.512776] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-10-17T20:46:46.512871] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-10-17T20:46:46.514021] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-10-17T20:46:46.514090] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-10-17T20:46:46.515804] [DEBUG] [LOCAL ] OWL: Trimmed 77710 records to 54336 (keeping 200 days of data) [2025-10-17T20:46:46.847017] [DEBUG] [LOCAL ] OWL: Primary data saved (54336 records). [2025-10-17T20:46:46.847246] [INFO ] [MAIN ] OWL: Full history saved. [2025-10-17T20:46:46.847354] [INFO ] [MAIN ] Update Progress: 1614/2368 symbols completed. OWL took 37.9s. Estimated remaining: 1h 45m 55s. Rate: 7.1 symbols/min [2025-10-17T20:46:46.970794] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-17T20:46:47.051925] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:46:47.052109] [DEBUG] [LOCAL ] PAAS: No existing data file found in primary storage. [2025-10-17T20:46:47.052147] [WARN ] [MAIN ] PAAS: No existing data found, performing full refresh instead. [2025-10-17T20:46:47.052288] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-17T20:46:47.052336] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-17T20:46:47.052417] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-17T20:46:47.052500] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-17T20:46:47.163137] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-17T20:46:47.409744] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:46:47.958004] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-10-17T20:46:48.107532] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-17T20:46:48.758006] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-17T20:46:49.067413] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.70 seconds). [2025-10-17T20:46:49.513170] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T20:46:49.558055] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-17T20:46:49.945492] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T20:46:50.078483] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-17T20:46:50.358035] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-17T20:46:51.158022] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-17T20:46:51.958038] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-17T20:46:52.758067] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-17T20:46:52.829157] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-17T20:46:53.046987] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-17T20:46:53.086414] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-17T20:46:53.558022] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-17T20:46:54.193785] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T20:46:54.358001] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-17T20:46:55.158015] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-17T20:46:55.365285] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-17T20:46:55.958022] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-17T20:46:56.754382] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T20:46:56.761718] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-17T20:46:56.814823] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-17T20:46:57.081161] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-17T20:46:57.558031] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-17T20:46:58.358038] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-17T20:46:58.735273] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T20:46:59.158073] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-17T20:46:59.925124] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T20:46:59.957989] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-17T20:47:00.156967] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-17T20:47:00.176179] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T20:47:00.758053] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-17T20:47:01.322298] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T20:47:01.558027] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-17T20:47:01.601845] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T20:47:02.358055] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-17T20:47:03.158048] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-17T20:47:03.709877] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-17T20:47:03.887975] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T20:47:03.958012] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-17T20:47:04.031299] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T20:47:04.033528] [INFO ] [REMOTE ] OWLT: Full fetch complete (12158 records). [2025-10-17T20:47:04.033705] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-17T20:47:04.436714] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-10-17T20:47:04.436797] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-10-17T20:47:04.437122] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-10-17T20:47:04.437162] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-10-17T20:47:04.437715] [DEBUG] [LOCAL ] OWLT: Trimmed 12158 records to 9544 (keeping 200 days of data) [2025-10-17T20:47:04.492660] [DEBUG] [LOCAL ] OWLT: Primary data saved (9544 records). [2025-10-17T20:47:04.492803] [INFO ] [MAIN ] OWLT: Full history saved. [2025-10-17T20:47:04.492889] [INFO ] [MAIN ] Update Progress: 1615/2368 symbols completed. OWLT took 31.7s. Estimated remaining: 1h 45m 51s. Rate: 7.1 symbols/min [2025-10-17T20:47:04.662369] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:47:04.662559] [DEBUG] [LOCAL ] PAC: No existing data file found in primary storage. [2025-10-17T20:47:04.662597] [WARN ] [MAIN ] PAC: No existing data found, performing full refresh instead. [2025-10-17T20:47:04.662759] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-17T20:47:04.662826] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-17T20:47:04.662876] [DEBUG] [LOCAL ] PAC: No primary data file found to delete. [2025-10-17T20:47:04.662910] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-17T20:47:04.763199] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-17T20:47:05.017468] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:47:05.558021] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-17T20:47:06.140664] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-17T20:47:06.358073] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-17T20:47:06.467195] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T20:47:06.471917] [INFO ] [REMOTE ] OXM: Full fetch complete (46248 records). [2025-10-17T20:47:06.472046] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-17T20:47:06.844907] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-10-17T20:47:06.844990] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-10-17T20:47:06.845874] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-10-17T20:47:06.845937] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-10-17T20:47:06.847008] [DEBUG] [LOCAL ] OXM: Trimmed 46248 records to 33719 (keeping 200 days of data) [2025-10-17T20:47:07.054394] [DEBUG] [LOCAL ] OXM: Primary data saved (33719 records). [2025-10-17T20:47:07.054556] [INFO ] [MAIN ] OXM: Full history saved. [2025-10-17T20:47:07.054686] [INFO ] [MAIN ] Update Progress: 1616/2368 symbols completed. OXM took 32.7s. Estimated remaining: 1h 45m 39s. Rate: 7.1 symbols/min [2025-10-17T20:47:07.163102] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-10-17T20:47:07.221742] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:47:07.253426] [DEBUG] [LOCAL ] PACK: Loaded 32206 existing records from primary storage. [2025-10-17T20:47:07.253715] [INFO ] [MAIN ] PACK: Loaded 32206 existing records. [2025-10-17T20:47:07.424620] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:47:07.424835] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-17T20:47:07.424882] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-17T20:47:07.425119] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-10-17T20:47:07.425175] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-17T20:47:07.771879] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:47:07.958029] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-10-17T20:47:08.032593] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-17T20:47:08.079856] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-17T20:47:08.123107] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T20:47:08.757990] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-17T20:47:09.074973] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T20:47:09.557991] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-17T20:47:09.642631] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-17T20:47:10.358002] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-17T20:47:11.158007] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-17T20:47:11.271211] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T20:47:11.958006] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-17T20:47:12.272215] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-17T20:47:12.758003] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-17T20:47:12.906044] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-17T20:47:13.168980] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-17T20:47:13.558032] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-17T20:47:14.358045] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-17T20:47:15.158069] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-17T20:47:15.300802] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-17T20:47:15.402813] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T20:47:15.518064] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T20:47:15.958056] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-17T20:47:16.297187] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T20:47:16.758051] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-17T20:47:17.558009] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-17T20:47:17.786394] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T20:47:18.212562] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-17T20:47:18.358055] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-17T20:47:19.158006] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-17T20:47:19.382138] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-17T20:47:19.958009] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-17T20:47:20.027196] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-17T20:47:20.758030] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-17T20:47:20.864345] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T20:47:20.954885] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T20:47:20.962231] [INFO ] [REMOTE ] PAAS: Full fetch complete (77622 records). [2025-10-17T20:47:20.962351] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-17T20:47:21.354325] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-10-17T20:47:21.354426] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-10-17T20:47:21.355739] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-10-17T20:47:21.355821] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-10-17T20:47:21.357279] [DEBUG] [LOCAL ] PAAS: Trimmed 77622 records to 54403 (keeping 200 days of data) [2025-10-17T20:47:21.466561] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T20:47:21.479678] [INFO ] [REMOTE ] OXY: Full fetch complete (77195 records). [2025-10-17T20:47:21.480260] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-17T20:47:21.481784] [FATAL] [VALIDATOR ] OXY: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T20:47:21.483343] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:47:21.483431] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:47:21.484043] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-17T20:47:21.485093] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-17T20:47:21.485436] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-17T20:47:21.486001] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-17T20:47:21.486368] [INFO ] [MAIN ] Update Progress: 1617/2368 symbols completed. OXY took 42.4s. Estimated remaining: 1h 45m 34s. Rate: 7.1 symbols/min [2025-10-17T20:47:21.562344] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-17T20:47:21.684283] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:47:21.688360] [DEBUG] [LOCAL ] PACS: No existing data file found in primary storage. [2025-10-17T20:47:21.689879] [WARN ] [MAIN ] PACS: No existing data found, performing full refresh instead. [2025-10-17T20:47:21.691698] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-17T20:47:21.692033] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-17T20:47:21.693174] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-17T20:47:21.694027] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-17T20:47:22.162190] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:47:22.267759] [DEBUG] [LOCAL ] PAAS: Primary data saved (54403 records). [2025-10-17T20:47:22.267905] [INFO ] [MAIN ] PAAS: Full history saved. [2025-10-17T20:47:22.267982] [INFO ] [MAIN ] Update Progress: 1618/2368 symbols completed. PAAS took 35.4s. Estimated remaining: 1h 45m 22s. Rate: 7.1 symbols/min [2025-10-17T20:47:22.366750] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-10-17T20:47:22.441105] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:47:22.441300] [DEBUG] [LOCAL ] PAG: No existing data file found in primary storage. [2025-10-17T20:47:22.441340] [WARN ] [MAIN ] PAG: No existing data found, performing full refresh instead. [2025-10-17T20:47:22.441451] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-17T20:47:22.441542] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-17T20:47:22.441606] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-17T20:47:22.441664] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-17T20:47:22.809338] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:47:23.141719] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T20:47:23.157908] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T20:47:23.158040] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-10-17T20:47:23.958025] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-17T20:47:24.272294] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T20:47:24.758025] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-17T20:47:25.254815] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T20:47:25.558014] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-10-17T20:47:25.803396] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-17T20:47:26.358032] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-17T20:47:26.400004] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-17T20:47:27.158041] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-10-17T20:47:27.891073] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T20:47:27.957995] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-17T20:47:27.982098] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T20:47:28.758073] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-17T20:47:29.208941] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T20:47:29.558034] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-10. [2025-10-17T20:47:29.577834] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-17T20:47:30.358044] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-17T20:47:30.505468] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T20:47:30.507715] [INFO ] [REMOTE ] PAC: Full fetch complete (16824 records). [2025-10-17T20:47:30.507810] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-10-17T20:47:30.873382] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-10-17T20:47:30.873478] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-10-17T20:47:30.873896] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-10-17T20:47:30.873958] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-10-17T20:47:30.874548] [DEBUG] [LOCAL ] PAC: Trimmed 16824 records to 11922 (keeping 200 days of data) [2025-10-17T20:47:30.947836] [DEBUG] [LOCAL ] PAC: Primary data saved (11922 records). [2025-10-17T20:47:30.947969] [INFO ] [MAIN ] PAC: Full history saved. [2025-10-17T20:47:30.948079] [INFO ] [MAIN ] Update Progress: 1619/2368 symbols completed. PAC took 26.5s. Estimated remaining: 1h 45m 14s. Rate: 7.1 symbols/min [2025-10-17T20:47:31.113019] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:47:31.113166] [DEBUG] [LOCAL ] PAGS: No existing data file found in primary storage. [2025-10-17T20:47:31.113202] [WARN ] [MAIN ] PAGS: No existing data found, performing full refresh instead. [2025-10-17T20:47:31.113311] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-17T20:47:31.113351] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-17T20:47:31.113431] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-17T20:47:31.113490] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-17T20:47:31.166408] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-10-17T20:47:31.466524] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:47:31.839414] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T20:47:31.958052] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-10-17T20:47:32.758075] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-17T20:47:32.847768] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T20:47:33.558000] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-17T20:47:33.823211] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T20:47:34.268627] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T20:47:34.358042] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-17T20:47:34.807796] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T20:47:35.158129] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-17T20:47:35.958086] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-17T20:47:36.148602] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T20:47:36.237140] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T20:47:36.758043] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-17T20:47:37.506927] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T20:47:37.558031] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-17T20:47:38.358019] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-17T20:47:38.448478] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T20:47:38.940128] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T20:47:38.945054] [INFO ] [REMOTE ] PACK: Full fetch complete (45120 records). [2025-10-17T20:47:38.945157] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-17T20:47:39.163396] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-17T20:47:39.363558] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-10-17T20:47:39.363639] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-10-17T20:47:39.364534] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-10-17T20:47:39.364577] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-10-17T20:47:39.365823] [DEBUG] [LOCAL ] PACK: Trimmed 45120 records to 32458 (keeping 200 days of data) [2025-10-17T20:47:39.556031] [DEBUG] [LOCAL ] PACK: Primary data saved (32458 records). [2025-10-17T20:47:39.556183] [INFO ] [MAIN ] PACK: Full history saved. [2025-10-17T20:47:39.556270] [INFO ] [MAIN ] Update Progress: 1620/2368 symbols completed. PACK took 32.5s. Estimated remaining: 1h 45m 5s. Rate: 7.1 symbols/min [2025-10-17T20:47:39.736317] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:47:39.742883] [DEBUG] [LOCAL ] PAI: Loaded 2788 existing records from primary storage. [2025-10-17T20:47:39.743114] [INFO ] [MAIN ] PAI: Loaded 2788 existing records. [2025-10-17T20:47:39.906804] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T20:47:39.947738] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:47:39.947961] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-17T20:47:39.948054] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-17T20:47:39.948228] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-10-17T20:47:39.948294] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-17T20:47:39.968190] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-17T20:47:40.297894] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:47:40.683848] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T20:47:40.758012] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-10-17T20:47:41.558073] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-17T20:47:41.678570] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-17T20:47:41.892670] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-17T20:47:42.358087] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-17T20:47:42.832495] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T20:47:43.158063] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-17T20:47:43.800573] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T20:47:43.958023] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-17T20:47:44.758038] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-17T20:47:45.098497] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T20:47:45.133447] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T20:47:45.558005] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-17T20:47:45.914922] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T20:47:46.358074] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-17T20:47:47.158043] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-17T20:47:47.461679] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-17T20:47:47.741951] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T20:47:47.957998] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-17T20:47:48.352354] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-17T20:47:48.758059] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-17T20:47:49.463321] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T20:47:49.474937] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T20:47:49.558048] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-17T20:47:50.101694] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-17T20:47:50.358038] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-17T20:47:51.158038] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-17T20:47:51.958008] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-17T20:47:52.157171] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T20:47:52.294208] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-17T20:47:52.532241] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-17T20:47:52.758000] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-17T20:47:53.279304] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-17T20:47:53.558043] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-17T20:47:54.358020] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-17T20:47:55.014197] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T20:47:55.158058] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-17T20:47:55.414172] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-17T20:47:55.958146] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-17T20:47:56.546829] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-17T20:47:56.758073] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-17T20:47:57.056732] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T20:47:57.558055] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-17T20:47:57.838246] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T20:47:57.841485] [INFO ] [REMOTE ] PAG: Full fetch complete (30669 records). [2025-10-17T20:47:57.841578] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-17T20:47:58.219686] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-10-17T20:47:58.219772] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-10-17T20:47:58.220384] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-10-17T20:47:58.220424] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-10-17T20:47:58.221161] [DEBUG] [LOCAL ] PAG: Trimmed 30669 records to 21914 (keeping 200 days of data) [2025-10-17T20:47:58.354581] [DEBUG] [LOCAL ] PAG: Primary data saved (21914 records). [2025-10-17T20:47:58.354731] [INFO ] [MAIN ] PAG: Full history saved. [2025-10-17T20:47:58.354812] [INFO ] [MAIN ] Update Progress: 1621/2368 symbols completed. PAG took 36.1s. Estimated remaining: 1h 45m 2s. Rate: 7.1 symbols/min [2025-10-17T20:47:58.365839] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-17T20:47:58.525188] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:47:58.525353] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-17T20:47:58.525391] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-17T20:47:58.525509] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-17T20:47:58.525552] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-17T20:47:58.525595] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-17T20:47:58.525634] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-17T20:47:58.899342] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:47:58.975828] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T20:47:59.158057] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-10-17T20:47:59.434687] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T20:47:59.435018] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-10-17T20:47:59.435108] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:47:59.435156] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-17T20:47:59.435190] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:47:59.435240] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-17T20:47:59.435321] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-17T20:47:59.435359] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-17T20:47:59.435420] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-17T20:47:59.435483] [INFO ] [MAIN ] Update Progress: 1622/2368 symbols completed. PAII took 1.1s. Estimated remaining: 1h 44m 50s. Rate: 7.1 symbols/min [2025-10-17T20:47:59.600021] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:47:59.600202] [DEBUG] [LOCAL ] PAM: No existing data file found in primary storage. [2025-10-17T20:47:59.600240] [WARN ] [MAIN ] PAM: No existing data found, performing full refresh instead. [2025-10-17T20:47:59.600360] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-17T20:47:59.600400] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-17T20:47:59.600440] [DEBUG] [LOCAL ] PAM: No primary data file found to delete. [2025-10-17T20:47:59.600472] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-17T20:47:59.958145] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:47:59.958274] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-17T20:48:00.089908] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T20:48:00.758032] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-17T20:48:01.558113] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-10-17T20:48:01.695162] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T20:48:02.358083] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-17T20:48:02.595541] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T20:48:03.095874] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T20:48:03.158004] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-17T20:48:03.736865] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T20:48:03.847139] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T20:48:03.852451] [INFO ] [REMOTE ] PACS: Full fetch complete (50613 records). [2025-10-17T20:48:03.852566] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-17T20:48:03.963197] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-17T20:48:04.237333] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-10-17T20:48:04.237417] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-10-17T20:48:04.238471] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-10-17T20:48:04.238538] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-10-17T20:48:04.239565] [DEBUG] [LOCAL ] PACS: Trimmed 50613 records to 35165 (keeping 200 days of data) [2025-10-17T20:48:04.460538] [DEBUG] [LOCAL ] PACS: Primary data saved (35165 records). [2025-10-17T20:48:04.460771] [INFO ] [MAIN ] PACS: Full history saved. [2025-10-17T20:48:04.460884] [INFO ] [MAIN ] Update Progress: 1623/2368 symbols completed. PACS took 43.0s. Estimated remaining: 1h 44m 40s. Rate: 7.1 symbols/min [2025-10-17T20:48:04.639268] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:48:04.639443] [DEBUG] [LOCAL ] PAR: No existing data file found in primary storage. [2025-10-17T20:48:04.639486] [WARN ] [MAIN ] PAR: No existing data found, performing full refresh instead. [2025-10-17T20:48:04.639601] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-17T20:48:04.639670] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-17T20:48:04.639749] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-17T20:48:04.639819] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-17T20:48:04.763103] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-17T20:48:05.016198] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:48:05.558072] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-17T20:48:05.654089] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T20:48:05.926452] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-17T20:48:06.358067] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-17T20:48:06.842636] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-17T20:48:06.850140] [INFO ] [REMOTE ] PAGS: Full fetch complete (76515 records). [2025-10-17T20:48:06.850296] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-17T20:48:07.163215] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-17T20:48:07.234537] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-10-17T20:48:07.234608] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-10-17T20:48:07.235694] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-10-17T20:48:07.235756] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-10-17T20:48:07.237156] [DEBUG] [LOCAL ] PAGS: Trimmed 76515 records to 53590 (keeping 200 days of data) [2025-10-17T20:48:07.556388] [DEBUG] [LOCAL ] PAGS: Primary data saved (53590 records). [2025-10-17T20:48:07.556679] [INFO ] [MAIN ] PAGS: Full history saved. [2025-10-17T20:48:07.556784] [INFO ] [MAIN ] Update Progress: 1624/2368 symbols completed. PAGS took 36.6s. Estimated remaining: 1h 44m 29s. Rate: 7.1 symbols/min [2025-10-17T20:48:07.725820] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:48:07.725998] [DEBUG] [LOCAL ] PARR: No existing data file found in primary storage. [2025-10-17T20:48:07.726110] [WARN ] [MAIN ] PARR: No existing data found, performing full refresh instead. [2025-10-17T20:48:07.726391] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-17T20:48:07.726584] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-17T20:48:07.726715] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-17T20:48:07.726893] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-17T20:48:07.900920] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-17T20:48:07.963923] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-17T20:48:08.013873] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T20:48:08.107915] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:48:08.701244] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-17T20:48:08.758043] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-17T20:48:09.558032] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-10-17T20:48:10.083206] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-17T20:48:10.358021] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-17T20:48:11.124400] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T20:48:11.157990] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-17T20:48:11.699742] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T20:48:11.958045] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-17T20:48:12.763112] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-17T20:48:12.778170] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T20:48:13.199702] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-17T20:48:13.428299] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-17T20:48:13.429339] [INFO ] [REMOTE ] PAI: Full fetch complete (4123 records). [2025-10-17T20:48:13.429427] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-17T20:48:13.563114] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-17T20:48:13.807205] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-17T20:48:13.807286] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-17T20:48:13.807427] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-17T20:48:13.807467] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-17T20:48:13.807958] [DEBUG] [LOCAL ] PAI: Trimmed 4123 records to 2805 (keeping 200 days of data) [2025-10-17T20:48:13.826253] [DEBUG] [LOCAL ] PAI: Primary data saved (2805 records). [2025-10-17T20:48:13.826340] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-17T20:48:13.826415] [INFO ] [MAIN ] Update Progress: 1625/2368 symbols completed. PAI took 34.3s. Estimated remaining: 1h 44m 19s. Rate: 7.1 symbols/min [2025-10-17T20:48:14.009730] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:48:14.009905] [DEBUG] [LOCAL ] PATH: No existing data file found in primary storage. [2025-10-17T20:48:14.009971] [WARN ] [MAIN ] PATH: No existing data found, performing full refresh instead. [2025-10-17T20:48:14.010102] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-17T20:48:14.010146] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-17T20:48:14.010194] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-17T20:48:14.010292] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-17T20:48:14.371512] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-10-17T20:48:14.376287] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:48:14.797762] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-17T20:48:15.158032] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-10-17T20:48:15.690389] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-17T20:48:15.958042] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-17T20:48:16.758056] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-17T20:48:17.507089] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T20:48:17.557980] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-17T20:48:17.726839] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-10-17T20:48:18.270719] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T20:48:18.358054] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-17T20:48:19.158086] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-17T20:48:19.300929] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T20:48:19.682031] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-17T20:48:19.958023] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-17T20:48:20.758045] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-17T20:48:21.352424] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T20:48:21.563112] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-17T20:48:21.580734] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-17T20:48:22.228151] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T20:48:22.358074] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-17T20:48:23.158072] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-17T20:48:23.290493] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T20:48:23.750872] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-17T20:48:23.958166] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-17T20:48:24.758111] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-17T20:48:25.227354] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-17T20:48:25.536987] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-17T20:48:25.558066] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-17T20:48:25.908955] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T20:48:26.358098] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-17T20:48:26.934507] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T20:48:27.158090] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-17T20:48:27.852248] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T20:48:27.857582] [INFO ] [REMOTE ] PAM: Full fetch complete (42351 records). [2025-10-17T20:48:27.857805] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-17T20:48:27.967284] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-17T20:48:28.292712] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-10-17T20:48:28.292845] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-10-17T20:48:28.293719] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-10-17T20:48:28.293781] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-10-17T20:48:28.294986] [DEBUG] [LOCAL ] PAM: Trimmed 42351 records to 29195 (keeping 200 days of data) [2025-10-17T20:48:28.471389] [DEBUG] [LOCAL ] PAM: Primary data saved (29195 records). [2025-10-17T20:48:28.471528] [INFO ] [MAIN ] PAM: Full history saved. [2025-10-17T20:48:28.471617] [INFO ] [MAIN ] Update Progress: 1626/2368 symbols completed. PAM took 29.0s. Estimated remaining: 1h 44m 14s. Rate: 7.1 symbols/min [2025-10-17T20:48:28.667382] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:48:28.667589] [DEBUG] [LOCAL ] PAXS: No existing data file found in primary storage. [2025-10-17T20:48:28.667639] [WARN ] [MAIN ] PAXS: No existing data found, performing full refresh instead. [2025-10-17T20:48:28.667788] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-17T20:48:28.668015] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-17T20:48:28.668093] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-17T20:48:28.668138] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-17T20:48:28.761140] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-17T20:48:29.066981] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-17T20:48:29.137798] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:48:29.558047] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-10-17T20:48:30.263177] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-17T20:48:30.302718] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T20:48:30.358060] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-17T20:48:30.923985] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T20:48:31.158079] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-17T20:48:31.557699] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T20:48:31.958082] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-17T20:48:32.758044] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-17T20:48:33.036583] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T20:48:33.414747] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T20:48:33.557994] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-17T20:48:33.873710] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T20:48:34.358103] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-17T20:48:35.067801] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T20:48:35.158061] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-17T20:48:35.958064] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-17T20:48:36.642378] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-17T20:48:36.763198] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-17T20:48:36.779165] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T20:48:37.272215] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T20:48:37.558027] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-17T20:48:37.866586] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T20:48:38.358072] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-17T20:48:39.158067] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-17T20:48:39.364629] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T20:48:39.525041] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-17T20:48:39.958057] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-17T20:48:40.348087] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-17T20:48:40.354088] [INFO ] [REMOTE ] PAR: Full fetch complete (49084 records). [2025-10-17T20:48:40.354226] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-17T20:48:40.722026] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-10-17T20:48:40.722102] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-10-17T20:48:40.723002] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-10-17T20:48:40.723063] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-10-17T20:48:40.724032] [DEBUG] [LOCAL ] PAR: Trimmed 49084 records to 34624 (keeping 200 days of data) [2025-10-17T20:48:40.773854] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-17T20:48:40.929255] [DEBUG] [LOCAL ] PAR: Primary data saved (34624 records). [2025-10-17T20:48:40.929363] [INFO ] [MAIN ] PAR: Full history saved. [2025-10-17T20:48:40.929436] [INFO ] [MAIN ] Update Progress: 1627/2368 symbols completed. PAR took 36.5s. Estimated remaining: 1h 44m 7s. Rate: 7.1 symbols/min [2025-10-17T20:48:41.096495] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:48:41.096742] [DEBUG] [LOCAL ] PAY: No existing data file found in primary storage. [2025-10-17T20:48:41.096788] [WARN ] [MAIN ] PAY: No existing data found, performing full refresh instead. [2025-10-17T20:48:41.096896] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-17T20:48:41.096937] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-17T20:48:41.096977] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-17T20:48:41.097057] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-17T20:48:41.444369] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:48:41.488513] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T20:48:41.494672] [INFO ] [REMOTE ] PARR: Full fetch complete (69063 records). [2025-10-17T20:48:41.494778] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-17T20:48:41.563281] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-10-17T20:48:41.881115] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-10-17T20:48:41.881196] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-10-17T20:48:41.882237] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-10-17T20:48:41.882301] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-10-17T20:48:41.883579] [DEBUG] [LOCAL ] PARR: Trimmed 69063 records to 48792 (keeping 200 days of data) [2025-10-17T20:48:42.163003] [DEBUG] [LOCAL ] PARR: Primary data saved (48792 records). [2025-10-17T20:48:42.163141] [INFO ] [MAIN ] PARR: Full history saved. [2025-10-17T20:48:42.163227] [INFO ] [MAIN ] Update Progress: 1628/2368 symbols completed. PARR took 34.6s. Estimated remaining: 1h 43m 56s. Rate: 7.1 symbols/min [2025-10-17T20:48:42.326507] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:48:42.326688] [DEBUG] [LOCAL ] PAYC: No existing data file found in primary storage. [2025-10-17T20:48:42.326740] [WARN ] [MAIN ] PAYC: No existing data found, performing full refresh instead. [2025-10-17T20:48:42.326847] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-17T20:48:42.326888] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-17T20:48:42.326928] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-17T20:48:42.326959] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-17T20:48:42.367831] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-17T20:48:42.671809] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:48:43.009016] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T20:48:43.108374] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-17T20:48:43.158001] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-17T20:48:43.684000] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-17T20:48:43.958000] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-17T20:48:44.758019] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-17T20:48:45.095746] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T20:48:45.276308] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-17T20:48:45.558051] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-17T20:48:46.227253] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T20:48:46.358014] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-17T20:48:46.652361] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T20:48:47.158049] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-17T20:48:47.683543] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T20:48:47.958071] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-17T20:48:48.758052] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-17T20:48:49.469191] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-17T20:48:49.506610] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T20:48:49.557980] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-17T20:48:50.018573] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T20:48:50.358056] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-17T20:48:51.107494] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T20:48:51.157996] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-17T20:48:51.473256] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T20:48:51.958027] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-17T20:48:52.500467] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T20:48:52.758001] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-10-17T20:48:53.017131] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-17T20:48:53.557959] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-17T20:48:54.108087] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T20:48:54.358052] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-17T20:48:55.150327] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T20:48:55.158121] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-17T20:48:55.297594] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T20:48:55.300766] [INFO ] [REMOTE ] PAXS: Full fetch complete (29672 records). [2025-10-17T20:48:55.300853] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-17T20:48:55.686039] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-10-17T20:48:55.686143] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-10-17T20:48:55.687034] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-10-17T20:48:55.687100] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-10-17T20:48:55.688112] [DEBUG] [LOCAL ] PAXS: Trimmed 29672 records to 21123 (keeping 200 days of data) [2025-10-17T20:48:55.823025] [DEBUG] [LOCAL ] PAXS: Primary data saved (21123 records). [2025-10-17T20:48:55.823206] [INFO ] [MAIN ] PAXS: Full history saved. [2025-10-17T20:48:55.823296] [INFO ] [MAIN ] Update Progress: 1629/2368 symbols completed. PAXS took 27.4s. Estimated remaining: 1h 43m 50s. Rate: 7.1 symbols/min [2025-10-17T20:48:55.964556] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-17T20:48:56.000396] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:48:56.000703] [DEBUG] [LOCAL ] PB: No existing data file found in primary storage. [2025-10-17T20:48:56.000762] [WARN ] [MAIN ] PB: No existing data found, performing full refresh instead. [2025-10-17T20:48:56.000927] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-17T20:48:56.000985] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-17T20:48:56.001032] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-17T20:48:56.001069] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-17T20:48:56.357678] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:48:56.758092] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-10-17T20:48:57.269585] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-17T20:48:57.525666] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T20:48:57.558044] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-17T20:48:57.973693] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T20:48:58.358061] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-17T20:48:59.112429] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T20:48:59.157998] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-17T20:48:59.905431] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T20:48:59.958091] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-17T20:49:00.579621] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T20:49:00.758117] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-17T20:49:01.563548] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-17T20:49:01.567309] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T20:49:02.358108] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-17T20:49:02.548450] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T20:49:03.151175] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T20:49:03.156841] [INFO ] [REMOTE ] PAY: Full fetch complete (54208 records). [2025-10-17T20:49:03.156939] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-17T20:49:03.168784] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-17T20:49:03.530925] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-10-17T20:49:03.531077] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-10-17T20:49:03.532410] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-10-17T20:49:03.532490] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-10-17T20:49:03.533882] [DEBUG] [LOCAL ] PAY: Trimmed 54208 records to 39122 (keeping 200 days of data) [2025-10-17T20:49:03.767324] [DEBUG] [LOCAL ] PAY: Primary data saved (39122 records). [2025-10-17T20:49:03.767572] [INFO ] [MAIN ] PAY: Full history saved. [2025-10-17T20:49:03.767691] [INFO ] [MAIN ] Update Progress: 1630/2368 symbols completed. PAY took 22.8s. Estimated remaining: 1h 43m 41s. Rate: 7.1 symbols/min [2025-10-17T20:49:03.897634] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T20:49:03.962700] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-17T20:49:03.980887] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:49:03.982133] [DEBUG] [LOCAL ] PBA: No existing data file found in primary storage. [2025-10-17T20:49:03.982202] [WARN ] [MAIN ] PBA: No existing data found, performing full refresh instead. [2025-10-17T20:49:03.982359] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-17T20:49:03.982403] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-17T20:49:03.982448] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-17T20:49:03.982482] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-17T20:49:04.362360] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:49:04.618206] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T20:49:04.758047] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-10-17T20:49:05.558122] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-17T20:49:05.679447] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T20:49:06.358047] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-17T20:49:06.563629] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T20:49:07.127159] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T20:49:07.157988] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-17T20:49:07.686327] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-17T20:49:07.958080] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-17T20:49:08.756391] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-17T20:49:08.759233] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-17T20:49:09.558018] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-17T20:49:09.747418] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T20:49:10.358084] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-17T20:49:11.158084] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-17T20:49:11.190555] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T20:49:11.350824] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-17T20:49:11.958039] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-17T20:49:12.102487] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T20:49:12.390816] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-17T20:49:12.758105] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-17T20:49:13.519348] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T20:49:13.558051] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-17T20:49:14.358033] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-17T20:49:15.163591] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-17T20:49:15.166909] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T20:49:15.408833] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-17T20:49:15.416082] [INFO ] [REMOTE ] PATH: Full fetch complete (77851 records). [2025-10-17T20:49:15.416218] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-17T20:49:15.797665] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-10-17T20:49:15.797799] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-10-17T20:49:15.798958] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-10-17T20:49:15.799022] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-10-17T20:49:15.800502] [DEBUG] [LOCAL ] PATH: Trimmed 77851 records to 54460 (keeping 200 days of data) [2025-10-17T20:49:15.967193] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-17T20:49:16.129128] [DEBUG] [LOCAL ] PATH: Primary data saved (54460 records). [2025-10-17T20:49:16.129286] [INFO ] [MAIN ] PATH: Full history saved. [2025-10-17T20:49:16.129366] [INFO ] [MAIN ] Update Progress: 1631/2368 symbols completed. PATH took 1m 2s. Estimated remaining: 1h 43m 34s. Rate: 7.1 symbols/min [2025-10-17T20:49:16.310147] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:49:16.310407] [DEBUG] [LOCAL ] PBF: No existing data file found in primary storage. [2025-10-17T20:49:16.310546] [WARN ] [MAIN ] PBF: No existing data found, performing full refresh instead. [2025-10-17T20:49:16.310694] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-17T20:49:16.310749] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-17T20:49:16.310794] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-17T20:49:16.310834] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-17T20:49:16.680724] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:49:16.705430] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-17T20:49:16.757996] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-10-17T20:49:17.478280] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-17T20:49:17.558097] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-17T20:49:17.787161] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T20:49:18.358060] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-17T20:49:18.602202] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T20:49:19.158059] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-17T20:49:19.628214] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-17T20:49:19.696884] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T20:49:19.958047] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-17T20:49:20.727329] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T20:49:20.732784] [INFO ] [REMOTE ] PAYC: Full fetch complete (53175 records). [2025-10-17T20:49:20.732882] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-17T20:49:20.763215] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-17T20:49:21.126543] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-10-17T20:49:21.126888] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-10-17T20:49:21.127941] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-10-17T20:49:21.128006] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-10-17T20:49:21.129233] [DEBUG] [LOCAL ] PAYC: Trimmed 53175 records to 36844 (keeping 200 days of data) [2025-10-17T20:49:21.360040] [DEBUG] [LOCAL ] PAYC: Primary data saved (36844 records). [2025-10-17T20:49:21.360181] [INFO ] [MAIN ] PAYC: Full history saved. [2025-10-17T20:49:21.360255] [INFO ] [MAIN ] Update Progress: 1632/2368 symbols completed. PAYC took 39.2s. Estimated remaining: 1h 43m 24s. Rate: 7.1 symbols/min [2025-10-17T20:49:21.528484] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:49:21.528860] [DEBUG] [LOCAL ] PBH: No existing data file found in primary storage. [2025-10-17T20:49:21.528909] [WARN ] [MAIN ] PBH: No existing data found, performing full refresh instead. [2025-10-17T20:49:21.529073] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-17T20:49:21.529116] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-17T20:49:21.529157] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-17T20:49:21.529191] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-17T20:49:21.570812] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-17T20:49:21.892065] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:49:21.919812] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T20:49:22.358044] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-17T20:49:22.575175] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T20:49:23.158015] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-17T20:49:23.512435] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-17T20:49:23.958039] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-10-17T20:49:24.038271] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T20:49:24.758044] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-17T20:49:24.898989] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T20:49:25.080287] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T20:49:25.558048] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-17T20:49:26.358076] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-17T20:49:26.630484] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-17T20:49:27.066627] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T20:49:27.072882] [INFO ] [REMOTE ] PB: Full fetch complete (59626 records). [2025-10-17T20:49:27.073003] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-17T20:49:27.163129] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-17T20:49:27.459102] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-10-17T20:49:27.459198] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-10-17T20:49:27.460234] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-10-17T20:49:27.460297] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-10-17T20:49:27.461535] [DEBUG] [LOCAL ] PB: Trimmed 59626 records to 42728 (keeping 200 days of data) [2025-10-17T20:49:27.724587] [DEBUG] [LOCAL ] PB: Primary data saved (42728 records). [2025-10-17T20:49:27.724736] [INFO ] [MAIN ] PB: Full history saved. [2025-10-17T20:49:27.724816] [INFO ] [MAIN ] Update Progress: 1633/2368 symbols completed. PB took 31.9s. Estimated remaining: 1h 43m 15s. Rate: 7.1 symbols/min [2025-10-17T20:49:27.898986] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:49:27.899229] [DEBUG] [LOCAL ] PBI: No existing data file found in primary storage. [2025-10-17T20:49:27.899281] [WARN ] [MAIN ] PBI: No existing data found, performing full refresh instead. [2025-10-17T20:49:27.899392] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-17T20:49:27.899433] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-17T20:49:27.899474] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-17T20:49:27.899506] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-17T20:49:27.966097] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-17T20:49:28.258407] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:49:28.287349] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-17T20:49:28.414606] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T20:49:28.758061] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-10-17T20:49:29.432534] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T20:49:29.558034] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-17T20:49:30.339078] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T20:49:30.357991] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-17T20:49:31.158070] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-17T20:49:31.419309] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T20:49:31.958031] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-17T20:49:32.209033] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T20:49:32.348051] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T20:49:32.758031] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-17T20:49:33.517671] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T20:49:33.557999] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-17T20:49:34.358051] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-17T20:49:34.511581] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T20:49:35.158034] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-17T20:49:35.411617] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T20:49:35.708122] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-17T20:49:35.715017] [INFO ] [REMOTE ] PBA: Full fetch complete (71684 records). [2025-10-17T20:49:35.715125] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-17T20:49:35.966823] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-17T20:49:36.131750] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-10-17T20:49:36.131863] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-10-17T20:49:36.133326] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-10-17T20:49:36.133409] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-10-17T20:49:36.135528] [DEBUG] [LOCAL ] PBA: Trimmed 71684 records to 49917 (keeping 200 days of data) [2025-10-17T20:49:36.506815] [DEBUG] [LOCAL ] PBA: Primary data saved (49917 records). [2025-10-17T20:49:36.507030] [INFO ] [MAIN ] PBA: Full history saved. [2025-10-17T20:49:36.507217] [INFO ] [MAIN ] Update Progress: 1634/2368 symbols completed. PBA took 32.7s. Estimated remaining: 1h 43m 7s. Rate: 7.1 symbols/min [2025-10-17T20:49:36.740419] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:49:36.740592] [DEBUG] [LOCAL ] PBR: No existing data file found in primary storage. [2025-10-17T20:49:36.740630] [WARN ] [MAIN ] PBR: No existing data found, performing full refresh instead. [2025-10-17T20:49:36.740770] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-17T20:49:36.740812] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-17T20:49:36.740891] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-17T20:49:36.740945] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-17T20:49:36.763168] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-17T20:49:37.232413] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:49:37.264535] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-17T20:49:37.558034] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-17T20:49:37.972019] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-17T20:49:38.133258] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T20:49:38.358021] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-17T20:49:39.158032] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-17T20:49:39.453959] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T20:49:39.709098] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T20:49:39.958033] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-10-17T20:49:40.758041] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-17T20:49:40.810451] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T20:49:41.558031] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-17T20:49:42.224239] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T20:49:42.263276] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-17T20:49:42.358004] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-17T20:49:43.158016] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-17T20:49:43.393558] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T20:49:43.958020] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-17T20:49:44.128089] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T20:49:44.758104] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-17T20:49:45.250877] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-17T20:49:45.558035] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-17T20:49:45.784390] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T20:49:46.161340] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T20:49:46.358061] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-17T20:49:47.158038] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-17T20:49:47.399378] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-17T20:49:47.958047] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-17T20:49:48.154273] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T20:49:48.758054] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-17T20:49:48.775946] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T20:49:48.945376] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T20:49:49.558069] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-17T20:49:50.358004] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-17T20:49:50.760765] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-17T20:49:51.158055] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-17T20:49:51.317406] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T20:49:51.325242] [INFO ] [REMOTE ] PBF: Full fetch complete (76738 records). [2025-10-17T20:49:51.325437] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-17T20:49:51.674845] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-17T20:49:51.753476] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-10-17T20:49:51.753551] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-10-17T20:49:51.754665] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-10-17T20:49:51.754729] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-10-17T20:49:51.756145] [DEBUG] [LOCAL ] PBF: Trimmed 76738 records to 53909 (keeping 200 days of data) [2025-10-17T20:49:51.968242] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-17T20:49:52.088552] [DEBUG] [LOCAL ] PBF: Primary data saved (53909 records). [2025-10-17T20:49:52.088721] [INFO ] [MAIN ] PBF: Full history saved. [2025-10-17T20:49:52.088820] [INFO ] [MAIN ] Update Progress: 1635/2368 symbols completed. PBF took 36.0s. Estimated remaining: 1h 43m 1s. Rate: 7.1 symbols/min [2025-10-17T20:49:52.256220] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:49:52.256389] [DEBUG] [LOCAL ] PBT: No existing data file found in primary storage. [2025-10-17T20:49:52.256430] [WARN ] [MAIN ] PBT: No existing data found, performing full refresh instead. [2025-10-17T20:49:52.256542] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-17T20:49:52.256600] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-17T20:49:52.256717] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-17T20:49:52.256776] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-17T20:49:52.613581] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:49:52.757980] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-10-17T20:49:53.020879] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T20:49:53.517963] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T20:49:53.557983] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-17T20:49:54.103943] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T20:49:54.358109] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-17T20:49:55.142727] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T20:49:55.157983] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-17T20:49:55.958033] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-17T20:49:56.093883] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T20:49:56.336335] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T20:49:56.758013] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-17T20:49:57.558079] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-17T20:49:57.680211] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-17T20:49:58.322386] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-17T20:49:58.358041] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-17T20:49:59.158105] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-17T20:49:59.192972] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T20:49:59.201481] [INFO ] [REMOTE ] PBI: Full fetch complete (72412 records). [2025-10-17T20:49:59.201712] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-17T20:49:59.407415] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T20:49:59.607041] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-10-17T20:49:59.607119] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-10-17T20:49:59.608214] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-10-17T20:49:59.608282] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-10-17T20:49:59.609735] [DEBUG] [LOCAL ] PBI: Trimmed 72412 records to 50739 (keeping 200 days of data) [2025-10-17T20:49:59.910049] [DEBUG] [LOCAL ] PBI: Primary data saved (50739 records). [2025-10-17T20:49:59.910217] [INFO ] [MAIN ] PBI: Full history saved. [2025-10-17T20:49:59.910345] [INFO ] [MAIN ] Update Progress: 1636/2368 symbols completed. PBI took 32.2s. Estimated remaining: 1h 42m 53s. Rate: 7.1 symbols/min [2025-10-17T20:49:59.963814] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-17T20:50:00.078003] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:50:00.088309] [DEBUG] [LOCAL ] PCF: Loaded 9109 existing records from primary storage. [2025-10-17T20:50:00.088481] [INFO ] [MAIN ] PCF: Loaded 9109 existing records. [2025-10-17T20:50:00.262700] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:50:00.262910] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-17T20:50:00.263012] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-17T20:50:00.263220] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-10-17T20:50:00.263278] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-17T20:50:00.620136] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:50:00.632534] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T20:50:00.637352] [INFO ] [REMOTE ] PBH: Full fetch complete (44599 records). [2025-10-17T20:50:00.637434] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-17T20:50:00.772398] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-10-17T20:50:01.005230] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-10-17T20:50:01.005327] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-10-17T20:50:01.006171] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-10-17T20:50:01.006232] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-10-17T20:50:01.007186] [DEBUG] [LOCAL ] PBH: Trimmed 44599 records to 33130 (keeping 200 days of data) [2025-10-17T20:50:01.203115] [DEBUG] [LOCAL ] PBH: Primary data saved (33130 records). [2025-10-17T20:50:01.203227] [INFO ] [MAIN ] PBH: Full history saved. [2025-10-17T20:50:01.203320] [INFO ] [MAIN ] Update Progress: 1637/2368 symbols completed. PBH took 39.8s. Estimated remaining: 1h 42m 41s. Rate: 7.1 symbols/min [2025-10-17T20:50:01.558028] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-17T20:50:01.973078] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-17T20:50:02.331573] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-17T20:50:02.358082] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-17T20:50:02.631206] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T20:50:03.157989] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-17T20:50:03.475316] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T20:50:03.958042] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-17T20:50:04.512935] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T20:50:04.758136] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-17T20:50:04.897405] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T20:50:05.558017] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-17T20:50:06.358061] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-17T20:50:06.598375] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T20:50:07.157999] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-17T20:50:07.205441] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-17T20:50:07.513019] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T20:50:07.958166] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-17T20:50:08.041408] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-17T20:50:08.758010] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-17T20:50:09.558034] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-17T20:50:09.594270] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T20:50:10.331037] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-17T20:50:10.357988] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-17T20:50:10.384161] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T20:50:11.158049] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-17T20:50:11.958115] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-17T20:50:12.391506] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-17T20:50:12.524515] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-17T20:50:12.758080] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-17T20:50:12.929604] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-17T20:50:13.558060] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-17T20:50:13.689993] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-17T20:50:14.358067] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-17T20:50:15.158026] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-17T20:50:15.389172] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T20:50:15.391880] [INFO ] [REMOTE ] PBT: Full fetch complete (24728 records). [2025-10-17T20:50:15.391952] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-17T20:50:15.755708] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-10-17T20:50:15.755800] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-10-17T20:50:15.756386] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-10-17T20:50:15.756476] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-10-17T20:50:15.757221] [DEBUG] [LOCAL ] PBT: Trimmed 24728 records to 17711 (keeping 200 days of data) [2025-10-17T20:50:15.863803] [DEBUG] [LOCAL ] PBT: Primary data saved (17711 records). [2025-10-17T20:50:15.864008] [INFO ] [MAIN ] PBT: Full history saved. [2025-10-17T20:50:15.864150] [INFO ] [MAIN ] Update Progress: 1638/2368 symbols completed. PBT took 23.8s. Estimated remaining: 1h 42m 36s. Rate: 7.1 symbols/min [2025-10-17T20:50:15.894145] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-17T20:50:15.957992] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-17T20:50:16.194430] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T20:50:16.758127] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-17T20:50:17.634327] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T20:50:17.637136] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-17T20:50:17.812422] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T20:50:17.819702] [INFO ] [REMOTE ] PBR: Full fetch complete (77881 records). [2025-10-17T20:50:17.819821] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-17T20:50:18.203610] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-10-17T20:50:18.203730] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-10-17T20:50:18.204877] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-10-17T20:50:18.204944] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-10-17T20:50:18.206443] [DEBUG] [LOCAL ] PBR: Trimmed 77881 records to 54493 (keeping 200 days of data) [2025-10-17T20:50:18.542253] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T20:50:18.547824] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-17T20:50:18.569389] [DEBUG] [LOCAL ] PBR: Primary data saved (54493 records). [2025-10-17T20:50:18.569530] [INFO ] [MAIN ] PBR: Full history saved. [2025-10-17T20:50:18.569632] [INFO ] [MAIN ] Update Progress: 1639/2368 symbols completed. PBR took 42.1s. Estimated remaining: 1h 42m 25s. Rate: 7.1 symbols/min [2025-10-17T20:50:19.429160] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-17T20:50:19.430928] [INFO ] [REMOTE ] PCF: Full fetch complete (13567 records). [2025-10-17T20:50:19.431011] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-17T20:50:19.791032] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-17T20:50:19.791129] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-17T20:50:19.791436] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-17T20:50:19.791477] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-17T20:50:19.791991] [DEBUG] [LOCAL ] PCF: Trimmed 13567 records to 9163 (keeping 200 days of data) [2025-10-17T20:50:19.843789] [DEBUG] [LOCAL ] PCF: Primary data saved (9163 records). [2025-10-17T20:50:19.843889] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-17T20:50:19.843963] [INFO ] [MAIN ] Update Progress: 1640/2368 symbols completed. PCF took 19.9s. Estimated remaining: 1h 42m 13s. Rate: 7.1 symbols/min [2025-10-17T20:50:20.436820] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:50:20.476364] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:50:20.525039] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:50:20.501618] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-10-17T20:50:20.530784] [DEBUG] [LOCAL ] PCN: No existing data file found in primary storage. [2025-10-17T20:50:20.530875] [WARN ] [MAIN ] PCN: No existing data found, performing full refresh instead. [2025-10-17T20:50:20.530623] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-10-17T20:50:20.552341] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-17T20:50:20.570494] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-17T20:50:20.552774] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-17T20:50:20.576522] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:50:20.576593] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-17T20:50:20.576710] [DEBUG] [LOCAL ] PCN: No primary data file found to delete. [2025-10-17T20:50:20.577174] [DEBUG] [LOCAL ] PCOR: No existing data file found in primary storage. [2025-10-17T20:50:20.577019] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-17T20:50:20.577091] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-17T20:50:20.582775] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-17T20:50:20.582687] [WARN ] [MAIN ] PCOR: No existing data found, performing full refresh instead. [2025-10-17T20:50:20.684548] [DEBUG] [LOCAL ] PCM: Loaded 6846 existing records from primary storage. [2025-10-17T20:50:20.662668] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-17T20:50:20.709088] [INFO ] [MAIN ] PCM: Loaded 6846 existing records. [2025-10-17T20:50:20.744778] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-17T20:50:20.888985] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-17T20:50:20.912719] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-17T20:50:21.294317] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:50:21.380265] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-17T20:50:21.406553] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-17T20:50:21.435609] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-10-17T20:50:21.460780] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-17T20:50:21.742310] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:50:21.784464] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-10-17T20:50:21.787272] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:50:21.801134] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-10-17T20:50:22.130537] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:50:22.131128] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-10-17T20:50:22.208911] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:50:22.209176] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-10-17T20:50:23.033291] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-17T20:50:23.035514] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-17T20:50:23.196270] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T20:50:23.201021] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-17T20:50:23.616902] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-17T20:50:23.908914] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-17T20:50:23.948882] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T20:50:23.959207] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-17T20:50:24.033223] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T20:50:24.758038] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-17T20:50:25.563205] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-17T20:50:25.568315] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T20:50:26.359208] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-17T20:50:26.360029] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T20:50:26.467079] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T20:50:27.158111] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-17T20:50:27.779206] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T20:50:27.958053] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-17T20:50:28.349282] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T20:50:28.758125] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-17T20:50:29.558081] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-17T20:50:29.613877] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T20:50:30.358032] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-17T20:50:30.375405] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T20:50:30.663118] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-17T20:50:31.158044] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-17T20:50:31.958005] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-17T20:50:32.191073] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T20:50:32.729126] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T20:50:32.758002] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-17T20:50:33.143251] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-17T20:50:33.558019] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-17T20:50:34.364852] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-17T20:50:34.399443] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-17T20:50:34.402843] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T20:50:35.158126] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-17T20:50:35.830366] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-17T20:50:35.958025] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-17T20:50:36.382809] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-17T20:50:36.758046] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-17T20:50:37.288134] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-17T20:50:37.558051] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-17T20:50:38.358085] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-17T20:50:38.413240] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T20:50:39.145956] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-17T20:50:39.157991] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-17T20:50:39.500314] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-17T20:50:39.880978] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-17T20:50:39.958044] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-17T20:50:40.758068] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-17T20:50:41.105050] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T20:50:41.558041] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-17T20:50:42.259983] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-17T20:50:42.357995] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-17T20:50:42.821285] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-17T20:50:43.158030] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-17T20:50:43.282245] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T20:50:43.957998] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-17T20:50:44.335805] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T20:50:44.658212] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T20:50:44.660315] [INFO ] [REMOTE ] PCM: Full fetch complete (10403 records). [2025-10-17T20:50:44.660391] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-17T20:50:44.763232] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-17T20:50:45.076668] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-17T20:50:45.076755] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-17T20:50:45.077024] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-17T20:50:45.077090] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-17T20:50:45.077549] [DEBUG] [LOCAL ] PCM: Trimmed 10403 records to 6870 (keeping 200 days of data) [2025-10-17T20:50:45.119721] [DEBUG] [LOCAL ] PCM: Primary data saved (6870 records). [2025-10-17T20:50:45.119835] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-17T20:50:45.119951] [INFO ] [MAIN ] Update Progress: 1641/2368 symbols completed. PCM took 25.3s. Estimated remaining: 1h 42m 12s. Rate: 7.1 symbols/min [2025-10-17T20:50:45.306853] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:50:45.320948] [DEBUG] [LOCAL ] PCQ: Loaded 12281 existing records from primary storage. [2025-10-17T20:50:45.321183] [INFO ] [MAIN ] PCQ: Loaded 12281 existing records. [2025-10-17T20:50:45.525971] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:50:45.526197] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-17T20:50:45.526256] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-17T20:50:45.526429] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-10-17T20:50:45.526516] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-17T20:50:45.563262] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-17T20:50:45.899586] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:50:46.358022] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-10-17T20:50:47.027373] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-17T20:50:47.157999] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-17T20:50:47.474860] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T20:50:47.494742] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T20:50:47.958008] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-17T20:50:48.758047] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-17T20:50:49.134555] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-17T20:50:49.558010] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-17T20:50:49.806421] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T20:50:49.956155] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-17T20:50:50.358066] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-17T20:50:51.157998] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-17T20:50:51.570131] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-17T20:50:51.958016] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-17T20:50:51.995488] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T20:50:52.432468] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T20:50:52.758055] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-17T20:50:52.880397] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-17T20:50:53.558038] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-17T20:50:54.356942] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T20:50:54.360100] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-17T20:50:54.384846] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T20:50:54.391061] [INFO ] [REMOTE ] PCOR: Full fetch complete (69431 records). [2025-10-17T20:50:54.391160] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-17T20:50:54.768617] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-10-17T20:50:54.768725] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-10-17T20:50:54.769751] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-10-17T20:50:54.769819] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-10-17T20:50:54.771224] [DEBUG] [LOCAL ] PCOR: Trimmed 69431 records to 48362 (keeping 200 days of data) [2025-10-17T20:50:55.050043] [DEBUG] [LOCAL ] PCOR: Primary data saved (48362 records). [2025-10-17T20:50:55.050181] [INFO ] [MAIN ] PCOR: Full history saved. [2025-10-17T20:50:55.050255] [INFO ] [MAIN ] Update Progress: 1642/2368 symbols completed. PCOR took 35.1s. Estimated remaining: 1h 42m 4s. Rate: 7.1 symbols/min [2025-10-17T20:50:55.163278] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-17T20:50:55.222402] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:50:55.222672] [DEBUG] [LOCAL ] PD: No existing data file found in primary storage. [2025-10-17T20:50:55.222791] [WARN ] [MAIN ] PD: No existing data found, performing full refresh instead. [2025-10-17T20:50:55.222926] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-17T20:50:55.222969] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-17T20:50:55.223010] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-17T20:50:55.223041] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-17T20:50:55.328998] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T20:50:55.580861] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:50:55.958063] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-17T20:50:56.554339] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-17T20:50:56.758003] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-17T20:50:56.978637] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-17T20:50:57.558030] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-10-17T20:50:57.981320] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T20:50:57.985700] [INFO ] [REMOTE ] PCN: Full fetch complete (34619 records). [2025-10-17T20:50:57.985846] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-17T20:50:58.372541] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-17T20:50:58.374770] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-10-17T20:50:58.374862] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-10-17T20:50:58.376481] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-10-17T20:50:58.376638] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-10-17T20:50:58.377764] [DEBUG] [LOCAL ] PCN: Trimmed 34619 records to 25556 (keeping 200 days of data) [2025-10-17T20:50:58.535243] [DEBUG] [LOCAL ] PCN: Primary data saved (25556 records). [2025-10-17T20:50:58.535401] [INFO ] [MAIN ] PCN: Full history saved. [2025-10-17T20:50:58.535499] [INFO ] [MAIN ] Update Progress: 1643/2368 symbols completed. PCN took 38.7s. Estimated remaining: 1h 41m 54s. Rate: 7.1 symbols/min [2025-10-17T20:50:58.715535] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:50:58.715734] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-17T20:50:58.715789] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-17T20:50:58.715901] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-17T20:50:58.715943] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-17T20:50:58.715985] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-17T20:50:58.716018] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-17T20:50:59.076149] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:50:59.158007] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-17T20:50:59.196571] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T20:50:59.957999] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-10-17T20:51:00.026742] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-17T20:51:00.256769] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-10-17T20:51:00.403293] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T20:51:00.410683] [INFO ] [REMOTE ] PCG: Full fetch complete (77898 records). [2025-10-17T20:51:00.410820] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-17T20:51:00.761887] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-17T20:51:00.811324] [DEBUG] [VALIDATOR ] PCG: All expected trading days are present. [2025-10-17T20:51:00.811450] [DEBUG] [VALIDATOR ] PCG: Primary data validation passed. [2025-10-17T20:51:00.812844] [INFO ] [MAIN ] PCG: Fetched primary data is valid. [2025-10-17T20:51:00.813051] [DEBUG] [LOCAL ] PCG: Saving primary data. [2025-10-17T20:51:00.814782] [DEBUG] [LOCAL ] PCG: Trimmed 77898 records to 54499 (keeping 200 days of data) [2025-10-17T20:51:01.166566] [DEBUG] [LOCAL ] PCG: Primary data saved (54499 records). [2025-10-17T20:51:01.166731] [INFO ] [MAIN ] PCG: Full history saved. [2025-10-17T20:51:01.166820] [INFO ] [MAIN ] Update Progress: 1644/2368 symbols completed. PCG took 41.3s. Estimated remaining: 1h 41m 43s. Rate: 7.1 symbols/min [2025-10-17T20:51:01.352862] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:51:01.353069] [DEBUG] [LOCAL ] PDI: No existing data file found in primary storage. [2025-10-17T20:51:01.353118] [WARN ] [MAIN ] PDI: No existing data found, performing full refresh instead. [2025-10-17T20:51:01.353253] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-17T20:51:01.353326] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-17T20:51:01.353411] [DEBUG] [LOCAL ] PDI: No primary data file found to delete. [2025-10-17T20:51:01.353477] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-17T20:51:01.566639] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-17T20:51:01.731147] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:51:01.975660] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-17T20:51:02.358067] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-10-17T20:51:02.504806] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T20:51:03.158046] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-17T20:51:03.684536] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-17T20:51:03.958023] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-17T20:51:04.493428] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-17T20:51:04.515224] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-17T20:51:04.758031] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-17T20:51:05.558032] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-17T20:51:06.358031] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-17T20:51:06.411850] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-17T20:51:06.628488] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T20:51:07.158057] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-17T20:51:07.877242] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T20:51:07.958050] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-17T20:51:08.248281] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T20:51:08.758031] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-17T20:51:09.557717] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T20:51:09.566822] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-17T20:51:09.764331] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T20:51:10.358075] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-17T20:51:11.158042] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-17T20:51:11.369700] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-17T20:51:11.649362] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-17T20:51:11.958000] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-17T20:51:12.061734] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T20:51:12.758030] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-17T20:51:13.558035] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-17T20:51:13.851343] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T20:51:14.358006] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-17T20:51:14.371197] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T20:51:14.373202] [INFO ] [REMOTE ] PCQ: Full fetch complete (16943 records). [2025-10-17T20:51:14.373302] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-17T20:51:14.661771] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-17T20:51:14.814277] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-17T20:51:14.814355] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-17T20:51:14.814788] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-17T20:51:14.814849] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-17T20:51:14.815404] [DEBUG] [LOCAL ] PCQ: Trimmed 16943 records to 12357 (keeping 200 days of data) [2025-10-17T20:51:14.880058] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-17T20:51:14.894565] [DEBUG] [LOCAL ] PCQ: Primary data saved (12357 records). [2025-10-17T20:51:14.894740] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-17T20:51:14.894835] [INFO ] [MAIN ] Update Progress: 1645/2368 symbols completed. PCQ took 29.8s. Estimated remaining: 1h 41m 36s. Rate: 7.1 symbols/min [2025-10-17T20:51:15.067303] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:51:15.067983] [DEBUG] [LOCAL ] PDM: No existing data file found in primary storage. [2025-10-17T20:51:15.068039] [WARN ] [MAIN ] PDM: No existing data found, performing full refresh instead. [2025-10-17T20:51:15.068205] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-17T20:51:15.068263] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-17T20:51:15.068306] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-17T20:51:15.068341] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-17T20:51:15.163305] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-17T20:51:15.439555] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:51:15.958091] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-10-17T20:51:16.758031] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-17T20:51:16.973063] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T20:51:17.502514] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T20:51:17.558031] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-17T20:51:18.358015] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-17T20:51:18.436212] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T20:51:18.778994] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-17T20:51:19.067320] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T20:51:19.157990] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-17T20:51:19.958073] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-17T20:51:20.614778] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T20:51:20.758071] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-17T20:51:21.558069] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-17T20:51:21.750681] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T20:51:22.358099] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-17T20:51:22.762130] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T20:51:23.058949] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T20:51:23.158082] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-17T20:51:23.574565] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T20:51:23.958101] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-17T20:51:24.239724] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-17T20:51:24.463700] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-17T20:51:24.758049] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-17T20:51:25.558040] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-17T20:51:26.357995] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-17T20:51:26.644164] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-17T20:51:26.810249] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T20:51:27.162517] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-17T20:51:27.167557] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T20:51:27.958024] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-17T20:51:28.758106] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-17T20:51:29.022457] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T20:51:29.074710] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-17T20:51:29.558041] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-17T20:51:29.839855] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T20:51:30.358038] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-17T20:51:31.158087] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-17T20:51:31.958051] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-17T20:51:32.026823] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-17T20:51:32.256750] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-17T20:51:32.367407] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-17T20:51:32.368365] [INFO ] [REMOTE ] PDCC: Full fetch complete (1372 records). [2025-10-17T20:51:32.368440] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-17T20:51:32.585510] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-17T20:51:32.585784] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-17T20:51:32.585845] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-17T20:51:32.585913] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-17T20:51:32.585989] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-17T20:51:32.586044] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-17T20:51:32.586088] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-17T20:51:32.586142] [INFO ] [MAIN ] Update Progress: 1646/2368 symbols completed. PDCC took 34.1s. Estimated remaining: 1h 41m 32s. Rate: 7.1 symbols/min [2025-10-17T20:51:32.749318] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:51:32.749424] [DEBUG] [LOCAL ] PDO: No existing data file found in primary storage. [2025-10-17T20:51:32.749460] [WARN ] [MAIN ] PDO: No existing data found, performing full refresh instead. [2025-10-17T20:51:32.749559] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-17T20:51:32.749597] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-17T20:51:32.749639] [DEBUG] [LOCAL ] PDO: No primary data file found to delete. [2025-10-17T20:51:32.749717] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-17T20:51:32.763319] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-17T20:51:33.061570] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-17T20:51:33.125688] [INFO ] [REMOTE ] PD: Full fetch complete (68254 records). [2025-10-17T20:51:33.130271] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:51:33.130529] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-17T20:51:33.510860] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-10-17T20:51:33.510941] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-10-17T20:51:33.512025] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-10-17T20:51:33.512090] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-10-17T20:51:33.513409] [DEBUG] [LOCAL ] PD: Trimmed 68254 records to 48923 (keeping 200 days of data) [2025-10-17T20:51:33.560579] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-17T20:51:33.795719] [DEBUG] [LOCAL ] PD: Primary data saved (48923 records). [2025-10-17T20:51:33.795861] [INFO ] [MAIN ] PD: Full history saved. [2025-10-17T20:51:33.795935] [INFO ] [MAIN ] Update Progress: 1647/2368 symbols completed. PD took 38.7s. Estimated remaining: 1h 41m 21s. Rate: 7.1 symbols/min [2025-10-17T20:51:33.965158] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:51:33.982623] [DEBUG] [LOCAL ] PDS: Loaded 17319 existing records from primary storage. [2025-10-17T20:51:33.982868] [INFO ] [MAIN ] PDS: Loaded 17319 existing records. [2025-10-17T20:51:34.157769] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:51:34.158024] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-17T20:51:34.158090] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-17T20:51:34.158481] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-10-17T20:51:34.158549] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-17T20:51:34.358046] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-10-17T20:51:34.512010] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:51:34.742134] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T20:51:35.098081] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T20:51:35.157996] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-17T20:51:35.958011] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-10-17T20:51:36.157541] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T20:51:36.626829] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T20:51:36.644194] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-17T20:51:36.758047] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-17T20:51:37.558032] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-17T20:51:38.315851] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T20:51:38.358040] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-17T20:51:38.611790] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-17T20:51:39.158043] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-17T20:51:39.827820] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-17T20:51:39.958030] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-17T20:51:40.572625] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T20:51:40.758007] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-17T20:51:41.147034] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T20:51:41.558047] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-17T20:51:42.335258] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-17T20:51:42.342255] [INFO ] [REMOTE ] PDM: Full fetch complete (57413 records). [2025-10-17T20:51:42.342379] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-17T20:51:42.368264] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-17T20:51:42.767272] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-10-17T20:51:42.767418] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-10-17T20:51:42.769117] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-10-17T20:51:42.769242] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-10-17T20:51:42.786314] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-17T20:51:42.792817] [DEBUG] [LOCAL ] PDM: Trimmed 57413 records to 40439 (keeping 200 days of data) [2025-10-17T20:51:43.013420] [DEBUG] [LOCAL ] PDM: Primary data saved (40439 records). [2025-10-17T20:51:43.013543] [INFO ] [MAIN ] PDM: Full history saved. [2025-10-17T20:51:43.013610] [INFO ] [MAIN ] Update Progress: 1648/2368 symbols completed. PDM took 28.1s. Estimated remaining: 1h 41m 12s. Rate: 7.1 symbols/min [2025-10-17T20:51:43.174670] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-17T20:51:43.185955] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:51:43.204297] [DEBUG] [LOCAL ] PDT: Loaded 17679 existing records from primary storage. [2025-10-17T20:51:43.204555] [INFO ] [MAIN ] PDT: Loaded 17679 existing records. [2025-10-17T20:51:43.377231] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:51:43.377424] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-17T20:51:43.377470] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-17T20:51:43.377687] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-10-17T20:51:43.377753] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-17T20:51:43.724216] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:51:43.818698] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T20:51:43.957981] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-10-17T20:51:44.758031] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-17T20:51:44.818301] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T20:51:44.825717] [INFO ] [REMOTE ] PDI: Full fetch complete (73118 records). [2025-10-17T20:51:44.825885] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-17T20:51:45.216347] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-10-17T20:51:45.216444] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-10-17T20:51:45.217684] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-10-17T20:51:45.217748] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-10-17T20:51:45.219118] [DEBUG] [LOCAL ] PDI: Trimmed 73118 records to 50903 (keeping 200 days of data) [2025-10-17T20:51:45.540219] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T20:51:45.555447] [DEBUG] [LOCAL ] PDI: Primary data saved (50903 records). [2025-10-17T20:51:45.555526] [INFO ] [MAIN ] PDI: Full history saved. [2025-10-17T20:51:45.555600] [INFO ] [MAIN ] Update Progress: 1649/2368 symbols completed. PDI took 44.4s. Estimated remaining: 1h 41m 1s. Rate: 7.1 symbols/min [2025-10-17T20:51:45.567178] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-17T20:51:45.731856] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:51:45.732000] [DEBUG] [LOCAL ] PDX: No existing data file found in primary storage. [2025-10-17T20:51:45.732036] [WARN ] [MAIN ] PDX: No existing data found, performing full refresh instead. [2025-10-17T20:51:45.732143] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-17T20:51:45.732183] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-17T20:51:45.732224] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-17T20:51:45.732255] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-17T20:51:46.044926] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-17T20:51:46.125587] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:51:46.357990] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-10-17T20:51:47.065540] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T20:51:47.158022] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-17T20:51:47.460725] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T20:51:47.958026] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-17T20:51:48.178020] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T20:51:48.758029] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-17T20:51:48.985442] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-17T20:51:49.558029] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-17T20:51:50.025438] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T20:51:50.358082] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-17T20:51:51.155344] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-17T20:51:51.163667] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-17T20:51:51.440194] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T20:51:51.958026] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-17T20:51:52.275520] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T20:51:52.758035] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-17T20:51:53.018692] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T20:51:53.557994] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-17T20:51:53.940579] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-17T20:51:54.358004] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-17T20:51:54.518210] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T20:51:55.158024] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-17T20:51:55.406771] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-17T20:51:55.958065] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-17T20:51:56.411711] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-17T20:51:56.758026] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-17T20:51:57.346567] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-17T20:51:57.558023] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-17T20:51:57.691732] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T20:51:58.358039] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-17T20:51:58.745015] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T20:51:59.158063] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-17T20:51:59.455168] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-17T20:51:59.958021] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-17T20:52:00.575537] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T20:52:00.758061] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-17T20:52:00.838982] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-17T20:52:01.558081] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-17T20:52:01.843887] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T20:52:02.358026] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-17T20:52:02.955520] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T20:52:03.158009] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-17T20:52:03.223715] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T20:52:03.226058] [INFO ] [REMOTE ] PDS: Full fetch complete (25684 records). [2025-10-17T20:52:03.226131] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-17T20:52:03.611182] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-10-17T20:52:03.611270] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-10-17T20:52:03.611815] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-10-17T20:52:03.611877] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-10-17T20:52:03.612514] [DEBUG] [LOCAL ] PDS: Trimmed 25684 records to 17407 (keeping 200 days of data) [2025-10-17T20:52:03.709879] [DEBUG] [LOCAL ] PDS: Primary data saved (17407 records). [2025-10-17T20:52:03.710011] [INFO ] [MAIN ] PDS: Full history saved. [2025-10-17T20:52:03.710121] [INFO ] [MAIN ] Update Progress: 1650/2368 symbols completed. PDS took 29.9s. Estimated remaining: 1h 40m 57s. Rate: 7.1 symbols/min [2025-10-17T20:52:03.875756] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:52:03.875933] [DEBUG] [LOCAL ] PEB: No existing data file found in primary storage. [2025-10-17T20:52:03.875972] [WARN ] [MAIN ] PEB: No existing data found, performing full refresh instead. [2025-10-17T20:52:03.876082] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-17T20:52:03.876147] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-17T20:52:03.876226] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-17T20:52:03.876285] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-17T20:52:03.964411] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-17T20:52:04.238527] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:52:04.636187] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T20:52:04.758029] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-17T20:52:05.111235] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T20:52:05.558039] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-17T20:52:06.293824] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T20:52:06.298811] [INFO ] [REMOTE ] PDO: Full fetch complete (46967 records). [2025-10-17T20:52:06.298969] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-17T20:52:06.365450] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-10-17T20:52:06.706953] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-17T20:52:06.711273] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-10-17T20:52:06.711901] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-10-17T20:52:06.712915] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-10-17T20:52:06.713316] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-10-17T20:52:06.714387] [DEBUG] [LOCAL ] PDO: Trimmed 46967 records to 31991 (keeping 200 days of data) [2025-10-17T20:52:06.906294] [DEBUG] [LOCAL ] PDO: Primary data saved (31991 records). [2025-10-17T20:52:06.906440] [INFO ] [MAIN ] PDO: Full history saved. [2025-10-17T20:52:06.906526] [INFO ] [MAIN ] Update Progress: 1651/2368 symbols completed. PDO took 34.3s. Estimated remaining: 1h 40m 47s. Rate: 7.1 symbols/min [2025-10-17T20:52:07.074406] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:52:07.074602] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-10-17T20:52:07.074660] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-10-17T20:52:07.074781] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-17T20:52:07.074822] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-17T20:52:07.074862] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-17T20:52:07.074893] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-17T20:52:07.163438] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-17T20:52:07.427065] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:52:07.958033] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-17T20:52:08.128594] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T20:52:08.179054] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T20:52:08.758050] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-17T20:52:09.018988] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T20:52:09.558022] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-17T20:52:10.358060] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-10-17T20:52:10.466793] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T20:52:10.579487] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T20:52:11.158054] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-17T20:52:11.958007] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-17T20:52:12.086895] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T20:52:12.167139] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T20:52:12.170820] [INFO ] [REMOTE ] PDT: Full fetch complete (25318 records). [2025-10-17T20:52:12.170930] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-17T20:52:12.567733] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-17T20:52:12.567839] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-17T20:52:12.568560] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-17T20:52:12.568602] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-17T20:52:12.569481] [DEBUG] [LOCAL ] PDT: Trimmed 25318 records to 17796 (keeping 200 days of data) [2025-10-17T20:52:12.689955] [DEBUG] [LOCAL ] PDT: Primary data saved (17796 records). [2025-10-17T20:52:12.690201] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-17T20:52:12.690312] [INFO ] [MAIN ] Update Progress: 1652/2368 symbols completed. PDT took 29.7s. Estimated remaining: 1h 40m 37s. Rate: 7.1 symbols/min [2025-10-17T20:52:12.763220] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-17T20:52:12.885950] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:52:12.886254] [DEBUG] [LOCAL ] PEN: No existing data file found in primary storage. [2025-10-17T20:52:12.886309] [WARN ] [MAIN ] PEN: No existing data found, performing full refresh instead. [2025-10-17T20:52:12.886469] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-17T20:52:12.886529] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-17T20:52:12.886587] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-17T20:52:12.886636] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-17T20:52:13.319479] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:52:13.558074] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-17T20:52:13.614214] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T20:52:14.358037] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-17T20:52:14.630552] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T20:52:14.687237] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-17T20:52:15.158117] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-17T20:52:15.958087] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-10-17T20:52:16.102974] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T20:52:16.114180] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-17T20:52:16.758028] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-17T20:52:17.200733] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T20:52:17.558061] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-17T20:52:18.358080] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-17T20:52:18.560692] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T20:52:19.158064] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-17T20:52:19.393541] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-17T20:52:19.855618] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T20:52:19.958008] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-17T20:52:20.653886] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T20:52:20.758031] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-17T20:52:21.330203] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T20:52:21.558006] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-17T20:52:22.358026] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-17T20:52:22.468992] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T20:52:23.145140] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T20:52:23.158063] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-17T20:52:23.246811] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T20:52:23.958029] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-17T20:52:24.758045] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-17T20:52:24.866993] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T20:52:25.558027] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-17T20:52:25.664312] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T20:52:25.859511] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T20:52:26.358100] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-17T20:52:26.463996] [DEBUG] [REMOTE ] PEN: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-17T20:52:26.464179] [WARN ] [REMOTE ] PEN: No data returned for month 2025-04 [2025-10-17T20:52:26.464267] [FATAL] [REMOTE ] PEN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:52:26.464391] [FATAL] [MAIN ] PEN: Failed to fetch primary data. [2025-10-17T20:52:26.464459] [WARN ] [MAIN ] PEN: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:52:26.464540] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-17T20:52:26.464614] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-17T20:52:26.464683] [INFO ] [LOCAL ] PEN: Starting deletion of derivative data. [2025-10-17T20:52:26.464743] [DEBUG] [LOCAL ] PEN: No derivative data file found to delete. [2025-10-17T20:52:26.464790] [INFO ] [MAIN ] Update Progress: 1653/2368 symbols completed. PEN took 13.8s. Estimated remaining: 1h 40m 31s. Rate: 7.1 symbols/min [2025-10-17T20:52:26.628571] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:52:26.640766] [DEBUG] [LOCAL ] PEO: Loaded 11228 existing records from primary storage. [2025-10-17T20:52:26.640991] [INFO ] [MAIN ] PEO: Loaded 11228 existing records. [2025-10-17T20:52:26.816367] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:52:26.816616] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-17T20:52:26.816712] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-17T20:52:26.816893] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-10-17T20:52:26.816959] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-17T20:52:27.164365] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-17T20:52:27.176852] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:52:27.426907] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T20:52:27.958038] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-17T20:52:28.758014] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-10-17T20:52:28.861114] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-17T20:52:28.863435] [INFO ] [REMOTE ] PDX: Full fetch complete (23728 records). [2025-10-17T20:52:28.863513] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-17T20:52:29.308668] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-10-17T20:52:29.309437] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-10-17T20:52:29.311625] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-10-17T20:52:29.310925] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-17T20:52:29.311805] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-10-17T20:52:29.324629] [DEBUG] [LOCAL ] PDX: Trimmed 23728 records to 14520 (keeping 200 days of data) [2025-10-17T20:52:29.415501] [DEBUG] [LOCAL ] PDX: Primary data saved (14520 records). [2025-10-17T20:52:29.415787] [INFO ] [MAIN ] PDX: Full history saved. [2025-10-17T20:52:29.415893] [INFO ] [MAIN ] Update Progress: 1654/2368 symbols completed. PDX took 43.9s. Estimated remaining: 1h 40m 20s. Rate: 7.1 symbols/min [2025-10-17T20:52:29.563125] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-17T20:52:29.616195] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-17T20:52:29.620050] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:52:29.640865] [DEBUG] [LOCAL ] PERF: Loaded 14465 existing records from primary storage. [2025-10-17T20:52:29.641132] [INFO ] [MAIN ] PERF: Loaded 14465 existing records. [2025-10-17T20:52:29.830682] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:52:29.831001] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-17T20:52:29.831061] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-17T20:52:29.831278] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-10-17T20:52:29.831336] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-17T20:52:30.206790] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:52:30.358046] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-17T20:52:31.158020] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-10-17T20:52:31.186102] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T20:52:31.300479] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T20:52:31.957994] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-17T20:52:32.277731] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T20:52:32.758020] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-17T20:52:32.842154] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T20:52:33.558031] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-17T20:52:34.358022] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-17T20:52:34.550151] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T20:52:35.158016] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-17T20:52:35.339897] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-17T20:52:35.339531] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T20:52:35.958031] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-17T20:52:36.750322] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T20:52:36.757266] [INFO ] [REMOTE ] PEB: Full fetch complete (73201 records). [2025-10-17T20:52:36.757388] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-17T20:52:36.769557] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-17T20:52:37.162198] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-10-17T20:52:37.162285] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-10-17T20:52:37.163421] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-10-17T20:52:37.163486] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-10-17T20:52:37.164909] [DEBUG] [LOCAL ] PEB: Trimmed 73201 records to 51448 (keeping 200 days of data) [2025-10-17T20:52:37.474605] [DEBUG] [LOCAL ] PEB: Primary data saved (51448 records). [2025-10-17T20:52:37.474761] [INFO ] [MAIN ] PEB: Full history saved. [2025-10-17T20:52:37.474837] [INFO ] [MAIN ] Update Progress: 1655/2368 symbols completed. PEB took 33.8s. Estimated remaining: 1h 40m 11s. Rate: 7.1 symbols/min [2025-10-17T20:52:37.566882] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-17T20:52:37.653884] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:52:37.654228] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-17T20:52:37.654287] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-17T20:52:37.654429] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-17T20:52:37.654507] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-17T20:52:37.654788] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-17T20:52:37.654891] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-17T20:52:38.035473] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:52:38.091024] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-17T20:52:38.103153] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T20:52:38.358032] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-10-17T20:52:38.587204] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-17T20:52:38.657325] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T20:52:38.657553] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-10-17T20:52:38.657663] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:52:38.657725] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-17T20:52:38.657785] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:52:38.657856] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-17T20:52:38.657935] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-17T20:52:38.657991] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-17T20:52:38.658035] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-17T20:52:38.658078] [INFO ] [MAIN ] Update Progress: 1656/2368 symbols completed. PEW took 1.2s. Estimated remaining: 1h 39m 60s. Rate: 7.1 symbols/min [2025-10-17T20:52:38.821241] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:52:38.829003] [DEBUG] [LOCAL ] PFD: Loaded 5434 existing records from primary storage. [2025-10-17T20:52:38.829224] [INFO ] [MAIN ] PFD: Loaded 5434 existing records. [2025-10-17T20:52:39.001099] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:52:39.001328] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-17T20:52:39.001378] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-17T20:52:39.001543] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-10-17T20:52:39.001600] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-17T20:52:39.161226] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-17T20:52:39.356537] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:52:39.958018] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-17T20:52:40.465856] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T20:52:40.758048] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-17T20:52:40.775493] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T20:52:41.558044] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-17T20:52:41.649908] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-17T20:52:42.358040] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-17T20:52:42.463760] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-17T20:52:43.158003] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-10-17T20:52:43.175579] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-17T20:52:43.958026] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-17T20:52:44.156817] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T20:52:44.758076] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-17T20:52:45.201416] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T20:52:45.405002] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T20:52:45.558035] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-17T20:52:46.355354] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-17T20:52:46.358009] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-17T20:52:47.158022] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-17T20:52:47.473265] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T20:52:47.836932] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T20:52:47.958046] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-10-17T20:52:48.758006] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-17T20:52:48.842099] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T20:52:49.558065] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-10-17T20:52:50.357999] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-17T20:52:50.498453] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T20:52:50.707281] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-17T20:52:51.158090] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-10. [2025-10-17T20:52:51.592248] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-17T20:52:51.958011] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-17T20:52:52.019382] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T20:52:52.021319] [INFO ] [REMOTE ] PEO: Full fetch complete (16231 records). [2025-10-17T20:52:52.021389] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-10-17T20:52:52.387278] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-10-17T20:52:52.387355] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-10-17T20:52:52.387775] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-10-17T20:52:52.387836] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-10-17T20:52:52.388365] [DEBUG] [LOCAL ] PEO: Trimmed 16231 records to 11292 (keeping 200 days of data) [2025-10-17T20:52:52.454893] [DEBUG] [LOCAL ] PEO: Primary data saved (11292 records). [2025-10-17T20:52:52.455047] [INFO ] [MAIN ] PEO: Full history saved. [2025-10-17T20:52:52.455143] [INFO ] [MAIN ] Update Progress: 1657/2368 symbols completed. PEO took 26.0s. Estimated remaining: 1h 39m 54s. Rate: 7.1 symbols/min [2025-10-17T20:52:52.620901] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:52:52.621116] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-10-17T20:52:52.621160] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-10-17T20:52:52.621279] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-17T20:52:52.621321] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-17T20:52:52.621363] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-17T20:52:52.621395] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-17T20:52:52.763188] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-17T20:52:52.963968] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T20:52:53.003330] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:52:53.463020] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-17T20:52:53.558065] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-17T20:52:54.358052] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-17T20:52:55.158047] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-17T20:52:55.354150] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T20:52:55.418202] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-17T20:52:55.843408] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-17T20:52:55.958079] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-17T20:52:56.758044] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-10-17T20:52:57.051583] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-17T20:52:57.054107] [INFO ] [REMOTE ] PERF: Full fetch complete (21899 records). [2025-10-17T20:52:57.054185] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-17T20:52:57.417599] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-10-17T20:52:57.417712] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-10-17T20:52:57.418176] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-10-17T20:52:57.418216] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-10-17T20:52:57.418814] [DEBUG] [LOCAL ] PERF: Trimmed 21899 records to 14549 (keeping 200 days of data) [2025-10-17T20:52:57.498894] [DEBUG] [LOCAL ] PERF: Primary data saved (14549 records). [2025-10-17T20:52:57.499024] [INFO ] [MAIN ] PERF: Full history saved. [2025-10-17T20:52:57.499102] [INFO ] [MAIN ] Update Progress: 1658/2368 symbols completed. PERF took 28.1s. Estimated remaining: 1h 39m 44s. Rate: 7.1 symbols/min [2025-10-17T20:52:57.563140] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-17T20:52:57.669011] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:52:57.669177] [DEBUG] [LOCAL ] PFGC: No existing data file found in primary storage. [2025-10-17T20:52:57.669216] [WARN ] [MAIN ] PFGC: No existing data found, performing full refresh instead. [2025-10-17T20:52:57.669333] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-17T20:52:57.669377] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-17T20:52:57.669420] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-17T20:52:57.669455] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-17T20:52:58.020129] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:52:58.358031] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-10-17T20:52:59.158051] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-17T20:52:59.388128] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-17T20:52:59.419005] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-17T20:52:59.426443] [INFO ] [REMOTE ] PEG: Full fetch complete (76965 records). [2025-10-17T20:52:59.426600] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-17T20:52:59.681272] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-17T20:52:59.848833] [DEBUG] [VALIDATOR ] PEG: All expected trading days are present. [2025-10-17T20:52:59.848921] [DEBUG] [VALIDATOR ] PEG: Primary data validation passed. [2025-10-17T20:52:59.850071] [INFO ] [MAIN ] PEG: Fetched primary data is valid. [2025-10-17T20:52:59.850135] [DEBUG] [LOCAL ] PEG: Saving primary data. [2025-10-17T20:52:59.851532] [DEBUG] [LOCAL ] PEG: Trimmed 76965 records to 53920 (keeping 200 days of data) [2025-10-17T20:52:59.960214] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-17T20:53:00.092603] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T20:53:00.216468] [DEBUG] [LOCAL ] PEG: Primary data saved (53920 records). [2025-10-17T20:53:00.216614] [INFO ] [MAIN ] PEG: Full history saved. [2025-10-17T20:53:00.216719] [INFO ] [MAIN ] Update Progress: 1659/2368 symbols completed. PEG took 53.3s. Estimated remaining: 1h 39m 33s. Rate: 7.1 symbols/min [2025-10-17T20:53:00.383677] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:53:00.383848] [DEBUG] [LOCAL ] PFH: No existing data file found in primary storage. [2025-10-17T20:53:00.383886] [WARN ] [MAIN ] PFH: No existing data found, performing full refresh instead. [2025-10-17T20:53:00.384001] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-17T20:53:00.384041] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-17T20:53:00.384081] [DEBUG] [LOCAL ] PFH: No primary data file found to delete. [2025-10-17T20:53:00.384113] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-17T20:53:00.743632] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:53:00.757989] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-10-17T20:53:00.802175] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T20:53:01.558035] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-17T20:53:01.639423] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-17T20:53:02.358037] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-17T20:53:03.158051] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-17T20:53:03.958013] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-17T20:53:03.981922] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T20:53:04.021130] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T20:53:04.230272] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-17T20:53:04.758018] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-17T20:53:04.875134] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-17T20:53:05.471319] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-17T20:53:05.558009] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-17T20:53:06.358086] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-17T20:53:07.038529] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-17T20:53:07.158075] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-17T20:53:07.816979] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-17T20:53:07.920677] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-17T20:53:07.958037] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-17T20:53:08.758129] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-17T20:53:09.558115] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-17T20:53:10.314728] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-17T20:53:10.357079] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-17T20:53:10.359367] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-17T20:53:10.361850] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T20:53:11.158023] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-17T20:53:11.211549] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T20:53:11.861277] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T20:53:11.862565] [INFO ] [REMOTE ] PFD: Full fetch complete (7444 records). [2025-10-17T20:53:11.862633] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-17T20:53:11.961575] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-17T20:53:12.215795] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-10-17T20:53:12.215866] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-10-17T20:53:12.216020] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-10-17T20:53:12.216057] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-10-17T20:53:12.216582] [DEBUG] [LOCAL ] PFD: Trimmed 7444 records to 5443 (keeping 200 days of data) [2025-10-17T20:53:12.248992] [DEBUG] [LOCAL ] PFD: Primary data saved (5443 records). [2025-10-17T20:53:12.249061] [INFO ] [MAIN ] PFD: Full history saved. [2025-10-17T20:53:12.249129] [INFO ] [MAIN ] Update Progress: 1660/2368 symbols completed. PFD took 33.6s. Estimated remaining: 1h 39m 26s. Rate: 7.1 symbols/min [2025-10-17T20:53:12.413434] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:53:12.428318] [DEBUG] [LOCAL ] PFL: Loaded 14464 existing records from primary storage. [2025-10-17T20:53:12.428526] [INFO ] [MAIN ] PFL: Loaded 14464 existing records. [2025-10-17T20:53:12.600014] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:53:12.600214] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-17T20:53:12.600261] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-17T20:53:12.600411] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-10-17T20:53:12.600448] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-17T20:53:12.764097] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-17T20:53:12.953831] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:53:13.557982] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-17T20:53:13.690051] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T20:53:13.732532] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T20:53:14.358041] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-17T20:53:15.116919] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-17T20:53:15.157999] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-17T20:53:15.958025] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-10-17T20:53:16.044687] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-17T20:53:16.342748] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-17T20:53:16.758052] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-17T20:53:17.293017] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T20:53:17.558045] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-17T20:53:17.573447] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-17T20:53:18.358036] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-17T20:53:19.158086] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-17T20:53:19.372168] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T20:53:19.788195] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-17T20:53:19.958015] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-17T20:53:20.496176] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.94 seconds). [2025-10-17T20:53:20.758077] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-17T20:53:20.820841] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T20:53:21.558039] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-17T20:53:22.358069] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-17T20:53:22.512159] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T20:53:23.087742] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-17T20:53:23.158051] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-17T20:53:23.958093] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-17T20:53:24.225061] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-10-17T20:53:24.758101] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-17T20:53:24.980837] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T20:53:25.023777] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T20:53:25.558122] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-17T20:53:26.358089] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-17T20:53:26.456834] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-17T20:53:27.006762] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-17T20:53:27.007923] [INFO ] [REMOTE ] PFH: Full fetch complete (9749 records). [2025-10-17T20:53:27.007999] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-17T20:53:27.163109] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-17T20:53:27.399972] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-10-17T20:53:27.400175] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-10-17T20:53:27.400834] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-10-17T20:53:27.400925] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-10-17T20:53:27.401568] [DEBUG] [LOCAL ] PFH: Trimmed 9749 records to 6643 (keeping 200 days of data) [2025-10-17T20:53:27.446070] [DEBUG] [LOCAL ] PFH: Primary data saved (6643 records). [2025-10-17T20:53:27.446279] [INFO ] [MAIN ] PFH: Full history saved. [2025-10-17T20:53:27.446484] [INFO ] [MAIN ] Update Progress: 1661/2368 symbols completed. PFH took 27.2s. Estimated remaining: 1h 39m 21s. Rate: 7.1 symbols/min [2025-10-17T20:53:27.626912] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:53:27.627198] [DEBUG] [LOCAL ] PFLT: No existing data file found in primary storage. [2025-10-17T20:53:27.627340] [WARN ] [MAIN ] PFLT: No existing data found, performing full refresh instead. [2025-10-17T20:53:27.627606] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-17T20:53:27.627695] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-17T20:53:27.627759] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-17T20:53:27.627796] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-17T20:53:27.796138] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (3.04 seconds). [2025-10-17T20:53:27.963740] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-17T20:53:28.061820] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:53:28.758029] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-17T20:53:28.908546] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T20:53:29.558076] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-17T20:53:29.611713] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T20:53:30.358025] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-10-17T20:53:30.407876] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-17T20:53:31.157994] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-17T20:53:31.251497] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T20:53:31.958059] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-17T20:53:32.101426] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-17T20:53:32.133675] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T20:53:32.758075] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-17T20:53:33.557995] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-17T20:53:33.749228] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T20:53:34.358043] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-17T20:53:34.682467] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T20:53:35.158027] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-17T20:53:35.362487] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-17T20:53:35.958035] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-17T20:53:36.162533] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T20:53:36.187041] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-17T20:53:36.758061] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-17T20:53:37.558050] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-17T20:53:37.813489] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-17T20:53:37.816517] [INFO ] [REMOTE ] PFL: Full fetch complete (20671 records). [2025-10-17T20:53:37.816588] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-17T20:53:38.171773] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-17T20:53:38.171852] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-17T20:53:38.172313] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-17T20:53:38.172354] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-17T20:53:38.173185] [DEBUG] [LOCAL ] PFL: Trimmed 20671 records to 14622 (keeping 200 days of data) [2025-10-17T20:53:38.260924] [DEBUG] [LOCAL ] PFL: Primary data saved (14622 records). [2025-10-17T20:53:38.261052] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-17T20:53:38.261131] [INFO ] [MAIN ] Update Progress: 1662/2368 symbols completed. PFL took 26.0s. Estimated remaining: 1h 39m 13s. Rate: 7.1 symbols/min [2025-10-17T20:53:38.359497] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-17T20:53:38.432831] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:53:38.454335] [DEBUG] [LOCAL ] PFN: Loaded 22569 existing records from primary storage. [2025-10-17T20:53:38.454554] [INFO ] [MAIN ] PFN: Loaded 22569 existing records. [2025-10-17T20:53:38.638072] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:53:38.638420] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-17T20:53:38.638489] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-17T20:53:38.638751] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-10-17T20:53:38.638807] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-17T20:53:38.938332] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (2.98 seconds). [2025-10-17T20:53:39.025501] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:53:39.025598] [INFO ] [REMOTE ] PFE: Full fetch complete (77993 records). [2025-10-17T20:53:39.026165] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-17T20:53:39.163996] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-10-17T20:53:39.437294] [DEBUG] [VALIDATOR ] PFE: All expected trading days are present. [2025-10-17T20:53:39.439766] [DEBUG] [VALIDATOR ] PFE: Primary data validation passed. [2025-10-17T20:53:39.440995] [INFO ] [MAIN ] PFE: Fetched primary data is valid. [2025-10-17T20:53:39.442494] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T20:53:39.441612] [DEBUG] [LOCAL ] PFE: Saving primary data. [2025-10-17T20:53:39.452153] [DEBUG] [LOCAL ] PFE: Trimmed 77993 records to 54593 (keeping 200 days of data) [2025-10-17T20:53:39.789492] [DEBUG] [LOCAL ] PFE: Primary data saved (54593 records). [2025-10-17T20:53:39.789662] [INFO ] [MAIN ] PFE: Full history saved. [2025-10-17T20:53:39.789760] [INFO ] [MAIN ] Update Progress: 1663/2368 symbols completed. PFE took 47.3s. Estimated remaining: 1h 39m 2s. Rate: 7.1 symbols/min [2025-10-17T20:53:39.961191] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:53:39.961465] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-17T20:53:39.970532] [DEBUG] [LOCAL ] PFO: Loaded 6121 existing records from primary storage. [2025-10-17T20:53:39.970868] [INFO ] [MAIN ] PFO: Loaded 6121 existing records. [2025-10-17T20:53:40.089797] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T20:53:40.143181] [INFO ] [REMOTE ] PFGC: Full fetch complete (67881 records). [2025-10-17T20:53:40.148567] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-17T20:53:40.255914] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:53:40.286964] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-17T20:53:40.287071] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-17T20:53:40.287333] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-10-17T20:53:40.292745] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-17T20:53:40.752382] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T20:53:40.796831] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-17T20:53:40.933387] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-10-17T20:53:40.951681] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-10-17T20:53:40.952838] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-10-17T20:53:40.969798] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-10-17T20:53:40.974688] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:53:40.975770] [DEBUG] [LOCAL ] PFGC: Trimmed 67881 records to 47796 (keeping 200 days of data) [2025-10-17T20:53:41.257772] [DEBUG] [LOCAL ] PFGC: Primary data saved (47796 records). [2025-10-17T20:53:41.257899] [INFO ] [MAIN ] PFGC: Full history saved. [2025-10-17T20:53:41.257972] [INFO ] [MAIN ] Update Progress: 1664/2368 symbols completed. PFGC took 43.8s. Estimated remaining: 1h 38m 50s. Rate: 7.1 symbols/min [2025-10-17T20:53:41.428196] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:53:41.428493] [DEBUG] [LOCAL ] PFS: No existing data file found in primary storage. [2025-10-17T20:53:41.436295] [WARN ] [MAIN ] PFS: No existing data found, performing full refresh instead. [2025-10-17T20:53:41.450121] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-17T20:53:41.450182] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-17T20:53:41.450816] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-17T20:53:41.451674] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-17T20:53:41.451596] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T20:53:41.559107] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-10-17T20:53:41.819019] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:53:41.981204] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T20:53:42.358021] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-17T20:53:42.504289] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T20:53:43.158010] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-10-17T20:53:43.958073] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-17T20:53:44.191829] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T20:53:44.559557] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T20:53:44.758012] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-17T20:53:45.027838] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T20:53:45.558065] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-17T20:53:46.045331] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T20:53:46.358041] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-17T20:53:46.648703] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T20:53:47.158064] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-17T20:53:47.797156] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T20:53:47.958141] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-17T20:53:48.676320] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T20:53:48.758029] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-17T20:53:49.181454] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T20:53:49.558041] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-17T20:53:50.358015] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-17T20:53:50.510924] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T20:53:50.604781] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T20:53:51.083859] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T20:53:51.158051] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-17T20:53:51.842132] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T20:53:51.957985] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-17T20:53:52.646928] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-17T20:53:52.757993] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-17T20:53:53.558013] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-17T20:53:54.276927] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T20:53:54.348471] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T20:53:54.358044] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-17T20:53:55.158042] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-17T20:53:55.848979] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T20:53:55.958013] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-17T20:53:55.990369] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T20:53:56.758078] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-17T20:53:57.457237] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T20:53:57.558044] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-17T20:53:57.845495] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T20:53:58.358001] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-17T20:53:58.856712] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-17T20:53:59.158058] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-17T20:53:59.241789] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T20:53:59.958019] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-17T20:54:00.547947] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T20:54:00.758114] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-17T20:54:01.344208] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T20:54:01.539925] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-17T20:54:01.557985] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-17T20:54:02.358110] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-17T20:54:02.456734] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T20:54:03.158050] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-17T20:54:03.858698] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T20:54:03.958055] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-17T20:54:04.591826] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T20:54:04.758024] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-17T20:54:05.431513] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T20:54:05.557988] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-17T20:54:05.944937] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-17T20:54:06.358079] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-17T20:54:06.948348] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-17T20:54:07.158016] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-17T20:54:07.829973] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T20:54:07.958012] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-17T20:54:08.495269] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T20:54:08.758137] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-17T20:54:09.558017] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-17T20:54:09.833221] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T20:54:09.949576] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-17T20:54:09.953394] [INFO ] [REMOTE ] PFN: Full fetch complete (31284 records). [2025-10-17T20:54:09.953468] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-17T20:54:10.316515] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-17T20:54:10.316587] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-17T20:54:10.317199] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-17T20:54:10.317259] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-17T20:54:10.318057] [DEBUG] [LOCAL ] PFN: Trimmed 31284 records to 22752 (keeping 200 days of data) [2025-10-17T20:54:10.366954] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-17T20:54:10.455613] [DEBUG] [LOCAL ] PFN: Primary data saved (22752 records). [2025-10-17T20:54:10.455728] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-17T20:54:10.455813] [INFO ] [MAIN ] Update Progress: 1665/2368 symbols completed. PFN took 32.2s. Estimated remaining: 1h 38m 51s. Rate: 7.1 symbols/min [2025-10-17T20:54:10.628050] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:54:10.628234] [DEBUG] [LOCAL ] PFSI: No existing data file found in primary storage. [2025-10-17T20:54:10.628273] [WARN ] [MAIN ] PFSI: No existing data found, performing full refresh instead. [2025-10-17T20:54:10.628412] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-17T20:54:10.628461] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-17T20:54:10.628503] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-17T20:54:10.628534] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-17T20:54:11.013200] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:54:11.022951] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T20:54:11.028879] [INFO ] [REMOTE ] PFS: Full fetch complete (52251 records). [2025-10-17T20:54:11.028993] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-17T20:54:11.165255] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-10-17T20:54:11.441013] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T20:54:11.441195] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-10-17T20:54:11.441306] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-10-17T20:54:11.444954] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-10-17T20:54:11.445018] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-10-17T20:54:11.446068] [DEBUG] [LOCAL ] PFS: Trimmed 52251 records to 36502 (keeping 200 days of data) [2025-10-17T20:54:11.662505] [DEBUG] [LOCAL ] PFS: Primary data saved (36502 records). [2025-10-17T20:54:11.662670] [INFO ] [MAIN ] PFS: Full history saved. [2025-10-17T20:54:11.662771] [INFO ] [MAIN ] Update Progress: 1666/2368 symbols completed. PFS took 30.4s. Estimated remaining: 1h 38m 39s. Rate: 7.1 symbols/min [2025-10-17T20:54:11.828213] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:54:11.828379] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-17T20:54:11.828418] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-17T20:54:11.828524] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-17T20:54:11.828565] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-17T20:54:11.828605] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-17T20:54:11.828637] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-17T20:54:11.965541] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-17T20:54:12.181527] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:54:12.294035] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T20:54:12.758065] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-17T20:54:12.768496] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T20:54:12.769907] [INFO ] [REMOTE ] PFO: Full fetch complete (7844 records). [2025-10-17T20:54:12.769979] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-17T20:54:13.119962] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-17T20:54:13.120036] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-17T20:54:13.120217] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-17T20:54:13.120256] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-17T20:54:13.120671] [DEBUG] [LOCAL ] PFO: Trimmed 7844 records to 6140 (keeping 200 days of data) [2025-10-17T20:54:13.156258] [DEBUG] [LOCAL ] PFO: Primary data saved (6140 records). [2025-10-17T20:54:13.156369] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-17T20:54:13.156452] [INFO ] [MAIN ] Update Progress: 1667/2368 symbols completed. PFO took 33.4s. Estimated remaining: 1h 38m 28s. Rate: 7.1 symbols/min [2025-10-17T20:54:13.324919] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:54:13.340999] [DEBUG] [LOCAL ] PGP: Loaded 5735 existing records from primary storage. [2025-10-17T20:54:13.341195] [INFO ] [MAIN ] PGP: Loaded 5735 existing records. [2025-10-17T20:54:13.527337] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:54:13.527551] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-17T20:54:13.527613] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-17T20:54:13.527867] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-10-17T20:54:13.527924] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-17T20:54:13.563134] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-17T20:54:13.885897] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:54:13.984991] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T20:54:14.358065] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-10-17T20:54:15.158026] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-17T20:54:15.489484] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T20:54:15.497064] [INFO ] [REMOTE ] PFLT: Full fetch complete (64363 records). [2025-10-17T20:54:15.497214] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-17T20:54:15.935478] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-10-17T20:54:15.935613] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-10-17T20:54:15.938237] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-10-17T20:54:15.938371] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-10-17T20:54:15.940359] [DEBUG] [LOCAL ] PFLT: Trimmed 64363 records to 44975 (keeping 200 days of data) [2025-10-17T20:54:16.023023] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-10-17T20:54:16.360580] [DEBUG] [LOCAL ] PFLT: Primary data saved (44975 records). [2025-10-17T20:54:16.360967] [INFO ] [MAIN ] PFLT: Full history saved. [2025-10-17T20:54:16.361098] [INFO ] [MAIN ] Update Progress: 1668/2368 symbols completed. PFLT took 48.9s. Estimated remaining: 1h 38m 17s. Rate: 7.1 symbols/min [2025-10-17T20:54:16.607352] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:54:16.608123] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-10-17T20:54:16.608491] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-10-17T20:54:16.609118] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-17T20:54:16.609300] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-17T20:54:16.623496] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-17T20:54:16.630809] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-17T20:54:16.634340] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-17T20:54:16.635963] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T20:54:16.758241] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-17T20:54:16.818381] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-10-17T20:54:17.087088] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:54:17.481563] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T20:54:17.558025] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-17T20:54:18.187119] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T20:54:18.358017] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-17T20:54:18.982984] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-17T20:54:19.158041] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-17T20:54:19.947608] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-17T20:54:19.957979] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-17T20:54:20.612418] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-17T20:54:20.758074] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-17T20:54:21.299317] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-17T20:54:21.558025] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-17T20:54:22.338893] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-17T20:54:22.358073] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-10-17T20:54:23.158056] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-17T20:54:23.958006] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-17T20:54:24.130690] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T20:54:24.758033] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-17T20:54:25.298225] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T20:54:25.302141] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-17T20:54:25.557998] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-17T20:54:26.358080] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-17T20:54:26.475573] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T20:54:27.158044] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-17T20:54:27.491955] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-17T20:54:27.697857] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-17T20:54:27.890445] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T20:54:27.958021] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-17T20:54:28.746297] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T20:54:28.757980] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-17T20:54:29.482175] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T20:54:29.484092] [INFO ] [REMOTE ] PGP: Full fetch complete (7916 records). [2025-10-17T20:54:29.484180] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-17T20:54:29.563165] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-17T20:54:29.836146] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-17T20:54:29.836227] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-17T20:54:29.836383] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-17T20:54:29.836422] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-17T20:54:29.836841] [DEBUG] [LOCAL ] PGP: Trimmed 7916 records to 5778 (keeping 200 days of data) [2025-10-17T20:54:29.874332] [DEBUG] [LOCAL ] PGP: Primary data saved (5778 records). [2025-10-17T20:54:29.874468] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-17T20:54:29.874615] [INFO ] [MAIN ] Update Progress: 1669/2368 symbols completed. PGP took 16.7s. Estimated remaining: 1h 38m 11s. Rate: 7.1 symbols/min [2025-10-17T20:54:30.039891] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:54:30.084996] [DEBUG] [LOCAL ] PGRE: Loaded 47344 existing records from primary storage. [2025-10-17T20:54:30.085291] [INFO ] [MAIN ] PGRE: Loaded 47344 existing records. [2025-10-17T20:54:30.257283] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:54:30.257465] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-17T20:54:30.257523] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-17T20:54:30.257821] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-10-17T20:54:30.257888] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-17T20:54:30.363118] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-17T20:54:30.615283] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:54:31.158046] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-17T20:54:31.602053] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-17T20:54:31.647304] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-17T20:54:31.958021] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-10-17T20:54:32.758041] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-17T20:54:33.558356] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-17T20:54:33.559850] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T20:54:33.628481] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-17T20:54:34.357996] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-17T20:54:34.732672] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-17T20:54:34.967505] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-17T20:54:35.158029] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-17T20:54:35.958039] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-17T20:54:36.535199] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T20:54:36.596541] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-17T20:54:36.757991] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-17T20:54:37.558045] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-17T20:54:38.040253] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-17T20:54:38.358024] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-17T20:54:39.070992] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-17T20:54:39.134911] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-17T20:54:39.157983] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-17T20:54:39.958030] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-17T20:54:40.453157] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-17T20:54:40.758059] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-17T20:54:41.293388] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T20:54:41.379082] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-17T20:54:41.558048] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-17T20:54:42.133276] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T20:54:42.358124] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-17T20:54:43.163330] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-17T20:54:43.176855] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T20:54:43.732780] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T20:54:43.958000] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-17T20:54:44.758002] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-17T20:54:45.140707] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-17T20:54:45.563209] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-17T20:54:45.579909] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T20:54:46.358042] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-17T20:54:46.919100] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T20:54:46.924317] [INFO ] [REMOTE ] PFSI: Full fetch complete (41539 records). [2025-10-17T20:54:46.924438] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-17T20:54:47.165075] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-17T20:54:47.317348] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-10-17T20:54:47.317455] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-10-17T20:54:47.318439] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-10-17T20:54:47.318525] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-10-17T20:54:47.319762] [DEBUG] [LOCAL ] PFSI: Trimmed 41539 records to 29716 (keeping 200 days of data) [2025-10-17T20:54:47.439201] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-17T20:54:47.542627] [DEBUG] [LOCAL ] PFSI: Primary data saved (29716 records). [2025-10-17T20:54:47.542779] [INFO ] [MAIN ] PFSI: Full history saved. [2025-10-17T20:54:47.542851] [INFO ] [MAIN ] Update Progress: 1670/2368 symbols completed. PFSI took 37.1s. Estimated remaining: 1h 38m 6s. Rate: 7.1 symbols/min [2025-10-17T20:54:47.710812] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:54:47.718880] [DEBUG] [LOCAL ] PGZ: Loaded 5570 existing records from primary storage. [2025-10-17T20:54:47.719055] [INFO ] [MAIN ] PGZ: Loaded 5570 existing records. [2025-10-17T20:54:47.907444] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:54:47.907935] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-17T20:54:47.908015] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-17T20:54:47.908315] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-10-17T20:54:47.908406] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-17T20:54:47.967607] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-17T20:54:48.203318] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T20:54:48.351867] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:54:48.758114] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-17T20:54:49.435344] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-17T20:54:49.563229] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-10-17T20:54:49.577501] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T20:54:50.358078] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-17T20:54:50.388372] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-17T20:54:50.417601] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T20:54:51.158031] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-17T20:54:51.958031] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-17T20:54:52.123614] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T20:54:52.598838] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-17T20:54:52.758040] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-17T20:54:53.558060] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-17T20:54:53.640556] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T20:54:54.250369] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-17T20:54:54.358084] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-17T20:54:54.576802] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T20:54:55.158033] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-17T20:54:55.857332] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-17T20:54:55.958035] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-17T20:54:56.609548] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-17T20:54:56.617114] [INFO ] [REMOTE ] PG: Full fetch complete (77927 records). [2025-10-17T20:54:56.617271] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-17T20:54:56.767803] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-17T20:54:57.021159] [DEBUG] [VALIDATOR ] PG: All expected trading days are present. [2025-10-17T20:54:57.021258] [DEBUG] [VALIDATOR ] PG: Primary data validation passed. [2025-10-17T20:54:57.022425] [INFO ] [MAIN ] PG: Fetched primary data is valid. [2025-10-17T20:54:57.022493] [DEBUG] [LOCAL ] PG: Saving primary data. [2025-10-17T20:54:57.024017] [DEBUG] [LOCAL ] PG: Trimmed 77927 records to 54533 (keeping 200 days of data) [2025-10-17T20:54:57.369053] [DEBUG] [LOCAL ] PG: Primary data saved (54533 records). [2025-10-17T20:54:57.369253] [INFO ] [MAIN ] PG: Full history saved. [2025-10-17T20:54:57.369362] [INFO ] [MAIN ] Update Progress: 1671/2368 symbols completed. PG took 45.7s. Estimated remaining: 1h 37m 59s. Rate: 7.1 symbols/min [2025-10-17T20:54:57.543776] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:54:57.543947] [DEBUG] [LOCAL ] PH: No existing data file found in primary storage. [2025-10-17T20:54:57.543984] [WARN ] [MAIN ] PH: No existing data found, performing full refresh instead. [2025-10-17T20:54:57.544097] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-17T20:54:57.544139] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-17T20:54:57.544182] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-17T20:54:57.544215] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-17T20:54:57.580473] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-17T20:54:57.616133] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T20:54:57.858487] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T20:54:57.978824] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:54:58.358146] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-17T20:54:58.999803] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-17T20:54:59.158023] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-17T20:54:59.511178] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-17T20:54:59.767077] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-17T20:54:59.958049] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-10-17T20:55:00.758095] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-17T20:55:01.558052] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-17T20:55:01.693728] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T20:55:02.358061] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-17T20:55:02.871866] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-17T20:55:02.879596] [INFO ] [REMOTE ] PGR: Full fetch complete (76762 records). [2025-10-17T20:55:02.879773] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-17T20:55:03.160882] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-17T20:55:03.286424] [DEBUG] [VALIDATOR ] PGR: All expected trading days are present. [2025-10-17T20:55:03.286583] [DEBUG] [VALIDATOR ] PGR: Primary data validation passed. [2025-10-17T20:55:03.287825] [INFO ] [MAIN ] PGR: Fetched primary data is valid. [2025-10-17T20:55:03.287911] [DEBUG] [LOCAL ] PGR: Saving primary data. [2025-10-17T20:55:03.289738] [DEBUG] [LOCAL ] PGR: Trimmed 76762 records to 53647 (keeping 200 days of data) [2025-10-17T20:55:03.410094] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T20:55:03.665096] [DEBUG] [LOCAL ] PGR: Primary data saved (53647 records). [2025-10-17T20:55:03.665280] [INFO ] [MAIN ] PGR: Full history saved. [2025-10-17T20:55:03.665388] [INFO ] [MAIN ] Update Progress: 1672/2368 symbols completed. PGR took 47.3s. Estimated remaining: 1h 37m 49s. Rate: 7.1 symbols/min [2025-10-17T20:55:03.838039] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:55:03.838323] [DEBUG] [LOCAL ] PHG: No existing data file found in primary storage. [2025-10-17T20:55:03.838373] [WARN ] [MAIN ] PHG: No existing data found, performing full refresh instead. [2025-10-17T20:55:03.838486] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-17T20:55:03.838529] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-17T20:55:03.838572] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-17T20:55:03.838610] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-17T20:55:03.977828] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-17T20:55:04.124833] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-17T20:55:04.214831] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:55:04.237322] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T20:55:04.758042] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-10-17T20:55:05.558001] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-17T20:55:05.636730] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T20:55:05.643080] [INFO ] [REMOTE ] PGRE: Full fetch complete (64597 records). [2025-10-17T20:55:05.643208] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-17T20:55:06.014885] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-10-17T20:55:06.014957] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-10-17T20:55:06.015927] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-10-17T20:55:06.015988] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-10-17T20:55:06.017218] [DEBUG] [LOCAL ] PGRE: Trimmed 64597 records to 47694 (keeping 200 days of data) [2025-10-17T20:55:06.240505] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-17T20:55:06.290940] [DEBUG] [LOCAL ] PGRE: Primary data saved (47694 records). [2025-10-17T20:55:06.291061] [INFO ] [MAIN ] PGRE: Full history saved. [2025-10-17T20:55:06.291160] [INFO ] [MAIN ] Update Progress: 1673/2368 symbols completed. PGRE took 36.4s. Estimated remaining: 1h 37m 38s. Rate: 7.1 symbols/min [2025-10-17T20:55:06.359765] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-17T20:55:06.463447] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:55:06.480060] [DEBUG] [LOCAL ] PHI: Loaded 15302 existing records from primary storage. [2025-10-17T20:55:06.480296] [INFO ] [MAIN ] PHI: Loaded 15302 existing records. [2025-10-17T20:55:06.675566] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T20:55:06.679964] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:55:06.688709] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-17T20:55:06.688768] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-17T20:55:06.688934] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-10-17T20:55:06.688989] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-17T20:55:07.035937] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:55:07.158003] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-10-17T20:55:07.958043] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-17T20:55:08.102351] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T20:55:08.228535] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T20:55:08.758111] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-17T20:55:09.469870] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-17T20:55:09.558030] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-17T20:55:09.629450] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T20:55:10.244787] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-17T20:55:10.246092] [INFO ] [REMOTE ] PGZ: Full fetch complete (8266 records). [2025-10-17T20:55:10.246161] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-17T20:55:10.358294] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-17T20:55:10.627472] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-17T20:55:10.627581] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-17T20:55:10.627861] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-17T20:55:10.627920] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-17T20:55:10.628362] [DEBUG] [LOCAL ] PGZ: Trimmed 8266 records to 5636 (keeping 200 days of data) [2025-10-17T20:55:10.663446] [DEBUG] [LOCAL ] PGZ: Primary data saved (5636 records). [2025-10-17T20:55:10.663586] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-17T20:55:10.663695] [INFO ] [MAIN ] Update Progress: 1674/2368 symbols completed. PGZ took 23.1s. Estimated remaining: 1h 37m 28s. Rate: 7.1 symbols/min [2025-10-17T20:55:10.847833] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:55:10.848081] [DEBUG] [LOCAL ] PHIN: No existing data file found in primary storage. [2025-10-17T20:55:10.848135] [WARN ] [MAIN ] PHIN: No existing data found, performing full refresh instead. [2025-10-17T20:55:10.848289] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-17T20:55:10.848883] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-17T20:55:10.848971] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-17T20:55:10.849037] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-17T20:55:11.161898] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-17T20:55:11.218516] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:55:11.301883] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T20:55:11.958067] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-17T20:55:12.758003] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-10-17T20:55:13.047440] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T20:55:13.221336] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T20:55:13.558024] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-17T20:55:14.358019] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-17T20:55:15.158013] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-17T20:55:15.240845] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T20:55:15.272569] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T20:55:15.958034] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-17T20:55:16.758014] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-17T20:55:16.984214] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-17T20:55:17.558071] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-17T20:55:18.004398] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-17T20:55:18.357996] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-17T20:55:18.632153] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T20:55:19.158051] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-17T20:55:19.881687] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T20:55:19.958090] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-17T20:55:20.142618] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-17T20:55:20.758120] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-17T20:55:21.579907] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T20:55:21.588031] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-17T20:55:21.785827] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T20:55:22.358030] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-17T20:57:20.190035] [DEBUG] [REMOTE ] PHG: Error fetching primary data for 2025-03: Server request status code is 524. [2025-10-17T20:57:20.190535] [WARN ] [REMOTE ] PHG: No data returned for month 2025-03 [2025-10-17T20:57:20.190634] [FATAL] [REMOTE ] PHG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:57:20.190770] [FATAL] [MAIN ] PHG: Failed to fetch primary data. [2025-10-17T20:57:20.190836] [WARN ] [MAIN ] PHG: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:57:20.190913] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-17T20:57:20.190985] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-17T20:57:20.191024] [INFO ] [LOCAL ] PHG: Starting deletion of derivative data. [2025-10-17T20:57:20.191064] [DEBUG] [LOCAL ] PHG: No derivative data file found to delete. [2025-10-17T20:57:20.191116] [INFO ] [MAIN ] Update Progress: 1675/2368 symbols completed. PHG took 2m 17s. Estimated remaining: 1h 38m 10s. Rate: 7.1 symbols/min [2025-10-17T20:57:20.370401] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:57:20.404226] [DEBUG] [LOCAL ] PHK: Loaded 26928 existing records from primary storage. [2025-10-17T20:57:20.404594] [INFO ] [MAIN ] PHK: Loaded 26928 existing records. [2025-10-17T20:57:20.593867] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:57:20.594168] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-17T20:57:20.594221] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-17T20:57:20.594496] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-10-17T20:57:20.594558] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-17T20:57:20.987162] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:57:20.987620] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-10-17T20:57:22.552057] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T20:57:22.558300] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-17T20:57:23.955526] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T20:57:23.962280] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-17T20:57:25.293360] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T20:57:25.301139] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-17T20:57:26.613448] [DEBUG] [REMOTE ] PH: Error fetching primary data for 2025-08: Server request status code is 524. [2025-10-17T20:57:26.614001] [WARN ] [REMOTE ] PH: No data returned for month 2025-08 [2025-10-17T20:57:26.614104] [FATAL] [REMOTE ] PH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:57:26.614207] [FATAL] [MAIN ] PH: Failed to fetch primary data. [2025-10-17T20:57:26.614272] [WARN ] [MAIN ] PH: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:57:26.614345] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-17T20:57:26.614419] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-17T20:57:26.614457] [INFO ] [LOCAL ] PH: Starting deletion of derivative data. [2025-10-17T20:57:26.614496] [DEBUG] [LOCAL ] PH: No derivative data file found to delete. [2025-10-17T20:57:26.614549] [INFO ] [MAIN ] Update Progress: 1676/2368 symbols completed. PH took 2m 29s. Estimated remaining: 1h 38m 1s. Rate: 7.1 symbols/min [2025-10-17T20:57:26.805878] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:57:26.806346] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-10-17T20:57:26.806419] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-10-17T20:57:26.806615] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-17T20:57:26.813399] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-17T20:57:26.823587] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-17T20:57:26.824637] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-17T20:57:26.825458] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T20:57:26.915829] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-17T20:57:27.204860] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:57:27.205288] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-10-17T20:57:27.390753] [DEBUG] [REMOTE ] PHI: Error fetching primary data for 2025-07: Server request status code is 524. [2025-10-17T20:57:27.391144] [WARN ] [REMOTE ] PHI: No data returned for month 2025-07 [2025-10-17T20:57:27.391263] [FATAL] [REMOTE ] PHI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T20:57:27.391398] [FATAL] [MAIN ] PHI: Failed to fetch primary data. [2025-10-17T20:57:27.391485] [WARN ] [MAIN ] PHI: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T20:57:27.391581] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-17T20:57:27.391709] [DEBUG] [LOCAL ] PHI: No primary data file found to delete. [2025-10-17T20:57:27.391773] [INFO ] [LOCAL ] PHI: Starting deletion of derivative data. [2025-10-17T20:57:27.391949] [DEBUG] [LOCAL ] PHI: Deleted derivative data file. [2025-10-17T20:57:27.392038] [INFO ] [MAIN ] Update Progress: 1677/2368 symbols completed. PHI took 2m 21s. Estimated remaining: 1h 37m 49s. Rate: 7.1 symbols/min [2025-10-17T20:57:28.319237] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-17T20:57:28.326174] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-17T20:57:29.102529] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T20:57:29.113464] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-17T20:57:29.533973] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T20:57:29.539178] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-17T20:57:30.686773] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T20:57:30.693982] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-17T20:57:30.800178] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T20:57:30.810568] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-17T20:57:31.985349] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T20:57:31.991906] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-17T20:57:32.593523] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T20:57:32.604573] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-17T20:57:33.379258] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T20:57:33.385333] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-10-17T20:57:34.131940] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-17T20:57:34.142996] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-17T20:57:34.798867] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T20:57:34.805303] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-10. [2025-10-17T20:57:35.700060] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T20:57:35.711545] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-17T20:57:36.024978] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T20:57:36.029430] [INFO ] [REMOTE ] PHK: Full fetch complete (39415 records). [2025-10-17T20:57:36.029560] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-10-17T20:57:36.411236] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-10-17T20:57:36.411319] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-10-17T20:57:36.412204] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-10-17T20:57:36.412270] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-10-17T20:57:36.413171] [DEBUG] [LOCAL ] PHK: Trimmed 39415 records to 27189 (keeping 200 days of data) [2025-10-17T20:57:36.573525] [DEBUG] [LOCAL ] PHK: Primary data saved (27189 records). [2025-10-17T20:57:36.573685] [INFO ] [MAIN ] PHK: Full history saved. [2025-10-17T20:57:36.573786] [INFO ] [MAIN ] Update Progress: 1678/2368 symbols completed. PHK took 16.4s. Estimated remaining: 1h 37m 41s. Rate: 7.1 symbols/min [2025-10-17T20:57:37.315628] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-17T20:57:37.326333] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-17T20:57:39.047285] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T20:57:39.057809] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-17T20:57:41.063101] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-17T20:57:41.074544] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-17T20:57:43.010873] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T20:57:43.021914] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-17T20:57:44.857675] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T20:57:44.869105] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-17T20:57:46.640347] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T20:57:46.647632] [INFO ] [REMOTE ] PHM: Full fetch complete (75163 records). [2025-10-17T20:57:46.647781] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-17T20:57:47.035440] [DEBUG] [VALIDATOR ] PHM: All expected trading days are present. [2025-10-17T20:57:47.035518] [DEBUG] [VALIDATOR ] PHM: Primary data validation passed. [2025-10-17T20:57:47.036613] [INFO ] [MAIN ] PHM: Fetched primary data is valid. [2025-10-17T20:57:47.036698] [DEBUG] [LOCAL ] PHM: Saving primary data. [2025-10-17T20:57:47.038204] [DEBUG] [LOCAL ] PHM: Trimmed 75163 records to 52425 (keeping 200 days of data) [2025-10-17T20:57:47.365834] [DEBUG] [LOCAL ] PHM: Primary data saved (52425 records). [2025-10-17T20:57:47.365972] [INFO ] [MAIN ] PHM: Full history saved. [2025-10-17T20:57:47.366044] [INFO ] [MAIN ] Update Progress: 1679/2368 symbols completed. PHM took 20.8s. Estimated remaining: 1h 37m 33s. Rate: 7.1 symbols/min [2025-10-17T20:57:49.065016] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (156.31 seconds). [2025-10-17T20:57:49.072185] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-17T20:57:49.979891] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T20:57:49.986233] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-17T20:58:06.695129] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (16.71 seconds). [2025-10-17T20:58:06.702265] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-17T20:58:08.306285] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T20:58:08.314930] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-17T20:58:11.404034] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (3.09 seconds). [2025-10-17T20:58:11.412108] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-17T20:58:12.846118] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T20:58:12.852990] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-17T20:58:14.185107] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T20:58:14.192094] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-17T20:58:15.633919] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T20:58:15.641502] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-17T20:58:17.858343] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-17T20:58:17.866362] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-17T20:58:19.233872] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T20:58:19.241056] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-17T20:58:20.585673] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T20:58:20.590024] [INFO ] [REMOTE ] PHIN: Full fetch complete (47654 records). [2025-10-17T20:58:20.590162] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-17T20:58:20.968187] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-10-17T20:58:20.968266] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-10-17T20:58:20.969183] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-10-17T20:58:20.969273] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-10-17T20:58:20.970268] [DEBUG] [LOCAL ] PHIN: Trimmed 47654 records to 32358 (keeping 200 days of data) [2025-10-17T20:58:21.164551] [DEBUG] [LOCAL ] PHIN: Primary data saved (32358 records). [2025-10-17T20:58:21.164709] [INFO ] [MAIN ] PHIN: Full history saved. [2025-10-17T20:58:21.164793] [INFO ] [MAIN ] Update Progress: 1680/2368 symbols completed. PHIN took 3m 11s. Estimated remaining: 1h 37m 35s. Rate: 7.1 symbols/min [2025-10-17T20:58:21.840470] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:58:21.851282] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:58:21.841307] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:58:21.853828] [DEBUG] [LOCAL ] PII: No existing data file found in primary storage. [2025-10-17T20:58:21.869077] [WARN ] [MAIN ] PII: No existing data found, performing full refresh instead. [2025-10-17T20:58:21.872906] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:58:21.873206] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-17T20:58:21.873521] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-17T20:58:21.873596] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-17T20:58:21.873726] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-17T20:58:21.880079] [DEBUG] [LOCAL ] PHR: No existing data file found in primary storage. [2025-10-17T20:58:21.891367] [WARN ] [MAIN ] PHR: No existing data found, performing full refresh instead. [2025-10-17T20:58:21.917093] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-17T20:58:21.917297] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-17T20:58:21.917582] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-17T20:58:21.926072] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-17T20:58:21.931488] [DEBUG] [LOCAL ] PIM: Loaded 4868 existing records from primary storage. [2025-10-17T20:58:21.971110] [INFO ] [MAIN ] PIM: Loaded 4868 existing records. [2025-10-17T20:58:22.292597] [DEBUG] [LOCAL ] PINE: Loaded 14493 existing records from primary storage. [2025-10-17T20:58:22.368209] [INFO ] [MAIN ] PINE: Loaded 14493 existing records. [2025-10-17T20:58:22.625017] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:58:22.832280] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-17T20:58:22.941612] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-17T20:58:22.900757] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:58:22.936299] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:58:22.942155] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-10-17T20:58:22.977403] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-10-17T20:58:22.975015] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-10-17T20:58:22.995111] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-17T20:58:22.998808] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:58:23.027818] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-17T20:58:23.062173] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-17T20:58:23.079054] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-10-17T20:58:23.089115] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-17T20:58:23.660009] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:58:23.693047] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-10-17T20:58:23.717911] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:58:23.719107] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-10-17T20:58:24.423397] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T20:58:24.425949] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-17T20:58:24.485213] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T20:58:24.492215] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-17T20:58:24.785834] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T20:58:24.795277] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-17T20:58:24.816799] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T20:58:24.820596] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-17T20:58:24.938511] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-17T20:58:24.939969] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-17T20:58:25.651014] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-17T20:58:25.652401] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-17T20:58:25.744327] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T20:58:25.752029] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-17T20:58:25.763304] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T20:58:25.767254] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-17T20:58:26.350311] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-17T20:58:26.351850] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-17T20:58:26.530415] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T20:58:26.540417] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-17T20:58:26.916968] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T20:58:26.920498] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-17T20:58:27.025873] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-17T20:58:27.028147] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-17T20:58:27.281390] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T20:58:27.288706] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-17T20:58:27.524695] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-17T20:58:27.526460] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-17T20:58:27.725533] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-17T20:58:27.729044] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-17T20:58:27.907190] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T20:58:27.916704] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-17T20:58:28.193663] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T20:58:28.195438] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-17T20:58:28.676425] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-17T20:58:28.680876] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-17T20:58:28.829798] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-17T20:58:28.831399] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-17T20:58:29.525757] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T20:58:29.537440] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-17T20:58:29.611851] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T20:58:29.614131] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-17T20:58:29.705777] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-17T20:58:29.722306] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T20:58:29.722016] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-17T20:58:29.726677] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-17T20:58:30.499032] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-17T20:58:30.501941] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-17T20:58:30.913053] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T20:58:30.917860] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-17T20:58:31.075179] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-17T20:58:31.076614] [INFO ] [REMOTE ] PIM: Full fetch complete (6424 records). [2025-10-17T20:58:31.077088] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-17T20:58:31.514060] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-17T20:58:31.514183] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-17T20:58:31.514496] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-17T20:58:31.514695] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-17T20:58:31.515356] [DEBUG] [LOCAL ] PIM: Trimmed 6424 records to 4880 (keeping 200 days of data) [2025-10-17T20:58:31.585148] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-17T20:58:31.582590] [DEBUG] [LOCAL ] PIM: Primary data saved (4880 records). [2025-10-17T20:58:31.595766] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-17T20:58:31.596501] [INFO ] [MAIN ] Update Progress: 1681/2368 symbols completed. PIM took 10.4s. Estimated remaining: 1h 37m 27s. Rate: 7.0 symbols/min [2025-10-17T20:58:31.596933] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-17T20:58:31.771030] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:58:31.771211] [DEBUG] [LOCAL ] PINS: No existing data file found in primary storage. [2025-10-17T20:58:31.771249] [WARN ] [MAIN ] PINS: No existing data found, performing full refresh instead. [2025-10-17T20:58:31.771360] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-17T20:58:31.771400] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-17T20:58:31.771440] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-17T20:58:31.771483] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-17T20:58:31.944061] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-17T20:58:32.032469] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-17T20:58:32.179249] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T20:58:32.214054] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-17T20:58:32.244830] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:58:32.245341] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-10-17T20:58:33.129630] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T20:58:33.133010] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-17T20:58:33.282143] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-17T20:58:33.290378] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-17T20:58:33.549238] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T20:58:33.559890] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-17T20:58:34.012593] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-17T20:58:34.015920] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-17T20:58:34.389766] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-17T20:58:34.400637] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-17T20:58:34.911769] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-17T20:58:34.914407] [INFO ] [REMOTE ] PINE: Full fetch complete (21069 records). [2025-10-17T20:58:34.914481] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-17T20:58:35.283005] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-17T20:58:35.360410] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-17T20:58:35.391247] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-10-17T20:58:35.391364] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-10-17T20:58:35.392057] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-10-17T20:58:35.392168] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-10-17T20:58:35.424366] [DEBUG] [LOCAL ] PINE: Trimmed 21069 records to 14582 (keeping 200 days of data) [2025-10-17T20:58:35.463973] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T20:58:35.502179] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-17T20:58:35.531571] [DEBUG] [LOCAL ] PINE: Primary data saved (14582 records). [2025-10-17T20:58:35.531741] [INFO ] [MAIN ] PINE: Full history saved. [2025-10-17T20:58:35.531839] [INFO ] [MAIN ] Update Progress: 1682/2368 symbols completed. PINE took 14.4s. Estimated remaining: 1h 37m 17s. Rate: 7.1 symbols/min [2025-10-17T20:58:35.708460] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:58:35.708672] [DEBUG] [LOCAL ] PIPR: No existing data file found in primary storage. [2025-10-17T20:58:35.708728] [WARN ] [MAIN ] PIPR: No existing data found, performing full refresh instead. [2025-10-17T20:58:35.708845] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-17T20:58:35.708888] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-17T20:58:35.708930] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-17T20:58:35.708965] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-17T20:58:36.081623] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:58:36.082175] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-10-17T20:58:36.775774] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T20:58:36.783452] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-17T20:58:36.823293] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-17T20:58:36.833672] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-17T20:58:37.054558] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-17T20:58:37.057502] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-17T20:58:37.089006] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T20:58:37.101115] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-17T20:58:37.966843] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T20:58:37.969931] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-17T20:58:38.411470] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T20:58:38.420170] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-17T20:58:38.785305] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T20:58:38.795191] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-17T20:58:38.833786] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-17T20:58:38.850554] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-17T20:58:38.852001] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T20:58:38.855111] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-17T20:58:39.934918] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T20:58:39.938797] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-17T20:58:40.218587] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T20:58:40.228390] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-17T20:58:40.493129] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T20:58:40.503084] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-17T20:58:40.649410] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T20:58:40.660830] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-17T20:58:41.088439] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T20:58:41.093084] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-17T20:58:41.775799] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T20:58:41.782228] [INFO ] [REMOTE ] PHR: Full fetch complete (53374 records). [2025-10-17T20:58:41.782355] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-17T20:58:42.183563] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-10-17T20:58:42.184024] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-10-17T20:58:42.191280] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-10-17T20:58:42.211674] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-10-17T20:58:42.213403] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T20:58:42.221485] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T20:58:42.227024] [INFO ] [REMOTE ] PII: Full fetch complete (71366 records). [2025-10-17T20:58:42.226906] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-17T20:58:42.227351] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-17T20:58:42.229329] [DEBUG] [LOCAL ] PHR: Trimmed 53374 records to 38391 (keeping 200 days of data) [2025-10-17T20:58:42.735707] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-10-17T20:58:42.736199] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-10-17T20:58:42.739392] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-10-17T20:58:42.742704] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-10-17T20:58:42.763482] [DEBUG] [LOCAL ] PII: Trimmed 71366 records to 49613 (keeping 200 days of data) [2025-10-17T20:58:42.962338] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-17T20:58:42.986246] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-17T20:58:43.035674] [DEBUG] [LOCAL ] PHR: Primary data saved (38391 records). [2025-10-17T20:58:43.037898] [INFO ] [MAIN ] PHR: Full history saved. [2025-10-17T20:58:43.040786] [INFO ] [MAIN ] Update Progress: 1683/2368 symbols completed. PHR took 21.9s. Estimated remaining: 1h 37m 8s. Rate: 7.1 symbols/min [2025-10-17T20:58:43.311965] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:58:43.316839] [DEBUG] [LOCAL ] PJT: No existing data file found in primary storage. [2025-10-17T20:58:43.316974] [WARN ] [MAIN ] PJT: No existing data found, performing full refresh instead. [2025-10-17T20:58:43.318497] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-17T20:58:43.318586] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-17T20:58:43.319548] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-17T20:58:43.319706] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-17T20:58:43.424126] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T20:58:43.458161] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-17T20:58:43.784239] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:58:43.785191] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-10-17T20:58:43.792116] [DEBUG] [LOCAL ] PII: Primary data saved (49613 records). [2025-10-17T20:58:43.792211] [INFO ] [MAIN ] PII: Full history saved. [2025-10-17T20:58:43.792304] [INFO ] [MAIN ] Update Progress: 1684/2368 symbols completed. PII took 22.6s. Estimated remaining: 1h 36m 56s. Rate: 7.1 symbols/min [2025-10-17T20:58:43.957181] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:58:43.957346] [DEBUG] [LOCAL ] PK: No existing data file found in primary storage. [2025-10-17T20:58:43.957384] [WARN ] [MAIN ] PK: No existing data found, performing full refresh instead. [2025-10-17T20:58:43.957492] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-17T20:58:43.957534] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-17T20:58:43.957614] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-17T20:58:43.957687] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-17T20:58:44.301067] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:58:44.301347] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-10-17T20:58:44.661495] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-17T20:58:44.665736] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-17T20:58:44.918757] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T20:58:44.922903] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-17T20:58:45.187718] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-17T20:58:45.199020] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-17T20:58:45.635211] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T20:58:45.639157] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-17T20:58:46.047995] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T20:58:46.060330] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-17T20:58:46.100019] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T20:58:46.104471] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-17T20:58:46.614406] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-17T20:58:46.618043] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-17T20:58:46.871714] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T20:58:46.882506] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-17T20:58:47.428070] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-17T20:58:47.433077] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-17T20:58:47.472060] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T20:58:47.482802] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-17T20:58:47.498344] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-17T20:58:47.501004] [INFO ] [REMOTE ] PIPR: Full fetch complete (20968 records). [2025-10-17T20:58:47.501112] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-17T20:58:47.854730] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-10-17T20:58:47.854833] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-10-17T20:58:47.855223] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-10-17T20:58:47.855262] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-10-17T20:58:47.855893] [DEBUG] [LOCAL ] PIPR: Trimmed 20968 records to 15399 (keeping 200 days of data) [2025-10-17T20:58:47.948916] [DEBUG] [LOCAL ] PIPR: Primary data saved (15399 records). [2025-10-17T20:58:47.949055] [INFO ] [MAIN ] PIPR: Full history saved. [2025-10-17T20:58:47.949149] [INFO ] [MAIN ] Update Progress: 1685/2368 symbols completed. PIPR took 12.4s. Estimated remaining: 1h 36m 46s. Rate: 7.1 symbols/min [2025-10-17T20:58:48.113195] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:58:48.128778] [DEBUG] [LOCAL ] PKE: Loaded 14192 existing records from primary storage. [2025-10-17T20:58:48.128990] [INFO ] [MAIN ] PKE: Loaded 14192 existing records. [2025-10-17T20:58:48.301337] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:58:48.301551] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-17T20:58:48.301597] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-17T20:58:48.301807] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-10-17T20:58:48.301864] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-17T20:58:48.663614] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:58:48.664108] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-10-17T20:58:48.682787] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T20:58:48.689483] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-17T20:58:49.054384] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-17T20:58:49.066055] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-17T20:58:49.098265] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T20:58:49.108052] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-17T20:58:49.609385] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T20:58:49.611899] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-17T20:58:50.110408] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T20:58:50.117385] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-17T20:58:50.669266] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T20:58:50.671974] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-17T20:58:50.961791] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T20:58:50.973373] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-17T20:58:51.022501] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T20:58:51.028152] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-17T20:58:51.295058] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-17T20:58:51.306438] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-17T20:58:51.741602] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-17T20:58:51.746051] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-17T20:58:51.795749] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T20:58:51.798419] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-17T20:58:52.804248] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T20:58:52.816136] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-17T20:58:52.823790] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-17T20:58:52.826009] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-17T20:58:52.961760] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-17T20:58:52.967266] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-17T20:58:53.499933] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-17T20:58:53.523173] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-17T20:58:53.527890] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-17T20:58:53.526935] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-17T20:58:54.113514] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T20:58:54.119112] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-17T20:58:54.131914] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T20:58:54.135247] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-17T20:58:54.290193] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T20:58:54.301312] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-17T20:58:54.975934] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T20:58:54.979279] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-17T20:58:55.130435] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T20:58:55.138029] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-17T20:58:55.176522] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T20:58:55.188236] [INFO ] [REMOTE ] PINS: Full fetch complete (77871 records). [2025-10-17T20:58:55.188437] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-17T20:58:55.675041] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-10-17T20:58:55.675133] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-10-17T20:58:55.676588] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-10-17T20:58:55.676882] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-10-17T20:58:55.678698] [DEBUG] [LOCAL ] PINS: Trimmed 77871 records to 54473 (keeping 200 days of data) [2025-10-17T20:58:55.945354] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-17T20:58:55.957845] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-17T20:58:56.050730] [DEBUG] [LOCAL ] PINS: Primary data saved (54473 records). [2025-10-17T20:58:56.050906] [INFO ] [MAIN ] PINS: Full history saved. [2025-10-17T20:58:56.050986] [INFO ] [MAIN ] Update Progress: 1686/2368 symbols completed. PINS took 24.5s. Estimated remaining: 1h 36m 37s. Rate: 7.1 symbols/min [2025-10-17T20:58:56.236880] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:58:56.253232] [DEBUG] [LOCAL ] PKG: No existing data file found in primary storage. [2025-10-17T20:58:56.253426] [WARN ] [MAIN ] PKG: No existing data found, performing full refresh instead. [2025-10-17T20:58:56.261574] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-17T20:58:56.262505] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T20:58:56.266289] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-17T20:58:56.268306] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T20:58:56.268566] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-17T20:58:56.279241] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-17T20:58:56.278682] [INFO ] [REMOTE ] PJT: Full fetch complete (32211 records). [2025-10-17T20:58:56.292140] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-17T20:58:56.314584] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-17T20:58:57.039319] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T20:58:57.103154] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-10-17T20:58:57.101209] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:58:57.103272] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-10-17T20:58:57.071781] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-17T20:58:57.103583] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-10-17T20:58:57.105167] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-10-17T20:58:57.105485] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-10-17T20:58:57.106827] [DEBUG] [LOCAL ] PJT: Trimmed 32211 records to 21931 (keeping 200 days of data) [2025-10-17T20:58:57.242519] [DEBUG] [LOCAL ] PJT: Primary data saved (21931 records). [2025-10-17T20:58:57.242679] [INFO ] [MAIN ] PJT: Full history saved. [2025-10-17T20:58:57.242772] [INFO ] [MAIN ] Update Progress: 1687/2368 symbols completed. PJT took 14.2s. Estimated remaining: 1h 36m 26s. Rate: 7.1 symbols/min [2025-10-17T20:58:57.409568] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:58:57.409763] [DEBUG] [LOCAL ] PKST: No existing data file found in primary storage. [2025-10-17T20:58:57.409809] [WARN ] [MAIN ] PKST: No existing data found, performing full refresh instead. [2025-10-17T20:58:57.409929] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-17T20:58:57.409972] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-17T20:58:57.410016] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-17T20:58:57.410049] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-17T20:58:57.755889] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:58:57.756213] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-10-17T20:58:58.204762] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T20:58:58.210746] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-17T20:58:58.347785] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-17T20:58:58.359677] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-17T20:58:58.742104] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T20:58:58.753945] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-17T20:58:59.009305] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T20:58:59.012677] [INFO ] [REMOTE ] PKE: Full fetch complete (18299 records). [2025-10-17T20:58:59.012752] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-17T20:58:59.207205] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T20:58:59.254507] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-17T20:58:59.405208] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-10-17T20:58:59.405288] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-10-17T20:58:59.405741] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-10-17T20:58:59.405802] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-10-17T20:58:59.406356] [DEBUG] [LOCAL ] PKE: Trimmed 18299 records to 14335 (keeping 200 days of data) [2025-10-17T20:58:59.493866] [DEBUG] [LOCAL ] PKE: Primary data saved (14335 records). [2025-10-17T20:58:59.494011] [INFO ] [MAIN ] PKE: Full history saved. [2025-10-17T20:58:59.494092] [INFO ] [MAIN ] Update Progress: 1688/2368 symbols completed. PKE took 11.5s. Estimated remaining: 1h 36m 15s. Rate: 7.1 symbols/min [2025-10-17T20:58:59.661373] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:58:59.661591] [DEBUG] [LOCAL ] PKX: No existing data file found in primary storage. [2025-10-17T20:58:59.661632] [WARN ] [MAIN ] PKX: No existing data found, performing full refresh instead. [2025-10-17T20:58:59.661766] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-17T20:58:59.661807] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-17T20:58:59.661849] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-17T20:58:59.661926] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-17T20:59:00.030076] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:59:00.030762] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-10-17T20:59:00.065276] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T20:59:00.077436] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-17T20:59:00.103171] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T20:59:00.112593] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-17T20:59:00.268290] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T20:59:00.273018] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-17T20:59:01.414425] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T20:59:01.422434] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-17T20:59:01.472929] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T20:59:01.477538] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-17T20:59:01.828594] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-17T20:59:01.836845] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-17T20:59:02.282838] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-17T20:59:02.295733] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-17T20:59:02.746253] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-17T20:59:02.751991] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-17T20:59:02.825023] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T20:59:02.831611] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-17T20:59:03.493940] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T20:59:03.502736] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-17T20:59:03.769267] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-17T20:59:03.774281] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-17T20:59:03.860511] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T20:59:03.867862] [INFO ] [REMOTE ] PK: Full fetch complete (76554 records). [2025-10-17T20:59:03.867994] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-17T20:59:04.263576] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-10-17T20:59:04.263732] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-10-17T20:59:04.272101] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-10-17T20:59:04.272199] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-10-17T20:59:04.284615] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T20:59:04.291858] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-17T20:59:04.293512] [DEBUG] [LOCAL ] PK: Trimmed 76554 records to 53536 (keeping 200 days of data) [2025-10-17T20:59:04.621900] [DEBUG] [LOCAL ] PK: Primary data saved (53536 records). [2025-10-17T20:59:04.622051] [INFO ] [MAIN ] PK: Full history saved. [2025-10-17T20:59:04.622129] [INFO ] [MAIN ] Update Progress: 1689/2368 symbols completed. PK took 20.8s. Estimated remaining: 1h 36m 5s. Rate: 7.1 symbols/min [2025-10-17T20:59:04.786336] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:59:04.786499] [DEBUG] [LOCAL ] PL: No existing data file found in primary storage. [2025-10-17T20:59:04.786536] [WARN ] [MAIN ] PL: No existing data found, performing full refresh instead. [2025-10-17T20:59:04.786690] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-17T20:59:04.786744] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-17T20:59:04.786786] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-17T20:59:04.786817] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-17T20:59:05.118371] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T20:59:05.169772] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:59:05.170816] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-10-17T20:59:05.171209] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-17T20:59:05.216216] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T20:59:05.225874] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-17T20:59:05.991713] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T20:59:05.999491] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-17T20:59:06.260343] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T20:59:06.264523] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-17T20:59:06.892130] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T20:59:06.900777] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-17T20:59:07.140163] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T20:59:07.147247] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-17T20:59:07.279980] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-17T20:59:07.290827] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-17T20:59:07.349464] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T20:59:07.353348] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-17T20:59:08.251591] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-17T20:59:08.257284] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-17T20:59:08.375487] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T20:59:08.384374] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-17T20:59:08.424539] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-17T20:59:08.429295] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-17T20:59:09.510710] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T20:59:09.516024] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-17T20:59:09.591734] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T20:59:09.597126] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-17T20:59:09.657116] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-17T20:59:09.667832] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-17T20:59:10.042792] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T20:59:10.051858] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-17T20:59:10.355751] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T20:59:10.359071] [INFO ] [REMOTE ] PKST: Full fetch complete (29025 records). [2025-10-17T20:59:10.359167] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-17T20:59:10.734960] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-10-17T20:59:10.735066] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-10-17T20:59:10.735805] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-10-17T20:59:10.735914] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-10-17T20:59:10.737074] [DEBUG] [LOCAL ] PKST: Trimmed 29025 records to 18809 (keeping 200 days of data) [2025-10-17T20:59:10.853091] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T20:59:10.861302] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-17T20:59:10.884784] [DEBUG] [LOCAL ] PKST: Primary data saved (18809 records). [2025-10-17T20:59:10.884933] [INFO ] [MAIN ] PKST: Full history saved. [2025-10-17T20:59:10.885008] [INFO ] [MAIN ] Update Progress: 1690/2368 symbols completed. PKST took 13.6s. Estimated remaining: 1h 35m 56s. Rate: 7.1 symbols/min [2025-10-17T20:59:11.052824] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:59:11.052985] [DEBUG] [LOCAL ] PLD: No existing data file found in primary storage. [2025-10-17T20:59:11.053029] [WARN ] [MAIN ] PLD: No existing data found, performing full refresh instead. [2025-10-17T20:59:11.053141] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-17T20:59:11.053181] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-17T20:59:11.053222] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-17T20:59:11.053253] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-17T20:59:11.410274] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:59:11.410737] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-10-17T20:59:11.514089] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T20:59:11.525972] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-17T20:59:12.028141] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-17T20:59:12.038201] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-17T20:59:12.067859] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-17T20:59:12.072077] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-17T20:59:12.868034] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T20:59:12.880617] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-17T20:59:12.968468] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T20:59:12.979118] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-17T20:59:13.261816] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T20:59:13.342241] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-17T20:59:14.036423] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T20:59:14.041615] [INFO ] [REMOTE ] PKG: Full fetch complete (57580 records). [2025-10-17T20:59:14.041774] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-17T20:59:14.462952] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-17T20:59:14.482229] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T20:59:14.485686] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-10-17T20:59:14.486326] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-10-17T20:59:14.486072] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-17T20:59:14.487735] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-10-17T20:59:14.488636] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-10-17T20:59:14.488538] [INFO ] [REMOTE ] PKX: Full fetch complete (36229 records). [2025-10-17T20:59:14.488875] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-17T20:59:14.562010] [DEBUG] [LOCAL ] PKG: Trimmed 57580 records to 39212 (keeping 200 days of data) [2025-10-17T20:59:14.972758] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-10-17T20:59:14.974726] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-10-17T20:59:14.975672] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-10-17T20:59:14.977902] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-10-17T20:59:14.982032] [DEBUG] [LOCAL ] PKX: Trimmed 36229 records to 23348 (keeping 200 days of data) [2025-10-17T20:59:15.113778] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-17T20:59:15.136621] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-17T20:59:15.279280] [DEBUG] [LOCAL ] PKX: Primary data saved (23348 records). [2025-10-17T20:59:15.279740] [INFO ] [MAIN ] PKX: Full history saved. [2025-10-17T20:59:15.280111] [INFO ] [MAIN ] Update Progress: 1691/2368 symbols completed. PKX took 15.8s. Estimated remaining: 1h 35m 46s. Rate: 7.1 symbols/min [2025-10-17T20:59:15.454543] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:59:15.455249] [DEBUG] [LOCAL ] PLNT: No existing data file found in primary storage. [2025-10-17T20:59:15.455562] [WARN ] [MAIN ] PLNT: No existing data found, performing full refresh instead. [2025-10-17T20:59:15.456503] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-17T20:59:15.457244] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-17T20:59:15.457680] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-17T20:59:15.457757] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-17T20:59:15.801242] [DEBUG] [LOCAL ] PKG: Primary data saved (39212 records). [2025-10-17T20:59:15.810908] [INFO ] [MAIN ] PKG: Full history saved. [2025-10-17T20:59:15.825974] [INFO ] [MAIN ] Update Progress: 1692/2368 symbols completed. PKG took 19.8s. Estimated remaining: 1h 35m 34s. Rate: 7.1 symbols/min [2025-10-17T20:59:15.830567] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:59:15.873799] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-10-17T20:59:16.003113] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:59:16.003260] [DEBUG] [LOCAL ] PLOW: No existing data file found in primary storage. [2025-10-17T20:59:16.003297] [WARN ] [MAIN ] PLOW: No existing data found, performing full refresh instead. [2025-10-17T20:59:16.003440] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-17T20:59:16.003506] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-17T20:59:16.003557] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-17T20:59:16.003590] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-17T20:59:16.351909] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:59:16.542344] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-10-17T20:59:16.590964] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-17T20:59:16.982184] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T20:59:17.341938] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-17T20:59:17.346203] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-17T20:59:17.391121] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T20:59:18.142351] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-17T20:59:18.482804] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T20:59:18.942343] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-17T20:59:19.742309] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-17T20:59:19.891904] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T20:59:20.542262] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-17T20:59:20.912968] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T20:59:21.342361] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-17T20:59:21.720294] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-17T20:59:21.807309] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-17T20:59:22.142318] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-17T20:59:22.445206] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T20:59:22.942323] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-17T20:59:23.742427] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-17T20:59:24.449582] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-17T20:59:24.542295] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-17T20:59:25.113329] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-17T20:59:25.342312] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-17T20:59:25.609794] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T20:59:26.142338] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-17T20:59:26.435720] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T20:59:26.942385] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-17T20:59:27.137982] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-17T20:59:27.742304] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-17T20:59:28.131027] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T20:59:28.542376] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-17T20:59:28.720513] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T20:59:29.342359] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-17T20:59:29.796698] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-17T20:59:29.988114] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-17T20:59:30.142317] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-17T20:59:30.942244] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-17T20:59:31.197844] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T20:59:31.379344] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-17T20:59:31.742333] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-17T20:59:32.542304] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-17T20:59:32.606666] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T20:59:33.342361] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-17T20:59:33.579378] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-17T20:59:33.698532] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T20:59:34.142311] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-17T20:59:34.942278] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-17T20:59:35.304999] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-17T20:59:35.745006] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-10-17T20:59:35.750744] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-17T20:59:36.542263] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-17T20:59:36.860754] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T20:59:37.066634] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-17T20:59:37.342336] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-17T20:59:38.142306] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-10-17T20:59:38.942329] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-17T20:59:39.036882] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T20:59:39.089504] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-17T20:59:39.114087] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-17T20:59:39.121286] [INFO ] [REMOTE ] PL: Full fetch complete (77105 records). [2025-10-17T20:59:39.121404] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-17T20:59:39.499615] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-10-17T20:59:39.499723] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-10-17T20:59:39.500835] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-10-17T20:59:39.500899] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-10-17T20:59:39.502291] [DEBUG] [LOCAL ] PL: Trimmed 77105 records to 53962 (keeping 200 days of data) [2025-10-17T20:59:39.764406] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-17T20:59:39.814787] [DEBUG] [LOCAL ] PL: Primary data saved (53962 records). [2025-10-17T20:59:39.814927] [INFO ] [MAIN ] PL: Full history saved. [2025-10-17T20:59:39.814999] [INFO ] [MAIN ] Update Progress: 1693/2368 symbols completed. PL took 35.2s. Estimated remaining: 1h 35m 32s. Rate: 7.1 symbols/min [2025-10-17T20:59:39.980099] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:59:39.980242] [DEBUG] [LOCAL ] PLYM: No existing data file found in primary storage. [2025-10-17T20:59:39.980280] [WARN ] [MAIN ] PLYM: No existing data found, performing full refresh instead. [2025-10-17T20:59:39.980403] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-17T20:59:39.980447] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-17T20:59:39.980488] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-17T20:59:39.980562] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-17T20:59:40.321574] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:59:40.542253] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-10-17T20:59:40.920503] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-17T20:59:41.342322] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-17T20:59:41.504197] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T20:59:41.916314] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T20:59:42.142313] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-17T20:59:42.942273] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-10. [2025-10-17T20:59:43.370059] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-17T20:59:43.506202] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T20:59:43.742345] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-17T20:59:43.796021] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T20:59:43.798475] [INFO ] [REMOTE ] PLOW: Full fetch complete (28438 records). [2025-10-17T20:59:43.798548] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-10-17T20:59:44.159401] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-10-17T20:59:44.159478] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-10-17T20:59:44.160063] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-10-17T20:59:44.160123] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-10-17T20:59:44.160847] [DEBUG] [LOCAL ] PLOW: Trimmed 28438 records to 20316 (keeping 200 days of data) [2025-10-17T20:59:44.288131] [DEBUG] [LOCAL ] PLOW: Primary data saved (20316 records). [2025-10-17T20:59:44.288264] [INFO ] [MAIN ] PLOW: Full history saved. [2025-10-17T20:59:44.288338] [INFO ] [MAIN ] Update Progress: 1694/2368 symbols completed. PLOW took 28.5s. Estimated remaining: 1h 35m 22s. Rate: 7.1 symbols/min [2025-10-17T20:59:44.483259] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:59:44.483455] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-10-17T20:59:44.483493] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-10-17T20:59:44.483605] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-17T20:59:44.483671] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-17T20:59:44.483736] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-17T20:59:44.483771] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-17T20:59:44.547917] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-17T20:59:44.835005] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:59:45.342337] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-10-17T20:59:45.683222] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T20:59:45.691140] [INFO ] [REMOTE ] PLD: Full fetch complete (77513 records). [2025-10-17T20:59:45.691325] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-17T20:59:45.902399] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T20:59:46.129356] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-10-17T20:59:46.129459] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-10-17T20:59:46.130885] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-10-17T20:59:46.130951] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-10-17T20:59:46.132729] [DEBUG] [LOCAL ] PLD: Trimmed 77513 records to 54196 (keeping 200 days of data) [2025-10-17T20:59:46.190568] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-17T20:59:46.479937] [DEBUG] [LOCAL ] PLD: Primary data saved (54196 records). [2025-10-17T20:59:46.480080] [INFO ] [MAIN ] PLD: Full history saved. [2025-10-17T20:59:46.480153] [INFO ] [MAIN ] Update Progress: 1695/2368 symbols completed. PLD took 35.6s. Estimated remaining: 1h 35m 11s. Rate: 7.1 symbols/min [2025-10-17T20:59:46.666831] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:59:46.687887] [DEBUG] [LOCAL ] PML: Loaded 22039 existing records from primary storage. [2025-10-17T20:59:46.688147] [INFO ] [MAIN ] PML: Loaded 22039 existing records. [2025-10-17T20:59:46.871749] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:59:46.872056] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-17T20:59:46.872178] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-17T20:59:46.872461] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-10-17T20:59:46.872521] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-17T20:59:46.947722] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-17T20:59:47.275346] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:59:47.311014] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T20:59:47.526564] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T20:59:47.742346] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-17T20:59:47.952573] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-17T20:59:48.522916] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T20:59:48.530018] [INFO ] [REMOTE ] PLNT: Full fetch complete (70764 records). [2025-10-17T20:59:48.530160] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-17T20:59:48.551487] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-17T20:59:48.925997] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-10-17T20:59:48.926071] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-10-17T20:59:48.927301] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-10-17T20:59:48.927376] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-10-17T20:59:48.928912] [DEBUG] [LOCAL ] PLNT: Trimmed 70764 records to 48907 (keeping 200 days of data) [2025-10-17T20:59:49.212820] [DEBUG] [LOCAL ] PLNT: Primary data saved (48907 records). [2025-10-17T20:59:49.212948] [INFO ] [MAIN ] PLNT: Full history saved. [2025-10-17T20:59:49.213022] [INFO ] [MAIN ] Update Progress: 1696/2368 symbols completed. PLNT took 33.9s. Estimated remaining: 1h 34m 60s. Rate: 7.1 symbols/min [2025-10-17T20:59:49.351059] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-10-17T20:59:49.385604] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T20:59:49.396883] [DEBUG] [LOCAL ] PMM: Loaded 10272 existing records from primary storage. [2025-10-17T20:59:49.397637] [INFO ] [MAIN ] PMM: Loaded 10272 existing records. [2025-10-17T20:59:49.568070] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T20:59:49.568280] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-17T20:59:49.568348] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-17T20:59:49.568532] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-10-17T20:59:49.568588] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-17T20:59:49.914739] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T20:59:50.115684] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T20:59:50.142242] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-17T20:59:50.877982] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T20:59:50.942253] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-17T20:59:51.628045] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-17T20:59:51.742297] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-17T20:59:52.038255] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T20:59:52.542252] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-17T20:59:53.008717] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T20:59:53.342345] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-10-17T20:59:53.611717] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T20:59:54.142413] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-17T20:59:54.606117] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T20:59:54.942350] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-17T20:59:55.742268] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-17T20:59:55.933933] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T20:59:55.952821] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T20:59:56.514593] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T20:59:56.542249] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-17T20:59:57.342305] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-17T20:59:57.450982] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T20:59:58.142263] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-17T20:59:58.475080] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T20:59:58.942267] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-17T20:59:59.181327] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-17T20:59:59.742300] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-17T21:00:00.402590] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T21:00:00.542295] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-17T21:00:01.342291] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-17T21:00:01.980156] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-17T21:00:02.142350] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-17T21:00:02.252698] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T21:00:02.470900] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T21:00:02.942298] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-17T21:00:03.742314] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-17T21:00:04.378400] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T21:00:04.543123] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-17T21:00:04.554404] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-17T21:00:05.342338] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-17T21:00:05.431130] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T21:00:05.899316] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-17T21:00:06.142298] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-17T21:00:06.942368] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-17T21:00:07.032993] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-17T21:00:07.632332] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-17T21:00:07.742356] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-17T21:00:07.804964] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-17T21:00:08.542289] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-17T21:00:08.758402] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T21:00:09.342317] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-17T21:00:09.725510] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T21:00:10.142285] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-17T21:00:10.263697] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T21:00:10.942322] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-17T21:00:11.700170] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T21:00:11.705759] [INFO ] [REMOTE ] PLYM: Full fetch complete (47883 records). [2025-10-17T21:00:11.705902] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-17T21:00:11.748811] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-17T21:00:12.080530] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-10-17T21:00:12.080620] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-10-17T21:00:12.081531] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-10-17T21:00:12.081586] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-10-17T21:00:12.082562] [DEBUG] [LOCAL ] PLYM: Trimmed 47883 records to 34815 (keeping 200 days of data) [2025-10-17T21:00:12.299498] [DEBUG] [LOCAL ] PLYM: Primary data saved (34815 records). [2025-10-17T21:00:12.299706] [INFO ] [MAIN ] PLYM: Full history saved. [2025-10-17T21:00:12.299843] [INFO ] [MAIN ] Update Progress: 1697/2368 symbols completed. PLYM took 32.5s. Estimated remaining: 1h 34m 57s. Rate: 7.1 symbols/min [2025-10-17T21:00:12.470223] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:00:12.482164] [DEBUG] [LOCAL ] PMO: Loaded 9927 existing records from primary storage. [2025-10-17T21:00:12.482376] [INFO ] [MAIN ] PMO: Loaded 9927 existing records. [2025-10-17T21:00:12.545401] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-17T21:00:12.676162] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:00:12.677186] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T21:00:12.677498] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-17T21:00:12.677945] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-17T21:00:12.680898] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-10-17T21:00:12.680822] [INFO ] [REMOTE ] PMM: Full fetch complete (17791 records). [2025-10-17T21:00:12.681159] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-17T21:00:12.713733] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-17T21:00:13.329934] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:00:13.346390] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-10-17T21:00:13.448291] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-17T21:00:13.448517] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-17T21:00:13.449022] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-17T21:00:13.449117] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-17T21:00:13.449849] [DEBUG] [LOCAL ] PMM: Trimmed 17791 records to 10328 (keeping 200 days of data) [2025-10-17T21:00:13.555570] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-17T21:00:13.579094] [DEBUG] [LOCAL ] PMM: Primary data saved (10328 records). [2025-10-17T21:00:13.579260] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-17T21:00:13.579379] [INFO ] [MAIN ] Update Progress: 1698/2368 symbols completed. PMM took 24.4s. Estimated remaining: 1h 34m 46s. Rate: 7.1 symbols/min [2025-10-17T21:00:13.765201] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:00:13.765395] [DEBUG] [LOCAL ] PMT: No existing data file found in primary storage. [2025-10-17T21:00:13.765432] [WARN ] [MAIN ] PMT: No existing data found, performing full refresh instead. [2025-10-17T21:00:13.765555] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-17T21:00:13.765623] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-17T21:00:13.765717] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-17T21:00:13.765771] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-17T21:00:14.049735] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T21:00:14.140022] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:00:14.142246] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-10-17T21:00:14.760943] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T21:00:14.942348] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-17T21:00:15.742362] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-17T21:00:16.302697] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T21:00:16.349409] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-17T21:00:16.542255] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-17T21:00:16.907900] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-17T21:00:17.342403] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-17T21:00:17.900594] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-17T21:00:18.142416] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-17T21:00:18.942293] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-17T21:00:19.370154] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-17T21:00:19.448061] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T21:00:19.452044] [INFO ] [REMOTE ] PML: Full fetch complete (29890 records). [2025-10-17T21:00:19.452124] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-17T21:00:19.747414] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-17T21:00:19.825857] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-17T21:00:19.826028] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-17T21:00:19.826801] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-17T21:00:19.826866] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-17T21:00:19.827780] [DEBUG] [LOCAL ] PML: Trimmed 29890 records to 22320 (keeping 200 days of data) [2025-10-17T21:00:19.954816] [DEBUG] [LOCAL ] PML: Primary data saved (22320 records). [2025-10-17T21:00:19.954949] [INFO ] [MAIN ] PML: Full history saved. [2025-10-17T21:00:19.955073] [INFO ] [MAIN ] Update Progress: 1699/2368 symbols completed. PML took 33.5s. Estimated remaining: 1h 34m 36s. Rate: 7.1 symbols/min [2025-10-17T21:00:20.126132] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:00:20.126374] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-17T21:00:20.126423] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-17T21:00:20.126534] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-17T21:00:20.126575] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-17T21:00:20.126616] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-17T21:00:20.126694] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-17T21:00:20.479029] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:00:20.503455] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T21:00:20.542257] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-10-17T21:00:20.980058] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-17T21:00:21.342349] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-17T21:00:21.774026] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-17T21:00:22.142278] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-17T21:00:22.205906] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-17T21:00:22.942331] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-17T21:00:23.743234] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-17T21:00:23.746289] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T21:00:23.879865] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T21:00:24.274897] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-17T21:00:24.542313] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-17T21:00:24.999058] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-17T21:00:25.342278] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-17T21:00:26.142310] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-17T21:00:26.321972] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-17T21:00:26.942293] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-17T21:00:27.742283] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-17T21:00:28.058319] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T21:00:28.242184] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-17T21:00:28.542349] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-17T21:00:29.342261] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-17T21:00:29.447022] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T21:00:29.866866] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-17T21:00:30.142324] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-17T21:00:30.307219] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T21:00:30.942346] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-17T21:00:31.072207] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T21:00:31.742363] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-17T21:00:32.542336] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-17T21:00:32.620141] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-17T21:00:32.748857] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T21:00:33.342293] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-17T21:00:34.142361] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-17T21:00:34.660455] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-17T21:00:34.667823] [INFO ] [REMOTE ] PM: Full fetch complete (77831 records). [2025-10-17T21:00:34.667952] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-17T21:00:34.947361] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-17T21:00:34.989557] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-17T21:00:35.109615] [DEBUG] [VALIDATOR ] PM: All expected trading days are present. [2025-10-17T21:00:35.109922] [DEBUG] [VALIDATOR ] PM: Primary data validation passed. [2025-10-17T21:00:35.112586] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T21:00:35.111435] [INFO ] [MAIN ] PM: Fetched primary data is valid. [2025-10-17T21:00:35.120894] [DEBUG] [LOCAL ] PM: Saving primary data. [2025-10-17T21:00:35.122233] [DEBUG] [LOCAL ] PM: Trimmed 77831 records to 54453 (keeping 200 days of data) [2025-10-17T21:00:35.435907] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-17T21:00:35.463873] [DEBUG] [LOCAL ] PM: Primary data saved (54453 records). [2025-10-17T21:00:35.463977] [INFO ] [MAIN ] PM: Full history saved. [2025-10-17T21:00:35.464044] [INFO ] [MAIN ] Update Progress: 1700/2368 symbols completed. PM took 51.2s. Estimated remaining: 1h 34m 31s. Rate: 7.1 symbols/min [2025-10-17T21:00:35.634103] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:00:35.634282] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-17T21:00:35.634330] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-17T21:00:35.634451] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-17T21:00:35.634493] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-17T21:00:35.634562] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-17T21:00:35.634606] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-17T21:00:35.747491] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-17T21:00:35.991465] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:00:36.542315] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-10-17T21:00:36.832674] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:00:36.832932] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-10-17T21:00:36.833021] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:00:36.833076] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-17T21:00:36.833146] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:00:36.833217] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-17T21:00:36.833279] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-17T21:00:36.833315] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-17T21:00:36.833353] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-17T21:00:36.833397] [INFO ] [MAIN ] Update Progress: 1701/2368 symbols completed. PMTV took 1.4s. Estimated remaining: 1h 34m 19s. Rate: 7.1 symbols/min [2025-10-17T21:00:37.002571] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:00:37.002799] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-17T21:00:37.002844] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-17T21:00:37.002963] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-17T21:00:37.003006] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-17T21:00:37.003050] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-17T21:00:37.003085] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-17T21:00:37.350023] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-17T21:00:37.363604] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:00:37.549398] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T21:00:37.736257] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-17T21:00:38.142323] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-17T21:00:38.942300] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-17T21:00:39.742368] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-10-17T21:00:39.847493] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T21:00:39.878211] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T21:00:40.028172] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:00:40.028524] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-10-17T21:00:40.028618] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:00:40.028700] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-17T21:00:40.028766] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:00:40.028840] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-17T21:00:40.028905] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-17T21:00:40.028944] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-17T21:00:40.028983] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-17T21:00:40.029031] [INFO ] [MAIN ] Update Progress: 1702/2368 symbols completed. PMTW took 3.2s. Estimated remaining: 1h 34m 9s. Rate: 7.1 symbols/min [2025-10-17T21:00:40.234799] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:00:40.234968] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-10-17T21:00:40.235006] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-10-17T21:00:40.235124] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-17T21:00:40.235165] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-17T21:00:40.235270] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-17T21:00:40.235311] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-17T21:00:40.555318] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-17T21:00:40.599307] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:00:41.342304] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-10-17T21:00:41.464596] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T21:00:42.142352] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-17T21:00:42.942359] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-17T21:00:42.982985] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T21:00:42.984422] [INFO ] [REMOTE ] PMO: Full fetch complete (16196 records). [2025-10-17T21:00:42.984517] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-17T21:00:43.353585] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-17T21:00:43.353712] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-17T21:00:43.354101] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-17T21:00:43.354177] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-17T21:00:43.354993] [DEBUG] [LOCAL ] PMO: Trimmed 16196 records to 9956 (keeping 200 days of data) [2025-10-17T21:00:43.402851] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-17T21:00:43.420169] [DEBUG] [LOCAL ] PMO: Primary data saved (9956 records). [2025-10-17T21:00:43.420370] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-17T21:00:43.420558] [INFO ] [MAIN ] Update Progress: 1703/2368 symbols completed. PMO took 31.1s. Estimated remaining: 1h 33m 58s. Rate: 7.1 symbols/min [2025-10-17T21:00:43.549551] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-17T21:00:43.628214] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:00:43.637358] [DEBUG] [LOCAL ] PNI: Loaded 6853 existing records from primary storage. [2025-10-17T21:00:43.637584] [INFO ] [MAIN ] PNI: Loaded 6853 existing records. [2025-10-17T21:00:43.747432] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-17T21:00:43.816112] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:00:43.816339] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-17T21:00:43.816398] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-17T21:00:43.816577] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-10-17T21:00:43.816633] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-17T21:00:44.159702] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:00:44.542366] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-10-17T21:00:45.342325] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-17T21:00:45.370495] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-17T21:00:45.840619] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-17T21:00:46.142294] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-17T21:00:46.536135] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-17T21:00:46.942330] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-17T21:00:46.977851] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T21:00:47.745900] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-17T21:00:47.748064] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T21:00:48.123276] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-17T21:00:48.542346] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-17T21:00:49.342348] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-17T21:00:49.706986] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-17T21:00:49.707760] [INFO ] [REMOTE ] PMTU: Full fetch complete (1195 records). [2025-10-17T21:00:49.707847] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-17T21:00:49.883902] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-17T21:00:49.884071] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-17T21:00:49.884152] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-17T21:00:49.884235] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-17T21:00:49.884319] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-17T21:00:49.884373] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-17T21:00:49.884430] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-17T21:00:49.884518] [INFO ] [MAIN ] Update Progress: 1704/2368 symbols completed. PMTU took 29.9s. Estimated remaining: 1h 33m 49s. Rate: 7.1 symbols/min [2025-10-17T21:00:50.057800] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:00:50.093245] [DEBUG] [LOCAL ] PNNT: Loaded 33703 existing records from primary storage. [2025-10-17T21:00:50.093549] [INFO ] [MAIN ] PNNT: Loaded 33703 existing records. [2025-10-17T21:00:50.142253] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-17T21:00:50.265764] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T21:00:50.312494] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:00:50.313119] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-17T21:00:50.313725] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-17T21:00:50.314095] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-10-17T21:00:50.314200] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-17T21:00:50.662259] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:00:50.942254] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-17T21:00:51.015473] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-17T21:00:51.742332] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-17T21:00:52.410170] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-17T21:00:52.542264] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-17T21:00:52.633183] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T21:00:52.639922] [INFO ] [REMOTE ] PMT: Full fetch complete (58696 records). [2025-10-17T21:00:52.640052] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-17T21:00:53.033540] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-10-17T21:00:53.033680] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-10-17T21:00:53.034734] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-10-17T21:00:53.034799] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-10-17T21:00:53.036075] [DEBUG] [LOCAL ] PMT: Trimmed 58696 records to 41335 (keeping 200 days of data) [2025-10-17T21:00:53.287217] [DEBUG] [LOCAL ] PMT: Primary data saved (41335 records). [2025-10-17T21:00:53.287378] [INFO ] [MAIN ] PMT: Full history saved. [2025-10-17T21:00:53.287455] [INFO ] [MAIN ] Update Progress: 1705/2368 symbols completed. PMT took 39.7s. Estimated remaining: 1h 33m 39s. Rate: 7.1 symbols/min [2025-10-17T21:00:53.349213] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-17T21:00:53.455188] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:00:53.455370] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-10-17T21:00:53.455426] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-10-17T21:00:53.455543] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-17T21:00:53.455585] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-17T21:00:53.455625] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-17T21:00:53.455691] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-17T21:00:53.925182] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:00:54.142285] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-10-17T21:00:54.249461] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T21:00:54.503447] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-17T21:00:54.942348] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-17T21:00:55.620099] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-17T21:00:55.737531] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T21:00:55.744611] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-17T21:00:56.542311] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-10-17T21:00:57.131203] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T21:00:57.342368] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-17T21:00:58.015770] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T21:00:58.142370] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-17T21:00:58.291078] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T21:00:58.710775] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T21:00:58.942313] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-17T21:00:59.742307] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-17T21:01:00.542261] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-17T21:01:00.735905] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-17T21:01:00.800098] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T21:01:01.342278] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-17T21:01:02.142330] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-17T21:01:02.594987] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-17T21:01:02.942290] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-17T21:01:03.100001] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-17T21:01:03.143140] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-17T21:01:03.742293] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-17T21:01:04.542335] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-17T21:01:04.616431] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T21:01:04.618026] [INFO ] [REMOTE ] PNI: Full fetch complete (9722 records). [2025-10-17T21:01:04.618118] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-17T21:01:05.026181] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-10-17T21:01:05.026397] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-10-17T21:01:05.026963] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-10-17T21:01:05.027083] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-10-17T21:01:05.028504] [DEBUG] [LOCAL ] PNI: Trimmed 9722 records to 6950 (keeping 200 days of data) [2025-10-17T21:01:05.075746] [DEBUG] [LOCAL ] PNI: Primary data saved (6950 records). [2025-10-17T21:01:05.076052] [INFO ] [MAIN ] PNI: Full history saved. [2025-10-17T21:01:05.076281] [INFO ] [MAIN ] Update Progress: 1706/2368 symbols completed. PNI took 21.7s. Estimated remaining: 1h 33m 32s. Rate: 7.1 symbols/min [2025-10-17T21:01:05.287142] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-17T21:01:05.306885] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:01:05.319061] [DEBUG] [LOCAL ] PNW: No existing data file found in primary storage. [2025-10-17T21:01:05.319174] [WARN ] [MAIN ] PNW: No existing data found, performing full refresh instead. [2025-10-17T21:01:05.319896] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-17T21:01:05.319985] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-17T21:01:05.320041] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-17T21:01:05.320078] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-17T21:01:05.352115] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-17T21:01:05.693460] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:01:06.142311] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-10-17T21:01:06.519513] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-17T21:01:06.942332] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-17T21:01:07.376914] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-17T21:01:07.742312] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-17T21:01:07.877814] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T21:01:08.542294] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-17T21:01:08.614280] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T21:01:09.342325] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-17T21:01:09.513726] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T21:01:09.941691] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T21:01:10.142360] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-17T21:01:10.942354] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-17T21:01:11.265748] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T21:01:11.742299] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-17T21:01:11.826897] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T21:01:12.532089] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T21:01:12.542248] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-17T21:01:13.342365] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-17T21:01:13.473713] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T21:01:14.142276] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-17T21:01:14.222206] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T21:01:14.942329] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-17T21:01:15.148052] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T21:01:15.715003] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T21:01:15.742252] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-17T21:01:16.542289] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-17T21:01:16.920799] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-17T21:01:17.334485] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T21:01:17.342479] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-17T21:01:18.142249] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-17T21:01:18.540503] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-17T21:01:18.745755] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T21:01:18.942286] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-17T21:01:19.325371] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T21:01:19.742272] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-17T21:01:20.542277] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-17T21:01:20.759494] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T21:01:21.163786] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T21:01:21.342332] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-17T21:01:22.142308] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-17T21:01:22.372298] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T21:01:22.882353] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T21:01:22.942271] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-17T21:01:23.742258] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-17T21:01:24.069516] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T21:01:24.080147] [INFO ] [REMOTE ] PNC: Full fetch complete (75707 records). [2025-10-17T21:01:24.080304] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-17T21:01:24.489094] [DEBUG] [VALIDATOR ] PNC: All expected trading days are present. [2025-10-17T21:01:24.501565] [DEBUG] [VALIDATOR ] PNC: Primary data validation passed. [2025-10-17T21:01:24.510054] [INFO ] [MAIN ] PNC: Fetched primary data is valid. [2025-10-17T21:01:24.511787] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T21:01:24.510724] [DEBUG] [LOCAL ] PNC: Saving primary data. [2025-10-17T21:01:24.520001] [DEBUG] [LOCAL ] PNC: Trimmed 75707 records to 52874 (keeping 200 days of data) [2025-10-17T21:01:24.575982] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-17T21:01:24.856408] [DEBUG] [LOCAL ] PNC: Primary data saved (52874 records). [2025-10-17T21:01:24.856536] [INFO ] [MAIN ] PNC: Full history saved. [2025-10-17T21:01:24.856606] [INFO ] [MAIN ] Update Progress: 1707/2368 symbols completed. PNC took 44.8s. Estimated remaining: 1h 33m 27s. Rate: 7.1 symbols/min [2025-10-17T21:01:25.025351] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:01:25.025508] [DEBUG] [LOCAL ] POR: No existing data file found in primary storage. [2025-10-17T21:01:25.025561] [WARN ] [MAIN ] POR: No existing data found, performing full refresh instead. [2025-10-17T21:01:25.025725] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-17T21:01:25.025790] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-17T21:01:25.025838] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-17T21:01:25.025873] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-17T21:01:25.349269] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-17T21:01:25.380174] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:01:25.439882] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T21:01:25.446539] [INFO ] [REMOTE ] PNR: Full fetch complete (69594 records). [2025-10-17T21:01:25.446679] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-17T21:01:25.851581] [DEBUG] [VALIDATOR ] PNR: All expected trading days are present. [2025-10-17T21:01:25.851686] [DEBUG] [VALIDATOR ] PNR: Primary data validation passed. [2025-10-17T21:01:25.852882] [INFO ] [MAIN ] PNR: Fetched primary data is valid. [2025-10-17T21:01:25.852947] [DEBUG] [LOCAL ] PNR: Saving primary data. [2025-10-17T21:01:25.854303] [DEBUG] [LOCAL ] PNR: Trimmed 69594 records to 48223 (keeping 200 days of data) [2025-10-17T21:01:26.144982] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-10-17T21:01:26.154244] [DEBUG] [LOCAL ] PNR: Primary data saved (48223 records). [2025-10-17T21:01:26.154380] [INFO ] [MAIN ] PNR: Full history saved. [2025-10-17T21:01:26.154635] [INFO ] [MAIN ] Update Progress: 1708/2368 symbols completed. PNR took 32.9s. Estimated remaining: 1h 33m 16s. Rate: 7.1 symbols/min [2025-10-17T21:01:26.370384] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:01:26.367043] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T21:01:26.379449] [DEBUG] [LOCAL ] POST: No existing data file found in primary storage. [2025-10-17T21:01:26.379838] [WARN ] [MAIN ] POST: No existing data found, performing full refresh instead. [2025-10-17T21:01:26.380212] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-17T21:01:26.380258] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-17T21:01:26.380300] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-17T21:01:26.380333] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-17T21:01:26.777372] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T21:01:26.776011] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:01:26.942262] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-10-17T21:01:27.742322] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-17T21:01:27.895293] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T21:01:28.528873] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T21:01:28.542242] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-17T21:01:29.193368] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T21:01:29.199936] [INFO ] [REMOTE ] PNNT: Full fetch complete (47888 records). [2025-10-17T21:01:29.200178] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-17T21:01:29.353524] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-17T21:01:29.621079] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-10-17T21:01:29.621207] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-10-17T21:01:29.623224] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-10-17T21:01:29.623314] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-10-17T21:01:29.625006] [DEBUG] [LOCAL ] PNNT: Trimmed 47888 records to 33922 (keeping 200 days of data) [2025-10-17T21:01:29.854390] [DEBUG] [LOCAL ] PNNT: Primary data saved (33922 records). [2025-10-17T21:01:29.854615] [INFO ] [MAIN ] PNNT: Full history saved. [2025-10-17T21:01:29.854759] [INFO ] [MAIN ] Update Progress: 1709/2368 symbols completed. PNNT took 40.0s. Estimated remaining: 1h 33m 6s. Rate: 7.1 symbols/min [2025-10-17T21:01:30.050365] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:01:30.050921] [DEBUG] [LOCAL ] PPG: No existing data file found in primary storage. [2025-10-17T21:01:30.051011] [WARN ] [MAIN ] PPG: No existing data found, performing full refresh instead. [2025-10-17T21:01:30.051488] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-17T21:01:30.051541] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-17T21:01:30.059295] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-17T21:01:30.071684] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-17T21:01:30.109598] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T21:01:30.151151] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-17T21:01:30.468177] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:01:30.942304] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-17T21:01:31.437874] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-17T21:01:31.742366] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-17T21:01:31.919411] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T21:01:32.061704] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T21:01:32.542352] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-10-17T21:01:33.342359] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-17T21:01:33.476355] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T21:01:34.142302] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-17T21:01:34.352347] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T21:01:34.514331] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-17T21:01:34.942299] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-17T21:01:35.742295] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-17T21:01:35.836962] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T21:01:36.359460] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T21:01:36.542313] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-17T21:01:37.342295] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-17T21:01:37.495388] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T21:01:37.981482] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T21:01:38.142318] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-17T21:01:38.942388] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-17T21:01:39.068172] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T21:01:39.743034] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-17T21:01:39.746198] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T21:01:40.263052] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-17T21:01:40.542351] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-17T21:01:41.342398] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-17T21:01:41.632753] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T21:01:42.092531] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T21:01:42.142336] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-17T21:01:42.942305] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-17T21:01:43.226263] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T21:01:43.623309] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T21:01:43.742278] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-17T21:01:44.298146] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T21:01:44.542281] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-17T21:01:45.342273] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-17T21:01:45.379867] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T21:01:46.142267] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-17T21:01:46.363209] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T21:01:46.636538] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-17T21:01:46.942276] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-17T21:01:47.742384] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-17T21:01:47.792551] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T21:01:48.524034] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T21:01:48.542254] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-17T21:01:49.342326] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-17T21:01:49.595134] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T21:01:49.852853] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T21:01:50.142360] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-17T21:01:50.942389] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-17T21:01:51.053827] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T21:01:51.059916] [INFO ] [REMOTE ] PNW: Full fetch complete (65974 records). [2025-10-17T21:01:51.060041] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-17T21:01:51.450049] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-10-17T21:01:51.450159] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-10-17T21:01:51.451216] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-10-17T21:01:51.451278] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-10-17T21:01:51.452591] [DEBUG] [LOCAL ] PNW: Trimmed 65974 records to 46225 (keeping 200 days of data) [2025-10-17T21:01:51.564459] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-17T21:01:51.571663] [INFO ] [REMOTE ] POST: Full fetch complete (55658 records). [2025-10-17T21:01:51.572806] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-17T21:01:51.747447] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-17T21:01:52.112814] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-10-17T21:01:52.113147] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-10-17T21:01:52.116864] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-10-17T21:01:52.119572] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-10-17T21:01:52.143883] [DEBUG] [LOCAL ] POST: Trimmed 55658 records to 39267 (keeping 200 days of data) [2025-10-17T21:01:52.252686] [DEBUG] [LOCAL ] PNW: Primary data saved (46225 records). [2025-10-17T21:01:52.253549] [INFO ] [MAIN ] PNW: Full history saved. [2025-10-17T21:01:52.253962] [INFO ] [MAIN ] Update Progress: 1710/2368 symbols completed. PNW took 47.2s. Estimated remaining: 1h 33m 3s. Rate: 7.1 symbols/min [2025-10-17T21:01:52.440060] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:01:52.441346] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-10-17T21:01:52.443739] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-10-17T21:01:52.444448] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-17T21:01:52.444842] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-17T21:01:52.445295] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-17T21:01:52.445362] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-17T21:01:52.925558] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:01:52.950765] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-10-17T21:01:52.961852] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-17T21:01:53.003608] [DEBUG] [LOCAL ] POST: Primary data saved (39267 records). [2025-10-17T21:01:53.003771] [INFO ] [MAIN ] POST: Full history saved. [2025-10-17T21:01:53.003849] [INFO ] [MAIN ] Update Progress: 1711/2368 symbols completed. POST took 26.8s. Estimated remaining: 1h 32m 51s. Rate: 7.1 symbols/min [2025-10-17T21:01:53.170094] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:01:53.196524] [DEBUG] [LOCAL ] PPT: Loaded 19948 existing records from primary storage. [2025-10-17T21:01:53.196791] [INFO ] [MAIN ] PPT: Loaded 19948 existing records. [2025-10-17T21:01:53.349059] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-17T21:01:53.378826] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:01:53.380289] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-17T21:01:53.380349] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-17T21:01:53.380844] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-10-17T21:01:53.380905] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-17T21:01:53.534137] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T21:01:53.831909] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:01:54.142394] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-10-17T21:01:54.933401] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-17T21:01:54.944562] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-17T21:01:55.260856] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T21:01:55.657621] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T21:01:55.742291] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-17T21:01:56.542315] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-17T21:01:56.758219] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T21:01:57.342293] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-17T21:01:57.640464] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T21:01:57.674524] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-17T21:01:58.142298] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-17T21:01:58.942295] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-17T21:01:59.073027] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T21:01:59.282089] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T21:01:59.742335] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-17T21:02:00.542270] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-17T21:02:00.793221] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T21:02:01.342303] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-17T21:02:01.560860] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-17T21:02:01.725693] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-17T21:02:02.142313] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-17T21:02:02.956064] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-17T21:02:02.958918] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T21:02:03.338451] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T21:02:03.742303] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-17T21:02:04.542329] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-17T21:02:04.679284] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T21:02:04.686512] [INFO ] [REMOTE ] PPG: Full fetch complete (74014 records). [2025-10-17T21:02:04.686635] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-17T21:02:05.102153] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-10-17T21:02:05.102232] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-10-17T21:02:05.103328] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-10-17T21:02:05.103392] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-10-17T21:02:05.104812] [DEBUG] [LOCAL ] PPG: Trimmed 74014 records to 51405 (keeping 200 days of data) [2025-10-17T21:02:05.345066] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-17T21:02:05.443595] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T21:02:05.453271] [INFO ] [REMOTE ] POR: Full fetch complete (68481 records). [2025-10-17T21:02:05.455521] [DEBUG] [LOCAL ] PPG: Primary data saved (51405 records). [2025-10-17T21:02:05.455717] [INFO ] [MAIN ] PPG: Full history saved. [2025-10-17T21:02:05.455825] [INFO ] [MAIN ] Update Progress: 1712/2368 symbols completed. PPG took 35.6s. Estimated remaining: 1h 32m 44s. Rate: 7.1 symbols/min [2025-10-17T21:02:05.467200] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-17T21:02:05.791128] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:02:05.801267] [DEBUG] [LOCAL ] PR: No existing data file found in primary storage. [2025-10-17T21:02:05.801337] [WARN ] [MAIN ] PR: No existing data found, performing full refresh instead. [2025-10-17T21:02:05.820167] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-17T21:02:05.823355] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-17T21:02:05.842768] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-17T21:02:05.878570] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-17T21:02:06.231372] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-10-17T21:02:06.247907] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-10-17T21:02:06.249205] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-10-17T21:02:06.272034] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-10-17T21:02:06.345755] [DEBUG] [LOCAL ] POR: Trimmed 68481 records to 47568 (keeping 200 days of data) [2025-10-17T21:02:06.471956] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:02:06.472715] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-10-17T21:02:06.560166] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T21:02:06.720940] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T21:02:06.816922] [DEBUG] [LOCAL ] POR: Primary data saved (47568 records). [2025-10-17T21:02:06.817139] [INFO ] [MAIN ] POR: Full history saved. [2025-10-17T21:02:06.817233] [INFO ] [MAIN ] Update Progress: 1713/2368 symbols completed. POR took 42.0s. Estimated remaining: 1h 32m 33s. Rate: 7.1 symbols/min [2025-10-17T21:02:06.951146] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-17T21:02:07.047695] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:02:07.047978] [DEBUG] [LOCAL ] PRA: No existing data file found in primary storage. [2025-10-17T21:02:07.048021] [WARN ] [MAIN ] PRA: No existing data found, performing full refresh instead. [2025-10-17T21:02:07.048157] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-17T21:02:07.048200] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-17T21:02:07.048241] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-17T21:02:07.048304] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-17T21:02:07.410182] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:02:07.742319] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-10-17T21:02:08.247542] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T21:02:08.424451] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-17T21:02:08.510238] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T21:02:08.542251] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-17T21:02:09.342344] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-17T21:02:09.772743] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T21:02:10.142378] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-17T21:02:10.563788] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-17T21:02:10.942353] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-17T21:02:11.280988] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T21:02:11.742376] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-17T21:02:12.542302] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-17T21:02:12.647192] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T21:02:13.342301] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-17T21:02:13.575623] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-17T21:02:13.617918] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T21:02:14.142301] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-17T21:02:14.708174] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T21:02:14.942265] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-17T21:02:15.334148] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T21:02:15.742374] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-17T21:02:16.542359] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-17T21:02:17.342323] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-17T21:02:17.476368] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T21:02:17.654147] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T21:02:17.656592] [INFO ] [REMOTE ] PPT: Full fetch complete (28479 records). [2025-10-17T21:02:17.656709] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-17T21:02:18.047100] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (3.10 seconds). [2025-10-17T21:02:18.067523] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-17T21:02:18.067968] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-17T21:02:18.068560] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-17T21:02:18.068664] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-17T21:02:18.069687] [DEBUG] [LOCAL ] PPT: Trimmed 28479 records to 20031 (keeping 200 days of data) [2025-10-17T21:02:18.150287] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-17T21:02:18.185327] [DEBUG] [LOCAL ] PPT: Primary data saved (20031 records). [2025-10-17T21:02:18.185431] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-17T21:02:18.185514] [INFO ] [MAIN ] Update Progress: 1714/2368 symbols completed. PPT took 25.2s. Estimated remaining: 1h 32m 26s. Rate: 7.1 symbols/min [2025-10-17T21:02:18.350758] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:02:18.355756] [DEBUG] [LOCAL ] PRCS: Loaded 2807 existing records from primary storage. [2025-10-17T21:02:18.355898] [INFO ] [MAIN ] PRCS: Loaded 2807 existing records. [2025-10-17T21:02:18.533468] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:02:18.533760] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-17T21:02:18.533823] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-17T21:02:18.533968] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-10-17T21:02:18.534068] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-17T21:02:18.876711] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:02:18.942239] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-10-17T21:02:19.202706] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T21:02:19.348793] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-17T21:02:19.742306] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-17T21:02:19.988605] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T21:02:20.542346] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-17T21:02:21.100544] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T21:02:21.342396] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-17T21:02:21.462414] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T21:02:22.032818] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-17T21:02:22.142272] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-17T21:02:22.713630] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-17T21:02:22.942336] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-17T21:02:23.742434] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-17T21:02:24.548591] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-17T21:02:24.555338] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T21:02:25.198324] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-17T21:02:25.342321] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-17T21:02:25.805866] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-17T21:02:26.142359] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-17T21:02:26.836240] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T21:02:26.942305] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-17T21:02:27.278719] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T21:02:27.441568] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-17T21:02:27.742260] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-17T21:02:28.342842] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-17T21:02:28.542347] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-17T21:02:29.342293] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-17T21:02:29.883908] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-17T21:02:30.142306] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-17T21:02:30.550910] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-17T21:02:30.942293] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-17T21:02:31.742271] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-17T21:02:32.142573] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T21:02:32.312715] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T21:02:32.542274] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-17T21:02:33.342277] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-17T21:02:33.386688] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T21:02:34.105147] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T21:02:34.142313] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-17T21:02:34.678601] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-17T21:02:34.942283] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-17T21:02:35.210034] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-17T21:02:35.742302] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-17T21:02:36.542286] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-17T21:02:36.746776] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T21:02:36.754638] [INFO ] [REMOTE ] PPL: Full fetch complete (77608 records). [2025-10-17T21:02:36.754816] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-17T21:02:37.086810] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-17T21:02:37.108600] [INFO ] [REMOTE ] PRCS: Full fetch complete (3906 records). [2025-10-17T21:02:37.129585] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-17T21:02:37.279736] [DEBUG] [VALIDATOR ] PPL: All expected trading days are present. [2025-10-17T21:02:37.286434] [DEBUG] [VALIDATOR ] PPL: Primary data validation passed. [2025-10-17T21:02:37.299018] [INFO ] [MAIN ] PPL: Fetched primary data is valid. [2025-10-17T21:02:37.299168] [DEBUG] [LOCAL ] PPL: Saving primary data. [2025-10-17T21:02:37.347376] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-17T21:02:37.474614] [DEBUG] [LOCAL ] PPL: Trimmed 77608 records to 54281 (keeping 200 days of data) [2025-10-17T21:02:37.690372] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-17T21:02:37.690512] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-17T21:02:37.691181] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-17T21:02:37.707542] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-17T21:02:37.714434] [DEBUG] [LOCAL ] PRCS: Trimmed 3906 records to 2830 (keeping 200 days of data) [2025-10-17T21:02:37.835908] [DEBUG] [LOCAL ] PRCS: Primary data saved (2830 records). [2025-10-17T21:02:37.852870] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-17T21:02:37.867726] [INFO ] [MAIN ] Update Progress: 1715/2368 symbols completed. PRCS took 19.7s. Estimated remaining: 1h 32m 22s. Rate: 7.1 symbols/min [2025-10-17T21:02:37.914172] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-17T21:02:38.083219] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:02:38.084245] [DEBUG] [LOCAL ] PRG: No existing data file found in primary storage. [2025-10-17T21:02:38.084945] [WARN ] [MAIN ] PRG: No existing data found, performing full refresh instead. [2025-10-17T21:02:38.087601] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-17T21:02:38.087709] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-17T21:02:38.088574] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-17T21:02:38.089980] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-17T21:02:38.160163] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-17T21:02:38.518959] [DEBUG] [LOCAL ] PPL: Primary data saved (54281 records). [2025-10-17T21:02:38.556391] [INFO ] [MAIN ] PPL: Full history saved. [2025-10-17T21:02:38.558120] [INFO ] [MAIN ] Update Progress: 1716/2368 symbols completed. PPL took 46.3s. Estimated remaining: 1h 32m 10s. Rate: 7.1 symbols/min [2025-10-17T21:02:38.586003] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:02:38.752262] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:02:38.752497] [DEBUG] [LOCAL ] PRGO: No existing data file found in primary storage. [2025-10-17T21:02:38.752565] [WARN ] [MAIN ] PRGO: No existing data found, performing full refresh instead. [2025-10-17T21:02:38.772768] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-17T21:02:38.772638] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T21:02:38.772922] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-17T21:02:38.779922] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-17T21:02:38.779979] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-17T21:02:38.949130] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-17T21:02:39.137833] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:02:39.742366] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-10-17T21:02:39.979466] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T21:02:40.393502] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T21:02:40.542297] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-17T21:02:41.260124] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T21:02:41.342300] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-10-17T21:02:42.142246] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-17T21:02:42.465777] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T21:02:42.942370] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-17T21:02:43.038329] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T21:02:43.228464] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T21:02:43.742303] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-17T21:02:44.150894] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T21:02:44.155755] [INFO ] [REMOTE ] PRA: Full fetch complete (45067 records). [2025-10-17T21:02:44.155881] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-17T21:02:44.535230] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-10-17T21:02:44.535310] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-10-17T21:02:44.536192] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-10-17T21:02:44.536253] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-10-17T21:02:44.537195] [DEBUG] [LOCAL ] PRA: Trimmed 45067 records to 35319 (keeping 200 days of data) [2025-10-17T21:02:44.583763] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-17T21:02:44.744289] [DEBUG] [LOCAL ] PRA: Primary data saved (35319 records). [2025-10-17T21:02:44.744472] [INFO ] [MAIN ] PRA: Full history saved. [2025-10-17T21:02:44.744590] [INFO ] [MAIN ] Update Progress: 1717/2368 symbols completed. PRA took 37.9s. Estimated remaining: 1h 32m 1s. Rate: 7.1 symbols/min [2025-10-17T21:02:45.342272] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-17T21:02:45.532576] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T21:02:46.142365] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-17T21:02:46.605342] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-17T21:02:46.613023] [INFO ] [REMOTE ] PR: Full fetch complete (77763 records). [2025-10-17T21:02:46.613155] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-17T21:02:46.946634] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T21:02:46.986236] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-17T21:02:47.028166] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-10-17T21:02:47.028243] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-10-17T21:02:47.029504] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-10-17T21:02:47.029573] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-10-17T21:02:47.031094] [DEBUG] [LOCAL ] PR: Trimmed 77763 records to 54390 (keeping 200 days of data) [2025-10-17T21:02:47.364062] [DEBUG] [LOCAL ] PR: Primary data saved (54390 records). [2025-10-17T21:02:47.364238] [INFO ] [MAIN ] PR: Full history saved. [2025-10-17T21:02:47.364352] [INFO ] [MAIN ] Update Progress: 1718/2368 symbols completed. PR took 41.9s. Estimated remaining: 1h 31m 50s. Rate: 7.1 symbols/min [2025-10-17T21:02:47.913328] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-17T21:02:47.922632] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-17T21:02:48.466604] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T21:02:48.542253] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-17T21:02:49.666522] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T21:02:49.676781] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-17T21:02:50.008814] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T21:02:50.142286] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-17T21:02:51.376590] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T21:02:51.390796] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-17T21:02:51.579562] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T21:02:51.742283] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-17T21:02:53.143618] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T21:02:53.153909] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-17T21:02:53.203601] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T21:02:53.342368] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-17T21:02:54.722607] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T21:02:54.731869] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-17T21:02:54.853208] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-17T21:02:54.942250] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-17T21:02:56.631047] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T21:02:56.640921] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-17T21:02:57.309162] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-17T21:02:57.315391] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-17T21:02:58.343684] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T21:02:58.354199] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-17T21:02:58.726495] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T21:02:58.732867] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-17T21:03:00.046880] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T21:03:00.057820] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-17T21:03:01.823456] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T21:03:01.831850] [INFO ] [REMOTE ] PRGO: Full fetch complete (68834 records). [2025-10-17T21:03:01.832297] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-17T21:03:02.250247] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-10-17T21:03:02.250411] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-10-17T21:03:02.252518] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-10-17T21:03:02.252608] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-10-17T21:03:02.254701] [DEBUG] [LOCAL ] PRGO: Trimmed 68834 records to 47838 (keeping 200 days of data) [2025-10-17T21:03:02.570702] [DEBUG] [LOCAL ] PRGO: Primary data saved (47838 records). [2025-10-17T21:03:02.570909] [INFO ] [MAIN ] PRGO: Full history saved. [2025-10-17T21:03:02.571003] [INFO ] [MAIN ] Update Progress: 1719/2368 symbols completed. PRGO took 24.0s. Estimated remaining: 1h 31m 44s. Rate: 7.1 symbols/min [2025-10-17T21:03:10.090032] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (11.36 seconds). [2025-10-17T21:03:10.095187] [INFO ] [REMOTE ] PRG: Full fetch complete (44292 records). [2025-10-17T21:03:10.095406] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-17T21:03:10.506236] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-10-17T21:03:10.506356] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-10-17T21:03:10.507629] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-10-17T21:03:10.507715] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-10-17T21:03:10.509223] [DEBUG] [LOCAL ] PRG: Trimmed 44292 records to 30087 (keeping 200 days of data) [2025-10-17T21:03:10.708542] [DEBUG] [LOCAL ] PRG: Primary data saved (30087 records). [2025-10-17T21:03:10.708738] [INFO ] [MAIN ] PRG: Full history saved. [2025-10-17T21:03:10.708868] [INFO ] [MAIN ] Update Progress: 1720/2368 symbols completed. PRG took 32.8s. Estimated remaining: 1h 31m 35s. Rate: 7.1 symbols/min [2025-10-17T21:03:11.311429] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:03:11.371304] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:03:11.399681] [DEBUG] [LOCAL ] PRKS: No existing data file found in primary storage. [2025-10-17T21:03:11.423956] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:03:11.450247] [DEBUG] [LOCAL ] PRIM: No existing data file found in primary storage. [2025-10-17T21:03:11.449998] [WARN ] [MAIN ] PRKS: No existing data found, performing full refresh instead. [2025-10-17T21:03:11.453689] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:03:11.454266] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-17T21:03:11.454386] [WARN ] [MAIN ] PRIM: No existing data found, performing full refresh instead. [2025-10-17T21:03:11.458017] [DEBUG] [LOCAL ] PRH: Loaded 4774 existing records from primary storage. [2025-10-17T21:03:11.458274] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-17T21:03:11.458838] [INFO ] [MAIN ] PRH: Loaded 4774 existing records. [2025-10-17T21:03:11.458461] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-17T21:03:11.458106] [DEBUG] [LOCAL ] PRI: No existing data file found in primary storage. [2025-10-17T21:03:11.464331] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-17T21:03:11.480256] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-17T21:03:11.489586] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-17T21:03:11.494949] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-17T21:03:11.500527] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-17T21:03:11.480105] [WARN ] [MAIN ] PRI: No existing data found, performing full refresh instead. [2025-10-17T21:03:11.610995] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-17T21:03:11.666615] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-17T21:03:11.695557] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-17T21:03:11.695765] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-17T21:03:12.125712] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:03:12.211468] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-17T21:03:12.223672] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-17T21:03:12.300393] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-10-17T21:03:12.339777] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-17T21:03:12.990682] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:03:13.052214] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-10-17T21:03:13.024172] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:03:13.120560] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-10-17T21:03:13.148154] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:03:13.172242] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-10-17T21:03:13.279826] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:03:13.280152] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-10-17T21:03:13.911428] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-17T21:03:13.913291] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-17T21:03:14.377190] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-17T21:03:14.381781] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-17T21:03:14.386963] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-17T21:03:14.389014] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-17T21:03:14.612911] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T21:03:14.621615] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-17T21:03:14.760002] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T21:03:14.768052] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-17T21:03:15.091424] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-17T21:03:15.095380] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-17T21:03:15.186488] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T21:03:15.188780] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-17T21:03:15.849863] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-17T21:03:15.851876] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-17T21:03:15.937409] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-17T21:03:15.941205] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-17T21:03:16.176233] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T21:03:16.184467] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-17T21:03:16.435495] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T21:03:16.444116] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-17T21:03:16.577480] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-17T21:03:16.579762] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-17T21:03:17.029264] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T21:03:17.033974] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-17T21:03:17.068932] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-17T21:03:17.071087] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-17T21:03:17.269990] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T21:03:17.278190] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-17T21:03:17.761269] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-17T21:03:17.762875] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-17T21:03:17.848888] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T21:03:17.853854] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-17T21:03:18.053217] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T21:03:18.061840] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-17T21:03:18.177742] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-17T21:03:18.179203] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-17T21:03:18.559283] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-17T21:03:18.568413] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-17T21:03:18.909091] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-17T21:03:18.942244] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-17T21:03:19.076851] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-17T21:03:19.548858] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-17T21:03:19.742292] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-17T21:03:19.781711] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T21:03:20.202945] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T21:03:20.542255] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-17T21:03:20.814944] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T21:03:21.342279] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-17T21:03:21.927119] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-17T21:03:21.928291] [INFO ] [REMOTE ] PRH: Full fetch complete (7463 records). [2025-10-17T21:03:21.928361] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-17T21:03:22.143610] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-17T21:03:22.298032] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-10-17T21:03:22.298123] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-10-17T21:03:22.298320] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-10-17T21:03:22.298504] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-10-17T21:03:22.313039] [DEBUG] [LOCAL ] PRH: Trimmed 7463 records to 4808 (keeping 200 days of data) [2025-10-17T21:03:22.335056] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T21:03:22.360392] [DEBUG] [LOCAL ] PRH: Primary data saved (4808 records). [2025-10-17T21:03:22.360498] [INFO ] [MAIN ] PRH: Full history saved. [2025-10-17T21:03:22.360572] [INFO ] [MAIN ] Update Progress: 1721/2368 symbols completed. PRH took 11.7s. Estimated remaining: 1h 31m 28s. Rate: 7.1 symbols/min [2025-10-17T21:03:22.526029] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:03:22.526174] [DEBUG] [LOCAL ] PRLB: No existing data file found in primary storage. [2025-10-17T21:03:22.526210] [WARN ] [MAIN ] PRLB: No existing data found, performing full refresh instead. [2025-10-17T21:03:22.526321] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-17T21:03:22.526363] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-17T21:03:22.526403] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-17T21:03:22.526435] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-17T21:03:22.867903] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:03:22.942246] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-10-17T21:03:23.742288] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-17T21:03:23.779178] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T21:03:23.842130] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-17T21:03:24.542348] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-17T21:03:25.342423] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-17T21:03:25.500784] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T21:03:26.144066] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-17T21:03:26.146512] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T21:03:26.228930] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-17T21:03:26.942272] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-17T21:03:27.023708] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-17T21:03:27.742341] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-17T21:03:28.542890] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-17T21:03:28.542823] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T21:03:29.342354] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-17T21:03:30.142273] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-17T21:03:30.182887] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T21:03:30.942360] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-17T21:03:30.990802] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (3.25 seconds). [2025-10-17T21:03:30.990411] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T21:03:31.742352] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-17T21:03:32.542280] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-17T21:03:32.736716] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T21:03:32.808091] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-10-17T21:03:33.342349] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-17T21:03:33.400725] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T21:03:33.591812] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T21:03:34.142325] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-17T21:03:34.942354] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-17T21:03:35.205438] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T21:03:35.298953] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T21:03:35.742268] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-17T21:03:36.214536] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T21:03:36.221175] [INFO ] [REMOTE ] PRKS: Full fetch complete (61780 records). [2025-10-17T21:03:36.221384] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-17T21:03:36.547626] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-17T21:03:36.631569] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-10-17T21:03:36.631697] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-10-17T21:03:36.632939] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-10-17T21:03:36.633006] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-10-17T21:03:36.634583] [DEBUG] [LOCAL ] PRKS: Trimmed 61780 records to 43185 (keeping 200 days of data) [2025-10-17T21:03:36.886009] [DEBUG] [LOCAL ] PRKS: Primary data saved (43185 records). [2025-10-17T21:03:36.886144] [INFO ] [MAIN ] PRKS: Full history saved. [2025-10-17T21:03:36.886219] [INFO ] [MAIN ] Update Progress: 1722/2368 symbols completed. PRKS took 26.2s. Estimated remaining: 1h 31m 22s. Rate: 7.1 symbols/min [2025-10-17T21:03:37.072339] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:03:37.072705] [DEBUG] [LOCAL ] PRM: No existing data file found in primary storage. [2025-10-17T21:03:37.072833] [WARN ] [MAIN ] PRM: No existing data found, performing full refresh instead. [2025-10-17T21:03:37.073118] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-17T21:03:37.073174] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-17T21:03:37.073329] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-17T21:03:37.073534] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-17T21:03:37.191957] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T21:03:37.347476] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-17T21:03:37.457767] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:03:37.622544] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T21:03:37.625395] [INFO ] [REMOTE ] PRI: Full fetch complete (25636 records). [2025-10-17T21:03:37.625473] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-17T21:03:37.985100] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-10-17T21:03:37.985190] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-10-17T21:03:37.985771] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-10-17T21:03:37.985832] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-10-17T21:03:37.986495] [DEBUG] [LOCAL ] PRI: Trimmed 25636 records to 18363 (keeping 200 days of data) [2025-10-17T21:03:38.097708] [DEBUG] [LOCAL ] PRI: Primary data saved (18363 records). [2025-10-17T21:03:38.097837] [INFO ] [MAIN ] PRI: Full history saved. [2025-10-17T21:03:38.097911] [INFO ] [MAIN ] Update Progress: 1723/2368 symbols completed. PRI took 27.4s. Estimated remaining: 1h 31m 11s. Rate: 7.1 symbols/min [2025-10-17T21:03:38.151195] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-10-17T21:03:38.264090] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:03:38.264255] [DEBUG] [LOCAL ] PRMB: No existing data file found in primary storage. [2025-10-17T21:03:38.264292] [WARN ] [MAIN ] PRMB: No existing data found, performing full refresh instead. [2025-10-17T21:03:38.264413] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-17T21:03:38.264455] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-17T21:03:38.264495] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-17T21:03:38.264528] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-17T21:03:38.606930] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:03:38.942299] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-10-17T21:03:39.116975] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T21:03:39.390229] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T21:03:39.742265] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-17T21:03:40.542295] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-17T21:03:40.887710] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-17T21:03:40.950624] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T21:03:41.342291] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-17T21:03:42.142308] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-17T21:03:42.182833] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T21:03:42.240014] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T21:03:42.942344] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-17T21:03:43.713563] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T21:03:43.719929] [INFO ] [REMOTE ] PRIM: Full fetch complete (63814 records). [2025-10-17T21:03:43.720089] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-17T21:03:43.751371] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-17T21:03:44.115089] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-10-17T21:03:44.115165] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-10-17T21:03:44.116187] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-10-17T21:03:44.116282] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-10-17T21:03:44.117520] [DEBUG] [LOCAL ] PRIM: Trimmed 63814 records to 44853 (keeping 200 days of data) [2025-10-17T21:03:44.392631] [DEBUG] [LOCAL ] PRIM: Primary data saved (44853 records). [2025-10-17T21:03:44.392797] [INFO ] [MAIN ] PRIM: Full history saved. [2025-10-17T21:03:44.392872] [INFO ] [MAIN ] Update Progress: 1724/2368 symbols completed. PRIM took 33.7s. Estimated remaining: 1h 31m 1s. Rate: 7.1 symbols/min [2025-10-17T21:03:44.543971] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-17T21:03:44.566953] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:03:44.568016] [DEBUG] [LOCAL ] PRO: No existing data file found in primary storage. [2025-10-17T21:03:44.568063] [WARN ] [MAIN ] PRO: No existing data found, performing full refresh instead. [2025-10-17T21:03:44.568178] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-17T21:03:44.568219] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-17T21:03:44.568260] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-17T21:03:44.568291] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-17T21:03:44.927114] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:03:44.982459] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-17T21:03:45.342341] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-17T21:03:45.396770] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-17T21:03:46.142320] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-17T21:03:46.425625] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T21:03:46.465561] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T21:03:46.942348] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-17T21:03:47.558175] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T21:03:47.742388] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-10-17T21:03:48.024836] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T21:03:48.542369] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-17T21:03:48.971990] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-17T21:03:49.342365] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-17T21:03:49.775778] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-17T21:03:49.778624] [INFO ] [REMOTE ] PRLB: Full fetch complete (30272 records). [2025-10-17T21:03:49.778745] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-17T21:03:50.148459] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-17T21:03:50.150516] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-10-17T21:03:50.150593] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-10-17T21:03:50.151289] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-10-17T21:03:50.151954] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-10-17T21:03:50.152778] [DEBUG] [LOCAL ] PRLB: Trimmed 30272 records to 20632 (keeping 200 days of data) [2025-10-17T21:03:50.290141] [DEBUG] [LOCAL ] PRLB: Primary data saved (20632 records). [2025-10-17T21:03:50.290269] [INFO ] [MAIN ] PRLB: Full history saved. [2025-10-17T21:03:50.290343] [INFO ] [MAIN ] Update Progress: 1725/2368 symbols completed. PRLB took 27.9s. Estimated remaining: 1h 30m 52s. Rate: 7.1 symbols/min [2025-10-17T21:03:50.466685] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:03:50.466860] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-10-17T21:03:50.466898] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-10-17T21:03:50.467023] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-17T21:03:50.467086] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-17T21:03:50.467129] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-17T21:03:50.467160] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-17T21:03:50.787977] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T21:03:50.848723] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:03:50.942292] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-17T21:03:51.742327] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-17T21:03:52.415007] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-17T21:03:52.542263] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-17T21:03:52.572152] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T21:03:53.097713] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-17T21:03:53.342288] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-17T21:03:54.142314] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-17T21:03:54.357042] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T21:03:54.419745] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T21:03:54.942295] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-17T21:03:55.742329] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-10-17T21:03:55.827455] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T21:03:56.044422] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:03:56.044754] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-10-17T21:03:56.044842] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:03:56.044915] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-10-17T21:03:56.044980] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:03:56.045049] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-17T21:03:56.045111] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-17T21:03:56.045146] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-10-17T21:03:56.045185] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-10-17T21:03:56.045233] [INFO ] [MAIN ] Update Progress: 1726/2368 symbols completed. PRSU took 5.8s. Estimated remaining: 1h 30m 43s. Rate: 7.1 symbols/min [2025-10-17T21:03:56.210837] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:03:56.218090] [DEBUG] [LOCAL ] PRT: Loaded 5190 existing records from primary storage. [2025-10-17T21:03:56.218265] [INFO ] [MAIN ] PRT: Loaded 5190 existing records. [2025-10-17T21:03:56.401774] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:03:56.402048] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-17T21:03:56.402255] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-17T21:03:56.402574] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-10-17T21:03:56.402689] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-17T21:03:56.544012] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-17T21:03:56.794324] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:03:56.796546] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T21:03:57.342350] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-10-17T21:03:58.082813] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T21:03:58.142335] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-17T21:03:58.266140] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-17T21:03:58.942336] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-17T21:03:59.742342] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-17T21:04:00.087468] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T21:04:00.253766] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-17T21:04:00.315115] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-17T21:04:00.542279] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-17T21:04:01.342291] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-17T21:04:01.501766] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T21:04:02.142296] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-17T21:04:02.948064] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-17T21:04:02.971377] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T21:04:03.742371] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-17T21:04:03.786266] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T21:04:03.787346] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-17T21:04:04.542350] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-17T21:04:05.272626] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-17T21:04:05.342276] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-17T21:04:05.433840] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T21:04:06.142274] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-17T21:04:06.685032] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-17T21:04:06.850945] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-17T21:04:06.942378] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-17T21:04:07.742356] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-17T21:04:08.542319] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-17T21:04:08.550581] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T21:04:09.076170] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-17T21:04:09.342348] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-17T21:04:10.106275] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T21:04:10.132522] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T21:04:10.142259] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-17T21:04:10.778632] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T21:04:10.942291] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-17T21:04:11.742370] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-17T21:04:12.542271] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-17T21:04:12.573271] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T21:04:12.579527] [INFO ] [REMOTE ] PRM: Full fetch complete (64652 records). [2025-10-17T21:04:12.579719] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-17T21:04:12.679008] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T21:04:12.985433] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-10-17T21:04:12.985512] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-10-17T21:04:12.986519] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-10-17T21:04:12.986584] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-10-17T21:04:12.988049] [DEBUG] [LOCAL ] PRM: Trimmed 64652 records to 45003 (keeping 200 days of data) [2025-10-17T21:04:13.247153] [DEBUG] [LOCAL ] PRM: Primary data saved (45003 records). [2025-10-17T21:04:13.247277] [INFO ] [MAIN ] PRM: Full history saved. [2025-10-17T21:04:13.247345] [INFO ] [MAIN ] Update Progress: 1727/2368 symbols completed. PRM took 36.4s. Estimated remaining: 1h 30m 37s. Rate: 7.1 symbols/min [2025-10-17T21:04:13.347519] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-17T21:04:13.421140] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:04:13.421290] [DEBUG] [LOCAL ] PRU: No existing data file found in primary storage. [2025-10-17T21:04:13.421330] [WARN ] [MAIN ] PRU: No existing data found, performing full refresh instead. [2025-10-17T21:04:13.421515] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-17T21:04:13.421569] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-17T21:04:13.421612] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-17T21:04:13.421666] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-17T21:04:13.776132] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:04:13.987407] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-17T21:04:13.988963] [INFO ] [REMOTE ] PRT: Full fetch complete (8676 records). [2025-10-17T21:04:13.989072] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-17T21:04:14.148801] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-10-17T21:04:14.401477] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-10-17T21:04:14.401745] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-10-17T21:04:14.402234] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-10-17T21:04:14.402412] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-10-17T21:04:14.403148] [DEBUG] [LOCAL ] PRT: Trimmed 8676 records to 5219 (keeping 200 days of data) [2025-10-17T21:04:14.439228] [DEBUG] [LOCAL ] PRT: Primary data saved (5219 records). [2025-10-17T21:04:14.439449] [INFO ] [MAIN ] PRT: Full history saved. [2025-10-17T21:04:14.439563] [INFO ] [MAIN ] Update Progress: 1728/2368 symbols completed. PRT took 18.4s. Estimated remaining: 1h 30m 26s. Rate: 7.1 symbols/min [2025-10-17T21:04:14.645508] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:04:14.645884] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-17T21:04:14.646108] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-17T21:04:14.646274] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-17T21:04:14.646380] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-17T21:04:14.646764] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-17T21:04:14.646893] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-17T21:04:14.791817] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-17T21:04:14.949611] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-17T21:04:15.080488] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:04:15.742345] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-10-17T21:04:15.830875] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T21:04:16.168485] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-17T21:04:16.542276] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-17T21:04:16.586793] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T21:04:17.342389] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-17T21:04:18.142306] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-17T21:04:18.469070] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-17T21:04:18.929934] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T21:04:18.942247] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-17T21:04:19.742313] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-17T21:04:20.179363] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T21:04:20.260429] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-17T21:04:20.542346] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-17T21:04:20.578527] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T21:04:20.585105] [INFO ] [REMOTE ] PRO: Full fetch complete (53610 records). [2025-10-17T21:04:20.585233] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-17T21:04:20.980510] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-10-17T21:04:20.980587] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-10-17T21:04:20.981510] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-10-17T21:04:20.981574] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-10-17T21:04:20.982678] [DEBUG] [LOCAL ] PRO: Trimmed 53610 records to 40543 (keeping 200 days of data) [2025-10-17T21:04:21.218287] [DEBUG] [LOCAL ] PRO: Primary data saved (40543 records). [2025-10-17T21:04:21.218402] [INFO ] [MAIN ] PRO: Full history saved. [2025-10-17T21:04:21.218471] [INFO ] [MAIN ] Update Progress: 1729/2368 symbols completed. PRO took 36.8s. Estimated remaining: 1h 30m 17s. Rate: 7.1 symbols/min [2025-10-17T21:04:21.352003] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-17T21:04:21.383126] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:04:21.383271] [DEBUG] [LOCAL ] PSA: No existing data file found in primary storage. [2025-10-17T21:04:21.383315] [WARN ] [MAIN ] PSA: No existing data found, performing full refresh instead. [2025-10-17T21:04:21.383441] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-17T21:04:21.383490] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-17T21:04:21.383532] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-17T21:04:21.383563] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-17T21:04:21.729624] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:04:22.142316] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-17T21:04:22.507085] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T21:04:22.540564] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-17T21:04:22.942292] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-17T21:04:23.153768] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-17T21:04:23.742302] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-10-17T21:04:24.542317] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-17T21:04:25.011269] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-17T21:04:25.342288] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-17T21:04:25.373274] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T21:04:25.399283] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T21:04:26.142282] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-17T21:04:26.571231] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-17T21:04:26.942353] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-17T21:04:27.224633] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T21:04:27.235336] [INFO ] [REMOTE ] PRMB: Full fetch complete (76320 records). [2025-10-17T21:04:27.235523] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-17T21:04:27.625341] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-10-17T21:04:27.625438] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-10-17T21:04:27.626583] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-10-17T21:04:27.626671] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-10-17T21:04:27.628220] [DEBUG] [LOCAL ] PRMB: Trimmed 76320 records to 53905 (keeping 200 days of data) [2025-10-17T21:04:27.742505] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-17T21:04:27.961929] [DEBUG] [LOCAL ] PRMB: Primary data saved (53905 records). [2025-10-17T21:04:27.962080] [INFO ] [MAIN ] PRMB: Full history saved. [2025-10-17T21:04:27.962192] [INFO ] [MAIN ] Update Progress: 1730/2368 symbols completed. PRMB took 49.9s. Estimated remaining: 1h 30m 8s. Rate: 7.1 symbols/min [2025-10-17T21:04:28.130192] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:04:28.140537] [DEBUG] [LOCAL ] PSBD: Loaded 8195 existing records from primary storage. [2025-10-17T21:04:28.140759] [INFO ] [MAIN ] PSBD: Loaded 8195 existing records. [2025-10-17T21:04:28.218809] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-17T21:04:28.324210] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:04:28.324452] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-17T21:04:28.324511] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-17T21:04:28.324745] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-10-17T21:04:28.324820] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-17T21:04:28.552688] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-17T21:04:28.727924] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:04:28.730236] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T21:04:28.941506] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-17T21:04:29.342344] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-17T21:04:30.142349] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-10-17T21:04:30.707201] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-17T21:04:30.795356] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-17T21:04:30.942290] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-17T21:04:31.742331] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-17T21:04:31.761901] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T21:04:32.542304] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-17T21:04:33.196906] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-17T21:04:33.342268] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-17T21:04:33.753076] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-17T21:04:33.799876] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T21:04:34.142343] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-17T21:04:34.942311] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-17T21:04:35.742341] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-17T21:04:35.800152] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T21:04:35.824765] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T21:04:36.542289] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-17T21:04:37.122272] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T21:04:37.342261] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-17T21:04:37.695768] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T21:04:37.853021] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T21:04:38.142288] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-17T21:04:38.572523] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-17T21:04:38.942291] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-17T21:04:39.742339] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-17T21:04:40.542272] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-17T21:04:40.749537] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T21:04:41.233832] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T21:04:41.342317] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-17T21:04:41.674880] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T21:04:41.872400] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-17T21:04:42.142288] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-17T21:04:42.942314] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-17T21:04:43.369159] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-17T21:04:43.370313] [INFO ] [REMOTE ] PRVS: Full fetch complete (1241 records). [2025-10-17T21:04:43.370438] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-17T21:04:43.604217] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-17T21:04:43.604715] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T21:04:43.604830] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T21:04:43.604906] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-17T21:04:43.604981] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-17T21:04:43.605021] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-17T21:04:43.605063] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-17T21:04:43.605176] [INFO ] [MAIN ] Update Progress: 1731/2368 symbols completed. PRVS took 29.2s. Estimated remaining: 1h 30m 2s. Rate: 7.1 symbols/min [2025-10-17T21:04:43.744117] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-17T21:04:43.842167] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:04:43.856121] [DEBUG] [LOCAL ] PSF: Loaded 7022 existing records from primary storage. [2025-10-17T21:04:43.856429] [INFO ] [MAIN ] PSF: Loaded 7022 existing records. [2025-10-17T21:04:44.178241] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-17T21:04:44.206839] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:04:44.223897] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-17T21:04:44.224435] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-17T21:04:44.224629] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-10-17T21:04:44.224730] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-17T21:04:44.547424] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-17T21:04:44.625307] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:04:45.342275] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-10-17T21:04:45.676694] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T21:04:46.142323] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-17T21:04:46.247568] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T21:04:46.640537] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-17T21:04:46.933164] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T21:04:46.942257] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-17T21:04:47.742299] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-17T21:04:48.542339] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-17T21:04:48.755466] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T21:04:49.223525] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T21:04:49.274286] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T21:04:49.342284] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-17T21:04:50.142307] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-17T21:04:50.942277] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-17T21:04:51.084703] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T21:04:51.636289] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-17T21:04:51.742254] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-17T21:04:51.924244] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T21:04:52.197816] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-17T21:04:52.542300] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-17T21:04:53.342295] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-17T21:04:54.142298] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-17T21:04:54.244735] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T21:04:54.251584] [INFO ] [REMOTE ] PRU: Full fetch complete (74510 records). [2025-10-17T21:04:54.251728] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-17T21:04:54.649308] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-10-17T21:04:54.649506] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-10-17T21:04:54.650702] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-10-17T21:04:54.650835] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-10-17T21:04:54.652445] [DEBUG] [LOCAL ] PRU: Trimmed 74510 records to 52007 (keeping 200 days of data) [2025-10-17T21:04:54.776990] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T21:04:54.776222] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-17T21:04:54.944110] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-17T21:04:55.021553] [DEBUG] [LOCAL ] PRU: Primary data saved (52007 records). [2025-10-17T21:04:55.021719] [INFO ] [MAIN ] PRU: Full history saved. [2025-10-17T21:04:55.021805] [INFO ] [MAIN ] Update Progress: 1732/2368 symbols completed. PRU took 41.8s. Estimated remaining: 1h 29m 55s. Rate: 7.1 symbols/min [2025-10-17T21:04:55.196404] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:04:55.196608] [DEBUG] [LOCAL ] PSFE: No existing data file found in primary storage. [2025-10-17T21:04:55.196688] [WARN ] [MAIN ] PSFE: No existing data found, performing full refresh instead. [2025-10-17T21:04:55.196859] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-17T21:04:55.196915] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-17T21:04:55.196961] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-17T21:04:55.196995] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-17T21:04:55.548703] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:04:55.742267] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-10-17T21:04:56.542374] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-17T21:04:56.935052] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T21:04:57.096452] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T21:04:57.342304] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-17T21:04:57.519699] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-17T21:04:58.142319] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-17T21:04:58.648478] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-17T21:04:58.942300] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-17T21:04:59.673680] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T21:04:59.679440] [INFO ] [REMOTE ] PSA: Full fetch complete (59597 records). [2025-10-17T21:04:59.679543] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-17T21:04:59.747521] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-17T21:04:59.868575] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T21:05:00.072856] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-10-17T21:05:00.072946] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-10-17T21:05:00.073974] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-10-17T21:05:00.074037] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-10-17T21:05:00.075267] [DEBUG] [LOCAL ] PSA: Trimmed 59597 records to 42766 (keeping 200 days of data) [2025-10-17T21:05:00.341373] [DEBUG] [LOCAL ] PSA: Primary data saved (42766 records). [2025-10-17T21:05:00.341500] [INFO ] [MAIN ] PSA: Full history saved. [2025-10-17T21:05:00.341573] [INFO ] [MAIN ] Update Progress: 1733/2368 symbols completed. PSA took 39.1s. Estimated remaining: 1h 29m 45s. Rate: 7.1 symbols/min [2025-10-17T21:05:00.511080] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:05:00.511299] [DEBUG] [LOCAL ] PSN: No existing data file found in primary storage. [2025-10-17T21:05:00.511353] [WARN ] [MAIN ] PSN: No existing data found, performing full refresh instead. [2025-10-17T21:05:00.511466] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-17T21:05:00.511507] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-17T21:05:00.511553] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-17T21:05:00.511585] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-17T21:05:00.547434] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-17T21:05:00.855534] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:05:01.306934] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T21:05:01.342241] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-17T21:05:01.435960] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T21:05:02.142285] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-17T21:05:02.812572] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-17T21:05:02.885704] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T21:05:02.942276] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-17T21:05:03.720962] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T21:05:03.742256] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-17T21:05:04.542313] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-17T21:05:04.595957] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T21:05:05.342295] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-10-17T21:05:05.923131] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T21:05:06.142294] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-17T21:05:06.942278] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-17T21:05:07.012515] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T21:05:07.501749] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T21:05:07.742323] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-17T21:05:07.783254] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T21:05:08.542358] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-17T21:05:09.247112] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T21:05:09.248738] [INFO ] [REMOTE ] PSF: Full fetch complete (9755 records). [2025-10-17T21:05:09.248812] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-17T21:05:09.343279] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-17T21:05:09.651785] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-17T21:05:09.651945] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-17T21:05:09.653694] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-17T21:05:09.652827] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-17T21:05:09.662685] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-17T21:05:09.663796] [DEBUG] [LOCAL ] PSF: Trimmed 9755 records to 7069 (keeping 200 days of data) [2025-10-17T21:05:09.706770] [DEBUG] [LOCAL ] PSF: Primary data saved (7069 records). [2025-10-17T21:05:09.706891] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-17T21:05:09.706993] [INFO ] [MAIN ] Update Progress: 1734/2368 symbols completed. PSF took 26.1s. Estimated remaining: 1h 29m 37s. Rate: 7.1 symbols/min [2025-10-17T21:05:09.881667] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:05:09.881829] [DEBUG] [LOCAL ] PSO: No existing data file found in primary storage. [2025-10-17T21:05:09.881867] [WARN ] [MAIN ] PSO: No existing data found, performing full refresh instead. [2025-10-17T21:05:09.881979] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-17T21:05:09.882020] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-17T21:05:09.882065] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-17T21:05:09.882097] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-17T21:05:10.143886] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-17T21:05:10.246919] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:05:10.365223] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T21:05:10.368294] [INFO ] [REMOTE ] PSBD: Full fetch complete (10757 records). [2025-10-17T21:05:10.368366] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-17T21:05:10.728201] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-10-17T21:05:10.728282] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-10-17T21:05:10.728586] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-10-17T21:05:10.728630] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-10-17T21:05:10.729141] [DEBUG] [LOCAL ] PSBD: Trimmed 10757 records to 8292 (keeping 200 days of data) [2025-10-17T21:05:10.783250] [DEBUG] [LOCAL ] PSBD: Primary data saved (8292 records). [2025-10-17T21:05:10.783408] [INFO ] [MAIN ] PSBD: Full history saved. [2025-10-17T21:05:10.783493] [INFO ] [MAIN ] Update Progress: 1735/2368 symbols completed. PSBD took 42.8s. Estimated remaining: 1h 29m 26s. Rate: 7.1 symbols/min [2025-10-17T21:05:10.948488] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:05:10.948592] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-10-17T21:05:10.986434] [DEBUG] [LOCAL ] PSQH: Loaded 35783 existing records from primary storage. [2025-10-17T21:05:10.986755] [INFO ] [MAIN ] PSQH: Loaded 35783 existing records. [2025-10-17T21:05:11.162503] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:05:11.162772] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-17T21:05:11.162833] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-17T21:05:11.163069] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-10-17T21:05:11.163125] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-17T21:05:11.518954] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:05:11.742265] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-10-17T21:05:11.877985] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T21:05:12.200165] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T21:05:12.542305] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-17T21:05:13.342287] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-17T21:05:13.692343] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-17T21:05:13.703684] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T21:05:14.142316] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-17T21:05:14.552329] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T21:05:14.942312] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-17T21:05:15.742298] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-17T21:05:16.043199] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T21:05:16.407682] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T21:05:16.542285] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-17T21:05:17.342290] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-17T21:05:17.751181] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-17T21:05:18.012628] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T21:05:18.142279] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-17T21:05:18.942282] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-10-17T21:05:18.980262] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T21:05:19.520203] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T21:05:19.742343] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-17T21:05:20.188762] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-17T21:05:20.542359] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-10. [2025-10-17T21:05:21.342283] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-17T21:05:21.505401] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T21:05:21.999597] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T21:05:22.003719] [INFO ] [REMOTE ] PSFE: Full fetch complete (43150 records). [2025-10-17T21:05:22.003810] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-10-17T21:05:22.147479] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-17T21:05:22.387144] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-10-17T21:05:22.387227] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-10-17T21:05:22.388194] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-10-17T21:05:22.388258] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-10-17T21:05:22.389292] [DEBUG] [LOCAL ] PSFE: Trimmed 43150 records to 30299 (keeping 200 days of data) [2025-10-17T21:05:22.566530] [DEBUG] [LOCAL ] PSFE: Primary data saved (30299 records). [2025-10-17T21:05:22.566751] [INFO ] [MAIN ] PSFE: Full history saved. [2025-10-17T21:05:22.566857] [INFO ] [MAIN ] Update Progress: 1736/2368 symbols completed. PSFE took 27.5s. Estimated remaining: 1h 29m 18s. Rate: 7.1 symbols/min [2025-10-17T21:05:22.737881] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:05:22.738063] [DEBUG] [LOCAL ] PSTG: No existing data file found in primary storage. [2025-10-17T21:05:22.738107] [WARN ] [MAIN ] PSTG: No existing data found, performing full refresh instead. [2025-10-17T21:05:22.738224] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-17T21:05:22.738266] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-17T21:05:22.738308] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-17T21:05:22.738341] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-17T21:05:22.967579] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-17T21:05:23.122997] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:05:23.154582] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T21:05:23.347496] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T21:05:23.742293] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-10-17T21:05:24.466587] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T21:05:24.542304] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-17T21:05:25.342330] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-17T21:05:25.452202] [DEBUG] [REMOTE ] PSO: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-17T21:05:25.452897] [WARN ] [REMOTE ] PSO: No data returned for month 2025-05 [2025-10-17T21:05:25.453003] [FATAL] [REMOTE ] PSO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:05:25.453099] [FATAL] [MAIN ] PSO: Failed to fetch primary data. [2025-10-17T21:05:25.453165] [WARN ] [MAIN ] PSO: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:05:25.453240] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-17T21:05:25.453312] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-17T21:05:25.453349] [INFO ] [LOCAL ] PSO: Starting deletion of derivative data. [2025-10-17T21:05:25.453389] [DEBUG] [LOCAL ] PSO: No derivative data file found to delete. [2025-10-17T21:05:25.453441] [INFO ] [MAIN ] Update Progress: 1737/2368 symbols completed. PSO took 15.7s. Estimated remaining: 1h 29m 8s. Rate: 7.1 symbols/min [2025-10-17T21:05:25.624961] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:05:25.625223] [DEBUG] [LOCAL ] PSTL: No existing data file found in primary storage. [2025-10-17T21:05:25.625295] [WARN ] [MAIN ] PSTL: No existing data found, performing full refresh instead. [2025-10-17T21:05:25.625560] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-17T21:05:25.625709] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-17T21:05:25.625828] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-17T21:05:25.625934] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-17T21:05:26.016156] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:05:26.048551] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-17T21:05:26.142259] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-10-17T21:05:26.174343] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T21:05:26.942377] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-17T21:05:27.290782] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T21:05:27.742295] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-17T21:05:28.542275] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-17T21:05:28.581478] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T21:05:29.342294] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-17T21:05:29.678110] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-17T21:05:30.005410] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T21:05:30.142296] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-17T21:05:30.942315] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-17T21:05:31.287427] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T21:05:31.742263] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-17T21:05:31.768773] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T21:05:32.105765] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T21:05:32.542288] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-17T21:05:33.114864] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T21:05:33.342296] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-17T21:05:33.664712] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T21:05:34.142297] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-17T21:05:34.663756] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-17T21:05:34.942319] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-17T21:05:35.301855] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T21:05:35.742291] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-17T21:05:36.542344] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-17T21:05:36.772707] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T21:05:36.979779] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-17T21:05:37.342350] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-17T21:05:38.142448] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-17T21:05:38.242856] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T21:05:38.942277] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-17T21:05:39.336569] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T21:05:39.747358] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-17T21:05:39.759693] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T21:05:40.464369] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-17T21:05:40.470484] [INFO ] [REMOTE ] PSN: Full fetch complete (67029 records). [2025-10-17T21:05:40.470639] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-17T21:05:40.547426] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-17T21:05:40.874382] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-10-17T21:05:40.874461] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-10-17T21:05:40.875509] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-10-17T21:05:40.875573] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-10-17T21:05:40.876859] [DEBUG] [LOCAL ] PSN: Trimmed 67029 records to 46125 (keeping 200 days of data) [2025-10-17T21:05:41.142985] [DEBUG] [LOCAL ] PSN: Primary data saved (46125 records). [2025-10-17T21:05:41.143112] [INFO ] [MAIN ] PSN: Full history saved. [2025-10-17T21:05:41.143184] [INFO ] [MAIN ] Update Progress: 1738/2368 symbols completed. PSN took 40.8s. Estimated remaining: 1h 29m 2s. Rate: 7.1 symbols/min [2025-10-17T21:05:41.311571] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:05:41.311767] [DEBUG] [LOCAL ] PSX: No existing data file found in primary storage. [2025-10-17T21:05:41.311811] [WARN ] [MAIN ] PSX: No existing data found, performing full refresh instead. [2025-10-17T21:05:41.311931] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-17T21:05:41.311971] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-17T21:05:41.312012] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-17T21:05:41.312043] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-17T21:05:41.347352] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-17T21:05:41.669062] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:05:41.703366] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T21:05:41.899432] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T21:05:42.142295] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-17T21:05:42.741044] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T21:05:42.942309] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-17T21:05:43.742402] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-17T21:05:44.076965] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T21:05:44.542281] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-10-17T21:05:44.824460] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T21:05:44.861344] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T21:05:45.342349] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-17T21:05:46.142342] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-17T21:05:46.402391] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-17T21:05:46.942267] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-17T21:05:47.103478] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T21:05:47.180243] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T21:05:47.742288] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-17T21:05:48.542282] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-17T21:05:48.819562] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-17T21:05:48.825734] [INFO ] [REMOTE ] PSQH: Full fetch complete (53439 records). [2025-10-17T21:05:48.825864] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-17T21:05:49.242541] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-10-17T21:05:49.242639] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-10-17T21:05:49.243778] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-10-17T21:05:49.243845] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-10-17T21:05:49.245237] [DEBUG] [LOCAL ] PSQH: Trimmed 53439 records to 36091 (keeping 200 days of data) [2025-10-17T21:05:49.343165] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-17T21:05:49.460914] [DEBUG] [LOCAL ] PSQH: Primary data saved (36091 records). [2025-10-17T21:05:49.461055] [INFO ] [MAIN ] PSQH: Full history saved. [2025-10-17T21:05:49.461136] [INFO ] [MAIN ] Update Progress: 1739/2368 symbols completed. PSQH took 38.7s. Estimated remaining: 1h 28m 53s. Rate: 7.1 symbols/min [2025-10-17T21:05:49.633051] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:05:49.633559] [DEBUG] [LOCAL ] PTA: No existing data file found in primary storage. [2025-10-17T21:05:49.633714] [WARN ] [MAIN ] PTA: No existing data found, performing full refresh instead. [2025-10-17T21:05:49.634677] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-17T21:05:49.634796] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-17T21:05:49.634898] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-17T21:05:49.634974] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-17T21:05:49.852905] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T21:05:50.039935] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:05:50.068725] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-17T21:05:50.142252] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-17T21:05:50.942270] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-17T21:05:51.320063] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-17T21:05:51.742276] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-17T21:05:52.008108] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T21:05:52.140904] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-17T21:05:52.542302] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-17T21:05:53.342269] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-10-17T21:05:53.371725] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-17T21:05:53.375235] [INFO ] [REMOTE ] PSTL: Full fetch complete (29543 records). [2025-10-17T21:05:53.375324] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-17T21:05:53.748850] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-10-17T21:05:53.749003] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-10-17T21:05:53.749606] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-10-17T21:05:53.749802] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-10-17T21:05:53.750825] [DEBUG] [LOCAL ] PSTL: Trimmed 29543 records to 20382 (keeping 200 days of data) [2025-10-17T21:05:53.868173] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-17T21:05:53.915546] [DEBUG] [LOCAL ] PSTL: Primary data saved (20382 records). [2025-10-17T21:05:53.915692] [INFO ] [MAIN ] PSTL: Full history saved. [2025-10-17T21:05:53.915775] [INFO ] [MAIN ] Update Progress: 1740/2368 symbols completed. PSTL took 28.5s. Estimated remaining: 1h 28m 44s. Rate: 7.1 symbols/min [2025-10-17T21:05:54.083391] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:05:54.083577] [DEBUG] [LOCAL ] PTY: No existing data file found in primary storage. [2025-10-17T21:05:54.083615] [WARN ] [MAIN ] PTY: No existing data found, performing full refresh instead. [2025-10-17T21:05:54.083750] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-17T21:05:54.083793] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-17T21:05:54.083884] [DEBUG] [LOCAL ] PTY: No primary data file found to delete. [2025-10-17T21:05:54.083927] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-17T21:05:54.147475] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-17T21:05:54.440946] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:05:54.488263] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T21:05:54.942286] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-10-17T21:05:55.742355] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-17T21:05:56.113831] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T21:05:56.316356] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T21:05:56.409615] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-17T21:05:56.542303] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-17T21:05:57.342310] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-17T21:05:57.459092] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-17T21:05:58.142289] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-17T21:05:58.905159] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T21:05:58.942249] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-17T21:05:59.203091] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T21:05:59.742298] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-17T21:06:00.542298] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-17T21:06:00.989938] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-17T21:06:01.247435] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-17T21:06:01.342290] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-17T21:06:02.142262] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-17T21:06:02.397540] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T21:06:02.803954] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-17T21:06:02.942284] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-17T21:06:03.742286] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-17T21:06:04.207153] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-17T21:06:04.542266] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-17T21:06:04.753294] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T21:06:04.931533] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-17T21:06:04.938803] [INFO ] [REMOTE ] PSTG: Full fetch complete (76701 records). [2025-10-17T21:06:04.938917] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-17T21:06:05.323222] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-10-17T21:06:05.323299] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-10-17T21:06:05.324452] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-10-17T21:06:05.324517] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-10-17T21:06:05.325956] [DEBUG] [LOCAL ] PSTG: Trimmed 76701 records to 53630 (keeping 200 days of data) [2025-10-17T21:06:05.374170] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-17T21:06:05.638916] [DEBUG] [LOCAL ] PSTG: Primary data saved (53630 records). [2025-10-17T21:06:05.639044] [INFO ] [MAIN ] PSTG: Full history saved. [2025-10-17T21:06:05.639115] [INFO ] [MAIN ] Update Progress: 1741/2368 symbols completed. PSTG took 43.1s. Estimated remaining: 1h 28m 36s. Rate: 7.1 symbols/min [2025-10-17T21:06:05.803597] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:06:05.803767] [DEBUG] [LOCAL ] PUK: No existing data file found in primary storage. [2025-10-17T21:06:05.803810] [WARN ] [MAIN ] PUK: No existing data found, performing full refresh instead. [2025-10-17T21:06:05.803921] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-17T21:06:05.803962] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-17T21:06:05.804004] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-17T21:06:05.804036] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-17T21:06:06.147285] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-17T21:06:06.170758] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:06:06.182285] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T21:06:06.227314] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T21:06:06.942308] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-17T21:06:07.603952] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T21:06:07.742295] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-17T21:06:08.542279] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-17T21:06:08.841379] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T21:06:09.018358] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-17T21:06:09.342321] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-17T21:06:10.113844] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T21:06:10.142243] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-17T21:06:10.942396] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-17T21:06:11.007245] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T21:06:11.475101] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-17T21:06:11.569678] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-17T21:06:11.742303] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-10-17T21:06:12.542358] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-17T21:06:13.342269] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-17T21:06:13.475144] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T21:06:13.504356] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T21:06:13.507411] [INFO ] [REMOTE ] PTA: Full fetch complete (22597 records). [2025-10-17T21:06:13.507484] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-17T21:06:13.866344] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-10-17T21:06:13.866452] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-10-17T21:06:13.867011] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-10-17T21:06:13.867121] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-10-17T21:06:13.867861] [DEBUG] [LOCAL ] PTA: Trimmed 22597 records to 15411 (keeping 200 days of data) [2025-10-17T21:06:13.964493] [DEBUG] [LOCAL ] PTA: Primary data saved (15411 records). [2025-10-17T21:06:13.964639] [INFO ] [MAIN ] PTA: Full history saved. [2025-10-17T21:06:13.964753] [INFO ] [MAIN ] Update Progress: 1742/2368 symbols completed. PTA took 24.5s. Estimated remaining: 1h 28m 28s. Rate: 7.1 symbols/min [2025-10-17T21:06:14.131258] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:06:14.131419] [DEBUG] [LOCAL ] PUMP: No existing data file found in primary storage. [2025-10-17T21:06:14.131455] [WARN ] [MAIN ] PUMP: No existing data found, performing full refresh instead. [2025-10-17T21:06:14.131567] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-17T21:06:14.131608] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-17T21:06:14.131677] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-17T21:06:14.131730] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-17T21:06:14.151370] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-17T21:06:14.484948] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:06:14.876882] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T21:06:14.942310] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-17T21:06:15.742332] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-10-17T21:06:16.044867] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-17T21:06:16.537560] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T21:06:16.544929] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-17T21:06:17.149257] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T21:06:17.342334] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-17T21:06:18.142326] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-17T21:06:18.522997] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T21:06:18.942269] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-17T21:06:19.071235] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-17T21:06:19.739890] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T21:06:19.747098] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-17T21:06:20.542303] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-17T21:06:20.783693] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T21:06:20.791113] [INFO ] [REMOTE ] PSX: Full fetch complete (77151 records). [2025-10-17T21:06:20.791252] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-17T21:06:21.178579] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-10-17T21:06:21.178702] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-10-17T21:06:21.179906] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-10-17T21:06:21.179982] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-10-17T21:06:21.181547] [DEBUG] [LOCAL ] PSX: Trimmed 77151 records to 53890 (keeping 200 days of data) [2025-10-17T21:06:21.368121] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-17T21:06:21.524990] [DEBUG] [LOCAL ] PSX: Primary data saved (53890 records). [2025-10-17T21:06:21.525130] [INFO ] [MAIN ] PSX: Full history saved. [2025-10-17T21:06:21.525204] [INFO ] [MAIN ] Update Progress: 1743/2368 symbols completed. PSX took 40.4s. Estimated remaining: 1h 28m 19s. Rate: 7.1 symbols/min [2025-10-17T21:06:21.690779] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:06:21.690969] [DEBUG] [LOCAL ] PVH: No existing data file found in primary storage. [2025-10-17T21:06:21.691014] [WARN ] [MAIN ] PVH: No existing data found, performing full refresh instead. [2025-10-17T21:06:21.691161] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-17T21:06:21.691204] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-17T21:06:21.691247] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-17T21:06:21.691283] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-17T21:06:22.048802] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:06:22.084676] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T21:06:22.142270] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-10-17T21:06:22.592481] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (2.85 seconds). [2025-10-17T21:06:22.893190] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T21:06:22.942263] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-17T21:06:23.672005] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T21:06:23.742304] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-17T21:06:24.543027] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T21:06:24.543128] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-17T21:06:25.342334] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-17T21:06:25.478169] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T21:06:26.142250] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-17T21:06:26.225390] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T21:06:26.244086] [DEBUG] [REMOTE ] PUMP: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-17T21:06:26.244366] [WARN ] [REMOTE ] PUMP: No data returned for month 2025-04 [2025-10-17T21:06:26.244474] [FATAL] [REMOTE ] PUMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:06:26.244579] [FATAL] [MAIN ] PUMP: Failed to fetch primary data. [2025-10-17T21:06:26.244690] [WARN ] [MAIN ] PUMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:06:26.244787] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-17T21:06:26.244869] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-17T21:06:26.244909] [INFO ] [LOCAL ] PUMP: Starting deletion of derivative data. [2025-10-17T21:06:26.244953] [DEBUG] [LOCAL ] PUMP: No derivative data file found to delete. [2025-10-17T21:06:26.245000] [INFO ] [MAIN ] Update Progress: 1744/2368 symbols completed. PUMP took 12.3s. Estimated remaining: 1h 28m 9s. Rate: 7.1 symbols/min [2025-10-17T21:06:26.415810] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:06:26.433531] [DEBUG] [LOCAL ] PVL: Loaded 4738 existing records from primary storage. [2025-10-17T21:06:26.433768] [INFO ] [MAIN ] PVL: Loaded 4738 existing records. [2025-10-17T21:06:26.608742] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:06:26.609078] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-17T21:06:26.609224] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-17T21:06:26.609516] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-10-17T21:06:26.609580] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-17T21:06:26.942262] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-17T21:06:26.942193] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-17T21:06:27.035469] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:06:27.035575] [INFO ] [REMOTE ] PTY: Full fetch complete (54270 records). [2025-10-17T21:06:27.035891] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-17T21:06:27.408885] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-10-17T21:06:27.408968] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-10-17T21:06:27.409913] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-10-17T21:06:27.409976] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-10-17T21:06:27.411028] [DEBUG] [LOCAL ] PTY: Trimmed 54270 records to 38349 (keeping 200 days of data) [2025-10-17T21:06:27.639805] [DEBUG] [LOCAL ] PTY: Primary data saved (38349 records). [2025-10-17T21:06:27.639933] [INFO ] [MAIN ] PTY: Full history saved. [2025-10-17T21:06:27.640005] [INFO ] [MAIN ] Update Progress: 1745/2368 symbols completed. PTY took 33.7s. Estimated remaining: 1h 27m 58s. Rate: 7.1 symbols/min [2025-10-17T21:06:27.744101] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-17T21:06:27.813623] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:06:27.813809] [DEBUG] [LOCAL ] PWR: No existing data file found in primary storage. [2025-10-17T21:06:27.813850] [WARN ] [MAIN ] PWR: No existing data found, performing full refresh instead. [2025-10-17T21:06:27.813957] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-17T21:06:27.813998] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-17T21:06:27.814038] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-17T21:06:27.814068] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-17T21:06:28.173140] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:06:28.542283] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-10-17T21:06:28.728045] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T21:06:29.342368] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-17T21:06:29.376467] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-17T21:06:29.648912] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T21:06:30.142365] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-17T21:06:30.942326] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-10-17T21:06:31.151386] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T21:06:31.742356] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-17T21:06:31.943870] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T21:06:32.542340] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-17T21:06:32.636515] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-17T21:06:32.680564] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T21:06:33.342293] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-17T21:06:34.142287] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-17T21:06:34.253146] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T21:06:34.942298] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-17T21:06:35.518458] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-17T21:06:35.742269] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-17T21:06:36.085667] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-17T21:06:36.438177] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-17T21:06:36.542324] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-17T21:06:36.655414] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T21:06:37.342312] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-17T21:06:38.071980] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-17T21:06:38.142293] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-17T21:06:38.263406] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-17T21:06:38.639867] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-17T21:06:38.942285] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-17T21:06:39.649444] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-17T21:06:39.742376] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-17T21:06:40.542292] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-17T21:06:41.342347] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-17T21:06:41.571428] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T21:06:41.953903] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-17T21:06:42.079343] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T21:06:42.142255] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-17T21:06:42.942348] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-17T21:06:43.742298] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-17T21:06:44.095505] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T21:06:44.542313] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-17T21:06:44.861347] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-17T21:06:45.025512] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-17T21:06:45.210462] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T21:06:45.342360] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-17T21:06:46.142276] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-17T21:06:46.904518] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-17T21:06:46.942308] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-17T21:06:47.293455] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T21:06:47.744012] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-17T21:06:47.746627] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-17T21:06:48.542303] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-17T21:06:49.342354] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-17T21:06:49.663994] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T21:06:49.943943] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T21:06:49.945323] [INFO ] [REMOTE ] PVL: Full fetch complete (7090 records). [2025-10-17T21:06:49.945396] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-17T21:06:50.144330] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-17T21:06:50.342407] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-10-17T21:06:50.342529] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-10-17T21:06:50.342814] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-10-17T21:06:50.342917] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-10-17T21:06:50.343580] [DEBUG] [LOCAL ] PVL: Trimmed 7090 records to 4769 (keeping 200 days of data) [2025-10-17T21:06:50.395481] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T21:06:50.410864] [DEBUG] [LOCAL ] PVL: Primary data saved (4769 records). [2025-10-17T21:06:50.410971] [INFO ] [MAIN ] PVL: Full history saved. [2025-10-17T21:06:50.411072] [INFO ] [MAIN ] Update Progress: 1746/2368 symbols completed. PVL took 24.2s. Estimated remaining: 1h 27m 55s. Rate: 7.1 symbols/min [2025-10-17T21:06:50.575399] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:06:50.575576] [DEBUG] [LOCAL ] PX: No existing data file found in primary storage. [2025-10-17T21:06:50.575614] [WARN ] [MAIN ] PX: No existing data found, performing full refresh instead. [2025-10-17T21:06:50.575746] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-17T21:06:50.575788] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-17T21:06:50.575832] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-17T21:06:50.575878] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-17T21:06:50.923577] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:06:50.942246] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-10-17T21:06:51.742341] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-17T21:06:52.040102] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T21:06:52.414218] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T21:06:52.542326] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-17T21:06:53.342268] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-17T21:06:53.479982] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T21:06:54.142268] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-17T21:06:54.220544] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T21:06:54.841359] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T21:06:54.942296] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-17T21:06:55.524866] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T21:06:55.742325] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-17T21:06:56.542303] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-17T21:06:56.659436] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T21:06:56.928566] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-17T21:06:56.934877] [INFO ] [REMOTE ] PVH: Full fetch complete (71049 records). [2025-10-17T21:06:56.935025] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-17T21:06:57.324532] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-10-17T21:06:57.324610] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-10-17T21:06:57.325711] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-10-17T21:06:57.325773] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-10-17T21:06:57.327082] [DEBUG] [LOCAL ] PVH: Trimmed 71049 records to 50636 (keeping 200 days of data) [2025-10-17T21:06:57.380913] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-17T21:06:57.636896] [DEBUG] [LOCAL ] PVH: Primary data saved (50636 records). [2025-10-17T21:06:57.637027] [INFO ] [MAIN ] PVH: Full history saved. [2025-10-17T21:06:57.637097] [INFO ] [MAIN ] Update Progress: 1747/2368 symbols completed. PVH took 36.1s. Estimated remaining: 1h 27m 46s. Rate: 7.1 symbols/min [2025-10-17T21:06:57.807283] [INFO ] [MAIN ] PXED: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:06:57.807485] [DEBUG] [LOCAL ] PXED: No existing data file found in primary storage. [2025-10-17T21:06:57.807533] [WARN ] [MAIN ] PXED: No existing data found, performing full refresh instead. [2025-10-17T21:06:57.807701] [INFO ] [MAIN ] PXED: Wiping existing primary data before full refresh. [2025-10-17T21:06:57.807773] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-17T21:06:57.807840] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-17T21:06:57.807886] [INFO ] [MAIN ] PXED: Starting full primary refresh. [2025-10-17T21:06:58.159932] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-17T21:06:58.164841] [INFO ] [REMOTE ] PXED: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:06:58.206852] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T21:06:58.942287] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-17T21:06:59.243440] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T21:06:59.742319] [INFO ] [REMOTE ] PXED: Fetching primary data for 2024-12. [2025-10-17T21:06:59.840200] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T21:06:59.846438] [INFO ] [REMOTE ] PUK: Full fetch complete (65360 records). [2025-10-17T21:06:59.846542] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-17T21:07:00.028266] [DEBUG] [REMOTE ] PXED: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:07:00.075026] [WARN ] [REMOTE ] PXED: No data returned for month 2024-12 [2025-10-17T21:07:00.075246] [FATAL] [REMOTE ] PXED: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:07:00.099726] [FATAL] [MAIN ] PXED: Failed to fetch primary data. [2025-10-17T21:07:00.119849] [WARN ] [MAIN ] PXED: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:07:00.125125] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-17T21:07:00.153141] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-17T21:07:00.165601] [INFO ] [LOCAL ] PXED: Starting deletion of derivative data. [2025-10-17T21:07:00.166198] [DEBUG] [LOCAL ] PXED: No derivative data file found to delete. [2025-10-17T21:07:00.178054] [INFO ] [MAIN ] Update Progress: 1748/2368 symbols completed. PXED took 2.5s. Estimated remaining: 1h 27m 35s. Rate: 7.1 symbols/min [2025-10-17T21:07:00.172719] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-17T21:07:00.373803] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-10-17T21:07:00.381613] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-10-17T21:07:00.385199] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-10-17T21:07:00.385294] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-10-17T21:07:00.437718] [DEBUG] [LOCAL ] PUK: Trimmed 65360 records to 45178 (keeping 200 days of data) [2025-10-17T21:07:00.455353] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:07:00.455906] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-17T21:07:00.456147] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-17T21:07:00.456304] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-17T21:07:00.456349] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-17T21:07:00.456393] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-17T21:07:00.456427] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-17T21:07:00.547526] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-17T21:07:00.907699] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:07:01.077138] [DEBUG] [LOCAL ] PUK: Primary data saved (45178 records). [2025-10-17T21:07:01.077261] [INFO ] [MAIN ] PUK: Full history saved. [2025-10-17T21:07:01.077333] [INFO ] [MAIN ] Update Progress: 1749/2368 symbols completed. PUK took 55.4s. Estimated remaining: 1h 27m 24s. Rate: 7.1 symbols/min [2025-10-17T21:07:01.255473] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:07:01.287570] [DEBUG] [LOCAL ] QD: Loaded 27656 existing records from primary storage. [2025-10-17T21:07:01.287948] [INFO ] [MAIN ] QD: Loaded 27656 existing records. [2025-10-17T21:07:01.350680] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-17T21:07:01.466413] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:07:01.466680] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-17T21:07:01.466739] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-17T21:07:01.466952] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-10-17T21:07:01.467008] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-17T21:07:01.816947] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:07:02.142355] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-10-17T21:07:02.353155] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T21:07:02.942318] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-17T21:07:03.162457] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T21:07:03.742311] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-17T21:07:04.448583] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T21:07:04.542358] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-10-17T21:07:05.010274] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.87 seconds). [2025-10-17T21:07:05.342272] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-17T21:07:05.661433] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T21:07:05.667964] [INFO ] [REMOTE ] PWR: Full fetch complete (69155 records). [2025-10-17T21:07:05.668088] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-17T21:07:06.041338] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T21:07:06.097389] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-10-17T21:07:06.097497] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-10-17T21:07:06.099124] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-10-17T21:07:06.099196] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-10-17T21:07:06.100791] [DEBUG] [LOCAL ] PWR: Trimmed 69155 records to 47297 (keeping 200 days of data) [2025-10-17T21:07:06.156343] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-17T21:07:06.405394] [DEBUG] [LOCAL ] PWR: Primary data saved (47297 records). [2025-10-17T21:07:06.405543] [INFO ] [MAIN ] PWR: Full history saved. [2025-10-17T21:07:06.405636] [INFO ] [MAIN ] Update Progress: 1750/2368 symbols completed. PWR took 38.8s. Estimated remaining: 1h 27m 14s. Rate: 7.1 symbols/min [2025-10-17T21:07:06.576172] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:07:06.576339] [DEBUG] [LOCAL ] QGEN: No existing data file found in primary storage. [2025-10-17T21:07:06.576376] [WARN ] [MAIN ] QGEN: No existing data found, performing full refresh instead. [2025-10-17T21:07:06.576488] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-17T21:07:06.576528] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-17T21:07:06.576569] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-17T21:07:06.576601] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-17T21:07:06.922211] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:07:06.942265] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-10-17T21:07:07.742342] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-17T21:07:07.878996] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T21:07:08.031113] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-10-17T21:07:08.201360] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T21:07:08.542262] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-17T21:07:08.937403] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-17T21:07:09.342326] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-17T21:07:10.142318] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-17T21:07:10.255085] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T21:07:10.942384] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-17T21:07:11.139296] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T21:07:11.547211] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-17T21:07:11.742330] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-17T21:07:12.542329] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-17T21:07:12.698819] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T21:07:13.201106] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T21:07:13.342286] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-17T21:07:14.142413] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-17T21:07:14.702543] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-17T21:07:14.942265] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-17T21:07:15.229076] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-17T21:07:15.742303] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-17T21:07:15.966388] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T21:07:16.336198] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T21:07:16.542302] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-17T21:07:17.342307] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-17T21:07:17.454578] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T21:07:18.142317] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-17T21:07:18.374540] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-17T21:07:18.695027] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-17T21:07:18.942402] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-17T21:07:19.653267] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T21:07:19.742282] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-17T21:07:20.542365] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-17T21:07:20.894228] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T21:07:21.342310] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-17T21:07:21.769380] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-10-17T21:07:22.142275] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-17T21:07:22.507303] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T21:07:22.550600] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T21:07:22.942391] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-17T21:07:23.742369] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-17T21:07:24.165167] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T21:07:24.169625] [INFO ] [REMOTE ] PX: Full fetch complete (50147 records). [2025-10-17T21:07:24.169962] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-17T21:07:24.547719] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-17T21:07:24.565911] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-10-17T21:07:24.566055] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-10-17T21:07:24.567168] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-10-17T21:07:24.567337] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-10-17T21:07:24.568625] [DEBUG] [LOCAL ] PX: Trimmed 50147 records to 34837 (keeping 200 days of data) [2025-10-17T21:07:24.783722] [DEBUG] [LOCAL ] PX: Primary data saved (34837 records). [2025-10-17T21:07:24.783859] [INFO ] [MAIN ] PX: Full history saved. [2025-10-17T21:07:24.783951] [INFO ] [MAIN ] Update Progress: 1751/2368 symbols completed. PX took 34.4s. Estimated remaining: 1h 27m 9s. Rate: 7.1 symbols/min [2025-10-17T21:07:24.957168] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:07:24.957491] [DEBUG] [LOCAL ] QS: No existing data file found in primary storage. [2025-10-17T21:07:24.957797] [WARN ] [MAIN ] QS: No existing data found, performing full refresh instead. [2025-10-17T21:07:24.958518] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-17T21:07:24.958572] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-17T21:07:24.958618] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-17T21:07:24.958696] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-17T21:07:25.113156] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.97 seconds). [2025-10-17T21:07:25.283685] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T21:07:25.356761] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-17T21:07:25.396767] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:07:26.142318] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-10-17T21:07:26.245297] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T21:07:26.866064] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T21:07:26.942310] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-17T21:07:27.742323] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-17T21:07:28.512516] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-17T21:07:28.542255] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-17T21:07:29.077164] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T21:07:29.342278] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-17T21:07:29.915033] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-10-17T21:07:30.142399] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-17T21:07:30.952474] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-17T21:07:30.977568] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-17T21:07:31.057150] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T21:07:31.336844] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-17T21:07:31.341470] [INFO ] [REMOTE ] QD: Full fetch complete (40031 records). [2025-10-17T21:07:31.341594] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-17T21:07:31.708591] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-10-17T21:07:31.708715] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-10-17T21:07:31.709750] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-10-17T21:07:31.709819] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-10-17T21:07:31.710966] [DEBUG] [LOCAL ] QD: Trimmed 40031 records to 27874 (keeping 200 days of data) [2025-10-17T21:07:31.754883] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-17T21:07:31.874198] [DEBUG] [LOCAL ] QD: Primary data saved (27874 records). [2025-10-17T21:07:31.874340] [INFO ] [MAIN ] QD: Full history saved. [2025-10-17T21:07:31.874419] [INFO ] [MAIN ] Update Progress: 1752/2368 symbols completed. QD took 30.8s. Estimated remaining: 1h 27m 1s. Rate: 7.1 symbols/min [2025-10-17T21:07:32.040413] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:07:32.040558] [DEBUG] [LOCAL ] QSR: No existing data file found in primary storage. [2025-10-17T21:07:32.040611] [WARN ] [MAIN ] QSR: No existing data found, performing full refresh instead. [2025-10-17T21:07:32.040745] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-17T21:07:32.040786] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-17T21:07:32.040827] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-17T21:07:32.040859] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-17T21:07:32.384214] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:07:32.542313] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-10-17T21:07:33.342294] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-17T21:07:33.696953] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T21:07:33.885599] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-10-17T21:07:33.935738] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-17T21:07:34.142296] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-17T21:07:34.942323] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-17T21:07:35.705907] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-17T21:07:35.742253] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-17T21:07:35.976346] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T21:07:36.542338] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-17T21:07:36.758998] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T21:07:37.342293] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-17T21:07:37.982879] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-17T21:07:38.142282] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-17T21:07:38.942273] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-17T21:07:38.997694] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T21:07:39.004634] [INFO ] [REMOTE ] QGEN: Full fetch complete (70463 records). [2025-10-17T21:07:39.004783] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-17T21:07:39.401682] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-10-17T21:07:39.401894] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-10-17T21:07:39.403045] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-10-17T21:07:39.403192] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-10-17T21:07:39.420783] [DEBUG] [LOCAL ] QGEN: Trimmed 70463 records to 49853 (keeping 200 days of data) [2025-10-17T21:07:39.435767] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.89 seconds). [2025-10-17T21:07:39.743876] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-17T21:07:39.744014] [DEBUG] [LOCAL ] QGEN: Primary data saved (49853 records). [2025-10-17T21:07:39.745149] [INFO ] [MAIN ] QGEN: Full history saved. [2025-10-17T21:07:39.745248] [INFO ] [MAIN ] Update Progress: 1753/2368 symbols completed. QGEN took 33.3s. Estimated remaining: 1h 26m 52s. Rate: 7.1 symbols/min [2025-10-17T21:07:39.919260] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:07:39.919477] [DEBUG] [LOCAL ] QTWO: No existing data file found in primary storage. [2025-10-17T21:07:39.919528] [WARN ] [MAIN ] QTWO: No existing data found, performing full refresh instead. [2025-10-17T21:07:39.919667] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-17T21:07:39.919725] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-17T21:07:39.919770] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-17T21:07:39.919840] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-17T21:07:40.282662] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:07:40.316054] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-17T21:07:40.346177] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T21:07:40.353735] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-10-17T21:07:40.353910] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-17T21:07:40.354679] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T21:07:40.354765] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-10-17T21:07:40.354834] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-10-17T21:07:40.354906] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-17T21:07:40.354973] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-17T21:07:40.355010] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-17T21:07:40.355049] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-10-17T21:07:40.355107] [INFO ] [MAIN ] Update Progress: 1754/2368 symbols completed. QBTS took 40.2s. Estimated remaining: 1h 26m 41s. Rate: 7.1 symbols/min [2025-10-17T21:07:40.562242] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-17T21:07:40.565401] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:07:40.596357] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T21:07:40.623569] [DEBUG] [LOCAL ] QUAD: Loaded 23460 existing records from primary storage. [2025-10-17T21:07:40.623857] [INFO ] [MAIN ] QUAD: Loaded 23460 existing records. [2025-10-17T21:07:40.794014] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:07:40.794205] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-17T21:07:40.794251] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-17T21:07:40.794487] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-10-17T21:07:40.794543] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-17T21:07:41.135948] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:07:41.342319] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-17T21:07:42.142367] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-10-17T21:07:42.891929] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-17T21:07:42.942252] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-17T21:07:43.268825] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T21:07:43.304854] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-17T21:07:43.742319] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-17T21:07:44.542307] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-10-17T21:07:44.816599] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-17T21:07:45.186037] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-17T21:07:45.342300] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-17T21:07:45.954758] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T21:07:46.142261] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-17T21:07:46.942311] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-17T21:07:47.202592] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T21:07:47.742329] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-17T21:07:48.061280] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T21:07:48.542314] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-17T21:07:49.037964] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-17T21:07:49.292712] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T21:07:49.342251] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-17T21:07:49.949340] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T21:07:50.142352] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-17T21:07:50.942355] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-17T21:07:51.049726] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T21:07:51.341849] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T21:07:51.742351] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-17T21:07:52.542369] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-17T21:07:52.832385] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T21:07:53.032115] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-17T21:07:53.342392] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-17T21:07:54.142292] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-17T21:07:54.942318] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-17T21:07:55.072190] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-17T21:07:55.188732] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T21:07:55.214980] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T21:07:55.742265] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-17T21:07:56.248254] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T21:07:56.542262] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-17T21:07:57.148904] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T21:07:57.342315] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-17T21:07:58.142332] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-17T21:07:58.884906] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T21:07:58.942238] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-17T21:07:59.227225] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-10-17T21:07:59.330906] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-17T21:07:59.742332] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-17T21:08:00.341254] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T21:08:00.542284] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-17T21:08:01.342258] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-17T21:08:01.697000] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T21:08:02.137500] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T21:08:02.144791] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-17T21:08:02.213142] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T21:08:02.942402] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-17T21:08:03.742306] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-17T21:08:04.542326] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-17T21:08:04.715522] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T21:08:04.723485] [INFO ] [REMOTE ] QSR: Full fetch complete (76053 records). [2025-10-17T21:08:04.723719] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-17T21:08:04.923135] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-10 (2.78 seconds). [2025-10-17T21:08:05.014853] [INFO ] [REMOTE ] QS: Full fetch complete (77920 records). [2025-10-17T21:08:05.031201] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-17T21:08:05.265488] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-10-17T21:08:05.288300] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-10-17T21:08:05.299936] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-10-17T21:08:05.310754] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-10-17T21:08:05.406286] [DEBUG] [LOCAL ] QSR: Trimmed 76053 records to 53233 (keeping 200 days of data) [2025-10-17T21:08:05.635084] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T21:08:05.705315] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-10-17T21:08:05.706997] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-10-17T21:08:05.708752] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-10-17T21:08:05.714953] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-10-17T21:08:05.713535] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-17T21:08:05.728032] [DEBUG] [LOCAL ] QS: Trimmed 77920 records to 54539 (keeping 200 days of data) [2025-10-17T21:08:05.966685] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T21:08:06.156246] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-17T21:08:06.285348] [DEBUG] [LOCAL ] QS: Primary data saved (54539 records). [2025-10-17T21:08:06.286438] [INFO ] [MAIN ] QS: Full history saved. [2025-10-17T21:08:06.286969] [INFO ] [MAIN ] Update Progress: 1755/2368 symbols completed. QS took 41.5s. Estimated remaining: 1h 26m 38s. Rate: 7.1 symbols/min [2025-10-17T21:08:06.470791] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:08:06.475185] [DEBUG] [LOCAL ] QVCC: No existing data file found in primary storage. [2025-10-17T21:08:06.475260] [WARN ] [MAIN ] QVCC: No existing data found, performing full refresh instead. [2025-10-17T21:08:06.481940] [DEBUG] [LOCAL ] QSR: Primary data saved (53233 records). [2025-10-17T21:08:06.482249] [INFO ] [MAIN ] QSR: Full history saved. [2025-10-17T21:08:06.482155] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-17T21:08:06.482538] [INFO ] [MAIN ] Update Progress: 1756/2368 symbols completed. QSR took 34.6s. Estimated remaining: 1h 26m 27s. Rate: 7.1 symbols/min [2025-10-17T21:08:06.482419] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-17T21:08:06.488047] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-17T21:08:06.505875] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-17T21:08:06.817480] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:08:06.938916] [DEBUG] [LOCAL ] QVCD: Loaded 4721 existing records from primary storage. [2025-10-17T21:08:06.939176] [INFO ] [MAIN ] QVCD: Loaded 4721 existing records. [2025-10-17T21:08:07.103762] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:08:07.125459] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-10-17T21:08:07.206178] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:08:07.206445] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-17T21:08:07.206502] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-17T21:08:07.206742] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-10-17T21:08:07.206802] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-17T21:08:07.481108] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-17T21:08:07.584007] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:08:07.608928] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T21:08:07.742273] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-10-17T21:08:08.130776] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T21:08:08.427069] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-17T21:08:08.542328] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-17T21:08:09.342342] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-17T21:08:09.996763] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-17T21:08:10.142308] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-17T21:08:10.291283] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T21:08:10.880104] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-17T21:08:10.942325] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-17T21:08:11.591362] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-17T21:08:11.742335] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-17T21:08:12.542301] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-17T21:08:13.095475] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-17T21:08:13.098339] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-17T21:08:13.105874] [INFO ] [REMOTE ] QTWO: Full fetch complete (58124 records). [2025-10-17T21:08:13.105974] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-17T21:08:13.347564] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-17T21:08:13.490041] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-10-17T21:08:13.490124] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-10-17T21:08:13.491161] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-10-17T21:08:13.491225] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-10-17T21:08:13.492401] [DEBUG] [LOCAL ] QTWO: Trimmed 58124 records to 40143 (keeping 200 days of data) [2025-10-17T21:08:13.735774] [DEBUG] [LOCAL ] QTWO: Primary data saved (40143 records). [2025-10-17T21:08:13.735901] [INFO ] [MAIN ] QTWO: Full history saved. [2025-10-17T21:08:13.735972] [INFO ] [MAIN ] Update Progress: 1757/2368 symbols completed. QTWO took 34.0s. Estimated remaining: 1h 26m 18s. Rate: 7.1 symbols/min [2025-10-17T21:08:14.070002] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-17T21:08:14.142362] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-17T21:08:14.822389] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-17T21:08:14.942254] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-17T21:08:15.742279] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-17T21:08:15.867888] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-17T21:08:16.542333] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-17T21:08:16.791090] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T21:08:17.342254] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-17T21:08:17.536827] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T21:08:17.540158] [INFO ] [REMOTE ] QUAD: Full fetch complete (33981 records). [2025-10-17T21:08:17.540263] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-17T21:08:17.907891] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-10-17T21:08:17.907967] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-10-17T21:08:17.908733] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-10-17T21:08:17.908796] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-10-17T21:08:17.909661] [DEBUG] [LOCAL ] QUAD: Trimmed 33981 records to 23589 (keeping 200 days of data) [2025-10-17T21:08:18.041867] [DEBUG] [LOCAL ] QUAD: Primary data saved (23589 records). [2025-10-17T21:08:18.041988] [INFO ] [MAIN ] QUAD: Full history saved. [2025-10-17T21:08:18.042071] [INFO ] [MAIN ] Update Progress: 1758/2368 symbols completed. QUAD took 37.7s. Estimated remaining: 1h 26m 8s. Rate: 7.1 symbols/min [2025-10-17T21:08:18.142308] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-17T21:08:18.168592] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-17T21:08:18.868369] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-17T21:08:18.942394] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-17T21:08:19.583326] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-17T21:08:19.742273] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-17T21:08:20.439278] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-17T21:08:20.542307] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-17T21:08:21.342273] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-17T21:08:21.426542] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-17T21:08:21.845307] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-17T21:08:22.142349] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-17T21:08:22.942301] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-17T21:08:23.009730] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-17T21:08:23.620727] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T21:08:23.622078] [INFO ] [REMOTE ] QVCD: Full fetch complete (6248 records). [2025-10-17T21:08:23.622149] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-17T21:08:23.747400] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-17T21:08:23.986793] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-10-17T21:08:23.986880] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-10-17T21:08:23.987046] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-10-17T21:08:23.987086] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-10-17T21:08:23.987582] [DEBUG] [LOCAL ] QVCD: Trimmed 6248 records to 4732 (keeping 200 days of data) [2025-10-17T21:08:24.017995] [DEBUG] [LOCAL ] QVCD: Primary data saved (4732 records). [2025-10-17T21:08:24.018164] [INFO ] [MAIN ] QVCD: Full history saved. [2025-10-17T21:08:24.018266] [INFO ] [MAIN ] Update Progress: 1759/2368 symbols completed. QVCD took 17.5s. Estimated remaining: 1h 25m 59s. Rate: 7.1 symbols/min [2025-10-17T21:08:24.582310] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T21:08:24.584667] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-17T21:08:25.480260] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T21:08:25.482816] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-17T21:08:26.356235] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-17T21:08:26.358607] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-17T21:08:27.263659] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-17T21:08:27.265517] [INFO ] [REMOTE ] QVCC: Full fetch complete (11993 records). [2025-10-17T21:08:27.265588] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-17T21:08:27.617935] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-10-17T21:08:27.618013] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-10-17T21:08:27.618288] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-10-17T21:08:27.618326] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-10-17T21:08:27.618835] [DEBUG] [LOCAL ] QVCC: Trimmed 11993 records to 9007 (keeping 200 days of data) [2025-10-17T21:08:27.672889] [DEBUG] [LOCAL ] QVCC: Primary data saved (9007 records). [2025-10-17T21:08:27.673031] [INFO ] [MAIN ] QVCC: Full history saved. [2025-10-17T21:08:27.673106] [INFO ] [MAIN ] Update Progress: 1760/2368 symbols completed. QVCC took 21.4s. Estimated remaining: 1h 25m 49s. Rate: 7.1 symbols/min [2025-10-17T21:08:28.242901] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:08:28.317222] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:08:28.363502] [DEBUG] [LOCAL ] QXO: No existing data file found in primary storage. [2025-10-17T21:08:28.383117] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:08:28.382233] [WARN ] [MAIN ] QXO: No existing data found, performing full refresh instead. [2025-10-17T21:08:28.361628] [DEBUG] [LOCAL ] R: No existing data file found in primary storage. [2025-10-17T21:08:28.382053] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:08:28.383581] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-17T21:08:28.383446] [DEBUG] [LOCAL ] RA: No existing data file found in primary storage. [2025-10-17T21:08:28.383883] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-17T21:08:28.383970] [DEBUG] [LOCAL ] RACE: No existing data file found in primary storage. [2025-10-17T21:08:28.383816] [WARN ] [MAIN ] RA: No existing data found, performing full refresh instead. [2025-10-17T21:08:28.383699] [WARN ] [MAIN ] R: No existing data found, performing full refresh instead. [2025-10-17T21:08:28.384298] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-17T21:08:28.384161] [WARN ] [MAIN ] RACE: No existing data found, performing full refresh instead. [2025-10-17T21:08:28.384575] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-17T21:08:28.384706] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-17T21:08:28.384428] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-17T21:08:28.385085] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-17T21:08:28.384898] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-17T21:08:28.385036] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-17T21:08:28.385468] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-17T21:08:28.385202] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-17T21:08:28.385360] [DEBUG] [LOCAL ] RA: No primary data file found to delete. [2025-10-17T21:08:28.385695] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-17T21:08:28.385856] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-17T21:08:28.385660] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-17T21:08:28.440129] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-17T21:08:29.801418] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:08:29.816962] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-10-17T21:08:29.816714] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:08:29.856167] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-10-17T21:08:29.892167] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:08:29.869064] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:08:29.892858] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-10-17T21:08:29.893293] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-10-17T21:08:31.116886] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T21:08:31.125416] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-17T21:08:31.147569] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T21:08:31.155976] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-17T21:08:31.429858] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T21:08:31.711393] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T21:08:31.742339] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-17T21:08:32.097327] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T21:08:32.542301] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-17T21:08:32.567756] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T21:08:33.315804] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T21:08:33.342246] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-17T21:08:33.706818] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T21:08:34.142275] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-17T21:08:34.874031] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T21:08:34.942262] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-17T21:08:35.494092] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T21:08:35.742258] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-17T21:08:36.112249] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-17T21:08:36.542340] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-17T21:08:37.315900] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T21:08:37.342247] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-17T21:08:37.756503] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-17T21:08:38.142293] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-17T21:08:38.942308] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-17T21:08:39.067554] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T21:08:39.742282] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-17T21:08:39.988353] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T21:08:40.305425] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T21:08:40.542311] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-17T21:08:41.123166] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T21:08:41.342255] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-17T21:08:42.122254] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T21:08:42.142251] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-17T21:08:42.695467] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-17T21:08:42.942285] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-17T21:08:43.742358] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-17T21:08:43.793802] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T21:08:44.261927] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-17T21:08:44.542326] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-17T21:08:44.637726] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-17T21:08:45.342312] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-17T21:08:45.760715] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T21:08:46.142312] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-17T21:08:46.232190] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T21:08:46.942259] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-17T21:08:47.742327] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-17T21:08:47.863958] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-17T21:08:47.925332] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-17T21:08:48.542325] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-17T21:08:49.156763] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T21:08:49.342369] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-17T21:08:49.778692] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T21:08:49.782737] [INFO ] [REMOTE ] R: Full fetch complete (42271 records). [2025-10-17T21:08:49.782855] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-17T21:08:50.150680] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-17T21:08:50.193274] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-10-17T21:08:50.193346] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-10-17T21:08:50.194191] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-10-17T21:08:50.194254] [DEBUG] [LOCAL ] R: Saving primary data. [2025-10-17T21:08:50.195722] [DEBUG] [LOCAL ] R: Trimmed 42271 records to 28752 (keeping 200 days of data) [2025-10-17T21:08:50.374145] [DEBUG] [LOCAL ] R: Primary data saved (28752 records). [2025-10-17T21:08:50.374269] [INFO ] [MAIN ] R: Full history saved. [2025-10-17T21:08:50.374341] [INFO ] [MAIN ] Update Progress: 1761/2368 symbols completed. R took 22.7s. Estimated remaining: 1h 25m 45s. Rate: 7.1 symbols/min [2025-10-17T21:08:50.538445] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:08:50.538596] [DEBUG] [LOCAL ] RAMP: No existing data file found in primary storage. [2025-10-17T21:08:50.538637] [WARN ] [MAIN ] RAMP: No existing data found, performing full refresh instead. [2025-10-17T21:08:50.538775] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-17T21:08:50.538846] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-17T21:08:50.538931] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-17T21:08:50.538984] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-17T21:08:50.888451] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:08:50.942251] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-17T21:08:51.281005] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T21:08:51.748067] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-10-17T21:08:51.749869] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T21:08:52.542263] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-17T21:08:52.596164] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T21:08:53.214039] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T21:08:53.342253] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-17T21:08:54.142285] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-17T21:08:54.505146] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T21:08:54.583343] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T21:08:54.936418] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-17T21:08:54.943132] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-17T21:08:55.742315] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-17T21:08:56.384122] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T21:08:56.542316] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-17T21:08:57.342329] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-17T21:08:57.752768] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-17T21:08:58.143679] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-17T21:08:58.145948] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T21:08:58.668910] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T21:08:58.942312] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-17T21:08:59.651015] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T21:08:59.742250] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-17T21:09:00.542289] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-17T21:09:00.650779] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T21:09:01.342316] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-17T21:09:01.702002] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-17T21:09:02.105219] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-17T21:09:02.109224] [INFO ] [REMOTE ] RA: Full fetch complete (31756 records). [2025-10-17T21:09:02.109419] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-17T21:09:02.145853] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-17T21:09:02.271864] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T21:09:02.313140] [INFO ] [REMOTE ] RACE: Full fetch complete (49106 records). [2025-10-17T21:09:02.328982] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-17T21:09:02.821787] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-10-17T21:09:02.837322] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-10-17T21:09:02.850035] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-10-17T21:09:02.850158] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-10-17T21:09:02.887480] [DEBUG] [LOCAL ] RA: Trimmed 31756 records to 22044 (keeping 200 days of data) [2025-10-17T21:09:02.983492] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-17T21:09:03.071608] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-10-17T21:09:03.071988] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-10-17T21:09:03.072906] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-10-17T21:09:03.073838] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-10-17T21:09:03.078010] [DEBUG] [LOCAL ] RACE: Trimmed 49106 records to 33535 (keeping 200 days of data) [2025-10-17T21:09:03.247315] [DEBUG] [LOCAL ] RA: Primary data saved (22044 records). [2025-10-17T21:09:03.247966] [INFO ] [MAIN ] RA: Full history saved. [2025-10-17T21:09:03.248365] [INFO ] [MAIN ] Update Progress: 1762/2368 symbols completed. RA took 35.6s. Estimated remaining: 1h 25m 38s. Rate: 7.1 symbols/min [2025-10-17T21:09:03.499759] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:09:03.503278] [DEBUG] [LOCAL ] RBA: No existing data file found in primary storage. [2025-10-17T21:09:03.503794] [WARN ] [MAIN ] RBA: No existing data found, performing full refresh instead. [2025-10-17T21:09:03.504568] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-17T21:09:03.505723] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-17T21:09:03.506181] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-17T21:09:03.506520] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-17T21:09:03.617585] [DEBUG] [LOCAL ] RACE: Primary data saved (33535 records). [2025-10-17T21:09:03.618185] [INFO ] [MAIN ] RACE: Full history saved. [2025-10-17T21:09:03.618314] [INFO ] [MAIN ] Update Progress: 1763/2368 symbols completed. RACE took 35.9s. Estimated remaining: 1h 25m 27s. Rate: 7.1 symbols/min [2025-10-17T21:09:04.013686] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:09:04.013936] [DEBUG] [LOCAL ] RBC: No existing data file found in primary storage. [2025-10-17T21:09:04.042521] [WARN ] [MAIN ] RBC: No existing data found, performing full refresh instead. [2025-10-17T21:09:04.091171] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:09:04.091589] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-10-17T21:09:04.091660] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-17T21:09:04.092889] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-17T21:09:04.093044] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-17T21:09:04.093235] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-17T21:09:04.210474] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-17T21:09:04.533097] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:09:04.542252] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-10-17T21:09:05.232139] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-17T21:09:05.342265] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-17T21:09:05.617725] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T21:09:05.804171] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T21:09:06.142271] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-17T21:09:06.942260] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-17T21:09:07.277177] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T21:09:07.441216] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-17T21:09:07.742330] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-17T21:09:08.502485] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-17T21:09:08.549194] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-17T21:09:08.566274] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T21:09:09.342267] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-17T21:09:09.673707] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T21:09:10.142295] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-17T21:09:10.942335] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-17T21:09:11.448249] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-17T21:09:11.742314] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-17T21:09:11.794156] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T21:09:12.118534] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T21:09:12.542296] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-17T21:09:13.342265] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-17T21:09:13.580451] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T21:09:13.683944] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T21:09:13.691296] [INFO ] [REMOTE ] QXO: Full fetch complete (76199 records). [2025-10-17T21:09:13.691449] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-17T21:09:14.072300] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-10-17T21:09:14.072380] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-10-17T21:09:14.073523] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-10-17T21:09:14.073600] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-10-17T21:09:14.075034] [DEBUG] [LOCAL ] QXO: Trimmed 76199 records to 54207 (keeping 200 days of data) [2025-10-17T21:09:14.159582] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-17T21:09:14.405969] [DEBUG] [LOCAL ] QXO: Primary data saved (54207 records). [2025-10-17T21:09:14.406115] [INFO ] [MAIN ] QXO: Full history saved. [2025-10-17T21:09:14.406193] [INFO ] [MAIN ] Update Progress: 1764/2368 symbols completed. QXO took 46.7s. Estimated remaining: 1h 25m 19s. Rate: 7.1 symbols/min [2025-10-17T21:09:14.587360] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:09:14.587762] [DEBUG] [LOCAL ] RBLX: No existing data file found in primary storage. [2025-10-17T21:09:14.587873] [WARN ] [MAIN ] RBLX: No existing data found, performing full refresh instead. [2025-10-17T21:09:14.588157] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-17T21:09:14.588348] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-17T21:09:14.588544] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-17T21:09:14.588609] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-17T21:09:14.776368] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T21:09:14.946923] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-17T21:09:14.988280] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:09:15.265495] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T21:09:15.742365] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-10-17T21:09:16.373720] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T21:09:16.542376] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-17T21:09:17.342346] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-17T21:09:17.774930] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T21:09:17.878327] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T21:09:18.142336] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-17T21:09:18.347993] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-17T21:09:18.942332] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-17T21:09:19.742291] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-17T21:09:19.783979] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T21:09:20.055025] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-17T21:09:20.542353] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-17T21:09:21.342284] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-17T21:09:21.529538] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T21:09:21.608412] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T21:09:22.142285] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-17T21:09:22.942301] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-17T21:09:23.011594] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T21:09:23.397802] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T21:09:23.401291] [INFO ] [REMOTE ] RBC: Full fetch complete (21764 records). [2025-10-17T21:09:23.401392] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-17T21:09:23.747549] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-17T21:09:23.896967] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-10-17T21:09:23.897095] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-10-17T21:09:23.898201] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-10-17T21:09:23.898289] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-10-17T21:09:23.899489] [DEBUG] [LOCAL ] RBC: Trimmed 21764 records to 15633 (keeping 200 days of data) [2025-10-17T21:09:24.058315] [DEBUG] [LOCAL ] RBC: Primary data saved (15633 records). [2025-10-17T21:09:24.058473] [INFO ] [MAIN ] RBC: Full history saved. [2025-10-17T21:09:24.058552] [INFO ] [MAIN ] Update Progress: 1765/2368 symbols completed. RBC took 20.4s. Estimated remaining: 1h 25m 11s. Rate: 7.1 symbols/min [2025-10-17T21:09:24.249109] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:09:24.258836] [DEBUG] [LOCAL ] RBOT: Loaded 6150 existing records from primary storage. [2025-10-17T21:09:24.259071] [INFO ] [MAIN ] RBOT: Loaded 6150 existing records. [2025-10-17T21:09:24.452916] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:09:24.453436] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-17T21:09:24.453598] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-17T21:09:24.453885] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-10-17T21:09:24.453977] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-17T21:09:24.543879] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-17T21:09:24.819004] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:09:24.845927] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T21:09:25.289599] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T21:09:25.295726] [INFO ] [REMOTE ] RAMP: Full fetch complete (54524 records). [2025-10-17T21:09:25.295848] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-17T21:09:25.347537] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-17T21:09:25.692469] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-10-17T21:09:25.692568] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-10-17T21:09:25.693591] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-10-17T21:09:25.693682] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-10-17T21:09:25.694962] [DEBUG] [LOCAL ] RAMP: Trimmed 54524 records to 38244 (keeping 200 days of data) [2025-10-17T21:09:25.911251] [DEBUG] [LOCAL ] RAMP: Primary data saved (38244 records). [2025-10-17T21:09:25.911383] [INFO ] [MAIN ] RAMP: Full history saved. [2025-10-17T21:09:25.911483] [INFO ] [MAIN ] Update Progress: 1766/2368 symbols completed. RAMP took 35.5s. Estimated remaining: 1h 25m 0s. Rate: 7.1 symbols/min [2025-10-17T21:09:26.079318] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:09:26.079474] [DEBUG] [LOCAL ] RBRK: No existing data file found in primary storage. [2025-10-17T21:09:26.079511] [WARN ] [MAIN ] RBRK: No existing data found, performing full refresh instead. [2025-10-17T21:09:26.079621] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-17T21:09:26.079694] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-17T21:09:26.079764] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-17T21:09:26.079830] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-17T21:09:26.153165] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-10-17T21:09:26.450478] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:09:26.896381] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-17T21:09:26.942342] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-10-17T21:09:27.028941] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-17T21:09:27.220279] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T21:09:27.742349] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-10-17T21:09:28.542408] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-17T21:09:28.927347] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T21:09:29.043952] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T21:09:29.342295] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-10-17T21:09:30.142349] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-17T21:09:30.781230] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-17T21:09:30.942308] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-17T21:09:31.051968] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T21:09:31.054222] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T21:09:31.742319] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-17T21:09:32.542331] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-10-17T21:09:33.179476] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-17T21:09:33.342330] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-17T21:09:33.483977] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T21:09:33.953560] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-17T21:09:34.142357] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-17T21:09:34.281842] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T21:09:34.942352] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-17T21:09:35.659250] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-17T21:09:35.742325] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-17T21:09:35.967914] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T21:09:36.430551] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-17T21:09:36.542290] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-17T21:09:37.342321] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-17T21:09:38.142348] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-17T21:09:38.652912] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-17T21:09:38.895011] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T21:09:38.942353] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-10-17T21:09:39.696215] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-17T21:09:39.742314] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-17T21:09:40.542350] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-17T21:09:40.626964] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T21:09:41.342348] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-10. [2025-10-17T21:09:42.117376] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-17T21:09:42.142244] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-17T21:09:42.428416] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T21:09:42.921355] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-17T21:09:42.927988] [INFO ] [REMOTE ] RBA: Full fetch complete (66453 records). [2025-10-17T21:09:42.928126] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-10-17T21:09:42.949241] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-17T21:09:43.312903] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-10-17T21:09:43.312986] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-10-17T21:09:43.314038] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-10-17T21:09:43.314102] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-10-17T21:09:43.315442] [DEBUG] [LOCAL ] RBA: Trimmed 66453 records to 46764 (keeping 200 days of data) [2025-10-17T21:09:43.601314] [DEBUG] [LOCAL ] RBA: Primary data saved (46764 records). [2025-10-17T21:09:43.601440] [INFO ] [MAIN ] RBA: Full history saved. [2025-10-17T21:09:43.601511] [INFO ] [MAIN ] Update Progress: 1767/2368 symbols completed. RBA took 40.4s. Estimated remaining: 1h 24m 55s. Rate: 7.1 symbols/min [2025-10-17T21:09:43.750101] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-17T21:09:43.769847] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:09:43.811780] [DEBUG] [LOCAL ] RC: Loaded 49268 existing records from primary storage. [2025-10-17T21:09:43.812075] [INFO ] [MAIN ] RC: Loaded 49268 existing records. [2025-10-17T21:09:43.990883] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:09:43.991149] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-17T21:09:43.991205] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-17T21:09:43.991550] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-10-17T21:09:43.991607] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-17T21:09:44.358966] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:09:44.394611] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-17T21:09:44.398521] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-17T21:09:44.542243] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-17T21:09:44.874934] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T21:09:45.342330] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-17T21:09:45.350011] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T21:09:46.142353] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-10-17T21:09:46.942310] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-17T21:09:47.742259] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-17T21:09:47.913798] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T21:09:47.972070] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T21:09:48.000613] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-17T21:09:48.542309] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-17T21:09:49.342308] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-17T21:09:49.633830] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-17T21:09:50.142337] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-17T21:09:50.883417] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T21:09:50.942245] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-17T21:09:51.168862] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-17T21:09:51.742340] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-17T21:09:52.043868] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T21:09:52.217918] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-17T21:09:52.542340] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-17T21:09:53.342287] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-17T21:09:54.142284] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-17T21:09:54.372061] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T21:09:54.418860] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-10-17T21:09:54.651143] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-17T21:09:54.942273] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-17T21:09:55.594995] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-17T21:09:55.742277] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-17T21:09:56.542270] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-17T21:09:56.809050] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T21:09:57.342372] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-17T21:09:58.142318] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-17T21:09:58.201580] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-17T21:09:58.220770] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-17T21:09:58.223613] [INFO ] [REMOTE ] RBOT: Full fetch complete (9280 records). [2025-10-17T21:09:58.223708] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-17T21:09:58.577610] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-10-17T21:09:58.577747] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-10-17T21:09:58.577978] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-10-17T21:09:58.578018] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-10-17T21:09:58.578413] [DEBUG] [LOCAL ] RBOT: Trimmed 9280 records to 6207 (keeping 200 days of data) [2025-10-17T21:09:58.612893] [DEBUG] [LOCAL ] RBOT: Primary data saved (6207 records). [2025-10-17T21:09:58.613002] [INFO ] [MAIN ] RBOT: Full history saved. [2025-10-17T21:09:58.613082] [INFO ] [MAIN ] Update Progress: 1768/2368 symbols completed. RBOT took 34.6s. Estimated remaining: 1h 24m 49s. Rate: 7.1 symbols/min [2025-10-17T21:09:58.779742] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:09:58.779979] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-17T21:09:58.780026] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-17T21:09:58.780140] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-17T21:09:58.780184] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-17T21:09:58.780226] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-17T21:09:58.780280] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-17T21:09:58.951279] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-17T21:09:59.144769] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:09:59.255562] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (2.71 seconds). [2025-10-17T21:09:59.263017] [INFO ] [REMOTE ] RBLX: Full fetch complete (77883 records). [2025-10-17T21:09:59.263156] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-17T21:09:59.651387] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-10-17T21:09:59.651464] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-10-17T21:09:59.652611] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-10-17T21:09:59.652698] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-10-17T21:09:59.654115] [DEBUG] [LOCAL ] RBLX: Trimmed 77883 records to 54498 (keeping 200 days of data) [2025-10-17T21:09:59.744773] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-10-17T21:09:59.992027] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T21:10:00.016100] [DEBUG] [LOCAL ] RBLX: Primary data saved (54498 records). [2025-10-17T21:10:00.016211] [INFO ] [MAIN ] RBLX: Full history saved. [2025-10-17T21:10:00.016276] [INFO ] [MAIN ] Update Progress: 1769/2368 symbols completed. RBLX took 45.6s. Estimated remaining: 1h 24m 38s. Rate: 7.1 symbols/min [2025-10-17T21:10:00.121974] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-17T21:10:00.191753] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:10:00.191909] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-10-17T21:10:00.191947] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-10-17T21:10:00.192062] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-17T21:10:00.192104] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-17T21:10:00.192166] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-17T21:10:00.192202] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-17T21:10:00.539714] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:10:00.542252] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-10-17T21:10:01.342354] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-17T21:10:01.456951] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T21:10:01.459191] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-17T21:10:01.473882] [INFO ] [REMOTE ] RBRK: Full fetch complete (76697 records). [2025-10-17T21:10:01.474086] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-17T21:10:01.876627] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-17T21:10:01.895669] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-10-17T21:10:01.897733] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-10-17T21:10:01.899062] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-10-17T21:10:01.899130] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-10-17T21:10:01.900715] [DEBUG] [LOCAL ] RBRK: Trimmed 76697 records to 53944 (keeping 200 days of data) [2025-10-17T21:10:02.142473] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-17T21:10:02.260894] [DEBUG] [LOCAL ] RBRK: Primary data saved (53944 records). [2025-10-17T21:10:02.261033] [INFO ] [MAIN ] RBRK: Full history saved. [2025-10-17T21:10:02.261110] [INFO ] [MAIN ] Update Progress: 1770/2368 symbols completed. RBRK took 36.3s. Estimated remaining: 1h 24m 27s. Rate: 7.1 symbols/min [2025-10-17T21:10:02.433378] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:10:02.433605] [DEBUG] [LOCAL ] RCI: No existing data file found in primary storage. [2025-10-17T21:10:02.433677] [WARN ] [MAIN ] RCI: No existing data found, performing full refresh instead. [2025-10-17T21:10:02.433803] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-17T21:10:02.433871] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-17T21:10:02.433950] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-17T21:10:02.433992] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-17T21:10:02.804104] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:10:02.894384] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T21:10:02.942330] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-10-17T21:10:03.742309] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-17T21:10:04.542266] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-17T21:10:04.933669] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-17T21:10:05.091581] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-17T21:10:05.342342] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-17T21:10:05.815421] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-17T21:10:06.142299] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-17T21:10:06.942277] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-17T21:10:06.961901] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T21:10:07.177182] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T21:10:07.742301] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-17T21:10:08.457393] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T21:10:08.542245] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-17T21:10:08.811531] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-17T21:10:09.229409] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T21:10:09.342263] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-17T21:10:09.994783] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-17T21:10:10.142307] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-17T21:10:10.942353] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-17T21:10:11.626187] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T21:10:11.742309] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-17T21:10:11.854497] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T21:10:12.481556] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-17T21:10:12.542291] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-17T21:10:13.342266] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-17T21:10:13.352004] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T21:10:13.975540] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-17T21:10:14.142285] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-17T21:10:14.834196] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-17T21:10:14.942324] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-17T21:10:15.742272] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-17T21:10:16.542405] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-17T21:10:16.794272] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T21:10:17.167918] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-17T21:10:17.342377] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-17T21:10:17.470723] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T21:10:17.732637] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-17T21:10:18.142309] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-17T21:10:18.578185] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-17T21:10:18.579273] [INFO ] [REMOTE ] RCD: Full fetch complete (6160 records). [2025-10-17T21:10:18.579346] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-17T21:10:18.945617] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-17T21:10:18.951677] [DEBUG] [VALIDATOR ] RCD: All expected trading days are present. [2025-10-17T21:10:18.952688] [DEBUG] [VALIDATOR ] RCD: Primary data validation passed. [2025-10-17T21:10:18.952989] [INFO ] [MAIN ] RCD: Fetched primary data is valid. [2025-10-17T21:10:18.953032] [DEBUG] [LOCAL ] RCD: Saving primary data. [2025-10-17T21:10:18.953440] [DEBUG] [LOCAL ] RCD: Trimmed 6160 records to 3432 (keeping 200 days of data) [2025-10-17T21:10:18.975476] [DEBUG] [LOCAL ] RCD: Primary data saved (3432 records). [2025-10-17T21:10:18.975596] [INFO ] [MAIN ] RCD: Full history saved. [2025-10-17T21:10:18.975700] [INFO ] [MAIN ] Update Progress: 1771/2368 symbols completed. RCD took 19.0s. Estimated remaining: 1h 24m 22s. Rate: 7.1 symbols/min [2025-10-17T21:10:19.140535] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:10:19.140745] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-17T21:10:19.140814] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-17T21:10:19.140930] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-17T21:10:19.140972] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-17T21:10:19.141012] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-17T21:10:19.141043] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-17T21:10:19.514900] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:10:19.515128] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-17T21:10:19.742319] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-17T21:10:20.143429] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-17T21:10:20.542352] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-17T21:10:21.342294] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-17T21:10:22.142348] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-17T21:10:22.306370] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T21:10:22.544490] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-17T21:10:22.942289] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-17T21:10:23.062602] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T21:10:23.742343] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-17T21:10:24.290692] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-17T21:10:24.380338] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-17T21:10:24.542339] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-10-17T21:10:25.342328] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-17T21:10:26.142282] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-17T21:10:26.494955] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-17T21:10:26.942337] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-17T21:10:27.742300] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-17T21:10:28.875978] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T21:10:28.876768] [INFO ] [REMOTE ] RCB: Full fetch complete (3725 records). [2025-10-17T21:10:28.876836] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-17T21:10:29.047905] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T21:10:29.048113] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-17T21:10:29.048185] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-17T21:10:29.048234] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-17T21:10:29.048308] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-17T21:10:29.048363] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-17T21:10:29.048407] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-17T21:10:29.048464] [INFO ] [MAIN ] Update Progress: 1772/2368 symbols completed. RCB took 30.4s. Estimated remaining: 1h 24m 14s. Rate: 7.1 symbols/min [2025-10-17T21:10:29.213416] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:10:29.232108] [DEBUG] [LOCAL ] RCS: Loaded 12406 existing records from primary storage. [2025-10-17T21:10:29.232340] [INFO ] [MAIN ] RCS: Loaded 12406 existing records. [2025-10-17T21:10:29.406691] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:10:29.406953] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-17T21:10:29.407001] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-17T21:10:29.407157] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-10-17T21:10:29.407197] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-17T21:10:29.756760] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:10:29.757077] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-10-17T21:10:31.179152] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (5.04 seconds). [2025-10-17T21:10:31.186344] [INFO ] [REMOTE ] RC: Full fetch complete (71081 records). [2025-10-17T21:10:31.186506] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-17T21:10:31.588015] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-10-17T21:10:31.588231] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-10-17T21:10:31.589534] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-10-17T21:10:31.589771] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-10-17T21:10:31.601069] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T21:10:31.605684] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-17T21:10:31.632161] [DEBUG] [LOCAL ] RC: Trimmed 71081 records to 49641 (keeping 200 days of data) [2025-10-17T21:10:31.634234] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (6.29 seconds). [2025-10-17T21:10:31.645142] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-17T21:10:31.956339] [DEBUG] [LOCAL ] RC: Primary data saved (49641 records). [2025-10-17T21:10:31.956473] [INFO ] [MAIN ] RC: Full history saved. [2025-10-17T21:10:31.957039] [INFO ] [MAIN ] Update Progress: 1773/2368 symbols completed. RC took 48.4s. Estimated remaining: 1h 24m 3s. Rate: 7.1 symbols/min [2025-10-17T21:10:32.126909] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:10:32.127165] [DEBUG] [LOCAL ] RCUS: No existing data file found in primary storage. [2025-10-17T21:10:32.127307] [WARN ] [MAIN ] RCUS: No existing data found, performing full refresh instead. [2025-10-17T21:10:32.127429] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-17T21:10:32.127471] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-17T21:10:32.127512] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-17T21:10:32.127545] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-17T21:10:32.492075] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:10:32.492458] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-10-17T21:10:32.521617] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (4.78 seconds). [2025-10-17T21:10:32.532609] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-17T21:10:33.190078] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T21:10:33.194790] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-17T21:10:33.683442] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T21:10:33.694665] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-17T21:10:34.134346] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T21:10:34.142685] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-17T21:10:34.179682] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T21:10:34.541923] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-17T21:10:34.942291] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-17T21:10:35.656433] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T21:10:35.724155] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T21:10:35.742256] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-17T21:10:36.542368] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-17T21:10:37.132942] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-17T21:10:37.342317] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-17T21:10:38.142268] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-17T21:10:38.551159] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-10-17T21:10:38.942400] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-17T21:10:39.420726] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-10-17T21:10:39.742342] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-17T21:10:42.059846] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (3.92 seconds). [2025-10-17T21:10:42.062781] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-17T21:10:42.226860] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (3.28 seconds). [2025-10-17T21:10:42.233569] [INFO ] [REMOTE ] RCI: Full fetch complete (70667 records). [2025-10-17T21:10:42.233699] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-17T21:10:42.559426] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-10-17T21:10:42.626960] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-17T21:10:42.664662] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-10-17T21:10:42.664852] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-10-17T21:10:42.666161] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-10-17T21:10:42.666289] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-10-17T21:10:42.667866] [DEBUG] [LOCAL ] RCI: Trimmed 70667 records to 49399 (keeping 200 days of data) [2025-10-17T21:10:42.789887] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-17T21:10:42.798106] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-17T21:10:42.948485] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (5.61 seconds). [2025-10-17T21:10:42.966303] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-17T21:10:43.036078] [DEBUG] [LOCAL ] RCI: Primary data saved (49399 records). [2025-10-17T21:10:43.036234] [INFO ] [MAIN ] RCI: Full history saved. [2025-10-17T21:10:43.036328] [INFO ] [MAIN ] Update Progress: 1774/2368 symbols completed. RCI took 40.8s. Estimated remaining: 1h 23m 56s. Rate: 7.1 symbols/min [2025-10-17T21:10:43.203949] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:10:43.204103] [DEBUG] [LOCAL ] RDDT: No existing data file found in primary storage. [2025-10-17T21:10:43.204141] [WARN ] [MAIN ] RDDT: No existing data found, performing full refresh instead. [2025-10-17T21:10:43.204252] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-17T21:10:43.204293] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-17T21:10:43.204334] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-17T21:10:43.204367] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-17T21:10:43.557829] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:10:43.748827] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-10-17T21:10:43.751732] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-17T21:10:44.118378] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T21:10:44.542346] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-17T21:10:45.134302] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-17T21:10:45.342311] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-17T21:10:45.536456] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T21:10:46.142304] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-17T21:10:46.327555] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-17T21:10:46.688209] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-17T21:10:46.942323] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-17T21:10:46.971331] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T21:10:47.742304] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-17T21:10:47.862491] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T21:10:48.542319] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-17T21:10:49.342338] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-17T21:10:50.142305] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-17T21:10:50.397686] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-17T21:10:50.439151] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-10-17T21:10:50.755681] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-17T21:10:50.942270] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-17T21:10:51.240212] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T21:10:51.742307] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-17T21:10:52.520766] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T21:10:52.542253] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-17T21:10:53.342339] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-17T21:10:54.121931] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T21:10:54.142245] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-17T21:10:54.235665] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-17T21:10:54.409488] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T21:10:54.412444] [INFO ] [REMOTE ] RCS: Full fetch complete (19306 records). [2025-10-17T21:10:54.412515] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-17T21:10:54.778357] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-17T21:10:54.778438] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-17T21:10:54.778952] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-17T21:10:54.779015] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-17T21:10:54.779591] [DEBUG] [LOCAL ] RCS: Trimmed 19306 records to 12509 (keeping 200 days of data) [2025-10-17T21:10:54.853288] [DEBUG] [LOCAL ] RCS: Primary data saved (12509 records). [2025-10-17T21:10:54.853435] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-17T21:10:54.853519] [INFO ] [MAIN ] Update Progress: 1775/2368 symbols completed. RCS took 25.8s. Estimated remaining: 1h 23m 48s. Rate: 7.1 symbols/min [2025-10-17T21:10:54.948164] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-17T21:10:55.027706] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:10:55.027903] [DEBUG] [LOCAL ] RDN: No existing data file found in primary storage. [2025-10-17T21:10:55.027944] [WARN ] [MAIN ] RDN: No existing data found, performing full refresh instead. [2025-10-17T21:10:55.028082] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-17T21:10:55.028125] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-17T21:10:55.028167] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-17T21:10:55.028206] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-17T21:10:55.462291] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:10:55.508196] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T21:10:55.742334] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-17T21:10:56.542303] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-17T21:10:57.342287] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-10-17T21:10:57.362896] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T21:10:57.369940] [INFO ] [REMOTE ] RCUS: Full fetch complete (60942 records). [2025-10-17T21:10:57.370062] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-17T21:10:57.753957] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-10-17T21:10:57.754155] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-10-17T21:10:57.755146] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-10-17T21:10:57.755229] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-10-17T21:10:57.756604] [DEBUG] [LOCAL ] RCUS: Trimmed 60942 records to 43674 (keeping 200 days of data) [2025-10-17T21:10:57.867339] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-10-17T21:10:58.043031] [DEBUG] [LOCAL ] RCUS: Primary data saved (43674 records). [2025-10-17T21:10:58.043162] [INFO ] [MAIN ] RCUS: Full history saved. [2025-10-17T21:10:58.043235] [INFO ] [MAIN ] Update Progress: 1776/2368 symbols completed. RCUS took 26.1s. Estimated remaining: 1h 23m 38s. Rate: 7.1 symbols/min [2025-10-17T21:10:58.143679] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-17T21:10:58.214339] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:10:58.214516] [DEBUG] [LOCAL ] RDW: No existing data file found in primary storage. [2025-10-17T21:10:58.214559] [WARN ] [MAIN ] RDW: No existing data found, performing full refresh instead. [2025-10-17T21:10:58.214700] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-17T21:10:58.214753] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-17T21:10:58.214795] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-17T21:10:58.214827] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-17T21:10:58.559320] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:10:58.843671] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-17T21:10:58.947363] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-17T21:10:58.960457] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T21:10:59.742384] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-10-17T21:11:00.542333] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-17T21:11:00.752252] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-17T21:11:01.342304] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-17T21:11:01.550963] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-10-17T21:11:01.771104] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T21:11:01.945136] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T21:11:02.142305] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-17T21:11:02.942265] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-17T21:11:03.027473] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T21:11:03.742365] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-17T21:11:03.836735] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-17T21:11:04.542281] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-17T21:11:04.641425] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-17T21:11:04.648845] [INFO ] [REMOTE ] RCL: Full fetch complete (75074 records). [2025-10-17T21:11:04.649118] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-17T21:11:04.650240] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-16) is before last completed trading day (2025-10-17). Symbol may be delisted or halted. [2025-10-17T21:11:04.650341] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-10-17T21:11:04.674835] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-10-17T21:11:04.674983] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-17T21:11:04.675279] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-17T21:11:04.675775] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-17T21:11:04.677253] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-10-17T21:11:04.677172] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T21:11:04.677475] [INFO ] [MAIN ] Update Progress: 1777/2368 symbols completed. RCL took 45.7s. Estimated remaining: 1h 23m 29s. Rate: 7.1 symbols/min [2025-10-17T21:11:04.854009] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:11:04.854131] [DEBUG] [LOCAL ] RDY: No existing data file found in primary storage. [2025-10-17T21:11:04.854168] [WARN ] [MAIN ] RDY: No existing data found, performing full refresh instead. [2025-10-17T21:11:04.854268] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-17T21:11:04.854307] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-17T21:11:04.854348] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-17T21:11:04.854379] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-17T21:11:05.197800] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:11:05.342254] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-10-17T21:11:06.142313] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-17T21:11:06.448953] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-17T21:11:06.583976] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T21:11:06.942303] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-17T21:11:07.742281] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-17T21:11:07.789187] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T21:11:08.542417] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-17T21:11:09.180216] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-17T21:11:09.342381] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-17T21:11:10.142361] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-17T21:11:10.297747] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-17T21:11:10.352358] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T21:11:10.942290] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-17T21:11:11.220070] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T21:11:11.742331] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-17T21:11:12.278669] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-17T21:11:12.542369] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-17T21:11:12.749141] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-17T21:11:13.342289] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-17T21:11:13.516435] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T21:11:14.142291] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-17T21:11:14.947426] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-17T21:11:14.967588] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-17T21:11:15.027391] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T21:11:15.742250] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-17T21:11:16.002893] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T21:11:16.542279] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-17T21:11:16.710600] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T21:11:17.342314] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-17T21:11:17.881910] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-17T21:11:18.142286] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-17T21:11:18.349529] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T21:11:18.942252] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-17T21:11:19.133545] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T21:11:19.742310] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-17T21:11:20.388749] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-17T21:11:20.542279] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-17T21:11:20.713225] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T21:11:21.342295] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-17T21:11:22.142264] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-17T21:11:22.335159] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T21:11:22.366782] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-17T21:11:22.942344] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-17T21:11:23.599535] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-17T21:11:23.742243] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-17T21:11:23.990810] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T21:11:24.542363] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-17T21:11:25.342275] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-17T21:11:25.665471] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-10-17T21:11:26.142319] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-17T21:11:26.212252] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-17T21:11:26.343103] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T21:11:26.839972] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T21:11:26.942255] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-17T21:11:27.742338] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-17T21:11:28.542334] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-17T21:11:28.846087] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-17T21:11:28.853384] [INFO ] [REMOTE ] RDDT: Full fetch complete (77929 records). [2025-10-17T21:11:28.853505] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-17T21:11:29.245015] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-10-17T21:11:29.245150] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-10-17T21:11:29.246565] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-10-17T21:11:29.246680] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-10-17T21:11:29.248155] [DEBUG] [LOCAL ] RDDT: Trimmed 77929 records to 54555 (keeping 200 days of data) [2025-10-17T21:11:29.379249] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T21:11:29.392142] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-17T21:11:29.429074] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-17T21:11:29.659737] [DEBUG] [LOCAL ] RDDT: Primary data saved (54555 records). [2025-10-17T21:11:29.659869] [INFO ] [MAIN ] RDDT: Full history saved. [2025-10-17T21:11:29.659942] [INFO ] [MAIN ] Update Progress: 1778/2368 symbols completed. RDDT took 46.6s. Estimated remaining: 1h 23m 26s. Rate: 7.1 symbols/min [2025-10-17T21:11:29.825579] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:11:29.825752] [DEBUG] [LOCAL ] RELX: No existing data file found in primary storage. [2025-10-17T21:11:29.825798] [WARN ] [MAIN ] RELX: No existing data found, performing full refresh instead. [2025-10-17T21:11:29.825934] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-17T21:11:29.826000] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-17T21:11:29.826050] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-17T21:11:29.826085] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-17T21:11:30.149849] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-17T21:11:30.180924] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:11:30.270277] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T21:11:30.277391] [INFO ] [REMOTE ] RDN: Full fetch complete (66053 records). [2025-10-17T21:11:30.277525] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-17T21:11:30.668425] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-10-17T21:11:30.668512] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-10-17T21:11:30.669559] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-10-17T21:11:30.669620] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-10-17T21:11:30.671621] [DEBUG] [LOCAL ] RDN: Trimmed 66053 records to 45209 (keeping 200 days of data) [2025-10-17T21:11:30.943672] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-10-17T21:11:30.943570] [DEBUG] [LOCAL ] RDN: Primary data saved (45209 records). [2025-10-17T21:11:30.944630] [INFO ] [MAIN ] RDN: Full history saved. [2025-10-17T21:11:30.944777] [INFO ] [MAIN ] Update Progress: 1779/2368 symbols completed. RDN took 36.1s. Estimated remaining: 1h 23m 15s. Rate: 7.1 symbols/min [2025-10-17T21:11:31.119256] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:11:31.144256] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T21:11:31.186147] [DEBUG] [LOCAL ] RERE: Loaded 41810 existing records from primary storage. [2025-10-17T21:11:31.186410] [INFO ] [MAIN ] RERE: Loaded 41810 existing records. [2025-10-17T21:11:31.365893] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:11:31.366123] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-17T21:11:31.366183] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-17T21:11:31.366440] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-10-17T21:11:31.366506] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-17T21:11:31.709228] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:11:31.742279] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-10-17T21:11:32.537714] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-17T21:11:32.544392] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-17T21:11:32.546171] [INFO ] [REMOTE ] RDW: Full fetch complete (75442 records). [2025-10-17T21:11:32.546279] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-17T21:11:32.854510] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T21:11:32.983797] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-10-17T21:11:32.983876] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-10-17T21:11:32.985204] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-10-17T21:11:32.985290] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-10-17T21:11:32.986849] [DEBUG] [LOCAL ] RDW: Trimmed 75442 records to 53025 (keeping 200 days of data) [2025-10-17T21:11:33.296462] [DEBUG] [LOCAL ] RDW: Primary data saved (53025 records). [2025-10-17T21:11:33.296583] [INFO ] [MAIN ] RDW: Full history saved. [2025-10-17T21:11:33.296690] [INFO ] [MAIN ] Update Progress: 1780/2368 symbols completed. RDW took 35.3s. Estimated remaining: 1h 23m 5s. Rate: 7.1 symbols/min [2025-10-17T21:11:33.352096] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-17T21:11:33.495186] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:11:33.496484] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T21:11:33.544631] [DEBUG] [LOCAL ] RES: Loaded 47297 existing records from primary storage. [2025-10-17T21:11:33.544947] [INFO ] [MAIN ] RES: Loaded 47297 existing records. [2025-10-17T21:11:33.736110] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:11:33.736510] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-17T21:11:33.736629] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-17T21:11:33.736953] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-10-17T21:11:33.743071] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-17T21:11:33.811737] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T21:11:33.870705] [INFO ] [REMOTE ] RDY: Full fetch complete (68797 records). [2025-10-17T21:11:33.881087] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-17T21:11:34.173285] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-17T21:11:34.440638] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:11:34.509873] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-10-17T21:11:34.509943] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-10-17T21:11:34.511061] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-10-17T21:11:34.511126] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-10-17T21:11:34.512412] [DEBUG] [LOCAL ] RDY: Trimmed 68797 records to 47210 (keeping 200 days of data) [2025-10-17T21:11:34.814227] [DEBUG] [LOCAL ] RDY: Primary data saved (47210 records). [2025-10-17T21:11:34.814366] [INFO ] [MAIN ] RDY: Full history saved. [2025-10-17T21:11:34.814455] [INFO ] [MAIN ] Update Progress: 1781/2368 symbols completed. RDY took 30.1s. Estimated remaining: 1h 22m 54s. Rate: 7.1 symbols/min [2025-10-17T21:11:34.951513] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-10-17T21:11:34.957022] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T21:11:35.045878] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:11:35.046056] [DEBUG] [LOCAL ] REVG: No existing data file found in primary storage. [2025-10-17T21:11:35.046103] [WARN ] [MAIN ] REVG: No existing data found, performing full refresh instead. [2025-10-17T21:11:35.046221] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-17T21:11:35.046263] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-17T21:11:35.046303] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-17T21:11:35.046334] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-17T21:11:35.449627] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:11:35.467823] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T21:11:35.742314] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-10-17T21:11:36.542327] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-17T21:11:36.821487] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T21:11:37.342323] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-17T21:11:37.469905] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T21:11:38.142301] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-17T21:11:38.185144] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T21:11:38.942346] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-17T21:11:38.983974] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T21:11:39.214149] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T21:11:39.742349] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-17T21:11:40.485747] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T21:11:40.542252] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-17T21:11:41.342264] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-17T21:11:41.591029] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T21:11:42.113918] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T21:11:42.142241] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-17T21:11:42.920080] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T21:11:42.942254] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-17T21:11:43.337274] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T21:11:43.742602] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-17T21:11:44.489511] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T21:11:44.542289] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-17T21:11:45.232722] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-17T21:11:45.342282] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-17T21:11:46.142291] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-17T21:11:46.349306] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T21:11:46.778884] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T21:11:46.942377] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-17T21:11:47.747388] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-17T21:11:47.761258] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T21:11:47.969040] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T21:11:48.542294] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-17T21:11:49.342275] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-17T21:11:49.426182] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T21:11:50.142340] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-17T21:11:50.294864] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T21:11:50.942319] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-17T21:11:51.161345] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T21:11:51.742263] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-17T21:11:51.844196] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T21:11:52.188412] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T21:11:52.542378] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-17T21:11:53.007382] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T21:11:53.342312] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-17T21:11:54.066065] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T21:11:54.142258] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-17T21:11:54.942311] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-17T21:11:54.982397] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T21:11:55.727264] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T21:11:55.742234] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-17T21:11:56.542308] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-17T21:11:56.799936] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T21:11:56.899728] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T21:11:57.342301] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-17T21:11:58.142273] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-17T21:11:58.304424] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T21:11:58.942271] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-17T21:11:58.972559] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T21:11:59.742325] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-17T21:11:59.770035] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T21:12:00.275993] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T21:12:00.281911] [INFO ] [REMOTE ] RERE: Full fetch complete (57773 records). [2025-10-17T21:12:00.282071] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-17T21:12:00.547487] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-17T21:12:00.667917] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-10-17T21:12:00.667999] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-10-17T21:12:00.668999] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-10-17T21:12:00.669061] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-10-17T21:12:00.670218] [DEBUG] [LOCAL ] RERE: Trimmed 57773 records to 42117 (keeping 200 days of data) [2025-10-17T21:12:00.906738] [DEBUG] [LOCAL ] RERE: Primary data saved (42117 records). [2025-10-17T21:12:00.906900] [INFO ] [MAIN ] RERE: Full history saved. [2025-10-17T21:12:00.907026] [INFO ] [MAIN ] Update Progress: 1782/2368 symbols completed. RERE took 30.0s. Estimated remaining: 1h 22m 51s. Rate: 7.1 symbols/min [2025-10-17T21:12:01.079293] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:12:01.079506] [DEBUG] [LOCAL ] REX: No existing data file found in primary storage. [2025-10-17T21:12:01.079666] [WARN ] [MAIN ] REX: No existing data found, performing full refresh instead. [2025-10-17T21:12:01.079878] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-17T21:12:01.079930] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-17T21:12:01.079976] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-17T21:12:01.080010] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-17T21:12:01.352335] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-17T21:12:01.444876] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:12:01.467597] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T21:12:02.142323] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-17T21:12:02.505372] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T21:12:02.942271] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-17T21:12:03.133401] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T21:12:03.620473] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T21:12:03.742299] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-17T21:12:04.542271] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-10-17T21:12:04.617093] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T21:12:05.342342] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-17T21:12:05.501425] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T21:12:05.761816] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T21:12:06.142359] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-17T21:12:06.942256] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-17T21:12:07.191110] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-17T21:12:07.198365] [INFO ] [REMOTE ] RELX: Full fetch complete (68341 records). [2025-10-17T21:12:07.207409] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-17T21:12:07.208419] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T21:12:07.621429] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-10-17T21:12:07.621526] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-10-17T21:12:07.622659] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-10-17T21:12:07.622727] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-10-17T21:12:07.624176] [DEBUG] [LOCAL ] RELX: Trimmed 68341 records to 49179 (keeping 200 days of data) [2025-10-17T21:12:07.743802] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-17T21:12:07.921132] [DEBUG] [LOCAL ] RELX: Primary data saved (49179 records). [2025-10-17T21:12:07.921263] [INFO ] [MAIN ] RELX: Full history saved. [2025-10-17T21:12:07.921364] [INFO ] [MAIN ] Update Progress: 1783/2368 symbols completed. RELX took 38.3s. Estimated remaining: 1h 22m 42s. Rate: 7.1 symbols/min [2025-10-17T21:12:08.090980] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:12:08.091138] [DEBUG] [LOCAL ] REXR: No existing data file found in primary storage. [2025-10-17T21:12:08.091198] [WARN ] [MAIN ] REXR: No existing data found, performing full refresh instead. [2025-10-17T21:12:08.091312] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-17T21:12:08.091353] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-17T21:12:08.091393] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-17T21:12:08.091424] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-17T21:12:08.491483] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:12:08.506222] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T21:12:08.511792] [INFO ] [REMOTE ] REVG: Full fetch complete (57958 records). [2025-10-17T21:12:08.511943] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-17T21:12:08.547560] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-17T21:12:08.891487] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-10-17T21:12:08.891574] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-10-17T21:12:08.892670] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-10-17T21:12:08.892737] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-10-17T21:12:08.893961] [DEBUG] [LOCAL ] REVG: Trimmed 57958 records to 40973 (keeping 200 days of data) [2025-10-17T21:12:09.147029] [DEBUG] [LOCAL ] REVG: Primary data saved (40973 records). [2025-10-17T21:12:09.147200] [INFO ] [MAIN ] REVG: Full history saved. [2025-10-17T21:12:09.147296] [INFO ] [MAIN ] Update Progress: 1784/2368 symbols completed. REVG took 34.3s. Estimated remaining: 1h 22m 31s. Rate: 7.1 symbols/min [2025-10-17T21:12:09.320027] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:12:09.320333] [DEBUG] [LOCAL ] REZI: No existing data file found in primary storage. [2025-10-17T21:12:09.320394] [WARN ] [MAIN ] REZI: No existing data found, performing full refresh instead. [2025-10-17T21:12:09.320505] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-17T21:12:09.320547] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-17T21:12:09.320589] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-17T21:12:09.320622] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-17T21:12:09.352271] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-10-17T21:12:09.658818] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T21:12:09.701105] [INFO ] [REMOTE ] RES: Full fetch complete (68786 records). [2025-10-17T21:12:09.707145] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:12:09.707362] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-17T21:12:09.820337] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-17T21:12:10.105802] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-10-17T21:12:10.105883] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-10-17T21:12:10.106949] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-10-17T21:12:10.107013] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-10-17T21:12:10.108481] [DEBUG] [LOCAL ] RES: Trimmed 68786 records to 47647 (keeping 200 days of data) [2025-10-17T21:12:10.156472] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-17T21:12:10.378800] [DEBUG] [LOCAL ] RES: Primary data saved (47647 records). [2025-10-17T21:12:10.378941] [INFO ] [MAIN ] RES: Full history saved. [2025-10-17T21:12:10.379555] [INFO ] [MAIN ] Update Progress: 1785/2368 symbols completed. RES took 37.1s. Estimated remaining: 1h 22m 20s. Rate: 7.1 symbols/min [2025-10-17T21:12:10.543674] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:12:10.543832] [DEBUG] [LOCAL ] RF: No existing data file found in primary storage. [2025-10-17T21:12:10.543870] [WARN ] [MAIN ] RF: No existing data found, performing full refresh instead. [2025-10-17T21:12:10.543978] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-17T21:12:10.544018] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-17T21:12:10.544057] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-17T21:12:10.544089] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-17T21:12:10.889971] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:12:10.942255] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-10-17T21:12:11.281487] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-17T21:12:11.323103] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-17T21:12:11.742298] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-10-17T21:12:12.542258] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-17T21:12:12.967539] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T21:12:13.329189] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T21:12:13.342235] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-17T21:12:13.373045] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-17T21:12:14.142303] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-17T21:12:14.827431] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T21:12:14.942262] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-17T21:12:15.742296] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-17T21:12:15.864229] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T21:12:16.455253] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T21:12:16.542301] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-17T21:12:17.337541] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T21:12:17.348198] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-17T21:12:18.142191] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T21:12:18.151731] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-17T21:12:18.254199] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T21:12:18.942325] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-17T21:12:19.728967] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T21:12:19.742233] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-17T21:12:20.542288] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-17T21:12:20.731182] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T21:12:21.166730] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T21:12:21.342321] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-17T21:12:21.702402] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-17T21:12:21.931754] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-17T21:12:22.142350] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-17T21:12:22.942335] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-17T21:12:23.713370] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T21:12:23.742270] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-17T21:12:24.542310] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-17T21:12:24.666192] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-17T21:12:25.342369] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-17T21:12:25.400135] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T21:12:25.438796] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-17T21:12:26.142326] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-17T21:12:26.942341] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-17T21:12:27.362795] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T21:12:27.742290] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-17T21:12:27.955227] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T21:12:28.542271] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-17T21:12:28.649604] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T21:12:29.342316] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-17T21:12:29.415045] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T21:12:29.658325] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T21:12:30.142288] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-17T21:12:30.942259] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-17T21:12:31.313339] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T21:12:31.316593] [INFO ] [REMOTE ] REX: Full fetch complete (21164 records). [2025-10-17T21:12:31.316710] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-17T21:12:31.641567] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-17T21:12:31.735456] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-10-17T21:12:31.735531] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-10-17T21:12:31.735979] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-10-17T21:12:31.736042] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-10-17T21:12:31.736582] [DEBUG] [LOCAL ] REX: Trimmed 21164 records to 14756 (keeping 200 days of data) [2025-10-17T21:12:31.771579] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-17T21:12:31.825479] [DEBUG] [LOCAL ] REX: Primary data saved (14756 records). [2025-10-17T21:12:31.825600] [INFO ] [MAIN ] REX: Full history saved. [2025-10-17T21:12:31.825690] [INFO ] [MAIN ] Update Progress: 1786/2368 symbols completed. REX took 30.9s. Estimated remaining: 1h 22m 16s. Rate: 7.1 symbols/min [2025-10-17T21:12:31.995878] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:12:32.008442] [DEBUG] [LOCAL ] RFI: Loaded 10479 existing records from primary storage. [2025-10-17T21:12:32.008694] [INFO ] [MAIN ] RFI: Loaded 10479 existing records. [2025-10-17T21:12:32.187895] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:12:32.188250] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-17T21:12:32.188307] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-17T21:12:32.188523] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-10-17T21:12:32.188579] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-17T21:12:32.548173] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-17T21:12:32.555278] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:12:32.902232] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T21:12:33.342331] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-17T21:12:33.616514] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-17T21:12:34.142318] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-17T21:12:34.296281] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T21:12:34.942364] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-10-17T21:12:35.096204] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T21:12:35.742307] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-17T21:12:36.102211] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-17T21:12:36.149267] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-17T21:12:36.542301] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-17T21:12:37.342268] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-17T21:12:37.539711] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-17T21:12:37.690618] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T21:12:38.142342] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-17T21:12:38.942338] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-17T21:12:38.988007] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-17T21:12:39.403103] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-17T21:12:39.742271] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-17T21:12:40.542321] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-17T21:12:40.751116] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T21:12:41.342256] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-17T21:12:41.411381] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-17T21:12:41.441139] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T21:12:41.447607] [INFO ] [REMOTE ] REZI: Full fetch complete (66127 records). [2025-10-17T21:12:41.447764] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-17T21:12:41.824941] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-10-17T21:12:41.825014] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-10-17T21:12:41.826094] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-10-17T21:12:41.826156] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-10-17T21:12:41.827415] [DEBUG] [LOCAL ] REZI: Trimmed 66127 records to 47764 (keeping 200 days of data) [2025-10-17T21:12:42.099242] [DEBUG] [LOCAL ] REZI: Primary data saved (47764 records). [2025-10-17T21:12:42.099368] [INFO ] [MAIN ] REZI: Full history saved. [2025-10-17T21:12:42.099439] [INFO ] [MAIN ] Update Progress: 1787/2368 symbols completed. REZI took 33.0s. Estimated remaining: 1h 22m 8s. Rate: 7.1 symbols/min [2025-10-17T21:12:42.153781] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-17T21:12:42.269119] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:12:42.281457] [DEBUG] [LOCAL ] RFL: Loaded 11494 existing records from primary storage. [2025-10-17T21:12:42.281673] [INFO ] [MAIN ] RFL: Loaded 11494 existing records. [2025-10-17T21:12:42.452928] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:12:42.453149] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-17T21:12:42.453207] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-17T21:12:42.453368] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-10-17T21:12:42.453423] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-17T21:12:42.818210] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:12:42.942294] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-10-17T21:12:42.980678] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T21:12:43.599265] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-17T21:12:43.742327] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-17T21:12:44.415802] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-17T21:12:44.542373] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-17T21:12:44.861592] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-17T21:12:45.342271] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-17T21:12:45.441130] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T21:12:45.977785] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-17T21:12:46.142313] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-17T21:12:46.942299] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-17T21:12:47.742269] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-17T21:12:47.894384] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T21:12:47.902895] [INFO ] [REMOTE ] REXR: Full fetch complete (75332 records). [2025-10-17T21:12:47.903039] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-17T21:12:48.014987] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-17T21:12:48.302809] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-10-17T21:12:48.302958] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-10-17T21:12:48.304168] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-10-17T21:12:48.304230] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-10-17T21:12:48.305700] [DEBUG] [LOCAL ] REXR: Trimmed 75332 records to 52912 (keeping 200 days of data) [2025-10-17T21:12:48.399352] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-17T21:12:48.542949] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-17T21:12:48.636951] [DEBUG] [LOCAL ] REXR: Primary data saved (52912 records). [2025-10-17T21:12:48.637083] [INFO ] [MAIN ] REXR: Full history saved. [2025-10-17T21:12:48.637178] [INFO ] [MAIN ] Update Progress: 1788/2368 symbols completed. REXR took 40.7s. Estimated remaining: 1h 21m 59s. Rate: 7.1 symbols/min [2025-10-17T21:12:48.815182] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:12:48.821927] [DEBUG] [LOCAL ] RFM: Loaded 4179 existing records from primary storage. [2025-10-17T21:12:48.822111] [INFO ] [MAIN ] RFM: Loaded 4179 existing records. [2025-10-17T21:12:48.997245] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:12:48.997467] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-17T21:12:48.997526] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-17T21:12:48.997742] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-10-17T21:12:48.997800] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-17T21:12:49.341057] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:12:49.342240] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-10-17T21:12:50.048684] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-17T21:12:50.142308] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-17T21:12:50.445776] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T21:12:50.942319] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-17T21:12:50.979239] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-17T21:12:51.564438] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T21:12:51.742258] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-17T21:12:52.542344] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-17T21:12:52.591852] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T21:12:53.163419] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-17T21:12:53.342332] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-17T21:12:54.084529] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-17T21:12:54.142355] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-17T21:12:54.942324] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-17T21:12:55.636032] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-17T21:12:55.742321] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-17T21:12:55.899060] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T21:12:55.907563] [INFO ] [REMOTE ] RF: Full fetch complete (77796 records). [2025-10-17T21:12:55.907802] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-17T21:12:56.301986] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-10-17T21:12:56.302065] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-10-17T21:12:56.303215] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-10-17T21:12:56.303278] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-10-17T21:12:56.304854] [DEBUG] [LOCAL ] RF: Trimmed 77796 records to 54412 (keeping 200 days of data) [2025-10-17T21:12:56.399784] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-17T21:12:56.544532] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-17T21:12:56.647885] [DEBUG] [LOCAL ] RF: Primary data saved (54412 records). [2025-10-17T21:12:56.648021] [INFO ] [MAIN ] RF: Full history saved. [2025-10-17T21:12:56.648092] [INFO ] [MAIN ] Update Progress: 1789/2368 symbols completed. RF took 46.3s. Estimated remaining: 1h 21m 51s. Rate: 7.1 symbols/min [2025-10-17T21:12:56.816345] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:12:56.826861] [DEBUG] [LOCAL ] RFMZ: Loaded 8815 existing records from primary storage. [2025-10-17T21:12:56.827049] [INFO ] [MAIN ] RFMZ: Loaded 8815 existing records. [2025-10-17T21:12:57.015584] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:12:57.015829] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-17T21:12:57.015876] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-17T21:12:57.016025] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-10-17T21:12:57.016063] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-17T21:12:57.344246] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-17T21:12:57.370902] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:12:57.430870] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-17T21:12:58.045474] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-17T21:12:58.142321] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-17T21:12:58.942354] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-17T21:12:59.322169] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T21:12:59.420843] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-17T21:12:59.742438] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-17T21:13:00.542271] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-17T21:13:00.749255] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-17T21:13:01.342291] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-17T21:13:01.574213] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T21:13:02.142320] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-17T21:13:02.303071] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T21:13:02.701035] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T21:13:02.942335] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-17T21:13:03.742327] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-17T21:13:04.062712] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T21:13:04.478096] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-17T21:13:04.542329] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-10-17T21:13:05.342294] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-17T21:13:05.585713] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T21:13:05.898912] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-17T21:13:05.900539] [INFO ] [REMOTE ] RFL: Full fetch complete (13177 records). [2025-10-17T21:13:05.900608] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-17T21:13:06.147464] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-17T21:13:06.263185] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-10-17T21:13:06.263262] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-10-17T21:13:06.263584] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-10-17T21:13:06.263624] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-10-17T21:13:06.264175] [DEBUG] [LOCAL ] RFL: Trimmed 13177 records to 11542 (keeping 200 days of data) [2025-10-17T21:13:06.327972] [DEBUG] [LOCAL ] RFL: Primary data saved (11542 records). [2025-10-17T21:13:06.328098] [INFO ] [MAIN ] RFL: Full history saved. [2025-10-17T21:13:06.328190] [INFO ] [MAIN ] Update Progress: 1790/2368 symbols completed. RFL took 24.2s. Estimated remaining: 1h 21m 42s. Rate: 7.1 symbols/min [2025-10-17T21:13:06.495230] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:13:06.495384] [DEBUG] [LOCAL ] RGA: No existing data file found in primary storage. [2025-10-17T21:13:06.495422] [WARN ] [MAIN ] RGA: No existing data found, performing full refresh instead. [2025-10-17T21:13:06.495542] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-17T21:13:06.495584] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-17T21:13:06.495626] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-17T21:13:06.495700] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-17T21:13:06.849499] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:13:06.942261] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-17T21:13:07.066268] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-17T21:13:07.610866] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-17T21:13:07.612001] [INFO ] [REMOTE ] RFM: Full fetch complete (5769 records). [2025-10-17T21:13:07.612069] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-17T21:13:07.748169] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-10-17T21:13:07.970107] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-10-17T21:13:07.970181] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-10-17T21:13:07.970340] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-10-17T21:13:07.970379] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-10-17T21:13:07.970773] [DEBUG] [LOCAL ] RFM: Trimmed 5769 records to 4229 (keeping 200 days of data) [2025-10-17T21:13:07.995434] [DEBUG] [LOCAL ] RFM: Primary data saved (4229 records). [2025-10-17T21:13:07.995511] [INFO ] [MAIN ] RFM: Full history saved. [2025-10-17T21:13:07.995585] [INFO ] [MAIN ] Update Progress: 1791/2368 symbols completed. RFM took 19.4s. Estimated remaining: 1h 21m 32s. Rate: 7.1 symbols/min [2025-10-17T21:13:08.182171] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:13:08.182341] [DEBUG] [LOCAL ] RGR: No existing data file found in primary storage. [2025-10-17T21:13:08.182377] [WARN ] [MAIN ] RGR: No existing data found, performing full refresh instead. [2025-10-17T21:13:08.182494] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-17T21:13:08.182535] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-17T21:13:08.182574] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-17T21:13:08.182608] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-17T21:13:08.528791] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:13:08.542251] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-10-17T21:13:09.319968] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T21:13:09.342240] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-17T21:13:09.804765] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T21:13:10.142334] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-17T21:13:10.800873] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T21:13:10.816168] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T21:13:10.942453] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-17T21:13:11.742296] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-17T21:13:11.837629] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-17T21:13:12.542348] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-17T21:13:12.962242] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T21:13:13.342276] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-17T21:13:13.429397] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-17T21:13:14.142295] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-17T21:13:14.938122] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T21:13:14.945675] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-17T21:13:15.043512] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-17T21:13:15.742268] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-17T21:13:15.862474] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T21:13:16.542265] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-17T21:13:16.847248] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T21:13:17.342305] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-17T21:13:17.430425] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T21:13:18.142314] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-17T21:13:18.456303] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T21:13:18.942266] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-17T21:13:19.135476] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T21:13:19.742295] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-17T21:13:20.436046] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T21:13:20.449140] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T21:13:20.450941] [INFO ] [REMOTE ] RFI: Full fetch complete (15259 records). [2025-10-17T21:13:20.451015] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-17T21:13:20.547498] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-17T21:13:20.828711] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-17T21:13:20.828833] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-17T21:13:20.829156] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-17T21:13:20.829198] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-17T21:13:20.829698] [DEBUG] [LOCAL ] RFI: Trimmed 15259 records to 10522 (keeping 200 days of data) [2025-10-17T21:13:20.891037] [DEBUG] [LOCAL ] RFI: Primary data saved (10522 records). [2025-10-17T21:13:20.891150] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-17T21:13:20.891230] [INFO ] [MAIN ] Update Progress: 1792/2368 symbols completed. RFI took 49.1s. Estimated remaining: 1h 21m 25s. Rate: 7.1 symbols/min [2025-10-17T21:13:21.054328] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:13:21.059329] [DEBUG] [LOCAL ] RGT: Loaded 2778 existing records from primary storage. [2025-10-17T21:13:21.059476] [INFO ] [MAIN ] RGT: Loaded 2778 existing records. [2025-10-17T21:13:21.233086] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:13:21.233349] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-17T21:13:21.233481] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-17T21:13:21.233638] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-10-17T21:13:21.233718] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-17T21:13:21.347448] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-17T21:13:21.481241] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T21:13:21.591357] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:13:22.142295] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-17T21:13:22.615098] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T21:13:22.942321] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-10-17T21:13:22.968212] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-17T21:13:23.535181] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-17T21:13:23.742321] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-17T21:13:24.542403] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-17T21:13:24.915604] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T21:13:25.342367] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-17T21:13:25.434314] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T21:13:26.142330] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-17T21:13:26.521826] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T21:13:26.942389] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-17T21:13:27.176460] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-17T21:13:27.485557] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-17T21:13:27.487382] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12281 records). [2025-10-17T21:13:27.487458] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-17T21:13:27.747818] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-17T21:13:27.845058] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-10-17T21:13:27.845136] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-10-17T21:13:27.845412] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-10-17T21:13:27.845452] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-10-17T21:13:27.845942] [DEBUG] [LOCAL ] RFMZ: Trimmed 12281 records to 8929 (keeping 200 days of data) [2025-10-17T21:13:27.901247] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8929 records). [2025-10-17T21:13:27.901393] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-10-17T21:13:27.901477] [INFO ] [MAIN ] Update Progress: 1793/2368 symbols completed. RFMZ took 31.3s. Estimated remaining: 1h 21m 16s. Rate: 7.1 symbols/min [2025-10-17T21:13:28.064462] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:13:28.064636] [DEBUG] [LOCAL ] RH: No existing data file found in primary storage. [2025-10-17T21:13:28.064713] [WARN ] [MAIN ] RH: No existing data found, performing full refresh instead. [2025-10-17T21:13:28.064830] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-17T21:13:28.064872] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-17T21:13:28.064912] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-17T21:13:28.064944] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-17T21:13:28.412156] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:13:28.416207] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-17T21:13:28.542290] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-10-17T21:13:29.342293] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-17T21:13:29.976047] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T21:13:30.107898] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T21:13:30.142254] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-17T21:13:30.942316] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-17T21:13:31.604589] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-17T21:13:31.752682] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-17T21:13:31.754114] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T21:13:32.542312] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-17T21:13:32.989819] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-17T21:13:33.342325] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-17T21:13:34.142267] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-17T21:13:34.233164] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T21:13:34.549168] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-17T21:13:34.942286] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-17T21:13:34.998974] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-17T21:13:35.742335] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-17T21:13:36.322420] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-17T21:13:36.542306] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-17T21:13:36.658932] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T21:13:37.342314] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-17T21:13:37.374376] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T21:13:38.142339] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-17T21:13:38.632234] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T21:13:38.942252] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-17T21:13:39.298011] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T21:13:39.588625] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-17T21:13:39.742270] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-17T21:13:40.542314] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-17T21:13:40.871986] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T21:13:41.161316] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-17T21:13:41.342315] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-17T21:13:42.142296] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-17T21:13:42.488667] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T21:13:42.491861] [INFO ] [REMOTE ] RGR: Full fetch complete (28864 records). [2025-10-17T21:13:42.491938] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-17T21:13:42.846878] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-10-17T21:13:42.846951] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-10-17T21:13:42.847523] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-10-17T21:13:42.847560] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-10-17T21:13:42.848314] [DEBUG] [LOCAL ] RGR: Trimmed 28864 records to 21263 (keeping 200 days of data) [2025-10-17T21:13:42.942332] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-17T21:13:42.975742] [DEBUG] [LOCAL ] RGR: Primary data saved (21263 records). [2025-10-17T21:13:42.975843] [INFO ] [MAIN ] RGR: Full history saved. [2025-10-17T21:13:42.975909] [INFO ] [MAIN ] Update Progress: 1794/2368 symbols completed. RGR took 35.0s. Estimated remaining: 1h 21m 9s. Rate: 7.1 symbols/min [2025-10-17T21:13:43.147050] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:13:43.147185] [DEBUG] [LOCAL ] RHI: No existing data file found in primary storage. [2025-10-17T21:13:43.147239] [WARN ] [MAIN ] RHI: No existing data found, performing full refresh instead. [2025-10-17T21:13:43.147361] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-17T21:13:43.147412] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-17T21:13:43.147456] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-17T21:13:43.147487] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-17T21:13:43.488158] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:13:43.742305] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-10-17T21:13:44.344924] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-17T21:13:44.408495] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T21:13:44.542248] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-17T21:13:45.341227] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T21:13:45.350103] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-17T21:13:46.142257] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-17T21:13:46.529830] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T21:13:46.922967] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T21:13:46.942243] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-17T21:13:47.441665] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-17T21:13:47.571474] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T21:13:47.742308] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-17T21:13:48.542355] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-17T21:13:49.342298] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-17T21:13:49.723610] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-17T21:13:49.876242] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-17T21:13:50.055842] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T21:13:50.142254] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-17T21:13:50.942309] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-17T21:13:51.742316] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-17T21:13:52.045919] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T21:13:52.316701] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T21:13:52.320924] [INFO ] [REMOTE ] RGA: Full fetch complete (45205 records). [2025-10-17T21:13:52.321005] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-17T21:13:52.552396] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-17T21:13:52.697082] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-10-17T21:13:52.697189] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-10-17T21:13:52.698185] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-10-17T21:13:52.698248] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-10-17T21:13:52.699265] [DEBUG] [LOCAL ] RGA: Trimmed 45205 records to 29820 (keeping 200 days of data) [2025-10-17T21:13:52.877287] [DEBUG] [LOCAL ] RGA: Primary data saved (29820 records). [2025-10-17T21:13:52.877418] [INFO ] [MAIN ] RGA: Full history saved. [2025-10-17T21:13:52.877490] [INFO ] [MAIN ] Update Progress: 1795/2368 symbols completed. RGA took 46.5s. Estimated remaining: 1h 21m 1s. Rate: 7.1 symbols/min [2025-10-17T21:13:53.042322] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:13:53.042488] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-17T21:13:53.042525] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-17T21:13:53.042636] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-17T21:13:53.042722] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-17T21:13:53.042770] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-17T21:13:53.042822] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-17T21:13:53.143715] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T21:13:53.150436] [INFO ] [REMOTE ] RGT: Full fetch complete (3956 records). [2025-10-17T21:13:53.166172] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-17T21:13:53.346717] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-17T21:13:53.657746] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:13:53.803315] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-17T21:13:53.803503] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-17T21:13:53.803792] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-17T21:13:53.803857] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-17T21:13:53.804207] [DEBUG] [LOCAL ] RGT: Trimmed 3956 records to 2793 (keeping 200 days of data) [2025-10-17T21:13:53.848622] [DEBUG] [LOCAL ] RGT: Primary data saved (2793 records). [2025-10-17T21:13:53.849317] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-17T21:13:53.850327] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-17T21:13:53.859958] [INFO ] [MAIN ] Update Progress: 1796/2368 symbols completed. RGT took 33.0s. Estimated remaining: 1h 20m 51s. Rate: 7.1 symbols/min [2025-10-17T21:13:54.028658] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:13:54.028866] [DEBUG] [LOCAL ] RHP: No existing data file found in primary storage. [2025-10-17T21:13:54.028928] [WARN ] [MAIN ] RHP: No existing data found, performing full refresh instead. [2025-10-17T21:13:54.029084] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-17T21:13:54.029138] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-17T21:13:54.029182] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-17T21:13:54.029214] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-17T21:13:54.147466] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-17T21:13:54.375049] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:13:54.942316] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-10-17T21:13:55.277492] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T21:13:55.742252] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-17T21:13:56.168054] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-17T21:13:56.254708] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T21:13:56.542273] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-17T21:13:57.342320] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-17T21:13:57.467482] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T21:13:58.052225] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T21:13:58.142256] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-17T21:13:58.942361] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-10-17T21:13:59.276730] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:13:59.277018] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-10-17T21:13:59.277140] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:13:59.277235] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-17T21:13:59.277320] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:13:59.277431] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-17T21:13:59.277518] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-17T21:13:59.277572] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-17T21:13:59.277682] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-17T21:13:59.277769] [INFO ] [MAIN ] Update Progress: 1797/2368 symbols completed. RHLD took 6.4s. Estimated remaining: 1h 20m 41s. Rate: 7.1 symbols/min [2025-10-17T21:13:59.541878] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-17T21:13:59.571288] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T21:13:59.742254] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-17T21:14:00.542360] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-17T21:14:01.343729] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-17T21:14:01.347603] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T21:14:01.357968] [INFO ] [REMOTE ] RH: Full fetch complete (66102 records). [2025-10-17T21:14:01.358156] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-17T21:14:01.774568] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-10-17T21:14:01.774739] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-10-17T21:14:01.776538] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-10-17T21:14:01.776615] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-10-17T21:14:01.778826] [DEBUG] [LOCAL ] RH: Trimmed 66102 records to 47994 (keeping 200 days of data) [2025-10-17T21:14:02.115068] [DEBUG] [LOCAL ] RH: Primary data saved (47994 records). [2025-10-17T21:14:02.124118] [INFO ] [MAIN ] RH: Full history saved. [2025-10-17T21:14:02.124271] [INFO ] [MAIN ] Update Progress: 1798/2368 symbols completed. RH took 34.2s. Estimated remaining: 1h 20m 31s. Rate: 7.1 symbols/min [2025-10-17T21:14:02.128783] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T21:14:02.142240] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-17T21:14:03.118775] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T21:14:03.134373] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-17T21:14:03.899926] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T21:14:03.910350] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-17T21:14:05.016029] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T21:14:05.027459] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-17T21:14:05.615335] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T21:14:05.625693] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-17T21:14:06.898629] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T21:14:06.909363] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-17T21:14:07.191066] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T21:14:07.200108] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-17T21:14:08.608365] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T21:14:08.619723] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-17T21:14:08.798273] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T21:14:08.806734] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-17T21:14:10.352988] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T21:14:10.359849] [INFO ] [REMOTE ] RHI: Full fetch complete (70663 records). [2025-10-17T21:14:10.360000] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-17T21:14:10.571983] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T21:14:10.696579] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-17T21:14:10.804864] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-10-17T21:14:10.804957] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-10-17T21:14:10.806092] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-10-17T21:14:10.806156] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-10-17T21:14:10.807603] [DEBUG] [LOCAL ] RHI: Trimmed 70663 records to 50243 (keeping 200 days of data) [2025-10-17T21:14:11.160876] [DEBUG] [LOCAL ] RHI: Primary data saved (50243 records). [2025-10-17T21:14:11.161047] [INFO ] [MAIN ] RHI: Full history saved. [2025-10-17T21:14:11.161187] [INFO ] [MAIN ] Update Progress: 1799/2368 symbols completed. RHI took 28.2s. Estimated remaining: 1h 20m 23s. Rate: 7.1 symbols/min [2025-10-17T21:14:12.375139] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T21:14:12.384061] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-17T21:14:13.877433] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T21:14:13.883489] [INFO ] [REMOTE ] RHP: Full fetch complete (58402 records). [2025-10-17T21:14:13.883682] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-17T21:14:14.278908] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-10-17T21:14:14.279002] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-10-17T21:14:14.280154] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-10-17T21:14:14.280224] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-10-17T21:14:14.281522] [DEBUG] [LOCAL ] RHP: Trimmed 58402 records to 41203 (keeping 200 days of data) [2025-10-17T21:14:14.544925] [DEBUG] [LOCAL ] RHP: Primary data saved (41203 records). [2025-10-17T21:14:14.545074] [INFO ] [MAIN ] RHP: Full history saved. [2025-10-17T21:14:14.545163] [INFO ] [MAIN ] Update Progress: 1800/2368 symbols completed. RHP took 20.7s. Estimated remaining: 1h 20m 12s. Rate: 7.1 symbols/min [2025-10-17T21:14:15.187007] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:14:15.195827] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:14:15.231587] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:14:15.231779] [DEBUG] [LOCAL ] RIO: No existing data file found in primary storage. [2025-10-17T21:14:15.231886] [WARN ] [MAIN ] RIO: No existing data found, performing full refresh instead. [2025-10-17T21:14:15.251828] [DEBUG] [LOCAL ] RITM: No existing data file found in primary storage. [2025-10-17T21:14:15.274051] [WARN ] [MAIN ] RITM: No existing data found, performing full refresh instead. [2025-10-17T21:14:15.277591] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:14:15.276834] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-17T21:14:15.277837] [DEBUG] [LOCAL ] RIV: No existing data file found in primary storage. [2025-10-17T21:14:15.277921] [WARN ] [MAIN ] RIV: No existing data found, performing full refresh instead. [2025-10-17T21:14:15.278178] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-17T21:14:15.278240] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-17T21:14:15.278298] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-17T21:14:15.278385] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-17T21:14:15.278548] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-17T21:14:15.278615] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-17T21:14:15.278764] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-17T21:14:15.278807] [DEBUG] [LOCAL ] RIV: No primary data file found to delete. [2025-10-17T21:14:15.284145] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-17T21:14:15.284337] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-17T21:14:15.290067] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-17T21:14:16.099996] [DEBUG] [LOCAL ] RIG: Loaded 54065 existing records from primary storage. [2025-10-17T21:14:16.134449] [INFO ] [MAIN ] RIG: Loaded 54065 existing records. [2025-10-17T21:14:16.563763] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:14:16.564160] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-10-17T21:14:16.532158] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:14:16.609416] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-10-17T21:14:16.596515] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:14:16.621238] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-10-17T21:14:16.691521] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:14:16.692369] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-17T21:14:16.692458] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-17T21:14:16.692818] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-10-17T21:14:16.692880] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-17T21:14:17.036183] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:14:17.036499] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-10-17T21:14:17.656746] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T21:14:17.660088] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-17T21:14:18.588873] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-17T21:14:18.592192] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-17T21:14:18.764223] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-17T21:14:18.776103] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-17T21:14:18.858524] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T21:14:18.870144] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-17T21:14:18.918392] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-17T21:14:18.929393] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-17T21:14:19.475913] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T21:14:19.478403] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-17T21:14:20.342939] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T21:14:20.345795] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-17T21:14:20.666275] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T21:14:20.676818] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-17T21:14:20.840351] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-17T21:14:20.853090] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-17T21:14:20.930578] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-17T21:14:20.949834] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-17T21:14:21.342361] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-17T21:14:22.142320] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-17T21:14:22.186707] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T21:14:22.580487] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-17T21:14:22.766388] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-17T21:14:22.942310] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-17T21:14:23.742348] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-17T21:14:23.972329] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-17T21:14:24.542333] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-17T21:14:24.699999] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T21:14:24.741449] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T21:14:25.342317] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-17T21:14:26.142334] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-17T21:14:26.825877] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-17T21:14:26.935630] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T21:14:26.946162] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-17T21:14:27.185013] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T21:14:27.742319] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-17T21:14:28.542294] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-17T21:14:29.133602] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-17T21:14:29.342404] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-17T21:14:29.981762] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-17T21:14:30.142278] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-17T21:14:30.352238] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T21:14:30.942317] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-17T21:14:31.072702] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T21:14:31.742309] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-17T21:14:32.434840] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-17T21:14:32.542278] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-17T21:14:33.088948] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-17T21:14:33.342314] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-17T21:14:33.727781] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-17T21:14:34.142281] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-17T21:14:34.661299] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-17T21:14:34.923755] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T21:14:34.942246] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-17T21:14:35.742251] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-17T21:14:36.258360] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-17T21:14:36.542343] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-17T21:14:37.109063] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-17T21:14:37.342296] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-17T21:14:37.460085] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T21:14:37.877331] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-17T21:14:38.142277] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-17T21:14:38.942318] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-17T21:14:39.287948] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-17T21:14:39.341200] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-17T21:14:39.742302] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-17T21:14:40.542299] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-17T21:14:41.089693] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-17T21:14:41.342311] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-17T21:14:41.921628] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-17T21:14:42.142295] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-17T21:14:42.595209] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-17T21:14:42.753147] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T21:14:42.755611] [INFO ] [REMOTE ] RIV: Full fetch complete (17701 records). [2025-10-17T21:14:42.755719] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-17T21:14:42.947827] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-17T21:14:43.115933] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-10-17T21:14:43.116005] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-10-17T21:14:43.116376] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-10-17T21:14:43.116414] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-10-17T21:14:43.116952] [DEBUG] [LOCAL ] RIV: Trimmed 17701 records to 12779 (keeping 200 days of data) [2025-10-17T21:14:43.193619] [DEBUG] [LOCAL ] RIV: Primary data saved (12779 records). [2025-10-17T21:14:43.193766] [INFO ] [MAIN ] RIV: Full history saved. [2025-10-17T21:14:43.193841] [INFO ] [MAIN ] Update Progress: 1801/2368 symbols completed. RIV took 28.6s. Estimated remaining: 1h 20m 10s. Rate: 7.1 symbols/min [2025-10-17T21:14:43.362415] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:14:43.362585] [DEBUG] [LOCAL ] RJF: No existing data file found in primary storage. [2025-10-17T21:14:43.362622] [WARN ] [MAIN ] RJF: No existing data found, performing full refresh instead. [2025-10-17T21:14:43.362752] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-17T21:14:43.362794] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-17T21:14:43.362834] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-17T21:14:43.362864] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-17T21:14:43.720876] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:14:43.748190] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-17T21:14:43.753838] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-17T21:14:44.542296] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-17T21:14:45.047359] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-17T21:14:45.054778] [INFO ] [REMOTE ] RITM: Full fetch complete (76752 records). [2025-10-17T21:14:45.054900] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-17T21:14:45.351729] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-10-17T21:14:45.476833] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-10-17T21:14:45.476933] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-10-17T21:14:45.478179] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-10-17T21:14:45.478252] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-10-17T21:14:45.479813] [DEBUG] [LOCAL ] RITM: Trimmed 76752 records to 53721 (keeping 200 days of data) [2025-10-17T21:14:45.750211] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-17T21:14:45.847078] [DEBUG] [LOCAL ] RITM: Primary data saved (53721 records). [2025-10-17T21:14:45.847223] [INFO ] [MAIN ] RITM: Full history saved. [2025-10-17T21:14:45.847300] [INFO ] [MAIN ] Update Progress: 1802/2368 symbols completed. RITM took 31.3s. Estimated remaining: 1h 19m 60s. Rate: 7.1 symbols/min [2025-10-17T21:14:46.011342] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:14:46.011497] [DEBUG] [LOCAL ] RKT: No existing data file found in primary storage. [2025-10-17T21:14:46.011534] [WARN ] [MAIN ] RKT: No existing data found, performing full refresh instead. [2025-10-17T21:14:46.011667] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-17T21:14:46.011724] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-17T21:14:46.011768] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-17T21:14:46.011801] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-17T21:14:46.147488] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-17T21:14:46.358808] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:14:46.767821] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-17T21:14:46.775878] [INFO ] [REMOTE ] RIO: Full fetch complete (77512 records). [2025-10-17T21:14:46.776055] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-17T21:14:46.949407] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-10-17T21:14:47.091430] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T21:14:47.204330] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-10-17T21:14:47.204407] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-10-17T21:14:47.205673] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-10-17T21:14:47.205738] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-10-17T21:14:47.207171] [DEBUG] [LOCAL ] RIO: Trimmed 77512 records to 54181 (keeping 200 days of data) [2025-10-17T21:14:47.531133] [DEBUG] [LOCAL ] RIO: Primary data saved (54181 records). [2025-10-17T21:14:47.531274] [INFO ] [MAIN ] RIO: Full history saved. [2025-10-17T21:14:47.531348] [INFO ] [MAIN ] Update Progress: 1803/2368 symbols completed. RIO took 33.0s. Estimated remaining: 1h 19m 49s. Rate: 7.1 symbols/min [2025-10-17T21:14:47.697016] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:14:47.697180] [DEBUG] [LOCAL ] RL: No existing data file found in primary storage. [2025-10-17T21:14:47.697216] [WARN ] [MAIN ] RL: No existing data found, performing full refresh instead. [2025-10-17T21:14:47.697331] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-17T21:14:47.697371] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-17T21:14:47.697412] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-17T21:14:47.697443] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-17T21:14:47.759544] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-17T21:14:48.053268] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:14:48.292226] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-17T21:14:48.301772] [INFO ] [REMOTE ] RIG: Full fetch complete (77846 records). [2025-10-17T21:14:48.302013] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-17T21:14:48.549822] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-10-17T21:14:48.721041] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-10-17T21:14:48.721162] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-10-17T21:14:48.723196] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-10-17T21:14:48.723304] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-10-17T21:14:48.725458] [DEBUG] [LOCAL ] RIG: Trimmed 77846 records to 54455 (keeping 200 days of data) [2025-10-17T21:14:49.096465] [DEBUG] [LOCAL ] RIG: Primary data saved (54455 records). [2025-10-17T21:14:49.096844] [INFO ] [MAIN ] RIG: Full history saved. [2025-10-17T21:14:49.096978] [INFO ] [MAIN ] Update Progress: 1804/2368 symbols completed. RIG took 34.6s. Estimated remaining: 1h 19m 39s. Rate: 7.1 symbols/min [2025-10-17T21:14:49.099178] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-17T21:14:49.284915] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:14:49.285264] [DEBUG] [LOCAL ] RLI: No existing data file found in primary storage. [2025-10-17T21:14:49.285309] [WARN ] [MAIN ] RLI: No existing data found, performing full refresh instead. [2025-10-17T21:14:49.285435] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-17T21:14:49.285477] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-17T21:14:49.285518] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-17T21:14:49.285551] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-17T21:14:49.357740] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-17T21:14:49.649600] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:14:49.679918] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-17T21:14:50.142300] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-17T21:14:50.354598] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T21:14:50.942312] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-17T21:14:51.285582] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-17T21:14:51.742304] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-17T21:14:51.870680] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T21:14:52.542362] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-10-17T21:14:52.695944] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T21:14:53.342283] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-17T21:14:53.511217] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-17T21:14:53.658705] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T21:14:54.142320] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-17T21:14:54.942305] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-17T21:14:55.046298] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T21:14:55.742370] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-17T21:14:56.257931] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-17T21:14:56.542320] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-17T21:14:56.869342] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T21:14:57.342299] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-17T21:14:57.555982] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T21:14:57.965028] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T21:14:58.142330] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-17T21:14:58.942343] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-17T21:14:59.290092] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T21:14:59.529179] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T21:14:59.742301] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-17T21:15:00.542298] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-17T21:15:01.166636] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-17T21:15:01.342268] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-17T21:15:01.377002] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T21:15:02.142386] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-17T21:15:02.749494] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-17T21:15:02.942331] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-17T21:15:03.546812] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-17T21:15:03.743571] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-17T21:15:03.749042] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T21:15:04.542270] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-17T21:15:04.732412] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-17T21:15:05.342322] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-17T21:15:05.647541] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T21:15:05.792417] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-17T21:15:06.142291] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-17T21:15:06.942258] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-17T21:15:07.297084] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T21:15:07.742345] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-17T21:15:08.384982] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T21:15:08.552102] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-17T21:15:08.584870] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-17T21:15:09.342282] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-17T21:15:09.414504] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T21:15:10.142264] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-17T21:15:10.223960] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T21:15:10.942278] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-17T21:15:11.374753] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-17T21:15:11.511093] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T21:15:11.742348] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-17T21:15:11.980204] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T21:15:12.542322] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-17T21:15:13.342280] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-17T21:15:13.773581] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T21:15:14.081308] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T21:15:14.142264] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-17T21:15:14.942348] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-17T21:15:15.306062] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T21:15:15.312364] [INFO ] [REMOTE ] RLI: Full fetch complete (48927 records). [2025-10-17T21:15:15.312481] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-17T21:15:15.712940] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-10-17T21:15:15.713037] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-10-17T21:15:15.714063] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-10-17T21:15:15.714149] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-10-17T21:15:15.715443] [DEBUG] [LOCAL ] RLI: Trimmed 48927 records to 35031 (keeping 200 days of data) [2025-10-17T21:15:15.778775] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-17T21:15:15.838633] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-17T21:15:15.978966] [DEBUG] [LOCAL ] RLI: Primary data saved (35031 records). [2025-10-17T21:15:15.979113] [INFO ] [MAIN ] RLI: Full history saved. [2025-10-17T21:15:15.979202] [INFO ] [MAIN ] Update Progress: 1805/2368 symbols completed. RLI took 26.9s. Estimated remaining: 1h 19m 36s. Rate: 7.1 symbols/min [2025-10-17T21:15:16.142345] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:15:16.142540] [DEBUG] [LOCAL ] RLJ: No existing data file found in primary storage. [2025-10-17T21:15:16.142579] [WARN ] [MAIN ] RLJ: No existing data found, performing full refresh instead. [2025-10-17T21:15:16.142724] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-17T21:15:16.142771] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-17T21:15:16.142812] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-17T21:15:16.142843] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-17T21:15:16.490474] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:15:16.542282] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-10-17T21:15:16.750101] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T21:15:17.342271] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-17T21:15:17.522278] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T21:15:18.142254] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-17T21:15:18.259991] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-17T21:15:18.942321] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-17T21:15:19.008334] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T21:15:19.014685] [INFO ] [REMOTE ] RJF: Full fetch complete (68660 records). [2025-10-17T21:15:19.014790] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-17T21:15:19.394437] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-10-17T21:15:19.394622] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-10-17T21:15:19.395819] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-10-17T21:15:19.395949] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-10-17T21:15:19.397392] [DEBUG] [LOCAL ] RJF: Trimmed 68660 records to 47356 (keeping 200 days of data) [2025-10-17T21:15:19.508055] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-17T21:15:19.718686] [DEBUG] [LOCAL ] RJF: Primary data saved (47356 records). [2025-10-17T21:15:19.718822] [INFO ] [MAIN ] RJF: Full history saved. [2025-10-17T21:15:19.718896] [INFO ] [MAIN ] Update Progress: 1806/2368 symbols completed. RJF took 36.5s. Estimated remaining: 1h 19m 26s. Rate: 7.1 symbols/min [2025-10-17T21:15:19.748195] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-17T21:15:19.887203] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:15:19.899950] [DEBUG] [LOCAL ] RLTY: Loaded 11237 existing records from primary storage. [2025-10-17T21:15:19.900148] [INFO ] [MAIN ] RLTY: Loaded 11237 existing records. [2025-10-17T21:15:20.070047] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:15:20.070236] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-17T21:15:20.070284] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-17T21:15:20.070460] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-10-17T21:15:20.070516] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-17T21:15:20.414939] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:15:20.542244] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-10-17T21:15:21.015219] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-17T21:15:21.023481] [INFO ] [REMOTE ] RKT: Full fetch complete (77581 records). [2025-10-17T21:15:21.023694] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-17T21:15:21.348240] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-17T21:15:21.427733] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-17T21:15:21.498214] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-10-17T21:15:21.498488] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-10-17T21:15:21.499856] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-10-17T21:15:21.499923] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-10-17T21:15:21.501463] [DEBUG] [LOCAL ] RKT: Trimmed 77581 records to 54509 (keeping 200 days of data) [2025-10-17T21:15:21.615818] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T21:15:21.872296] [DEBUG] [LOCAL ] RKT: Primary data saved (54509 records). [2025-10-17T21:15:21.872449] [INFO ] [MAIN ] RKT: Full history saved. [2025-10-17T21:15:21.872529] [INFO ] [MAIN ] Update Progress: 1807/2368 symbols completed. RKT took 36.0s. Estimated remaining: 1h 19m 16s. Rate: 7.1 symbols/min [2025-10-17T21:15:22.040272] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:15:22.083850] [DEBUG] [LOCAL ] RLX: Loaded 48456 existing records from primary storage. [2025-10-17T21:15:22.084229] [INFO ] [MAIN ] RLX: Loaded 48456 existing records. [2025-10-17T21:15:22.147524] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-17T21:15:22.260695] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:15:22.260935] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-17T21:15:22.260983] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-17T21:15:22.261210] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-10-17T21:15:22.261276] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-17T21:15:22.611832] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:15:22.942261] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-17T21:15:23.095808] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T21:15:23.742315] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-17T21:15:23.832580] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-17T21:15:23.928896] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T21:15:24.542341] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-17T21:15:25.342311] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-10-17T21:15:25.390716] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T21:15:26.142259] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-17T21:15:26.314128] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T21:15:26.942270] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-17T21:15:27.066873] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-17T21:15:27.379507] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T21:15:27.384368] [INFO ] [REMOTE ] RL: Full fetch complete (59533 records). [2025-10-17T21:15:27.384462] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-17T21:15:27.743937] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-17T21:15:27.759828] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-10-17T21:15:27.759910] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-10-17T21:15:27.760912] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-10-17T21:15:27.761080] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-10-17T21:15:27.762296] [DEBUG] [LOCAL ] RL: Trimmed 59533 records to 40561 (keeping 200 days of data) [2025-10-17T21:15:28.016269] [DEBUG] [LOCAL ] RL: Primary data saved (40561 records). [2025-10-17T21:15:28.016438] [INFO ] [MAIN ] RL: Full history saved. [2025-10-17T21:15:28.016526] [INFO ] [MAIN ] Update Progress: 1808/2368 symbols completed. RL took 40.5s. Estimated remaining: 1h 19m 6s. Rate: 7.1 symbols/min [2025-10-17T21:15:28.181219] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:15:28.191340] [DEBUG] [LOCAL ] RM: Loaded 7602 existing records from primary storage. [2025-10-17T21:15:28.191509] [INFO ] [MAIN ] RM: Loaded 7602 existing records. [2025-10-17T21:15:28.366247] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:15:28.366423] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-17T21:15:28.366468] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-17T21:15:28.366674] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-10-17T21:15:28.366732] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-17T21:15:28.548982] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-17T21:15:28.730706] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:15:28.766501] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T21:15:28.996237] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-17T21:15:29.342324] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-17T21:15:30.115204] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T21:15:30.142246] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-17T21:15:30.942301] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-17T21:15:31.202387] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T21:15:31.742349] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-17T21:15:31.780851] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T21:15:31.836087] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-17T21:15:32.542291] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-17T21:15:33.342323] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-17T21:15:33.449916] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T21:15:33.468220] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-17T21:15:34.142319] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-17T21:15:34.942283] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-10-17T21:15:35.051126] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T21:15:35.742327] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-17T21:15:35.762978] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-17T21:15:35.792400] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T21:15:36.542308] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-17T21:15:36.648830] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T21:15:37.342261] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-17T21:15:37.382749] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T21:15:38.142303] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-17T21:15:38.830049] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T21:15:38.942295] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-17T21:15:39.091589] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T21:15:39.742319] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-17T21:15:40.542276] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-17T21:15:40.603552] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-17T21:15:40.734108] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T21:15:41.342341] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-17T21:15:41.398447] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T21:15:42.142327] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-17T21:15:42.942336] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-17T21:15:43.034580] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T21:15:43.066482] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T21:15:43.742285] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-17T21:15:44.542340] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-17T21:15:44.748501] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T21:15:45.342358] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-17T21:15:45.373821] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T21:15:45.380828] [INFO ] [REMOTE ] RLJ: Full fetch complete (69381 records). [2025-10-17T21:15:45.380988] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-17T21:15:45.659976] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T21:15:45.788526] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-10-17T21:15:45.788620] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-10-17T21:15:45.789776] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-10-17T21:15:45.789841] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-10-17T21:15:45.791279] [DEBUG] [LOCAL ] RLJ: Trimmed 69381 records to 48741 (keeping 200 days of data) [2025-10-17T21:15:46.076908] [DEBUG] [LOCAL ] RLJ: Primary data saved (48741 records). [2025-10-17T21:15:46.077042] [INFO ] [MAIN ] RLJ: Full history saved. [2025-10-17T21:15:46.077138] [INFO ] [MAIN ] Update Progress: 1809/2368 symbols completed. RLJ took 30.1s. Estimated remaining: 1h 19m 1s. Rate: 7.1 symbols/min [2025-10-17T21:15:46.149549] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-17T21:15:46.245292] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:15:46.245466] [DEBUG] [LOCAL ] RMAX: No existing data file found in primary storage. [2025-10-17T21:15:46.245504] [WARN ] [MAIN ] RMAX: No existing data found, performing full refresh instead. [2025-10-17T21:15:46.245616] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-17T21:15:46.245691] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-17T21:15:46.245750] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-17T21:15:46.245784] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-17T21:15:46.586315] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:15:46.942351] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-17T21:15:47.110763] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T21:15:47.128348] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-17T21:15:47.742272] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-17T21:15:47.812230] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T21:15:47.814198] [INFO ] [REMOTE ] RLTY: Full fetch complete (17337 records). [2025-10-17T21:15:47.814274] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-17T21:15:48.181377] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-10-17T21:15:48.181451] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-10-17T21:15:48.181933] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-10-17T21:15:48.181997] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-10-17T21:15:48.182507] [DEBUG] [LOCAL ] RLTY: Trimmed 17337 records to 11297 (keeping 200 days of data) [2025-10-17T21:15:48.253266] [DEBUG] [LOCAL ] RLTY: Primary data saved (11297 records). [2025-10-17T21:15:48.253394] [INFO ] [MAIN ] RLTY: Full history saved. [2025-10-17T21:15:48.253473] [INFO ] [MAIN ] Update Progress: 1810/2368 symbols completed. RLTY took 28.5s. Estimated remaining: 1h 18m 50s. Rate: 7.1 symbols/min [2025-10-17T21:15:48.435518] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:15:48.435704] [DEBUG] [LOCAL ] RMD: No existing data file found in primary storage. [2025-10-17T21:15:48.435756] [WARN ] [MAIN ] RMD: No existing data found, performing full refresh instead. [2025-10-17T21:15:48.435870] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-17T21:15:48.435935] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-17T21:15:48.436200] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-17T21:15:48.436237] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-17T21:15:48.546970] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-10-17T21:15:48.741900] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T21:15:48.821660] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:15:49.342359] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-17T21:15:49.897068] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T21:15:50.142300] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-17T21:15:50.171724] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-17T21:15:50.942374] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-17T21:15:51.742356] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-10-17T21:15:51.990854] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T21:15:52.018433] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T21:15:52.542298] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-17T21:15:53.162793] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T21:15:53.342279] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-17T21:15:53.578972] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T21:15:54.142359] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-17T21:15:54.942340] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-17T21:15:55.013252] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T21:15:55.265224] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T21:15:55.455374] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-17T21:15:55.742309] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-17T21:15:56.542350] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-17T21:15:57.032424] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-17T21:15:57.342319] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-17T21:15:58.017254] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-17T21:15:58.110755] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T21:15:58.142245] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-17T21:15:58.942300] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-17T21:15:59.742264] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-17T21:15:59.763953] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-17T21:16:00.038257] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T21:16:00.542344] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-17T21:16:01.342289] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-17T21:16:01.543736] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-17T21:16:02.125144] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T21:16:02.142300] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-17T21:16:02.942326] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-17T21:16:03.737256] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-17T21:16:03.743801] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-17T21:16:03.754107] [INFO ] [REMOTE ] RLX: Full fetch complete (70229 records). [2025-10-17T21:16:03.769209] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-17T21:16:03.771523] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T21:16:04.201461] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-10-17T21:16:04.201680] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-10-17T21:16:04.203068] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-10-17T21:16:04.203139] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-10-17T21:16:04.204865] [DEBUG] [LOCAL ] RLX: Trimmed 70229 records to 48812 (keeping 200 days of data) [2025-10-17T21:16:04.313559] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-17T21:16:04.549727] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-17T21:16:04.584840] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T21:16:04.597800] [INFO ] [REMOTE ] RM: Full fetch complete (11521 records). [2025-10-17T21:16:04.601015] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-17T21:16:04.782874] [DEBUG] [LOCAL ] RLX: Primary data saved (48812 records). [2025-10-17T21:16:04.794179] [INFO ] [MAIN ] RLX: Full history saved. [2025-10-17T21:16:04.815951] [INFO ] [MAIN ] Update Progress: 1811/2368 symbols completed. RLX took 42.9s. Estimated remaining: 1h 18m 44s. Rate: 7.1 symbols/min [2025-10-17T21:16:05.300442] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:16:05.300718] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-10-17T21:16:05.300814] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-10-17T21:16:05.300920] [DEBUG] [LOCAL ] RMI: No existing data file found in primary storage. [2025-10-17T21:16:05.301311] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-10-17T21:16:05.301483] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-10-17T21:16:05.301412] [WARN ] [MAIN ] RMI: No existing data found, performing full refresh instead. [2025-10-17T21:16:05.301835] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-17T21:16:05.302273] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-17T21:16:05.302608] [DEBUG] [LOCAL ] RM: Trimmed 11521 records to 7642 (keeping 200 days of data) [2025-10-17T21:16:05.302705] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-17T21:16:05.302956] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-17T21:16:05.365788] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-17T21:16:05.576310] [DEBUG] [LOCAL ] RM: Primary data saved (7642 records). [2025-10-17T21:16:05.617812] [INFO ] [MAIN ] RM: Full history saved. [2025-10-17T21:16:05.634731] [INFO ] [MAIN ] Update Progress: 1812/2368 symbols completed. RM took 37.6s. Estimated remaining: 1h 18m 34s. Rate: 7.1 symbols/min [2025-10-17T21:16:05.849995] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:16:05.893434] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-17T21:16:05.928543] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:16:05.928968] [DEBUG] [LOCAL ] RMM: No existing data file found in primary storage. [2025-10-17T21:16:05.929014] [WARN ] [MAIN ] RMM: No existing data found, performing full refresh instead. [2025-10-17T21:16:05.929128] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-17T21:16:05.929168] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-17T21:16:05.929208] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-17T21:16:05.929239] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-17T21:16:06.147457] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-10-17T21:16:06.279262] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:16:06.886882] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-17T21:16:06.942347] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-17T21:16:07.295391] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T21:16:07.742290] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-10-17T21:16:07.794917] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-17T21:16:08.542253] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-17T21:16:08.703062] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-17T21:16:08.920558] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-17T21:16:09.342289] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-17T21:16:10.142268] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-17T21:16:10.168775] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T21:16:10.942302] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-17T21:16:11.483967] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-17T21:16:11.513296] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-17T21:16:11.742350] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-17T21:16:12.542353] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-17T21:16:12.555274] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T21:16:13.176670] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-17T21:16:13.342367] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-17T21:16:14.142348] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-17T21:16:14.162876] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-17T21:16:14.942348] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-17T21:16:15.742319] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-17T21:16:15.747879] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T21:16:16.068727] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-17T21:16:16.542271] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-17T21:16:16.629852] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-17T21:16:17.342311] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-17T21:16:17.701921] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T21:16:17.912178] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-17T21:16:18.142348] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-17T21:16:18.942342] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-17T21:16:19.696035] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T21:16:19.742292] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-17T21:16:20.051963] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T21:16:20.055363] [INFO ] [REMOTE ] RMAX: Full fetch complete (29925 records). [2025-10-17T21:16:20.055481] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-17T21:16:20.431435] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-10-17T21:16:20.431534] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-10-17T21:16:20.432231] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-10-17T21:16:20.432293] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-10-17T21:16:20.433143] [DEBUG] [LOCAL ] RMAX: Trimmed 29925 records to 21894 (keeping 200 days of data) [2025-10-17T21:16:20.544210] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-17T21:16:20.556016] [DEBUG] [LOCAL ] RMAX: Primary data saved (21894 records). [2025-10-17T21:16:20.556193] [INFO ] [MAIN ] RMAX: Full history saved. [2025-10-17T21:16:20.556291] [INFO ] [MAIN ] Update Progress: 1813/2368 symbols completed. RMAX took 34.5s. Estimated remaining: 1h 18m 27s. Rate: 7.1 symbols/min [2025-10-17T21:16:20.725510] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:16:20.733117] [DEBUG] [LOCAL ] RMMZ: Loaded 4814 existing records from primary storage. [2025-10-17T21:16:20.733299] [INFO ] [MAIN ] RMMZ: Loaded 4814 existing records. [2025-10-17T21:16:20.906475] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:16:20.906725] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-17T21:16:20.906802] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-17T21:16:20.907042] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-10-17T21:16:20.907109] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-17T21:16:21.260888] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:16:21.342283] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-10-17T21:16:21.452457] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-17T21:16:21.481095] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T21:16:22.142311] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-17T21:16:22.179099] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-17T21:16:22.922902] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T21:16:22.942277] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-17T21:16:23.742276] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-17T21:16:23.804030] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-17T21:16:24.498275] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-17T21:16:24.542268] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-17T21:16:25.041327] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-17T21:16:25.342294] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-17T21:16:25.967451] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-17T21:16:26.142289] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-17T21:16:26.784309] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-17T21:16:26.942303] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-17T21:16:27.742266] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-17T21:16:27.828990] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-17T21:16:28.414502] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-17T21:16:28.542313] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-17T21:16:29.342300] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-17T21:16:30.142286] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-17T21:16:30.190171] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T21:16:30.300308] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T21:16:30.942291] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-17T21:16:31.230458] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T21:16:31.604354] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-17T21:16:31.742303] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-17T21:16:32.500870] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T21:16:32.542270] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-17T21:16:33.194936] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-17T21:16:33.196000] [INFO ] [REMOTE ] RMI: Full fetch complete (6035 records). [2025-10-17T21:16:33.196090] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-17T21:16:33.346485] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-17T21:16:33.546405] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-10-17T21:16:33.546487] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-10-17T21:16:33.546677] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-10-17T21:16:33.546739] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-10-17T21:16:33.547103] [DEBUG] [LOCAL ] RMI: Trimmed 6035 records to 4804 (keeping 200 days of data) [2025-10-17T21:16:33.576394] [DEBUG] [LOCAL ] RMI: Primary data saved (4804 records). [2025-10-17T21:16:33.576496] [INFO ] [MAIN ] RMI: Full history saved. [2025-10-17T21:16:33.576589] [INFO ] [MAIN ] Update Progress: 1814/2368 symbols completed. RMI took 28.7s. Estimated remaining: 1h 18m 20s. Rate: 7.1 symbols/min [2025-10-17T21:16:33.745555] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:16:33.764943] [DEBUG] [LOCAL ] RMT: Loaded 17675 existing records from primary storage. [2025-10-17T21:16:33.765218] [INFO ] [MAIN ] RMT: Loaded 17675 existing records. [2025-10-17T21:16:33.938961] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:16:33.939179] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-17T21:16:33.939227] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-17T21:16:33.939405] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-10-17T21:16:33.939463] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-17T21:16:34.148042] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-17T21:16:34.284217] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:16:34.446934] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T21:16:34.942262] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-17T21:16:35.101350] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-17T21:16:35.647971] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-17T21:16:35.742281] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-17T21:16:36.441229] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-17T21:16:36.542280] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-17T21:16:37.293544] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T21:16:37.342286] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-17T21:16:38.084351] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-17T21:16:38.142532] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-17T21:16:38.942340] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-17T21:16:39.719896] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T21:16:39.721881] [INFO ] [REMOTE ] RMM: Full fetch complete (14836 records). [2025-10-17T21:16:39.721971] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-17T21:16:39.747533] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-17T21:16:39.825531] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T21:16:39.855484] [INFO ] [REMOTE ] RMD: Full fetch complete (61511 records). [2025-10-17T21:16:39.855726] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-17T21:16:40.466380] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-10-17T21:16:40.466267] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T21:16:40.467867] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-10-17T21:16:40.468807] [INFO ] [REMOTE ] RMMZ: Full fetch complete (6704 records). [2025-10-17T21:16:40.468707] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-10-17T21:16:40.479370] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-17T21:16:40.549167] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-10-17T21:16:40.554521] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-10-17T21:16:40.609583] [DEBUG] [LOCAL ] RMM: Trimmed 14836 records to 10866 (keeping 200 days of data) [2025-10-17T21:16:40.665450] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-10-17T21:16:40.676704] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-10-17T21:16:40.681342] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-10-17T21:16:40.687048] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-10-17T21:16:40.855778] [DEBUG] [LOCAL ] RMD: Trimmed 61511 records to 42676 (keeping 200 days of data) [2025-10-17T21:16:41.061446] [DEBUG] [LOCAL ] RMM: Primary data saved (10866 records). [2025-10-17T21:16:41.113488] [INFO ] [MAIN ] RMM: Full history saved. [2025-10-17T21:16:41.119509] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-10-17T21:16:41.120021] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-10-17T21:16:41.121615] [INFO ] [MAIN ] Update Progress: 1815/2368 symbols completed. RMM took 35.5s. Estimated remaining: 1h 18m 11s. Rate: 7.1 symbols/min [2025-10-17T21:16:41.121470] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-10-17T21:16:41.123053] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-10-17T21:16:41.162144] [DEBUG] [LOCAL ] RMMZ: Trimmed 6704 records to 4841 (keeping 200 days of data) [2025-10-17T21:16:41.352301] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:16:41.350788] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4841 records). [2025-10-17T21:16:41.356142] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-10-17T21:16:41.356374] [DEBUG] [LOCAL ] RNG: No existing data file found in primary storage. [2025-10-17T21:16:41.356286] [INFO ] [MAIN ] Update Progress: 1816/2368 symbols completed. RMMZ took 20.8s. Estimated remaining: 1h 18m 0s. Rate: 7.1 symbols/min [2025-10-17T21:16:41.356736] [WARN ] [MAIN ] RNG: No existing data found, performing full refresh instead. [2025-10-17T21:16:41.370978] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-17T21:16:41.378430] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-17T21:16:41.451677] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-17T21:16:41.478809] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-17T21:16:41.740814] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T21:16:41.751092] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-17T21:16:41.791277] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:16:41.830937] [DEBUG] [LOCAL ] RNGR: No existing data file found in primary storage. [2025-10-17T21:16:41.831063] [WARN ] [MAIN ] RNGR: No existing data found, performing full refresh instead. [2025-10-17T21:16:41.850726] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-17T21:16:41.866408] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-17T21:16:41.898068] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-17T21:16:41.918536] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-17T21:16:42.171204] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:16:42.188056] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-10-17T21:16:42.260594] [DEBUG] [LOCAL ] RMD: Primary data saved (42676 records). [2025-10-17T21:16:42.298783] [INFO ] [MAIN ] RMD: Full history saved. [2025-10-17T21:16:42.319575] [INFO ] [MAIN ] Update Progress: 1817/2368 symbols completed. RMD took 54.1s. Estimated remaining: 1h 17m 50s. Rate: 7.1 symbols/min [2025-10-17T21:16:42.586287] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:16:42.609584] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:16:42.628233] [DEBUG] [LOCAL ] RNP: Loaded 16282 existing records from primary storage. [2025-10-17T21:16:42.628492] [INFO ] [MAIN ] RNP: Loaded 16282 existing records. [2025-10-17T21:16:42.841042] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:16:42.841367] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-17T21:16:42.841423] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-17T21:16:42.841600] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-10-17T21:16:42.841696] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-17T21:16:42.947389] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-10-17T21:16:43.145461] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T21:16:43.211114] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:16:43.742319] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-10-17T21:16:43.955188] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T21:16:44.164599] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T21:16:44.542311] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-17T21:16:44.884104] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T21:16:45.342330] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-17T21:16:46.142330] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-17T21:16:46.181069] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T21:16:46.527818] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T21:16:46.942285] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-17T21:16:47.092856] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T21:16:47.742296] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-17T21:16:48.070742] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T21:16:48.542313] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-17T21:16:48.800969] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T21:16:49.337286] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T21:16:49.342232] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-17T21:16:50.142267] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-17T21:16:50.524154] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-17T21:16:50.942309] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-17T21:16:51.248806] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T21:16:51.742318] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-17T21:16:52.070924] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T21:16:52.542278] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-17T21:16:52.857275] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-17T21:16:53.342258] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-17T21:16:53.652335] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T21:16:54.142295] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-17T21:16:54.417386] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T21:16:54.942336] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-17T21:16:55.625569] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T21:16:55.742331] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-17T21:16:55.901478] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T21:16:56.542350] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-17T21:16:57.342357] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-17T21:16:57.639711] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T21:16:57.687951] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T21:16:58.142278] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-17T21:16:58.262411] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-17T21:16:58.942325] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-17T21:16:59.231150] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T21:16:59.742267] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-17T21:17:00.036064] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T21:17:00.542272] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-17T21:17:00.806074] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T21:17:01.342274] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-17T21:17:02.142319] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-17T21:17:02.395697] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T21:17:02.423040] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T21:17:02.942341] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-17T21:17:03.241793] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T21:17:03.742358] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-17T21:17:04.542283] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-17T21:17:04.644682] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T21:17:04.683980] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-17T21:17:05.342284] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-17T21:17:05.676064] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T21:17:06.142441] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-17T21:17:06.535709] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-17T21:17:06.942259] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-17T21:17:07.309954] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T21:17:07.742347] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-17T21:17:08.542357] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-17T21:17:08.664741] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T21:17:09.044364] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T21:17:09.047609] [INFO ] [REMOTE ] RNGR: Full fetch complete (28507 records). [2025-10-17T21:17:09.047754] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-17T21:17:09.342270] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-17T21:17:09.445780] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-10-17T21:17:09.445894] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-10-17T21:17:09.446532] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-10-17T21:17:09.446605] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-10-17T21:17:09.447856] [DEBUG] [LOCAL ] RNGR: Trimmed 28507 records to 21011 (keeping 200 days of data) [2025-10-17T21:17:09.573235] [DEBUG] [LOCAL ] RNGR: Primary data saved (21011 records). [2025-10-17T21:17:09.573368] [INFO ] [MAIN ] RNGR: Full history saved. [2025-10-17T21:17:09.573442] [INFO ] [MAIN ] Update Progress: 1818/2368 symbols completed. RNGR took 28.2s. Estimated remaining: 1h 17m 47s. Rate: 7.1 symbols/min [2025-10-17T21:17:09.733327] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-17T21:17:09.766420] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:17:09.771873] [DEBUG] [LOCAL ] RNR: No existing data file found in primary storage. [2025-10-17T21:17:09.772120] [WARN ] [MAIN ] RNR: No existing data found, performing full refresh instead. [2025-10-17T21:17:09.772272] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-17T21:17:09.772348] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-17T21:17:09.772916] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-17T21:17:09.773002] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-17T21:17:10.126761] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:17:10.142247] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-10-17T21:17:10.556396] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-17T21:17:10.942315] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-17T21:17:11.742269] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-17T21:17:11.819303] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T21:17:12.542376] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-17T21:17:12.735221] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T21:17:12.735811] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T21:17:12.754284] [INFO ] [REMOTE ] RNP: Full fetch complete (23627 records). [2025-10-17T21:17:12.754715] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-17T21:17:13.110889] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-17T21:17:13.110967] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-17T21:17:13.111322] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-17T21:17:13.111361] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-17T21:17:13.111990] [DEBUG] [LOCAL ] RNP: Trimmed 23627 records to 16390 (keeping 200 days of data) [2025-10-17T21:17:13.210477] [DEBUG] [LOCAL ] RNP: Primary data saved (16390 records). [2025-10-17T21:17:13.210618] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-17T21:17:13.210733] [INFO ] [MAIN ] Update Progress: 1819/2368 symbols completed. RNP took 30.9s. Estimated remaining: 1h 17m 37s. Rate: 7.1 symbols/min [2025-10-17T21:17:13.347467] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-17T21:17:13.379493] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:17:13.379969] [DEBUG] [LOCAL ] RNST: No existing data file found in primary storage. [2025-10-17T21:17:13.380126] [WARN ] [MAIN ] RNST: No existing data found, performing full refresh instead. [2025-10-17T21:17:13.380245] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-17T21:17:13.380288] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-17T21:17:13.380329] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-17T21:17:13.380360] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-17T21:17:13.536137] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T21:17:13.763227] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:17:14.142344] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-17T21:17:14.942276] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-17T21:17:15.147882] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T21:17:15.655102] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T21:17:15.742253] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-17T21:17:15.947840] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T21:17:15.950993] [INFO ] [REMOTE ] RMT: Full fetch complete (25575 records). [2025-10-17T21:17:15.951063] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-17T21:17:16.304265] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-17T21:17:16.304337] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-17T21:17:16.304861] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-17T21:17:16.304923] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-17T21:17:16.305522] [DEBUG] [LOCAL ] RMT: Trimmed 25575 records to 17753 (keeping 200 days of data) [2025-10-17T21:17:16.411538] [DEBUG] [LOCAL ] RMT: Primary data saved (17753 records). [2025-10-17T21:17:16.411829] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-17T21:17:16.411944] [INFO ] [MAIN ] Update Progress: 1820/2368 symbols completed. RMT took 42.8s. Estimated remaining: 1h 17m 27s. Rate: 7.1 symbols/min [2025-10-17T21:17:16.548040] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-17T21:17:16.580381] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:17:16.580608] [DEBUG] [LOCAL ] ROG: No existing data file found in primary storage. [2025-10-17T21:17:16.580684] [WARN ] [MAIN ] ROG: No existing data found, performing full refresh instead. [2025-10-17T21:17:16.580823] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-17T21:17:16.580864] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-17T21:17:16.580906] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-17T21:17:16.580937] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-17T21:17:16.927311] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:17:17.342305] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-10-17T21:17:17.485613] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T21:17:18.142318] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-17T21:17:18.214542] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T21:17:18.352556] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T21:17:18.942351] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-17T21:17:19.742336] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-17T21:17:19.762110] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T21:17:19.769603] [INFO ] [REMOTE ] RNG: Full fetch complete (69820 records). [2025-10-17T21:17:19.769762] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-17T21:17:20.168831] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-10-17T21:17:20.168906] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-10-17T21:17:20.169969] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-10-17T21:17:20.170031] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-10-17T21:17:20.171286] [DEBUG] [LOCAL ] RNG: Trimmed 69820 records to 48827 (keeping 200 days of data) [2025-10-17T21:17:20.452830] [DEBUG] [LOCAL ] RNG: Primary data saved (48827 records). [2025-10-17T21:17:20.452951] [INFO ] [MAIN ] RNG: Full history saved. [2025-10-17T21:17:20.453019] [INFO ] [MAIN ] Update Progress: 1821/2368 symbols completed. RNG took 39.3s. Estimated remaining: 1h 17m 17s. Rate: 7.1 symbols/min [2025-10-17T21:17:20.547491] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-10-17T21:17:20.632273] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:17:20.632694] [DEBUG] [LOCAL ] ROK: No existing data file found in primary storage. [2025-10-17T21:17:20.632810] [WARN ] [MAIN ] ROK: No existing data found, performing full refresh instead. [2025-10-17T21:17:20.633051] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-17T21:17:20.633119] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-17T21:17:20.652725] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-17T21:17:20.652866] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-17T21:17:20.659415] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T21:17:20.894277] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T21:17:21.039320] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:17:21.342315] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-17T21:17:21.793371] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T21:17:22.142315] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-17T21:17:22.465566] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T21:17:22.942309] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-10-17T21:17:23.710934] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T21:17:23.742306] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-17T21:17:24.542330] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-17T21:17:24.662139] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-17T21:17:24.948876] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T21:17:25.342284] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-17T21:17:26.111877] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T21:17:26.142260] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-17T21:17:26.785452] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-17T21:17:26.942278] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-17T21:17:27.742327] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-17T21:17:27.981500] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-17T21:17:28.485847] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T21:17:28.542248] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-17T21:17:28.922459] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T21:17:29.342296] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-17T21:17:30.147382] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-17T21:17:30.161016] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T21:17:30.397402] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T21:17:30.942320] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-17T21:17:31.252102] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T21:17:31.742327] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-17T21:17:32.542354] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-17T21:17:32.622518] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T21:17:32.838837] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T21:17:33.342314] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-17T21:17:34.096312] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-17T21:17:34.142342] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-17T21:17:34.942271] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-17T21:17:35.195354] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T21:17:35.742265] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-17T21:17:35.799698] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T21:17:35.902166] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T21:17:36.542294] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-17T21:17:37.342317] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-17T21:17:37.577802] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T21:17:37.624373] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T21:17:38.142352] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-17T21:17:38.942310] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-17T21:17:39.250400] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T21:17:39.742281] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-17T21:17:39.869174] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T21:17:40.542277] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-17T21:17:40.894364] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-17T21:17:41.213733] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T21:17:41.342287] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-17T21:17:41.953391] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T21:17:42.142311] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-17T21:17:42.809312] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T21:17:42.848576] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T21:17:42.851363] [INFO ] [REMOTE ] ROG: Full fetch complete (30778 records). [2025-10-17T21:17:42.851441] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-17T21:17:42.948761] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-17T21:17:43.226040] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-10-17T21:17:43.226116] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-10-17T21:17:43.226756] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-10-17T21:17:43.226816] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-10-17T21:17:43.227541] [DEBUG] [LOCAL ] ROG: Trimmed 30778 records to 22472 (keeping 200 days of data) [2025-10-17T21:17:43.358107] [DEBUG] [LOCAL ] ROG: Primary data saved (22472 records). [2025-10-17T21:17:43.358233] [INFO ] [MAIN ] ROG: Full history saved. [2025-10-17T21:17:43.358302] [INFO ] [MAIN ] Update Progress: 1822/2368 symbols completed. ROG took 26.9s. Estimated remaining: 1h 17m 13s. Rate: 7.1 symbols/min [2025-10-17T21:17:43.524876] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:17:43.525038] [DEBUG] [LOCAL ] ROL: No existing data file found in primary storage. [2025-10-17T21:17:43.525076] [WARN ] [MAIN ] ROL: No existing data found, performing full refresh instead. [2025-10-17T21:17:43.525190] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-17T21:17:43.525231] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-17T21:17:43.525274] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-17T21:17:43.525307] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-17T21:17:43.753073] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-17T21:17:43.876081] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:17:44.304591] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T21:17:44.311448] [INFO ] [REMOTE ] RNR: Full fetch complete (51142 records). [2025-10-17T21:17:44.311610] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-17T21:17:44.550504] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-10-17T21:17:44.703004] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-10-17T21:17:44.703082] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-10-17T21:17:44.704016] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-10-17T21:17:44.704077] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-10-17T21:17:44.705159] [DEBUG] [LOCAL ] RNR: Trimmed 51142 records to 34313 (keeping 200 days of data) [2025-10-17T21:17:44.917879] [DEBUG] [LOCAL ] RNR: Primary data saved (34313 records). [2025-10-17T21:17:44.918005] [INFO ] [MAIN ] RNR: Full history saved. [2025-10-17T21:17:44.918073] [INFO ] [MAIN ] Update Progress: 1823/2368 symbols completed. RNR took 35.3s. Estimated remaining: 1h 17m 2s. Rate: 7.1 symbols/min [2025-10-17T21:17:45.088986] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:17:45.089153] [DEBUG] [LOCAL ] RPM: No existing data file found in primary storage. [2025-10-17T21:17:45.089191] [WARN ] [MAIN ] RPM: No existing data found, performing full refresh instead. [2025-10-17T21:17:45.089308] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-17T21:17:45.089348] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-17T21:17:45.089388] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-17T21:17:45.089420] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-17T21:17:45.342951] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-17T21:17:45.443225] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:17:45.468860] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T21:17:46.142299] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-10-17T21:17:46.344330] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T21:17:46.942383] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-17T21:17:47.018146] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T21:17:47.660324] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T21:17:47.742249] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-17T21:17:48.475065] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T21:17:48.542286] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-17T21:17:49.342291] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-17T21:17:49.460015] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T21:17:49.965120] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T21:17:50.142321] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-17T21:17:50.793179] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T21:17:50.942300] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-17T21:17:51.742289] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-17T21:17:51.906250] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-17T21:17:52.542281] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-17T21:17:52.694329] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T21:17:53.165673] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T21:17:53.342319] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-17T21:17:54.142282] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-17T21:17:54.360137] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T21:17:54.830428] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T21:17:54.835992] [INFO ] [REMOTE ] ROK: Full fetch complete (62745 records). [2025-10-17T21:17:54.836105] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-17T21:17:54.947537] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-17T21:17:55.219326] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-10-17T21:17:55.219409] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-10-17T21:17:55.220483] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-10-17T21:17:55.220546] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-10-17T21:17:55.221809] [DEBUG] [LOCAL ] ROK: Trimmed 62745 records to 43878 (keeping 200 days of data) [2025-10-17T21:17:55.493024] [DEBUG] [LOCAL ] ROK: Primary data saved (43878 records). [2025-10-17T21:17:55.493167] [INFO ] [MAIN ] ROK: Full history saved. [2025-10-17T21:17:55.493243] [INFO ] [MAIN ] Update Progress: 1824/2368 symbols completed. ROK took 35.0s. Estimated remaining: 1h 16m 54s. Rate: 7.1 symbols/min [2025-10-17T21:17:55.665689] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:17:55.683704] [DEBUG] [LOCAL ] RPT: Loaded 19230 existing records from primary storage. [2025-10-17T21:17:55.683925] [INFO ] [MAIN ] RPT: Loaded 19230 existing records. [2025-10-17T21:17:55.747517] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-17T21:17:55.867216] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:17:55.867489] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-17T21:17:55.867716] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-17T21:17:55.867977] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-10-17T21:17:55.868131] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-17T21:17:56.011497] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-17T21:17:56.271735] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:17:56.512281] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T21:17:56.542311] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-17T21:17:56.705256] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T21:17:56.710156] [INFO ] [REMOTE ] RNST: Full fetch complete (52916 records). [2025-10-17T21:17:56.710298] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-17T21:17:57.092410] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-10-17T21:17:57.092497] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-10-17T21:17:57.093461] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-10-17T21:17:57.093525] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-10-17T21:17:57.094750] [DEBUG] [LOCAL ] RNST: Trimmed 52916 records to 36994 (keeping 200 days of data) [2025-10-17T21:17:57.325190] [DEBUG] [LOCAL ] RNST: Primary data saved (36994 records). [2025-10-17T21:17:57.325342] [INFO ] [MAIN ] RNST: Full history saved. [2025-10-17T21:17:57.325418] [INFO ] [MAIN ] Update Progress: 1825/2368 symbols completed. RNST took 44.1s. Estimated remaining: 1h 16m 44s. Rate: 7.1 symbols/min [2025-10-17T21:17:57.347497] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-17T21:17:57.501033] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:17:57.501211] [DEBUG] [LOCAL ] RQI: No existing data file found in primary storage. [2025-10-17T21:17:57.501297] [WARN ] [MAIN ] RQI: No existing data found, performing full refresh instead. [2025-10-17T21:17:57.501431] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-17T21:17:57.501472] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-17T21:17:57.501514] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-17T21:17:57.501545] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-17T21:17:57.856050] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:17:58.142340] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-10-17T21:17:58.327321] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-17T21:17:58.942386] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-17T21:17:59.231498] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T21:17:59.663062] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T21:17:59.742329] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-17T21:18:00.223589] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-17T21:18:00.542362] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-17T21:18:01.298176] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T21:18:01.342317] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-17T21:18:02.142345] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-17T21:18:02.623006] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-17T21:18:02.766160] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T21:18:02.942312] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-17T21:18:03.714479] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T21:18:03.742263] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-17T21:18:04.542320] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-10-17T21:18:04.739462] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T21:18:05.342311] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-17T21:18:05.590177] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T21:18:05.726038] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T21:18:06.142282] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-17T21:18:06.942266] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-17T21:18:07.235136] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T21:18:07.585447] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-17T21:18:07.742287] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-17T21:18:08.322799] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T21:18:08.542324] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-17T21:18:08.912517] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-17T21:18:09.342307] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-17T21:18:09.802439] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T21:18:10.142335] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-17T21:18:10.544684] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T21:18:10.942333] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-17T21:18:11.742289] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-17T21:18:11.797030] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T21:18:12.542307] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-17T21:18:12.607857] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T21:18:12.654859] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T21:18:13.342322] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-17T21:18:14.142339] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-17T21:18:14.203146] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T21:18:14.942354] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-17T21:18:15.039090] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T21:18:15.045393] [INFO ] [REMOTE ] RPM: Full fetch complete (59856 records). [2025-10-17T21:18:15.045571] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-17T21:18:15.359803] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-17T21:18:15.468425] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-10-17T21:18:15.468509] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-10-17T21:18:15.469674] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-10-17T21:18:15.469737] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-10-17T21:18:15.470976] [DEBUG] [LOCAL ] RPM: Trimmed 59856 records to 42595 (keeping 200 days of data) [2025-10-17T21:18:15.736292] [DEBUG] [LOCAL ] RPM: Primary data saved (42595 records). [2025-10-17T21:18:15.736420] [INFO ] [MAIN ] RPM: Full history saved. [2025-10-17T21:18:15.736489] [INFO ] [MAIN ] Update Progress: 1826/2368 symbols completed. RPM took 30.8s. Estimated remaining: 1h 16m 38s. Rate: 7.1 symbols/min [2025-10-17T21:18:15.747924] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-17T21:18:15.908762] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:18:15.908934] [DEBUG] [LOCAL ] RRC: No existing data file found in primary storage. [2025-10-17T21:18:15.908971] [WARN ] [MAIN ] RRC: No existing data found, performing full refresh instead. [2025-10-17T21:18:15.909081] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-17T21:18:15.909122] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-17T21:18:15.909163] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-17T21:18:15.909195] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-17T21:18:16.263682] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:18:16.542304] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-10-17T21:18:16.774611] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T21:18:17.079843] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T21:18:17.342313] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-17T21:18:18.112380] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T21:18:18.142245] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-17T21:18:18.802992] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T21:18:18.942244] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-17T21:18:19.742350] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-17T21:18:20.305974] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-17T21:18:20.542407] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-17T21:18:20.783049] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T21:18:21.235591] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-17T21:18:21.242937] [INFO ] [REMOTE ] ROL: Full fetch complete (73224 records). [2025-10-17T21:18:21.243084] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-17T21:18:21.345178] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-17T21:18:21.635468] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-10-17T21:18:21.635551] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-10-17T21:18:21.636704] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-10-17T21:18:21.636770] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-10-17T21:18:21.638265] [DEBUG] [LOCAL ] ROL: Trimmed 73224 records to 51102 (keeping 200 days of data) [2025-10-17T21:18:21.980393] [DEBUG] [LOCAL ] ROL: Primary data saved (51102 records). [2025-10-17T21:18:21.981180] [INFO ] [MAIN ] ROL: Full history saved. [2025-10-17T21:18:21.981300] [INFO ] [MAIN ] Update Progress: 1827/2368 symbols completed. ROL took 38.6s. Estimated remaining: 1h 16m 29s. Rate: 7.1 symbols/min [2025-10-17T21:18:21.982108] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-17T21:18:22.165117] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-17T21:18:22.173937] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:18:22.176348] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-17T21:18:22.180719] [DEBUG] [LOCAL ] RRX: No existing data file found in primary storage. [2025-10-17T21:18:22.181455] [WARN ] [MAIN ] RRX: No existing data found, performing full refresh instead. [2025-10-17T21:18:22.181981] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-17T21:18:22.182033] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-17T21:18:22.182079] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-17T21:18:22.182111] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-17T21:18:22.530893] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:18:22.942352] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-17T21:18:23.574816] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T21:18:23.742320] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-17T21:18:24.542279] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-10-17T21:18:24.823602] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T21:18:24.834472] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-17T21:18:24.839959] [INFO ] [REMOTE ] RQI: Full fetch complete (42940 records). [2025-10-17T21:18:24.840080] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-10-17T21:18:25.208738] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-10-17T21:18:25.208825] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-10-17T21:18:25.209691] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-10-17T21:18:25.209752] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-10-17T21:18:25.210861] [DEBUG] [LOCAL ] RQI: Trimmed 42940 records to 29541 (keeping 200 days of data) [2025-10-17T21:18:25.355383] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-17T21:18:25.390929] [DEBUG] [LOCAL ] RQI: Primary data saved (29541 records). [2025-10-17T21:18:25.391062] [INFO ] [MAIN ] RQI: Full history saved. [2025-10-17T21:18:25.391136] [INFO ] [MAIN ] Update Progress: 1828/2368 symbols completed. RQI took 28.1s. Estimated remaining: 1h 16m 19s. Rate: 7.1 symbols/min [2025-10-17T21:18:25.555792] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:18:25.556505] [DEBUG] [LOCAL ] RS: No existing data file found in primary storage. [2025-10-17T21:18:25.556551] [WARN ] [MAIN ] RS: No existing data found, performing full refresh instead. [2025-10-17T21:18:25.556693] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-17T21:18:25.556747] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-17T21:18:25.556789] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-17T21:18:25.556822] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-17T21:18:25.907732] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:18:26.050325] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T21:18:26.142253] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-10-17T21:18:26.942335] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-17T21:18:27.151040] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T21:18:27.714892] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T21:18:27.742259] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-17T21:18:27.793689] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T21:18:28.542347] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-17T21:18:29.228234] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T21:18:29.342311] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-17T21:18:30.142327] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-17T21:18:30.467847] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T21:18:30.942330] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-17T21:18:30.979073] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T21:18:31.653482] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T21:18:31.742254] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-17T21:18:32.534407] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T21:18:32.544557] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-17T21:18:33.342314] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-17T21:18:33.558529] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-17T21:18:34.127709] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T21:18:34.142240] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-17T21:18:34.942305] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-17T21:18:35.172881] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T21:18:35.613941] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-17T21:18:35.742327] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-17T21:18:36.386455] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T21:18:36.542315] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-17T21:18:36.911717] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T21:18:37.342286] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-17T21:18:38.142282] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-17T21:18:38.300005] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T21:18:38.627134] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T21:18:38.902078] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T21:18:38.942332] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-17T21:18:39.742371] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-17T21:18:40.547358] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-17T21:18:40.558746] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T21:18:41.342282] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-17T21:18:41.477398] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T21:18:42.142350] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-17T21:18:42.557165] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-17T21:18:42.601946] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-17T21:18:42.942345] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-17T21:18:43.414013] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T21:18:43.742303] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-17T21:18:44.257767] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-17T21:18:44.542351] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-17T21:18:45.342271] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-17T21:18:45.385064] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T21:18:45.689790] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T21:18:45.694243] [INFO ] [REMOTE ] RS: Full fetch complete (38820 records). [2025-10-17T21:18:45.694452] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-17T21:18:46.100415] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-10-17T21:18:46.100548] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-10-17T21:18:46.102068] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-10-17T21:18:46.102149] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-10-17T21:18:46.103572] [DEBUG] [LOCAL ] RS: Trimmed 38820 records to 25141 (keeping 200 days of data) [2025-10-17T21:18:46.158874] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-17T21:18:46.274208] [DEBUG] [LOCAL ] RS: Primary data saved (25141 records). [2025-10-17T21:18:46.274417] [INFO ] [MAIN ] RS: Full history saved. [2025-10-17T21:18:46.274538] [INFO ] [MAIN ] Update Progress: 1829/2368 symbols completed. RS took 20.9s. Estimated remaining: 1h 16m 14s. Rate: 7.1 symbols/min [2025-10-17T21:18:46.446936] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:18:46.455893] [DEBUG] [LOCAL ] RSF: Loaded 4342 existing records from primary storage. [2025-10-17T21:18:46.456182] [INFO ] [MAIN ] RSF: Loaded 4342 existing records. [2025-10-17T21:18:46.636877] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:18:46.637178] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-17T21:18:46.637231] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-17T21:18:46.637455] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-10-17T21:18:46.637528] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-17T21:18:46.943976] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-17T21:18:47.025787] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:18:47.062777] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T21:18:47.261217] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T21:18:47.742339] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-10-17T21:18:48.333283] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-17T21:18:48.542313] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-17T21:18:48.690090] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T21:18:49.342404] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-17T21:18:49.949624] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-17T21:18:50.142376] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-17T21:18:50.206132] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T21:18:50.942320] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-17T21:18:51.694414] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T21:18:51.724621] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T21:18:51.742268] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-17T21:18:52.542349] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-17T21:18:53.138953] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T21:18:53.144963] [INFO ] [REMOTE ] RRX: Full fetch complete (58791 records). [2025-10-17T21:18:53.145121] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-17T21:18:53.351802] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-17T21:18:53.579779] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-10-17T21:18:53.579915] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-10-17T21:18:53.581586] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-10-17T21:18:53.581710] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-10-17T21:18:53.588871] [DEBUG] [LOCAL ] RRX: Trimmed 58791 records to 41654 (keeping 200 days of data) [2025-10-17T21:18:53.597762] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-17T21:18:53.930388] [DEBUG] [LOCAL ] RRX: Primary data saved (41654 records). [2025-10-17T21:18:53.930524] [INFO ] [MAIN ] RRX: Full history saved. [2025-10-17T21:18:53.930614] [INFO ] [MAIN ] Update Progress: 1830/2368 symbols completed. RRX took 31.9s. Estimated remaining: 1h 16m 6s. Rate: 7.1 symbols/min [2025-10-17T21:18:54.111376] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:18:54.111556] [DEBUG] [LOCAL ] RSG: No existing data file found in primary storage. [2025-10-17T21:18:54.111594] [WARN ] [MAIN ] RSG: No existing data found, performing full refresh instead. [2025-10-17T21:18:54.111736] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-17T21:18:54.111804] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-17T21:18:54.111873] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-17T21:18:54.111921] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-17T21:18:54.147512] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-17T21:18:54.510674] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:18:54.719862] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-17T21:18:54.942343] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-17T21:18:55.067290] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T21:18:55.074896] [INFO ] [REMOTE ] RRC: Full fetch complete (76739 records). [2025-10-17T21:18:55.075080] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-17T21:18:55.476483] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-10-17T21:18:55.476569] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-10-17T21:18:55.477779] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-10-17T21:18:55.477847] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-10-17T21:18:55.479316] [DEBUG] [LOCAL ] RRC: Trimmed 76739 records to 53680 (keeping 200 days of data) [2025-10-17T21:18:55.762345] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-10-17T21:18:55.814559] [DEBUG] [LOCAL ] RRC: Primary data saved (53680 records). [2025-10-17T21:18:55.814727] [INFO ] [MAIN ] RRC: Full history saved. [2025-10-17T21:18:55.814813] [INFO ] [MAIN ] Update Progress: 1831/2368 symbols completed. RRC took 40.1s. Estimated remaining: 1h 15m 55s. Rate: 7.1 symbols/min [2025-10-17T21:18:55.992917] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:18:55.994058] [DEBUG] [LOCAL ] RSI: No existing data file found in primary storage. [2025-10-17T21:18:55.993948] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T21:18:55.996929] [WARN ] [MAIN ] RSI: No existing data found, performing full refresh instead. [2025-10-17T21:18:55.997280] [INFO ] [REMOTE ] RPT: Full fetch complete (28384 records). [2025-10-17T21:18:55.997398] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-17T21:18:55.997202] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-17T21:18:55.997535] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-17T21:18:55.997792] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-17T21:18:56.030340] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-17T21:18:56.546060] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-17T21:18:56.791635] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-10-17T21:18:56.791402] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:18:56.792301] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-10-17T21:18:56.793557] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-10-17T21:18:56.793790] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-10-17T21:18:56.795285] [DEBUG] [LOCAL ] RPT: Trimmed 28384 records to 19322 (keeping 200 days of data) [2025-10-17T21:18:56.932049] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T21:18:56.962853] [DEBUG] [LOCAL ] RPT: Primary data saved (19322 records). [2025-10-17T21:18:56.963017] [INFO ] [MAIN ] RPT: Full history saved. [2025-10-17T21:18:56.963106] [INFO ] [MAIN ] Update Progress: 1832/2368 symbols completed. RPT took 1m 1s. Estimated remaining: 1h 15m 45s. Rate: 7.1 symbols/min [2025-10-17T21:18:57.142088] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:18:57.178966] [DEBUG] [LOCAL ] RSKD: Loaded 33696 existing records from primary storage. [2025-10-17T21:18:57.179283] [INFO ] [MAIN ] RSKD: Loaded 33696 existing records. [2025-10-17T21:18:57.284728] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-17T21:18:57.346169] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-17T21:18:57.369466] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:18:57.369857] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-17T21:18:57.369910] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-17T21:18:57.370128] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-10-17T21:18:57.370259] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-17T21:18:57.715419] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:18:57.937555] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-17T21:18:58.142364] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-10-17T21:18:58.942276] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-17T21:18:59.650939] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T21:18:59.742339] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-17T21:18:59.882302] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T21:19:00.542335] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-10-17T21:19:00.750320] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T21:19:01.342336] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-17T21:19:02.147459] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-17T21:19:02.165155] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T21:19:02.223487] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T21:19:02.942303] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-17T21:19:03.057195] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-17T21:19:03.742295] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-17T21:19:04.411562] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T21:19:04.542268] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-17T21:19:04.648229] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T21:19:05.286561] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T21:19:05.342271] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-17T21:19:06.142292] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-17T21:19:06.304227] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T21:19:06.942343] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-17T21:19:07.703822] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T21:19:07.742249] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-17T21:19:08.051066] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-17T21:19:08.542303] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-17T21:19:08.764783] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-17T21:19:09.342273] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-17T21:19:09.414635] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-17T21:19:10.004147] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T21:19:10.142291] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-17T21:19:10.804531] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-17T21:19:10.942301] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-17T21:19:11.520408] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-17T21:19:11.521554] [INFO ] [REMOTE ] RSF: Full fetch complete (5703 records). [2025-10-17T21:19:11.521630] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-17T21:19:11.751899] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-17T21:19:11.868053] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-17T21:19:11.868151] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-17T21:19:11.868330] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-17T21:19:11.868391] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-17T21:19:11.868828] [DEBUG] [LOCAL ] RSF: Trimmed 5703 records to 4371 (keeping 200 days of data) [2025-10-17T21:19:11.895903] [DEBUG] [LOCAL ] RSF: Primary data saved (4371 records). [2025-10-17T21:19:11.895995] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-17T21:19:11.896091] [INFO ] [MAIN ] Update Progress: 1833/2368 symbols completed. RSF took 25.6s. Estimated remaining: 1h 15m 38s. Rate: 7.1 symbols/min [2025-10-17T21:19:12.060246] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:19:12.060404] [DEBUG] [LOCAL ] RTO: No existing data file found in primary storage. [2025-10-17T21:19:12.060442] [WARN ] [MAIN ] RTO: No existing data found, performing full refresh instead. [2025-10-17T21:19:12.060557] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-17T21:19:12.060598] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-17T21:19:12.060639] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-17T21:19:12.060715] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-17T21:19:12.406766] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:19:12.542271] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-10-17T21:19:13.350284] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-17T21:19:13.352031] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-17T21:19:14.104106] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T21:19:14.142287] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-17T21:19:14.212929] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-17T21:19:14.942287] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-17T21:19:15.742265] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-17T21:19:15.817573] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T21:19:16.399936] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T21:19:16.542261] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-17T21:19:16.832565] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T21:19:17.342299] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-17T21:19:18.142263] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-17T21:19:18.169179] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T21:19:18.750058] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T21:19:18.942270] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-17T21:19:19.136711] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-17T21:19:19.742290] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-17T21:19:20.542263] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-17T21:19:20.726690] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T21:19:20.770311] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-17T21:19:21.342310] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-17T21:19:21.848503] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T21:19:22.142353] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-17T21:19:22.942280] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-17T21:19:22.986158] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T21:19:23.747380] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-17T21:19:23.760053] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-17T21:19:23.767162] [INFO ] [REMOTE ] RSG: Full fetch complete (68422 records). [2025-10-17T21:19:23.767295] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-17T21:19:24.196037] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-10-17T21:19:24.196147] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-10-17T21:19:24.197637] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-10-17T21:19:24.197825] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-10-17T21:19:24.199314] [DEBUG] [LOCAL ] RSG: Trimmed 68422 records to 48206 (keeping 200 days of data) [2025-10-17T21:19:24.326362] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T21:19:24.543067] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-17T21:19:24.561904] [DEBUG] [LOCAL ] RSG: Primary data saved (48206 records). [2025-10-17T21:19:24.562032] [INFO ] [MAIN ] RSG: Full history saved. [2025-10-17T21:19:24.562120] [INFO ] [MAIN ] Update Progress: 1834/2368 symbols completed. RSG took 30.6s. Estimated remaining: 1h 15m 31s. Rate: 7.1 symbols/min [2025-10-17T21:19:24.747320] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:19:24.747451] [DEBUG] [LOCAL ] RTX: No existing data file found in primary storage. [2025-10-17T21:19:24.747489] [WARN ] [MAIN ] RTX: No existing data found, performing full refresh instead. [2025-10-17T21:19:24.747603] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-17T21:19:24.747665] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-17T21:19:24.747762] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-17T21:19:24.747806] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-17T21:19:25.093613] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:19:25.342291] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-10-17T21:19:25.497398] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T21:19:25.926173] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T21:19:26.142293] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-17T21:19:26.942274] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-17T21:19:27.245472] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-17T21:19:27.716852] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T21:19:27.742267] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-17T21:19:27.893966] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T21:19:27.898626] [INFO ] [REMOTE ] RSKD: Full fetch complete (48455 records). [2025-10-17T21:19:27.898757] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-17T21:19:28.281182] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-10-17T21:19:28.281280] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-10-17T21:19:28.282310] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-10-17T21:19:28.282373] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-10-17T21:19:28.283536] [DEBUG] [LOCAL ] RSKD: Trimmed 48455 records to 33929 (keeping 200 days of data) [2025-10-17T21:19:28.469116] [DEBUG] [LOCAL ] RSKD: Primary data saved (33929 records). [2025-10-17T21:19:28.469253] [INFO ] [MAIN ] RSKD: Full history saved. [2025-10-17T21:19:28.469349] [INFO ] [MAIN ] Update Progress: 1835/2368 symbols completed. RSKD took 31.5s. Estimated remaining: 1h 15m 21s. Rate: 7.1 symbols/min [2025-10-17T21:19:28.547433] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-17T21:19:28.639571] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:19:28.639765] [DEBUG] [LOCAL ] RVLV: No existing data file found in primary storage. [2025-10-17T21:19:28.639810] [WARN ] [MAIN ] RVLV: No existing data found, performing full refresh instead. [2025-10-17T21:19:28.639918] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-17T21:19:28.639959] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-17T21:19:28.640000] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-17T21:19:28.640032] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-17T21:19:28.989456] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:19:29.342270] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-10-17T21:19:29.526868] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T21:19:30.142316] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-17T21:19:30.502227] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-17T21:19:30.942308] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-17T21:19:30.990469] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T21:19:31.749878] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-17T21:19:31.766566] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T21:19:32.542292] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-17T21:19:32.950288] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-17T21:19:33.342323] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-17T21:19:33.561251] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T21:19:33.658481] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T21:19:34.142305] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-17T21:19:34.942307] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-17T21:19:35.317115] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T21:19:35.742303] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-17T21:19:35.961211] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-17T21:19:36.542309] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-17T21:19:36.791628] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T21:19:37.342295] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-17T21:19:37.687135] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T21:19:38.016518] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-17T21:19:38.142255] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-17T21:19:38.672125] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T21:19:38.942346] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-17T21:19:39.742444] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-17T21:19:40.354401] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T21:19:40.399280] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-17T21:19:40.542256] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-17T21:19:41.063796] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T21:19:41.071550] [INFO ] [REMOTE ] RSI: Full fetch complete (69732 records). [2025-10-17T21:19:41.071816] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-17T21:19:41.348068] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-17T21:19:41.494281] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-10-17T21:19:41.494395] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-10-17T21:19:41.496346] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-10-17T21:19:41.496415] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-10-17T21:19:41.498320] [DEBUG] [LOCAL ] RSI: Trimmed 69732 records to 47708 (keeping 200 days of data) [2025-10-17T21:19:41.792145] [DEBUG] [LOCAL ] RSI: Primary data saved (47708 records). [2025-10-17T21:19:41.792296] [INFO ] [MAIN ] RSI: Full history saved. [2025-10-17T21:19:41.792376] [INFO ] [MAIN ] Update Progress: 1836/2368 symbols completed. RSI took 46.0s. Estimated remaining: 1h 15m 14s. Rate: 7.1 symbols/min [2025-10-17T21:19:41.963454] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:19:41.963635] [DEBUG] [LOCAL ] RVT: No existing data file found in primary storage. [2025-10-17T21:19:41.963710] [WARN ] [MAIN ] RVT: No existing data found, performing full refresh instead. [2025-10-17T21:19:41.963846] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-17T21:19:41.963886] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-17T21:19:41.963926] [DEBUG] [LOCAL ] RVT: No primary data file found to delete. [2025-10-17T21:19:41.963957] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-17T21:19:42.145973] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-17T21:19:42.335457] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:19:42.854226] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-17T21:19:42.942262] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-17T21:19:43.075779] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T21:19:43.742333] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-17T21:19:44.053030] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T21:19:44.542308] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-17T21:19:45.309264] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-17T21:19:45.343765] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-17T21:19:45.346177] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T21:19:46.142267] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-10-17T21:19:46.242097] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T21:19:46.942303] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-17T21:19:47.518256] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-17T21:19:47.579897] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T21:19:47.742335] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-17T21:19:48.502205] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T21:19:48.542343] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-17T21:19:49.342352] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-17T21:19:49.653085] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T21:19:50.139276] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-17T21:19:50.145352] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-17T21:19:50.146680] [INFO ] [REMOTE ] RTO: Full fetch complete (58844 records). [2025-10-17T21:19:50.146772] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-17T21:19:50.558156] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-10-17T21:19:50.558374] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-10-17T21:19:50.559705] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-10-17T21:19:50.559771] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-10-17T21:19:50.561090] [DEBUG] [LOCAL ] RTO: Trimmed 58844 records to 40597 (keeping 200 days of data) [2025-10-17T21:19:50.680673] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T21:19:50.835158] [DEBUG] [LOCAL ] RTO: Primary data saved (40597 records). [2025-10-17T21:19:50.835293] [INFO ] [MAIN ] RTO: Full history saved. [2025-10-17T21:19:50.835368] [INFO ] [MAIN ] Update Progress: 1837/2368 symbols completed. RTO took 38.9s. Estimated remaining: 1h 15m 6s. Rate: 7.1 symbols/min [2025-10-17T21:19:50.942287] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-17T21:19:51.183687] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-17T21:19:51.742409] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-17T21:19:52.236413] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T21:19:52.542352] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-17T21:19:53.342300] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-17T21:19:53.802689] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-17T21:19:53.810248] [INFO ] [REMOTE ] RTX: Full fetch complete (77875 records). [2025-10-17T21:19:53.810393] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-17T21:19:54.202340] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-10-17T21:19:54.202442] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-10-17T21:19:54.203695] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-10-17T21:19:54.203779] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-10-17T21:19:54.205349] [DEBUG] [LOCAL ] RTX: Trimmed 77875 records to 54486 (keeping 200 days of data) [2025-10-17T21:19:54.342078] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T21:19:54.354165] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-17T21:19:54.589507] [DEBUG] [LOCAL ] RTX: Primary data saved (54486 records). [2025-10-17T21:19:54.589689] [INFO ] [MAIN ] RTX: Full history saved. [2025-10-17T21:19:54.589844] [INFO ] [MAIN ] Update Progress: 1838/2368 symbols completed. RTX took 30.0s. Estimated remaining: 1h 14m 56s. Rate: 7.1 symbols/min [2025-10-17T21:19:54.685872] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T21:19:54.942270] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-17T21:19:56.120593] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T21:19:56.131818] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-17T21:19:56.382614] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-17T21:19:56.542260] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-17T21:19:57.780794] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T21:19:57.791101] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-17T21:19:57.824582] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-17T21:19:58.142333] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-17T21:19:59.349256] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T21:19:59.359444] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-17T21:19:59.526489] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T21:19:59.742271] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-17T21:20:00.723890] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T21:20:00.730783] [INFO ] [REMOTE ] RVLV: Full fetch complete (69027 records). [2025-10-17T21:20:00.730925] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-17T21:20:01.131113] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-10-17T21:20:01.131205] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-10-17T21:20:01.132608] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-10-17T21:20:01.132715] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-10-17T21:20:01.134244] [DEBUG] [LOCAL ] RVLV: Trimmed 69027 records to 48144 (keeping 200 days of data) [2025-10-17T21:20:01.435406] [DEBUG] [LOCAL ] RVLV: Primary data saved (48144 records). [2025-10-17T21:20:01.435586] [INFO ] [MAIN ] RVLV: Full history saved. [2025-10-17T21:20:01.435704] [INFO ] [MAIN ] Update Progress: 1839/2368 symbols completed. RVLV took 33.0s. Estimated remaining: 1h 14m 47s. Rate: 7.1 symbols/min [2025-10-17T21:20:01.689038] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T21:20:01.699401] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-17T21:20:03.010707] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T21:20:03.017003] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-17T21:20:04.310188] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T21:20:04.316175] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-17T21:20:05.678145] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T21:20:05.682021] [INFO ] [REMOTE ] RVT: Full fetch complete (39217 records). [2025-10-17T21:20:05.682102] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-17T21:20:06.068693] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-10-17T21:20:06.068776] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-10-17T21:20:06.069543] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-10-17T21:20:06.069583] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-10-17T21:20:06.070391] [DEBUG] [LOCAL ] RVT: Trimmed 39217 records to 26714 (keeping 200 days of data) [2025-10-17T21:20:06.225443] [DEBUG] [LOCAL ] RVT: Primary data saved (26714 records). [2025-10-17T21:20:06.225567] [INFO ] [MAIN ] RVT: Full history saved. [2025-10-17T21:20:06.225637] [INFO ] [MAIN ] Update Progress: 1840/2368 symbols completed. RVT took 24.4s. Estimated remaining: 1h 14m 37s. Rate: 7.1 symbols/min [2025-10-17T21:20:06.819229] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:20:06.874664] [DEBUG] [LOCAL ] RVTY: No existing data file found in primary storage. [2025-10-17T21:20:06.940536] [WARN ] [MAIN ] RVTY: No existing data found, performing full refresh instead. [2025-10-17T21:20:06.927216] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:20:06.944034] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:20:06.940420] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:20:06.944201] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-17T21:20:06.944372] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-17T21:20:06.944478] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-17T21:20:06.945215] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-17T21:20:06.945298] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-17T21:20:06.945528] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-17T21:20:06.945745] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-17T21:20:06.945829] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-17T21:20:06.946020] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-17T21:20:06.946187] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-17T21:20:06.946331] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-17T21:20:06.946273] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-17T21:20:06.946484] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-17T21:20:06.952022] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-17T21:20:06.964045] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-17T21:20:06.982739] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-17T21:20:07.318390] [DEBUG] [LOCAL ] RWT: Loaded 41041 existing records from primary storage. [2025-10-17T21:20:07.396376] [INFO ] [MAIN ] RWT: Loaded 41041 existing records. [2025-10-17T21:20:08.184282] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:20:08.272569] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-17T21:20:08.271533] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:20:08.274723] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-17T21:20:08.275028] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-10-17T21:20:08.276803] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:20:08.299474] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-10-17T21:20:08.299379] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:20:08.295815] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-10-17T21:20:08.300195] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-17T21:20:08.300034] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-10-17T21:20:08.664434] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:20:08.664790] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-10-17T21:20:08.864434] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-17T21:20:08.865569] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-17T21:20:08.925097] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-17T21:20:08.926199] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-17T21:20:09.322020] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-17T21:20:09.323433] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-17T21:20:09.608564] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T21:20:09.610444] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-17T21:20:09.688254] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T21:20:09.696579] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-17T21:20:09.838330] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-17T21:20:10.120949] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-17T21:20:10.142267] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-17T21:20:10.321966] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T21:20:10.701367] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-17T21:20:10.942349] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-17T21:20:11.287749] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T21:20:11.742308] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-17T21:20:12.288462] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-17T21:20:12.551757] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-17T21:20:12.556477] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T21:20:13.342306] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-17T21:20:13.881556] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-17T21:20:14.142257] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-17T21:20:14.240041] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T21:20:14.942311] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-17T21:20:15.396947] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-17T21:20:15.593158] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T21:20:15.742308] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-17T21:20:16.542370] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-17T21:20:17.124472] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-17T21:20:17.342344] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-17T21:20:17.607814] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T21:20:18.142349] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-17T21:20:18.942261] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-17T21:20:19.039262] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T21:20:19.353924] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-17T21:20:19.742305] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-17T21:20:20.068178] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T21:20:20.150373] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-17T21:20:20.542316] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-17T21:20:20.931968] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-17T21:20:21.342299] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-17T21:20:21.863990] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-17T21:20:22.142288] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-17T21:20:22.866626] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-17T21:20:22.942314] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-17T21:20:23.614197] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-17T21:20:23.742306] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-17T21:20:24.496724] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-17T21:20:24.542283] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-17T21:20:25.237327] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-17T21:20:25.342256] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-17T21:20:25.910121] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-17T21:20:25.911082] [INFO ] [REMOTE ] RWTO: Full fetch complete (4816 records). [2025-10-17T21:20:25.911150] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-17T21:20:26.088901] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T21:20:26.089121] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-17T21:20:26.089190] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-17T21:20:26.089267] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-17T21:20:26.089331] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-17T21:20:26.089377] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-17T21:20:26.089417] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-17T21:20:26.089473] [INFO ] [MAIN ] Update Progress: 1841/2368 symbols completed. RWTO took 19.9s. Estimated remaining: 1h 14m 32s. Rate: 7.1 symbols/min [2025-10-17T21:20:26.151236] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-17T21:20:26.265187] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:20:26.265353] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-17T21:20:26.265391] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-17T21:20:26.265512] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-17T21:20:26.265553] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-17T21:20:26.265594] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-17T21:20:26.265627] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-17T21:20:26.620779] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:20:26.723705] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-17T21:20:26.942309] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-17T21:20:27.742296] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-17T21:20:28.542295] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-17T21:20:28.880808] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-17T21:20:29.089385] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-17T21:20:29.090273] [INFO ] [REMOTE ] RWTN: Full fetch complete (3158 records). [2025-10-17T21:20:29.090342] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-17T21:20:29.267690] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-17T21:20:29.267926] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-17T21:20:29.268006] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-17T21:20:29.268085] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-17T21:20:29.268150] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-17T21:20:29.268187] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-17T21:20:29.268229] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-17T21:20:29.268299] [INFO ] [MAIN ] Update Progress: 1842/2368 symbols completed. RWTN took 23.0s. Estimated remaining: 1h 14m 22s. Rate: 7.1 symbols/min [2025-10-17T21:20:29.347286] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-17T21:20:29.442395] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:20:29.442597] [DEBUG] [LOCAL ] RXO: No existing data file found in primary storage. [2025-10-17T21:20:29.442699] [WARN ] [MAIN ] RXO: No existing data found, performing full refresh instead. [2025-10-17T21:20:29.442902] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-17T21:20:29.442996] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-17T21:20:29.443107] [DEBUG] [LOCAL ] RXO: No primary data file found to delete. [2025-10-17T21:20:29.443247] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-17T21:20:29.649241] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T21:20:29.842508] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:20:30.142341] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-10-17T21:20:30.942296] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-10-17T21:20:31.033072] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T21:20:31.243402] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:20:31.243720] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-10-17T21:20:31.243807] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:20:31.243853] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-10-17T21:20:31.243886] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:20:31.243948] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-17T21:20:31.244010] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-17T21:20:31.244044] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-17T21:20:31.244083] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-17T21:20:31.244139] [INFO ] [MAIN ] Update Progress: 1843/2368 symbols completed. RWTP took 5.2s. Estimated remaining: 1h 14m 12s. Rate: 7.1 symbols/min [2025-10-17T21:20:31.414598] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:20:31.414801] [DEBUG] [LOCAL ] RY: No existing data file found in primary storage. [2025-10-17T21:20:31.414858] [WARN ] [MAIN ] RY: No existing data found, performing full refresh instead. [2025-10-17T21:20:31.414983] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-17T21:20:31.415050] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-17T21:20:31.415253] [DEBUG] [LOCAL ] RY: No primary data file found to delete. [2025-10-17T21:20:31.415324] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-17T21:20:31.584375] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T21:20:31.745981] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-17T21:20:31.835402] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:20:32.542335] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-17T21:20:33.342338] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-17T21:20:33.411682] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T21:20:34.142301] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-17T21:20:34.427080] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-17T21:20:34.942321] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-10-17T21:20:34.971845] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T21:20:35.403190] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T21:20:35.742287] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-17T21:20:35.848098] [DEBUG] [REMOTE ] RVTY: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-17T21:20:35.848427] [WARN ] [REMOTE ] RVTY: No data returned for month 2025-08 [2025-10-17T21:20:35.848536] [FATAL] [REMOTE ] RVTY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:20:35.848670] [FATAL] [MAIN ] RVTY: Failed to fetch primary data. [2025-10-17T21:20:35.848737] [WARN ] [MAIN ] RVTY: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:20:35.848807] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-17T21:20:35.848894] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-17T21:20:35.848949] [INFO ] [LOCAL ] RVTY: Starting deletion of derivative data. [2025-10-17T21:20:35.848993] [DEBUG] [LOCAL ] RVTY: No derivative data file found to delete. [2025-10-17T21:20:35.849039] [INFO ] [MAIN ] Update Progress: 1844/2368 symbols completed. RVTY took 29.6s. Estimated remaining: 1h 14m 2s. Rate: 7.1 symbols/min [2025-10-17T21:20:36.016417] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:20:36.016579] [DEBUG] [LOCAL ] RYAM: No existing data file found in primary storage. [2025-10-17T21:20:36.016617] [WARN ] [MAIN ] RYAM: No existing data found, performing full refresh instead. [2025-10-17T21:20:36.016894] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-17T21:20:36.016945] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-17T21:20:36.016989] [DEBUG] [LOCAL ] RYAM: No primary data file found to delete. [2025-10-17T21:20:36.017022] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-17T21:20:36.378805] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:20:36.409318] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T21:20:36.542254] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-17T21:20:37.342260] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-17T21:20:38.142341] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-17T21:20:38.320010] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T21:20:38.888524] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T21:20:38.942289] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-17T21:20:39.742336] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-17T21:20:39.974684] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T21:20:40.542446] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-17T21:20:40.547325] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T21:20:41.342295] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-17T21:20:41.444925] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T21:20:42.142305] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-10-17T21:20:42.264926] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T21:20:42.933817] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T21:20:42.943307] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-17T21:20:43.506806] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T21:20:43.742334] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-17T21:20:44.406225] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T21:20:44.542324] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-17T21:20:45.012108] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T21:20:45.342371] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-17T21:20:46.151458] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-17T21:20:46.180145] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T21:20:46.877820] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T21:20:46.942249] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-17T21:20:47.742372] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-17T21:20:48.185542] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-17T21:20:48.490162] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-17T21:20:48.542279] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-17T21:20:49.293340] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T21:20:49.298969] [INFO ] [REMOTE ] RWT: Full fetch complete (58213 records). [2025-10-17T21:20:49.299102] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-17T21:20:49.347513] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-17T21:20:49.706383] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-10-17T21:20:49.706462] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-10-17T21:20:49.707452] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-10-17T21:20:49.707514] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-10-17T21:20:49.708701] [DEBUG] [LOCAL ] RWT: Trimmed 58213 records to 41307 (keeping 200 days of data) [2025-10-17T21:20:49.946562] [DEBUG] [LOCAL ] RWT: Primary data saved (41307 records). [2025-10-17T21:20:49.946717] [INFO ] [MAIN ] RWT: Full history saved. [2025-10-17T21:20:49.946879] [INFO ] [MAIN ] Update Progress: 1845/2368 symbols completed. RWT took 43.7s. Estimated remaining: 1h 13m 55s. Rate: 7.1 symbols/min [2025-10-17T21:20:50.118406] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:20:50.118540] [DEBUG] [LOCAL ] RYAN: No existing data file found in primary storage. [2025-10-17T21:20:50.118575] [WARN ] [MAIN ] RYAN: No existing data found, performing full refresh instead. [2025-10-17T21:20:50.118734] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-17T21:20:50.118809] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-17T21:20:50.118865] [DEBUG] [LOCAL ] RYAN: No primary data file found to delete. [2025-10-17T21:20:50.118911] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-17T21:20:50.149245] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-17T21:20:50.527188] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-17T21:20:50.559008] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:20:50.819627] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T21:20:50.942254] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-17T21:20:51.701345] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T21:20:51.742245] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-17T21:20:52.542260] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-10-17T21:20:52.579280] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T21:20:53.185426] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-17T21:20:53.342318] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-17T21:20:54.150226] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-17T21:20:54.157373] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T21:20:54.951557] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-17T21:20:54.969111] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T21:20:55.742268] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-17T21:20:55.837416] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T21:20:56.384111] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T21:20:56.542370] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-17T21:20:56.962545] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T21:20:57.342311] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-17T21:20:58.142333] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-17T21:20:58.219952] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T21:20:58.483236] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T21:20:58.942317] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-17T21:20:58.962929] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T21:20:59.742322] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-17T21:21:00.542351] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-17T21:21:00.609376] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T21:21:00.619498] [INFO ] [REMOTE ] RXO: Full fetch complete (68848 records). [2025-10-17T21:21:00.619715] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-17T21:21:01.012507] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-10-17T21:21:01.012598] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-10-17T21:21:01.013705] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-10-17T21:21:01.013786] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-10-17T21:21:01.015265] [DEBUG] [LOCAL ] RXO: Trimmed 68848 records to 49101 (keeping 200 days of data) [2025-10-17T21:21:01.317899] [DEBUG] [LOCAL ] RXO: Primary data saved (49101 records). [2025-10-17T21:21:01.318079] [INFO ] [MAIN ] RXO: Full history saved. [2025-10-17T21:21:01.318203] [INFO ] [MAIN ] Update Progress: 1846/2368 symbols completed. RXO took 32.0s. Estimated remaining: 1h 13m 47s. Rate: 7.1 symbols/min [2025-10-17T21:21:01.349237] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-17T21:21:01.497238] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:21:01.497523] [DEBUG] [LOCAL ] RYI: No existing data file found in primary storage. [2025-10-17T21:21:01.497602] [WARN ] [MAIN ] RYI: No existing data found, performing full refresh instead. [2025-10-17T21:21:01.497782] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-17T21:21:01.497842] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-17T21:21:01.497890] [DEBUG] [LOCAL ] RYI: No primary data file found to delete. [2025-10-17T21:21:01.497923] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-17T21:21:01.809171] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-17T21:21:01.903146] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:21:01.923347] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-17T21:21:02.142329] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-17T21:21:02.942355] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-10-17T21:21:03.086048] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T21:21:03.436865] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T21:21:03.652441] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-17T21:21:03.742298] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-17T21:21:04.542274] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-17T21:21:04.823430] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T21:21:05.342306] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-17T21:21:05.801020] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T21:21:06.142283] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-17T21:21:06.913392] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T21:21:06.942242] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-17T21:21:07.434619] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T21:21:07.439719] [INFO ] [REMOTE ] RYAM: Full fetch complete (49151 records). [2025-10-17T21:21:07.439838] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-17T21:21:07.747467] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-17T21:21:07.815987] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-10-17T21:21:07.816059] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-10-17T21:21:07.816961] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-10-17T21:21:07.817023] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-10-17T21:21:07.818078] [DEBUG] [LOCAL ] RYAM: Trimmed 49151 records to 35616 (keeping 200 days of data) [2025-10-17T21:21:08.007374] [DEBUG] [LOCAL ] RYAM: Primary data saved (35616 records). [2025-10-17T21:21:08.007503] [INFO ] [MAIN ] RYAM: Full history saved. [2025-10-17T21:21:08.007590] [INFO ] [MAIN ] Update Progress: 1847/2368 symbols completed. RYAM took 32.2s. Estimated remaining: 1h 13m 39s. Rate: 7.1 symbols/min [2025-10-17T21:21:08.172109] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:21:08.172229] [DEBUG] [LOCAL ] RYN: No existing data file found in primary storage. [2025-10-17T21:21:08.172264] [WARN ] [MAIN ] RYN: No existing data found, performing full refresh instead. [2025-10-17T21:21:08.172370] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-17T21:21:08.172424] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-17T21:21:08.172492] [DEBUG] [LOCAL ] RYN: No primary data file found to delete. [2025-10-17T21:21:08.172538] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-17T21:21:08.519183] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:21:08.542236] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-10-17T21:21:08.590087] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T21:21:09.342248] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-17T21:21:09.592540] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-17T21:21:10.053423] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T21:21:10.142251] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-17T21:21:10.918101] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-17T21:21:10.924451] [INFO ] [REMOTE ] RY: Full fetch complete (69313 records). [2025-10-17T21:21:10.924563] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-17T21:21:10.947537] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-17T21:21:11.320890] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-10-17T21:21:11.320994] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-10-17T21:21:11.322158] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-10-17T21:21:11.322238] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-10-17T21:21:11.324144] [DEBUG] [LOCAL ] RY: Trimmed 69313 records to 48438 (keeping 200 days of data) [2025-10-17T21:21:11.447222] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T21:21:11.662421] [DEBUG] [LOCAL ] RY: Primary data saved (48438 records). [2025-10-17T21:21:11.662566] [INFO ] [MAIN ] RY: Full history saved. [2025-10-17T21:21:11.662666] [INFO ] [MAIN ] Update Progress: 1848/2368 symbols completed. RY took 40.4s. Estimated remaining: 1h 13m 29s. Rate: 7.1 symbols/min [2025-10-17T21:21:11.750752] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-17T21:21:11.834338] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:21:11.834566] [DEBUG] [LOCAL ] RZB: No existing data file found in primary storage. [2025-10-17T21:21:11.834610] [WARN ] [MAIN ] RZB: No existing data found, performing full refresh instead. [2025-10-17T21:21:11.834757] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-17T21:21:11.834809] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-17T21:21:11.834851] [DEBUG] [LOCAL ] RZB: No primary data file found to delete. [2025-10-17T21:21:11.834882] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-17T21:21:12.199273] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:21:12.213509] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-17T21:21:12.542352] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-10-17T21:21:13.241357] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-17T21:21:13.342314] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-17T21:21:13.414822] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T21:21:13.903402] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T21:21:14.142324] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-17T21:21:14.828057] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-17T21:21:14.942295] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-17T21:21:15.609279] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-17T21:21:15.742309] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-17T21:21:16.542356] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-17T21:21:17.070819] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-17T21:21:17.133209] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-17T21:21:17.342431] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-17T21:21:18.142358] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-17T21:21:18.924927] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T21:21:18.942244] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-17T21:21:19.172416] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-17T21:21:19.742293] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-17T21:21:20.066162] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-17T21:21:20.444311] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T21:21:20.542290] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-17T21:21:21.342335] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-17T21:21:22.139563] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T21:21:22.148421] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-17T21:21:22.543692] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T21:21:22.942307] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-17T21:21:23.333068] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T21:21:23.742300] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-17T21:21:24.465070] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-17T21:21:24.542263] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-17T21:21:24.693715] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T21:21:25.342317] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-17T21:21:25.917727] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T21:21:26.142296] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-17T21:21:26.393251] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T21:21:26.732579] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-17T21:21:26.942303] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-17T21:21:27.742322] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-17T21:21:27.925405] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-17T21:21:28.542285] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-17T21:21:29.119630] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T21:21:29.345277] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-17T21:21:29.351091] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T21:21:29.787315] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-17T21:21:30.142290] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-17T21:21:30.942289] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-17T21:21:31.601367] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T21:21:31.742279] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-17T21:21:31.976898] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T21:21:32.542303] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-17T21:21:33.042833] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-17T21:21:33.043877] [INFO ] [REMOTE ] RZB: Full fetch complete (8357 records). [2025-10-17T21:21:33.043946] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-17T21:21:33.343910] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-17T21:21:33.411194] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-10-17T21:21:33.411331] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-10-17T21:21:33.411585] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-10-17T21:21:33.411770] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-10-17T21:21:33.412244] [DEBUG] [LOCAL ] RZB: Trimmed 8357 records to 6031 (keeping 200 days of data) [2025-10-17T21:21:33.470229] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T21:21:33.488823] [DEBUG] [LOCAL ] RZB: Primary data saved (6031 records). [2025-10-17T21:21:33.488930] [INFO ] [MAIN ] RZB: Full history saved. [2025-10-17T21:21:33.489024] [INFO ] [MAIN ] Update Progress: 1849/2368 symbols completed. RZB took 21.8s. Estimated remaining: 1h 13m 24s. Rate: 7.1 symbols/min [2025-10-17T21:21:33.654662] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:21:33.664220] [DEBUG] [LOCAL ] RZC: Loaded 6691 existing records from primary storage. [2025-10-17T21:21:33.664397] [INFO ] [MAIN ] RZC: Loaded 6691 existing records. [2025-10-17T21:21:33.837356] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:21:33.837549] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-17T21:21:33.837596] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-17T21:21:33.837840] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-17T21:21:33.837902] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-17T21:21:34.143306] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-17T21:21:34.195856] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:21:34.459018] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T21:21:34.942281] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-10-17T21:21:35.676181] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T21:21:35.678684] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T21:21:35.742288] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-17T21:21:36.398083] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-17T21:21:36.542309] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-17T21:21:36.644616] [DEBUG] [REMOTE ] RYAN: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-17T21:21:36.644995] [WARN ] [REMOTE ] RYAN: No data returned for month 2025-10 [2025-10-17T21:21:36.645089] [FATAL] [REMOTE ] RYAN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:21:36.645175] [FATAL] [MAIN ] RYAN: Failed to fetch primary data. [2025-10-17T21:21:36.645244] [WARN ] [MAIN ] RYAN: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:21:36.645318] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-17T21:21:36.645387] [DEBUG] [LOCAL ] RYAN: No primary data file found to delete. [2025-10-17T21:21:36.645431] [INFO ] [LOCAL ] RYAN: Starting deletion of derivative data. [2025-10-17T21:21:36.645477] [DEBUG] [LOCAL ] RYAN: No derivative data file found to delete. [2025-10-17T21:21:36.645544] [INFO ] [MAIN ] Update Progress: 1850/2368 symbols completed. RYAN took 46.7s. Estimated remaining: 1h 13m 14s. Rate: 7.1 symbols/min [2025-10-17T21:21:36.815565] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:21:36.868357] [DEBUG] [LOCAL ] S: Loaded 53926 existing records from primary storage. [2025-10-17T21:21:36.868751] [INFO ] [MAIN ] S: Loaded 53926 existing records. [2025-10-17T21:21:37.049218] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:21:37.049512] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-17T21:21:37.049571] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-17T21:21:37.049787] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-17T21:21:37.049843] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-17T21:21:37.347562] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-17T21:21:37.454731] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:21:38.142338] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-17T21:21:38.406501] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-17T21:21:38.942333] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-10-17T21:21:39.701858] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T21:21:39.742313] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-17T21:21:40.542348] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-17T21:21:41.248636] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-17T21:21:41.302586] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T21:21:41.309111] [INFO ] [REMOTE ] RYN: Full fetch complete (65515 records). [2025-10-17T21:21:41.309271] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-17T21:21:41.352285] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-17T21:21:41.548865] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T21:21:41.619293] [INFO ] [REMOTE ] RYI: Full fetch complete (31986 records). [2025-10-17T21:21:41.622004] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-17T21:21:41.844107] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-10-17T21:21:41.844390] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-10-17T21:21:41.861600] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-10-17T21:21:41.872126] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-10-17T21:21:41.921911] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-17T21:21:41.955378] [DEBUG] [LOCAL ] RYN: Trimmed 65515 records to 46269 (keeping 200 days of data) [2025-10-17T21:21:42.146496] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-17T21:21:42.256506] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-10-17T21:21:42.257187] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-10-17T21:21:42.258978] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-10-17T21:21:42.259342] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-10-17T21:21:42.262710] [DEBUG] [LOCAL ] RYI: Trimmed 31986 records to 22046 (keeping 200 days of data) [2025-10-17T21:21:42.528249] [DEBUG] [LOCAL ] RYI: Primary data saved (22046 records). [2025-10-17T21:21:42.530218] [INFO ] [MAIN ] RYI: Full history saved. [2025-10-17T21:21:42.531405] [INFO ] [MAIN ] Update Progress: 1851/2368 symbols completed. RYI took 41.2s. Estimated remaining: 1h 13m 5s. Rate: 7.1 symbols/min [2025-10-17T21:21:42.712524] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:21:42.785402] [DEBUG] [LOCAL ] RYN: Primary data saved (46269 records). [2025-10-17T21:21:42.798036] [INFO ] [MAIN ] RYN: Full history saved. [2025-10-17T21:21:42.799462] [INFO ] [MAIN ] Update Progress: 1852/2368 symbols completed. RYN took 34.8s. Estimated remaining: 1h 12m 54s. Rate: 7.1 symbols/min [2025-10-17T21:21:42.805751] [DEBUG] [LOCAL ] SA: Loaded 44726 existing records from primary storage. [2025-10-17T21:21:42.821728] [INFO ] [MAIN ] SA: Loaded 44726 existing records. [2025-10-17T21:21:42.958677] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-17T21:21:42.984506] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-17T21:21:43.153005] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:21:43.173994] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:21:43.174260] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-17T21:21:43.174317] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-17T21:21:43.174504] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-17T21:21:43.174559] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-17T21:21:43.295882] [DEBUG] [LOCAL ] SABA: Loaded 9369 existing records from primary storage. [2025-10-17T21:21:43.301813] [INFO ] [MAIN ] SABA: Loaded 9369 existing records. [2025-10-17T21:21:43.708609] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:21:43.744416] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-17T21:21:43.735612] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-17T21:21:43.769629] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:21:43.770735] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-17T21:21:43.770931] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-17T21:21:43.770980] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-17T21:21:44.176793] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:21:44.542301] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-10-17T21:21:44.550078] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T21:21:45.038415] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-17T21:21:45.342322] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-17T21:21:46.143819] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T21:21:46.142355] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-17T21:21:46.804466] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-17T21:21:46.942330] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-10-17T21:21:47.272625] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-17T21:21:47.691697] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T21:21:47.742319] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-17T21:21:48.542292] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-17T21:21:48.719441] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-17T21:21:49.342290] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-17T21:21:50.074959] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-17T21:21:50.142312] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-17T21:21:50.451725] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T21:21:50.942357] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-17T21:21:51.685567] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T21:21:51.742333] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-17T21:21:52.542338] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-17T21:21:52.636598] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-17T21:21:52.670346] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T21:21:53.342399] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-17T21:21:53.993451] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T21:21:54.104018] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T21:21:54.142275] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-17T21:21:54.885871] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T21:21:54.942390] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-17T21:21:55.556449] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-17T21:21:55.742370] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-17T21:21:56.542380] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-17T21:21:56.566072] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-17T21:21:57.342372] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-17T21:21:58.016245] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-17T21:21:58.046880] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T21:21:58.142263] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-17T21:21:58.942304] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-17T21:21:59.742343] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-17T21:21:59.890853] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T21:22:00.542327] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-17T21:22:00.650286] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T21:22:01.342259] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-17T21:22:01.544107] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-17T21:22:02.142358] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-17T21:22:02.157668] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-17T21:22:02.350864] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T21:22:02.942305] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-17T21:22:03.742299] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-17T21:22:03.756408] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-17T21:22:04.013842] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-17T21:22:04.331924] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T21:22:04.542297] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-17T21:22:05.166503] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-17T21:22:05.167806] [INFO ] [REMOTE ] RZC: Full fetch complete (9702 records). [2025-10-17T21:22:05.167875] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-17T21:22:05.347377] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-17T21:22:05.521018] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-17T21:22:05.521082] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-17T21:22:05.521304] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-17T21:22:05.521342] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-17T21:22:05.521773] [DEBUG] [LOCAL ] RZC: Trimmed 9702 records to 6724 (keeping 200 days of data) [2025-10-17T21:22:05.560671] [DEBUG] [LOCAL ] RZC: Primary data saved (6724 records). [2025-10-17T21:22:05.560810] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-17T21:22:05.560904] [INFO ] [MAIN ] Update Progress: 1853/2368 symbols completed. RZC took 32.1s. Estimated remaining: 1h 12m 49s. Rate: 7.1 symbols/min [2025-10-17T21:22:05.723766] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:22:05.753965] [DEBUG] [LOCAL ] SAFE: Loaded 30601 existing records from primary storage. [2025-10-17T21:22:05.754229] [INFO ] [MAIN ] SAFE: Loaded 30601 existing records. [2025-10-17T21:22:05.925219] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:22:05.925456] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-17T21:22:05.925524] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-17T21:22:05.925783] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-10-17T21:22:05.925853] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-17T21:22:06.147404] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-17T21:22:06.288896] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:22:06.942318] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-17T21:22:07.031002] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T21:22:07.742322] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-17T21:22:07.926406] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-17T21:22:08.388795] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-17T21:22:08.542297] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-17T21:22:09.353130] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-17T21:22:09.359915] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T21:22:10.021564] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-17T21:22:10.023280] [INFO ] [REMOTE ] SABA: Full fetch complete (15141 records). [2025-10-17T21:22:10.023353] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-17T21:22:10.147436] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-17T21:22:10.396938] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-17T21:22:10.397015] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-17T21:22:10.397352] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-17T21:22:10.397392] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-17T21:22:10.397996] [DEBUG] [LOCAL ] SABA: Trimmed 15141 records to 9397 (keeping 200 days of data) [2025-10-17T21:22:10.454840] [DEBUG] [LOCAL ] SABA: Primary data saved (9397 records). [2025-10-17T21:22:10.454974] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-17T21:22:10.455056] [INFO ] [MAIN ] Update Progress: 1854/2368 symbols completed. SABA took 27.7s. Estimated remaining: 1h 12m 40s. Rate: 7.1 symbols/min [2025-10-17T21:22:10.631333] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:22:10.652156] [DEBUG] [LOCAL ] SAH: Loaded 21345 existing records from primary storage. [2025-10-17T21:22:10.652599] [INFO ] [MAIN ] SAH: Loaded 21345 existing records. [2025-10-17T21:22:10.831482] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:22:10.831828] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-17T21:22:10.831884] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-17T21:22:10.832126] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-10-17T21:22:10.832180] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-17T21:22:10.954950] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-10-17T21:22:10.995067] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-17T21:22:11.243116] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:22:11.742341] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-17T21:22:11.811617] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T21:22:12.297593] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-17T21:22:12.542297] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-17T21:22:13.342338] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-10-17T21:22:13.905537] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T21:22:13.952987] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-17T21:22:13.958800] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-17T21:22:14.142291] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-17T21:22:14.942327] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-17T21:22:15.221504] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T21:22:15.742361] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-17T21:22:16.542261] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-17T21:22:16.756979] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-17T21:22:17.342318] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-17T21:22:17.464637] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T21:22:17.471947] [INFO ] [REMOTE ] S: Full fetch complete (77659 records). [2025-10-17T21:22:17.472070] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-17T21:22:17.821829] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-17T21:22:17.884471] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-17T21:22:17.884542] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-17T21:22:17.885684] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-17T21:22:17.885747] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-17T21:22:17.887142] [DEBUG] [LOCAL ] S: Trimmed 77659 records to 54316 (keeping 200 days of data) [2025-10-17T21:22:18.158434] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-17T21:22:18.211724] [DEBUG] [LOCAL ] S: Primary data saved (54316 records). [2025-10-17T21:22:18.211831] [INFO ] [MAIN ] S: Full history saved. [2025-10-17T21:22:18.212376] [INFO ] [MAIN ] Update Progress: 1855/2368 symbols completed. S took 41.6s. Estimated remaining: 1h 12m 31s. Rate: 7.1 symbols/min [2025-10-17T21:22:18.384775] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:22:18.384927] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-17T21:22:18.384980] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-17T21:22:18.385124] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-17T21:22:18.385189] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-17T21:22:18.385237] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-17T21:22:18.385270] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-17T21:22:18.712730] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T21:22:18.769098] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:22:18.942247] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-10-17T21:22:19.303315] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-17T21:22:19.742273] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-17T21:22:19.949062] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T21:22:19.959281] [INFO ] [REMOTE ] SA: Full fetch complete (63348 records). [2025-10-17T21:22:19.959385] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-17T21:22:20.359199] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-17T21:22:20.359266] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-17T21:22:20.360387] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-17T21:22:20.360491] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-17T21:22:20.361849] [DEBUG] [LOCAL ] SA: Trimmed 63348 records to 45114 (keeping 200 days of data) [2025-10-17T21:22:20.562402] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-17T21:22:20.626815] [DEBUG] [LOCAL ] SA: Primary data saved (45114 records). [2025-10-17T21:22:20.626939] [INFO ] [MAIN ] SA: Full history saved. [2025-10-17T21:22:20.627566] [INFO ] [MAIN ] Update Progress: 1856/2368 symbols completed. SA took 38.1s. Estimated remaining: 1h 12m 21s. Rate: 7.1 symbols/min [2025-10-17T21:22:20.815569] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:22:20.829854] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T21:22:20.856553] [DEBUG] [LOCAL ] SAM: Loaded 21519 existing records from primary storage. [2025-10-17T21:22:20.856816] [INFO ] [MAIN ] SAM: Loaded 21519 existing records. [2025-10-17T21:22:21.030210] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:22:21.030391] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-17T21:22:21.030436] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-17T21:22:21.030593] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-10-17T21:22:21.030630] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-17T21:22:21.344720] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-17T21:22:21.380295] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:22:21.635775] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-17T21:22:21.767430] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-17T21:22:22.142266] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-10-17T21:22:22.942263] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-17T21:22:23.039241] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-17T21:22:23.275012] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-17T21:22:23.742305] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-17T21:22:24.542298] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-17T21:22:25.136750] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-17T21:22:25.342238] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-17T21:22:25.463793] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-17T21:22:26.142244] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-17T21:22:26.625267] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-17T21:22:26.942293] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-17T21:22:27.546502] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-17T21:22:27.742256] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-17T21:22:28.113873] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T21:22:28.542246] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-17T21:22:28.888845] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T21:22:29.342251] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-17T21:22:29.665468] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-17T21:22:29.689205] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-17T21:22:30.142353] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-17T21:22:30.942323] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-17T21:22:31.272482] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T21:22:31.742353] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-17T21:22:32.069383] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-17T21:22:32.341133] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T21:22:32.542324] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-17T21:22:32.820393] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-17T21:22:33.342316] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-17T21:22:34.142277] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-17T21:22:34.466395] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T21:22:34.942368] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-17T21:22:34.971942] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T21:22:35.742308] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-17T21:22:36.065270] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-17T21:22:36.217157] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T21:22:36.542326] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-17T21:22:37.342292] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-17T21:22:37.822302] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-17T21:22:38.142326] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-17T21:22:38.326374] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-17T21:22:38.452488] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-17T21:22:38.942322] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-17T21:22:39.742257] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-17T21:22:40.124369] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-17T21:22:40.132249] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-17T21:22:40.542285] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-17T21:22:41.342273] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-17T21:22:41.579022] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T21:22:42.142364] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-17T21:22:42.427881] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T21:22:42.942326] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-17T21:22:43.270013] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-17T21:22:43.319122] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T21:22:43.322962] [INFO ] [REMOTE ] SAFE: Full fetch complete (44416 records). [2025-10-17T21:22:43.323066] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-17T21:22:43.694368] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-17T21:22:43.694443] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-17T21:22:43.695297] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-17T21:22:43.695360] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-17T21:22:43.696239] [DEBUG] [LOCAL ] SAFE: Trimmed 44416 records to 30751 (keeping 200 days of data) [2025-10-17T21:22:43.748290] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-17T21:22:43.881991] [DEBUG] [LOCAL ] SAFE: Primary data saved (30751 records). [2025-10-17T21:22:43.882117] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-17T21:22:43.882213] [INFO ] [MAIN ] Update Progress: 1857/2368 symbols completed. SAFE took 38.3s. Estimated remaining: 1h 12m 17s. Rate: 7.1 symbols/min [2025-10-17T21:22:44.048118] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:22:44.096183] [DEBUG] [LOCAL ] SAN: Loaded 53355 existing records from primary storage. [2025-10-17T21:22:44.096488] [INFO ] [MAIN ] SAN: Loaded 53355 existing records. [2025-10-17T21:22:44.160547] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-17T21:22:44.177953] [INFO ] [REMOTE ] SAJ: Full fetch complete (930 records). [2025-10-17T21:22:44.196438] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-17T21:22:44.381676] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:22:44.397372] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-17T21:22:44.402575] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-17T21:22:44.430260] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-17T21:22:44.438163] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-17T21:22:44.543014] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-17T21:22:44.553891] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-17T21:22:44.558290] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-17T21:22:44.558354] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-17T21:22:44.558683] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-17T21:22:44.602197] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-17T21:22:44.632573] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-17T21:22:44.681859] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-17T21:22:44.702371] [INFO ] [MAIN ] Update Progress: 1858/2368 symbols completed. SAJ took 26.5s. Estimated remaining: 1h 12m 6s. Rate: 7.1 symbols/min [2025-10-17T21:22:44.961568] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:22:44.979438] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:22:45.028325] [DEBUG] [LOCAL ] SAND: Loaded 52246 existing records from primary storage. [2025-10-17T21:22:45.028613] [INFO ] [MAIN ] SAND: Loaded 52246 existing records. [2025-10-17T21:22:45.199023] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:22:45.199250] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-10-17T21:22:45.199297] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-10-17T21:22:45.199469] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-10-17T21:22:45.199506] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-10-17T21:22:45.347672] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-17T21:22:45.551850] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:22:45.665308] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T21:22:46.142342] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-10-17T21:22:46.652991] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T21:22:46.942357] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-17T21:22:47.742352] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-10-17T21:22:47.996838] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T21:22:48.244324] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T21:22:48.247024] [INFO ] [REMOTE ] SAH: Full fetch complete (30809 records). [2025-10-17T21:22:48.247127] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-17T21:22:48.547563] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-17T21:22:48.620025] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-17T21:22:48.620109] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-17T21:22:48.620776] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-17T21:22:48.620839] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-17T21:22:48.621739] [DEBUG] [LOCAL ] SAH: Trimmed 30809 records to 21442 (keeping 200 days of data) [2025-10-17T21:22:48.754038] [DEBUG] [LOCAL ] SAH: Primary data saved (21442 records). [2025-10-17T21:22:48.754166] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-17T21:22:48.754254] [INFO ] [MAIN ] Update Progress: 1859/2368 symbols completed. SAH took 38.3s. Estimated remaining: 1h 11m 56s. Rate: 7.1 symbols/min [2025-10-17T21:22:48.924418] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:22:48.972369] [DEBUG] [LOCAL ] SAP: Loaded 50240 existing records from primary storage. [2025-10-17T21:22:48.972738] [INFO ] [MAIN ] SAP: Loaded 50240 existing records. [2025-10-17T21:22:49.152335] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:22:49.152593] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-17T21:22:49.152638] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-17T21:22:49.152901] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-17T21:22:49.152970] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-17T21:22:49.347415] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-10-17T21:22:49.523947] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:22:49.608896] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T21:22:49.659597] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-17T21:22:50.142356] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-17T21:22:50.942323] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-10-17T21:22:51.158782] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T21:22:51.742358] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-10-17T21:22:51.850092] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T21:22:52.542354] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-17T21:22:53.342281] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-17T21:23:06.384415] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (14.64 seconds). [2025-10-17T21:23:06.394243] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-10-17T21:23:06.689473] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (15.75 seconds). [2025-10-17T21:23:06.699037] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-17T21:23:06.908199] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (13.57 seconds). [2025-10-17T21:23:06.913758] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-17T21:23:06.976088] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (14.43 seconds). [2025-10-17T21:23:06.986052] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-17T21:23:07.557169] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-17T21:23:07.560230] [INFO ] [REMOTE ] SAM: Full fetch complete (31143 records). [2025-10-17T21:23:07.560314] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-17T21:23:07.925915] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-17T21:23:07.926044] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-17T21:23:07.926689] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-17T21:23:07.927172] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-17T21:23:07.927965] [DEBUG] [LOCAL ] SAM: Trimmed 31143 records to 21607 (keeping 200 days of data) [2025-10-17T21:23:08.062262] [DEBUG] [LOCAL ] SAM: Primary data saved (21607 records). [2025-10-17T21:23:08.062397] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-17T21:23:08.062481] [INFO ] [MAIN ] Update Progress: 1860/2368 symbols completed. SAM took 47.4s. Estimated remaining: 1h 11m 51s. Rate: 7.1 symbols/min [2025-10-17T21:23:08.257315] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:23:08.281228] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T21:23:08.292464] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-10-17T21:23:08.315973] [DEBUG] [LOCAL ] SAR: Loaded 17353 existing records from primary storage. [2025-10-17T21:23:08.317026] [INFO ] [MAIN ] SAR: Loaded 17353 existing records. [2025-10-17T21:23:08.494871] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:23:08.495136] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-17T21:23:08.495196] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-17T21:23:08.495631] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-10-17T21:23:08.495723] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-17T21:23:08.863444] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:23:08.863881] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-10-17T21:23:08.934630] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-17T21:23:08.945020] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-17T21:23:09.056864] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-17T21:23:09.067904] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-17T21:23:09.803343] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-17T21:23:09.806582] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-17T21:23:10.027061] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T21:23:10.038041] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-10-17T21:23:10.329975] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-17T21:23:10.332859] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-17T21:23:10.491495] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T21:23:10.500531] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-17T21:23:10.584273] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T21:23:10.595342] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-17T21:23:11.395712] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T21:23:11.399475] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-17T21:23:11.788585] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T21:23:11.799827] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-10-17T21:23:12.389590] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-17T21:23:12.400594] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-17T21:23:12.520594] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T21:23:12.520046] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-17T21:23:12.535808] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-17T21:23:12.536250] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-17T21:23:13.553353] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T21:23:13.563888] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-10-17T21:23:13.587775] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-17T21:23:13.591531] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-17T21:23:14.191708] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-17T21:23:14.202251] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-17T21:23:14.445441] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T21:23:14.457015] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-17T21:23:14.631589] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T21:23:14.635546] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-17T21:23:15.483788] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-17T21:23:15.495573] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-10-17T21:23:16.062414] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T21:23:16.066066] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-17T21:23:16.408967] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-17T21:23:16.421059] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-17T21:23:16.852608] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-17T21:23:16.863206] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-17T21:23:16.898209] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T21:23:16.902977] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-17T21:23:16.989770] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T21:23:17.000949] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-10-17T21:23:17.993224] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T21:23:17.997455] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-17T21:23:18.171926] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T21:23:18.183553] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-17T21:23:18.295991] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T21:23:18.483575] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T21:23:18.942379] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-10. [2025-10-17T21:23:19.144708] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-17T21:23:19.742264] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-17T21:23:20.082188] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T21:23:20.542278] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-17T21:23:20.722986] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T21:23:20.740047] [INFO ] [REMOTE ] SAND: Full fetch complete (74774 records). [2025-10-17T21:23:20.741079] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T21:23:20.741221] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-10-17T21:23:20.745230] [INFO ] [REMOTE ] SAR: Full fetch complete (23956 records). [2025-10-17T21:23:20.745355] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-17T21:23:21.345399] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-17T21:23:21.518172] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-17T21:23:21.557099] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-17T21:23:21.576249] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-17T21:23:21.576437] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-10-17T21:23:21.576619] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-10-17T21:23:21.576741] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-17T21:23:21.577842] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-10-17T21:23:21.577956] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-10-17T21:23:21.580164] [DEBUG] [LOCAL ] SAND: Trimmed 74774 records to 52633 (keeping 200 days of data) [2025-10-17T21:23:21.580384] [DEBUG] [LOCAL ] SAR: Trimmed 23956 records to 17471 (keeping 200 days of data) [2025-10-17T21:23:21.815263] [DEBUG] [LOCAL ] SAR: Primary data saved (17471 records). [2025-10-17T21:23:21.818798] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-17T21:23:21.820067] [INFO ] [MAIN ] Update Progress: 1861/2368 symbols completed. SAR took 13.8s. Estimated remaining: 1h 11m 44s. Rate: 7.1 symbols/min [2025-10-17T21:23:22.096291] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:23:22.158829] [DEBUG] [LOCAL ] SARO: Loaded 48715 existing records from primary storage. [2025-10-17T21:23:22.162831] [INFO ] [MAIN ] SARO: Loaded 48715 existing records. [2025-10-17T21:23:22.416269] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:23:22.416561] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-17T21:23:22.416814] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-17T21:23:22.417384] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-17T21:23:22.418194] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-17T21:23:22.554805] [DEBUG] [LOCAL ] SAND: Primary data saved (52633 records). [2025-10-17T21:23:22.615787] [INFO ] [MAIN ] SAND: Full history saved. [2025-10-17T21:23:22.680990] [INFO ] [MAIN ] Update Progress: 1862/2368 symbols completed. SAND took 38.0s. Estimated remaining: 1h 11m 33s. Rate: 7.1 symbols/min [2025-10-17T21:23:22.930153] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:23:22.906068] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-17T21:23:22.941099] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-10-17T21:23:23.011455] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-17T21:23:23.014939] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:23:23.015838] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-17T21:23:23.015894] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-17T21:23:23.016025] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-17T21:23:23.016080] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-17T21:23:23.016135] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-17T21:23:23.016178] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-17T21:23:23.375544] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:23:23.398436] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-17T21:23:23.406878] [INFO ] [REMOTE ] SAN: Full fetch complete (76542 records). [2025-10-17T21:23:23.407121] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-17T21:23:23.748471] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-10-17T21:23:23.882231] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-17T21:23:23.882314] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-17T21:23:23.883527] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-17T21:23:23.883594] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-17T21:23:23.885047] [DEBUG] [LOCAL ] SAN: Trimmed 76542 records to 53738 (keeping 200 days of data) [2025-10-17T21:23:24.091441] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-17T21:23:24.204517] [DEBUG] [LOCAL ] SAN: Primary data saved (53738 records). [2025-10-17T21:23:24.204704] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-17T21:23:24.204855] [INFO ] [MAIN ] Update Progress: 1863/2368 symbols completed. SAN took 40.3s. Estimated remaining: 1h 11m 23s. Rate: 7.1 symbols/min [2025-10-17T21:23:24.374590] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:23:24.374839] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-17T21:23:24.374899] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-17T21:23:24.375010] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-17T21:23:24.375052] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-17T21:23:24.375094] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-17T21:23:24.375127] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-17T21:23:24.557991] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-17T21:23:24.772207] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:23:24.774755] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T21:23:24.816429] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T21:23:24.963118] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-17T21:23:25.342288] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-17T21:23:26.142256] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-10-17T21:23:26.859623] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-17T21:23:26.893145] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T21:23:26.942309] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-17T21:23:27.742361] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-17T21:23:28.088834] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-17T21:23:28.112481] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T21:23:28.542378] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-17T21:23:29.342384] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-17T21:23:29.803793] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-17T21:23:30.142263] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-17T21:23:30.488482] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T21:23:30.553500] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-17T21:23:30.942269] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-17T21:23:31.359849] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-17T21:23:31.742295] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-17T21:23:32.542342] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-17T21:23:33.342304] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-17T21:23:33.661957] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T21:23:33.669131] [INFO ] [REMOTE ] SAP: Full fetch complete (72198 records). [2025-10-17T21:23:33.669324] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-17T21:23:33.743372] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-17T21:23:34.069986] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-17T21:23:34.070087] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-17T21:23:34.071448] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-17T21:23:34.071528] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-17T21:23:34.073141] [DEBUG] [LOCAL ] SAP: Trimmed 72198 records to 50604 (keeping 200 days of data) [2025-10-17T21:23:34.163960] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-17T21:23:34.203890] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T21:23:34.419456] [DEBUG] [LOCAL ] SAP: Primary data saved (50604 records). [2025-10-17T21:23:34.419583] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-17T21:23:34.419713] [INFO ] [MAIN ] Update Progress: 1864/2368 symbols completed. SAP took 45.7s. Estimated remaining: 1h 11m 15s. Rate: 7.1 symbols/min [2025-10-17T21:23:34.594040] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-17T21:23:34.595566] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:23:34.595811] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-17T21:23:34.596919] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-17T21:23:34.597060] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-17T21:23:34.597131] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-17T21:23:34.597210] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-17T21:23:34.597263] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-17T21:23:34.950313] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:23:34.947030] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-17T21:23:35.277499] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-17T21:23:35.742278] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-10-17T21:23:36.103481] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-17T21:23:36.542293] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-17T21:23:36.876344] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-17T21:23:37.342298] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-17T21:23:37.674739] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-17T21:23:38.142321] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-17T21:23:38.248581] [DEBUG] [REMOTE ] SAZ: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-17T21:23:38.249326] [WARN ] [REMOTE ] SAZ: No data returned for month 2025-02 [2025-10-17T21:23:38.249442] [FATAL] [REMOTE ] SAZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:23:38.249534] [FATAL] [MAIN ] SAZ: Failed to fetch primary data. [2025-10-17T21:23:38.249598] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:23:38.249700] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-17T21:23:38.249781] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-17T21:23:38.249819] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-17T21:23:38.249858] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-17T21:23:38.249921] [INFO ] [MAIN ] Update Progress: 1865/2368 symbols completed. SAZ took 3.8s. Estimated remaining: 1h 11m 5s. Rate: 7.1 symbols/min [2025-10-17T21:23:38.431362] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:23:38.471078] [DEBUG] [LOCAL ] SB: Loaded 33128 existing records from primary storage. [2025-10-17T21:23:38.471399] [INFO ] [MAIN ] SB: Loaded 33128 existing records. [2025-10-17T21:23:38.718265] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:23:38.718545] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-17T21:23:38.718625] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-17T21:23:38.718906] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-17T21:23:38.718980] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-17T21:23:38.947471] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-17T21:23:39.242978] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:23:39.387455] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-17T21:23:39.742300] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-17T21:23:40.542349] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-17T21:23:40.880172] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-17T21:23:41.342324] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-10-17T21:23:41.380604] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T21:23:42.142387] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-17T21:23:42.942432] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-17T21:23:42.977109] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T21:23:43.262957] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-17T21:23:43.744847] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-17T21:23:43.748101] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T21:23:44.097478] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-17T21:23:44.542294] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-17T21:23:44.877749] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-17T21:23:44.878506] [INFO ] [REMOTE ] SAT: Full fetch complete (1499 records). [2025-10-17T21:23:44.878601] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-17T21:23:45.055636] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-17T21:23:45.055848] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-17T21:23:45.055918] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-17T21:23:45.056029] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-17T21:23:45.056130] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-17T21:23:45.056181] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-17T21:23:45.056239] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-17T21:23:45.056323] [INFO ] [MAIN ] Update Progress: 1866/2368 symbols completed. SAT took 22.3s. Estimated remaining: 1h 10m 56s. Rate: 7.1 symbols/min [2025-10-17T21:23:45.227861] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:23:45.228051] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-17T21:23:45.228088] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-17T21:23:45.228228] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-17T21:23:45.228305] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-17T21:23:45.228369] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-17T21:23:45.228404] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-17T21:23:45.347384] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-17T21:23:45.594544] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:23:46.142297] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-17T21:23:46.570088] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-17T21:23:46.899067] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T21:23:46.942290] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-17T21:23:47.742276] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-17T21:23:48.542362] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-10-17T21:23:48.622592] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T21:23:48.744797] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:23:48.745124] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-10-17T21:23:48.745238] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:23:48.745333] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-17T21:23:48.745419] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:23:48.745513] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-17T21:23:48.745613] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-17T21:23:48.745689] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-17T21:23:48.745760] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-17T21:23:48.745831] [INFO ] [MAIN ] Update Progress: 1867/2368 symbols completed. SBDS took 3.7s. Estimated remaining: 1h 10m 47s. Rate: 7.1 symbols/min [2025-10-17T21:23:48.916135] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:23:48.963584] [DEBUG] [LOCAL ] SBH: Loaded 50242 existing records from primary storage. [2025-10-17T21:23:48.963957] [INFO ] [MAIN ] SBH: Loaded 50242 existing records. [2025-10-17T21:23:49.145082] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:23:49.145400] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-17T21:23:49.145450] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-17T21:23:49.145636] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-10-17T21:23:49.145733] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-17T21:23:49.347576] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-17T21:23:49.435759] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T21:23:49.554723] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:23:50.142353] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-17T21:23:50.942275] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-17T21:23:51.094300] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T21:23:51.272919] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-17T21:23:51.635519] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T21:23:51.742251] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-17T21:23:52.542369] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-10-17T21:23:53.207402] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T21:23:53.342305] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-17T21:23:53.661789] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-17T21:23:54.142257] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-17T21:23:54.190072] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T21:23:54.507485] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-17T21:23:54.942340] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-17T21:23:55.742284] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-17T21:23:56.333451] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-17T21:23:56.542322] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-17T21:23:57.030260] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-17T21:23:57.342274] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-17T21:23:57.375910] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T21:23:58.142311] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-17T21:23:58.732778] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-17T21:23:58.942347] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-17T21:23:59.710579] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T21:23:59.742300] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-17T21:24:00.225127] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T21:24:00.542327] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-17T21:24:01.342305] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-17T21:24:01.695169] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-17T21:24:01.696090] [INFO ] [REMOTE ] SAY: Full fetch complete (1382 records). [2025-10-17T21:24:01.696271] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-17T21:24:01.934803] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-17T21:24:01.943203] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-17T21:24:01.953260] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-17T21:24:01.954027] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-17T21:24:01.954513] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-17T21:24:01.955068] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-17T21:24:01.955204] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-17T21:24:01.955285] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-17T21:24:01.955395] [INFO ] [MAIN ] Update Progress: 1868/2368 symbols completed. SAY took 37.8s. Estimated remaining: 1h 10m 39s. Rate: 7.1 symbols/min [2025-10-17T21:24:02.120917] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:24:02.131371] [DEBUG] [LOCAL ] SBI: Loaded 7626 existing records from primary storage. [2025-10-17T21:24:02.131564] [INFO ] [MAIN ] SBI: Loaded 7626 existing records. [2025-10-17T21:24:02.151353] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-17T21:24:02.251563] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T21:24:02.334031] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:24:02.334225] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-17T21:24:02.334273] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-17T21:24:02.334417] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-17T21:24:02.334454] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-17T21:24:02.673090] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:24:02.942264] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-10-17T21:24:03.648751] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-17T21:24:03.747417] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-17T21:24:03.761070] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T21:24:04.542285] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-17T21:24:05.097070] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-17T21:24:05.342317] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-17T21:24:06.142332] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-17T21:24:06.283539] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T21:24:06.671165] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T21:24:06.677901] [INFO ] [REMOTE ] SARO: Full fetch complete (69004 records). [2025-10-17T21:24:06.678007] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-17T21:24:06.951781] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-17T21:24:07.083805] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-17T21:24:07.083892] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-17T21:24:07.084977] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-17T21:24:07.085061] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-17T21:24:07.086471] [DEBUG] [LOCAL ] SARO: Trimmed 69004 records to 49102 (keeping 200 days of data) [2025-10-17T21:24:07.396337] [DEBUG] [LOCAL ] SARO: Primary data saved (49102 records). [2025-10-17T21:24:07.396790] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-17T21:24:07.398230] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T21:24:07.404898] [INFO ] [MAIN ] Update Progress: 1869/2368 symbols completed. SARO took 45.6s. Estimated remaining: 1h 10m 30s. Rate: 7.1 symbols/min [2025-10-17T21:24:07.445020] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T21:24:07.590247] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:24:07.600836] [DEBUG] [LOCAL ] SBR: Loaded 7854 existing records from primary storage. [2025-10-17T21:24:07.601062] [INFO ] [MAIN ] SBR: Loaded 7854 existing records. [2025-10-17T21:24:07.745218] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-17T21:24:07.816239] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:24:07.816562] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-17T21:24:07.816607] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-17T21:24:07.816791] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-17T21:24:07.816846] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-17T21:24:08.174980] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:24:08.442488] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-17T21:24:08.542290] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-17T21:24:09.342287] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-10-17T21:24:10.142415] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-17T21:24:10.156220] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T21:24:10.300012] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T21:24:10.841380] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-17T21:24:10.942300] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-17T21:24:11.737102] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-17T21:24:11.742234] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-17T21:24:12.347213] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T21:24:12.542380] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-17T21:24:13.340865] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-17T21:24:13.343577] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-17T21:24:14.142356] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-17T21:24:14.942294] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-17T21:24:15.053120] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T21:24:15.353289] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T21:24:15.358007] [INFO ] [REMOTE ] SB: Full fetch complete (49564 records). [2025-10-17T21:24:15.358173] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-17T21:24:15.733312] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T21:24:15.748391] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-17T21:24:15.753264] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-17T21:24:15.755226] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-17T21:24:15.756258] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-17T21:24:15.756432] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-17T21:24:15.757537] [DEBUG] [LOCAL ] SB: Trimmed 49564 records to 33292 (keeping 200 days of data) [2025-10-17T21:24:15.945599] [DEBUG] [LOCAL ] SB: Primary data saved (33292 records). [2025-10-17T21:24:15.945760] [INFO ] [MAIN ] SB: Full history saved. [2025-10-17T21:24:15.945846] [INFO ] [MAIN ] Update Progress: 1870/2368 symbols completed. SB took 37.7s. Estimated remaining: 1h 10m 22s. Rate: 7.1 symbols/min [2025-10-17T21:24:16.114176] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:24:16.160687] [DEBUG] [LOCAL ] SBS: Loaded 49699 existing records from primary storage. [2025-10-17T21:24:16.161015] [INFO ] [MAIN ] SBS: Loaded 49699 existing records. [2025-10-17T21:24:16.348335] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:24:16.348611] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-17T21:24:16.348750] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-17T21:24:16.348948] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-17T21:24:16.349004] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-17T21:24:16.516737] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-17T21:24:16.550624] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-17T21:24:16.728778] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:24:17.342313] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-10-17T21:24:18.142256] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-17T21:24:18.363850] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T21:24:18.921203] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T21:24:18.922742] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T21:24:18.942252] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-17T21:24:19.547791] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-17T21:24:19.742287] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-17T21:24:20.542333] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-17T21:24:21.279905] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-17T21:24:21.342248] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-17T21:24:21.380882] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T21:24:22.142311] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-17T21:24:22.875532] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T21:24:22.877138] [INFO ] [REMOTE ] SBI: Full fetch complete (10637 records). [2025-10-17T21:24:22.877206] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-17T21:24:22.952092] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-17T21:24:23.126287] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T21:24:23.282026] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-17T21:24:23.282094] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-17T21:24:23.282324] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-17T21:24:23.282361] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-17T21:24:23.282812] [DEBUG] [LOCAL ] SBI: Trimmed 10637 records to 7760 (keeping 200 days of data) [2025-10-17T21:24:23.326697] [DEBUG] [LOCAL ] SBI: Primary data saved (7760 records). [2025-10-17T21:24:23.326847] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-17T21:24:23.326935] [INFO ] [MAIN ] Update Progress: 1871/2368 symbols completed. SBI took 21.4s. Estimated remaining: 1h 10m 13s. Rate: 7.1 symbols/min [2025-10-17T21:24:23.493453] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:24:23.508994] [DEBUG] [LOCAL ] SBSI: Loaded 15054 existing records from primary storage. [2025-10-17T21:24:23.509210] [INFO ] [MAIN ] SBSI: Loaded 15054 existing records. [2025-10-17T21:24:23.682303] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:24:23.682571] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-17T21:24:23.682623] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-17T21:24:23.682894] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-10-17T21:24:23.682949] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-17T21:24:23.744164] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-17T21:24:23.785777] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-17T21:24:24.055090] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:24:24.542266] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-17T21:24:25.317573] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-17T21:24:25.342240] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-17T21:24:25.472700] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T21:24:26.075323] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-17T21:24:26.142285] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-17T21:24:26.942345] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-17T21:24:27.742264] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-10-17T21:24:27.771145] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T21:24:27.771954] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T21:24:27.783113] [INFO ] [REMOTE ] SBH: Full fetch complete (73081 records). [2025-10-17T21:24:27.783752] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-17T21:24:28.174453] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-17T21:24:28.174563] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-17T21:24:28.176002] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-17T21:24:28.176073] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-17T21:24:28.177689] [DEBUG] [LOCAL ] SBH: Trimmed 73081 records to 50615 (keeping 200 days of data) [2025-10-17T21:24:28.482896] [DEBUG] [LOCAL ] SBH: Primary data saved (50615 records). [2025-10-17T21:24:28.483045] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-17T21:24:28.483546] [INFO ] [MAIN ] Update Progress: 1872/2368 symbols completed. SBH took 39.7s. Estimated remaining: 1h 10m 3s. Rate: 7.1 symbols/min [2025-10-17T21:24:28.548517] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-17T21:24:28.678855] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:24:28.718351] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T21:24:28.741471] [DEBUG] [LOCAL ] SBSW: Loaded 53562 existing records from primary storage. [2025-10-17T21:24:28.741892] [INFO ] [MAIN ] SBSW: Loaded 53562 existing records. [2025-10-17T21:24:28.918687] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:24:28.918963] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-17T21:24:28.919012] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-17T21:24:28.919213] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-17T21:24:28.919271] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-17T21:24:29.279281] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:24:29.342249] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-10-17T21:24:30.142287] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-17T21:24:30.173813] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-17T21:24:30.812764] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T21:24:30.942293] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-17T21:24:31.118026] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-17T21:24:31.742394] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-17T21:24:32.373473] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T21:24:32.542273] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-17T21:24:32.625236] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T21:24:33.342284] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-17T21:24:33.971470] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-17T21:24:34.142294] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-17T21:24:34.242568] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T21:24:34.942323] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-17T21:24:34.962048] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-17T21:24:35.742357] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-17T21:24:36.542310] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-17T21:24:36.775410] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T21:24:37.084930] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-17T21:24:37.342272] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-17T21:24:37.398078] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-17T21:24:38.142347] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-17T21:24:38.942274] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-17T21:24:39.083500] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-17T21:24:39.202073] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-17T21:24:39.723142] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T21:24:39.725188] [INFO ] [REMOTE ] SBR: Full fetch complete (11346 records). [2025-10-17T21:24:39.725257] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-17T21:24:39.747519] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-17T21:24:40.081461] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-17T21:24:40.081534] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-17T21:24:40.081816] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-17T21:24:40.081876] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-17T21:24:40.082328] [DEBUG] [LOCAL ] SBR: Trimmed 11346 records to 7937 (keeping 200 days of data) [2025-10-17T21:24:40.129878] [DEBUG] [LOCAL ] SBR: Primary data saved (7937 records). [2025-10-17T21:24:40.129984] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-17T21:24:40.130059] [INFO ] [MAIN ] Update Progress: 1873/2368 symbols completed. SBR took 32.7s. Estimated remaining: 1h 9m 56s. Rate: 7.1 symbols/min [2025-10-17T21:24:40.295535] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:24:40.295685] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-17T21:24:40.295736] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-17T21:24:40.295844] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-17T21:24:40.295885] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-17T21:24:40.295925] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-17T21:24:40.295957] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-17T21:24:40.547485] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-17T21:24:40.644892] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:24:40.841217] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T21:24:41.342253] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-10-17T21:24:41.596072] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-10-17T21:24:42.142270] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-17T21:24:42.479772] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T21:24:42.942272] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-17T21:24:42.964446] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T21:24:43.169322] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-17T21:24:43.742291] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-17T21:24:44.060730] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-17T21:24:44.542304] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-17T21:24:45.342283] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-17T21:24:46.142276] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-17T21:24:46.535316] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T21:24:46.942325] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-17T21:24:47.094291] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T21:24:47.170725] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-17T21:24:47.271090] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-17T21:24:47.742349] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-17T21:24:48.542301] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-17T21:24:49.342276] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-17T21:24:49.427254] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T21:24:49.574674] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-17T21:24:49.588723] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T21:24:50.142297] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-17T21:24:50.942274] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-17T21:24:51.092492] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T21:24:51.742301] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-17T21:24:52.542329] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-17T21:24:52.867635] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-17T21:24:52.986436] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-17T21:24:53.313252] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T21:24:53.342264] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-17T21:24:54.142379] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-17T21:24:54.942277] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-17T21:24:55.048184] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T21:24:55.636125] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T21:24:55.742252] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-17T21:24:55.904346] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-17T21:24:56.542271] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-17T21:24:57.342306] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-17T21:24:57.408474] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-17T21:24:57.674212] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-17T21:24:58.142267] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-17T21:24:58.206578] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T21:24:58.209274] [INFO ] [REMOTE ] SBSI: Full fetch complete (21313 records). [2025-10-17T21:24:58.209347] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-17T21:24:58.590797] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-17T21:24:58.590909] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-17T21:24:58.591630] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-17T21:24:58.591709] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-17T21:24:58.592450] [DEBUG] [LOCAL ] SBSI: Trimmed 21313 records to 15203 (keeping 200 days of data) [2025-10-17T21:24:58.699120] [DEBUG] [LOCAL ] SBSI: Primary data saved (15203 records). [2025-10-17T21:24:58.699367] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-17T21:24:58.699489] [INFO ] [MAIN ] Update Progress: 1874/2368 symbols completed. SBSI took 35.4s. Estimated remaining: 1h 9m 50s. Rate: 7.1 symbols/min [2025-10-17T21:24:58.903902] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:24:58.956021] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-17T21:24:58.960416] [DEBUG] [LOCAL ] SCCO: Loaded 49968 existing records from primary storage. [2025-10-17T21:24:58.961061] [INFO ] [MAIN ] SCCO: Loaded 49968 existing records. [2025-10-17T21:24:59.175259] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:24:59.175632] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-17T21:24:59.175730] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-17T21:24:59.176061] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-17T21:24:59.176158] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-17T21:24:59.620946] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:24:59.742273] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-17T21:25:00.011245] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T21:25:00.317756] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-17T21:25:00.542334] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-17T21:25:00.586459] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T21:25:00.593211] [INFO ] [REMOTE ] SBS: Full fetch complete (70460 records). [2025-10-17T21:25:00.593376] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-17T21:25:00.967493] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-17T21:25:00.967571] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-17T21:25:00.968737] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-17T21:25:00.968802] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-17T21:25:00.970123] [DEBUG] [LOCAL ] SBS: Trimmed 70460 records to 50057 (keeping 200 days of data) [2025-10-17T21:25:01.266076] [DEBUG] [LOCAL ] SBS: Primary data saved (50057 records). [2025-10-17T21:25:01.266205] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-17T21:25:01.266285] [INFO ] [MAIN ] Update Progress: 1875/2368 symbols completed. SBS took 45.3s. Estimated remaining: 1h 9m 40s. Rate: 7.1 symbols/min [2025-10-17T21:25:01.347604] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-10-17T21:25:01.441732] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:25:01.463468] [DEBUG] [LOCAL ] SCD: Loaded 13499 existing records from primary storage. [2025-10-17T21:25:01.463740] [INFO ] [MAIN ] SCD: Loaded 13499 existing records. [2025-10-17T21:25:01.638314] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:25:01.638575] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-17T21:25:01.638623] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-17T21:25:01.638885] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-17T21:25:01.638941] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-17T21:25:01.984581] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:25:02.142304] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-10-17T21:25:02.835315] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-17T21:25:02.928770] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-17T21:25:02.934039] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T21:25:02.943446] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-17T21:25:03.742351] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-17T21:25:04.542410] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-17T21:25:04.706750] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-17T21:25:05.312852] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T21:25:05.342323] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-17T21:25:05.862006] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-17T21:25:05.872965] [INFO ] [REMOTE ] SBSW: Full fetch complete (76732 records). [2025-10-17T21:25:05.873280] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-17T21:25:06.147403] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-17T21:25:06.267032] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-17T21:25:06.267111] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-17T21:25:06.268437] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-17T21:25:06.268503] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-17T21:25:06.270074] [DEBUG] [LOCAL ] SBSW: Trimmed 76732 records to 53952 (keeping 200 days of data) [2025-10-17T21:25:06.582553] [DEBUG] [LOCAL ] SBSW: Primary data saved (53952 records). [2025-10-17T21:25:06.582762] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-17T21:25:06.583326] [INFO ] [MAIN ] Update Progress: 1876/2368 symbols completed. SBSW took 38.1s. Estimated remaining: 1h 9m 31s. Rate: 7.1 symbols/min [2025-10-17T21:25:06.695311] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-17T21:25:06.774814] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:25:06.824786] [DEBUG] [LOCAL ] SCHW: Loaded 54075 existing records from primary storage. [2025-10-17T21:25:06.825095] [INFO ] [MAIN ] SCHW: Loaded 54075 existing records. [2025-10-17T21:25:06.945514] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-17T21:25:07.008120] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:25:07.008498] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-17T21:25:07.008602] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-17T21:25:07.008947] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-10-17T21:25:07.009004] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-17T21:25:07.352824] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-17T21:25:07.402045] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:25:07.404932] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-17T21:25:07.742287] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-10-17T21:25:08.542351] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-17T21:25:09.342318] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-17T21:25:09.836302] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-17T21:25:09.865433] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-17T21:25:09.939888] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T21:25:10.142325] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-17T21:25:10.942328] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-17T21:25:10.992044] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T21:25:11.742338] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-17T21:25:12.542276] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-17T21:25:12.920509] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-17T21:25:13.342259] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-17T21:25:13.371185] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-17T21:25:13.404065] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T21:25:13.682771] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-17T21:25:13.683460] [INFO ] [REMOTE ] SBXD: Full fetch complete (3121 records). [2025-10-17T21:25:13.683546] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-17T21:25:13.857882] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 177 unique days, need 200 days [2025-10-17T21:25:13.858112] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-17T21:25:13.858183] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-17T21:25:13.858255] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-17T21:25:13.858322] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-17T21:25:13.858357] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-17T21:25:13.858397] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-17T21:25:13.858451] [INFO ] [MAIN ] Update Progress: 1877/2368 symbols completed. SBXD took 33.7s. Estimated remaining: 1h 9m 22s. Rate: 7.1 symbols/min [2025-10-17T21:25:14.142287] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-17T21:25:14.887977] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T21:25:14.942308] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-17T21:25:15.742294] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-17T21:25:16.542286] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-17T21:25:16.804518] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-17T21:25:17.135363] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-17T21:25:17.209514] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T21:25:17.342297] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-17T21:25:18.142261] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-17T21:25:18.384742] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T21:25:18.942276] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-17T21:25:19.682619] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T21:25:19.742273] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-17T21:25:19.889852] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T21:25:20.542301] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-17T21:25:21.342287] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-17T21:25:21.535321] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T21:25:22.142322] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-17T21:25:22.236456] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T21:25:22.525800] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-17T21:25:22.942348] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-17T21:25:23.673513] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T21:25:23.742361] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-17T21:25:24.542345] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-17T21:25:25.021914] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-17T21:25:25.342383] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-17T21:25:25.399807] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-17T21:25:25.402430] [INFO ] [REMOTE ] SCD: Full fetch complete (17004 records). [2025-10-17T21:25:25.402515] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-17T21:25:25.771379] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-17T21:25:25.864886] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-17T21:25:25.864967] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-17T21:25:25.865379] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-17T21:25:25.865419] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-17T21:25:25.866094] [DEBUG] [LOCAL ] SCD: Trimmed 17004 records to 13601 (keeping 200 days of data) [2025-10-17T21:25:25.948402] [DEBUG] [LOCAL ] SCD: Primary data saved (13601 records). [2025-10-17T21:25:25.948541] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-17T21:25:25.948622] [INFO ] [MAIN ] Update Progress: 1878/2368 symbols completed. SCD took 24.7s. Estimated remaining: 1h 9m 14s. Rate: 7.1 symbols/min [2025-10-17T21:25:26.142407] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-17T21:25:27.285127] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-17T21:25:27.296774] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-17T21:25:28.037148] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T21:25:28.044317] [INFO ] [REMOTE ] SCCO: Full fetch complete (71838 records). [2025-10-17T21:25:28.044469] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-17T21:25:28.423943] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-17T21:25:28.424021] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-17T21:25:28.425115] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-17T21:25:28.425177] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-17T21:25:28.426446] [DEBUG] [LOCAL ] SCCO: Trimmed 71838 records to 50329 (keeping 200 days of data) [2025-10-17T21:25:28.727606] [DEBUG] [LOCAL ] SCCO: Primary data saved (50329 records). [2025-10-17T21:25:28.727775] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-17T21:25:28.727879] [INFO ] [MAIN ] Update Progress: 1879/2368 symbols completed. SCCO took 30.0s. Estimated remaining: 1h 9m 4s. Rate: 7.1 symbols/min [2025-10-17T21:25:29.186519] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-17T21:25:29.197277] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-17T21:25:31.278511] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-17T21:25:31.290286] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-17T21:25:33.310271] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-17T21:25:33.321477] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-17T21:25:35.346375] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-17T21:25:35.357931] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-17T21:25:37.293426] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T21:25:37.301045] [INFO ] [REMOTE ] SCHW: Full fetch complete (77865 records). [2025-10-17T21:25:37.301211] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-17T21:25:37.702934] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-17T21:25:37.703040] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-17T21:25:37.704332] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-17T21:25:37.704398] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-17T21:25:37.705949] [DEBUG] [LOCAL ] SCHW: Trimmed 77865 records to 54465 (keeping 200 days of data) [2025-10-17T21:25:38.047141] [DEBUG] [LOCAL ] SCHW: Primary data saved (54465 records). [2025-10-17T21:25:38.047305] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-17T21:25:38.047465] [INFO ] [MAIN ] Update Progress: 1880/2368 symbols completed. SCHW took 31.5s. Estimated remaining: 1h 8m 56s. Rate: 7.1 symbols/min [2025-10-17T21:25:38.576302] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:25:38.749747] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:25:38.781689] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:25:38.800862] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:25:38.832928] [DEBUG] [LOCAL ] SCL: Loaded 15067 existing records from primary storage. [2025-10-17T21:25:38.833565] [INFO ] [MAIN ] SCL: Loaded 15067 existing records. [2025-10-17T21:25:38.909671] [DEBUG] [LOCAL ] SCM: Loaded 20377 existing records from primary storage. [2025-10-17T21:25:38.961100] [INFO ] [MAIN ] SCM: Loaded 20377 existing records. [2025-10-17T21:25:38.970741] [DEBUG] [LOCAL ] SCS: Loaded 43846 existing records from primary storage. [2025-10-17T21:25:39.031518] [INFO ] [MAIN ] SCS: Loaded 43846 existing records. [2025-10-17T21:25:39.242639] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:25:39.293429] [DEBUG] [LOCAL ] SCI: Loaded 46821 existing records from primary storage. [2025-10-17T21:25:39.326932] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-17T21:25:39.337565] [INFO ] [MAIN ] SCI: Loaded 46821 existing records. [2025-10-17T21:25:39.337457] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-17T21:25:39.410939] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:25:39.420048] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-10-17T21:25:39.435725] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-17T21:25:39.449910] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-17T21:25:39.449823] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-17T21:25:39.540527] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-17T21:25:39.552123] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-17T21:25:39.604355] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:25:39.673602] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-17T21:25:39.757524] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-17T21:25:39.810433] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-17T21:25:39.811840] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-17T21:25:39.853888] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:25:39.964042] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-17T21:25:40.002542] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-17T21:25:40.060538] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-10-17T21:25:40.060734] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-17T21:25:40.754271] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:25:40.783734] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-10-17T21:25:41.018630] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:25:41.063833] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:25:41.064483] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-10-17T21:25:41.087358] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-10-17T21:25:41.147145] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:25:41.147399] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-10-17T21:25:41.779374] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T21:25:41.783354] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-17T21:25:42.236375] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T21:25:42.240865] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-17T21:25:42.379336] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T21:25:42.383597] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-17T21:25:42.707761] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T21:25:42.716293] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-17T21:25:43.238872] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-17T21:25:43.243277] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-17T21:25:43.258816] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T21:25:43.263354] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-17T21:25:43.575356] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-17T21:25:43.583960] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-17T21:25:43.838103] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-17T21:25:43.845880] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-17T21:25:43.899038] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-17T21:25:43.902876] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-17T21:25:44.210939] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T21:25:44.214700] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-17T21:25:44.841162] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T21:25:44.849401] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-17T21:25:45.034365] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T21:25:45.054417] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T21:25:45.054721] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-17T21:25:45.059773] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-17T21:25:45.472146] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-17T21:25:45.477933] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-17T21:25:45.824304] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-17T21:25:45.828231] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-17T21:25:46.368450] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T21:25:46.378190] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-17T21:25:46.541763] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T21:25:46.593341] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T21:25:46.618595] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-17T21:25:46.942332] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-17T21:25:47.742395] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-17T21:25:47.969776] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T21:25:48.503347] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T21:25:48.542292] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-17T21:25:48.584284] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-17T21:25:49.342329] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-17T21:25:49.992190] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T21:25:50.142285] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-17T21:25:50.610214] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T21:25:50.942334] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-17T21:25:51.742287] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-17T21:25:52.194301] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-17T21:25:52.542383] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-17T21:25:52.852375] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T21:25:53.342327] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-17T21:25:54.120432] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T21:25:54.142351] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-17T21:25:54.700414] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T21:25:54.942363] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-17T21:25:55.373512] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (4.43 seconds). [2025-10-17T21:25:55.742309] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-17T21:25:55.920327] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T21:25:56.542395] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-17T21:25:57.342338] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-17T21:25:58.220013] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T21:25:58.230859] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-17T21:25:58.273565] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T21:25:58.942311] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-17T21:25:59.589841] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T21:25:59.596082] [INFO ] [REMOTE ] SCS: Full fetch complete (61134 records). [2025-10-17T21:25:59.596227] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-17T21:25:59.980993] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-17T21:25:59.981080] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-17T21:25:59.982102] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-17T21:25:59.982165] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-17T21:25:59.983414] [DEBUG] [LOCAL ] SCS: Trimmed 61134 records to 44145 (keeping 200 days of data) [2025-10-17T21:26:00.076956] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (4.33 seconds). [2025-10-17T21:26:00.083295] [INFO ] [REMOTE ] SCL: Full fetch complete (21547 records). [2025-10-17T21:26:00.085009] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-17T21:26:00.496826] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-17T21:26:00.497784] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-17T21:26:00.498911] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-17T21:26:00.499016] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-17T21:26:00.510292] [DEBUG] [LOCAL ] SCL: Trimmed 21547 records to 15195 (keeping 200 days of data) [2025-10-17T21:26:00.710001] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (5.77 seconds). [2025-10-17T21:26:00.737429] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-17T21:26:00.739380] [DEBUG] [LOCAL ] SCL: Primary data saved (15195 records). [2025-10-17T21:26:00.743234] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-17T21:26:00.743687] [INFO ] [MAIN ] Update Progress: 1881/2368 symbols completed. SCL took 22.7s. Estimated remaining: 1h 8m 51s. Rate: 7.1 symbols/min [2025-10-17T21:26:00.938969] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:26:00.970976] [DEBUG] [LOCAL ] SCS: Primary data saved (44145 records). [2025-10-17T21:26:00.971180] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-17T21:26:00.971296] [INFO ] [MAIN ] Update Progress: 1882/2368 symbols completed. SCS took 22.9s. Estimated remaining: 1h 8m 41s. Rate: 7.1 symbols/min [2025-10-17T21:26:01.088841] [DEBUG] [LOCAL ] SD: Loaded 28900 existing records from primary storage. [2025-10-17T21:26:01.182925] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:26:01.128067] [INFO ] [MAIN ] SD: Loaded 28900 existing records. [2025-10-17T21:26:01.179605] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-17T21:26:01.224930] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-17T21:26:01.281742] [DEBUG] [LOCAL ] SDHC: Loaded 10427 existing records from primary storage. [2025-10-17T21:26:01.287567] [INFO ] [MAIN ] SDHC: Loaded 10427 existing records. [2025-10-17T21:26:01.495536] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:26:01.539561] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-17T21:26:01.555357] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-17T21:26:01.577635] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-17T21:26:01.583177] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:26:01.583595] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-17T21:26:01.583524] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-17T21:26:01.588900] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-17T21:26:01.666186] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-17T21:26:01.697405] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-17T21:26:02.264286] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:26:02.273537] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-10-17T21:26:02.364495] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:26:02.365278] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-10-17T21:26:02.418314] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-17T21:26:02.476354] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T21:26:02.942333] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-17T21:26:03.292223] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T21:26:03.344835] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T21:26:03.742285] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-17T21:26:04.326867] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-17T21:26:04.542347] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-17T21:26:04.731639] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T21:26:05.342297] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-17T21:26:05.617322] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T21:26:06.142283] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-17T21:26:06.746251] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T21:26:06.942272] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-17T21:26:07.336435] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-17T21:26:07.742295] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-17T21:26:08.118195] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T21:26:08.122167] [INFO ] [REMOTE ] SCM: Full fetch complete (29181 records). [2025-10-17T21:26:08.122271] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-17T21:26:08.482034] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-17T21:26:08.482115] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-17T21:26:08.482701] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-17T21:26:08.482763] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-17T21:26:08.483439] [DEBUG] [LOCAL ] SCM: Trimmed 29181 records to 20521 (keeping 200 days of data) [2025-10-17T21:26:08.543736] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-17T21:26:08.610110] [DEBUG] [LOCAL ] SCM: Primary data saved (20521 records). [2025-10-17T21:26:08.610222] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-17T21:26:08.610296] [INFO ] [MAIN ] Update Progress: 1883/2368 symbols completed. SCM took 30.6s. Estimated remaining: 1h 8m 32s. Rate: 7.1 symbols/min [2025-10-17T21:26:08.782057] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:26:08.795339] [DEBUG] [LOCAL ] SDHY: Loaded 11120 existing records from primary storage. [2025-10-17T21:26:08.795561] [INFO ] [MAIN ] SDHY: Loaded 11120 existing records. [2025-10-17T21:26:08.987181] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:26:08.988522] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-17T21:26:08.988705] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-17T21:26:08.993800] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-17T21:26:08.993961] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-17T21:26:08.994001] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-17T21:26:09.344878] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-17T21:26:09.344817] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:26:09.354462] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-17T21:26:10.142338] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-17T21:26:10.942290] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-10-17T21:26:10.983271] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T21:26:11.506838] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-17T21:26:11.742326] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-17T21:26:11.916418] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-17T21:26:12.542331] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-17T21:26:13.162403] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T21:26:13.294105] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T21:26:13.342300] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-17T21:26:14.142310] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-17T21:26:14.268832] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-17T21:26:14.942342] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-17T21:26:15.629729] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T21:26:15.638688] [INFO ] [REMOTE ] SCI: Full fetch complete (67664 records). [2025-10-17T21:26:15.638825] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-17T21:26:15.747450] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-17T21:26:16.083541] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-17T21:26:16.083735] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-17T21:26:16.084838] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-17T21:26:16.084915] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-17T21:26:16.101527] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T21:26:16.107487] [DEBUG] [LOCAL ] SCI: Trimmed 67664 records to 47084 (keeping 200 days of data) [2025-10-17T21:26:16.414963] [DEBUG] [LOCAL ] SCI: Primary data saved (47084 records). [2025-10-17T21:26:16.415162] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-17T21:26:16.415782] [INFO ] [MAIN ] Update Progress: 1884/2368 symbols completed. SCI took 38.4s. Estimated remaining: 1h 8m 23s. Rate: 7.1 symbols/min [2025-10-17T21:26:16.547532] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-17T21:26:16.608548] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:26:16.619739] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-17T21:26:16.675101] [DEBUG] [LOCAL ] SDRL: Loaded 41849 existing records from primary storage. [2025-10-17T21:26:16.675576] [INFO ] [MAIN ] SDRL: Loaded 41849 existing records. [2025-10-17T21:26:16.959304] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:26:16.959614] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-17T21:26:16.959713] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-17T21:26:16.959968] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-17T21:26:16.960036] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-17T21:26:17.347455] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-17T21:26:17.497994] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:26:18.015423] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T21:26:18.142275] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-17T21:26:18.189558] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-17T21:26:18.942294] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-10-17T21:26:19.409480] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T21:26:19.742357] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-17T21:26:20.547451] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-17T21:26:20.567493] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-17T21:26:20.572087] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T21:26:21.342310] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-17T21:26:21.907431] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T21:26:22.091609] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T21:26:22.142253] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-17T21:26:22.897230] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-17T21:26:22.942343] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-17T21:26:23.742322] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-17T21:26:23.758915] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-17T21:26:24.542333] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-17T21:26:25.013077] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-17T21:26:25.137772] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-17T21:26:25.342332] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-17T21:26:26.086927] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T21:26:26.142302] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-17T21:26:26.867092] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T21:26:26.942350] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-17T21:26:27.742263] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-17T21:26:27.874970] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T21:26:28.542340] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-17T21:26:29.206533] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T21:26:29.332447] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T21:26:29.342242] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-17T21:26:30.073968] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-17T21:26:30.142308] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-17T21:26:30.942307] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-17T21:26:31.742349] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-17T21:26:31.774542] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-17T21:26:31.807905] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T21:26:32.542269] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-17T21:26:32.881214] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T21:26:32.885440] [INFO ] [REMOTE ] SD: Full fetch complete (40873 records). [2025-10-17T21:26:32.885531] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-17T21:26:33.252998] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-17T21:26:33.253080] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-17T21:26:33.254020] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-17T21:26:33.254084] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-17T21:26:33.255088] [DEBUG] [LOCAL ] SD: Trimmed 40873 records to 29067 (keeping 200 days of data) [2025-10-17T21:26:33.343724] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-17T21:26:33.438799] [DEBUG] [LOCAL ] SD: Primary data saved (29067 records). [2025-10-17T21:26:33.438954] [INFO ] [MAIN ] SD: Full history saved. [2025-10-17T21:26:33.439042] [INFO ] [MAIN ] Update Progress: 1885/2368 symbols completed. SD took 32.7s. Estimated remaining: 1h 8m 17s. Rate: 7.1 symbols/min [2025-10-17T21:26:33.611776] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:26:33.661784] [DEBUG] [LOCAL ] SE: Loaded 53692 existing records from primary storage. [2025-10-17T21:26:33.662133] [INFO ] [MAIN ] SE: Loaded 53692 existing records. [2025-10-17T21:26:33.840977] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:26:33.841336] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-17T21:26:33.841437] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-17T21:26:33.841692] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-10-17T21:26:33.841830] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-17T21:26:33.993815] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T21:26:34.147800] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-17T21:26:34.171540] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-17T21:26:34.232263] [INFO ] [REMOTE ] SDHY: Full fetch complete (15728 records). [2025-10-17T21:26:34.253083] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:26:34.248609] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-17T21:26:34.601665] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-17T21:26:34.601746] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-17T21:26:34.602059] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-17T21:26:34.602097] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-17T21:26:34.602566] [DEBUG] [LOCAL ] SDHY: Trimmed 15728 records to 11214 (keeping 200 days of data) [2025-10-17T21:26:34.669020] [DEBUG] [LOCAL ] SDHY: Primary data saved (11214 records). [2025-10-17T21:26:34.669138] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-17T21:26:34.669217] [INFO ] [MAIN ] Update Progress: 1886/2368 symbols completed. SDHY took 26.1s. Estimated remaining: 1h 8m 7s. Rate: 7.1 symbols/min [2025-10-17T21:26:34.834552] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:26:34.880313] [DEBUG] [LOCAL ] SEE: Loaded 48569 existing records from primary storage. [2025-10-17T21:26:34.880813] [INFO ] [MAIN ] SEE: Loaded 48569 existing records. [2025-10-17T21:26:34.942690] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-17T21:26:35.070288] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T21:26:35.069875] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:26:35.074034] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-17T21:26:35.074412] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-17T21:26:35.074639] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-10-17T21:26:35.074718] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-17T21:26:35.433132] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:26:35.742356] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-17T21:26:36.542279] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-10-17T21:26:36.563616] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T21:26:36.566142] [INFO ] [REMOTE ] SDHC: Full fetch complete (16895 records). [2025-10-17T21:26:36.566368] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-17T21:26:36.843436] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T21:26:37.020315] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-17T21:26:37.020499] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-17T21:26:37.021162] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-17T21:26:37.021230] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-17T21:26:37.022076] [DEBUG] [LOCAL ] SDHC: Trimmed 16895 records to 10499 (keeping 200 days of data) [2025-10-17T21:26:37.094609] [DEBUG] [LOCAL ] SDHC: Primary data saved (10499 records). [2025-10-17T21:26:37.094856] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-17T21:26:37.094971] [INFO ] [MAIN ] Update Progress: 1887/2368 symbols completed. SDHC took 36.1s. Estimated remaining: 1h 7m 57s. Rate: 7.1 symbols/min [2025-10-17T21:26:37.274818] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:26:37.289097] [DEBUG] [LOCAL ] SEG: Loaded 12910 existing records from primary storage. [2025-10-17T21:26:37.289310] [INFO ] [MAIN ] SEG: Loaded 12910 existing records. [2025-10-17T21:26:37.350378] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-10-17T21:26:37.467453] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:26:37.467778] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-17T21:26:37.467844] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-17T21:26:37.468036] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-17T21:26:37.468094] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-17T21:26:37.820820] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:26:38.142337] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-17T21:26:38.224289] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T21:26:38.942355] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-10-17T21:26:39.324859] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T21:26:39.624485] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T21:26:39.742304] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-17T21:26:39.807179] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-17T21:26:40.542396] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-17T21:26:41.192039] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T21:26:41.342267] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-17T21:26:41.415900] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T21:26:42.142382] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-17T21:26:42.942295] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-17T21:26:42.992934] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T21:26:43.742323] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-17T21:26:43.786317] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T21:26:43.929629] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-17T21:26:44.542287] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-17T21:26:45.342336] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-17T21:26:45.398101] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T21:26:45.442868] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-17T21:26:46.142299] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-17T21:26:46.942284] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-17T21:26:47.226914] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T21:26:47.742356] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-17T21:26:47.916378] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-17T21:26:48.432194] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-17T21:26:48.542293] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-17T21:26:48.652770] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-17T21:26:49.342326] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-17T21:26:50.068257] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T21:26:50.142258] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-17T21:26:50.942309] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-17T21:26:51.240890] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-17T21:26:51.585757] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T21:26:51.742282] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-17T21:26:52.361065] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T21:26:52.542295] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-17T21:26:53.342319] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-17T21:26:53.354540] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T21:26:53.853014] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-17T21:26:54.142345] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-17T21:26:54.862432] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T21:26:54.942306] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-17T21:26:55.742339] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-17T21:26:56.267497] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-17T21:26:56.510445] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T21:26:56.542261] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-17T21:26:56.553047] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-17T21:26:57.342347] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-17T21:26:58.123758] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T21:26:58.142243] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-17T21:26:58.942305] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-17T21:26:59.070749] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T21:26:59.742255] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-17T21:26:59.815020] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T21:26:59.924315] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-17T21:27:00.542367] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-17T21:27:01.180441] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T21:27:01.186214] [INFO ] [REMOTE ] SDRL: Full fetch complete (61522 records). [2025-10-17T21:27:01.186311] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-17T21:27:01.350141] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-17T21:27:01.599239] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-17T21:27:01.599332] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-17T21:27:01.600464] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-17T21:27:01.600536] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-17T21:27:01.601941] [DEBUG] [LOCAL ] SDRL: Trimmed 61522 records to 42072 (keeping 200 days of data) [2025-10-17T21:27:01.840935] [DEBUG] [LOCAL ] SDRL: Primary data saved (42072 records). [2025-10-17T21:27:01.841060] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-17T21:27:01.841707] [INFO ] [MAIN ] Update Progress: 1888/2368 symbols completed. SDRL took 45.4s. Estimated remaining: 1h 7m 52s. Rate: 7.1 symbols/min [2025-10-17T21:27:02.009344] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:27:02.053925] [DEBUG] [LOCAL ] SEI: Loaded 50322 existing records from primary storage. [2025-10-17T21:27:02.054221] [INFO ] [MAIN ] SEI: Loaded 50322 existing records. [2025-10-17T21:27:02.143725] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-17T21:27:02.233319] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:27:02.233555] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-17T21:27:02.233610] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-17T21:27:02.233830] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-17T21:27:02.233883] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-17T21:27:02.603479] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:27:02.606036] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-17T21:27:02.777957] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-17T21:27:02.942263] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-17T21:27:03.353575] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T21:27:03.360470] [INFO ] [REMOTE ] SEE: Full fetch complete (70115 records). [2025-10-17T21:27:03.360576] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-17T21:27:03.738343] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-17T21:27:03.738422] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-17T21:27:03.739500] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-17T21:27:03.739570] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-17T21:27:03.740899] [DEBUG] [LOCAL ] SEE: Trimmed 70115 records to 48915 (keeping 200 days of data) [2025-10-17T21:27:03.742345] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-17T21:27:04.029089] [DEBUG] [LOCAL ] SEE: Primary data saved (48915 records). [2025-10-17T21:27:04.029219] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-17T21:27:04.029299] [INFO ] [MAIN ] Update Progress: 1889/2368 symbols completed. SEE took 29.4s. Estimated remaining: 1h 7m 42s. Rate: 7.1 symbols/min [2025-10-17T21:27:04.208829] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:27:04.255118] [DEBUG] [LOCAL ] SEM: Loaded 43497 existing records from primary storage. [2025-10-17T21:27:04.255506] [INFO ] [MAIN ] SEM: Loaded 43497 existing records. [2025-10-17T21:27:04.449341] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:27:04.449596] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-17T21:27:04.449681] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-17T21:27:04.449883] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-10-17T21:27:04.449966] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-17T21:27:04.547959] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-10-17T21:27:04.754422] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T21:27:04.826113] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:27:05.139181] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-17T21:27:05.342306] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-17T21:27:06.000123] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T21:27:06.015986] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-17T21:27:06.018146] [INFO ] [REMOTE ] SEG: Full fetch complete (19784 records). [2025-10-17T21:27:06.018249] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-17T21:27:06.156762] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-10-17T21:27:06.382902] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-17T21:27:06.382980] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-17T21:27:06.383384] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-17T21:27:06.383423] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-17T21:27:06.383972] [DEBUG] [LOCAL ] SEG: Trimmed 19784 records to 12956 (keeping 200 days of data) [2025-10-17T21:27:06.459462] [DEBUG] [LOCAL ] SEG: Primary data saved (12956 records). [2025-10-17T21:27:06.459618] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-17T21:27:06.459737] [INFO ] [MAIN ] Update Progress: 1890/2368 symbols completed. SEG took 29.4s. Estimated remaining: 1h 7m 32s. Rate: 7.1 symbols/min [2025-10-17T21:27:06.624687] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:27:06.661623] [DEBUG] [LOCAL ] SEMR: Loaded 42385 existing records from primary storage. [2025-10-17T21:27:06.661964] [INFO ] [MAIN ] SEMR: Loaded 42385 existing records. [2025-10-17T21:27:06.832720] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:27:06.832939] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-17T21:27:06.832985] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-17T21:27:06.833160] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-17T21:27:06.833201] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-17T21:27:06.947524] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-17T21:27:07.177995] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:27:07.742299] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-10-17T21:27:07.866362] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T21:27:08.542305] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-17T21:27:09.109615] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-17T21:27:09.324005] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T21:27:09.342285] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-17T21:27:10.055560] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T21:27:10.142269] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-17T21:27:10.903991] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T21:27:10.942241] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-17T21:27:11.738093] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T21:27:11.745561] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-17T21:27:12.563255] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-17T21:27:12.580716] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T21:27:13.150968] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T21:27:13.342278] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-17T21:27:14.142317] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-17T21:27:14.794351] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-17T21:27:14.942282] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-17T21:27:15.128811] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T21:27:15.481139] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T21:27:15.742427] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-17T21:27:16.542365] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-17T21:27:16.690394] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T21:27:16.697978] [INFO ] [REMOTE ] SE: Full fetch complete (77258 records). [2025-10-17T21:27:16.698142] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-17T21:27:17.098269] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-10-17T21:27:17.098453] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-10-17T21:27:17.099833] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-10-17T21:27:17.099960] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-10-17T21:27:17.101605] [DEBUG] [LOCAL ] SE: Trimmed 77258 records to 54082 (keeping 200 days of data) [2025-10-17T21:27:17.346075] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-17T21:27:17.355209] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T21:27:17.483409] [DEBUG] [LOCAL ] SE: Primary data saved (54082 records). [2025-10-17T21:27:17.483558] [INFO ] [MAIN ] SE: Full history saved. [2025-10-17T21:27:17.483663] [INFO ] [MAIN ] Update Progress: 1891/2368 symbols completed. SE took 44.0s. Estimated remaining: 1h 7m 24s. Rate: 7.1 symbols/min [2025-10-17T21:27:17.653762] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:27:17.701500] [DEBUG] [LOCAL ] SES: Loaded 51968 existing records from primary storage. [2025-10-17T21:27:17.701856] [INFO ] [MAIN ] SES: Loaded 51968 existing records. [2025-10-17T21:27:17.881318] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:27:17.881602] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-17T21:27:17.881837] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-17T21:27:17.882776] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-17T21:27:17.882854] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-17T21:27:18.147356] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-17T21:27:18.272371] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:27:18.267369] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T21:27:18.903991] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T21:27:18.942255] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-17T21:27:19.729924] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T21:27:19.743263] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-10-17T21:27:20.353982] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T21:27:20.542302] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-17T21:27:21.342297] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-17T21:27:21.791002] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-17T21:27:21.888567] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-17T21:27:22.142337] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-17T21:27:22.766345] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T21:27:22.942282] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-17T21:27:23.628800] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-17T21:27:23.742273] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-17T21:27:24.448421] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T21:27:24.542301] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-17T21:27:25.342358] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-17T21:27:25.441468] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T21:27:26.142336] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-17T21:27:26.410117] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T21:27:26.942332] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-17T21:27:27.086624] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-17T21:27:27.537505] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-17T21:27:27.742343] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-17T21:27:28.538751] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T21:27:28.546723] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-17T21:27:29.342297] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-17T21:27:30.026496] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T21:27:30.131346] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-17T21:27:30.142242] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-17T21:27:30.942293] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-17T21:27:31.162112] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T21:27:31.742334] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-17T21:27:32.547972] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-17T21:27:32.550690] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T21:27:32.682316] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-17T21:27:33.342300] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-17T21:27:33.633868] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T21:27:33.641339] [INFO ] [REMOTE ] SEI: Full fetch complete (71017 records). [2025-10-17T21:27:33.641502] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-17T21:27:34.034714] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-17T21:27:34.035040] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-17T21:27:34.036201] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-17T21:27:34.036266] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-17T21:27:34.037691] [DEBUG] [LOCAL ] SEI: Trimmed 71017 records to 50711 (keeping 200 days of data) [2025-10-17T21:27:34.143142] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-17T21:27:34.361177] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T21:27:34.390540] [DEBUG] [LOCAL ] SEI: Primary data saved (50711 records). [2025-10-17T21:27:34.390680] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-17T21:27:34.391432] [INFO ] [MAIN ] Update Progress: 1892/2368 symbols completed. SEI took 32.5s. Estimated remaining: 1h 7m 18s. Rate: 7.1 symbols/min [2025-10-17T21:27:34.567071] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:27:34.607267] [DEBUG] [LOCAL ] SF: Loaded 41866 existing records from primary storage. [2025-10-17T21:27:34.607548] [INFO ] [MAIN ] SF: Loaded 41866 existing records. [2025-10-17T21:27:34.784690] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:27:34.784897] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-17T21:27:34.784944] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-17T21:27:34.785296] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-10-17T21:27:34.785355] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-17T21:27:34.947722] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-17T21:27:35.157390] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:27:35.664391] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-17T21:27:35.749944] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-17T21:27:35.766638] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T21:27:36.542324] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-10-17T21:27:36.580190] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T21:27:37.342307] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-17T21:27:38.045675] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T21:27:38.150184] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-17T21:27:38.156398] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-17T21:27:38.879634] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T21:27:38.942255] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-17T21:27:39.254582] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T21:27:39.261194] [INFO ] [REMOTE ] SEMR: Full fetch complete (60463 records). [2025-10-17T21:27:39.261300] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-17T21:27:39.670774] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-17T21:27:39.670891] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-17T21:27:39.672432] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-17T21:27:39.672517] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-17T21:27:39.674309] [DEBUG] [LOCAL ] SEMR: Trimmed 60463 records to 42727 (keeping 200 days of data) [2025-10-17T21:27:39.772146] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-17T21:27:39.934837] [DEBUG] [LOCAL ] SEMR: Primary data saved (42727 records). [2025-10-17T21:27:39.934971] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-17T21:27:39.935507] [INFO ] [MAIN ] Update Progress: 1893/2368 symbols completed. SEMR took 33.5s. Estimated remaining: 1h 7m 9s. Rate: 7.1 symbols/min [2025-10-17T21:27:40.106297] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:27:40.113460] [DEBUG] [LOCAL ] SFB: Loaded 3845 existing records from primary storage. [2025-10-17T21:27:40.113705] [INFO ] [MAIN ] SFB: Loaded 3845 existing records. [2025-10-17T21:27:40.295284] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:27:40.295526] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-17T21:27:40.295573] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-17T21:27:40.295747] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-17T21:27:40.295803] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-17T21:27:40.560512] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-17T21:27:40.679711] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:27:40.702946] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-17T21:27:41.342297] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-17T21:27:42.042294] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T21:27:42.050041] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-17T21:27:42.059955] [INFO ] [REMOTE ] SEM: Full fetch complete (61636 records). [2025-10-17T21:27:42.060159] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-17T21:27:42.147611] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-10-17T21:27:42.448391] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-17T21:27:42.448509] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-17T21:27:42.449607] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-17T21:27:42.449773] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-17T21:27:42.451045] [DEBUG] [LOCAL ] SEM: Trimmed 61636 records to 43811 (keeping 200 days of data) [2025-10-17T21:27:42.710586] [DEBUG] [LOCAL ] SEM: Primary data saved (43811 records). [2025-10-17T21:27:42.710737] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-17T21:27:42.710826] [INFO ] [MAIN ] Update Progress: 1894/2368 symbols completed. SEM took 38.7s. Estimated remaining: 1h 6m 59s. Rate: 7.1 symbols/min [2025-10-17T21:27:42.827265] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-17T21:27:42.886783] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T21:27:42.917634] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:27:42.938722] [DEBUG] [LOCAL ] SFBS: Loaded 21365 existing records from primary storage. [2025-10-17T21:27:42.938991] [INFO ] [MAIN ] SFBS: Loaded 21365 existing records. [2025-10-17T21:27:42.949735] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-17T21:27:43.127086] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:27:43.127290] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-17T21:27:43.127338] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-17T21:27:43.127551] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-10-17T21:27:43.127620] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-17T21:27:43.481148] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:27:43.742291] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-10-17T21:27:44.542336] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-17T21:27:44.585993] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T21:27:44.845118] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T21:27:45.118784] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-17T21:27:45.342295] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-17T21:27:46.142295] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-17T21:27:46.598763] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-17T21:27:46.942342] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-17T21:27:47.070047] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T21:27:47.742303] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-17T21:27:48.542331] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-17T21:27:49.120635] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-17T21:27:49.220828] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-17T21:27:49.296748] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-17T21:27:49.342244] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-17T21:27:50.142300] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-17T21:27:50.942325] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-17T21:27:51.390743] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-17T21:27:51.662773] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T21:27:51.742249] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-17T21:27:52.005136] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T21:27:52.542271] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-17T21:27:53.152990] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T21:27:53.215166] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T21:27:53.342274] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-17T21:27:54.142266] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-17T21:27:54.457610] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T21:27:54.475388] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-17T21:27:54.942269] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-17T21:27:55.608049] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T21:27:55.742371] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-17T21:27:56.542308] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-17T21:27:57.263695] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T21:27:57.342288] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-17T21:27:57.689036] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-17T21:27:58.142321] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-17T21:27:58.805460] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T21:27:58.942245] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-17T21:27:59.742342] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-17T21:28:00.346741] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T21:28:00.355488] [INFO ] [REMOTE ] SF: Full fetch complete (60317 records). [2025-10-17T21:28:00.355901] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-17T21:28:00.452618] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-17T21:28:00.547408] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-17T21:28:00.802902] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-17T21:28:00.803010] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-17T21:28:00.804054] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-17T21:28:00.804128] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-17T21:28:00.805359] [DEBUG] [LOCAL ] SF: Trimmed 60317 records to 42171 (keeping 200 days of data) [2025-10-17T21:28:01.066431] [DEBUG] [LOCAL ] SF: Primary data saved (42171 records). [2025-10-17T21:28:01.066548] [INFO ] [MAIN ] SF: Full history saved. [2025-10-17T21:28:01.067080] [INFO ] [MAIN ] Update Progress: 1895/2368 symbols completed. SF took 26.7s. Estimated remaining: 1h 6m 53s. Rate: 7.1 symbols/min [2025-10-17T21:28:01.255827] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:28:01.260879] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-17T21:28:01.281469] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T21:28:01.323379] [DEBUG] [LOCAL ] SFL: Loaded 45689 existing records from primary storage. [2025-10-17T21:28:01.323682] [INFO ] [MAIN ] SFL: Loaded 45689 existing records. [2025-10-17T21:28:01.352020] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-17T21:28:01.498247] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:28:01.498493] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-17T21:28:01.498551] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-17T21:28:01.498777] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-17T21:28:01.498845] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-17T21:28:01.845026] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:28:02.142373] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-10-17T21:28:02.942348] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-17T21:28:03.747497] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-17T21:28:03.760751] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T21:28:03.947841] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-17T21:28:03.955508] [INFO ] [REMOTE ] SES: Full fetch complete (75647 records). [2025-10-17T21:28:03.955666] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-17T21:28:04.117539] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T21:28:04.269768] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-17T21:28:04.363678] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-17T21:28:04.363772] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-17T21:28:04.364908] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-17T21:28:04.364971] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-17T21:28:04.366433] [DEBUG] [LOCAL ] SES: Trimmed 75647 records to 52357 (keeping 200 days of data) [2025-10-17T21:28:04.566771] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-17T21:28:04.670991] [DEBUG] [LOCAL ] SES: Primary data saved (52357 records). [2025-10-17T21:28:04.671112] [INFO ] [MAIN ] SES: Full history saved. [2025-10-17T21:28:04.671222] [INFO ] [MAIN ] Update Progress: 1896/2368 symbols completed. SES took 47.2s. Estimated remaining: 1h 6m 43s. Rate: 7.1 symbols/min [2025-10-17T21:28:04.835365] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:28:04.884075] [DEBUG] [LOCAL ] SG: Loaded 53883 existing records from primary storage. [2025-10-17T21:28:04.884422] [INFO ] [MAIN ] SG: Loaded 53883 existing records. [2025-10-17T21:28:05.057083] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:28:05.057284] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-17T21:28:05.057330] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-17T21:28:05.057525] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-10-17T21:28:05.057572] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-17T21:28:05.347529] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-17T21:28:05.415495] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:28:05.614984] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-17T21:28:06.062065] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-17T21:28:06.142307] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-17T21:28:06.619562] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-17T21:28:06.620564] [INFO ] [REMOTE ] SFB: Full fetch complete (5768 records). [2025-10-17T21:28:06.620632] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-17T21:28:06.949591] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-10-17T21:28:07.004798] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-17T21:28:07.004907] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-17T21:28:07.005155] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-17T21:28:07.005219] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-17T21:28:07.006013] [DEBUG] [LOCAL ] SFB: Trimmed 5768 records to 3858 (keeping 200 days of data) [2025-10-17T21:28:07.030674] [DEBUG] [LOCAL ] SFB: Primary data saved (3858 records). [2025-10-17T21:28:07.030822] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-17T21:28:07.030912] [INFO ] [MAIN ] Update Progress: 1897/2368 symbols completed. SFB took 27.1s. Estimated remaining: 1h 6m 33s. Rate: 7.1 symbols/min [2025-10-17T21:28:07.202526] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:28:07.247947] [DEBUG] [LOCAL ] SGHC: Loaded 47394 existing records from primary storage. [2025-10-17T21:28:07.248250] [INFO ] [MAIN ] SGHC: Loaded 47394 existing records. [2025-10-17T21:28:07.420704] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:28:07.420936] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-17T21:28:07.421012] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-17T21:28:07.421296] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-17T21:28:07.421375] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-17T21:28:07.747758] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-17T21:28:07.788707] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:28:08.542310] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-17T21:28:08.859959] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T21:28:08.910330] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-17T21:28:09.342299] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-17T21:28:10.147504] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-10-17T21:28:10.157854] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T21:28:10.942323] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-17T21:28:11.150685] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T21:28:11.219792] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-17T21:28:11.742353] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-17T21:28:12.542264] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-17T21:28:12.596165] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T21:28:13.342288] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-17T21:28:13.397690] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T21:28:14.142316] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-17T21:28:14.393320] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T21:28:14.434260] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T21:28:14.942341] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-17T21:28:15.657903] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T21:28:15.742326] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-17T21:28:16.542299] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-17T21:28:16.650147] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T21:28:17.279721] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T21:28:17.342299] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-17T21:28:18.128396] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T21:28:18.145011] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-17T21:28:18.942277] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-17T21:28:18.968730] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T21:28:19.164289] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T21:28:19.742264] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-17T21:28:20.542309] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-17T21:28:20.964450] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-17T21:28:21.193313] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T21:28:21.342280] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-17T21:28:21.920855] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T21:28:22.142282] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-17T21:28:22.942303] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-17T21:28:23.136413] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T21:28:23.139858] [INFO ] [REMOTE ] SFBS: Full fetch complete (30333 records). [2025-10-17T21:28:23.139939] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-17T21:28:23.508897] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-17T21:28:23.509055] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-17T21:28:23.509748] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-17T21:28:23.509832] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-17T21:28:23.535039] [DEBUG] [LOCAL ] SFBS: Trimmed 30333 records to 21563 (keeping 200 days of data) [2025-10-17T21:28:23.551906] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-17T21:28:23.698258] [DEBUG] [LOCAL ] SFBS: Primary data saved (21563 records). [2025-10-17T21:28:23.698400] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-17T21:28:23.698502] [INFO ] [MAIN ] Update Progress: 1898/2368 symbols completed. SFBS took 41.0s. Estimated remaining: 1h 6m 27s. Rate: 7.1 symbols/min [2025-10-17T21:28:23.752045] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-17T21:28:23.866444] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:28:23.866588] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-17T21:28:23.866624] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-17T21:28:23.866751] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-17T21:28:23.866791] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-17T21:28:23.866832] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-17T21:28:23.866863] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-17T21:28:24.210759] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:28:24.493812] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T21:28:24.542274] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-17T21:28:25.342252] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-17T21:28:25.702521] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-17T21:28:26.142308] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-17T21:28:26.382481] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T21:28:26.532183] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-17T21:28:26.942312] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-10-17T21:28:27.153707] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:28:27.154032] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-10-17T21:28:27.154122] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:28:27.154174] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-17T21:28:27.154232] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:28:27.154306] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-17T21:28:27.154369] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-17T21:28:27.154406] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-17T21:28:27.154452] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-17T21:28:27.154557] [INFO ] [MAIN ] Update Progress: 1899/2368 symbols completed. SGI took 3.5s. Estimated remaining: 1h 6m 17s. Rate: 7.1 symbols/min [2025-10-17T21:28:27.326204] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:28:27.335724] [DEBUG] [LOCAL ] SGU: Loaded 6613 existing records from primary storage. [2025-10-17T21:28:27.335942] [INFO ] [MAIN ] SGU: Loaded 6613 existing records. [2025-10-17T21:28:27.510104] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:28:27.510328] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-17T21:28:27.510393] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-17T21:28:27.510556] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-17T21:28:27.510612] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-17T21:28:27.748186] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-10-17T21:28:27.868956] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:28:28.185892] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T21:28:28.542324] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-17T21:28:29.151086] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T21:28:29.342312] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-10-17T21:28:30.142392] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-17T21:28:30.549528] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-17T21:28:30.931182] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T21:28:30.942253] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-10-17T21:28:31.372778] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-17T21:28:31.742374] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-17T21:28:32.542347] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-10-17T21:28:32.683820] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T21:28:33.069913] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T21:28:33.112502] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-17T21:28:33.342268] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-17T21:28:33.939094] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T21:28:34.142392] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-17T21:28:34.942303] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-17T21:28:35.742313] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-10-17T21:28:35.805143] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T21:28:35.812488] [INFO ] [REMOTE ] SGHC: Full fetch complete (65272 records). [2025-10-17T21:28:35.812702] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-17T21:28:36.199702] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-17T21:28:36.199803] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-17T21:28:36.200900] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-17T21:28:36.200964] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-17T21:28:36.202305] [DEBUG] [LOCAL ] SGHC: Trimmed 65272 records to 47745 (keeping 200 days of data) [2025-10-17T21:28:36.494788] [DEBUG] [LOCAL ] SGHC: Primary data saved (47745 records). [2025-10-17T21:28:36.494942] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-17T21:28:36.495522] [INFO ] [MAIN ] Update Progress: 1900/2368 symbols completed. SGHC took 29.5s. Estimated remaining: 1h 6m 9s. Rate: 7.1 symbols/min [2025-10-17T21:28:36.559785] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-17T21:28:36.676059] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:28:36.724442] [DEBUG] [LOCAL ] SHAK: Loaded 49173 existing records from primary storage. [2025-10-17T21:28:36.724840] [INFO ] [MAIN ] SHAK: Loaded 49173 existing records. [2025-10-17T21:28:36.912824] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:28:36.913330] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-17T21:28:36.913451] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-17T21:28:36.913794] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-10-17T21:28:36.913855] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-17T21:28:37.033793] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-17T21:28:37.256855] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-17T21:28:37.338973] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:28:37.350758] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-10-17T21:28:37.367837] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T21:28:38.142295] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-17T21:28:38.942350] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-17T21:28:39.018234] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T21:28:39.566778] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-17T21:28:39.742398] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-17T21:28:40.114052] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-17T21:28:40.122381] [INFO ] [REMOTE ] SG: Full fetch complete (77458 records). [2025-10-17T21:28:40.122559] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-17T21:28:40.516816] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-17T21:28:40.516927] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-17T21:28:40.518525] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-17T21:28:40.518595] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-17T21:28:40.520220] [DEBUG] [LOCAL ] SG: Trimmed 77458 records to 54264 (keeping 200 days of data) [2025-10-17T21:28:40.568916] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-10. [2025-10-17T21:28:40.841463] [DEBUG] [LOCAL ] SG: Primary data saved (54264 records). [2025-10-17T21:28:40.841611] [INFO ] [MAIN ] SG: Full history saved. [2025-10-17T21:28:40.841727] [INFO ] [MAIN ] Update Progress: 1901/2368 symbols completed. SG took 36.2s. Estimated remaining: 1h 5m 59s. Rate: 7.1 symbols/min [2025-10-17T21:28:41.007727] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:28:41.031929] [DEBUG] [LOCAL ] SHCO: Loaded 25733 existing records from primary storage. [2025-10-17T21:28:41.032184] [INFO ] [MAIN ] SHCO: Loaded 25733 existing records. [2025-10-17T21:28:41.214216] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:28:41.214523] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-17T21:28:41.214601] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-17T21:28:41.214976] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-17T21:28:41.215032] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-17T21:28:41.346026] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-17T21:28:41.638767] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:28:41.641286] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-17T21:28:42.134536] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-17T21:28:42.142238] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-17T21:28:42.207397] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T21:28:42.213971] [INFO ] [REMOTE ] SFL: Full fetch complete (65900 records). [2025-10-17T21:28:42.214085] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-17T21:28:42.595817] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-17T21:28:42.595912] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-17T21:28:42.596976] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-17T21:28:42.597058] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-17T21:28:42.598455] [DEBUG] [LOCAL ] SFL: Trimmed 65900 records to 46032 (keeping 200 days of data) [2025-10-17T21:28:42.816608] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-17T21:28:42.879386] [DEBUG] [LOCAL ] SFL: Primary data saved (46032 records). [2025-10-17T21:28:42.879517] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-17T21:28:42.880118] [INFO ] [MAIN ] Update Progress: 1902/2368 symbols completed. SFL took 41.8s. Estimated remaining: 1h 5m 49s. Rate: 7.1 symbols/min [2025-10-17T21:28:42.947544] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-17T21:28:43.056573] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:28:43.107499] [DEBUG] [LOCAL ] SHEL: Loaded 54063 existing records from primary storage. [2025-10-17T21:28:43.107885] [INFO ] [MAIN ] SHEL: Loaded 54063 existing records. [2025-10-17T21:28:43.289193] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:28:43.289427] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-17T21:28:43.289476] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-17T21:28:43.289696] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-17T21:28:43.289755] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-17T21:28:43.665338] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:28:43.671156] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T21:28:43.742254] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-10-17T21:28:44.542296] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-10-17T21:28:45.342276] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-17T21:28:45.747415] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-17T21:28:45.772634] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-17T21:28:46.142347] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-17T21:28:46.942310] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-17T21:28:47.108081] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-17T21:28:47.217021] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T21:28:47.679195] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T21:28:47.742352] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-17T21:28:48.542278] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-17T21:28:48.882322] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T21:28:49.303939] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-17T21:28:49.342304] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-17T21:28:50.142305] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-17T21:28:50.740936] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T21:28:50.942344] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-17T21:28:51.669300] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-17T21:28:51.742260] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-17T21:28:52.253072] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-17T21:28:52.542309] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-17T21:28:53.137092] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T21:28:53.138345] [INFO ] [REMOTE ] SGU: Full fetch complete (8982 records). [2025-10-17T21:28:53.138414] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-17T21:28:53.344948] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-17T21:28:53.497545] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-17T21:28:53.497707] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-17T21:28:53.498080] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-17T21:28:53.498198] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-17T21:28:53.498902] [DEBUG] [LOCAL ] SGU: Trimmed 8982 records to 6653 (keeping 200 days of data) [2025-10-17T21:28:53.560818] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T21:28:53.579713] [DEBUG] [LOCAL ] SGU: Primary data saved (6653 records). [2025-10-17T21:28:53.579841] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-17T21:28:53.580261] [INFO ] [MAIN ] Update Progress: 1903/2368 symbols completed. SGU took 26.4s. Estimated remaining: 1h 5m 41s. Rate: 7.1 symbols/min [2025-10-17T21:28:53.760418] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:28:53.790178] [DEBUG] [LOCAL ] SHG: Loaded 26746 existing records from primary storage. [2025-10-17T21:28:53.790447] [INFO ] [MAIN ] SHG: Loaded 26746 existing records. [2025-10-17T21:28:53.967061] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:28:53.967276] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-17T21:28:53.967324] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-17T21:28:53.967510] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-17T21:28:53.967564] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-17T21:28:54.149007] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-17T21:28:54.316515] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:28:54.333442] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-17T21:28:54.942340] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-10-17T21:28:55.742259] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-17T21:28:56.240984] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-17T21:28:56.306316] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T21:28:56.542298] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-17T21:28:57.342288] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-17T21:28:57.521390] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T21:28:57.803025] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T21:28:58.142313] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-17T21:28:58.942257] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-17T21:28:59.188451] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T21:28:59.486614] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-17T21:28:59.742339] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-17T21:29:00.298582] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-17T21:29:00.542283] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-17T21:29:01.342307] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-17T21:29:01.940072] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-17T21:29:01.990448] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-17T21:29:02.142298] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-17T21:29:02.364400] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-17T21:29:02.942355] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-17T21:29:03.187989] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-17T21:29:03.742316] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-17T21:29:04.133052] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-17T21:29:04.542261] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-17T21:29:05.342326] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-17T21:29:05.583323] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T21:29:06.142310] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-17T21:29:06.386605] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T21:29:06.651723] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-17T21:29:06.942290] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-17T21:29:07.747501] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-17T21:29:07.761042] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T21:29:07.817294] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-17T21:29:08.542288] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-17T21:29:09.084793] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-17T21:29:09.342295] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-17T21:29:09.549893] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-17T21:29:10.142298] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-17T21:29:10.942299] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-17T21:29:11.238042] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-17T21:29:11.667833] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-17T21:29:11.742278] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-17T21:29:12.542355] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-17T21:29:12.656456] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-17T21:29:13.342362] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-17T21:29:13.367575] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-17T21:29:14.133317] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-17T21:29:14.144341] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-17T21:29:14.942277] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-17T21:29:15.149168] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T21:29:15.265159] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T21:29:15.269627] [INFO ] [REMOTE ] SHG: Full fetch complete (41214 records). [2025-10-17T21:29:15.269743] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-17T21:29:15.645346] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-17T21:29:15.645429] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-17T21:29:15.646269] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-17T21:29:15.646354] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-17T21:29:15.647252] [DEBUG] [LOCAL ] SHG: Trimmed 41214 records to 27006 (keeping 200 days of data) [2025-10-17T21:29:15.756714] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-17T21:29:15.816589] [DEBUG] [LOCAL ] SHG: Primary data saved (27006 records). [2025-10-17T21:29:15.816805] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-17T21:29:15.816916] [INFO ] [MAIN ] Update Progress: 1904/2368 symbols completed. SHG took 22.2s. Estimated remaining: 1h 5m 36s. Rate: 7.1 symbols/min [2025-10-17T21:29:15.987433] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:29:16.030490] [DEBUG] [LOCAL ] SHO: Loaded 49749 existing records from primary storage. [2025-10-17T21:29:16.030860] [INFO ] [MAIN ] SHO: Loaded 49749 existing records. [2025-10-17T21:29:16.202853] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:29:16.203136] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-17T21:29:16.203183] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-17T21:29:16.203453] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-10-17T21:29:16.203510] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-17T21:29:16.550437] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:29:16.550534] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-17T21:29:16.960801] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-17T21:29:17.014456] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T21:29:17.342375] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-17T21:29:18.041854] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T21:29:18.142315] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-10-17T21:29:18.155181] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T21:29:18.159532] [INFO ] [REMOTE ] SHCO: Full fetch complete (37579 records). [2025-10-17T21:29:18.159720] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-17T21:29:18.536244] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-17T21:29:18.536316] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-17T21:29:18.537082] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-17T21:29:18.537143] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-17T21:29:18.537995] [DEBUG] [LOCAL ] SHCO: Trimmed 37579 records to 25956 (keeping 200 days of data) [2025-10-17T21:29:18.678188] [DEBUG] [LOCAL ] SHCO: Primary data saved (25956 records). [2025-10-17T21:29:18.678312] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-17T21:29:18.678389] [INFO ] [MAIN ] Update Progress: 1905/2368 symbols completed. SHCO took 37.8s. Estimated remaining: 1h 5m 26s. Rate: 7.1 symbols/min [2025-10-17T21:29:18.847206] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:29:18.853004] [DEBUG] [LOCAL ] SHOC: Loaded 3264 existing records from primary storage. [2025-10-17T21:29:18.853157] [INFO ] [MAIN ] SHOC: Loaded 3264 existing records. [2025-10-17T21:29:18.948081] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-17T21:29:19.031586] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:29:19.031814] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-17T21:29:19.031861] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-17T21:29:19.032023] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-17T21:29:19.032079] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-17T21:29:19.379707] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:29:19.742305] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-17T21:29:19.843421] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T21:29:20.542356] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-17T21:29:20.584456] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T21:29:20.592237] [INFO ] [REMOTE ] SHAK: Full fetch complete (71139 records). [2025-10-17T21:29:20.592525] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-17T21:29:21.021039] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-17T21:29:21.021153] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-17T21:29:21.022589] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-17T21:29:21.022683] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-17T21:29:21.024192] [DEBUG] [LOCAL ] SHAK: Trimmed 71139 records to 49501 (keeping 200 days of data) [2025-10-17T21:29:21.321530] [DEBUG] [LOCAL ] SHAK: Primary data saved (49501 records). [2025-10-17T21:29:21.321691] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-17T21:29:21.321803] [INFO ] [MAIN ] Update Progress: 1906/2368 symbols completed. SHAK took 44.8s. Estimated remaining: 1h 5m 16s. Rate: 7.1 symbols/min [2025-10-17T21:29:21.351953] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-10-17T21:29:21.493629] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:29:21.543615] [DEBUG] [LOCAL ] SHW: Loaded 50744 existing records from primary storage. [2025-10-17T21:29:21.544054] [INFO ] [MAIN ] SHW: Loaded 50744 existing records. [2025-10-17T21:29:21.728167] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:29:21.729174] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-17T21:29:21.729234] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-17T21:29:21.730025] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-10-17T21:29:21.730082] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-17T21:29:22.069929] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-17T21:29:22.170004] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-17T21:29:22.173547] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:29:22.177163] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T21:29:22.294910] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-17T21:29:22.942299] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-17T21:29:23.687836] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T21:29:23.742343] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-17T21:29:23.782320] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T21:29:23.790057] [INFO ] [REMOTE ] SHEL: Full fetch complete (77835 records). [2025-10-17T21:29:23.790250] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-17T21:29:24.188010] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-17T21:29:24.188097] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-17T21:29:24.189317] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-17T21:29:24.189410] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-17T21:29:24.190945] [DEBUG] [LOCAL ] SHEL: Trimmed 77835 records to 54453 (keeping 200 days of data) [2025-10-17T21:29:24.423331] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-17T21:29:24.533156] [DEBUG] [LOCAL ] SHEL: Primary data saved (54453 records). [2025-10-17T21:29:24.533302] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-17T21:29:24.533891] [INFO ] [MAIN ] Update Progress: 1907/2368 symbols completed. SHEL took 41.7s. Estimated remaining: 1h 5m 7s. Rate: 7.1 symbols/min [2025-10-17T21:29:24.548260] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-17T21:29:24.706928] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:29:24.707108] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-17T21:29:24.707145] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-17T21:29:24.707264] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-17T21:29:24.707304] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-17T21:29:24.707344] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-17T21:29:24.707374] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-17T21:29:25.049529] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:29:25.342345] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-10-17T21:29:25.701975] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T21:29:25.711163] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:29:25.712602] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-10-17T21:29:25.712759] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:29:25.712845] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-17T21:29:25.712927] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:29:25.713017] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-17T21:29:25.713102] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-17T21:29:25.713156] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-17T21:29:25.713219] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-17T21:29:25.713296] [INFO ] [MAIN ] Update Progress: 1908/2368 symbols completed. SI took 1.2s. Estimated remaining: 1h 4m 56s. Rate: 7.1 symbols/min [2025-10-17T21:29:25.892408] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:29:25.934883] [DEBUG] [LOCAL ] SID: Loaded 43016 existing records from primary storage. [2025-10-17T21:29:25.935184] [INFO ] [MAIN ] SID: Loaded 43016 existing records. [2025-10-17T21:29:26.134726] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:29:26.134949] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-17T21:29:26.134997] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-17T21:29:26.135187] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-17T21:29:26.135243] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-17T21:29:26.147424] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-17T21:29:26.530719] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:29:26.942300] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-10-17T21:29:27.011436] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T21:29:27.742348] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-10-17T21:29:28.542278] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-17T21:29:28.577823] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T21:29:29.342337] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-17T21:29:29.349487] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T21:29:30.142352] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-17T21:29:30.175145] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T21:29:30.942332] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-17T21:29:31.170039] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T21:29:31.747636] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-17T21:29:31.759078] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T21:29:32.542332] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-17T21:29:32.605872] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T21:29:33.342332] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-17T21:29:33.440354] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T21:29:33.518573] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T21:29:34.142312] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-17T21:29:34.934789] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T21:29:34.944497] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-17T21:29:35.302419] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T21:29:35.466157] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-17T21:29:35.742344] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-17T21:29:36.542358] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-17T21:29:37.019531] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-17T21:29:37.342299] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-17T21:29:37.373938] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T21:29:38.142397] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-17T21:29:38.828346] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T21:29:38.942267] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-17T21:29:39.742350] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-17T21:29:39.955875] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T21:29:40.542394] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-17T21:29:40.604901] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T21:29:41.014756] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T21:29:41.342320] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-17T21:29:42.142349] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-17T21:29:42.685326] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-17T21:29:42.747346] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T21:29:42.942290] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-17T21:29:43.430471] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-17T21:29:43.750330] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-17T21:29:43.772074] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T21:29:44.395598] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-17T21:29:44.542331] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-17T21:29:45.342344] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-17T21:29:45.824358] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-17T21:29:46.118137] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T21:29:46.142259] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-17T21:29:46.942291] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-17T21:29:47.430089] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-17T21:29:47.728296] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T21:29:47.742239] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-17T21:29:48.272069] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-17T21:29:48.273156] [INFO ] [REMOTE ] SHOC: Full fetch complete (6934 records). [2025-10-17T21:29:48.273246] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-17T21:29:48.547500] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-17T21:29:48.627671] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-17T21:29:48.627769] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-17T21:29:48.627966] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-17T21:29:48.628074] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-17T21:29:48.628446] [DEBUG] [LOCAL ] SHOC: Trimmed 6934 records to 3283 (keeping 200 days of data) [2025-10-17T21:29:48.648784] [DEBUG] [LOCAL ] SHOC: Primary data saved (3283 records). [2025-10-17T21:29:48.648861] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-17T21:29:48.648938] [INFO ] [MAIN ] Update Progress: 1909/2368 symbols completed. SHOC took 30.0s. Estimated remaining: 1h 4m 51s. Rate: 7.1 symbols/min [2025-10-17T21:29:48.815158] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:29:48.858633] [DEBUG] [LOCAL ] SIG: Loaded 45983 existing records from primary storage. [2025-10-17T21:29:48.858947] [INFO ] [MAIN ] SIG: Loaded 45983 existing records. [2025-10-17T21:29:49.041166] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:29:49.041404] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-17T21:29:49.041475] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-17T21:29:49.041708] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-10-17T21:29:49.041774] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-17T21:29:49.357144] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-17T21:29:49.396985] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:29:50.142322] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-17T21:29:50.395747] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T21:29:50.796304] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T21:29:50.802676] [INFO ] [REMOTE ] SHO: Full fetch complete (70935 records). [2025-10-17T21:29:50.802863] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-17T21:29:50.946448] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-10-17T21:29:51.201611] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-17T21:29:51.201737] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-17T21:29:51.203034] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-17T21:29:51.203120] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-17T21:29:51.204570] [DEBUG] [LOCAL ] SHO: Trimmed 70935 records to 50038 (keeping 200 days of data) [2025-10-17T21:29:51.507189] [DEBUG] [LOCAL ] SHO: Primary data saved (50038 records). [2025-10-17T21:29:51.507337] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-17T21:29:51.507454] [INFO ] [MAIN ] Update Progress: 1910/2368 symbols completed. SHO took 35.7s. Estimated remaining: 1h 4m 42s. Rate: 7.1 symbols/min [2025-10-17T21:29:51.686202] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:29:51.709713] [DEBUG] [LOCAL ] SII: Loaded 24193 existing records from primary storage. [2025-10-17T21:29:51.710000] [INFO ] [MAIN ] SII: Loaded 24193 existing records. [2025-10-17T21:29:51.752961] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-17T21:29:51.914102] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:29:51.924222] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-17T21:29:51.924339] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-17T21:29:51.924671] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-17T21:29:51.924983] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-17T21:29:51.943880] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T21:29:52.292116] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:29:52.542297] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-10-17T21:29:52.711189] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T21:29:53.342265] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-17T21:29:53.512067] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T21:29:53.550751] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T21:29:54.142301] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-17T21:29:54.768384] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T21:29:54.942285] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-17T21:29:55.742257] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-17T21:29:55.845152] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T21:29:56.300251] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-17T21:29:56.542327] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-17T21:29:57.334179] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T21:29:57.340597] [INFO ] [REMOTE ] SID: Full fetch complete (60934 records). [2025-10-17T21:29:57.340735] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-17T21:29:57.352468] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-17T21:29:57.557109] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-17T21:29:57.746728] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-17T21:29:57.746814] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-17T21:29:57.747860] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-17T21:29:57.747923] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-17T21:29:57.749234] [DEBUG] [LOCAL ] SID: Trimmed 60934 records to 43366 (keeping 200 days of data) [2025-10-17T21:29:57.990853] [DEBUG] [LOCAL ] SID: Primary data saved (43366 records). [2025-10-17T21:29:57.990976] [INFO ] [MAIN ] SID: Full history saved. [2025-10-17T21:29:57.991523] [INFO ] [MAIN ] Update Progress: 1911/2368 symbols completed. SID took 32.3s. Estimated remaining: 1h 4m 33s. Rate: 7.1 symbols/min [2025-10-17T21:29:58.157741] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:29:58.155193] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-17T21:29:58.189143] [DEBUG] [LOCAL ] SILA: Loaded 30693 existing records from primary storage. [2025-10-17T21:29:58.189432] [INFO ] [MAIN ] SILA: Loaded 30693 existing records. [2025-10-17T21:29:58.365734] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:29:58.365949] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-17T21:29:58.366007] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-17T21:29:58.366219] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-17T21:29:58.366284] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-17T21:29:58.712523] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:29:58.908224] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T21:29:58.942249] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-10-17T21:29:59.742309] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-17T21:30:00.058977] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T21:30:00.089317] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T21:30:00.542303] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-17T21:30:01.131775] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-17T21:30:01.342295] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-17T21:30:01.653241] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T21:30:02.142310] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-17T21:30:02.942351] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-17T21:30:03.364156] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-17T21:30:03.531045] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-17T21:30:03.742359] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-17T21:30:04.293750] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T21:30:04.542301] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-17T21:30:05.191908] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T21:30:05.342316] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-17T21:30:06.142310] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-17T21:30:06.283876] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T21:30:06.834498] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T21:30:06.942328] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-17T21:30:07.742291] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-17T21:30:08.025295] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-17T21:30:08.542285] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-17T21:30:08.845704] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T21:30:08.874417] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T21:30:09.342339] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-17T21:30:10.142372] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-17T21:30:10.324897] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T21:30:10.332241] [INFO ] [REMOTE ] SHW: Full fetch complete (73287 records). [2025-10-17T21:30:10.332380] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-17T21:30:10.719081] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-17T21:30:10.728618] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-17T21:30:10.744304] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-17T21:30:10.745271] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-17T21:30:10.746360] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T21:30:10.757161] [DEBUG] [LOCAL ] SHW: Trimmed 73287 records to 51119 (keeping 200 days of data) [2025-10-17T21:30:10.945350] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-17T21:30:11.096847] [DEBUG] [LOCAL ] SHW: Primary data saved (51119 records). [2025-10-17T21:30:11.097051] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-17T21:30:11.097169] [INFO ] [MAIN ] Update Progress: 1912/2368 symbols completed. SHW took 49.8s. Estimated remaining: 1h 4m 25s. Rate: 7.1 symbols/min [2025-10-17T21:30:11.261240] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:30:11.298341] [DEBUG] [LOCAL ] SITC: Loaded 42145 existing records from primary storage. [2025-10-17T21:30:11.298635] [INFO ] [MAIN ] SITC: Loaded 42145 existing records. [2025-10-17T21:30:11.475499] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:30:11.475887] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-17T21:30:11.475944] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-17T21:30:11.476254] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-10-17T21:30:11.476292] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-17T21:30:11.748906] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-17T21:30:11.839874] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:30:11.891684] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T21:30:12.028943] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T21:30:12.542360] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-17T21:30:13.171963] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T21:30:13.254047] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-17T21:30:13.342348] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-17T21:30:14.142289] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-10-17T21:30:14.942289] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-17T21:30:15.063196] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T21:30:15.742300] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-17T21:30:15.781099] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T21:30:16.035695] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-17T21:30:16.039495] [INFO ] [REMOTE ] SII: Full fetch complete (31313 records). [2025-10-17T21:30:16.039599] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-17T21:30:16.398639] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-17T21:30:16.398743] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-17T21:30:16.399362] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-17T21:30:16.399402] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-17T21:30:16.400172] [DEBUG] [LOCAL ] SII: Trimmed 31313 records to 24434 (keeping 200 days of data) [2025-10-17T21:30:16.543359] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-17T21:30:16.551508] [DEBUG] [LOCAL ] SII: Primary data saved (24434 records). [2025-10-17T21:30:16.551590] [INFO ] [MAIN ] SII: Full history saved. [2025-10-17T21:30:16.551709] [INFO ] [MAIN ] Update Progress: 1913/2368 symbols completed. SII took 25.0s. Estimated remaining: 1h 4m 16s. Rate: 7.1 symbols/min [2025-10-17T21:30:16.723432] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:30:16.758955] [DEBUG] [LOCAL ] SITE: Loaded 35881 existing records from primary storage. [2025-10-17T21:30:16.759257] [INFO ] [MAIN ] SITE: Loaded 35881 existing records. [2025-10-17T21:30:16.901820] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T21:30:16.972229] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:30:16.972470] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-17T21:30:16.972530] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-17T21:30:16.972737] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-17T21:30:16.972794] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-17T21:30:17.333041] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:30:17.342259] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-10-17T21:30:18.044584] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T21:30:18.142288] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-17T21:30:18.613324] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T21:30:18.942321] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-17T21:30:19.553428] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T21:30:19.742329] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-17T21:30:19.985834] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T21:30:20.542334] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-17T21:30:21.342288] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-17T21:30:21.642262] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T21:30:22.063911] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-17T21:30:22.142275] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-17T21:30:22.748318] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T21:30:22.942303] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-17T21:30:23.742316] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-17T21:30:23.860365] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T21:30:24.210140] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T21:30:24.542368] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-17T21:30:24.733246] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-17T21:30:25.342322] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-17T21:30:26.149682] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-17T21:30:26.155409] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T21:30:26.913736] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T21:30:26.942276] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-17T21:30:27.645594] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-17T21:30:27.742321] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-17T21:30:28.455592] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T21:30:28.542301] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-17T21:30:29.342311] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-17T21:30:29.391552] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T21:30:30.147375] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-17T21:30:30.162688] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T21:30:30.473894] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T21:30:30.942307] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-17T21:30:31.139788] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T21:30:31.742294] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-17T21:30:32.477197] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T21:30:32.542258] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-17T21:30:32.913777] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T21:30:32.919911] [INFO ] [REMOTE ] SILA: Full fetch complete (44513 records). [2025-10-17T21:30:32.920051] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-17T21:30:33.291020] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-17T21:30:33.291095] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-17T21:30:33.291972] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-17T21:30:33.292034] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-17T21:30:33.292990] [DEBUG] [LOCAL ] SILA: Trimmed 44513 records to 30851 (keeping 200 days of data) [2025-10-17T21:30:33.343946] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-17T21:30:33.480336] [DEBUG] [LOCAL ] SILA: Primary data saved (30851 records). [2025-10-17T21:30:33.480616] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-17T21:30:33.480747] [INFO ] [MAIN ] Update Progress: 1914/2368 symbols completed. SILA took 35.5s. Estimated remaining: 1h 4m 10s. Rate: 7.1 symbols/min [2025-10-17T21:30:33.648599] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:30:33.697385] [DEBUG] [LOCAL ] SJM: Loaded 50509 existing records from primary storage. [2025-10-17T21:30:33.697739] [INFO ] [MAIN ] SJM: Loaded 50509 existing records. [2025-10-17T21:30:33.874817] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:30:33.875084] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-17T21:30:33.875185] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-17T21:30:33.875505] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-10-17T21:30:33.875564] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-17T21:30:34.155163] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-17T21:30:34.168947] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T21:30:34.221988] [INFO ] [REMOTE ] SIG: Full fetch complete (67866 records). [2025-10-17T21:30:34.236561] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-17T21:30:34.256107] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:30:34.640571] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-17T21:30:34.640689] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-17T21:30:34.641796] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-17T21:30:34.641859] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-17T21:30:34.643103] [DEBUG] [LOCAL ] SIG: Trimmed 67866 records to 46214 (keeping 200 days of data) [2025-10-17T21:30:34.888097] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T21:30:34.949311] [DEBUG] [LOCAL ] SIG: Primary data saved (46214 records). [2025-10-17T21:30:34.944284] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-17T21:30:34.950446] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-17T21:30:34.950603] [INFO ] [MAIN ] Update Progress: 1915/2368 symbols completed. SIG took 46.3s. Estimated remaining: 1h 3m 60s. Rate: 7.1 symbols/min [2025-10-17T21:30:35.117385] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:30:35.138266] [DEBUG] [LOCAL ] SJT: Loaded 22722 existing records from primary storage. [2025-10-17T21:30:35.138500] [INFO ] [MAIN ] SJT: Loaded 22722 existing records. [2025-10-17T21:30:35.313975] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:30:35.314162] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-17T21:30:35.314208] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-17T21:30:35.314381] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-17T21:30:35.314437] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-17T21:30:35.667435] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:30:35.713603] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T21:30:35.742246] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-17T21:30:36.380970] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T21:30:36.542303] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-17T21:30:37.342298] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-10-17T21:30:37.651927] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T21:30:38.042575] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T21:30:38.142311] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-17T21:30:38.489100] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T21:30:38.942359] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-17T21:30:39.578016] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-17T21:30:39.742383] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-10-17T21:30:39.957624] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-17T21:30:40.542392] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-17T21:30:41.342362] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-17T21:30:41.397440] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T21:30:41.907992] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T21:30:41.916767] [INFO ] [REMOTE ] SITC: Full fetch complete (60718 records). [2025-10-17T21:30:41.916939] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-17T21:30:42.147523] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-17T21:30:42.299513] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-17T21:30:42.299670] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-17T21:30:42.300736] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-17T21:30:42.300802] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-17T21:30:42.302150] [DEBUG] [LOCAL ] SITC: Trimmed 60718 records to 42442 (keeping 200 days of data) [2025-10-17T21:30:42.523259] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T21:30:42.567416] [DEBUG] [LOCAL ] SITC: Primary data saved (42442 records). [2025-10-17T21:30:42.567526] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-17T21:30:42.567599] [INFO ] [MAIN ] Update Progress: 1916/2368 symbols completed. SITC took 31.5s. Estimated remaining: 1h 3m 51s. Rate: 7.1 symbols/min [2025-10-17T21:30:42.733124] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:30:42.768824] [DEBUG] [LOCAL ] SKE: Loaded 37259 existing records from primary storage. [2025-10-17T21:30:42.769108] [INFO ] [MAIN ] SKE: Loaded 37259 existing records. [2025-10-17T21:30:42.944613] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:30:42.944721] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-17T21:30:42.945059] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-17T21:30:42.945833] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-17T21:30:42.946006] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-17T21:30:42.946047] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-17T21:30:43.330318] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:30:43.742311] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-10-17T21:30:43.856145] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T21:30:44.518620] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T21:30:44.542274] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-17T21:30:45.032066] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-17T21:30:45.342329] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-17T21:30:45.940767] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T21:30:45.946237] [INFO ] [REMOTE ] SITE: Full fetch complete (50601 records). [2025-10-17T21:30:45.946326] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-17T21:30:46.150574] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-17T21:30:46.317615] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-17T21:30:46.317736] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-17T21:30:46.318778] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-17T21:30:46.318853] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-17T21:30:46.319871] [DEBUG] [LOCAL ] SITE: Trimmed 50601 records to 36106 (keeping 200 days of data) [2025-10-17T21:30:46.447026] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-17T21:30:46.549973] [DEBUG] [LOCAL ] SITE: Primary data saved (36106 records). [2025-10-17T21:30:46.550110] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-17T21:30:46.550197] [INFO ] [MAIN ] Update Progress: 1917/2368 symbols completed. SITE took 30.0s. Estimated remaining: 1h 3m 41s. Rate: 7.1 symbols/min [2025-10-17T21:30:46.942371] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-17T21:30:47.742313] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-17T21:30:47.906854] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T21:30:47.976910] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-17T21:30:48.542302] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-17T21:30:48.999562] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-17T21:30:49.342366] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-17T21:30:50.142291] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-17T21:30:50.260810] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T21:30:50.314170] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T21:30:50.942350] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-17T21:30:51.507949] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T21:30:51.742346] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-17T21:30:52.444191] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T21:30:52.542274] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-17T21:30:53.113424] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T21:30:53.342343] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-17T21:30:54.142369] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-17T21:30:54.282996] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T21:30:54.820426] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T21:30:54.942336] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-17T21:30:55.200243] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T21:30:55.742354] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-17T21:30:56.542267] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-17T21:30:56.825899] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T21:30:57.103119] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T21:30:57.342390] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-17T21:30:57.675588] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T21:30:58.142375] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-17T21:30:58.939530] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T21:30:58.946254] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-17T21:30:59.742273] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-17T21:30:59.984372] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T21:31:00.183132] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T21:31:00.542259] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-17T21:31:01.342276] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-17T21:31:01.373306] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T21:31:02.142322] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-17T21:31:02.414048] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T21:31:02.473075] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-17T21:31:02.942330] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-17T21:31:03.144843] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-17T21:31:03.742269] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-17T21:31:04.081138] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T21:31:04.086399] [INFO ] [REMOTE ] SJT: Full fetch complete (31919 records). [2025-10-17T21:31:04.086515] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-17T21:31:04.467008] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-17T21:31:04.467201] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-17T21:31:04.468130] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-17T21:31:04.468238] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-17T21:31:04.469762] [DEBUG] [LOCAL ] SJT: Trimmed 31919 records to 22927 (keeping 200 days of data) [2025-10-17T21:31:04.548046] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-17T21:31:04.589816] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T21:31:04.646837] [DEBUG] [LOCAL ] SJT: Primary data saved (22927 records). [2025-10-17T21:31:04.646969] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-17T21:31:04.647050] [INFO ] [MAIN ] Update Progress: 1918/2368 symbols completed. SJT took 29.7s. Estimated remaining: 1h 3m 35s. Rate: 7.1 symbols/min [2025-10-17T21:31:05.342273] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-17T21:31:06.180544] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T21:31:06.189560] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-17T21:31:06.913095] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T21:31:06.920064] [INFO ] [REMOTE ] SJM: Full fetch complete (72329 records). [2025-10-17T21:31:06.920217] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-17T21:31:07.309978] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-17T21:31:07.310067] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-17T21:31:07.311234] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-17T21:31:07.311305] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-17T21:31:07.312780] [DEBUG] [LOCAL ] SJM: Trimmed 72329 records to 50860 (keeping 200 days of data) [2025-10-17T21:31:07.620027] [DEBUG] [LOCAL ] SJM: Primary data saved (50860 records). [2025-10-17T21:31:07.620148] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-17T21:31:07.620227] [INFO ] [MAIN ] Update Progress: 1919/2368 symbols completed. SJM took 34.1s. Estimated remaining: 1h 3m 25s. Rate: 7.1 symbols/min [2025-10-17T21:31:07.889778] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T21:31:07.896325] [INFO ] [REMOTE ] SKE: Full fetch complete (52151 records). [2025-10-17T21:31:07.896435] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-17T21:31:08.266945] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-17T21:31:08.267029] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-17T21:31:08.268011] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-17T21:31:08.268076] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-17T21:31:08.269214] [DEBUG] [LOCAL ] SKE: Trimmed 52151 records to 37617 (keeping 200 days of data) [2025-10-17T21:31:08.484726] [DEBUG] [LOCAL ] SKE: Primary data saved (37617 records). [2025-10-17T21:31:08.484875] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-17T21:31:08.484959] [INFO ] [MAIN ] Update Progress: 1920/2368 symbols completed. SKE took 25.9s. Estimated remaining: 1h 3m 15s. Rate: 7.1 symbols/min [2025-10-17T21:31:09.056275] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:31:09.178345] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:31:09.129504] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:31:09.221289] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:31:09.232123] [DEBUG] [LOCAL ] SKIL: Loaded 6699 existing records from primary storage. [2025-10-17T21:31:09.232533] [INFO ] [MAIN ] SKIL: Loaded 6699 existing records. [2025-10-17T21:31:09.258730] [DEBUG] [LOCAL ] SKLZ: Loaded 11665 existing records from primary storage. [2025-10-17T21:31:09.282299] [INFO ] [MAIN ] SKLZ: Loaded 11665 existing records. [2025-10-17T21:31:09.430015] [DEBUG] [LOCAL ] SKM: Loaded 35553 existing records from primary storage. [2025-10-17T21:31:09.490877] [INFO ] [MAIN ] SKM: Loaded 35553 existing records. [2025-10-17T21:31:09.577020] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:31:09.583177] [DEBUG] [LOCAL ] SKT: Loaded 42837 existing records from primary storage. [2025-10-17T21:31:09.638223] [INFO ] [MAIN ] SKT: Loaded 42837 existing records. [2025-10-17T21:31:09.622417] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-17T21:31:09.669276] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-17T21:31:09.731844] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-17T21:31:09.744452] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-17T21:31:09.848781] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:31:09.980573] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-17T21:31:09.997480] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-17T21:31:10.008546] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-17T21:31:10.033244] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-17T21:31:10.151794] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:31:10.268680] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-17T21:31:10.268598] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:31:10.309615] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-17T21:31:10.344049] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-17T21:31:10.352023] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-17T21:31:10.373858] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-10-17T21:31:10.384667] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-10-17T21:31:10.390023] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-17T21:31:10.389927] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-17T21:31:10.936812] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:31:11.013354] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-10-17T21:31:11.291627] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:31:11.362891] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-10-17T21:31:11.516121] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:31:11.527981] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-10-17T21:31:11.551033] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:31:11.552751] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-10-17T21:31:11.924007] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T21:31:11.927528] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-17T21:31:12.547230] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T21:31:12.552258] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-17T21:31:12.641283] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T21:31:12.650518] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-17T21:31:12.689224] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-17T21:31:12.692038] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-17T21:31:13.054005] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T21:31:13.182259] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-17T21:31:13.342267] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-17T21:31:13.398480] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-17T21:31:13.639060] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T21:31:14.142339] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-17T21:31:14.195511] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-17T21:31:14.646472] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-17T21:31:14.942316] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-17T21:31:15.742317] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-17T21:31:16.424302] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-17T21:31:16.455517] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T21:31:16.542254] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-17T21:31:17.342292] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-17T21:31:18.129638] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T21:31:18.142252] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-17T21:31:18.641361] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T21:31:18.942295] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-17T21:31:19.725970] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T21:31:19.742266] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-17T21:31:19.860844] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-17T21:31:20.542346] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-17T21:31:21.280589] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-17T21:31:21.327552] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T21:31:21.342249] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-17T21:31:22.142295] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-17T21:31:22.627417] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-17T21:31:22.942272] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-17T21:31:22.984975] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T21:31:23.742376] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-17T21:31:24.252432] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T21:31:24.480968] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-17T21:31:24.542314] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-17T21:31:25.325244] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-17T21:31:25.342240] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-17T21:31:26.034825] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-17T21:31:26.142305] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-17T21:31:26.942289] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-17T21:31:27.704974] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T21:31:27.706514] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T21:31:27.742247] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-17T21:31:28.502619] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-17T21:31:28.504726] [INFO ] [REMOTE ] SKIL: Full fetch complete (10337 records). [2025-10-17T21:31:28.504801] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-17T21:31:28.547432] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-17T21:31:28.868359] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-17T21:31:28.868465] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-17T21:31:28.868791] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-17T21:31:28.868853] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-17T21:31:28.869281] [DEBUG] [LOCAL ] SKIL: Trimmed 10337 records to 6839 (keeping 200 days of data) [2025-10-17T21:31:28.909316] [DEBUG] [LOCAL ] SKIL: Primary data saved (6839 records). [2025-10-17T21:31:28.909432] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-17T21:31:28.909518] [INFO ] [MAIN ] Update Progress: 1921/2368 symbols completed. SKIL took 20.4s. Estimated remaining: 1h 3m 9s. Rate: 7.1 symbols/min [2025-10-17T21:31:29.079400] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:31:29.115156] [DEBUG] [LOCAL ] SKY: Loaded 38776 existing records from primary storage. [2025-10-17T21:31:29.115451] [INFO ] [MAIN ] SKY: Loaded 38776 existing records. [2025-10-17T21:31:29.290890] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:31:29.291103] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-17T21:31:29.291152] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-17T21:31:29.291361] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-10-17T21:31:29.291417] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-17T21:31:29.348267] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-17T21:31:29.655089] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:31:30.093137] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T21:31:30.142257] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-17T21:31:30.861626] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T21:31:30.942249] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-17T21:31:31.742298] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-17T21:31:31.862149] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T21:31:32.375365] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T21:31:32.509565] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-17T21:31:32.542260] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-17T21:31:33.301685] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-17T21:31:33.342249] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-17T21:31:34.142275] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-10-17T21:31:34.330698] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T21:31:34.942292] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-17T21:31:35.540086] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T21:31:35.742290] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-10-17T21:31:35.985524] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T21:31:36.542299] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-17T21:31:37.093067] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T21:31:37.342293] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-17T21:31:37.990064] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T21:31:38.142263] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-17T21:31:38.856872] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T21:31:38.942275] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-10-17T21:31:39.129885] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-17T21:31:39.742292] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-17T21:31:39.815730] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-17T21:31:40.542262] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-10-17T21:31:40.581112] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T21:31:41.342349] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-17T21:31:41.883496] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T21:31:42.142266] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-10. [2025-10-17T21:31:42.451573] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T21:31:42.942343] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-17T21:31:43.478422] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T21:31:43.483501] [INFO ] [REMOTE ] SKM: Full fetch complete (49052 records). [2025-10-17T21:31:43.483609] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-17T21:31:43.742492] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-17T21:31:43.760812] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T21:31:43.768402] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18014 records). [2025-10-17T21:31:43.780137] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-17T21:31:44.021956] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-17T21:31:44.045785] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-17T21:31:44.058030] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-17T21:31:44.076579] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-17T21:31:44.190308] [DEBUG] [LOCAL ] SKM: Trimmed 49052 records to 35792 (keeping 200 days of data) [2025-10-17T21:31:44.369466] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-17T21:31:44.372978] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-17T21:31:44.375680] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-17T21:31:44.377004] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-17T21:31:44.384394] [DEBUG] [LOCAL ] SKLZ: Trimmed 18014 records to 11752 (keeping 200 days of data) [2025-10-17T21:31:44.547832] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11752 records). [2025-10-17T21:31:44.545743] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-17T21:31:44.555885] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-17T21:31:44.568943] [DEBUG] [LOCAL ] SKM: Primary data saved (35792 records). [2025-10-17T21:31:44.569193] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-17T21:31:44.569122] [INFO ] [MAIN ] Update Progress: 1922/2368 symbols completed. SKLZ took 36.1s. Estimated remaining: 1h 3m 3s. Rate: 7.1 symbols/min [2025-10-17T21:31:44.581710] [INFO ] [MAIN ] Update Progress: 1923/2368 symbols completed. SKM took 36.1s. Estimated remaining: 1h 2m 52s. Rate: 7.1 symbols/min [2025-10-17T21:31:44.926223] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:31:44.930750] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:31:44.949342] [DEBUG] [LOCAL ] SKYH: Loaded 16341 existing records from primary storage. [2025-10-17T21:31:44.949684] [INFO ] [MAIN ] SKYH: Loaded 16341 existing records. [2025-10-17T21:31:45.148756] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:31:45.149306] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-17T21:31:45.163809] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-17T21:31:45.164109] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-17T21:31:45.164203] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-17T21:31:45.165050] [DEBUG] [LOCAL ] SLB: Loaded 54087 existing records from primary storage. [2025-10-17T21:31:45.208700] [INFO ] [MAIN ] SLB: Loaded 54087 existing records. [2025-10-17T21:31:45.505068] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T21:31:45.599160] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:31:45.625287] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-17T21:31:45.641193] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-17T21:31:45.646497] [INFO ] [REMOTE ] SKT: Full fetch complete (60608 records). [2025-10-17T21:31:45.661164] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-17T21:31:45.661071] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-10-17T21:31:45.665088] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-17T21:31:45.917332] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:31:45.955012] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-10-17T21:31:46.566249] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:31:46.590323] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-10-17T21:31:46.605051] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-17T21:31:46.605751] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-17T21:31:46.608543] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-17T21:31:46.608740] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-17T21:31:46.607238] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T21:31:46.619244] [DEBUG] [LOCAL ] SKT: Trimmed 60608 records to 43136 (keeping 200 days of data) [2025-10-17T21:31:46.877912] [DEBUG] [LOCAL ] SKT: Primary data saved (43136 records). [2025-10-17T21:31:46.878045] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-17T21:31:46.878150] [INFO ] [MAIN ] Update Progress: 1924/2368 symbols completed. SKT took 38.4s. Estimated remaining: 1h 2m 42s. Rate: 7.1 symbols/min [2025-10-17T21:31:46.945170] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-17T21:31:47.057561] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:31:47.072043] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T21:31:47.108548] [DEBUG] [LOCAL ] SLF: Loaded 39052 existing records from primary storage. [2025-10-17T21:31:47.108904] [INFO ] [MAIN ] SLF: Loaded 39052 existing records. [2025-10-17T21:31:47.304489] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:31:47.304740] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-17T21:31:47.304812] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-17T21:31:47.305040] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-17T21:31:47.305104] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-17T21:31:47.664862] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:31:47.742282] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-10-17T21:31:48.542269] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-17T21:31:48.623099] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T21:31:48.774369] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-17T21:31:49.141079] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T21:31:49.157342] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T21:31:49.342272] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-17T21:31:50.142338] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-17T21:31:50.797878] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T21:31:50.942293] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-17T21:31:51.687996] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T21:31:51.742263] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-17T21:31:52.254051] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-17T21:31:52.542298] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-17T21:31:53.120614] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T21:31:53.342299] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-17T21:31:54.142278] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-17T21:31:54.338207] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-17T21:31:54.399940] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T21:31:54.942291] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-17T21:31:55.713581] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T21:31:55.742348] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-17T21:31:56.542310] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-17T21:31:56.933362] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T21:31:57.008136] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-17T21:31:57.342257] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-17T21:31:57.812678] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T21:31:58.142288] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-17T21:31:58.880842] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T21:31:58.942296] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-17T21:31:59.742287] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-17T21:31:59.917888] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-17T21:32:00.312503] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-17T21:32:00.542309] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-17T21:32:01.342306] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-17T21:32:01.367884] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T21:32:01.631001] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T21:32:02.142292] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-17T21:32:02.942278] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-17T21:32:03.429320] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-17T21:32:03.614307] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T21:32:03.742308] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-17T21:32:04.494412] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T21:32:04.542324] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-17T21:32:05.342306] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-17T21:32:05.710526] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-17T21:32:06.012283] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T21:32:06.142326] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-17T21:32:06.445315] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T21:32:06.942296] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-17T21:32:07.627786] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-17T21:32:07.742292] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-17T21:32:07.782299] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-17T21:32:08.542338] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-17T21:32:09.342269] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-17T21:32:09.545824] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-17T21:32:09.835112] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-17T21:32:10.142287] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-17T21:32:10.942318] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-17T21:32:11.224511] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-17T21:32:11.235362] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T21:32:11.742379] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-17T21:32:12.241844] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-17T21:32:12.542363] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-17T21:32:13.076545] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-17T21:32:13.342277] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-17T21:32:13.425109] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-17T21:32:13.428088] [INFO ] [REMOTE ] SKYH: Full fetch complete (22548 records). [2025-10-17T21:32:13.428203] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-17T21:32:13.816142] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-17T21:32:13.816228] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-17T21:32:13.816786] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-17T21:32:13.816852] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-17T21:32:13.817626] [DEBUG] [LOCAL ] SKYH: Trimmed 22548 records to 16482 (keeping 200 days of data) [2025-10-17T21:32:13.919658] [DEBUG] [LOCAL ] SKYH: Primary data saved (16482 records). [2025-10-17T21:32:13.919801] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-17T21:32:13.919897] [INFO ] [MAIN ] Update Progress: 1925/2368 symbols completed. SKYH took 29.3s. Estimated remaining: 1h 2m 38s. Rate: 7.1 symbols/min [2025-10-17T21:32:14.085599] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:32:14.134135] [DEBUG] [LOCAL ] SLG: Loaded 45971 existing records from primary storage. [2025-10-17T21:32:14.134501] [INFO ] [MAIN ] SLG: Loaded 45971 existing records. [2025-10-17T21:32:14.147440] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-17T21:32:14.314750] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:32:14.314985] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-17T21:32:14.315054] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-17T21:32:14.315271] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-10-17T21:32:14.315345] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-17T21:32:14.667950] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:32:14.681929] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T21:32:14.687140] [INFO ] [REMOTE ] SLF: Full fetch complete (56501 records). [2025-10-17T21:32:14.687235] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-17T21:32:14.948713] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-10-17T21:32:15.066857] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-17T21:32:15.066942] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-17T21:32:15.067957] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-17T21:32:15.068021] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-17T21:32:15.069118] [DEBUG] [LOCAL ] SLF: Trimmed 56501 records to 39322 (keeping 200 days of data) [2025-10-17T21:32:15.312006] [DEBUG] [LOCAL ] SLF: Primary data saved (39322 records). [2025-10-17T21:32:15.312146] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-17T21:32:15.312231] [INFO ] [MAIN ] Update Progress: 1926/2368 symbols completed. SLF took 28.4s. Estimated remaining: 1h 2m 28s. Rate: 7.1 symbols/min [2025-10-17T21:32:15.482859] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:32:15.520749] [DEBUG] [LOCAL ] SLGN: Loaded 41193 existing records from primary storage. [2025-10-17T21:32:15.521056] [INFO ] [MAIN ] SLGN: Loaded 41193 existing records. [2025-10-17T21:32:15.699109] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:32:15.699334] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-17T21:32:15.699398] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-17T21:32:15.699623] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-10-17T21:32:15.699712] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-17T21:32:15.761484] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-17T21:32:16.055466] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:32:16.088788] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T21:32:16.542333] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-17T21:32:16.672026] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-17T21:32:17.204874] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T21:32:17.210561] [INFO ] [REMOTE ] SKY: Full fetch complete (54332 records). [2025-10-17T21:32:17.210688] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-17T21:32:17.351382] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-10-17T21:32:17.606051] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-17T21:32:17.606141] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-17T21:32:17.607190] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-17T21:32:17.607254] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-17T21:32:17.608416] [DEBUG] [LOCAL ] SKY: Trimmed 54332 records to 39132 (keeping 200 days of data) [2025-10-17T21:32:17.834518] [DEBUG] [LOCAL ] SKY: Primary data saved (39132 records). [2025-10-17T21:32:17.834689] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-17T21:32:17.834830] [INFO ] [MAIN ] Update Progress: 1927/2368 symbols completed. SKY took 48.9s. Estimated remaining: 1h 2m 18s. Rate: 7.1 symbols/min [2025-10-17T21:32:18.006401] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:32:18.006591] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-17T21:32:18.006630] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-17T21:32:18.006788] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-17T21:32:18.006829] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-17T21:32:18.006870] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-17T21:32:18.006903] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-17T21:32:18.147439] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-17T21:32:18.410076] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:32:18.618118] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-17T21:32:18.860997] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T21:32:18.942306] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-17T21:32:19.742301] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-17T21:32:19.956540] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T21:32:20.513587] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-17T21:32:20.542253] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-17T21:32:21.342265] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-17T21:32:21.972302] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-17T21:32:21.980092] [INFO ] [REMOTE ] SLB: Full fetch complete (77877 records). [2025-10-17T21:32:21.980264] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-17T21:32:22.144062] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-10-17T21:32:22.381785] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-10-17T21:32:22.381866] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-10-17T21:32:22.383136] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-10-17T21:32:22.383204] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-10-17T21:32:22.384707] [DEBUG] [LOCAL ] SLB: Trimmed 77877 records to 54477 (keeping 200 days of data) [2025-10-17T21:32:22.570008] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-17T21:32:22.731415] [DEBUG] [LOCAL ] SLB: Primary data saved (54477 records). [2025-10-17T21:32:22.731585] [INFO ] [MAIN ] SLB: Full history saved. [2025-10-17T21:32:22.731740] [INFO ] [MAIN ] Update Progress: 1928/2368 symbols completed. SLB took 38.1s. Estimated remaining: 1h 2m 9s. Rate: 7.1 symbols/min [2025-10-17T21:32:22.905177] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:32:22.943924] [DEBUG] [LOCAL ] SLQT: Loaded 43838 existing records from primary storage. [2025-10-17T21:32:22.944260] [INFO ] [MAIN ] SLQT: Loaded 43838 existing records. [2025-10-17T21:32:22.943273] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-17T21:32:23.145513] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:32:23.140332] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-17T21:32:23.148832] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-17T21:32:23.154319] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-17T21:32:23.154959] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-17T21:32:23.155028] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-17T21:32:23.342503] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-10-17T21:32:23.396142] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-17T21:32:23.558764] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:32:23.742268] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-17T21:32:24.542316] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-17T21:32:25.305444] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T21:32:25.342275] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-17T21:32:26.142319] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-10-17T21:32:26.181894] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T21:32:26.916536] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T21:32:26.942318] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-17T21:32:27.643585] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T21:32:27.742377] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-17T21:32:28.089807] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-17T21:32:28.389400] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T21:32:28.542314] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-17T21:32:29.342326] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-17T21:32:29.689444] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-17T21:32:30.128019] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T21:32:30.142245] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-17T21:32:30.942391] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-17T21:32:31.278916] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-17T21:32:31.561533] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T21:32:31.742351] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-17T21:32:32.542396] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-17T21:32:33.044444] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-17T21:32:33.342313] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-17T21:32:33.471084] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T21:32:33.683460] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-17T21:32:34.142301] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-17T21:32:34.942339] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-17T21:32:35.627908] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-17T21:32:35.670165] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T21:32:35.742258] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-17T21:32:36.542271] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-17T21:32:37.280363] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T21:32:37.342299] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-17T21:32:38.082239] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T21:32:38.142310] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-17T21:32:38.455991] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T21:32:38.462676] [INFO ] [REMOTE ] SLGN: Full fetch complete (59290 records). [2025-10-17T21:32:38.462843] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-17T21:32:38.844748] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-17T21:32:38.844828] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-17T21:32:38.845823] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-17T21:32:38.845885] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-17T21:32:38.847035] [DEBUG] [LOCAL ] SLGN: Trimmed 59290 records to 41517 (keeping 200 days of data) [2025-10-17T21:32:38.945289] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-17T21:32:39.103526] [DEBUG] [LOCAL ] SLGN: Primary data saved (41517 records). [2025-10-17T21:32:39.103711] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-17T21:32:39.103831] [INFO ] [MAIN ] Update Progress: 1929/2368 symbols completed. SLGN took 23.8s. Estimated remaining: 1h 2m 2s. Rate: 7.1 symbols/min [2025-10-17T21:32:39.267632] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:32:39.294879] [DEBUG] [LOCAL ] SLVM: Loaded 28003 existing records from primary storage. [2025-10-17T21:32:39.295134] [INFO ] [MAIN ] SLVM: Loaded 28003 existing records. [2025-10-17T21:32:39.467806] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:32:39.468014] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-17T21:32:39.468061] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-17T21:32:39.468230] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-10-17T21:32:39.468268] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-17T21:32:39.747147] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-17T21:32:39.829566] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:32:39.856806] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T21:32:40.132004] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-17T21:32:40.542317] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-10-17T21:32:40.624485] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T21:32:41.342373] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-17T21:32:41.784486] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T21:32:42.142315] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-17T21:32:42.942316] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-17T21:32:43.015786] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T21:32:43.198919] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T21:32:43.229134] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-17T21:32:43.742394] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-17T21:32:44.542352] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-17T21:32:45.007081] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T21:32:45.342336] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-17T21:32:46.143633] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-17T21:32:46.145950] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T21:32:46.717511] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-17T21:32:46.942368] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-17T21:32:47.742411] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-17T21:32:48.150020] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-17T21:32:48.542290] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-17T21:32:48.758015] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T21:32:48.877020] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T21:32:49.342398] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-17T21:32:50.142388] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-17T21:32:50.192013] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T21:32:50.684699] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T21:32:50.942316] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-17T21:32:51.233988] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-17T21:32:51.234949] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1045 records). [2025-10-17T21:32:51.235034] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-17T21:32:51.415556] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-17T21:32:51.415779] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-17T21:32:51.415848] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-17T21:32:51.415916] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-17T21:32:51.415981] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-17T21:32:51.416019] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-17T21:32:51.416058] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-17T21:32:51.416111] [INFO ] [MAIN ] Update Progress: 1930/2368 symbols completed. SLNZ took 33.6s. Estimated remaining: 1h 1m 54s. Rate: 7.1 symbols/min [2025-10-17T21:32:51.628010] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:32:51.675573] [DEBUG] [LOCAL ] SM: Loaded 52766 existing records from primary storage. [2025-10-17T21:32:51.675899] [INFO ] [MAIN ] SM: Loaded 52766 existing records. [2025-10-17T21:32:51.743136] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-17T21:32:51.863836] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:32:51.879994] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-17T21:32:51.880119] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-17T21:32:51.880429] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-10-17T21:32:51.880741] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-17T21:32:51.881496] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T21:32:52.236013] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:32:52.542309] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-10-17T21:32:53.009556] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T21:32:53.342303] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-17T21:32:53.908293] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T21:32:54.142352] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-17T21:32:54.819143] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T21:32:54.942291] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-17T21:32:55.422026] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-17T21:32:55.742314] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-17T21:32:56.545393] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-17T21:32:56.550790] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T21:32:57.005895] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T21:32:57.342367] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-17T21:32:58.114379] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T21:32:58.120686] [INFO ] [REMOTE ] SLG: Full fetch complete (65119 records). [2025-10-17T21:32:58.120793] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-17T21:32:58.151610] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-17T21:32:58.504084] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-17T21:32:58.504229] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-17T21:32:58.505379] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-17T21:32:58.505444] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-17T21:32:58.506712] [DEBUG] [LOCAL ] SLG: Trimmed 65119 records to 46349 (keeping 200 days of data) [2025-10-17T21:32:58.790391] [DEBUG] [LOCAL ] SLG: Primary data saved (46349 records). [2025-10-17T21:32:58.790526] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-17T21:32:58.790608] [INFO ] [MAIN ] Update Progress: 1931/2368 symbols completed. SLG took 44.9s. Estimated remaining: 1h 1m 46s. Rate: 7.1 symbols/min [2025-10-17T21:32:58.942259] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-17T21:32:58.960123] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:32:58.960959] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-17T21:32:58.961051] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-17T21:32:58.961169] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-17T21:32:58.961210] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-17T21:32:58.961251] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-17T21:32:58.961291] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-17T21:32:59.144197] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T21:32:59.354556] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:32:59.742260] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-10-17T21:32:59.932739] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T21:32:59.952523] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:32:59.952904] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-10-17T21:32:59.952996] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:32:59.953044] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-17T21:32:59.953105] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:32:59.953177] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-17T21:32:59.953241] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-17T21:32:59.953278] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-17T21:32:59.953318] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-17T21:32:59.953364] [INFO ] [MAIN ] Update Progress: 1932/2368 symbols completed. SMA took 1.2s. Estimated remaining: 1h 1m 36s. Rate: 7.1 symbols/min [2025-10-17T21:33:00.122328] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:33:00.132803] [DEBUG] [LOCAL ] SMBK: Loaded 8308 existing records from primary storage. [2025-10-17T21:33:00.133031] [INFO ] [MAIN ] SMBK: Loaded 8308 existing records. [2025-10-17T21:33:00.313455] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:33:00.313733] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-17T21:33:00.313896] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-17T21:33:00.314100] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-17T21:33:00.314181] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-17T21:33:00.447587] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T21:33:00.547377] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-17T21:33:00.690220] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:33:01.342283] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-17T21:33:02.142335] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-17T21:33:02.367728] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-17T21:33:02.661918] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-17T21:33:02.942331] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-10-17T21:33:03.426061] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-17T21:33:03.428130] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T21:33:03.742266] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-17T21:33:04.522968] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T21:33:04.542287] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-17T21:33:05.168037] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T21:33:05.342323] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-17T21:33:06.142320] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-17T21:33:06.942295] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-17T21:33:07.135800] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T21:33:07.402074] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T21:33:07.406471] [INFO ] [REMOTE ] SLVM: Full fetch complete (40191 records). [2025-10-17T21:33:07.406558] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-17T21:33:07.748683] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-17T21:33:07.790619] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-17T21:33:07.790727] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-17T21:33:07.791618] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-17T21:33:07.791700] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-17T21:33:07.792728] [DEBUG] [LOCAL ] SLVM: Trimmed 40191 records to 28167 (keeping 200 days of data) [2025-10-17T21:33:07.966008] [DEBUG] [LOCAL ] SLVM: Primary data saved (28167 records). [2025-10-17T21:33:07.966154] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-17T21:33:07.966244] [INFO ] [MAIN ] Update Progress: 1933/2368 symbols completed. SLVM took 28.9s. Estimated remaining: 1h 1m 27s. Rate: 7.1 symbols/min [2025-10-17T21:33:08.147880] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:33:08.162771] [DEBUG] [LOCAL ] SMC: Loaded 11307 existing records from primary storage. [2025-10-17T21:33:08.163140] [INFO ] [MAIN ] SMC: Loaded 11307 existing records. [2025-10-17T21:33:08.364380] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:33:08.364850] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-17T21:33:08.364973] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-17T21:33:08.372394] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-17T21:33:08.382398] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-17T21:33:08.402529] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T21:33:08.498825] [INFO ] [REMOTE ] SLQT: Full fetch complete (63860 records). [2025-10-17T21:33:08.504925] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-17T21:33:08.547937] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-17T21:33:08.963992] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:33:09.173882] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-17T21:33:09.173962] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-17T21:33:09.174995] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-17T21:33:09.175058] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-17T21:33:09.176317] [DEBUG] [LOCAL ] SLQT: Trimmed 63860 records to 44143 (keeping 200 days of data) [2025-10-17T21:33:09.343281] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-10-17T21:33:09.428113] [DEBUG] [LOCAL ] SLQT: Primary data saved (44143 records). [2025-10-17T21:33:09.428228] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-17T21:33:09.428341] [INFO ] [MAIN ] Update Progress: 1934/2368 symbols completed. SLQT took 46.7s. Estimated remaining: 1h 1m 17s. Rate: 7.1 symbols/min [2025-10-17T21:33:09.601010] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:33:09.608299] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T21:33:09.653520] [DEBUG] [LOCAL ] SMFG: Loaded 48740 existing records from primary storage. [2025-10-17T21:33:09.678806] [INFO ] [MAIN ] SMFG: Loaded 48740 existing records. [2025-10-17T21:33:09.767566] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-17T21:33:09.883459] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:33:09.883687] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-17T21:33:09.883746] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-17T21:33:09.883937] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-17T21:33:09.883993] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-17T21:33:10.146713] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-17T21:33:10.260819] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:33:10.269193] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T21:33:10.942335] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-17T21:33:11.742261] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-10-17T21:33:12.068636] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T21:33:12.087118] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T21:33:12.542363] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-17T21:33:13.342342] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-17T21:33:13.403576] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T21:33:13.953866] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T21:33:14.142260] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-17T21:33:14.182605] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T21:33:14.942299] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-17T21:33:15.740219] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T21:33:15.742689] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-17T21:33:16.107904] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-17T21:33:16.520550] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T21:33:16.542251] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-17T21:33:17.342302] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-17T21:33:18.142318] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-17T21:33:18.269572] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T21:33:18.890272] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-17T21:33:18.945324] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-17T21:33:18.950452] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T21:33:19.738057] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T21:33:19.742264] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-17T21:33:20.542300] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-17T21:33:21.342338] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-17T21:33:21.500212] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T21:33:22.142268] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-17T21:33:22.175479] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-17T21:33:22.430027] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T21:33:22.942303] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-17T21:33:23.749226] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-17T21:33:23.771317] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T21:33:23.829832] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T21:33:24.542338] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-17T21:33:25.342267] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-17T21:33:25.519550] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T21:33:25.527558] [INFO ] [REMOTE ] SM: Full fetch complete (75839 records). [2025-10-17T21:33:25.527790] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-17T21:33:25.537940] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T21:33:25.929754] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-17T21:33:25.929838] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-17T21:33:25.930989] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-17T21:33:25.931052] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-17T21:33:25.932445] [DEBUG] [LOCAL ] SM: Trimmed 75839 records to 53152 (keeping 200 days of data) [2025-10-17T21:33:26.037365] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-17T21:33:26.153016] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-17T21:33:26.269257] [DEBUG] [LOCAL ] SM: Primary data saved (53152 records). [2025-10-17T21:33:26.269391] [INFO ] [MAIN ] SM: Full history saved. [2025-10-17T21:33:26.269470] [INFO ] [MAIN ] Update Progress: 1935/2368 symbols completed. SM took 34.9s. Estimated remaining: 1h 1m 10s. Rate: 7.1 symbols/min [2025-10-17T21:33:26.434793] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:33:26.476559] [DEBUG] [LOCAL ] SMG: Loaded 43649 existing records from primary storage. [2025-10-17T21:33:26.476896] [INFO ] [MAIN ] SMG: Loaded 43649 existing records. [2025-10-17T21:33:26.655884] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:33:26.656167] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-17T21:33:26.656225] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-17T21:33:26.656507] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-10-17T21:33:26.656571] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-17T21:33:26.948471] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-17T21:33:26.948147] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-17T21:33:27.025169] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:33:27.715673] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-17T21:33:27.717460] [INFO ] [REMOTE ] SMBK: Full fetch complete (11873 records). [2025-10-17T21:33:27.717530] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-17T21:33:27.747543] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-17T21:33:28.072253] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-17T21:33:28.072328] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-17T21:33:28.072589] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-17T21:33:28.072629] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-17T21:33:28.073114] [DEBUG] [LOCAL ] SMBK: Trimmed 11873 records to 8414 (keeping 200 days of data) [2025-10-17T21:33:28.121996] [DEBUG] [LOCAL ] SMBK: Primary data saved (8414 records). [2025-10-17T21:33:28.122107] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-17T21:33:28.122185] [INFO ] [MAIN ] Update Progress: 1936/2368 symbols completed. SMBK took 28.2s. Estimated remaining: 1h 1m 0s. Rate: 7.1 symbols/min [2025-10-17T21:33:28.286075] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:33:28.300544] [DEBUG] [LOCAL ] SMHI: Loaded 13165 existing records from primary storage. [2025-10-17T21:33:28.300795] [INFO ] [MAIN ] SMHI: Loaded 13165 existing records. [2025-10-17T21:33:28.471749] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:33:28.471973] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-17T21:33:28.472020] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-17T21:33:28.472161] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-17T21:33:28.472198] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-17T21:33:28.547434] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-10-17T21:33:28.819738] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:33:29.342266] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-17T21:33:29.562164] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T21:33:29.885797] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-17T21:33:30.096372] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T21:33:30.142274] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-10-17T21:33:30.942289] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-17T21:33:31.393061] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T21:33:31.515863] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T21:33:31.742393] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-17T21:33:32.542291] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-17T21:33:33.342326] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-17T21:33:33.516087] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T21:33:33.603599] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T21:33:34.147016] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-17T21:33:34.150373] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-17T21:33:34.942407] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-17T21:33:35.730620] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T21:33:35.742251] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-17T21:33:35.837736] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T21:33:36.338013] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T21:33:36.340021] [INFO ] [REMOTE ] SMC: Full fetch complete (16585 records). [2025-10-17T21:33:36.340100] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-17T21:33:36.549585] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-17T21:33:36.719498] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-17T21:33:36.719569] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-17T21:33:36.719988] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-17T21:33:36.720060] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-17T21:33:36.720583] [DEBUG] [LOCAL ] SMC: Trimmed 16585 records to 11371 (keeping 200 days of data) [2025-10-17T21:33:36.786811] [DEBUG] [LOCAL ] SMC: Primary data saved (11371 records). [2025-10-17T21:33:36.786935] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-17T21:33:36.787017] [INFO ] [MAIN ] Update Progress: 1937/2368 symbols completed. SMC took 28.8s. Estimated remaining: 1h 0m 52s. Rate: 7.1 symbols/min [2025-10-17T21:33:36.967738] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:33:36.986687] [DEBUG] [LOCAL ] SMP: Loaded 18960 existing records from primary storage. [2025-10-17T21:33:36.986928] [INFO ] [MAIN ] SMP: Loaded 18960 existing records. [2025-10-17T21:33:37.172728] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:33:37.172994] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-17T21:33:37.173080] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-17T21:33:37.173277] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-10-17T21:33:37.173319] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-17T21:33:37.347525] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-17T21:33:37.590185] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:33:38.142269] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-10-17T21:33:38.208245] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T21:33:38.493155] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T21:33:38.942312] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-17T21:33:39.125038] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T21:33:39.742325] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-17T21:33:40.549595] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-17T21:33:40.571161] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T21:33:40.688829] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T21:33:41.342345] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-17T21:33:41.398660] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-17T21:33:42.142312] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-17T21:33:42.362578] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-17T21:33:42.942316] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-17T21:33:43.742265] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-17T21:33:43.830346] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T21:33:43.886670] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-17T21:33:44.542295] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-17T21:33:45.342277] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-17T21:33:45.533415] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T21:33:45.534263] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-17T21:33:46.142304] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-17T21:33:46.942290] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-17T21:33:46.999914] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T21:33:47.123574] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-17T21:33:47.742350] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-17T21:33:48.542309] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-17T21:33:48.655788] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-17T21:33:48.657551] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T21:33:49.342305] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-17T21:33:49.626064] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T21:33:50.142355] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-17T21:33:50.225847] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-17T21:33:50.942328] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-17T21:33:51.286487] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T21:33:51.740216] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T21:33:51.743672] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-17T21:33:52.542315] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-17T21:33:53.342300] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-17T21:33:53.389075] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T21:33:53.397020] [INFO ] [REMOTE ] SMFG: Full fetch complete (69372 records). [2025-10-17T21:33:53.397218] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-17T21:33:53.695169] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T21:33:53.932264] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-17T21:33:53.932469] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-17T21:33:53.935835] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-17T21:33:53.935917] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-17T21:33:53.938235] [DEBUG] [LOCAL ] SMFG: Trimmed 69372 records to 49084 (keeping 200 days of data) [2025-10-17T21:33:54.081843] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-17T21:33:54.160518] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-17T21:33:54.300287] [DEBUG] [LOCAL ] SMFG: Primary data saved (49084 records). [2025-10-17T21:33:54.300500] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-17T21:33:54.300604] [INFO ] [MAIN ] Update Progress: 1938/2368 symbols completed. SMFG took 44.9s. Estimated remaining: 1h 0m 46s. Rate: 7.1 symbols/min [2025-10-17T21:33:54.476563] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:33:54.534928] [DEBUG] [LOCAL ] SMR: Loaded 54189 existing records from primary storage. [2025-10-17T21:33:54.535440] [INFO ] [MAIN ] SMR: Loaded 54189 existing records. [2025-10-17T21:33:54.724330] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:33:54.724728] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-17T21:33:54.724791] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-17T21:33:54.725028] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-10-17T21:33:54.725073] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-17T21:33:54.952246] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-17T21:33:55.143853] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:33:55.668094] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T21:33:55.669919] [INFO ] [REMOTE ] SMHI: Full fetch complete (21643 records). [2025-10-17T21:33:55.669991] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-17T21:33:55.747372] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-17T21:33:56.051918] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-17T21:33:56.052067] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-17T21:33:56.052540] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-17T21:33:56.052637] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-17T21:33:56.053376] [DEBUG] [LOCAL ] SMHI: Trimmed 21643 records to 13216 (keeping 200 days of data) [2025-10-17T21:33:56.133166] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T21:33:56.161114] [DEBUG] [LOCAL ] SMHI: Primary data saved (13216 records). [2025-10-17T21:33:56.161231] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-17T21:33:56.161306] [INFO ] [MAIN ] Update Progress: 1939/2368 symbols completed. SMHI took 28.0s. Estimated remaining: 1h 0m 36s. Rate: 7.1 symbols/min [2025-10-17T21:33:56.329047] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:33:56.369095] [DEBUG] [LOCAL ] SMRT: Loaded 44269 existing records from primary storage. [2025-10-17T21:33:56.369380] [INFO ] [MAIN ] SMRT: Loaded 44269 existing records. [2025-10-17T21:33:56.545201] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-10-17T21:33:56.545109] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:33:56.546097] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-17T21:33:56.546145] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-17T21:33:56.546323] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-17T21:33:56.546379] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-17T21:33:56.908857] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T21:33:56.916122] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:33:57.342320] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-10-17T21:33:58.142284] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-17T21:33:58.887859] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T21:33:58.942243] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-17T21:33:59.274505] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-10-17T21:33:59.741818] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T21:33:59.750813] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-17T21:34:00.324719] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T21:34:00.542279] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-17T21:34:01.342273] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-17T21:34:01.730195] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-17T21:34:02.142270] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-17T21:34:02.765556] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (3.01 seconds). [2025-10-17T21:34:02.942281] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-17T21:34:03.217721] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-17T21:34:03.262353] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-17T21:34:03.742377] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-17T21:34:04.542303] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-17T21:34:05.342415] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-17T21:34:05.411934] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-17T21:34:05.495382] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T21:34:06.124311] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T21:34:06.142243] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-17T21:34:06.178015] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T21:34:06.942331] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-17T21:34:07.742375] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-17T21:34:07.768560] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T21:34:08.542327] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-17T21:34:08.689962] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T21:34:08.692732] [INFO ] [REMOTE ] SMP: Full fetch complete (26413 records). [2025-10-17T21:34:08.692841] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-17T21:34:09.063502] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-17T21:34:09.063588] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-17T21:34:09.064154] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-17T21:34:09.064219] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-17T21:34:09.065074] [DEBUG] [LOCAL ] SMP: Trimmed 26413 records to 19099 (keeping 200 days of data) [2025-10-17T21:34:09.187969] [DEBUG] [LOCAL ] SMP: Primary data saved (19099 records). [2025-10-17T21:34:09.188171] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-17T21:34:09.188303] [INFO ] [MAIN ] Update Progress: 1940/2368 symbols completed. SMP took 32.4s. Estimated remaining: 1h 0m 28s. Rate: 7.1 symbols/min [2025-10-17T21:34:09.359174] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-17T21:34:09.362772] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:34:09.399726] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-17T21:34:09.436448] [DEBUG] [LOCAL ] SMWB: Loaded 32395 existing records from primary storage. [2025-10-17T21:34:09.436742] [INFO ] [MAIN ] SMWB: Loaded 32395 existing records. [2025-10-17T21:34:09.611253] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:34:09.611468] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-17T21:34:09.611520] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-17T21:34:09.611797] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-17T21:34:09.611856] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-17T21:34:09.973546] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:34:10.093232] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-17T21:34:10.142246] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-17T21:34:10.950127] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-17T21:34:10.970060] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T21:34:11.651875] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T21:34:11.742287] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-17T21:34:12.542346] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-17T21:34:13.199529] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T21:34:13.253015] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-17T21:34:13.342306] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-17T21:34:13.969289] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T21:34:13.975132] [INFO ] [REMOTE ] SMG: Full fetch complete (62975 records). [2025-10-17T21:34:13.975300] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-17T21:34:14.150047] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-10-17T21:34:14.372506] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-17T21:34:14.372613] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-17T21:34:14.373863] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-17T21:34:14.373938] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-17T21:34:14.375294] [DEBUG] [LOCAL ] SMG: Trimmed 62975 records to 43860 (keeping 200 days of data) [2025-10-17T21:34:14.640174] [DEBUG] [LOCAL ] SMG: Primary data saved (43860 records). [2025-10-17T21:34:14.640320] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-17T21:34:14.640461] [INFO ] [MAIN ] Update Progress: 1941/2368 symbols completed. SMG took 48.4s. Estimated remaining: 1h 0m 19s. Rate: 7.1 symbols/min [2025-10-17T21:34:14.809382] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:34:14.857344] [DEBUG] [LOCAL ] SN: Loaded 50370 existing records from primary storage. [2025-10-17T21:34:14.857755] [INFO ] [MAIN ] SN: Loaded 50370 existing records. [2025-10-17T21:34:14.949013] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-17T21:34:15.036602] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:34:15.036864] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-17T21:34:15.036913] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-17T21:34:15.037090] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-17T21:34:15.037142] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-17T21:34:15.391266] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:34:15.683812] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T21:34:15.742324] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-17T21:34:16.159825] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-10-17T21:34:16.201335] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-17T21:34:16.542387] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-17T21:34:17.103766] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T21:34:17.342388] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-10-17T21:34:18.058737] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T21:34:18.142351] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-17T21:34:18.942422] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-17T21:34:18.978834] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T21:34:19.683897] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T21:34:19.742274] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-17T21:34:20.542360] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-17T21:34:21.230277] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T21:34:21.278095] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-17T21:34:21.342302] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-17T21:34:22.025450] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T21:34:22.142330] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-17T21:34:22.942381] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-17T21:34:23.565260] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-17T21:34:23.571277] [INFO ] [REMOTE ] SMRT: Full fetch complete (62299 records). [2025-10-17T21:34:23.571467] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-17T21:34:23.752255] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-17T21:34:23.981460] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-17T21:34:23.981776] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-17T21:34:23.983017] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-17T21:34:23.983162] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-17T21:34:23.984671] [DEBUG] [LOCAL ] SMRT: Trimmed 62299 records to 44571 (keeping 200 days of data) [2025-10-17T21:34:24.242664] [DEBUG] [LOCAL ] SMRT: Primary data saved (44571 records). [2025-10-17T21:34:24.242810] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-17T21:34:24.242992] [INFO ] [MAIN ] Update Progress: 1942/2368 symbols completed. SMRT took 28.1s. Estimated remaining: 1h 0m 11s. Rate: 7.1 symbols/min [2025-10-17T21:34:24.418580] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:34:24.474759] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (3.13 seconds). [2025-10-17T21:34:24.473210] [DEBUG] [LOCAL ] SNA: Loaded 26111 existing records from primary storage. [2025-10-17T21:34:24.486735] [INFO ] [MAIN ] SNA: Loaded 26111 existing records. [2025-10-17T21:34:24.550094] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-17T21:34:24.696973] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:34:24.697237] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-17T21:34:24.699135] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-17T21:34:24.699222] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-17T21:34:24.709126] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-10-17T21:34:24.709195] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-17T21:34:25.063785] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:34:25.151916] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-17T21:34:25.342269] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-10-17T21:34:26.142344] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-17T21:34:26.607617] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-17T21:34:26.942366] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-17T21:34:27.308832] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-10-17T21:34:27.341960] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-17T21:34:27.742285] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-17T21:34:28.542281] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-17T21:34:28.635555] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T21:34:29.069339] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T21:34:29.342380] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-17T21:34:30.142350] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-17T21:34:30.942281] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-17T21:34:31.062931] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T21:34:31.147391] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-17T21:34:31.445479] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-17T21:34:31.742376] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-17T21:34:32.322183] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T21:34:32.542332] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-17T21:34:33.342247] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-17T21:34:33.619412] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T21:34:33.991406] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T21:34:34.142309] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-17T21:34:34.942289] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-17T21:34:35.582527] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T21:34:35.742270] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-17T21:34:36.059146] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (2.72 seconds). [2025-10-17T21:34:36.067285] [INFO ] [REMOTE ] SMR: Full fetch complete (77977 records). [2025-10-17T21:34:36.067559] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-17T21:34:36.405680] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T21:34:36.489873] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-10-17T21:34:36.489995] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-10-17T21:34:36.491623] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-10-17T21:34:36.491739] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-10-17T21:34:36.493901] [DEBUG] [LOCAL ] SMR: Trimmed 77977 records to 54579 (keeping 200 days of data) [2025-10-17T21:34:36.547933] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-17T21:34:36.834257] [DEBUG] [LOCAL ] SMR: Primary data saved (54579 records). [2025-10-17T21:34:36.835018] [INFO ] [MAIN ] SMR: Full history saved. [2025-10-17T21:34:36.835377] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-17T21:34:36.835660] [INFO ] [MAIN ] Update Progress: 1943/2368 symbols completed. SMR took 42.5s. Estimated remaining: 1h 0m 3s. Rate: 7.1 symbols/min [2025-10-17T21:34:36.883196] [INFO ] [REMOTE ] SMWB: Full fetch complete (49005 records). [2025-10-17T21:34:36.908864] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-17T21:34:37.173149] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:34:37.346391] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-17T21:34:37.403738] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-17T21:34:37.403857] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-17T21:34:37.405092] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-17T21:34:37.405262] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-17T21:34:37.406939] [DEBUG] [LOCAL ] SMWB: Trimmed 49005 records to 32540 (keeping 200 days of data) [2025-10-17T21:34:37.528544] [DEBUG] [LOCAL ] SNAP: Loaded 54186 existing records from primary storage. [2025-10-17T21:34:37.530085] [INFO ] [MAIN ] SNAP: Loaded 54186 existing records. [2025-10-17T21:34:37.720262] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:34:37.721551] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-17T21:34:37.722136] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-17T21:34:37.723039] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-17T21:34:37.723112] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-17T21:34:38.118370] [DEBUG] [LOCAL ] SMWB: Primary data saved (32540 records). [2025-10-17T21:34:38.118738] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-17T21:34:38.123988] [INFO ] [MAIN ] Update Progress: 1944/2368 symbols completed. SMWB took 28.9s. Estimated remaining: 59m 53s. Rate: 7.1 symbols/min [2025-10-17T21:34:38.189766] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:34:38.221631] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-10-17T21:34:38.280251] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T21:34:38.376369] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:34:38.383588] [DEBUG] [LOCAL ] SNDA: Loaded 4504 existing records from primary storage. [2025-10-17T21:34:38.383837] [INFO ] [MAIN ] SNDA: Loaded 4504 existing records. [2025-10-17T21:34:38.554567] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:34:38.554825] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-17T21:34:38.554913] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-17T21:34:38.555048] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-17T21:34:38.555087] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-17T21:34:38.903435] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:34:38.942260] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-10-17T21:34:39.184010] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T21:34:39.742286] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-17T21:34:39.799778] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-17T21:34:40.515515] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-17T21:34:40.542255] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-17T21:34:41.324616] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T21:34:41.342251] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-17T21:34:42.142350] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-17T21:34:42.637335] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-17T21:34:42.700109] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T21:34:42.942284] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-17T21:34:42.990980] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-17T21:34:43.742368] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-17T21:34:44.221420] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T21:34:44.453933] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-17T21:34:44.542334] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-17T21:34:45.342366] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-17T21:34:46.142315] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-17T21:34:46.247554] [DEBUG] [REMOTE ] SNA: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-17T21:34:46.247824] [WARN ] [REMOTE ] SNA: No data returned for month 2025-07 [2025-10-17T21:34:46.247925] [FATAL] [REMOTE ] SNA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:34:46.248018] [FATAL] [MAIN ] SNA: Failed to fetch primary data. [2025-10-17T21:34:46.248087] [WARN ] [MAIN ] SNA: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:34:46.248179] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-17T21:34:46.248256] [DEBUG] [LOCAL ] SNA: No primary data file found to delete. [2025-10-17T21:34:46.248296] [INFO ] [LOCAL ] SNA: Starting deletion of derivative data. [2025-10-17T21:34:46.248447] [DEBUG] [LOCAL ] SNA: Deleted derivative data file. [2025-10-17T21:34:46.248556] [INFO ] [MAIN ] Update Progress: 1945/2368 symbols completed. SNA took 22.0s. Estimated remaining: 59m 45s. Rate: 7.1 symbols/min [2025-10-17T21:34:46.457725] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:34:46.496115] [DEBUG] [LOCAL ] SNDR: Loaded 41893 existing records from primary storage. [2025-10-17T21:34:46.496393] [INFO ] [MAIN ] SNDR: Loaded 41893 existing records. [2025-10-17T21:34:46.680781] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:34:46.681211] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-17T21:34:46.681279] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-17T21:34:46.681669] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-10-17T21:34:46.681780] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-17T21:34:46.947681] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-17T21:34:46.989133] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-17T21:34:47.081705] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:34:47.110686] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T21:34:47.623019] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-17T21:34:47.742258] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-17T21:34:48.381862] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-17T21:34:48.542270] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-17T21:34:49.218582] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-17T21:34:49.342325] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-10-17T21:34:50.142384] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-17T21:34:50.787153] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T21:34:50.942304] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-17T21:34:51.742345] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-17T21:34:52.295980] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-17T21:34:52.401377] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-17T21:34:52.436105] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T21:34:52.542273] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-17T21:34:53.342291] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-17T21:34:54.142293] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-17T21:34:54.770143] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-17T21:34:54.813890] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T21:34:54.942320] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-17T21:34:55.387021] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-10-17T21:34:55.742288] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-17T21:34:56.542299] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-17T21:34:56.788206] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T21:34:57.342303] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-17T21:34:57.896347] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-17T21:34:57.972551] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T21:34:58.102852] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-17T21:34:58.142279] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-17T21:34:58.942321] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-17T21:34:59.742299] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-17T21:35:00.386336] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-17T21:35:00.457810] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T21:35:00.542292] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-17T21:35:01.243204] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T21:35:01.342279] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-17T21:35:02.132379] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-17T21:35:02.142262] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-17T21:35:02.942340] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-17T21:35:03.092478] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T21:35:03.560320] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T21:35:03.560512] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-17T21:35:03.742364] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-17T21:35:04.348539] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T21:35:04.349727] [INFO ] [REMOTE ] SNDA: Full fetch complete (7571 records). [2025-10-17T21:35:04.349799] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-17T21:35:04.548492] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-17T21:35:04.722225] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-17T21:35:04.722310] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-17T21:35:04.722529] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-17T21:35:04.722592] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-17T21:35:04.723002] [DEBUG] [LOCAL ] SNDA: Trimmed 7571 records to 4539 (keeping 200 days of data) [2025-10-17T21:35:04.749066] [DEBUG] [LOCAL ] SNDA: Primary data saved (4539 records). [2025-10-17T21:35:04.749181] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-17T21:35:04.749264] [INFO ] [MAIN ] Update Progress: 1946/2368 symbols completed. SNDA took 26.6s. Estimated remaining: 59m 38s. Rate: 7.1 symbols/min [2025-10-17T21:35:04.922376] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:35:04.969347] [DEBUG] [LOCAL ] SNN: Loaded 44635 existing records from primary storage. [2025-10-17T21:35:04.969825] [INFO ] [MAIN ] SNN: Loaded 44635 existing records. [2025-10-17T21:35:05.158287] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:35:05.158506] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-17T21:35:05.158552] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-17T21:35:05.158851] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-17T21:35:05.158908] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-17T21:35:05.347700] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-17T21:35:05.507258] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:35:06.142322] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-10-17T21:35:06.195444] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T21:35:06.202436] [INFO ] [REMOTE ] SN: Full fetch complete (71716 records). [2025-10-17T21:35:06.202544] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-17T21:35:06.589436] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-17T21:35:06.589520] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-17T21:35:06.590685] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-17T21:35:06.590748] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-17T21:35:06.592129] [DEBUG] [LOCAL ] SN: Trimmed 71716 records to 50745 (keeping 200 days of data) [2025-10-17T21:35:06.888294] [DEBUG] [LOCAL ] SN: Primary data saved (50745 records). [2025-10-17T21:35:06.888423] [INFO ] [MAIN ] SN: Full history saved. [2025-10-17T21:35:06.888503] [INFO ] [MAIN ] Update Progress: 1947/2368 symbols completed. SN took 52.2s. Estimated remaining: 59m 28s. Rate: 7.1 symbols/min [2025-10-17T21:35:06.951069] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-17T21:35:07.061415] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:35:07.061585] [DEBUG] [LOCAL ] SNOW: No existing data file found in primary storage. [2025-10-17T21:35:07.061718] [WARN ] [MAIN ] SNOW: No existing data found, performing full refresh instead. [2025-10-17T21:35:07.061837] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-17T21:35:07.061879] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-17T21:35:07.061921] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-10-17T21:35:07.061959] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-17T21:35:07.349900] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-17T21:35:07.464746] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:35:07.487404] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-17T21:35:07.742295] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-17T21:35:08.542302] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-17T21:35:09.289865] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T21:35:09.342259] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-10-17T21:35:09.743985] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-10-17T21:35:09.951404] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T21:35:10.142295] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-17T21:35:10.942283] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-17T21:35:11.582238] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-17T21:35:11.615213] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T21:35:11.742305] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-17T21:35:12.542285] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-17T21:35:13.342331] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-17T21:35:13.613858] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-10-17T21:35:14.004322] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-17T21:35:14.140260] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T21:35:14.143433] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-17T21:35:14.850835] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T21:35:14.942287] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-17T21:35:15.742352] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-17T21:35:16.562690] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-17T21:35:16.583926] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T21:35:16.593155] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-17T21:35:16.605256] [INFO ] [REMOTE ] SNDR: Full fetch complete (60128 records). [2025-10-17T21:35:16.606395] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-17T21:35:16.982524] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-17T21:35:16.982620] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-17T21:35:16.983735] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-17T21:35:16.983799] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-17T21:35:16.985385] [DEBUG] [LOCAL ] SNDR: Trimmed 60128 records to 42209 (keeping 200 days of data) [2025-10-17T21:35:17.235150] [DEBUG] [LOCAL ] SNDR: Primary data saved (42209 records). [2025-10-17T21:35:17.235275] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-17T21:35:17.235371] [INFO ] [MAIN ] Update Progress: 1948/2368 symbols completed. SNDR took 31.0s. Estimated remaining: 59m 20s. Rate: 7.1 symbols/min [2025-10-17T21:35:17.347457] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-17T21:35:17.404402] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:35:17.447443] [DEBUG] [LOCAL ] SNV: Loaded 49426 existing records from primary storage. [2025-10-17T21:35:17.447801] [INFO ] [MAIN ] SNV: Loaded 49426 existing records. [2025-10-17T21:35:17.619439] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:35:17.619625] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-17T21:35:17.619709] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-17T21:35:17.619901] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-10-17T21:35:17.619941] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-17T21:35:17.979530] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:35:18.009871] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-17T21:35:18.142258] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-17T21:35:18.361389] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T21:35:18.942344] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-17T21:35:19.626503] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-17T21:35:19.633837] [INFO ] [REMOTE ] SNAP: Full fetch complete (77975 records). [2025-10-17T21:35:19.633946] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-17T21:35:19.747571] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-10-17T21:35:20.022007] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-17T21:35:20.022094] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-17T21:35:20.023266] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-17T21:35:20.023330] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-17T21:35:20.024784] [DEBUG] [LOCAL ] SNAP: Trimmed 77975 records to 54576 (keeping 200 days of data) [2025-10-17T21:35:20.339026] [DEBUG] [LOCAL ] SNAP: Primary data saved (54576 records). [2025-10-17T21:35:20.339309] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-17T21:35:20.339415] [INFO ] [MAIN ] Update Progress: 1949/2368 symbols completed. SNAP took 43.5s. Estimated remaining: 59m 11s. Rate: 7.1 symbols/min [2025-10-17T21:35:20.511833] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:35:20.574394] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-17T21:35:20.575848] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T21:35:20.597339] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-17T21:35:20.627896] [DEBUG] [LOCAL ] SNX: Loaded 39754 existing records from primary storage. [2025-10-17T21:35:20.628188] [INFO ] [MAIN ] SNX: Loaded 39754 existing records. [2025-10-17T21:35:20.801116] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:35:20.801372] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-17T21:35:20.801419] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-17T21:35:20.801594] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-10-17T21:35:20.801631] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-17T21:35:21.156506] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:35:21.342276] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-10-17T21:35:21.539724] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T21:35:22.142387] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-17T21:35:22.862113] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T21:35:22.914318] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-17T21:35:22.942274] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-17T21:35:23.319538] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T21:35:23.742307] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-17T21:35:24.542317] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-17T21:35:25.351843] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-17T21:35:25.373389] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-17T21:35:25.477685] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-17T21:35:26.142294] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-17T21:35:26.367319] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-17T21:35:26.932803] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T21:35:26.942240] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-17T21:35:27.742262] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-17T21:35:28.142913] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-17T21:35:28.527870] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T21:35:28.542236] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-17T21:35:29.342268] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-17T21:35:29.446495] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T21:35:30.142351] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-17T21:35:30.239518] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-17T21:35:30.908490] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T21:35:30.942266] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-17T21:35:31.712237] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T21:35:31.742274] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-17T21:35:32.417251] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T21:35:32.423066] [INFO ] [REMOTE ] SNN: Full fetch complete (63104 records). [2025-10-17T21:35:32.423203] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-17T21:35:32.547401] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-17T21:35:32.816620] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-17T21:35:32.816751] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-17T21:35:32.817934] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-17T21:35:32.818006] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-17T21:35:32.819602] [DEBUG] [LOCAL ] SNN: Trimmed 63104 records to 44929 (keeping 200 days of data) [2025-10-17T21:35:33.085189] [DEBUG] [LOCAL ] SNN: Primary data saved (44929 records). [2025-10-17T21:35:33.085316] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-17T21:35:33.085393] [INFO ] [MAIN ] Update Progress: 1950/2368 symbols completed. SNN took 28.3s. Estimated remaining: 59m 3s. Rate: 7.1 symbols/min [2025-10-17T21:35:33.251356] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:35:33.300832] [DEBUG] [LOCAL ] SO: Loaded 54004 existing records from primary storage. [2025-10-17T21:35:33.301142] [INFO ] [MAIN ] SO: Loaded 54004 existing records. [2025-10-17T21:35:33.363550] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-17T21:35:33.479774] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:35:33.479998] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-17T21:35:33.480047] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-17T21:35:33.480540] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-10-17T21:35:33.480597] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-17T21:35:33.841557] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:35:33.957689] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-17T21:35:34.142338] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-10-17T21:35:34.352169] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T21:35:34.942267] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-17T21:35:35.103437] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T21:35:35.742329] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-17T21:35:35.952458] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T21:35:36.446851] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T21:35:36.542279] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-17T21:35:37.342310] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-17T21:35:37.387684] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T21:35:38.003368] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T21:35:38.142274] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-17T21:35:38.942276] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-17T21:35:39.159491] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-17T21:35:39.632476] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-17T21:35:39.742274] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-17T21:35:40.542354] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-17T21:35:41.272307] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T21:35:41.342291] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-17T21:35:41.378990] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-17T21:35:42.142341] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-17T21:35:42.306985] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T21:35:42.942957] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-17T21:35:42.945245] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T21:35:43.742317] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-17T21:35:44.448598] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T21:35:44.486599] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-17T21:35:44.542257] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-17T21:35:45.342263] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-17T21:35:45.375393] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T21:35:46.142322] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-17T21:35:46.395981] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T21:35:46.942292] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-17T21:35:47.742287] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-17T21:35:47.823168] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-17T21:35:48.011023] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T21:35:48.016502] [INFO ] [REMOTE ] SNX: Full fetch complete (57401 records). [2025-10-17T21:35:48.016620] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-17T21:35:48.417052] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-17T21:35:48.435444] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-17T21:35:48.435546] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-17T21:35:48.447253] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-17T21:35:48.447346] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-17T21:35:48.449120] [DEBUG] [LOCAL ] SNX: Trimmed 57401 records to 39987 (keeping 200 days of data) [2025-10-17T21:35:48.543737] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-17T21:35:48.709461] [DEBUG] [LOCAL ] SNX: Primary data saved (39987 records). [2025-10-17T21:35:48.709632] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-17T21:35:48.709759] [INFO ] [MAIN ] Update Progress: 1951/2368 symbols completed. SNX took 28.4s. Estimated remaining: 58m 56s. Rate: 7.1 symbols/min [2025-10-17T21:35:48.877925] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:35:48.912815] [DEBUG] [LOCAL ] SOBO: Loaded 39708 existing records from primary storage. [2025-10-17T21:35:48.913097] [INFO ] [MAIN ] SOBO: Loaded 39708 existing records. [2025-10-17T21:35:49.092589] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:35:49.092803] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-17T21:35:49.092880] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-17T21:35:49.093083] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-17T21:35:49.093141] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-17T21:35:49.350917] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-17T21:35:49.456715] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:35:49.485202] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-17T21:35:50.142251] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-17T21:35:50.417463] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T21:35:50.942355] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-17T21:35:51.742283] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-10-17T21:35:51.807385] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-17T21:35:51.815941] [INFO ] [REMOTE ] SNOW: Full fetch complete (77732 records). [2025-10-17T21:35:51.816199] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-17T21:35:51.930800] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T21:35:52.253018] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-10-17T21:35:52.253103] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-10-17T21:35:52.254300] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-10-17T21:35:52.254366] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-10-17T21:35:52.255871] [DEBUG] [LOCAL ] SNOW: Trimmed 77732 records to 54371 (keeping 200 days of data) [2025-10-17T21:35:52.543309] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-17T21:35:52.591238] [DEBUG] [LOCAL ] SNOW: Primary data saved (54371 records). [2025-10-17T21:35:52.591387] [INFO ] [MAIN ] SNOW: Full history saved. [2025-10-17T21:35:52.591462] [INFO ] [MAIN ] Update Progress: 1952/2368 symbols completed. SNOW took 45.7s. Estimated remaining: 58m 47s. Rate: 7.1 symbols/min [2025-10-17T21:35:52.765339] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:35:52.802976] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-17T21:35:52.857040] [DEBUG] [LOCAL ] SOC: Loaded 51356 existing records from primary storage. [2025-10-17T21:35:52.857448] [INFO ] [MAIN ] SOC: Loaded 51356 existing records. [2025-10-17T21:35:53.031910] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:35:53.032183] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-17T21:35:53.032233] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-17T21:35:53.032469] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-17T21:35:53.032553] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-17T21:35:53.344271] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-17T21:35:53.415912] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:35:53.446172] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T21:35:53.771570] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-17T21:35:53.783275] [INFO ] [REMOTE ] SNV: Full fetch complete (71746 records). [2025-10-17T21:35:53.783494] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-17T21:35:54.147427] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-17T21:35:54.372492] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-17T21:35:54.372578] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-17T21:35:54.373730] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-17T21:35:54.373795] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-17T21:35:54.375202] [DEBUG] [LOCAL ] SNV: Trimmed 71746 records to 49816 (keeping 200 days of data) [2025-10-17T21:35:54.704866] [DEBUG] [LOCAL ] SNV: Primary data saved (49816 records). [2025-10-17T21:35:54.705005] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-17T21:35:54.705089] [INFO ] [MAIN ] Update Progress: 1953/2368 symbols completed. SNV took 37.5s. Estimated remaining: 58m 37s. Rate: 7.1 symbols/min [2025-10-17T21:35:54.877111] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:35:54.884871] [DEBUG] [LOCAL ] SOJC: Loaded 4835 existing records from primary storage. [2025-10-17T21:35:54.885100] [INFO ] [MAIN ] SOJC: Loaded 4835 existing records. [2025-10-17T21:35:54.956276] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-10-17T21:35:55.082293] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:35:55.082517] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-17T21:35:55.082567] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-17T21:35:55.082759] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-17T21:35:55.082816] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-17T21:35:55.464880] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:35:55.498051] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T21:35:55.543175] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-17T21:35:55.742275] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-17T21:35:56.542274] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-10-17T21:35:56.646467] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T21:35:57.342287] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-17T21:35:57.649233] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T21:35:57.653113] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T21:35:58.142307] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-17T21:35:58.952888] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-17T21:35:58.958473] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T21:35:59.560601] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-17T21:35:59.742318] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-17T21:35:59.996765] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T21:36:00.296227] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-17T21:36:00.542352] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-17T21:36:01.261689] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T21:36:01.270682] [INFO ] [REMOTE ] SO: Full fetch complete (77772 records). [2025-10-17T21:36:01.270823] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-17T21:36:01.347410] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-17T21:36:01.708741] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-17T21:36:01.708874] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-17T21:36:01.710773] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-17T21:36:01.710868] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-17T21:36:01.713673] [DEBUG] [LOCAL ] SO: Trimmed 77772 records to 54394 (keeping 200 days of data) [2025-10-17T21:36:02.091135] [DEBUG] [LOCAL ] SO: Primary data saved (54394 records). [2025-10-17T21:36:02.091346] [INFO ] [MAIN ] SO: Full history saved. [2025-10-17T21:36:02.091453] [INFO ] [MAIN ] Update Progress: 1954/2368 symbols completed. SO took 29.0s. Estimated remaining: 58m 28s. Rate: 7.1 symbols/min [2025-10-17T21:36:02.151751] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-17T21:36:02.279146] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:36:02.296939] [DEBUG] [LOCAL ] SOJD: Loaded 13066 existing records from primary storage. [2025-10-17T21:36:02.297279] [INFO ] [MAIN ] SOJD: Loaded 13066 existing records. [2025-10-17T21:36:02.483861] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:36:02.484287] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-17T21:36:02.484352] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-17T21:36:02.484569] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-17T21:36:02.484626] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-17T21:36:02.875172] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:36:02.942324] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-10-17T21:36:03.016621] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T21:36:03.647791] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T21:36:03.742265] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-17T21:36:03.764318] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-17T21:36:04.477922] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-17T21:36:04.542253] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-17T21:36:05.342308] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-17T21:36:06.142318] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-17T21:36:06.322496] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T21:36:06.942369] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-17T21:36:06.971359] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T21:36:07.055617] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-17T21:36:07.742302] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-17T21:36:08.436195] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T21:36:08.542321] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-17T21:36:09.242400] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T21:36:09.342295] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-17T21:36:10.142277] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-17T21:36:10.600192] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-17T21:36:10.942349] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-17T21:36:11.557312] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-17T21:36:11.742315] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-17T21:36:12.160702] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-17T21:36:12.542318] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-17T21:36:12.648690] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T21:36:13.151457] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-17T21:36:13.342339] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-17T21:36:13.620836] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T21:36:14.142294] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-17T21:36:14.228739] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-17T21:36:14.942297] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-17T21:36:15.593446] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-17T21:36:15.611507] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T21:36:15.742324] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-17T21:36:16.542401] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-17T21:36:17.136198] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-17T21:36:17.136037] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T21:36:17.342373] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-17T21:36:17.879912] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-17T21:36:18.142347] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-17T21:36:18.555585] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-17T21:36:18.942341] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-17T21:36:19.422046] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-17T21:36:19.423115] [INFO ] [REMOTE ] SOJC: Full fetch complete (7330 records). [2025-10-17T21:36:19.423185] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-17T21:36:19.747530] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-17T21:36:19.810216] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-17T21:36:19.810296] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-17T21:36:19.810510] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-17T21:36:19.810551] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-17T21:36:19.811511] [DEBUG] [LOCAL ] SOJC: Trimmed 7330 records to 4852 (keeping 200 days of data) [2025-10-17T21:36:19.841680] [DEBUG] [LOCAL ] SOJC: Primary data saved (4852 records). [2025-10-17T21:36:19.841795] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-17T21:36:19.841873] [INFO ] [MAIN ] Update Progress: 1955/2368 symbols completed. SOJC took 25.1s. Estimated remaining: 58m 22s. Rate: 7.1 symbols/min [2025-10-17T21:36:20.013976] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:36:20.025590] [DEBUG] [LOCAL ] SOJE: Loaded 8935 existing records from primary storage. [2025-10-17T21:36:20.025875] [INFO ] [MAIN ] SOJE: Loaded 8935 existing records. [2025-10-17T21:36:20.211087] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:36:20.211296] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-17T21:36:20.211343] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-17T21:36:20.211549] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-17T21:36:20.211608] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-17T21:36:20.547479] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-17T21:36:20.584935] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:36:21.342255] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-10-17T21:36:21.548628] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T21:36:22.034454] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T21:36:22.077726] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-17T21:36:22.142316] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-17T21:36:22.942277] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-17T21:36:23.640402] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T21:36:23.646213] [INFO ] [REMOTE ] SOBO: Full fetch complete (58455 records). [2025-10-17T21:36:23.646306] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-17T21:36:23.745343] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-17T21:36:24.027614] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-17T21:36:24.027823] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-17T21:36:24.028848] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-17T21:36:24.028930] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-17T21:36:24.030826] [DEBUG] [LOCAL ] SOBO: Trimmed 58455 records to 40006 (keeping 200 days of data) [2025-10-17T21:36:24.101986] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-17T21:36:24.289833] [DEBUG] [LOCAL ] SOBO: Primary data saved (40006 records). [2025-10-17T21:36:24.289964] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-17T21:36:24.290043] [INFO ] [MAIN ] Update Progress: 1956/2368 symbols completed. SOBO took 35.6s. Estimated remaining: 58m 12s. Rate: 7.1 symbols/min [2025-10-17T21:36:24.455286] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:36:24.455436] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-17T21:36:24.455486] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-17T21:36:24.455617] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-17T21:36:24.455703] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-17T21:36:24.455792] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-17T21:36:24.455831] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-17T21:36:24.549047] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-17T21:36:24.801345] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:36:24.953333] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T21:36:25.342313] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-17T21:36:26.142275] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-10-17T21:36:26.494067] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:36:26.501142] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T21:36:26.500266] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-10-17T21:36:26.503875] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:36:26.503967] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-10-17T21:36:26.504045] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:36:26.504128] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-17T21:36:26.504207] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-17T21:36:26.504255] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-17T21:36:26.504309] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-17T21:36:26.504369] [INFO ] [MAIN ] Update Progress: 1957/2368 symbols completed. SOJF took 2.2s. Estimated remaining: 58m 3s. Rate: 7.1 symbols/min [2025-10-17T21:36:26.575955] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-17T21:36:26.942362] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-17T21:36:27.742309] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-17T21:36:27.934257] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-17T21:36:28.517193] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-17T21:36:28.542255] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-17T21:36:29.340044] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-17T21:36:29.342934] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-17T21:36:30.142346] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-17T21:36:30.159050] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T21:36:30.942288] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-17T21:36:31.692974] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-17T21:36:31.742263] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-17T21:36:31.789203] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T21:36:32.524193] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-17T21:36:32.542248] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-17T21:36:33.256380] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T21:36:33.342290] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-17T21:36:34.142293] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-17T21:36:34.942269] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-17T21:36:35.082804] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-17T21:36:35.318463] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T21:36:35.694985] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-17T21:36:35.742327] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-17T21:36:36.542332] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-17T21:36:37.342351] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-17T21:36:37.682235] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T21:36:37.835602] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-17T21:36:37.843209] [INFO ] [REMOTE ] SOC: Full fetch complete (72103 records). [2025-10-17T21:36:37.843395] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-17T21:36:38.145305] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-17T21:36:38.164043] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T21:36:38.267835] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-17T21:36:38.268069] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-17T21:36:38.269591] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-17T21:36:38.269779] [INFO ] [REMOTE ] SOJE: Full fetch complete (13593 records). [2025-10-17T21:36:38.269864] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-17T21:36:38.275877] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-17T21:36:38.373908] [DEBUG] [LOCAL ] SOC: Trimmed 72103 records to 51745 (keeping 200 days of data) [2025-10-17T21:36:38.794054] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-17T21:36:38.795033] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-17T21:36:38.796594] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-17T21:36:38.796702] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-17T21:36:38.798820] [DEBUG] [LOCAL ] SOJE: Trimmed 13593 records to 8990 (keeping 200 days of data) [2025-10-17T21:36:38.863589] [DEBUG] [LOCAL ] SOJE: Primary data saved (8990 records). [2025-10-17T21:36:38.867424] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-17T21:36:38.867628] [INFO ] [MAIN ] Update Progress: 1958/2368 symbols completed. SOJE took 19.0s. Estimated remaining: 57m 55s. Rate: 7.1 symbols/min [2025-10-17T21:36:39.054195] [DEBUG] [LOCAL ] SOC: Primary data saved (51745 records). [2025-10-17T21:36:39.054346] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-17T21:36:39.054428] [INFO ] [MAIN ] Update Progress: 1959/2368 symbols completed. SOC took 46.5s. Estimated remaining: 57m 45s. Rate: 7.1 symbols/min [2025-10-17T21:36:39.067580] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-17T21:36:39.070857] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-17T21:36:40.016805] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-17T21:36:40.024578] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-17T21:36:40.798998] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-17T21:36:40.801295] [INFO ] [REMOTE ] SOJD: Full fetch complete (19173 records). [2025-10-17T21:36:40.801420] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-17T21:36:41.169909] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-17T21:36:41.169994] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-17T21:36:41.170401] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-17T21:36:41.170443] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-17T21:36:41.171081] [DEBUG] [LOCAL ] SOJD: Trimmed 19173 records to 13136 (keeping 200 days of data) [2025-10-17T21:36:41.252284] [DEBUG] [LOCAL ] SOJD: Primary data saved (13136 records). [2025-10-17T21:36:41.252442] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-17T21:36:41.252531] [INFO ] [MAIN ] Update Progress: 1960/2368 symbols completed. SOJD took 39.2s. Estimated remaining: 57m 35s. Rate: 7.1 symbols/min [2025-10-17T21:36:41.806699] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:36:41.986173] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:36:41.987123] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:36:41.984531] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:36:42.008710] [DEBUG] [LOCAL ] SOL: Loaded 13297 existing records from primary storage. [2025-10-17T21:36:42.008991] [INFO ] [MAIN ] SOL: Loaded 13297 existing records. [2025-10-17T21:36:42.196568] [DEBUG] [LOCAL ] SON: Loaded 43716 existing records from primary storage. [2025-10-17T21:36:42.240573] [INFO ] [MAIN ] SON: Loaded 43716 existing records. [2025-10-17T21:36:42.340619] [DEBUG] [LOCAL ] SOLV: Loaded 44087 existing records from primary storage. [2025-10-17T21:36:42.349734] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:36:42.350521] [DEBUG] [LOCAL ] SONY: Loaded 53769 existing records from primary storage. [2025-10-17T21:36:42.361806] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-17T21:36:42.367308] [INFO ] [MAIN ] SONY: Loaded 53769 existing records. [2025-10-17T21:36:42.372896] [INFO ] [MAIN ] SOLV: Loaded 44087 existing records. [2025-10-17T21:36:42.389188] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-17T21:36:42.456677] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-17T21:36:42.522715] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-17T21:36:42.768909] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:36:42.849945] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-17T21:36:42.923085] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-17T21:36:42.936009] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:36:42.941542] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-10-17T21:36:42.972923] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-17T21:36:42.993577] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-17T21:36:43.016831] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-17T21:36:42.998080] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:36:43.063028] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-10-17T21:36:43.063389] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-17T21:36:43.063322] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-17T21:36:43.074038] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-17T21:36:43.092599] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-17T21:36:43.092858] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-17T21:36:44.002660] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:36:44.105189] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-10-17T21:36:44.280321] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:36:44.317461] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-10-17T21:36:44.311916] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:36:44.324592] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-10-17T21:36:44.379930] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:36:44.380214] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-10-17T21:36:45.287312] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T21:36:45.292146] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-17T21:36:45.780013] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-17T21:36:45.789038] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-17T21:36:46.008706] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T21:36:46.018595] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-17T21:36:46.349564] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T21:36:46.356326] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-17T21:36:46.436894] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-17T21:36:46.935448] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T21:36:46.943574] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-17T21:36:47.284859] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T21:36:47.308618] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T21:36:47.742294] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-17T21:36:48.542267] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-17T21:36:48.601981] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T21:36:49.082126] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T21:36:49.342298] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-17T21:36:49.653248] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T21:36:50.142284] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-17T21:36:50.942293] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-17T21:36:51.166616] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-17T21:36:51.725526] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T21:36:51.742247] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-17T21:36:51.890558] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-17T21:36:52.542317] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-17T21:36:53.324470] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T21:36:53.342247] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-17T21:36:53.534525] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-17T21:36:54.142297] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-17T21:36:54.911155] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T21:36:54.942245] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-17T21:36:55.209250] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T21:36:55.742337] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-17T21:36:56.526465] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T21:36:56.542251] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-17T21:36:56.746981] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-17T21:36:57.342339] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-17T21:36:58.022547] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T21:36:58.142338] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-17T21:36:58.831416] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T21:36:58.942270] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-17T21:36:59.742320] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-17T21:37:00.082780] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T21:37:00.496748] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T21:37:00.542248] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-17T21:37:01.342315] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-17T21:37:01.504507] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T21:37:02.142325] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-17T21:37:02.180253] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T21:37:02.942248] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-17T21:37:03.051119] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-17T21:37:03.427078] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-17T21:37:03.742314] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-17T21:37:03.794061] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T21:37:04.542336] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-17T21:37:05.342284] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-17T21:37:05.411308] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T21:37:05.457681] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-17T21:37:06.142292] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-17T21:37:06.942290] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-17T21:37:07.378480] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-17T21:37:07.628565] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T21:37:07.742267] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-17T21:37:07.909144] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-17T21:37:07.912630] [INFO ] [REMOTE ] SOL: Full fetch complete (21287 records). [2025-10-17T21:37:07.912742] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-17T21:37:08.269890] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-17T21:37:08.269969] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-17T21:37:08.270358] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-17T21:37:08.270418] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-17T21:37:08.270999] [DEBUG] [LOCAL ] SOL: Trimmed 21287 records to 13596 (keeping 200 days of data) [2025-10-17T21:37:08.346384] [DEBUG] [LOCAL ] SOL: Primary data saved (13596 records). [2025-10-17T21:37:08.346510] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-17T21:37:08.346628] [INFO ] [MAIN ] Update Progress: 1961/2368 symbols completed. SOL took 27.1s. Estimated remaining: 57m 30s. Rate: 7.1 symbols/min [2025-10-17T21:37:08.519010] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:37:08.524308] [DEBUG] [LOCAL ] SOR: Loaded 2902 existing records from primary storage. [2025-10-17T21:37:08.524474] [INFO ] [MAIN ] SOR: Loaded 2902 existing records. [2025-10-17T21:37:08.554129] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-17T21:37:08.700280] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:37:08.700529] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-17T21:37:08.700596] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-17T21:37:08.700757] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-17T21:37:08.700813] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-17T21:37:09.082011] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:37:09.334891] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T21:37:09.344569] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-10-17T21:37:09.819757] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-17T21:37:10.142301] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-17T21:37:10.574235] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-17T21:37:10.942328] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-17T21:37:11.602691] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T21:37:11.742305] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-17T21:37:12.098006] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T21:37:12.103981] [INFO ] [REMOTE ] SOLV: Full fetch complete (63514 records). [2025-10-17T21:37:12.104115] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-17T21:37:12.493271] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-17T21:37:12.493381] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-17T21:37:12.494573] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-17T21:37:12.494637] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-17T21:37:12.495935] [DEBUG] [LOCAL ] SOLV: Trimmed 63514 records to 44343 (keeping 200 days of data) [2025-10-17T21:37:12.548034] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-17T21:37:12.758592] [DEBUG] [LOCAL ] SOLV: Primary data saved (44343 records). [2025-10-17T21:37:12.758762] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-17T21:37:12.758885] [INFO ] [MAIN ] Update Progress: 1962/2368 symbols completed. SOLV took 31.5s. Estimated remaining: 57m 21s. Rate: 7.1 symbols/min [2025-10-17T21:37:12.926560] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:37:12.937017] [DEBUG] [LOCAL ] SOS: Loaded 9535 existing records from primary storage. [2025-10-17T21:37:12.937197] [INFO ] [MAIN ] SOS: Loaded 9535 existing records. [2025-10-17T21:37:13.116845] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:37:13.117205] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-17T21:37:13.117372] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-17T21:37:13.117610] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-17T21:37:13.117702] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-17T21:37:13.354593] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-17T21:37:13.472783] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:37:13.500822] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T21:37:13.984285] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-17T21:37:14.142274] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-17T21:37:14.360195] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T21:37:14.634712] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T21:37:14.942355] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-17T21:37:15.742354] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-10-17T21:37:16.476368] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T21:37:16.483230] [INFO ] [REMOTE ] SON: Full fetch complete (62820 records). [2025-10-17T21:37:16.483342] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-17T21:37:16.547835] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-17T21:37:16.879715] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-17T21:37:16.879816] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-17T21:37:16.880867] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-17T21:37:16.880932] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-17T21:37:16.882409] [DEBUG] [LOCAL ] SON: Trimmed 62820 records to 44067 (keeping 200 days of data) [2025-10-17T21:37:17.111967] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T21:37:17.116760] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-17T21:37:17.184469] [DEBUG] [LOCAL ] SON: Primary data saved (44067 records). [2025-10-17T21:37:17.184617] [INFO ] [MAIN ] SON: Full history saved. [2025-10-17T21:37:17.184821] [INFO ] [MAIN ] Update Progress: 1963/2368 symbols completed. SON took 35.9s. Estimated remaining: 57m 12s. Rate: 7.1 symbols/min [2025-10-17T21:37:17.361178] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:37:17.343254] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-17T21:37:17.396084] [DEBUG] [LOCAL ] SPB: Loaded 34352 existing records from primary storage. [2025-10-17T21:37:17.396438] [INFO ] [MAIN ] SPB: Loaded 34352 existing records. [2025-10-17T21:37:17.570043] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:37:17.570209] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-17T21:37:17.570257] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-17T21:37:17.570422] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-17T21:37:17.570461] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-17T21:37:17.921087] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:37:17.935923] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-17T21:37:18.142380] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-17T21:37:18.707563] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-17T21:37:18.942354] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-17T21:37:19.742315] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-17T21:37:20.406971] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-17T21:37:20.542261] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-17T21:37:20.740439] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T21:37:21.186697] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-17T21:37:21.342327] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-17T21:37:22.013374] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T21:37:22.142342] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-17T21:37:22.942344] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-17T21:37:23.431193] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-17T21:37:23.742316] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-10-17T21:37:24.087961] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T21:37:24.542343] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-17T21:37:24.963709] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T21:37:25.012177] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-17T21:37:25.342253] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-17T21:37:26.142265] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-17T21:37:26.559497] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T21:37:26.617920] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-17T21:37:26.942361] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-17T21:37:27.466033] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-17T21:37:27.742350] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-17T21:37:28.230053] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-17T21:37:28.542317] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-17T21:37:28.992371] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-17T21:37:28.993316] [INFO ] [REMOTE ] SOR: Full fetch complete (4379 records). [2025-10-17T21:37:28.993384] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-17T21:37:29.342432] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-17T21:37:29.343634] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-17T21:37:29.343760] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-17T21:37:29.343921] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-17T21:37:29.343962] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-17T21:37:29.344323] [DEBUG] [LOCAL ] SOR: Trimmed 4379 records to 2914 (keeping 200 days of data) [2025-10-17T21:37:29.362156] [DEBUG] [LOCAL ] SOR: Primary data saved (2914 records). [2025-10-17T21:37:29.362240] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-17T21:37:29.362315] [INFO ] [MAIN ] Update Progress: 1964/2368 symbols completed. SOR took 21.0s. Estimated remaining: 57m 4s. Rate: 7.1 symbols/min [2025-10-17T21:37:29.530352] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:37:29.575531] [DEBUG] [LOCAL ] SPCE: Loaded 50365 existing records from primary storage. [2025-10-17T21:37:29.575873] [INFO ] [MAIN ] SPCE: Loaded 50365 existing records. [2025-10-17T21:37:29.752139] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:37:29.752360] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-17T21:37:29.752407] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-17T21:37:29.752598] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-17T21:37:29.752686] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-17T21:37:30.095227] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:37:30.142260] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-17T21:37:30.582622] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-17T21:37:30.942257] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-17T21:37:31.278046] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-17T21:37:31.286170] [INFO ] [REMOTE ] SONY: Full fetch complete (77405 records). [2025-10-17T21:37:31.286305] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-17T21:37:31.720337] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-17T21:37:31.720477] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-17T21:37:31.721996] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-17T21:37:31.722075] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-17T21:37:31.723739] [DEBUG] [LOCAL ] SONY: Trimmed 77405 records to 54159 (keeping 200 days of data) [2025-10-17T21:37:31.777344] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-10-17T21:37:31.971105] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-17T21:37:32.095637] [DEBUG] [LOCAL ] SONY: Primary data saved (54159 records). [2025-10-17T21:37:32.095801] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-17T21:37:32.095886] [INFO ] [MAIN ] Update Progress: 1965/2368 symbols completed. SONY took 50.8s. Estimated remaining: 56m 54s. Rate: 7.1 symbols/min [2025-10-17T21:37:32.278452] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:37:32.287974] [DEBUG] [LOCAL ] SPE: Loaded 6288 existing records from primary storage. [2025-10-17T21:37:32.288181] [INFO ] [MAIN ] SPE: Loaded 6288 existing records. [2025-10-17T21:37:32.458786] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:37:32.459040] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-17T21:37:32.459087] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-17T21:37:32.459283] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-17T21:37:32.459343] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-17T21:37:32.547508] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-17T21:37:32.805617] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:37:33.342264] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-17T21:37:33.778604] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T21:37:33.842638] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-17T21:37:33.843729] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T21:37:34.142291] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-17T21:37:34.942261] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-10-17T21:37:35.320065] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-17T21:37:35.742293] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-17T21:37:35.780494] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-17T21:37:36.542292] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-17T21:37:37.283348] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-17T21:37:37.342321] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-17T21:37:37.761152] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-17T21:37:37.817241] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T21:37:38.142359] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-17T21:37:38.942370] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-17T21:37:39.723965] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-17T21:37:39.742243] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-17T21:37:39.931503] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T21:37:40.478730] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-17T21:37:40.542316] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-17T21:37:41.342299] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-17T21:37:42.142364] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-17T21:37:42.586495] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-17T21:37:42.776839] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T21:37:42.829490] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-17T21:37:42.942282] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-17T21:37:43.742343] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-17T21:37:44.343297] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T21:37:44.542296] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-17T21:37:44.829731] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T21:37:45.259573] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T21:37:45.342285] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-17T21:37:46.142282] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-17T21:37:46.787222] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-17T21:37:46.942275] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-17T21:37:47.367464] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T21:37:47.742290] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-17T21:37:48.152140] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-17T21:37:48.542344] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-17T21:37:49.268328] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-17T21:37:49.342265] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-17T21:37:49.679121] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-17T21:37:50.069928] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-17T21:37:50.142269] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-17T21:37:50.942283] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-17T21:37:51.111367] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-17T21:37:51.113589] [INFO ] [REMOTE ] SOS: Full fetch complete (11227 records). [2025-10-17T21:37:51.113705] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-17T21:37:51.473424] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-17T21:37:51.473499] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-17T21:37:51.473780] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-17T21:37:51.473842] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-17T21:37:51.474282] [DEBUG] [LOCAL ] SOS: Trimmed 11227 records to 9578 (keeping 200 days of data) [2025-10-17T21:37:51.529162] [DEBUG] [LOCAL ] SOS: Primary data saved (9578 records). [2025-10-17T21:37:51.529308] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-17T21:37:51.529393] [INFO ] [MAIN ] Update Progress: 1966/2368 symbols completed. SOS took 38.8s. Estimated remaining: 56m 48s. Rate: 7.1 symbols/min [2025-10-17T21:37:51.700539] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:37:51.748041] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-17T21:37:51.750867] [DEBUG] [LOCAL ] SPG: Loaded 50579 existing records from primary storage. [2025-10-17T21:37:51.751150] [INFO ] [MAIN ] SPG: Loaded 50579 existing records. [2025-10-17T21:37:51.938359] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:37:51.938566] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-17T21:37:51.938613] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-17T21:37:51.938845] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-10-17T21:37:51.938901] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-17T21:37:52.294941] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:37:52.396424] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T21:37:52.542319] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-17T21:37:53.342344] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-10-17T21:37:53.983034] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-17T21:37:54.056626] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T21:37:54.142249] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-17T21:37:54.942343] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-17T21:37:55.042952] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T21:37:55.742280] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-17T21:37:56.167378] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-17T21:37:56.252680] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-17T21:37:56.253907] [INFO ] [REMOTE ] SPE: Full fetch complete (9829 records). [2025-10-17T21:37:56.253978] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-17T21:37:56.425662] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T21:37:56.547377] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-17T21:37:56.647227] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-17T21:37:56.647299] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-17T21:37:56.647584] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-17T21:37:56.647669] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-17T21:37:56.648134] [DEBUG] [LOCAL ] SPE: Trimmed 9829 records to 6321 (keeping 200 days of data) [2025-10-17T21:37:56.685755] [DEBUG] [LOCAL ] SPE: Primary data saved (6321 records). [2025-10-17T21:37:56.685849] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-17T21:37:56.685928] [INFO ] [MAIN ] Update Progress: 1967/2368 symbols completed. SPE took 24.6s. Estimated remaining: 56m 39s. Rate: 7.1 symbols/min [2025-10-17T21:37:56.871839] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:37:56.914308] [DEBUG] [LOCAL ] SPGI: Loaded 46239 existing records from primary storage. [2025-10-17T21:37:56.914597] [INFO ] [MAIN ] SPGI: Loaded 46239 existing records. [2025-10-17T21:37:57.096431] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:37:57.096632] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-17T21:37:57.096865] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-17T21:37:57.097042] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-10-17T21:37:57.097080] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-17T21:37:57.347516] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-17T21:37:57.447281] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:37:57.980052] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T21:37:58.142339] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-17T21:37:58.942294] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-10-17T21:37:59.443049] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-17T21:37:59.742270] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-17T21:37:59.947815] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T21:38:00.355393] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T21:38:00.542339] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-17T21:38:01.342293] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-17T21:38:01.688028] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-17T21:38:01.695498] [INFO ] [REMOTE ] SPCE: Full fetch complete (72624 records). [2025-10-17T21:38:01.695714] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-17T21:38:02.120789] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-17T21:38:02.120974] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-17T21:38:02.122213] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-17T21:38:02.122443] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-17T21:38:02.124049] [DEBUG] [LOCAL ] SPCE: Trimmed 72624 records to 50750 (keeping 200 days of data) [2025-10-17T21:38:02.173099] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-17T21:38:02.396031] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T21:38:02.488911] [DEBUG] [LOCAL ] SPCE: Primary data saved (50750 records). [2025-10-17T21:38:02.489111] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-17T21:38:02.489741] [INFO ] [MAIN ] Update Progress: 1968/2368 symbols completed. SPCE took 33.1s. Estimated remaining: 56m 30s. Rate: 7.1 symbols/min [2025-10-17T21:38:02.666137] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:38:02.685148] [DEBUG] [LOCAL ] SPH: Loaded 16775 existing records from primary storage. [2025-10-17T21:38:02.685410] [INFO ] [MAIN ] SPH: Loaded 16775 existing records. [2025-10-17T21:38:02.805974] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T21:38:02.892477] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:38:02.892636] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-17T21:38:02.892721] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-17T21:38:02.892876] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-17T21:38:02.892915] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-17T21:38:02.954371] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-17T21:38:03.241513] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:38:03.742317] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-17T21:38:03.815256] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T21:38:04.242759] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T21:38:04.247102] [INFO ] [REMOTE ] SPB: Full fetch complete (47723 records). [2025-10-17T21:38:04.247222] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-17T21:38:04.547494] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-10-17T21:38:04.621693] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-17T21:38:04.621834] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-17T21:38:04.622851] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-17T21:38:04.622914] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-17T21:38:04.623947] [DEBUG] [LOCAL ] SPB: Trimmed 47723 records to 34547 (keeping 200 days of data) [2025-10-17T21:38:04.832476] [DEBUG] [LOCAL ] SPB: Primary data saved (34547 records). [2025-10-17T21:38:04.832598] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-17T21:38:04.832697] [INFO ] [MAIN ] Update Progress: 1969/2368 symbols completed. SPB took 47.6s. Estimated remaining: 56m 20s. Rate: 7.1 symbols/min [2025-10-17T21:38:05.002625] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:38:05.039682] [DEBUG] [LOCAL ] SPHR: Loaded 40893 existing records from primary storage. [2025-10-17T21:38:05.039965] [INFO ] [MAIN ] SPHR: Loaded 40893 existing records. [2025-10-17T21:38:05.218292] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:38:05.218607] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-17T21:38:05.218718] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-17T21:38:05.219095] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-17T21:38:05.219214] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-17T21:38:05.342831] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-17T21:38:05.601543] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-17T21:38:05.630049] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:38:05.770798] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T21:38:06.142283] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-17T21:38:06.942267] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-10-17T21:38:07.227587] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T21:38:07.650220] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T21:38:07.742245] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-17T21:38:07.919451] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T21:38:08.542290] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-17T21:38:09.342255] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-17T21:38:09.619608] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T21:38:09.791391] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-17T21:38:10.142304] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-17T21:38:10.837460] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T21:38:10.942334] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-17T21:38:11.742300] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-17T21:38:12.133828] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T21:38:12.268150] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T21:38:12.542355] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-17T21:38:13.342270] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-17T21:38:13.566186] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T21:38:13.677743] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T21:38:14.142345] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-17T21:38:14.384038] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T21:38:14.942365] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-17T21:38:15.702490] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T21:38:15.742318] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-17T21:38:16.524970] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T21:38:16.542255] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-17T21:38:17.342275] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-17T21:38:17.439917] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T21:38:18.147605] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-17T21:38:18.170977] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T21:38:18.345150] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T21:38:18.942288] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-17T21:38:19.742292] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-17T21:38:20.135341] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T21:38:20.351688] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T21:38:20.542259] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-17T21:38:20.783929] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T21:38:21.342282] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-17T21:38:22.142272] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-17T21:38:22.404573] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-17T21:38:22.469329] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T21:38:22.942347] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-17T21:38:23.742317] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-17T21:38:23.857884] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T21:38:24.317185] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T21:38:24.542302] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-17T21:38:24.690615] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-17T21:38:25.342311] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-17T21:38:26.142350] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-17T21:38:26.361886] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T21:38:26.765497] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T21:38:26.942307] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-17T21:38:27.144274] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-17T21:38:27.614161] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-17T21:38:27.625270] [INFO ] [REMOTE ] SPGI: Full fetch complete (67623 records). [2025-10-17T21:38:27.626145] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-17T21:38:27.747447] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-17T21:38:28.004071] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-17T21:38:28.004152] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-17T21:38:28.005236] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-17T21:38:28.005299] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-17T21:38:28.007067] [DEBUG] [LOCAL ] SPGI: Trimmed 67623 records to 46609 (keeping 200 days of data) [2025-10-17T21:38:28.303926] [DEBUG] [LOCAL ] SPGI: Primary data saved (46609 records). [2025-10-17T21:38:28.304059] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-17T21:38:28.304143] [INFO ] [MAIN ] Update Progress: 1970/2368 symbols completed. SPGI took 31.6s. Estimated remaining: 56m 15s. Rate: 7.1 symbols/min [2025-10-17T21:38:28.476523] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:38:28.513469] [DEBUG] [LOCAL ] SPIR: Loaded 37864 existing records from primary storage. [2025-10-17T21:38:28.513807] [INFO ] [MAIN ] SPIR: Loaded 37864 existing records. [2025-10-17T21:38:28.547569] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-17T21:38:28.697578] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:38:28.697931] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-17T21:38:28.698023] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-17T21:38:28.698592] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-17T21:38:28.698708] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-17T21:38:28.799096] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T21:38:29.082769] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:38:29.342323] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-17T21:38:30.086081] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T21:38:30.142254] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-17T21:38:30.267335] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T21:38:30.269743] [INFO ] [REMOTE ] SPH: Full fetch complete (27820 records). [2025-10-17T21:38:30.269893] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-17T21:38:30.646726] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-17T21:38:30.646809] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-17T21:38:30.647360] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-17T21:38:30.647400] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-17T21:38:30.648309] [DEBUG] [LOCAL ] SPH: Trimmed 27820 records to 16862 (keeping 200 days of data) [2025-10-17T21:38:30.750094] [DEBUG] [LOCAL ] SPH: Primary data saved (16862 records). [2025-10-17T21:38:30.750227] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-17T21:38:30.750375] [INFO ] [MAIN ] Update Progress: 1971/2368 symbols completed. SPH took 28.3s. Estimated remaining: 56m 5s. Rate: 7.1 symbols/min [2025-10-17T21:38:30.916530] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:38:30.924008] [DEBUG] [LOCAL ] SPMC: Loaded 5301 existing records from primary storage. [2025-10-17T21:38:30.924184] [INFO ] [MAIN ] SPMC: Loaded 5301 existing records. [2025-10-17T21:38:30.954622] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-17T21:38:31.100037] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:38:31.100257] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-17T21:38:31.100303] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-17T21:38:31.100469] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-17T21:38:31.100524] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-17T21:38:31.451238] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:38:31.742259] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-10-17T21:38:31.780349] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T21:38:32.295015] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-17T21:38:32.542267] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-17T21:38:32.811906] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T21:38:33.101361] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T21:38:33.342297] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-17T21:38:34.143489] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T21:38:34.142480] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-17T21:38:34.942346] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-17T21:38:35.742278] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-10-17T21:38:35.774246] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T21:38:36.542336] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-17T21:38:36.718471] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T21:38:36.773899] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-17T21:38:37.342370] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-17T21:38:38.075183] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T21:38:38.081611] [INFO ] [REMOTE ] SPHR: Full fetch complete (58758 records). [2025-10-17T21:38:38.081746] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-17T21:38:38.147472] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-17T21:38:38.482279] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-17T21:38:38.482368] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-17T21:38:38.483387] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-17T21:38:38.483451] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-17T21:38:38.484671] [DEBUG] [LOCAL ] SPHR: Trimmed 58758 records to 41225 (keeping 200 days of data) [2025-10-17T21:38:38.732379] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T21:38:38.793357] [DEBUG] [LOCAL ] SPHR: Primary data saved (41225 records). [2025-10-17T21:38:38.793501] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-17T21:38:38.793665] [INFO ] [MAIN ] Update Progress: 1972/2368 symbols completed. SPHR took 34.0s. Estimated remaining: 55m 57s. Rate: 7.1 symbols/min [2025-10-17T21:38:38.947363] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-17T21:38:38.999022] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T21:38:39.002423] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:38:39.005195] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-17T21:38:39.005259] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-17T21:38:39.005402] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-17T21:38:39.005476] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-17T21:38:39.005533] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-17T21:38:39.005580] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-17T21:38:39.377447] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:38:39.742363] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-10-17T21:38:39.962088] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:38:39.962440] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-10-17T21:38:39.962534] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:38:39.962602] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-17T21:38:39.962684] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:38:39.962739] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-17T21:38:39.962797] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-17T21:38:39.962831] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-17T21:38:39.962870] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-17T21:38:39.962917] [INFO ] [MAIN ] Update Progress: 1973/2368 symbols completed. SPME took 1.2s. Estimated remaining: 55m 47s. Rate: 7.1 symbols/min [2025-10-17T21:38:40.132542] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:38:40.167064] [DEBUG] [LOCAL ] SPNT: Loaded 34961 existing records from primary storage. [2025-10-17T21:38:40.167385] [INFO ] [MAIN ] SPNT: Loaded 34961 existing records. [2025-10-17T21:38:40.341428] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:38:40.341614] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-17T21:38:40.341689] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-17T21:38:40.341907] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-10-17T21:38:40.341961] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-17T21:38:40.552505] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-17T21:38:40.704218] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:38:40.725628] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T21:38:41.271822] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T21:38:41.278976] [INFO ] [REMOTE ] SPG: Full fetch complete (72170 records). [2025-10-17T21:38:41.279114] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-17T21:38:41.347540] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-10-17T21:38:41.665893] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-17T21:38:41.665988] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-17T21:38:41.667263] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-17T21:38:41.667333] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-17T21:38:41.669475] [DEBUG] [LOCAL ] SPG: Trimmed 72170 records to 50898 (keeping 200 days of data) [2025-10-17T21:38:42.010208] [DEBUG] [LOCAL ] SPG: Primary data saved (50898 records). [2025-10-17T21:38:42.010413] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-17T21:38:42.011471] [INFO ] [MAIN ] Update Progress: 1974/2368 symbols completed. SPG took 50.5s. Estimated remaining: 55m 37s. Rate: 7.1 symbols/min [2025-10-17T21:38:42.147499] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-17T21:38:42.198555] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:38:42.254015] [DEBUG] [LOCAL ] SPOT: Loaded 50683 existing records from primary storage. [2025-10-17T21:38:42.254345] [INFO ] [MAIN ] SPOT: Loaded 50683 existing records. [2025-10-17T21:38:42.462490] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:38:42.462836] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-17T21:38:42.462917] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-17T21:38:42.463133] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-10-17T21:38:42.463189] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-17T21:38:42.863382] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:38:42.885414] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T21:38:42.907295] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-17T21:38:42.942250] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-17T21:38:43.742296] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-17T21:38:44.436186] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T21:38:44.542274] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-10-17T21:38:44.867796] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T21:38:45.342271] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-17T21:38:45.951867] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-17T21:38:46.142262] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-17T21:38:46.615086] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-17T21:38:46.942311] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-17T21:38:47.749548] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-17T21:38:47.754598] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T21:38:48.246023] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T21:38:48.350946] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T21:38:48.542362] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-17T21:38:49.342308] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-17T21:38:49.944871] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-17T21:38:49.983199] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T21:38:50.142299] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-17T21:38:50.942294] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-17T21:38:51.742316] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-17T21:38:52.182266] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-17T21:38:52.354121] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T21:38:52.358677] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-17T21:38:52.542348] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-17T21:38:53.342383] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-17T21:38:54.108535] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T21:38:54.142281] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-17T21:38:54.758815] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T21:38:54.942374] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-17T21:38:55.646889] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T21:38:55.742314] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-17T21:38:56.542422] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-17T21:38:57.095535] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-17T21:38:57.133563] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-17T21:38:57.222845] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T21:38:57.342267] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-17T21:38:57.936115] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T21:38:57.937430] [INFO ] [REMOTE ] SPMC: Full fetch complete (8192 records). [2025-10-17T21:38:57.937510] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-17T21:38:58.147460] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-17T21:38:58.294988] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-17T21:38:58.295078] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-17T21:38:58.295358] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-17T21:38:58.295419] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-17T21:38:58.295919] [DEBUG] [LOCAL ] SPMC: Trimmed 8192 records to 5342 (keeping 200 days of data) [2025-10-17T21:38:58.329101] [DEBUG] [LOCAL ] SPMC: Primary data saved (5342 records). [2025-10-17T21:38:58.329227] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-17T21:38:58.329314] [INFO ] [MAIN ] Update Progress: 1975/2368 symbols completed. SPMC took 27.6s. Estimated remaining: 55m 30s. Rate: 7.1 symbols/min [2025-10-17T21:38:58.492954] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:38:58.532937] [DEBUG] [LOCAL ] SPR: Loaded 41421 existing records from primary storage. [2025-10-17T21:38:58.533262] [INFO ] [MAIN ] SPR: Loaded 41421 existing records. [2025-10-17T21:38:58.705403] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:38:58.705609] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-17T21:38:58.705683] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-17T21:38:58.705879] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-17T21:38:58.705918] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-17T21:38:58.947710] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-17T21:38:59.059234] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:38:59.569317] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T21:38:59.742301] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-10-17T21:39:00.542372] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-17T21:39:01.347346] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-17T21:39:01.361925] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T21:39:01.417401] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-17T21:39:01.896845] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-17T21:39:02.142357] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-17T21:39:02.901965] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T21:39:02.942292] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-17T21:39:03.706507] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T21:39:03.742299] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-17T21:39:04.493827] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T21:39:04.499352] [INFO ] [REMOTE ] SPIR: Full fetch complete (53956 records). [2025-10-17T21:39:04.499456] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-17T21:39:04.553746] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-17T21:39:04.888903] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-17T21:39:04.889058] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-17T21:39:04.890115] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-17T21:39:04.890181] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-17T21:39:04.891332] [DEBUG] [LOCAL ] SPIR: Trimmed 53956 records to 38185 (keeping 200 days of data) [2025-10-17T21:39:05.117198] [DEBUG] [LOCAL ] SPIR: Primary data saved (38185 records). [2025-10-17T21:39:05.117406] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-17T21:39:05.117591] [INFO ] [MAIN ] Update Progress: 1976/2368 symbols completed. SPIR took 36.8s. Estimated remaining: 55m 21s. Rate: 7.1 symbols/min [2025-10-17T21:39:05.232530] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-17T21:39:05.319673] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:39:05.331583] [DEBUG] [LOCAL ] SPRU: Loaded 9836 existing records from primary storage. [2025-10-17T21:39:05.331827] [INFO ] [MAIN ] SPRU: Loaded 9836 existing records. [2025-10-17T21:39:05.352264] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-17T21:39:05.512964] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:39:05.513198] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-17T21:39:05.513245] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-17T21:39:05.513408] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-17T21:39:05.513467] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-17T21:39:05.859207] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:39:06.142313] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-10-17T21:39:06.914616] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-17T21:39:06.934501] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-17T21:39:06.942234] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-17T21:39:07.111622] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T21:39:07.663874] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T21:39:07.742363] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-17T21:39:08.542404] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-17T21:39:08.890975] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-17T21:39:09.187899] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-17T21:39:09.342325] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-17T21:39:10.142340] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-17T21:39:10.793938] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-17T21:39:10.942361] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-17T21:39:10.990619] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T21:39:11.693202] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-17T21:39:11.742252] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-17T21:39:12.541883] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-17T21:39:12.543984] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-17T21:39:13.342346] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-17T21:39:13.921896] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T21:39:14.066231] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-17T21:39:14.142300] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-10-17T21:39:14.942276] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-17T21:39:14.957492] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-17T21:39:15.742369] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-17T21:39:16.370168] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T21:39:16.542304] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-17T21:39:17.142780] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T21:39:17.342345] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-17T21:39:17.998446] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T21:39:18.142322] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-17T21:39:18.897194] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-17T21:39:18.942333] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-17T21:39:19.742330] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-17T21:39:20.149370] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T21:39:20.154115] [INFO ] [REMOTE ] SPNT: Full fetch complete (48768 records). [2025-10-17T21:39:20.154246] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-17T21:39:20.532628] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-17T21:39:20.532748] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-17T21:39:20.533715] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-17T21:39:20.533868] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-17T21:39:20.545228] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-10-17T21:39:20.545037] [DEBUG] [LOCAL ] SPNT: Trimmed 48768 records to 35165 (keeping 200 days of data) [2025-10-17T21:39:20.567091] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-17T21:39:20.778015] [DEBUG] [LOCAL ] SPNT: Primary data saved (35165 records). [2025-10-17T21:39:20.778142] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-17T21:39:20.778223] [INFO ] [MAIN ] Update Progress: 1977/2368 symbols completed. SPNT took 40.8s. Estimated remaining: 55m 14s. Rate: 7.1 symbols/min [2025-10-17T21:39:20.944398] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:39:20.967576] [DEBUG] [LOCAL ] SPXC: Loaded 23611 existing records from primary storage. [2025-10-17T21:39:20.967873] [INFO ] [MAIN ] SPXC: Loaded 23611 existing records. [2025-10-17T21:39:21.147471] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:39:21.147741] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-17T21:39:21.147892] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-17T21:39:21.148113] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-10-17T21:39:21.148187] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-17T21:39:21.327239] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T21:39:21.342708] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-17T21:39:21.543202] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:39:21.751751] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-17T21:39:22.142342] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-17T21:39:22.942330] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-10-17T21:39:23.537420] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-17T21:39:23.571490] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-17T21:39:23.604500] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T21:39:23.742299] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-17T21:39:24.542269] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-10-17T21:39:25.342258] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-17T21:39:25.748374] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-17T21:39:26.142317] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-17T21:39:26.178823] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-17T21:39:26.663370] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T21:39:26.669041] [INFO ] [REMOTE ] SPR: Full fetch complete (60137 records). [2025-10-17T21:39:26.669145] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-17T21:39:26.949614] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-10. [2025-10-17T21:39:27.044143] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-17T21:39:27.044285] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-17T21:39:27.045411] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-17T21:39:27.045558] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-17T21:39:27.046811] [DEBUG] [LOCAL ] SPR: Trimmed 60137 records to 41640 (keeping 200 days of data) [2025-10-17T21:39:27.298425] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T21:39:27.306299] [DEBUG] [LOCAL ] SPR: Primary data saved (41640 records). [2025-10-17T21:39:27.306371] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-17T21:39:27.306914] [INFO ] [MAIN ] Update Progress: 1978/2368 symbols completed. SPR took 29.0s. Estimated remaining: 55m 5s. Rate: 7.1 symbols/min [2025-10-17T21:39:27.476417] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:39:27.489089] [DEBUG] [LOCAL ] SPXX: Loaded 9377 existing records from primary storage. [2025-10-17T21:39:27.489326] [INFO ] [MAIN ] SPXX: Loaded 9377 existing records. [2025-10-17T21:39:27.672775] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:39:27.673130] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-17T21:39:27.673261] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-17T21:39:27.679921] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-17T21:39:27.680253] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-17T21:39:27.680191] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T21:39:27.747395] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-17T21:39:27.725364] [INFO ] [REMOTE ] SPRU: Full fetch complete (12068 records). [2025-10-17T21:39:27.776593] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-17T21:39:28.353735] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:39:28.412541] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-17T21:39:28.412618] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-17T21:39:28.412950] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-17T21:39:28.413004] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-17T21:39:28.413447] [DEBUG] [LOCAL ] SPRU: Trimmed 12068 records to 10000 (keeping 200 days of data) [2025-10-17T21:39:28.467509] [DEBUG] [LOCAL ] SPRU: Primary data saved (10000 records). [2025-10-17T21:39:28.467633] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-17T21:39:28.467751] [INFO ] [MAIN ] Update Progress: 1979/2368 symbols completed. SPRU took 23.3s. Estimated remaining: 54m 55s. Rate: 7.1 symbols/min [2025-10-17T21:39:28.547447] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-17T21:39:28.642962] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:39:28.687556] [DEBUG] [LOCAL ] SQM: Loaded 49174 existing records from primary storage. [2025-10-17T21:39:28.687936] [INFO ] [MAIN ] SQM: Loaded 49174 existing records. [2025-10-17T21:39:28.865770] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:39:28.865976] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-17T21:39:28.866023] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-17T21:39:28.866444] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-17T21:39:28.866502] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-17T21:39:29.220077] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:39:29.342349] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-10-17T21:39:29.636841] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T21:39:30.052669] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T21:39:30.142248] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-17T21:39:30.880377] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T21:39:30.942271] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-10-17T21:39:31.249207] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-17T21:39:31.558220] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-17T21:39:31.742270] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-17T21:39:32.542282] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-17T21:39:33.174221] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-17T21:39:33.342372] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-17T21:39:33.912638] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-17T21:39:34.142888] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T21:39:34.142417] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-17T21:39:34.942347] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-17T21:39:35.742288] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-17T21:39:35.768890] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T21:39:35.816816] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-17T21:39:36.542285] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-17T21:39:37.342378] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-17T21:39:37.770434] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-17T21:39:37.832901] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-17T21:39:37.839666] [INFO ] [REMOTE ] SPOT: Full fetch complete (73784 records). [2025-10-17T21:39:37.839780] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-17T21:39:38.147448] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-17T21:39:38.224776] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-10-17T21:39:38.224857] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-10-17T21:39:38.225985] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-10-17T21:39:38.226047] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-10-17T21:39:38.227436] [DEBUG] [LOCAL ] SPOT: Trimmed 73784 records to 51040 (keeping 200 days of data) [2025-10-17T21:39:38.537249] [DEBUG] [LOCAL ] SPOT: Primary data saved (51040 records). [2025-10-17T21:39:38.537376] [INFO ] [MAIN ] SPOT: Full history saved. [2025-10-17T21:39:38.537455] [INFO ] [MAIN ] Update Progress: 1980/2368 symbols completed. SPOT took 56.5s. Estimated remaining: 54m 47s. Rate: 7.1 symbols/min [2025-10-17T21:39:38.706106] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:39:38.732947] [DEBUG] [LOCAL ] SQNS: Loaded 27732 existing records from primary storage. [2025-10-17T21:39:38.733289] [INFO ] [MAIN ] SQNS: Loaded 27732 existing records. [2025-10-17T21:39:38.842234] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-17T21:39:38.943370] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-17T21:39:38.943303] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:39:38.957086] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-17T21:39:38.957186] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-17T21:39:38.957409] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-17T21:39:38.960301] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T21:39:38.957877] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-17T21:39:39.313069] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:39:39.686391] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-17T21:39:39.742242] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-17T21:39:40.464768] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T21:39:40.542314] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-17T21:39:41.342364] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-17T21:39:41.608220] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-17T21:39:41.789391] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-17T21:39:42.142296] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-17T21:39:42.853584] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T21:39:42.942304] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-10-17T21:39:43.742279] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-17T21:39:43.981947] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T21:39:44.530873] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-17T21:39:44.542252] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-17T21:39:45.342287] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-17T21:39:46.142323] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-17T21:39:46.298029] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T21:39:46.587748] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-17T21:39:46.942267] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-17T21:39:47.006181] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-17T21:39:47.742298] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-17T21:39:48.542362] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-17T21:39:48.581785] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T21:39:48.718026] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-17T21:39:49.334922] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T21:39:49.337599] [INFO ] [REMOTE ] SPXX: Full fetch complete (13425 records). [2025-10-17T21:39:49.340774] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-17T21:39:49.347513] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-17T21:39:49.707544] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-17T21:39:49.707624] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-17T21:39:49.708062] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-17T21:39:49.708124] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-17T21:39:49.708615] [DEBUG] [LOCAL ] SPXX: Trimmed 13425 records to 9463 (keeping 200 days of data) [2025-10-17T21:39:49.768788] [DEBUG] [LOCAL ] SPXX: Primary data saved (9463 records). [2025-10-17T21:39:49.768929] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-17T21:39:49.769029] [INFO ] [MAIN ] Update Progress: 1981/2368 symbols completed. SPXX took 22.5s. Estimated remaining: 54m 39s. Rate: 7.1 symbols/min [2025-10-17T21:39:49.943298] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:39:49.977051] [DEBUG] [LOCAL ] SR: Loaded 32722 existing records from primary storage. [2025-10-17T21:39:49.977356] [INFO ] [MAIN ] SR: Loaded 32722 existing records. [2025-10-17T21:39:50.170291] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:39:50.164197] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-17T21:39:50.170622] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-17T21:39:50.170736] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-17T21:39:50.171775] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-10-17T21:39:50.171836] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-17T21:39:50.535906] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-17T21:39:50.617142] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:39:50.942291] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-17T21:39:51.559221] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T21:39:51.742272] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-17T21:39:52.547438] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-10-17T21:39:52.562629] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T21:39:52.913179] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T21:39:53.342302] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-17T21:39:53.882039] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T21:39:54.142276] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-17T21:39:54.408354] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T21:39:54.411907] [INFO ] [REMOTE ] SPXC: Full fetch complete (34160 records). [2025-10-17T21:39:54.411992] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-17T21:39:54.787005] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-17T21:39:54.787079] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-17T21:39:54.787793] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-17T21:39:54.787855] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-17T21:39:54.788624] [DEBUG] [LOCAL ] SPXC: Trimmed 34160 records to 23724 (keeping 200 days of data) [2025-10-17T21:39:54.932239] [DEBUG] [LOCAL ] SPXC: Primary data saved (23724 records). [2025-10-17T21:39:54.932366] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-17T21:39:54.932445] [INFO ] [MAIN ] Update Progress: 1982/2368 symbols completed. SPXC took 34.2s. Estimated remaining: 54m 30s. Rate: 7.1 symbols/min [2025-10-17T21:39:54.947378] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-17T21:39:55.114799] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:39:55.165856] [DEBUG] [LOCAL ] SRE: Loaded 53806 existing records from primary storage. [2025-10-17T21:39:55.166181] [INFO ] [MAIN ] SRE: Loaded 53806 existing records. [2025-10-17T21:39:55.341675] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:39:55.342141] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-17T21:39:55.342277] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-17T21:39:55.342559] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-10-17T21:39:55.342615] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-17T21:39:55.608989] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T21:39:55.715726] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:39:55.742246] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-10-17T21:39:56.357747] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T21:39:56.542282] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-17T21:39:57.321053] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T21:39:57.342247] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-17T21:39:57.384247] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-17T21:39:58.142322] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-17T21:39:58.942276] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-17T21:39:59.054076] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T21:39:59.450035] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T21:39:59.742287] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-17T21:40:00.542333] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-17T21:40:00.844566] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-17T21:40:01.071218] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-17T21:40:01.224610] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T21:40:01.342285] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-17T21:40:02.142354] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-17T21:40:02.942368] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-17T21:40:03.147319] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T21:40:03.624093] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-17T21:40:03.742274] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-17T21:40:04.542270] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-17T21:40:04.721074] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T21:40:05.342275] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-17T21:40:05.546347] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T21:40:05.919042] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T21:40:06.142355] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-17T21:40:06.901067] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T21:40:06.942254] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-17T21:40:07.569909] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T21:40:07.742304] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-17T21:40:08.466955] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T21:40:08.542294] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-17T21:40:08.830075] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T21:40:09.342307] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-17T21:40:09.530617] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T21:40:10.142287] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-17T21:40:10.942271] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-17T21:40:11.016958] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T21:40:11.742291] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-17T21:40:12.423823] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-17T21:40:12.490556] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T21:40:12.497627] [INFO ] [REMOTE ] SQM: Full fetch complete (69739 records). [2025-10-17T21:40:12.497814] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-17T21:40:12.551563] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-17T21:40:12.886810] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-17T21:40:12.887018] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-17T21:40:12.888312] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-17T21:40:12.888390] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-17T21:40:12.890110] [DEBUG] [LOCAL ] SQM: Trimmed 69739 records to 49549 (keeping 200 days of data) [2025-10-17T21:40:12.965326] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T21:40:13.200517] [DEBUG] [LOCAL ] SQM: Primary data saved (49549 records). [2025-10-17T21:40:13.200760] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-17T21:40:13.200859] [INFO ] [MAIN ] Update Progress: 1983/2368 symbols completed. SQM took 44.7s. Estimated remaining: 54m 24s. Rate: 7.1 symbols/min [2025-10-17T21:40:13.347361] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-17T21:40:13.366751] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:40:13.379468] [DEBUG] [LOCAL ] SREA: Loaded 10055 existing records from primary storage. [2025-10-17T21:40:13.379703] [INFO ] [MAIN ] SREA: Loaded 10055 existing records. [2025-10-17T21:40:13.551458] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:40:13.551729] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-17T21:40:13.551783] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-17T21:40:13.551945] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-17T21:40:13.552001] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-17T21:40:13.900624] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:40:14.142294] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-10-17T21:40:14.673386] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-17T21:40:14.771990] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-17T21:40:14.794751] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T21:40:14.942281] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-17T21:40:15.728297] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T21:40:15.742246] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-17T21:40:16.542370] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-17T21:40:16.909200] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T21:40:16.913201] [INFO ] [REMOTE ] SR: Full fetch complete (46222 records). [2025-10-17T21:40:16.913281] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-17T21:40:17.283857] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-17T21:40:17.283933] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-17T21:40:17.284841] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-17T21:40:17.284903] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-17T21:40:17.285832] [DEBUG] [LOCAL ] SR: Trimmed 46222 records to 32870 (keeping 200 days of data) [2025-10-17T21:40:17.342724] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-17T21:40:17.495439] [DEBUG] [LOCAL ] SR: Primary data saved (32870 records). [2025-10-17T21:40:17.495592] [INFO ] [MAIN ] SR: Full history saved. [2025-10-17T21:40:17.495703] [INFO ] [MAIN ] Update Progress: 1984/2368 symbols completed. SR took 27.7s. Estimated remaining: 54m 14s. Rate: 7.1 symbols/min [2025-10-17T21:40:17.661248] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:40:17.698023] [DEBUG] [LOCAL ] SRFM: Loaded 39445 existing records from primary storage. [2025-10-17T21:40:17.698306] [INFO ] [MAIN ] SRFM: Loaded 39445 existing records. [2025-10-17T21:40:17.872941] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:40:17.873205] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-17T21:40:17.873251] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-17T21:40:17.873786] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-17T21:40:17.873843] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-17T21:40:18.147568] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-17T21:40:18.251521] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:40:18.247199] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T21:40:18.929038] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T21:40:18.942232] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-17T21:40:19.051467] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T21:40:19.734868] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T21:40:19.742237] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-17T21:40:20.312136] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-17T21:40:20.542306] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-10-17T21:40:21.342299] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-17T21:40:22.142336] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-17T21:40:22.211964] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T21:40:22.232204] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-17T21:40:22.942381] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-17T21:40:23.210935] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T21:40:23.214895] [INFO ] [REMOTE ] SQNS: Full fetch complete (33129 records). [2025-10-17T21:40:23.215018] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-17T21:40:23.581609] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-17T21:40:23.581714] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-17T21:40:23.582432] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-17T21:40:23.582524] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-17T21:40:23.583474] [DEBUG] [LOCAL ] SQNS: Trimmed 33129 records to 27898 (keeping 200 days of data) [2025-10-17T21:40:23.733812] [DEBUG] [LOCAL ] SQNS: Primary data saved (27898 records). [2025-10-17T21:40:23.733938] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-17T21:40:23.734016] [INFO ] [MAIN ] Update Progress: 1985/2368 symbols completed. SQNS took 45.2s. Estimated remaining: 54m 5s. Rate: 7.1 symbols/min [2025-10-17T21:40:23.747373] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-17T21:40:23.903441] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:40:23.919137] [DEBUG] [LOCAL ] SRG: Loaded 15555 existing records from primary storage. [2025-10-17T21:40:23.919350] [INFO ] [MAIN ] SRG: Loaded 15555 existing records. [2025-10-17T21:40:24.096763] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:40:24.097016] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-17T21:40:24.097118] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-17T21:40:24.109456] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-17T21:40:24.111347] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-17T21:40:24.147891] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T21:40:24.469443] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:40:24.542260] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-17T21:40:24.644043] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T21:40:25.342346] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-17T21:40:26.142256] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-10-17T21:40:26.255850] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T21:40:26.524792] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T21:40:26.942324] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-17T21:40:27.313250] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T21:40:27.742285] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-17T21:40:28.176773] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-17T21:40:28.541054] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-17T21:40:28.543492] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-17T21:40:29.342325] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-17T21:40:29.565889] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-17T21:40:30.077123] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-17T21:40:30.142262] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-17T21:40:30.876690] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-17T21:40:30.942262] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-17T21:40:31.742319] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-17T21:40:31.763731] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-17T21:40:32.414886] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-17T21:40:32.416460] [INFO ] [REMOTE ] SREA: Full fetch complete (15048 records). [2025-10-17T21:40:32.416539] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-17T21:40:32.547427] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-17T21:40:32.799556] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-17T21:40:32.799679] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-17T21:40:32.800041] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-17T21:40:32.800084] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-17T21:40:32.800769] [DEBUG] [LOCAL ] SREA: Trimmed 15048 records to 10096 (keeping 200 days of data) [2025-10-17T21:40:32.864109] [DEBUG] [LOCAL ] SREA: Primary data saved (10096 records). [2025-10-17T21:40:32.864252] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-17T21:40:32.864337] [INFO ] [MAIN ] Update Progress: 1986/2368 symbols completed. SREA took 19.7s. Estimated remaining: 53m 57s. Rate: 7.1 symbols/min [2025-10-17T21:40:33.028665] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:40:33.054912] [DEBUG] [LOCAL ] SRI: Loaded 26642 existing records from primary storage. [2025-10-17T21:40:33.055169] [INFO ] [MAIN ] SRI: Loaded 26642 existing records. [2025-10-17T21:40:33.235987] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:40:33.236230] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-17T21:40:33.236279] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-17T21:40:33.236455] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-17T21:40:33.236512] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-17T21:40:33.347512] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-17T21:40:33.775004] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:40:33.783946] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-17T21:40:34.142359] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-10-17T21:40:34.942275] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-17T21:40:35.318615] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-17T21:40:35.514741] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T21:40:35.653145] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-17T21:40:35.742318] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-17T21:40:36.542345] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-17T21:40:37.256042] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T21:40:37.342258] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-17T21:40:38.142324] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-17T21:40:38.414337] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T21:40:38.441960] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T21:40:38.942336] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-17T21:40:39.742302] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-17T21:40:40.542345] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-17T21:40:40.686658] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-17T21:40:40.845747] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T21:40:40.869178] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-17T21:40:41.342269] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-17T21:40:41.797837] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T21:40:41.879889] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-17T21:40:41.889428] [INFO ] [REMOTE ] SRE: Full fetch complete (77495 records). [2025-10-17T21:40:41.889602] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-17T21:40:42.147494] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-17T21:40:42.296774] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-17T21:40:42.296851] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-17T21:40:42.298040] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-17T21:40:42.298103] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-17T21:40:42.299520] [DEBUG] [LOCAL ] SRE: Trimmed 77495 records to 54192 (keeping 200 days of data) [2025-10-17T21:40:42.636066] [DEBUG] [LOCAL ] SRE: Primary data saved (54192 records). [2025-10-17T21:40:42.636254] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-17T21:40:42.636372] [INFO ] [MAIN ] Update Progress: 1987/2368 symbols completed. SRE took 47.7s. Estimated remaining: 53m 49s. Rate: 7.1 symbols/min [2025-10-17T21:40:42.801978] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:40:42.802144] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-17T21:40:42.802182] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-17T21:40:42.802290] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-17T21:40:42.802342] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-17T21:40:42.802408] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-17T21:40:42.802462] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-17T21:40:42.948357] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-17T21:40:43.160372] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:40:43.282610] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T21:40:43.742323] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-17T21:40:44.317902] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T21:40:44.542279] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-10-17T21:40:44.654601] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-17T21:40:45.130532] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-17T21:40:45.342293] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-17T21:40:45.879157] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-17T21:40:46.142288] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-17T21:40:46.942281] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-17T21:40:46.989731] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T21:40:47.323915] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-17T21:40:47.742312] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-17T21:40:48.542283] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-17T21:40:48.897309] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-17T21:40:49.342375] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-17T21:40:49.897295] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-17T21:40:50.142259] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-17T21:40:50.514941] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-17T21:40:50.515845] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T21:40:50.942359] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-17T21:40:51.742312] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-17T21:40:52.219273] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-17T21:40:52.542377] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-17T21:40:52.989985] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T21:40:53.335506] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T21:40:53.342242] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-17T21:40:54.142314] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-17T21:40:54.430486] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T21:40:54.942304] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-17T21:40:55.742327] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-17T21:40:56.011047] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T21:40:56.018963] [INFO ] [REMOTE ] SRFM: Full fetch complete (50871 records). [2025-10-17T21:40:56.019085] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-17T21:40:56.396018] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T21:40:56.479287] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-17T21:40:56.479380] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-17T21:40:56.480355] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-17T21:40:56.480417] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-17T21:40:56.481632] [DEBUG] [LOCAL ] SRFM: Trimmed 50871 records to 39823 (keeping 200 days of data) [2025-10-17T21:40:56.566209] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-17T21:40:56.713163] [DEBUG] [LOCAL ] SRFM: Primary data saved (39823 records). [2025-10-17T21:40:56.713306] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-17T21:40:56.713884] [INFO ] [MAIN ] Update Progress: 1988/2368 symbols completed. SRFM took 39.2s. Estimated remaining: 53m 41s. Rate: 7.1 symbols/min [2025-10-17T21:40:56.885827] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:40:56.898209] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T21:40:56.907985] [DEBUG] [LOCAL ] SRV: Loaded 7481 existing records from primary storage. [2025-10-17T21:40:56.908177] [INFO ] [MAIN ] SRV: Loaded 7481 existing records. [2025-10-17T21:40:57.096872] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:40:57.097106] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-17T21:40:57.097165] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-17T21:40:57.097315] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-17T21:40:57.097371] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-17T21:40:57.352101] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-17T21:40:57.460510] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:40:57.774344] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-17T21:40:57.867039] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T21:40:58.142270] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-17T21:40:58.483479] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-17T21:40:58.942342] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-17T21:40:59.313041] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-17T21:40:59.742319] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-17T21:41:00.100697] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-17T21:41:00.542321] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-17T21:41:01.342284] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-10-17T21:41:02.036235] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-17T21:41:02.049783] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-17T21:41:02.142345] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-17T21:41:02.942330] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-17T21:41:02.967460] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T21:41:03.306744] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-17T21:41:03.307498] [INFO ] [REMOTE ] SRL: Full fetch complete (1868 records). [2025-10-17T21:41:03.307565] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-17T21:41:03.481075] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-17T21:41:03.481226] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-17T21:41:03.481272] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-17T21:41:03.481346] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-17T21:41:03.481407] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-17T21:41:03.481442] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-17T21:41:03.481480] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-17T21:41:03.481532] [INFO ] [MAIN ] Update Progress: 1989/2368 symbols completed. SRL took 20.8s. Estimated remaining: 53m 33s. Rate: 7.1 symbols/min [2025-10-17T21:41:03.646559] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:41:03.686235] [DEBUG] [LOCAL ] SSB: Loaded 43122 existing records from primary storage. [2025-10-17T21:41:03.686506] [INFO ] [MAIN ] SSB: Loaded 43122 existing records. [2025-10-17T21:41:03.747594] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-17T21:41:03.869265] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:41:03.869474] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-17T21:41:03.869532] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-17T21:41:03.869733] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-10-17T21:41:03.869793] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-17T21:41:04.220493] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:41:04.542262] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-10-17T21:41:04.581166] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-17T21:41:05.342348] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-17T21:41:05.958507] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T21:41:06.142261] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-17T21:41:06.530999] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-17T21:41:06.744176] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T21:41:06.746511] [INFO ] [REMOTE ] SRG: Full fetch complete (23380 records). [2025-10-17T21:41:06.746584] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-17T21:41:06.947701] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-17T21:41:07.148875] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-17T21:41:07.148959] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-17T21:41:07.149500] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-17T21:41:07.149561] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-17T21:41:07.150269] [DEBUG] [LOCAL ] SRG: Trimmed 23380 records to 15640 (keeping 200 days of data) [2025-10-17T21:41:07.243512] [DEBUG] [LOCAL ] SRG: Primary data saved (15640 records). [2025-10-17T21:41:07.243621] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-17T21:41:07.243755] [INFO ] [MAIN ] Update Progress: 1990/2368 symbols completed. SRG took 43.5s. Estimated remaining: 53m 23s. Rate: 7.1 symbols/min [2025-10-17T21:41:07.420052] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:41:07.444989] [DEBUG] [LOCAL ] SSD: Loaded 22749 existing records from primary storage. [2025-10-17T21:41:07.445234] [INFO ] [MAIN ] SSD: Loaded 22749 existing records. [2025-10-17T21:41:07.630177] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:41:07.630399] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-17T21:41:07.630451] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-17T21:41:07.630700] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-10-17T21:41:07.630758] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-17T21:41:07.747448] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-17T21:41:07.989854] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:41:08.542319] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-10-17T21:41:08.632605] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-17T21:41:08.692140] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T21:41:09.342356] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-17T21:41:09.648534] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T21:41:10.142339] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-17T21:41:10.809417] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T21:41:10.917228] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-17T21:41:10.942249] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-17T21:41:11.742322] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-17T21:41:12.081856] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T21:41:12.542340] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-17T21:41:13.342261] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-17T21:41:13.744423] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T21:41:14.142332] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-17T21:41:14.825453] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T21:41:14.846302] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-17T21:41:14.942302] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-17T21:41:15.742291] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-17T21:41:15.807044] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-17T21:41:16.145159] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (4.40 seconds). [2025-10-17T21:41:16.542340] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-17T21:41:16.922077] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-17T21:41:17.342277] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-17T21:41:17.443274] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-17T21:41:17.446293] [INFO ] [REMOTE ] SRI: Full fetch complete (39928 records). [2025-10-17T21:41:17.446372] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-17T21:41:17.822313] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-17T21:41:17.822408] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-17T21:41:17.823216] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-17T21:41:17.823278] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-17T21:41:17.824139] [DEBUG] [LOCAL ] SRI: Trimmed 39928 records to 26831 (keeping 200 days of data) [2025-10-17T21:41:17.983917] [DEBUG] [LOCAL ] SRI: Primary data saved (26831 records). [2025-10-17T21:41:17.984093] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-17T21:41:17.984213] [INFO ] [MAIN ] Update Progress: 1991/2368 symbols completed. SRI took 45.1s. Estimated remaining: 53m 15s. Rate: 7.1 symbols/min [2025-10-17T21:41:18.107171] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T21:41:18.145852] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-17T21:41:18.167956] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:41:18.205624] [DEBUG] [LOCAL ] SSL: Loaded 41797 existing records from primary storage. [2025-10-17T21:41:18.205987] [INFO ] [MAIN ] SSL: Loaded 41797 existing records. [2025-10-17T21:41:18.382435] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:41:18.382721] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-17T21:41:18.382780] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-17T21:41:18.382981] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-17T21:41:18.383037] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-17T21:41:18.725074] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:41:18.942306] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-10-17T21:41:19.742308] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-17T21:41:19.823205] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T21:41:20.502669] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-17T21:41:20.542304] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-17T21:41:20.642216] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T21:41:21.268353] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-17T21:41:21.342318] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-17T21:41:22.142339] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-17T21:41:22.941636] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T21:41:22.950127] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-17T21:41:23.714524] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T21:41:23.742251] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-17T21:41:24.128033] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T21:41:24.542291] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-17T21:41:25.219012] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T21:41:25.220593] [INFO ] [REMOTE ] SRV: Full fetch complete (11350 records). [2025-10-17T21:41:25.220695] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-17T21:41:25.351679] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-17T21:41:25.607319] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-17T21:41:25.607456] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-17T21:41:25.607831] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-17T21:41:25.607909] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-17T21:41:25.619175] [DEBUG] [LOCAL ] SRV: Trimmed 11350 records to 7537 (keeping 200 days of data) [2025-10-17T21:41:25.666120] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-17T21:41:25.706053] [DEBUG] [LOCAL ] SRV: Primary data saved (7537 records). [2025-10-17T21:41:25.706206] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-17T21:41:25.706294] [INFO ] [MAIN ] Update Progress: 1992/2368 symbols completed. SRV took 29.0s. Estimated remaining: 53m 7s. Rate: 7.1 symbols/min [2025-10-17T21:41:25.961957] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:41:25.979897] [DEBUG] [LOCAL ] SST: Loaded 11622 existing records from primary storage. [2025-10-17T21:41:25.980226] [INFO ] [MAIN ] SST: Loaded 11622 existing records. [2025-10-17T21:41:26.143771] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-17T21:41:26.255568] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:41:26.255914] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-17T21:41:26.255985] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-17T21:41:26.256170] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-17T21:41:26.256246] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-17T21:41:26.624172] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T21:41:26.700225] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:41:26.942284] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-10-17T21:41:27.742250] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-17T21:41:27.786168] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-17T21:41:27.930133] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T21:41:28.542269] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-17T21:41:28.863500] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T21:41:29.342346] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-17T21:41:30.036297] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T21:41:30.142309] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-17T21:41:30.486571] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T21:41:30.942310] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-17T21:41:31.717795] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T21:41:31.742243] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-17T21:41:32.451639] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T21:41:32.542292] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-17T21:41:33.215861] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T21:41:33.222334] [INFO ] [REMOTE ] SSB: Full fetch complete (61663 records). [2025-10-17T21:41:33.222483] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-17T21:41:33.343535] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-17T21:41:33.677549] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-17T21:41:33.677663] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-17T21:41:33.679011] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-17T21:41:33.679078] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-17T21:41:33.680669] [DEBUG] [LOCAL ] SSB: Trimmed 61663 records to 43425 (keeping 200 days of data) [2025-10-17T21:41:33.953232] [DEBUG] [LOCAL ] SSB: Primary data saved (43425 records). [2025-10-17T21:41:33.953360] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-17T21:41:33.953454] [INFO ] [MAIN ] Update Progress: 1993/2368 symbols completed. SSB took 30.5s. Estimated remaining: 52m 58s. Rate: 7.1 symbols/min [2025-10-17T21:41:34.150273] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:41:34.153188] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T21:41:34.146925] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-17T21:41:34.191811] [DEBUG] [LOCAL ] SSTK: Loaded 25552 existing records from primary storage. [2025-10-17T21:41:34.192066] [INFO ] [MAIN ] SSTK: Loaded 25552 existing records. [2025-10-17T21:41:34.373997] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:41:34.374233] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-17T21:41:34.374287] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-17T21:41:34.374474] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-10-17T21:41:34.374530] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-17T21:41:34.483147] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-17T21:41:34.739771] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:41:34.942274] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-17T21:41:35.342217] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-17T21:41:35.742328] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-10-17T21:41:35.799233] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T21:41:36.542313] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-17T21:41:36.906497] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T21:41:37.342263] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-17T21:41:37.696313] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T21:41:38.142308] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-17T21:41:38.897373] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T21:41:38.942265] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-17T21:41:39.171013] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-17T21:41:39.742311] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-17T21:41:40.308341] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T21:41:40.542283] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-17T21:41:41.090573] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-17T21:41:41.342324] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-17T21:41:41.993000] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T21:41:42.142246] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-17T21:41:42.495908] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T21:41:42.942275] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-17T21:41:43.564284] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T21:41:43.742260] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-17T21:41:44.534178] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T21:41:44.542777] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-17T21:41:44.929219] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-17T21:41:45.342302] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-17T21:41:45.363806] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-17T21:41:46.142308] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-17T21:41:46.469256] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T21:41:46.942257] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-17T21:41:47.105022] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-17T21:41:47.742308] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-17T21:41:47.990243] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T21:41:47.993555] [INFO ] [REMOTE ] SSD: Full fetch complete (32426 records). [2025-10-17T21:41:47.993713] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-17T21:41:48.368561] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-17T21:41:48.368635] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-17T21:41:48.369333] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-17T21:41:48.369395] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-17T21:41:48.370147] [DEBUG] [LOCAL ] SSD: Trimmed 32426 records to 22917 (keeping 200 days of data) [2025-10-17T21:41:48.512144] [DEBUG] [LOCAL ] SSD: Primary data saved (22917 records). [2025-10-17T21:41:48.512274] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-17T21:41:48.512541] [INFO ] [MAIN ] Update Progress: 1994/2368 symbols completed. SSD took 41.3s. Estimated remaining: 52m 51s. Rate: 7.1 symbols/min [2025-10-17T21:41:48.544494] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-17T21:41:48.680819] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:41:48.725248] [DEBUG] [LOCAL ] ST: Loaded 50212 existing records from primary storage. [2025-10-17T21:41:48.725597] [INFO ] [MAIN ] ST: Loaded 50212 existing records. [2025-10-17T21:41:48.897523] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:41:48.897755] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-17T21:41:48.897838] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-17T21:41:48.898044] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-10-17T21:41:48.898099] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-17T21:41:49.245439] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:41:49.353010] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-10-17T21:41:49.357752] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T21:41:49.877043] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-17T21:41:50.142326] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-17T21:41:50.242509] [DEBUG] [REMOTE ] SST: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-17T21:41:50.242792] [WARN ] [REMOTE ] SST: No data returned for month 2025-06 [2025-10-17T21:41:50.242881] [FATAL] [REMOTE ] SST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:41:50.242959] [FATAL] [MAIN ] SST: Failed to fetch primary data. [2025-10-17T21:41:50.243020] [WARN ] [MAIN ] SST: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:41:50.243092] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-17T21:41:50.243152] [DEBUG] [LOCAL ] SST: No primary data file found to delete. [2025-10-17T21:41:50.243186] [INFO ] [LOCAL ] SST: Starting deletion of derivative data. [2025-10-17T21:41:50.243322] [DEBUG] [LOCAL ] SST: Deleted derivative data file. [2025-10-17T21:41:50.243402] [INFO ] [MAIN ] Update Progress: 1995/2368 symbols completed. SST took 24.5s. Estimated remaining: 52m 41s. Rate: 7.1 symbols/min [2025-10-17T21:41:50.407682] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:41:50.455936] [DEBUG] [LOCAL ] STAG: Loaded 50506 existing records from primary storage. [2025-10-17T21:41:50.456271] [INFO ] [MAIN ] STAG: Loaded 50506 existing records. [2025-10-17T21:41:50.633398] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:41:50.633584] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-17T21:41:50.633631] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-17T21:41:50.633886] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-10-17T21:41:50.633940] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-17T21:41:50.945872] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-17T21:41:50.989556] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:41:51.021590] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T21:41:51.742307] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-17T21:41:52.542273] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-17T21:41:52.608354] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T21:41:53.298950] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T21:41:53.342253] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-17T21:41:53.670289] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T21:41:54.142304] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-17T21:41:54.880579] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T21:41:54.942286] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-17T21:41:55.223601] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T21:41:55.742307] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-10-17T21:41:56.542344] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-17T21:41:56.581986] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T21:41:57.342276] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-17T21:41:57.433701] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T21:41:57.625781] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T21:41:57.629902] [INFO ] [REMOTE ] SSTK: Full fetch complete (41669 records). [2025-10-17T21:41:57.630013] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-17T21:41:58.064977] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-17T21:41:58.065062] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-17T21:41:58.065980] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-17T21:41:58.066046] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-17T21:41:58.067015] [DEBUG] [LOCAL ] SSTK: Trimmed 41669 records to 25830 (keeping 200 days of data) [2025-10-17T21:41:58.156849] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-17T21:41:58.228332] [DEBUG] [LOCAL ] SSTK: Primary data saved (25830 records). [2025-10-17T21:41:58.228466] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-17T21:41:58.228551] [INFO ] [MAIN ] Update Progress: 1996/2368 symbols completed. SSTK took 24.3s. Estimated remaining: 52m 32s. Rate: 7.1 symbols/min [2025-10-17T21:41:58.392567] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:41:58.409913] [DEBUG] [LOCAL ] STC: Loaded 17452 existing records from primary storage. [2025-10-17T21:41:58.410339] [INFO ] [MAIN ] STC: Loaded 17452 existing records. [2025-10-17T21:41:58.592288] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:41:58.592587] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-17T21:41:58.592706] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-17T21:41:58.592964] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-10-17T21:41:58.593100] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-17T21:41:58.788541] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-17T21:41:58.949258] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-17T21:41:58.978823] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:41:59.742399] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-17T21:41:59.982133] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T21:42:00.117939] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T21:42:00.123589] [INFO ] [REMOTE ] SSL: Full fetch complete (60069 records). [2025-10-17T21:42:00.123705] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-17T21:42:00.499192] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-17T21:42:00.499270] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-17T21:42:00.500286] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-17T21:42:00.500349] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-17T21:42:00.501447] [DEBUG] [LOCAL ] SSL: Trimmed 60069 records to 42084 (keeping 200 days of data) [2025-10-17T21:42:00.545730] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-17T21:42:00.737944] [DEBUG] [LOCAL ] SSL: Primary data saved (42084 records). [2025-10-17T21:42:00.738113] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-17T21:42:00.738207] [INFO ] [MAIN ] Update Progress: 1997/2368 symbols completed. SSL took 42.8s. Estimated remaining: 52m 23s. Rate: 7.1 symbols/min [2025-10-17T21:42:01.342279] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-10-17T21:42:01.403568] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T21:42:02.142266] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-17T21:42:02.406144] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T21:42:02.431469] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T21:42:02.942287] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-17T21:42:03.742283] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-17T21:42:03.839902] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T21:42:03.903207] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-17T21:42:04.542360] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-17T21:42:05.326393] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T21:42:05.342242] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-17T21:42:05.543072] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T21:42:06.142299] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-17T21:42:06.942262] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-17T21:42:07.058751] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T21:42:07.742258] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-17T21:42:07.897457] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T21:42:08.002348] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T21:42:08.542296] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-17T21:42:09.342262] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-17T21:42:09.383372] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T21:42:09.719358] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T21:42:10.142346] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-17T21:42:10.942322] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-17T21:42:11.093771] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-17T21:42:11.207149] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T21:42:11.742344] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-17T21:42:12.357902] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T21:42:12.542281] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-17T21:42:13.342310] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-17T21:42:13.589529] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T21:42:14.142252] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-17T21:42:14.310896] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T21:42:14.317961] [INFO ] [REMOTE ] ST: Full fetch complete (72140 records). [2025-10-17T21:42:14.318076] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-17T21:42:14.632508] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T21:42:14.738241] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-17T21:42:14.738324] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-17T21:42:14.739555] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-17T21:42:14.739621] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-17T21:42:14.741060] [DEBUG] [LOCAL ] ST: Trimmed 72140 records to 50556 (keeping 200 days of data) [2025-10-17T21:42:14.947680] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-17T21:42:15.044330] [DEBUG] [LOCAL ] ST: Primary data saved (50556 records). [2025-10-17T21:42:15.044464] [INFO ] [MAIN ] ST: Full history saved. [2025-10-17T21:42:15.044543] [INFO ] [MAIN ] Update Progress: 1998/2368 symbols completed. ST took 26.5s. Estimated remaining: 52m 15s. Rate: 7.1 symbols/min [2025-10-17T21:42:15.753944] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T21:42:15.764116] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-17T21:42:16.064301] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T21:42:16.542332] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-17T21:42:17.335639] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T21:42:17.347410] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-17T21:42:17.505454] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T21:42:18.142321] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-17T21:42:19.149302] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T21:42:19.164383] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T21:42:19.169321] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-17T21:42:19.742333] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-17T21:42:19.998846] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-17T21:42:20.001231] [INFO ] [REMOTE ] STC: Full fetch complete (25554 records). [2025-10-17T21:42:20.001330] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-17T21:42:20.374399] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-17T21:42:20.374528] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-17T21:42:20.375142] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-17T21:42:20.375206] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-17T21:42:20.375866] [DEBUG] [LOCAL ] STC: Trimmed 25554 records to 17534 (keeping 200 days of data) [2025-10-17T21:42:20.483154] [DEBUG] [LOCAL ] STC: Primary data saved (17534 records). [2025-10-17T21:42:20.483297] [INFO ] [MAIN ] STC: Full history saved. [2025-10-17T21:42:20.483380] [INFO ] [MAIN ] Update Progress: 1999/2368 symbols completed. STC took 22.3s. Estimated remaining: 52m 6s. Rate: 7.1 symbols/min [2025-10-17T21:42:21.493516] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T21:42:21.504277] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-17T21:42:23.258761] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T21:42:23.265895] [INFO ] [REMOTE ] STAG: Full fetch complete (72565 records). [2025-10-17T21:42:23.266013] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-17T21:42:23.651860] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-17T21:42:23.651959] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-17T21:42:23.653102] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-17T21:42:23.653165] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-17T21:42:23.654526] [DEBUG] [LOCAL ] STAG: Trimmed 72565 records to 50883 (keeping 200 days of data) [2025-10-17T21:42:23.961623] [DEBUG] [LOCAL ] STAG: Primary data saved (50883 records). [2025-10-17T21:42:23.961781] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-17T21:42:23.962305] [INFO ] [MAIN ] Update Progress: 2000/2368 symbols completed. STAG took 33.7s. Estimated remaining: 51m 57s. Rate: 7.1 symbols/min [2025-10-17T21:42:24.541994] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:42:24.558387] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:42:24.627108] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:42:24.655498] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:42:24.682730] [DEBUG] [LOCAL ] STEL: Loaded 22796 existing records from primary storage. [2025-10-17T21:42:24.688828] [INFO ] [MAIN ] STEL: Loaded 22796 existing records. [2025-10-17T21:42:24.757691] [DEBUG] [LOCAL ] STEW: Loaded 15758 existing records from primary storage. [2025-10-17T21:42:24.821088] [INFO ] [MAIN ] STEW: Loaded 15758 existing records. [2025-10-17T21:42:24.829523] [DEBUG] [LOCAL ] STE: Loaded 35653 existing records from primary storage. [2025-10-17T21:42:24.928423] [DEBUG] [LOCAL ] STEM: Loaded 39157 existing records from primary storage. [2025-10-17T21:42:24.949375] [INFO ] [MAIN ] STE: Loaded 35653 existing records. [2025-10-17T21:42:24.949621] [INFO ] [MAIN ] STEM: Loaded 39157 existing records. [2025-10-17T21:42:25.063591] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:42:25.171912] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-17T21:42:25.197739] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-17T21:42:25.234201] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-10-17T21:42:25.258572] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-17T21:42:25.330931] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:42:25.372752] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-17T21:42:25.399755] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-17T21:42:25.498884] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-17T21:42:25.540012] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:42:25.550498] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-17T21:42:25.565000] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:42:25.540146] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-17T21:42:25.565666] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-17T21:42:25.565564] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-17T21:42:25.586781] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-10-17T21:42:25.586948] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-17T21:42:25.586718] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-17T21:42:25.685446] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-17T21:42:25.719673] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-17T21:42:26.660847] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:42:26.725006] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-10-17T21:42:26.895889] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:42:26.902349] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-10-17T21:42:26.891810] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:42:26.927829] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-10-17T21:42:26.981785] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:42:26.982117] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-10-17T21:42:27.889772] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T21:42:27.895418] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-17T21:42:27.919358] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T21:42:27.923102] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-17T21:42:28.012946] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T21:42:28.019911] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-17T21:42:28.485942] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T21:42:28.489096] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-17T21:42:28.650365] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T21:42:28.661458] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-17T21:42:28.893794] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-17T21:42:28.897828] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-17T21:42:29.233077] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-17T21:42:29.342330] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-17T21:42:29.411158] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T21:42:29.497202] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-17T21:42:30.142328] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-17T21:42:30.391016] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T21:42:30.942289] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-17T21:42:30.982255] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-17T21:42:31.324724] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-17T21:42:31.742270] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-17T21:42:32.073249] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T21:42:32.542375] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-17T21:42:32.966624] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T21:42:33.342404] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-17T21:42:33.952840] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-17T21:42:34.063197] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T21:42:34.142398] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-17T21:42:34.942306] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-17T21:42:35.742298] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-17T21:42:35.971305] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T21:42:36.040111] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-17T21:42:36.542324] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-17T21:42:36.733631] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-17T21:42:37.342255] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-17T21:42:37.768378] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-17T21:42:38.142314] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-17T21:42:38.261638] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T21:42:38.942365] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-17T21:42:39.633937] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T21:42:39.742282] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-17T21:42:40.542268] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-17T21:42:40.725589] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T21:42:41.339366] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-17T21:42:41.346561] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-17T21:42:41.653779] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-17T21:42:42.142264] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-17T21:42:42.383992] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T21:42:42.942297] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-17T21:42:43.673927] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-17T21:42:43.698810] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T21:42:43.742240] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-17T21:42:44.542300] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-17T21:42:44.604424] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-17T21:42:45.342329] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-17T21:42:45.592944] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T21:42:46.142328] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-17T21:42:46.815982] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T21:42:46.824900] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T21:42:46.827615] [INFO ] [REMOTE ] STEW: Full fetch complete (21730 records). [2025-10-17T21:42:46.827722] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-17T21:42:46.947443] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-17T21:42:47.203588] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-17T21:42:47.203723] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-17T21:42:47.204456] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-17T21:42:47.204505] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-17T21:42:47.205431] [DEBUG] [LOCAL ] STEW: Trimmed 21730 records to 15838 (keeping 200 days of data) [2025-10-17T21:42:47.311688] [DEBUG] [LOCAL ] STEW: Primary data saved (15838 records). [2025-10-17T21:42:47.311956] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-17T21:42:47.312132] [INFO ] [MAIN ] Update Progress: 2001/2368 symbols completed. STEW took 23.3s. Estimated remaining: 51m 51s. Rate: 7.1 symbols/min [2025-10-17T21:42:47.485120] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:42:47.485362] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-17T21:42:47.485400] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-17T21:42:47.485535] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-17T21:42:47.485577] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-17T21:42:47.485617] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-17T21:42:47.485704] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-17T21:42:47.747513] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-17T21:42:47.858884] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:42:48.541722] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T21:42:48.549439] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-17T21:42:49.342275] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-17T21:42:49.498097] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T21:42:49.502771] [INFO ] [REMOTE ] STEL: Full fetch complete (32104 records). [2025-10-17T21:42:49.502912] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-17T21:42:49.817345] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-17T21:42:49.979486] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-17T21:42:49.979583] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-17T21:42:49.980260] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-17T21:42:49.980322] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-17T21:42:49.981124] [DEBUG] [LOCAL ] STEL: Trimmed 32104 records to 22979 (keeping 200 days of data) [2025-10-17T21:42:50.125670] [DEBUG] [LOCAL ] STEL: Primary data saved (22979 records). [2025-10-17T21:42:50.125817] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-17T21:42:50.125939] [INFO ] [MAIN ] Update Progress: 2002/2368 symbols completed. STEL took 26.2s. Estimated remaining: 51m 42s. Rate: 7.1 symbols/min [2025-10-17T21:42:50.147444] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-17T21:42:50.297812] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:42:50.310503] [DEBUG] [LOCAL ] STK: Loaded 9817 existing records from primary storage. [2025-10-17T21:42:50.310743] [INFO ] [MAIN ] STK: Loaded 9817 existing records. [2025-10-17T21:42:50.517044] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:42:50.517363] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-17T21:42:50.517535] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-17T21:42:50.517840] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-17T21:42:50.517954] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-17T21:42:50.816158] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T21:42:50.908341] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:42:50.942267] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-10-17T21:42:51.742270] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-10-17T21:42:51.766295] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-17T21:42:52.108426] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-17T21:42:52.112064] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-17T21:42:52.542343] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-17T21:42:53.320085] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T21:42:53.342251] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-17T21:42:54.133546] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-17T21:42:54.142238] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-17T21:42:54.942327] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-17T21:42:54.985566] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-17T21:42:55.233460] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-17T21:42:55.742294] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-17T21:42:56.542270] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-17T21:42:56.552333] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T21:42:56.898855] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-17T21:42:57.342282] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-17T21:42:58.142378] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-17T21:42:58.508870] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-17T21:42:58.774215] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T21:42:58.942273] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-17T21:42:59.742330] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-17T21:43:00.542283] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-17T21:43:00.553317] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-17T21:43:00.797122] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T21:43:01.342264] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-17T21:43:01.508127] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T21:43:01.613859] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-17T21:43:02.142334] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-17T21:43:02.942365] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-17T21:43:03.574547] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-17T21:43:03.742315] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-17T21:43:04.399204] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-17T21:43:04.542324] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-17T21:43:05.342310] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-17T21:43:05.425716] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-17T21:43:05.845295] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-17T21:43:05.850275] [INFO ] [REMOTE ] STE: Full fetch complete (50946 records). [2025-10-17T21:43:05.850372] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-17T21:43:06.146850] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-17T21:43:06.155232] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T21:43:06.256618] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-17T21:43:06.256732] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-17T21:43:06.257839] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-17T21:43:06.257917] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-17T21:43:06.259104] [DEBUG] [LOCAL ] STE: Trimmed 50946 records to 35901 (keeping 200 days of data) [2025-10-17T21:43:06.495022] [DEBUG] [LOCAL ] STE: Primary data saved (35901 records). [2025-10-17T21:43:06.495167] [INFO ] [MAIN ] STE: Full history saved. [2025-10-17T21:43:06.495273] [INFO ] [MAIN ] Update Progress: 2003/2368 symbols completed. STE took 42.5s. Estimated remaining: 51m 35s. Rate: 7.1 symbols/min [2025-10-17T21:43:06.676310] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:43:06.731795] [DEBUG] [LOCAL ] STLA: Loaded 53945 existing records from primary storage. [2025-10-17T21:43:06.732128] [INFO ] [MAIN ] STLA: Loaded 53945 existing records. [2025-10-17T21:43:06.926830] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:43:06.927083] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-17T21:43:06.927152] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-17T21:43:06.927528] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-17T21:43:06.927583] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-17T21:43:06.949448] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-17T21:43:07.011111] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-17T21:43:07.291985] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:43:07.742301] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-10-17T21:43:08.352065] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T21:43:08.542313] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-17T21:43:09.342316] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-17T21:43:09.954284] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T21:43:10.071137] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-17T21:43:10.100384] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-17T21:43:10.142272] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-17T21:43:10.942326] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-17T21:43:11.742330] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-17T21:43:12.205910] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-17T21:43:12.257377] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-17T21:43:12.500115] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T21:43:12.505711] [INFO ] [REMOTE ] STEM: Full fetch complete (61219 records). [2025-10-17T21:43:12.505828] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-17T21:43:12.547420] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-17T21:43:12.939194] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-17T21:43:12.939343] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-17T21:43:12.940495] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-17T21:43:12.940564] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-17T21:43:12.941934] [DEBUG] [LOCAL ] STEM: Trimmed 61219 records to 39412 (keeping 200 days of data) [2025-10-17T21:43:13.175485] [DEBUG] [LOCAL ] STEM: Primary data saved (39412 records). [2025-10-17T21:43:13.175632] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-17T21:43:13.175765] [INFO ] [MAIN ] Update Progress: 2004/2368 symbols completed. STEM took 49.2s. Estimated remaining: 51m 26s. Rate: 7.1 symbols/min [2025-10-17T21:43:13.349471] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:43:13.347540] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-17T21:43:13.401298] [DEBUG] [LOCAL ] STM: Loaded 53962 existing records from primary storage. [2025-10-17T21:43:13.401664] [INFO ] [MAIN ] STM: Loaded 53962 existing records. [2025-10-17T21:43:13.596129] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:43:13.603768] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-17T21:43:13.603692] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-17T21:43:13.603921] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-17T21:43:13.607263] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-17T21:43:13.607327] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-17T21:43:13.911709] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-17T21:43:14.006190] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:43:14.142382] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-10-17T21:43:14.942346] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-17T21:43:15.742323] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-17T21:43:16.158298] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-17T21:43:16.159121] [INFO ] [REMOTE ] STG: Full fetch complete (2503 records). [2025-10-17T21:43:16.159191] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-17T21:43:16.352364] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-17T21:43:16.352855] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-17T21:43:16.363099] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-17T21:43:16.370395] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-17T21:43:16.370540] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-17T21:43:16.380958] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-17T21:43:16.381131] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-17T21:43:16.381270] [INFO ] [MAIN ] Update Progress: 2005/2368 symbols completed. STG took 29.1s. Estimated remaining: 51m 16s. Rate: 7.1 symbols/min [2025-10-17T21:43:16.415007] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-17T21:43:16.560320] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-17T21:43:16.564165] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:43:16.590540] [DEBUG] [LOCAL ] STN: Loaded 22966 existing records from primary storage. [2025-10-17T21:43:16.590804] [INFO ] [MAIN ] STN: Loaded 22966 existing records. [2025-10-17T21:43:16.767054] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:43:16.767261] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-17T21:43:16.767308] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-17T21:43:16.767489] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-17T21:43:16.767528] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-17T21:43:17.167916] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:43:17.170185] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-17T21:43:17.342248] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-10-17T21:43:18.142255] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-17T21:43:18.327999] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T21:43:18.507833] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-17T21:43:18.942309] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-17T21:43:18.955236] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T21:43:18.958198] [INFO ] [REMOTE ] STK: Full fetch complete (14323 records). [2025-10-17T21:43:18.958306] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-17T21:43:19.316789] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-17T21:43:19.316871] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-17T21:43:19.317202] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-17T21:43:19.317265] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-17T21:43:19.317794] [DEBUG] [LOCAL ] STK: Trimmed 14323 records to 9914 (keeping 200 days of data) [2025-10-17T21:43:19.376397] [DEBUG] [LOCAL ] STK: Primary data saved (9914 records). [2025-10-17T21:43:19.376512] [INFO ] [MAIN ] STK: Full history saved. [2025-10-17T21:43:19.376592] [INFO ] [MAIN ] Update Progress: 2006/2368 symbols completed. STK took 29.3s. Estimated remaining: 51m 7s. Rate: 7.1 symbols/min [2025-10-17T21:43:19.543598] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:43:19.584281] [DEBUG] [LOCAL ] STNG: Loaded 43907 existing records from primary storage. [2025-10-17T21:43:19.584587] [INFO ] [MAIN ] STNG: Loaded 43907 existing records. [2025-10-17T21:43:19.748413] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-17T21:43:19.762168] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:43:19.763072] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-17T21:43:19.763148] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-17T21:43:19.763353] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-17T21:43:19.763404] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-17T21:43:20.114061] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:43:20.542296] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-10-17T21:43:21.194049] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-17T21:43:21.342259] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-17T21:43:21.795823] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-17T21:43:22.147709] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-17T21:43:22.158680] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T21:43:22.942311] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-17T21:43:23.298796] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T21:43:23.749307] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-17T21:43:23.755966] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-17T21:43:24.542314] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-17T21:43:24.569561] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T21:43:24.740876] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-17T21:43:25.342298] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-17T21:43:26.142272] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-17T21:43:26.725075] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-17T21:43:26.942400] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-17T21:43:27.430917] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-17T21:43:27.649248] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T21:43:27.742336] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-17T21:43:28.542273] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-17T21:43:29.044411] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-17T21:43:29.342299] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-17T21:43:29.897877] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-17T21:43:29.992415] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-17T21:43:30.142294] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-17T21:43:30.942332] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-17T21:43:31.742289] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-17T21:43:31.926427] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-17T21:43:32.403578] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T21:43:32.542320] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-17T21:43:32.708573] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-17T21:43:33.342312] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-17T21:43:33.971575] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-17T21:43:34.142294] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-17T21:43:34.253590] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T21:43:34.942290] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-17T21:43:35.639664] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-17T21:43:35.744498] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-17T21:43:35.747426] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T21:43:36.151890] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-17T21:43:36.542274] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-17T21:43:37.342281] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-17T21:43:37.829604] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-17T21:43:38.105232] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T21:43:38.142244] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-17T21:43:38.364413] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-17T21:43:38.942299] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-17T21:43:39.742267] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-17T21:43:39.805784] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T21:43:40.542277] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-17T21:43:40.970700] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-17T21:43:41.342259] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-17T21:43:41.657169] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T21:43:42.124931] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T21:43:42.142241] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-17T21:43:42.942308] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-17T21:43:43.231469] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-17T21:43:43.410129] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-17T21:43:43.742369] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-17T21:43:44.542325] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-17T21:43:45.342418] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-17T21:43:45.914152] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-10-17T21:43:46.142294] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-17T21:43:46.205797] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T21:43:46.230819] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T21:43:46.264007] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-17T21:43:46.271489] [INFO ] [REMOTE ] STLA: Full fetch complete (77655 records). [2025-10-17T21:43:46.271697] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-17T21:43:46.670618] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-17T21:43:46.670762] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-17T21:43:46.671961] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-17T21:43:46.672031] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-17T21:43:46.673521] [DEBUG] [LOCAL ] STLA: Trimmed 77655 records to 54335 (keeping 200 days of data) [2025-10-17T21:43:46.944595] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-17T21:43:46.998911] [DEBUG] [LOCAL ] STLA: Primary data saved (54335 records). [2025-10-17T21:43:46.999064] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-17T21:43:46.999152] [INFO ] [MAIN ] Update Progress: 2007/2368 symbols completed. STLA took 40.5s. Estimated remaining: 51m 2s. Rate: 7.1 symbols/min [2025-10-17T21:43:47.170714] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:43:47.184743] [DEBUG] [LOCAL ] STRV: Loaded 11224 existing records from primary storage. [2025-10-17T21:43:47.184985] [INFO ] [MAIN ] STRV: Loaded 11224 existing records. [2025-10-17T21:43:47.359880] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:43:47.360188] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-17T21:43:47.360249] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-17T21:43:47.360435] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-17T21:43:47.360496] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-17T21:43:47.737593] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:43:47.742242] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-10-17T21:43:48.123163] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T21:43:48.167068] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-17T21:43:48.175056] [INFO ] [REMOTE ] STM: Full fetch complete (77694 records). [2025-10-17T21:43:48.175186] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-17T21:43:48.544852] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-17T21:43:48.569331] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-17T21:43:48.570017] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-17T21:43:48.571363] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-17T21:43:48.571532] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-17T21:43:48.573066] [DEBUG] [LOCAL ] STM: Trimmed 77694 records to 54352 (keeping 200 days of data) [2025-10-17T21:43:48.805338] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-17T21:43:48.930147] [DEBUG] [LOCAL ] STM: Primary data saved (54352 records). [2025-10-17T21:43:48.930284] [INFO ] [MAIN ] STM: Full history saved. [2025-10-17T21:43:48.930366] [INFO ] [MAIN ] Update Progress: 2008/2368 symbols completed. STM took 35.8s. Estimated remaining: 50m 52s. Rate: 7.1 symbols/min [2025-10-17T21:43:49.095381] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:43:49.146441] [DEBUG] [LOCAL ] STT: Loaded 51424 existing records from primary storage. [2025-10-17T21:43:49.146788] [INFO ] [MAIN ] STT: Loaded 51424 existing records. [2025-10-17T21:43:49.320600] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:43:49.320883] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-17T21:43:49.320930] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-17T21:43:49.321127] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-10-17T21:43:49.321184] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-17T21:43:49.350601] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-17T21:43:49.603430] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-17T21:43:49.627576] [INFO ] [REMOTE ] STN: Full fetch complete (32604 records). [2025-10-17T21:43:49.655444] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-17T21:43:49.685414] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:43:50.047228] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-17T21:43:50.047308] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-17T21:43:50.048075] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-17T21:43:50.048137] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-17T21:43:50.048931] [DEBUG] [LOCAL ] STN: Trimmed 32604 records to 23104 (keeping 200 days of data) [2025-10-17T21:43:50.144817] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-17T21:43:50.194324] [DEBUG] [LOCAL ] STN: Primary data saved (23104 records). [2025-10-17T21:43:50.194454] [INFO ] [MAIN ] STN: Full history saved. [2025-10-17T21:43:50.194558] [INFO ] [MAIN ] Update Progress: 2009/2368 symbols completed. STN took 33.8s. Estimated remaining: 50m 43s. Rate: 7.1 symbols/min [2025-10-17T21:43:50.364276] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:43:50.364493] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-17T21:43:50.364538] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-17T21:43:50.364681] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-17T21:43:50.364735] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-17T21:43:50.364778] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-17T21:43:50.364830] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-17T21:43:50.551168] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-17T21:43:50.732462] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:43:50.942300] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-17T21:43:51.593820] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T21:43:51.600479] [INFO ] [REMOTE ] STNG: Full fetch complete (64344 records). [2025-10-17T21:43:51.600619] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-17T21:43:51.752353] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-10-17T21:43:51.844545] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-17T21:43:52.043537] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-17T21:43:52.043615] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-17T21:43:52.044864] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-17T21:43:52.044950] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-17T21:43:52.046372] [DEBUG] [LOCAL ] STNG: Trimmed 64344 records to 44277 (keeping 200 days of data) [2025-10-17T21:43:52.108254] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:43:52.145103] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-10-17T21:43:52.152674] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:43:52.152769] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-17T21:43:52.153334] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:43:52.159461] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-17T21:43:52.162817] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-17T21:43:52.163504] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-17T21:43:52.163910] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-17T21:43:52.164230] [INFO ] [MAIN ] Update Progress: 2010/2368 symbols completed. STUB took 2.0s. Estimated remaining: 50m 33s. Rate: 7.1 symbols/min [2025-10-17T21:43:52.356052] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:43:52.499839] [DEBUG] [LOCAL ] STVN: Loaded 26968 existing records from primary storage. [2025-10-17T21:43:52.501181] [INFO ] [MAIN ] STVN: Loaded 26968 existing records. [2025-10-17T21:43:52.544094] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-10-17T21:43:52.716031] [DEBUG] [LOCAL ] STNG: Primary data saved (44277 records). [2025-10-17T21:43:52.716287] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-17T21:43:52.715925] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:43:52.716507] [INFO ] [MAIN ] Update Progress: 2011/2368 symbols completed. STNG took 33.3s. Estimated remaining: 50m 23s. Rate: 7.1 symbols/min [2025-10-17T21:43:52.716705] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-17T21:43:52.716954] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-17T21:43:52.750792] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-17T21:43:52.784179] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-17T21:43:53.047371] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:43:53.255443] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:43:53.292047] [DEBUG] [LOCAL ] STWD: Loaded 52371 existing records from primary storage. [2025-10-17T21:43:53.292370] [INFO ] [MAIN ] STWD: Loaded 52371 existing records. [2025-10-17T21:43:53.353703] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-17T21:43:53.469356] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:43:53.469588] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-17T21:43:53.469637] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-17T21:43:53.469878] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-10-17T21:43:53.469935] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-17T21:43:53.853900] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:43:54.142345] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-10-17T21:43:54.322276] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T21:43:54.510163] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-17T21:43:54.942358] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-17T21:43:55.742291] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-10-17T21:43:55.822973] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T21:43:56.542277] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-17T21:43:57.342376] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-17T21:43:57.848160] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-17T21:43:57.990265] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (3.05 seconds). [2025-10-17T21:43:58.142311] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-17T21:43:58.547608] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-17T21:43:58.941369] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-17T21:43:58.952244] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-17T21:43:59.399365] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T21:43:59.742330] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-17T21:44:00.542367] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-17T21:44:01.015479] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-17T21:44:01.046272] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T21:44:01.342273] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-17T21:44:01.468049] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-17T21:44:02.142282] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-17T21:44:02.554585] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T21:44:02.942349] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-17T21:44:03.742281] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-17T21:44:03.788070] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T21:44:03.885581] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T21:44:04.542346] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-17T21:44:05.342360] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-17T21:44:05.421273] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T21:44:05.787729] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-17T21:44:06.129250] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T21:44:06.142243] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-17T21:44:06.936294] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-17T21:44:06.942241] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-17T21:44:07.707607] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T21:44:07.742268] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-17T21:44:08.476608] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T21:44:08.478530] [INFO ] [REMOTE ] STRV: Full fetch complete (17556 records). [2025-10-17T21:44:08.478600] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-17T21:44:08.552735] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-17T21:44:08.911715] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-17T21:44:08.911807] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-17T21:44:08.912294] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-17T21:44:08.912334] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-17T21:44:08.912959] [DEBUG] [LOCAL ] STRV: Trimmed 17556 records to 11268 (keeping 200 days of data) [2025-10-17T21:44:08.984303] [DEBUG] [LOCAL ] STRV: Primary data saved (11268 records). [2025-10-17T21:44:08.984439] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-17T21:44:08.984521] [INFO ] [MAIN ] Update Progress: 2012/2368 symbols completed. STRV took 22.0s. Estimated remaining: 50m 16s. Rate: 7.1 symbols/min [2025-10-17T21:44:09.148308] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:44:09.151856] [DEBUG] [LOCAL ] STXD: Loaded 1253 existing records from primary storage. [2025-10-17T21:44:09.151991] [INFO ] [MAIN ] STXD: Loaded 1253 existing records. [2025-10-17T21:44:09.322632] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:44:09.322847] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-17T21:44:09.322896] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-17T21:44:09.323011] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-17T21:44:09.323049] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-17T21:44:09.352327] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-17T21:44:09.670397] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:44:10.142263] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-17T21:44:10.457121] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T21:44:10.942324] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-17T21:44:11.258941] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T21:44:11.312330] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T21:44:11.742346] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-17T21:44:12.552533] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-17T21:44:12.555884] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T21:44:12.596806] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T21:44:13.342333] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-10-17T21:44:13.772748] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-17T21:44:14.142296] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-17T21:44:14.388540] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T21:44:14.920569] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-17T21:44:14.942254] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-17T21:44:15.742287] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-17T21:44:16.173294] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-17T21:44:16.542331] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-17T21:44:17.342286] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-17T21:44:17.571212] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T21:44:17.775739] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-17T21:44:18.142296] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-17T21:44:18.295458] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T21:44:18.573960] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-17T21:44:18.942366] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-17T21:44:19.742424] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-17T21:44:20.016166] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T21:44:20.542394] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-17T21:44:20.979302] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-17T21:44:21.342315] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-17T21:44:21.560008] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-17T21:44:21.800497] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-17T21:44:22.142331] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-17T21:44:22.942292] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-17T21:44:23.248811] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T21:44:23.253686] [INFO ] [REMOTE ] STVN: Full fetch complete (39372 records). [2025-10-17T21:44:23.253899] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-17T21:44:23.417288] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-17T21:44:23.688762] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-17T21:44:23.688893] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-17T21:44:23.690836] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-17T21:44:23.690914] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-17T21:44:23.692836] [DEBUG] [LOCAL ] STVN: Trimmed 39372 records to 27140 (keeping 200 days of data) [2025-10-17T21:44:23.745564] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-17T21:44:23.911446] [DEBUG] [LOCAL ] STVN: Primary data saved (27140 records). [2025-10-17T21:44:23.911684] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-17T21:44:23.911811] [INFO ] [MAIN ] Update Progress: 2013/2368 symbols completed. STVN took 31.7s. Estimated remaining: 50m 9s. Rate: 7.1 symbols/min [2025-10-17T21:44:24.099366] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:44:24.104931] [DEBUG] [LOCAL ] STXE: Loaded 2117 existing records from primary storage. [2025-10-17T21:44:24.105138] [INFO ] [MAIN ] STXE: Loaded 2117 existing records. [2025-10-17T21:44:24.189602] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-17T21:44:24.318404] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:44:24.319205] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-17T21:44:24.319265] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-17T21:44:24.319534] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-17T21:44:24.319593] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-17T21:44:24.547483] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-17T21:44:24.708098] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:44:25.342357] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-17T21:44:26.142389] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-17T21:44:26.463227] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-17T21:44:26.491604] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-17T21:44:26.787182] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T21:44:26.942305] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-17T21:44:27.742345] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-17T21:44:28.268035] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-17T21:44:28.542305] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-17T21:44:28.622871] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T21:44:29.050204] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-17T21:44:29.342309] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-17T21:44:29.795039] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-17T21:44:29.795814] [INFO ] [REMOTE ] STXD: Full fetch complete (2047 records). [2025-10-17T21:44:29.795882] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-17T21:44:30.139558] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-17T21:44:30.139626] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-17T21:44:30.139740] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-17T21:44:30.139790] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-17T21:44:30.140123] [DEBUG] [LOCAL ] STXD: Trimmed 2047 records to 1262 (keeping 200 days of data) [2025-10-17T21:44:30.146401] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-17T21:44:30.149759] [DEBUG] [LOCAL ] STXD: Primary data saved (1262 records). [2025-10-17T21:44:30.149877] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-17T21:44:30.149955] [INFO ] [MAIN ] Update Progress: 2014/2368 symbols completed. STXD took 21.2s. Estimated remaining: 49m 60s. Rate: 7.1 symbols/min [2025-10-17T21:44:30.314610] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:44:30.319317] [DEBUG] [LOCAL ] STXG: Loaded 2433 existing records from primary storage. [2025-10-17T21:44:30.319464] [INFO ] [MAIN ] STXG: Loaded 2433 existing records. [2025-10-17T21:44:30.489945] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:44:30.490112] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-17T21:44:30.490160] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-17T21:44:30.490280] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-17T21:44:30.490318] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-17T21:44:30.835537] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:44:30.942340] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-10-17T21:44:31.573195] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-17T21:44:31.742296] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-17T21:44:32.059152] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-17T21:44:32.208639] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-17T21:44:32.542332] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-17T21:44:33.017145] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-17T21:44:33.342336] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-17T21:44:34.142277] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-17T21:44:34.707506] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-17T21:44:34.942289] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-17T21:44:35.261535] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T21:44:35.494933] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-17T21:44:35.742267] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-10-17T21:44:36.319354] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-17T21:44:36.542286] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-17T21:44:37.342300] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-17T21:44:38.011797] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-17T21:44:38.139862] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-17T21:44:38.142444] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-17T21:44:38.148473] [INFO ] [REMOTE ] STWD: Full fetch complete (75368 records). [2025-10-17T21:44:38.148563] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-17T21:44:38.545446] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-17T21:44:38.545775] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-17T21:44:38.546970] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-17T21:44:38.547034] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-17T21:44:38.548450] [DEBUG] [LOCAL ] STWD: Trimmed 75368 records to 52750 (keeping 200 days of data) [2025-10-17T21:44:38.768390] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T21:44:38.882378] [DEBUG] [LOCAL ] STWD: Primary data saved (52750 records). [2025-10-17T21:44:38.882524] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-17T21:44:38.882606] [INFO ] [MAIN ] Update Progress: 2015/2368 symbols completed. STWD took 46.2s. Estimated remaining: 49m 51s. Rate: 7.1 symbols/min [2025-10-17T21:44:38.947501] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-17T21:44:39.053101] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:44:39.057155] [DEBUG] [LOCAL ] STXK: Loaded 1535 existing records from primary storage. [2025-10-17T21:44:39.057344] [INFO ] [MAIN ] STXK: Loaded 1535 existing records. [2025-10-17T21:44:39.234386] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:44:39.234597] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-17T21:44:39.234666] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-17T21:44:39.234866] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-17T21:44:39.234922] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-17T21:44:39.580304] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:44:39.588515] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-17T21:44:39.742235] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-17T21:44:40.171634] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-17T21:44:40.542333] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-17T21:44:41.197684] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-17T21:44:41.342419] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-17T21:44:41.799482] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-17T21:44:42.142344] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-17T21:44:42.942347] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-10-17T21:44:43.386019] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-17T21:44:43.742277] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-17T21:44:43.850233] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T21:44:44.179619] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-17T21:44:44.542312] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-17T21:44:45.047846] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-17T21:44:45.342364] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-17T21:44:46.142391] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-17T21:44:46.166087] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T21:44:46.173250] [INFO ] [REMOTE ] STT: Full fetch complete (74473 records). [2025-10-17T21:44:46.173407] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-17T21:44:46.560756] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-17T21:44:46.560833] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-17T21:44:46.561954] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-17T21:44:46.562018] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-17T21:44:46.563434] [DEBUG] [LOCAL ] STT: Trimmed 74473 records to 51813 (keeping 200 days of data) [2025-10-17T21:44:46.631837] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-17T21:44:46.897400] [DEBUG] [LOCAL ] STT: Primary data saved (51813 records). [2025-10-17T21:44:46.897536] [INFO ] [MAIN ] STT: Full history saved. [2025-10-17T21:44:46.897613] [INFO ] [MAIN ] Update Progress: 2016/2368 symbols completed. STT took 58.0s. Estimated remaining: 49m 43s. Rate: 7.1 symbols/min [2025-10-17T21:44:46.950140] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-17T21:44:47.069340] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:44:47.069466] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-17T21:44:47.069503] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-17T21:44:47.069834] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-17T21:44:47.069890] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-17T21:44:47.069933] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-17T21:44:47.069964] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-17T21:44:47.419120] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:44:47.421935] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-17T21:44:47.742308] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-17T21:44:48.170100] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-17T21:44:48.542314] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-17T21:44:49.011204] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-17T21:44:49.342317] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-17T21:44:49.778429] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-17T21:44:50.142363] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-17T21:44:50.585575] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-17T21:44:50.942327] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-10-17T21:44:51.287935] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-17T21:44:51.742374] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-17T21:44:52.194537] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-17T21:44:52.542349] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-17T21:44:53.006196] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-17T21:44:53.007099] [INFO ] [REMOTE ] STXG: Full fetch complete (4076 records). [2025-10-17T21:44:53.007170] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-17T21:44:53.347237] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-17T21:44:53.373892] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-17T21:44:53.373983] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-17T21:44:53.374141] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-17T21:44:53.374181] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-17T21:44:53.374610] [DEBUG] [LOCAL ] STXG: Trimmed 4076 records to 2452 (keeping 200 days of data) [2025-10-17T21:44:53.391219] [DEBUG] [LOCAL ] STXG: Primary data saved (2452 records). [2025-10-17T21:44:53.391292] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-17T21:44:53.391366] [INFO ] [MAIN ] Update Progress: 2017/2368 symbols completed. STXG took 23.2s. Estimated remaining: 49m 34s. Rate: 7.1 symbols/min [2025-10-17T21:44:53.573221] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:44:53.578768] [DEBUG] [LOCAL ] STXT: Loaded 2516 existing records from primary storage. [2025-10-17T21:44:53.579022] [INFO ] [MAIN ] STXT: Loaded 2516 existing records. [2025-10-17T21:44:53.775850] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:44:53.776076] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-17T21:44:53.776125] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-17T21:44:53.776252] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-17T21:44:53.776316] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-17T21:44:53.895387] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-17T21:44:54.147569] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-17T21:44:54.176480] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:44:54.503336] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-17T21:44:54.942323] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-17T21:44:55.381491] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-17T21:44:55.742313] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-17T21:44:56.347950] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-17T21:44:56.542305] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-17T21:44:56.994341] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-17T21:44:57.342351] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-17T21:44:57.752511] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-17T21:44:58.142357] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-17T21:44:58.481823] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-17T21:44:58.942319] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-17T21:44:59.405859] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-17T21:44:59.742395] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-10-17T21:45:00.301502] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-17T21:45:00.542283] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-17T21:45:01.257021] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-17T21:45:01.342253] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-17T21:45:01.684829] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-17T21:45:02.142343] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-17T21:45:02.502183] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-17T21:45:02.942266] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-17T21:45:03.232130] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-17T21:45:03.742339] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-17T21:45:04.107935] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-17T21:45:04.542313] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-17T21:45:05.021349] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-17T21:45:05.342328] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-17T21:45:05.848182] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-17T21:45:05.849125] [INFO ] [REMOTE ] STXE: Full fetch complete (3508 records). [2025-10-17T21:45:05.849258] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-17T21:45:06.147526] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-17T21:45:06.215274] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-17T21:45:06.215362] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-17T21:45:06.215495] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-17T21:45:06.215544] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-17T21:45:06.216041] [DEBUG] [LOCAL ] STXE: Trimmed 3508 records to 2136 (keeping 200 days of data) [2025-10-17T21:45:06.230782] [DEBUG] [LOCAL ] STXE: Primary data saved (2136 records). [2025-10-17T21:45:06.230893] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-17T21:45:06.230995] [INFO ] [MAIN ] Update Progress: 2018/2368 symbols completed. STXE took 42.3s. Estimated remaining: 49m 26s. Rate: 7.1 symbols/min [2025-10-17T21:45:06.399315] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:45:06.403775] [DEBUG] [LOCAL ] STXV: Loaded 1531 existing records from primary storage. [2025-10-17T21:45:06.403926] [INFO ] [MAIN ] STXV: Loaded 1531 existing records. [2025-10-17T21:45:06.582794] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-17T21:45:06.587528] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:45:06.589415] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-17T21:45:06.589498] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-17T21:45:06.589703] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-17T21:45:06.589772] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-17T21:45:06.947376] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-17T21:45:06.954159] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:45:07.444269] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-17T21:45:07.742304] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-17T21:45:08.202733] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-17T21:45:08.542297] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-17T21:45:09.052113] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-17T21:45:09.342299] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-17T21:45:09.689045] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-17T21:45:09.689810] [INFO ] [REMOTE ] STXM: Full fetch complete (1408 records). [2025-10-17T21:45:09.689879] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-17T21:45:09.863266] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-17T21:45:09.863475] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-17T21:45:09.863541] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-17T21:45:09.863590] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-17T21:45:09.863669] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-17T21:45:09.863726] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-17T21:45:09.863770] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-17T21:45:09.863839] [INFO ] [MAIN ] Update Progress: 2019/2368 symbols completed. STXM took 23.0s. Estimated remaining: 49m 17s. Rate: 7.1 symbols/min [2025-10-17T21:45:10.037238] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:45:10.097105] [DEBUG] [LOCAL ] STZ: Loaded 52801 existing records from primary storage. [2025-10-17T21:45:10.097527] [INFO ] [MAIN ] STZ: Loaded 52801 existing records. [2025-10-17T21:45:10.147553] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-10-17T21:45:10.301357] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:45:10.301575] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-17T21:45:10.301623] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-17T21:45:10.301884] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-10-17T21:45:10.301942] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-17T21:45:10.685756] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-17T21:45:10.708853] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:45:10.942310] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-10-17T21:45:11.742351] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-17T21:45:12.271982] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-17T21:45:12.542386] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-17T21:45:12.759395] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T21:45:13.150539] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-17T21:45:13.342319] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-17T21:45:13.783783] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-17T21:45:14.142366] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-17T21:45:14.509373] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-17T21:45:14.942287] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-17T21:45:15.417212] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-17T21:45:15.418141] [INFO ] [REMOTE ] STXK: Full fetch complete (2429 records). [2025-10-17T21:45:15.418209] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-17T21:45:15.742498] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-17T21:45:15.822568] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-17T21:45:15.822675] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-17T21:45:15.822804] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-17T21:45:15.822846] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-17T21:45:15.823172] [DEBUG] [LOCAL ] STXK: Trimmed 2429 records to 1548 (keeping 200 days of data) [2025-10-17T21:45:15.833764] [DEBUG] [LOCAL ] STXK: Primary data saved (1548 records). [2025-10-17T21:45:15.833829] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-17T21:45:15.833902] [INFO ] [MAIN ] Update Progress: 2020/2368 symbols completed. STXK took 37.0s. Estimated remaining: 49m 8s. Rate: 7.1 symbols/min [2025-10-17T21:45:15.998270] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:45:16.053786] [DEBUG] [LOCAL ] SU: Loaded 53816 existing records from primary storage. [2025-10-17T21:45:16.054114] [INFO ] [MAIN ] SU: Loaded 53816 existing records. [2025-10-17T21:45:16.228807] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:45:16.229028] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-17T21:45:16.229076] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-17T21:45:16.229275] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-17T21:45:16.229332] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-17T21:45:16.325772] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-17T21:45:16.550737] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-17T21:45:16.592260] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:45:17.042753] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T21:45:17.342331] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-17T21:45:17.824465] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-17T21:45:18.142327] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-17T21:45:18.670839] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-17T21:45:18.942313] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-17T21:45:19.417552] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-17T21:45:19.742392] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-17T21:45:20.242599] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-17T21:45:20.542298] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-10-17T21:45:21.342318] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-17T21:45:21.682420] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-17T21:45:22.142317] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-17T21:45:22.323052] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T21:45:22.698827] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-17T21:45:22.942289] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-17T21:45:23.361030] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-17T21:45:23.742303] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-17T21:45:24.542300] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-17T21:45:24.970839] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-17T21:45:25.342262] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-17T21:45:25.707702] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-17T21:45:25.799108] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-17T21:45:26.142317] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-17T21:45:26.658621] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-17T21:45:26.942350] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-17T21:45:27.404496] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-17T21:45:27.405767] [INFO ] [REMOTE ] STXT: Full fetch complete (3892 records). [2025-10-17T21:45:27.405875] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-17T21:45:27.752427] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-17T21:45:27.798540] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-17T21:45:27.798677] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-17T21:45:27.798956] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-17T21:45:27.799023] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-17T21:45:27.799428] [DEBUG] [LOCAL ] STXT: Trimmed 3892 records to 2537 (keeping 200 days of data) [2025-10-17T21:45:27.817280] [DEBUG] [LOCAL ] STXT: Primary data saved (2537 records). [2025-10-17T21:45:27.817578] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-17T21:45:27.817736] [INFO ] [MAIN ] Update Progress: 2021/2368 symbols completed. STXT took 34.4s. Estimated remaining: 49m 0s. Rate: 7.1 symbols/min [2025-10-17T21:45:27.992256] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:45:28.045522] [DEBUG] [LOCAL ] SUI: Loaded 42398 existing records from primary storage. [2025-10-17T21:45:28.045955] [INFO ] [MAIN ] SUI: Loaded 42398 existing records. [2025-10-17T21:45:28.238624] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:45:28.239043] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-17T21:45:28.239129] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-17T21:45:28.239752] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-17T21:45:28.239823] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-17T21:45:28.547519] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-17T21:45:28.631555] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:45:29.006018] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-17T21:45:29.342281] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-17T21:45:29.692368] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-17T21:45:29.693152] [INFO ] [REMOTE ] STXV: Full fetch complete (2528 records). [2025-10-17T21:45:29.693220] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-17T21:45:30.072453] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-17T21:45:30.072786] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-17T21:45:30.073146] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-17T21:45:30.083819] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-17T21:45:30.102142] [DEBUG] [LOCAL ] STXV: Trimmed 2528 records to 1542 (keeping 200 days of data) [2025-10-17T21:45:30.120702] [DEBUG] [LOCAL ] STXV: Primary data saved (1542 records). [2025-10-17T21:45:30.120831] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-17T21:45:30.120572] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-17T21:45:30.120976] [INFO ] [MAIN ] Update Progress: 2022/2368 symbols completed. STXV took 23.9s. Estimated remaining: 48m 51s. Rate: 7.1 symbols/min [2025-10-17T21:45:30.147394] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-10-17T21:45:30.308564] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:45:30.352729] [DEBUG] [LOCAL ] SUN: Loaded 38717 existing records from primary storage. [2025-10-17T21:45:30.353188] [INFO ] [MAIN ] SUN: Loaded 38717 existing records. [2025-10-17T21:45:30.528881] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:45:30.529175] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-17T21:45:30.529223] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-17T21:45:30.529472] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-17T21:45:30.529529] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-17T21:45:30.891822] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:45:30.942296] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-17T21:45:31.742309] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-17T21:45:31.791620] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T21:45:32.542285] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-17T21:45:32.934417] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T21:45:33.117942] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T21:45:33.342288] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-10-17T21:45:34.142299] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-17T21:45:34.202847] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T21:45:34.424545] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T21:45:34.942293] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-17T21:45:35.742361] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-17T21:45:35.934485] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T21:45:36.483787] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T21:45:36.542282] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-17T21:45:36.826722] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T21:45:37.342345] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-17T21:45:38.142287] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-17T21:45:38.515486] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T21:45:38.859918] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T21:45:38.942306] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-17T21:45:39.742323] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-17T21:45:39.965538] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-17T21:45:40.542297] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-17T21:45:40.662832] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T21:45:40.751883] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-17T21:45:41.342342] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-17T21:45:42.142365] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-17T21:45:42.509874] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T21:45:42.942307] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-17T21:45:43.158509] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T21:45:43.745904] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-17T21:45:43.750871] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T21:45:44.542287] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-17T21:45:45.125754] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-17T21:45:45.342302] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-17T21:45:45.542005] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-17T21:45:46.119045] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T21:45:46.142290] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-17T21:45:46.942317] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-17T21:45:47.411863] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-17T21:45:47.742387] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-17T21:45:47.826592] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T21:45:48.387063] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T21:45:48.542281] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-17T21:45:49.342325] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-17T21:45:49.620046] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T21:45:50.084939] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T21:45:50.142250] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-17T21:45:50.324769] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-17T21:45:50.942306] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-17T21:45:51.748147] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-17T21:45:51.759410] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T21:45:52.542327] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-17T21:45:52.911063] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-17T21:45:53.342408] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-17T21:45:53.528771] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T21:45:53.575695] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-17T21:45:53.581835] [INFO ] [REMOTE ] SUI: Full fetch complete (61010 records). [2025-10-17T21:45:53.581978] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-17T21:45:53.965355] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-17T21:45:53.965446] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-17T21:45:53.966532] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-17T21:45:53.966604] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-17T21:45:53.968190] [DEBUG] [LOCAL ] SUI: Trimmed 61010 records to 42659 (keeping 200 days of data) [2025-10-17T21:45:54.148048] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-17T21:45:54.241307] [DEBUG] [LOCAL ] SUI: Primary data saved (42659 records). [2025-10-17T21:45:54.241449] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-17T21:45:54.241531] [INFO ] [MAIN ] Update Progress: 2023/2368 symbols completed. SUI took 26.4s. Estimated remaining: 48m 45s. Rate: 7.1 symbols/min [2025-10-17T21:45:54.437015] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:45:54.483184] [DEBUG] [LOCAL ] SUPV: Loaded 48253 existing records from primary storage. [2025-10-17T21:45:54.483502] [INFO ] [MAIN ] SUPV: Loaded 48253 existing records. [2025-10-17T21:45:54.659103] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:45:54.659345] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-17T21:45:54.659404] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-17T21:45:54.659598] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-17T21:45:54.659689] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-17T21:45:54.947375] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-17T21:45:55.010931] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:45:55.395011] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T21:45:55.650351] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T21:45:55.742270] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-10-17T21:45:56.542290] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-17T21:45:56.795925] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T21:45:57.342262] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-17T21:45:57.428300] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T21:45:58.142334] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-17T21:45:58.462632] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T21:45:58.576479] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-17T21:45:58.584390] [INFO ] [REMOTE ] STZ: Full fetch complete (76165 records). [2025-10-17T21:45:58.584523] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-17T21:45:58.956513] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-17T21:45:59.025257] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-17T21:45:59.025356] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-17T21:45:59.026843] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-17T21:45:59.026922] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-17T21:45:59.028620] [DEBUG] [LOCAL ] STZ: Trimmed 76165 records to 53184 (keeping 200 days of data) [2025-10-17T21:45:59.382628] [DEBUG] [LOCAL ] STZ: Primary data saved (53184 records). [2025-10-17T21:45:59.382801] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-17T21:45:59.382902] [INFO ] [MAIN ] Update Progress: 2024/2368 symbols completed. STZ took 49.5s. Estimated remaining: 48m 36s. Rate: 7.1 symbols/min [2025-10-17T21:45:59.572567] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:45:59.617921] [DEBUG] [LOCAL ] SUZ: Loaded 46035 existing records from primary storage. [2025-10-17T21:45:59.618279] [INFO ] [MAIN ] SUZ: Loaded 46035 existing records. [2025-10-17T21:45:59.744036] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-17T21:45:59.820550] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:45:59.821365] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-17T21:45:59.821510] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-17T21:45:59.821804] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-17T21:45:59.821985] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-17T21:46:00.003495] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T21:46:00.253609] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:46:00.542280] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-10-17T21:46:00.934934] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-17T21:46:01.342298] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-17T21:46:01.637016] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T21:46:02.142255] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-17T21:46:02.330830] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T21:46:02.942283] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-17T21:46:02.965946] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T21:46:03.683295] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T21:46:03.742268] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-17T21:46:04.542292] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-17T21:46:04.619097] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-17T21:46:05.149855] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T21:46:05.342290] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-17T21:46:06.051025] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T21:46:06.142314] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-17T21:46:06.919759] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T21:46:06.942265] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-17T21:46:07.742361] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-17T21:46:07.847949] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T21:46:07.855244] [INFO ] [REMOTE ] SU: Full fetch complete (77564 records). [2025-10-17T21:46:07.855395] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-17T21:46:08.253580] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-17T21:46:08.253715] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-17T21:46:08.255142] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-17T21:46:08.255209] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-17T21:46:08.256802] [DEBUG] [LOCAL ] SU: Trimmed 77564 records to 54206 (keeping 200 days of data) [2025-10-17T21:46:08.546731] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-17T21:46:08.598529] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T21:46:08.630413] [DEBUG] [LOCAL ] SU: Primary data saved (54206 records). [2025-10-17T21:46:08.630557] [INFO ] [MAIN ] SU: Full history saved. [2025-10-17T21:46:08.630663] [INFO ] [MAIN ] Update Progress: 2025/2368 symbols completed. SU took 52.8s. Estimated remaining: 48m 27s. Rate: 7.1 symbols/min [2025-10-17T21:46:08.794844] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:46:08.837174] [DEBUG] [LOCAL ] SVV: Loaded 40548 existing records from primary storage. [2025-10-17T21:46:08.837472] [INFO ] [MAIN ] SVV: Loaded 40548 existing records. [2025-10-17T21:46:09.016301] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:46:09.016591] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-17T21:46:09.016833] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-17T21:46:09.017153] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-17T21:46:09.017210] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-17T21:46:09.349853] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-17T21:46:09.400927] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:46:09.432262] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T21:46:10.142353] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-17T21:46:10.193164] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T21:46:10.199245] [INFO ] [REMOTE ] SUN: Full fetch complete (55383 records). [2025-10-17T21:46:10.199374] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-17T21:46:10.577626] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-17T21:46:10.577732] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-17T21:46:10.579027] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-17T21:46:10.579095] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-17T21:46:10.580339] [DEBUG] [LOCAL ] SUN: Trimmed 55383 records to 39035 (keeping 200 days of data) [2025-10-17T21:46:10.812567] [DEBUG] [LOCAL ] SUN: Primary data saved (39035 records). [2025-10-17T21:46:10.812722] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-17T21:46:10.813268] [INFO ] [MAIN ] Update Progress: 2026/2368 symbols completed. SUN took 40.7s. Estimated remaining: 48m 18s. Rate: 7.1 symbols/min [2025-10-17T21:46:10.956496] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-10-17T21:46:10.990635] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:46:11.020675] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T21:46:11.075754] [DEBUG] [LOCAL ] SW: Loaded 53577 existing records from primary storage. [2025-10-17T21:46:11.076075] [INFO ] [MAIN ] SW: Loaded 53577 existing records. [2025-10-17T21:46:11.251450] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:46:11.251634] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-17T21:46:11.251713] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-17T21:46:11.251893] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-17T21:46:11.251931] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-17T21:46:11.609931] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:46:11.754052] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-17T21:46:11.760633] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T21:46:12.357759] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T21:46:12.542284] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-17T21:46:13.342297] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-17T21:46:13.389290] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T21:46:14.147433] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-17T21:46:14.161872] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T21:46:14.685276] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T21:46:14.942326] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-17T21:46:15.723766] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T21:46:15.742262] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-17T21:46:16.217603] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-17T21:46:16.542291] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-17T21:46:16.951151] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-17T21:46:17.342379] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-10-17T21:46:17.889137] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-17T21:46:18.142291] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-17T21:46:18.942299] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-17T21:46:19.067929] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T21:46:19.622418] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T21:46:19.742287] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-17T21:46:20.542482] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-17T21:46:20.701840] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T21:46:21.239811] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T21:46:21.342355] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-17T21:46:22.142320] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-17T21:46:22.196402] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T21:46:22.852408] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T21:46:22.942254] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-17T21:46:23.695884] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-17T21:46:23.742289] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-17T21:46:24.285907] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-17T21:46:24.542263] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-17T21:46:25.342283] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-17T21:46:25.440626] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T21:46:25.947913] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T21:46:26.142288] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-17T21:46:26.877709] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T21:46:26.942256] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-17T21:46:27.742340] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-17T21:46:28.066317] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-17T21:46:28.464379] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-17T21:46:28.471576] [INFO ] [REMOTE ] SUZ: Full fetch complete (66784 records). [2025-10-17T21:46:28.471808] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-17T21:46:28.549615] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-17T21:46:28.932297] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-17T21:46:28.932433] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-17T21:46:28.934347] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-17T21:46:28.934526] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-17T21:46:28.936617] [DEBUG] [LOCAL ] SUZ: Trimmed 66784 records to 46367 (keeping 200 days of data) [2025-10-17T21:46:29.257346] [DEBUG] [LOCAL ] SUZ: Primary data saved (46367 records). [2025-10-17T21:46:29.257596] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-17T21:46:29.257797] [INFO ] [MAIN ] Update Progress: 2027/2368 symbols completed. SUZ took 29.9s. Estimated remaining: 48m 11s. Rate: 7.1 symbols/min [2025-10-17T21:46:29.347483] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-17T21:46:29.446295] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:46:29.511145] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T21:46:29.538275] [DEBUG] [LOCAL ] SWK: Loaded 52860 existing records from primary storage. [2025-10-17T21:46:29.538601] [INFO ] [MAIN ] SWK: Loaded 52860 existing records. [2025-10-17T21:46:29.717234] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:46:29.717404] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-17T21:46:29.717451] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-17T21:46:29.717680] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-17T21:46:29.717743] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-17T21:46:30.101205] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:46:30.125544] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T21:46:30.142248] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-10-17T21:46:30.942332] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-17T21:46:31.384406] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T21:46:31.742302] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-17T21:46:31.912834] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T21:46:32.196099] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-17T21:46:32.542305] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-17T21:46:33.342377] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-17T21:46:33.415369] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-17T21:46:33.422865] [INFO ] [REMOTE ] SUPV: Full fetch complete (68869 records). [2025-10-17T21:46:33.423031] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-17T21:46:33.831349] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-17T21:46:33.831430] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-17T21:46:33.832551] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-17T21:46:33.832616] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-17T21:46:33.834340] [DEBUG] [LOCAL ] SUPV: Trimmed 68869 records to 48638 (keeping 200 days of data) [2025-10-17T21:46:34.123360] [DEBUG] [LOCAL ] SUPV: Primary data saved (48638 records). [2025-10-17T21:46:34.123579] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-17T21:46:34.123847] [INFO ] [MAIN ] Update Progress: 2028/2368 symbols completed. SUPV took 39.9s. Estimated remaining: 48m 2s. Rate: 7.1 symbols/min [2025-10-17T21:46:34.147425] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-17T21:46:34.304253] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:46:34.346628] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T21:46:34.380193] [DEBUG] [LOCAL ] SWX: Loaded 31180 existing records from primary storage. [2025-10-17T21:46:34.380489] [INFO ] [MAIN ] SWX: Loaded 31180 existing records. [2025-10-17T21:46:34.557012] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:46:34.557244] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-17T21:46:34.557293] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-17T21:46:34.557492] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-17T21:46:34.557549] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-17T21:46:34.914962] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:46:34.931865] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T21:46:34.938312] [INFO ] [REMOTE ] SVV: Full fetch complete (57359 records). [2025-10-17T21:46:34.938459] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-17T21:46:34.950138] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-17T21:46:35.318697] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-17T21:46:35.319021] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-17T21:46:35.319944] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-17T21:46:35.320012] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-17T21:46:35.321119] [DEBUG] [LOCAL ] SVV: Trimmed 57359 records to 40914 (keeping 200 days of data) [2025-10-17T21:46:35.553170] [DEBUG] [LOCAL ] SVV: Primary data saved (40914 records). [2025-10-17T21:46:35.553287] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-17T21:46:35.553362] [INFO ] [MAIN ] Update Progress: 2029/2368 symbols completed. SVV took 26.9s. Estimated remaining: 47m 52s. Rate: 7.1 symbols/min [2025-10-17T21:46:35.720386] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:46:35.728377] [DEBUG] [LOCAL ] SWZ: Loaded 6131 existing records from primary storage. [2025-10-17T21:46:35.728539] [INFO ] [MAIN ] SWZ: Loaded 6131 existing records. [2025-10-17T21:46:35.764369] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-10-17T21:46:35.908845] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:46:35.909181] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-17T21:46:35.909304] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-17T21:46:35.909737] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-17T21:46:35.909799] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-17T21:46:36.293729] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-17T21:46:36.309563] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:46:36.542250] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-17T21:46:36.759302] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-17T21:46:36.815415] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T21:46:37.342318] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-17T21:46:38.142332] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-10-17T21:46:38.356874] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T21:46:38.595861] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T21:46:38.750904] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-17T21:46:38.942372] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-17T21:46:39.742336] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-17T21:46:40.171466] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T21:46:40.542352] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-17T21:46:41.342286] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-17T21:46:41.691027] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T21:46:41.889089] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T21:46:42.142336] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-17T21:46:42.744525] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T21:46:42.942356] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-17T21:46:43.149216] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T21:46:43.742343] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-17T21:46:44.023771] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-17T21:46:44.324924] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-17T21:46:44.542367] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-17T21:46:45.342359] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-17T21:46:45.967529] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-17T21:46:46.142269] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-17T21:46:46.309052] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T21:46:46.655178] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T21:46:46.942312] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-17T21:46:47.546887] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T21:46:47.742325] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-17T21:46:48.312766] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-17T21:46:48.542344] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-17T21:46:49.342302] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-17T21:46:50.142271] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-17T21:46:50.460299] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T21:46:50.773494] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T21:46:50.785317] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-17T21:46:50.942294] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-17T21:46:51.742282] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-17T21:46:52.291575] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-17T21:46:52.546779] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-17T21:46:52.549045] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-17T21:46:53.342303] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-17T21:46:53.443408] [DEBUG] [REMOTE ] SWZ: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-17T21:46:53.443779] [WARN ] [REMOTE ] SWZ: No data returned for month 2025-09 [2025-10-17T21:46:53.443869] [FATAL] [REMOTE ] SWZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:46:53.443950] [FATAL] [MAIN ] SWZ: Failed to fetch primary data. [2025-10-17T21:46:53.444010] [WARN ] [MAIN ] SWZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:46:53.444081] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-17T21:46:53.444144] [DEBUG] [LOCAL ] SWZ: No primary data file found to delete. [2025-10-17T21:46:53.444179] [INFO ] [LOCAL ] SWZ: Starting deletion of derivative data. [2025-10-17T21:46:53.444356] [DEBUG] [LOCAL ] SWZ: Deleted derivative data file. [2025-10-17T21:46:53.444438] [INFO ] [MAIN ] Update Progress: 2030/2368 symbols completed. SWZ took 17.9s. Estimated remaining: 47m 45s. Rate: 7.1 symbols/min [2025-10-17T21:46:53.607924] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:46:53.645152] [DEBUG] [LOCAL ] SXC: Loaded 41934 existing records from primary storage. [2025-10-17T21:46:53.645441] [INFO ] [MAIN ] SXC: Loaded 41934 existing records. [2025-10-17T21:46:53.821839] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:46:53.822047] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-17T21:46:53.822094] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-17T21:46:53.822282] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-17T21:46:53.822338] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-17T21:46:54.143336] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-17T21:46:54.186335] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:46:54.509398] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T21:46:54.942339] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-17T21:46:55.246202] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T21:46:55.742352] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-10-17T21:46:56.542299] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-17T21:46:56.851470] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T21:46:57.338151] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T21:46:57.347470] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-17T21:46:57.869569] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-17T21:46:58.010139] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-17T21:46:58.017708] [INFO ] [REMOTE ] SW: Full fetch complete (77089 records). [2025-10-17T21:46:58.017907] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-17T21:46:58.156262] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-17T21:46:58.402278] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-17T21:46:58.402364] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-17T21:46:58.403578] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-17T21:46:58.403667] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-17T21:46:58.405144] [DEBUG] [LOCAL ] SW: Trimmed 77089 records to 53965 (keeping 200 days of data) [2025-10-17T21:46:58.734680] [DEBUG] [LOCAL ] SW: Primary data saved (53965 records). [2025-10-17T21:46:58.734818] [INFO ] [MAIN ] SW: Full history saved. [2025-10-17T21:46:58.735452] [INFO ] [MAIN ] Update Progress: 2031/2368 symbols completed. SW took 47.9s. Estimated remaining: 47m 36s. Rate: 7.1 symbols/min [2025-10-17T21:46:58.901777] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:46:58.916689] [DEBUG] [LOCAL ] SXI: Loaded 12057 existing records from primary storage. [2025-10-17T21:46:58.916916] [INFO ] [MAIN ] SXI: Loaded 12057 existing records. [2025-10-17T21:46:58.947449] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-17T21:46:59.095196] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:46:59.095399] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-17T21:46:59.095446] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-17T21:46:59.095618] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-17T21:46:59.095709] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-17T21:46:59.446884] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:46:59.742372] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-17T21:47:00.211873] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-17T21:47:00.542274] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-10-17T21:47:00.656560] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T21:47:01.138906] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T21:47:01.253604] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-17T21:47:01.342252] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-17T21:47:02.142272] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-17T21:47:02.166877] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T21:47:02.942363] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-17T21:47:03.742282] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-17T21:47:03.772812] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-17T21:47:04.061448] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-17T21:47:04.542337] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-17T21:47:04.941764] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T21:47:05.342276] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-17T21:47:05.724597] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T21:47:05.729219] [INFO ] [REMOTE ] SWX: Full fetch complete (44017 records). [2025-10-17T21:47:05.729355] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-17T21:47:06.102263] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-17T21:47:06.102366] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-17T21:47:06.103239] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-17T21:47:06.103301] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-17T21:47:06.104271] [DEBUG] [LOCAL ] SWX: Trimmed 44017 records to 31339 (keeping 200 days of data) [2025-10-17T21:47:06.159986] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-17T21:47:06.299738] [DEBUG] [LOCAL ] SWX: Primary data saved (31339 records). [2025-10-17T21:47:06.299870] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-17T21:47:06.299961] [INFO ] [MAIN ] Update Progress: 2032/2368 symbols completed. SWX took 32.2s. Estimated remaining: 47m 28s. Rate: 7.1 symbols/min [2025-10-17T21:47:06.477981] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:47:06.509951] [DEBUG] [LOCAL ] SXT: Loaded 30053 existing records from primary storage. [2025-10-17T21:47:06.510257] [INFO ] [MAIN ] SXT: Loaded 30053 existing records. [2025-10-17T21:47:06.706882] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:47:06.707163] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-17T21:47:06.707219] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-17T21:47:06.707395] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-17T21:47:06.707445] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-17T21:47:06.948720] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-17T21:47:07.093857] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:47:07.146386] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T21:47:07.742265] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-10-17T21:47:07.771397] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T21:47:07.871158] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-17T21:47:08.542273] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-17T21:47:08.847354] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-17T21:47:09.342292] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-17T21:47:10.143069] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-17T21:47:10.145436] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-17T21:47:10.186355] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-17T21:47:10.942289] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-17T21:47:11.017682] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-17T21:47:11.742262] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-17T21:47:12.109917] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-17T21:47:12.542335] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-17T21:47:13.206986] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T21:47:13.342372] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-17T21:47:13.996597] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T21:47:14.004545] [INFO ] [REMOTE ] SWK: Full fetch complete (75536 records). [2025-10-17T21:47:14.004793] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-17T21:47:14.151630] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-17T21:47:14.282891] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-17T21:47:14.428741] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-17T21:47:14.428830] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-17T21:47:14.430032] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-17T21:47:14.430096] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-17T21:47:14.431600] [DEBUG] [LOCAL ] SWK: Trimmed 75536 records to 53219 (keeping 200 days of data) [2025-10-17T21:47:14.763897] [DEBUG] [LOCAL ] SWK: Primary data saved (53219 records). [2025-10-17T21:47:14.764067] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-17T21:47:14.764222] [INFO ] [MAIN ] Update Progress: 2033/2368 symbols completed. SWK took 45.5s. Estimated remaining: 47m 19s. Rate: 7.1 symbols/min [2025-10-17T21:47:14.928258] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:47:14.928435] [DEBUG] [LOCAL ] SYF: No existing data file found in primary storage. [2025-10-17T21:47:14.928473] [WARN ] [MAIN ] SYF: No existing data found, performing full refresh instead. [2025-10-17T21:47:14.928583] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-17T21:47:14.928636] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-17T21:47:14.928723] [DEBUG] [LOCAL ] SYF: No primary data file found to delete. [2025-10-17T21:47:14.928771] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-17T21:47:14.948695] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-17T21:47:15.274043] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:47:15.742301] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-10-17T21:47:15.904732] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T21:47:15.983382] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T21:47:16.542347] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-17T21:47:17.342382] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-17T21:47:17.394383] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T21:47:17.414395] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T21:47:18.142340] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-17T21:47:18.800254] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T21:47:18.942274] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-17T21:47:19.742363] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-17T21:47:19.927284] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T21:47:19.983837] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-17T21:47:20.542326] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-17T21:47:20.627720] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T21:47:21.342489] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-17T21:47:22.054463] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T21:47:22.142272] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-17T21:47:22.208542] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-17T21:47:22.942296] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-17T21:47:23.742281] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-17T21:47:23.868438] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T21:47:24.127497] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T21:47:24.348616] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T21:47:24.351554] [INFO ] [REMOTE ] SXI: Full fetch complete (15693 records). [2025-10-17T21:47:24.351661] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-17T21:47:24.550418] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-17T21:47:24.727922] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-17T21:47:24.728004] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-17T21:47:24.728387] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-17T21:47:24.728464] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-17T21:47:24.729298] [DEBUG] [LOCAL ] SXI: Trimmed 15693 records to 12191 (keeping 200 days of data) [2025-10-17T21:47:24.805782] [DEBUG] [LOCAL ] SXI: Primary data saved (12191 records). [2025-10-17T21:47:24.805929] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-17T21:47:24.806014] [INFO ] [MAIN ] Update Progress: 2034/2368 symbols completed. SXI took 26.1s. Estimated remaining: 47m 11s. Rate: 7.1 symbols/min [2025-10-17T21:47:24.974389] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:47:25.020180] [DEBUG] [LOCAL ] SYK: Loaded 47294 existing records from primary storage. [2025-10-17T21:47:25.020514] [INFO ] [MAIN ] SYK: Loaded 47294 existing records. [2025-10-17T21:47:25.204991] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:47:25.205245] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-17T21:47:25.205302] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-17T21:47:25.205476] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-17T21:47:25.205515] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-17T21:47:25.347625] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-17T21:47:25.572817] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:47:26.142272] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-10-17T21:47:26.419537] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T21:47:26.707995] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-17T21:47:26.942304] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-10-17T21:47:27.742291] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-17T21:47:27.867386] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T21:47:28.542334] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-17T21:47:28.786980] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T21:47:28.840562] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T21:47:28.846604] [INFO ] [REMOTE ] SXC: Full fetch complete (61027 records). [2025-10-17T21:47:28.846737] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-17T21:47:29.225397] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-17T21:47:29.225483] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-17T21:47:29.226575] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-17T21:47:29.226639] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-17T21:47:29.228211] [DEBUG] [LOCAL ] SXC: Trimmed 61027 records to 42228 (keeping 200 days of data) [2025-10-17T21:47:29.342883] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-17T21:47:29.474314] [DEBUG] [LOCAL ] SXC: Primary data saved (42228 records). [2025-10-17T21:47:29.474433] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-17T21:47:29.474521] [INFO ] [MAIN ] Update Progress: 2035/2368 symbols completed. SXC took 36.0s. Estimated remaining: 47m 2s. Rate: 7.1 symbols/min [2025-10-17T21:47:29.640821] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:47:29.690861] [DEBUG] [LOCAL ] SYY: Loaded 53602 existing records from primary storage. [2025-10-17T21:47:29.691217] [INFO ] [MAIN ] SYY: Loaded 53602 existing records. [2025-10-17T21:47:29.866704] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:47:29.866948] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-17T21:47:29.867018] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-17T21:47:29.867248] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-17T21:47:29.867303] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-17T21:47:30.143807] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-10-17T21:47:30.225697] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:47:30.317102] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T21:47:30.615115] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T21:47:30.942289] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-17T21:47:31.742356] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-10-17T21:47:32.044518] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-17T21:47:32.542283] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-17T21:47:32.631787] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T21:47:33.199739] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-17T21:47:33.342305] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-10-17T21:47:33.401496] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-17T21:47:34.142271] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-17T21:47:34.942419] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-17T21:47:35.035278] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T21:47:35.063395] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T21:47:35.742309] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-17T21:47:36.542292] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-17T21:47:36.790601] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T21:47:37.342266] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-10-17T21:47:37.586879] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-17T21:47:37.911599] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-17T21:47:38.142302] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-17T21:47:38.942252] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-17T21:47:39.103240] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T21:47:39.742350] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-10-17T21:47:39.785927] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T21:47:40.542295] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-17T21:47:40.894242] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T21:47:41.342325] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-17T21:47:41.515680] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T21:47:41.578307] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T21:47:42.142356] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-17T21:47:42.942384] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-17T21:47:42.983829] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T21:47:43.441196] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-17T21:47:43.742389] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-17T21:47:44.542390] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-10-17T21:47:44.774499] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T21:47:44.822055] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T21:47:44.826713] [INFO ] [REMOTE ] SXT: Full fetch complete (39550 records). [2025-10-17T21:47:44.826818] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-17T21:47:45.196965] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-17T21:47:45.197055] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-17T21:47:45.197917] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-17T21:47:45.197981] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-17T21:47:45.199048] [DEBUG] [LOCAL ] SXT: Trimmed 39550 records to 30246 (keeping 200 days of data) [2025-10-17T21:47:45.354069] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-17T21:47:45.393176] [DEBUG] [LOCAL ] SXT: Primary data saved (30246 records). [2025-10-17T21:47:45.393328] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-17T21:47:45.393423] [INFO ] [MAIN ] Update Progress: 2036/2368 symbols completed. SXT took 39.1s. Estimated remaining: 46m 55s. Rate: 7.1 symbols/min [2025-10-17T21:47:45.561079] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:47:45.612840] [DEBUG] [LOCAL ] T: Loaded 54188 existing records from primary storage. [2025-10-17T21:47:45.613199] [INFO ] [MAIN ] T: Loaded 54188 existing records. [2025-10-17T21:47:45.790382] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:47:45.790629] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-17T21:47:45.790711] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-17T21:47:45.790933] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-17T21:47:45.790989] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-17T21:47:46.142984] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-17T21:47:46.162899] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:47:46.284457] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T21:47:46.942355] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-10-17T21:47:47.371014] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-17T21:47:47.443076] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T21:47:47.742294] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-17T21:47:48.542307] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-10. [2025-10-17T21:47:49.227605] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-17T21:47:49.236547] [INFO ] [REMOTE ] SYF: Full fetch complete (77557 records). [2025-10-17T21:47:49.236747] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-17T21:47:49.342402] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-17T21:47:49.651749] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-17T21:47:49.652010] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-17T21:47:49.664472] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-17T21:47:49.682506] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-17T21:47:49.718607] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-10-17T21:47:49.716484] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-17T21:47:49.729776] [DEBUG] [LOCAL ] SYF: Trimmed 77557 records to 54234 (keeping 200 days of data) [2025-10-17T21:47:50.069545] [DEBUG] [LOCAL ] SYF: Primary data saved (54234 records). [2025-10-17T21:47:50.069780] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-17T21:47:50.069899] [INFO ] [MAIN ] Update Progress: 2037/2368 symbols completed. SYF took 35.3s. Estimated remaining: 46m 46s. Rate: 7.1 symbols/min [2025-10-17T21:47:50.142305] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-17T21:47:50.942314] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-17T21:47:51.205970] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T21:47:51.742313] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-17T21:47:52.021568] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T21:47:52.542288] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-17T21:47:53.116803] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-17T21:47:53.342309] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-17T21:47:53.424881] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T21:47:54.142323] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-17T21:47:54.526257] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-17T21:47:54.942300] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-17T21:47:55.688328] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-17T21:47:55.742341] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-17T21:47:55.904145] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T21:47:56.542269] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-17T21:47:56.797849] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-17T21:47:57.146812] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-17T21:47:57.153837] [INFO ] [REMOTE ] SYK: Full fetch complete (69167 records). [2025-10-17T21:47:57.153991] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-17T21:47:57.347457] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-17T21:47:57.547274] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-17T21:47:57.547406] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-17T21:47:57.548572] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-17T21:47:57.548636] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-17T21:47:57.549973] [DEBUG] [LOCAL ] SYK: Trimmed 69167 records to 47627 (keeping 200 days of data) [2025-10-17T21:47:57.848708] [DEBUG] [LOCAL ] SYK: Primary data saved (47627 records). [2025-10-17T21:47:57.848890] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-17T21:47:57.849821] [INFO ] [MAIN ] Update Progress: 2038/2368 symbols completed. SYK took 33.0s. Estimated remaining: 46m 37s. Rate: 7.1 symbols/min [2025-10-17T21:47:57.879586] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-17T21:47:58.142283] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-17T21:47:59.189957] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T21:47:59.201293] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-17T21:47:59.607270] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-17T21:47:59.614885] [INFO ] [REMOTE ] SYY: Full fetch complete (77196 records). [2025-10-17T21:47:59.615064] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-17T21:48:00.014679] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-17T21:48:00.014789] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-17T21:48:00.016042] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-17T21:48:00.016108] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-17T21:48:00.017606] [DEBUG] [LOCAL ] SYY: Trimmed 77196 records to 53990 (keeping 200 days of data) [2025-10-17T21:48:00.351402] [DEBUG] [LOCAL ] SYY: Primary data saved (53990 records). [2025-10-17T21:48:00.351543] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-17T21:48:00.351625] [INFO ] [MAIN ] Update Progress: 2039/2368 symbols completed. SYY took 30.9s. Estimated remaining: 46m 28s. Rate: 7.1 symbols/min [2025-10-17T21:48:00.637558] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-17T21:48:00.648893] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-17T21:48:03.482808] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-10-17T21:48:03.494442] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-17T21:48:05.823561] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-17T21:48:05.841049] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-17T21:48:08.542524] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-17T21:48:08.555154] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-17T21:48:11.025277] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-17T21:48:11.038584] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-17T21:48:13.470332] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-17T21:48:13.481975] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-17T21:48:14.171424] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-17T21:48:14.179019] [INFO ] [REMOTE ] T: Full fetch complete (77978 records). [2025-10-17T21:48:14.179174] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-17T21:48:14.569564] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-17T21:48:14.569639] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-17T21:48:14.570873] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-17T21:48:14.570937] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-17T21:48:14.572361] [DEBUG] [LOCAL ] T: Trimmed 77978 records to 54578 (keeping 200 days of data) [2025-10-17T21:48:14.904265] [DEBUG] [LOCAL ] T: Primary data saved (54578 records). [2025-10-17T21:48:14.904389] [INFO ] [MAIN ] T: Full history saved. [2025-10-17T21:48:14.904480] [INFO ] [MAIN ] Update Progress: 2040/2368 symbols completed. T took 29.5s. Estimated remaining: 46m 20s. Rate: 7.1 symbols/min [2025-10-17T21:48:15.542400] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:48:15.534509] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:48:15.533625] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:48:15.594543] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:48:15.656939] [DEBUG] [LOCAL ] TAC: Loaded 43476 existing records from primary storage. [2025-10-17T21:48:15.671582] [INFO ] [MAIN ] TAC: Loaded 43476 existing records. [2025-10-17T21:48:15.769762] [DEBUG] [LOCAL ] TAL: Loaded 52161 existing records from primary storage. [2025-10-17T21:48:15.815028] [INFO ] [MAIN ] TAL: Loaded 52161 existing records. [2025-10-17T21:48:15.837173] [DEBUG] [LOCAL ] TALO: Loaded 51350 existing records from primary storage. [2025-10-17T21:48:15.866679] [DEBUG] [LOCAL ] TAK: Loaded 50538 existing records from primary storage. [2025-10-17T21:48:15.904220] [INFO ] [MAIN ] TAK: Loaded 50538 existing records. [2025-10-17T21:48:15.910904] [INFO ] [MAIN ] TALO: Loaded 51350 existing records. [2025-10-17T21:48:16.008835] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:48:16.086099] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-17T21:48:16.103606] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-17T21:48:16.169023] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-17T21:48:16.190832] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-17T21:48:16.371897] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:48:16.464007] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-17T21:48:16.513844] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:48:16.513986] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-17T21:48:16.525243] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-17T21:48:16.548841] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-17T21:48:16.559538] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-17T21:48:16.548568] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:48:16.559673] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-17T21:48:16.588218] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-17T21:48:16.609318] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-17T21:48:16.602131] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-17T21:48:16.663283] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-17T21:48:16.792325] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-17T21:48:16.826854] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-17T21:48:17.176824] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:48:17.218160] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-10-17T21:48:17.729219] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:48:17.766065] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-10-17T21:48:17.889586] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:48:17.883998] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:48:17.889938] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-10-17T21:48:17.890209] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-10-17T21:48:19.014192] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T21:48:19.023848] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-17T21:48:19.480599] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T21:48:19.490487] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-17T21:48:19.533294] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T21:48:19.542865] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-17T21:48:19.708679] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-17T21:48:19.719375] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-17T21:48:20.559548] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T21:48:20.569292] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-17T21:48:20.942578] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T21:48:20.952325] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-17T21:48:21.184281] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T21:48:21.194790] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-17T21:48:21.488992] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T21:48:21.499776] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-17T21:48:22.274998] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T21:48:22.284570] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-17T21:48:22.565949] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T21:48:22.574978] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-17T21:48:22.847754] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T21:48:22.857424] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-17T21:48:23.479286] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-17T21:48:23.492304] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-17T21:48:23.923474] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T21:48:23.933235] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-17T21:48:24.062273] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T21:48:24.072546] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-17T21:48:24.516069] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T21:48:24.526308] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-17T21:48:25.044984] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T21:48:25.056310] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-17T21:48:25.523359] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T21:48:25.532783] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-17T21:48:25.761705] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T21:48:25.772603] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-17T21:48:26.221082] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T21:48:26.231952] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-17T21:48:26.545466] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T21:48:26.556734] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-17T21:48:27.094570] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T21:48:27.105085] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-17T21:48:27.294485] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-17T21:48:27.305243] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-17T21:48:27.495262] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-17T21:48:27.505735] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-17T21:48:27.968141] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T21:48:27.981709] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-17T21:48:28.216625] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T21:48:28.225919] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-17T21:48:28.778071] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T21:48:28.788446] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-17T21:48:28.977737] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T21:48:28.988003] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-17T21:48:29.653021] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T21:48:29.663118] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-17T21:48:29.766033] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T21:48:30.032538] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T21:48:30.142247] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-17T21:48:30.673183] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T21:48:30.942281] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-17T21:48:31.464332] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T21:48:31.554625] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-17T21:48:31.742225] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-17T21:48:32.441715] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T21:48:32.542246] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-17T21:48:33.342297] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-17T21:48:33.604995] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-17T21:48:34.094474] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T21:48:34.142255] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-17T21:48:34.942388] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-17T21:48:35.095339] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T21:48:35.742276] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-17T21:48:35.849386] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T21:48:35.856609] [INFO ] [REMOTE ] TAC: Full fetch complete (64587 records). [2025-10-17T21:48:35.856793] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-17T21:48:36.248567] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-17T21:48:36.248675] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-17T21:48:36.249750] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-17T21:48:36.249811] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-17T21:48:36.251003] [DEBUG] [LOCAL ] TAC: Trimmed 64587 records to 43866 (keeping 200 days of data) [2025-10-17T21:48:36.517010] [DEBUG] [LOCAL ] TAC: Primary data saved (43866 records). [2025-10-17T21:48:36.517202] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-17T21:48:36.517327] [INFO ] [MAIN ] Update Progress: 2041/2368 symbols completed. TAC took 21.6s. Estimated remaining: 46m 14s. Rate: 7.1 symbols/min [2025-10-17T21:48:36.548718] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-17T21:48:36.697173] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:48:36.728951] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T21:48:36.783409] [DEBUG] [LOCAL ] TAP: Loaded 53352 existing records from primary storage. [2025-10-17T21:48:36.783768] [INFO ] [MAIN ] TAP: Loaded 53352 existing records. [2025-10-17T21:48:36.958503] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:48:36.958773] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-17T21:48:36.958824] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-17T21:48:36.959053] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-17T21:48:36.959109] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-17T21:48:37.322152] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:48:37.342248] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-10-17T21:48:37.390005] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T21:48:38.142268] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-17T21:48:38.227718] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T21:48:38.234958] [INFO ] [REMOTE ] TALO: Full fetch complete (73455 records). [2025-10-17T21:48:38.235118] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-17T21:48:38.616193] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-17T21:48:38.616290] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-17T21:48:38.617416] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-17T21:48:38.617560] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-17T21:48:38.623426] [DEBUG] [LOCAL ] TALO: Trimmed 73455 records to 51714 (keeping 200 days of data) [2025-10-17T21:48:38.738803] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T21:48:38.944193] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-17T21:48:38.953789] [DEBUG] [LOCAL ] TALO: Primary data saved (51714 records). [2025-10-17T21:48:38.953925] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-17T21:48:38.954009] [INFO ] [MAIN ] Update Progress: 2042/2368 symbols completed. TALO took 24.0s. Estimated remaining: 46m 4s. Rate: 7.1 symbols/min [2025-10-17T21:48:39.117607] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:48:39.130572] [DEBUG] [LOCAL ] TBB: Loaded 11583 existing records from primary storage. [2025-10-17T21:48:39.130811] [INFO ] [MAIN ] TBB: Loaded 11583 existing records. [2025-10-17T21:48:39.301492] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:48:39.301684] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-17T21:48:39.301741] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-17T21:48:39.302239] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-17T21:48:39.302311] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-17T21:48:39.655040] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:48:39.742242] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-10-17T21:48:39.776024] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T21:48:39.782927] [INFO ] [REMOTE ] TAK: Full fetch complete (71916 records). [2025-10-17T21:48:39.783024] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-17T21:48:40.162854] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-17T21:48:40.162931] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-17T21:48:40.164017] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-17T21:48:40.164080] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-17T21:48:40.165430] [DEBUG] [LOCAL ] TAK: Trimmed 71916 records to 50897 (keeping 200 days of data) [2025-10-17T21:48:40.464175] [DEBUG] [LOCAL ] TAK: Primary data saved (50897 records). [2025-10-17T21:48:40.464280] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-17T21:48:40.464413] [INFO ] [MAIN ] Update Progress: 2043/2368 symbols completed. TAK took 25.6s. Estimated remaining: 45m 55s. Rate: 7.1 symbols/min [2025-10-17T21:48:40.543492] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-17T21:48:40.633187] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:48:40.663717] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T21:48:40.701025] [DEBUG] [LOCAL ] TBBB: Loaded 36038 existing records from primary storage. [2025-10-17T21:48:40.701307] [INFO ] [MAIN ] TBBB: Loaded 36038 existing records. [2025-10-17T21:48:40.878563] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:48:40.878816] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-17T21:48:40.878890] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-17T21:48:40.879115] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-17T21:48:40.879172] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-17T21:48:41.239943] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:48:41.240426] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T21:48:41.342246] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-17T21:48:42.142291] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-10-17T21:48:42.279111] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T21:48:42.708868] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-17T21:48:42.942305] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-17T21:48:43.470197] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T21:48:43.742325] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-17T21:48:44.542262] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-17T21:48:44.627238] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T21:48:44.855422] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T21:48:45.342388] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-17T21:48:45.828900] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T21:48:45.835881] [INFO ] [REMOTE ] TAL: Full fetch complete (75702 records). [2025-10-17T21:48:45.835997] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-17T21:48:46.147384] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-17T21:48:46.222694] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-17T21:48:46.222784] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-17T21:48:46.223988] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-17T21:48:46.224115] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-17T21:48:46.225639] [DEBUG] [LOCAL ] TAL: Trimmed 75702 records to 52497 (keeping 200 days of data) [2025-10-17T21:48:46.543471] [DEBUG] [LOCAL ] TAL: Primary data saved (52497 records). [2025-10-17T21:48:46.543610] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-17T21:48:46.543724] [INFO ] [MAIN ] Update Progress: 2044/2368 symbols completed. TAL took 31.6s. Estimated remaining: 45m 46s. Rate: 7.1 symbols/min [2025-10-17T21:48:46.710778] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:48:46.732100] [DEBUG] [LOCAL ] TBI: Loaded 22768 existing records from primary storage. [2025-10-17T21:48:46.732465] [INFO ] [MAIN ] TBI: Loaded 22768 existing records. [2025-10-17T21:48:46.915567] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:48:46.922072] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-17T21:48:46.922737] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-17T21:48:46.923054] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T21:48:46.925890] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-17T21:48:46.926424] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-17T21:48:46.947358] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-17T21:48:47.077856] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T21:48:47.318864] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:48:47.742338] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-17T21:48:48.529264] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T21:48:48.542238] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-17T21:48:48.787583] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T21:48:49.342281] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-17T21:48:49.358061] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-17T21:48:50.142340] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-10-17T21:48:50.942338] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-10-17T21:48:51.114778] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-17T21:48:51.207910] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T21:48:51.742266] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-17T21:48:51.983876] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T21:48:52.542287] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-10-17T21:48:53.156869] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T21:48:53.333077] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-17T21:48:53.342237] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-10-17T21:48:54.146245] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-17T21:48:54.147895] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T21:48:54.942303] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-17T21:48:55.292138] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T21:48:55.742306] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-17T21:48:56.506177] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T21:48:56.542254] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-17T21:48:57.342389] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-10-17T21:48:57.623406] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-17T21:48:57.908531] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-17T21:48:58.142410] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T21:48:58.142497] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-17T21:48:58.942427] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-17T21:48:59.742380] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-10-17T21:48:59.914483] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T21:49:00.022375] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T21:49:00.542349] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-17T21:49:00.651203] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T21:49:01.342321] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-10. [2025-10-17T21:49:01.732087] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-17T21:49:02.077962] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-17T21:49:02.079922] [INFO ] [REMOTE ] TBB: Full fetch complete (16563 records). [2025-10-17T21:49:02.080076] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-17T21:49:02.147410] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-17T21:49:02.448247] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-17T21:49:02.448340] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-17T21:49:02.448747] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-17T21:49:02.448833] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-17T21:49:02.449365] [DEBUG] [LOCAL ] TBB: Trimmed 16563 records to 11659 (keeping 200 days of data) [2025-10-17T21:49:02.521873] [DEBUG] [LOCAL ] TBB: Primary data saved (11659 records). [2025-10-17T21:49:02.522016] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-17T21:49:02.522096] [INFO ] [MAIN ] Update Progress: 2045/2368 symbols completed. TBB took 23.6s. Estimated remaining: 45m 39s. Rate: 7.1 symbols/min [2025-10-17T21:49:02.687173] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:49:02.687376] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-17T21:49:02.687413] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-17T21:49:02.687527] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-17T21:49:02.687567] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-17T21:49:02.687607] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-17T21:49:02.687671] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-17T21:49:02.947564] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-17T21:49:03.042521] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:49:03.742272] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-10-17T21:49:04.144264] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-17T21:49:04.147928] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-17T21:49:04.235308] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-17T21:49:04.542327] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-17T21:49:05.342279] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-17T21:49:05.680313] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-17T21:49:05.758956] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-17T21:49:06.142279] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-17T21:49:06.942291] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-17T21:49:07.449400] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-17T21:49:07.742272] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-17T21:49:08.073169] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T21:49:08.100520] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-17T21:49:08.542313] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-17T21:49:08.879971] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-17T21:49:09.342405] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-17T21:49:10.142351] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-17T21:49:10.486398] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-17T21:49:10.895828] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-17T21:49:10.942259] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-17T21:49:11.742294] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-17T21:49:12.092819] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-17T21:49:12.542284] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-17T21:49:12.843404] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-17T21:49:12.845581] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T21:49:13.342297] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-17T21:49:14.142310] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-17T21:49:14.942330] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-17T21:49:15.169460] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T21:49:15.507108] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-17T21:49:15.527137] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T21:49:15.742338] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-17T21:49:16.542309] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-17T21:49:16.901156] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-17T21:49:17.085785] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T21:49:17.090959] [INFO ] [REMOTE ] TBBB: Full fetch complete (51917 records). [2025-10-17T21:49:17.091089] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-17T21:49:17.347498] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-17T21:49:17.475737] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-17T21:49:17.475816] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-17T21:49:17.476787] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-17T21:49:17.476860] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-17T21:49:17.478215] [DEBUG] [LOCAL ] TBBB: Trimmed 51917 records to 36273 (keeping 200 days of data) [2025-10-17T21:49:17.687199] [DEBUG] [LOCAL ] TBBB: Primary data saved (36273 records). [2025-10-17T21:49:17.687351] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-17T21:49:17.688143] [INFO ] [MAIN ] Update Progress: 2046/2368 symbols completed. TBBB took 37.2s. Estimated remaining: 45m 31s. Rate: 7.1 symbols/min [2025-10-17T21:49:17.858251] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:49:17.869422] [DEBUG] [LOCAL ] TBN: Loaded 4014 existing records from primary storage. [2025-10-17T21:49:17.869629] [INFO ] [MAIN ] TBN: Loaded 4014 existing records. [2025-10-17T21:49:18.055436] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:49:18.055914] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-17T21:49:18.056065] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-17T21:49:18.056287] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-17T21:49:18.056390] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-17T21:49:18.147404] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-17T21:49:18.362438] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T21:49:18.480578] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:49:18.942308] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-17T21:49:19.282509] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-17T21:49:19.375023] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-17T21:49:19.742280] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-17T21:49:20.100177] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-17T21:49:20.100974] [INFO ] [REMOTE ] TBLU: Full fetch complete (1224 records). [2025-10-17T21:49:20.101043] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-17T21:49:20.281662] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-17T21:49:20.281874] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-17T21:49:20.281921] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-17T21:49:20.281997] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-17T21:49:20.282083] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-17T21:49:20.282138] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-17T21:49:20.282181] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-17T21:49:20.282251] [INFO ] [MAIN ] Update Progress: 2047/2368 symbols completed. TBLU took 17.8s. Estimated remaining: 45m 22s. Rate: 7.1 symbols/min [2025-10-17T21:49:20.446178] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:49:20.446348] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-17T21:49:20.446384] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-17T21:49:20.446492] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-17T21:49:20.446532] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-17T21:49:20.446572] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-17T21:49:20.446604] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-17T21:49:20.542437] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-10-17T21:49:20.788546] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:49:21.039549] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-17T21:49:21.342294] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-17T21:49:22.142301] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-10-17T21:49:22.336382] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:49:22.336726] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-10-17T21:49:22.336822] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:49:22.336873] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-17T21:49:22.336931] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:49:22.337004] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-17T21:49:22.337068] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-17T21:49:22.337121] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-17T21:49:22.337162] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-17T21:49:22.337212] [INFO ] [MAIN ] Update Progress: 2048/2368 symbols completed. TCAI took 2.1s. Estimated remaining: 45m 12s. Rate: 7.1 symbols/min [2025-10-17T21:49:22.505443] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T21:49:22.530202] [INFO ] [MAIN ] TCBX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:49:22.548634] [DEBUG] [LOCAL ] TCBX: Loaded 10278 existing records from primary storage. [2025-10-17T21:49:22.548966] [INFO ] [MAIN ] TCBX: Loaded 10278 existing records. [2025-10-17T21:49:22.733142] [WARN ] [MAIN ] TCBX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:49:22.733334] [INFO ] [MAIN ] TCBX: Wiping existing primary data before full refresh. [2025-10-17T21:49:22.733390] [INFO ] [LOCAL ] TCBX: Starting deletion of primary data. [2025-10-17T21:49:22.733558] [DEBUG] [LOCAL ] TCBX: Deleted primary data file. [2025-10-17T21:49:22.733608] [INFO ] [MAIN ] TCBX: Starting full primary refresh. [2025-10-17T21:49:22.947540] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-17T21:49:23.080100] [INFO ] [REMOTE ] TCBX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:49:23.656596] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-17T21:49:23.742304] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-17T21:49:24.356259] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-17T21:49:24.542282] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-17T21:49:25.174399] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-17T21:49:25.342295] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2024-12. [2025-10-17T21:49:26.142279] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-17T21:49:26.283757] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-17T21:49:26.589011] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-17T21:49:26.942311] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-17T21:49:27.742354] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-17T21:49:27.941840] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T21:49:28.542343] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-17T21:49:29.342333] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-17T21:49:29.435096] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T21:49:29.442524] [INFO ] [REMOTE ] TAP: Full fetch complete (76486 records). [2025-10-17T21:49:29.442677] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-17T21:49:29.607515] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-17T21:49:29.627482] [INFO ] [REMOTE ] TBI: Full fetch complete (31918 records). [2025-10-17T21:49:29.645257] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-17T21:49:29.831633] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-17T21:49:30.144138] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-17T21:49:30.143941] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-17T21:49:30.149363] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-17T21:49:30.170915] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-17T21:49:30.174674] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-17T21:49:30.269691] [DEBUG] [LOCAL ] TAP: Trimmed 76486 records to 53723 (keeping 200 days of data) [2025-10-17T21:49:30.299465] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-17T21:49:30.299539] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-17T21:49:30.299864] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-17T21:49:30.299925] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-17T21:49:30.300724] [DEBUG] [LOCAL ] TBI: Trimmed 31918 records to 22962 (keeping 200 days of data) [2025-10-17T21:49:30.537164] [DEBUG] [LOCAL ] TBI: Primary data saved (22962 records). [2025-10-17T21:49:30.537868] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-17T21:49:30.539901] [INFO ] [MAIN ] Update Progress: 2049/2368 symbols completed. TBI took 44.0s. Estimated remaining: 45m 4s. Rate: 7.1 symbols/min [2025-10-17T21:49:30.723323] [INFO ] [MAIN ] TCPA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:49:30.724467] [DEBUG] [LOCAL ] TCPA: No existing data file found in primary storage. [2025-10-17T21:49:30.725249] [WARN ] [MAIN ] TCPA: No existing data found, performing full refresh instead. [2025-10-17T21:49:30.725412] [INFO ] [MAIN ] TCPA: Wiping existing primary data before full refresh. [2025-10-17T21:49:30.725770] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-17T21:49:30.726769] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-17T21:49:30.727104] [INFO ] [MAIN ] TCPA: Starting full primary refresh. [2025-10-17T21:49:30.767103] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T21:49:30.949125] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-01. [2025-10-17T21:49:31.222711] [INFO ] [REMOTE ] TCPA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:49:31.315707] [DEBUG] [LOCAL ] TAP: Primary data saved (53723 records). [2025-10-17T21:49:31.315861] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-17T21:49:31.316106] [INFO ] [MAIN ] Update Progress: 2050/2368 symbols completed. TAP took 54.8s. Estimated remaining: 44m 54s. Rate: 7.1 symbols/min [2025-10-17T21:49:31.482736] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:49:31.532858] [DEBUG] [LOCAL ] TD: Loaded 52715 existing records from primary storage. [2025-10-17T21:49:31.533182] [INFO ] [MAIN ] TD: Loaded 52715 existing records. [2025-10-17T21:49:31.711745] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:49:31.711971] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-17T21:49:31.712020] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-17T21:49:31.712237] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-17T21:49:31.712292] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-17T21:49:31.747404] [INFO ] [REMOTE ] TCPA: Fetching primary data for 2024-12. [2025-10-17T21:49:32.002996] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-17T21:49:32.010060] [DEBUG] [REMOTE ] TCPA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:49:32.026184] [WARN ] [REMOTE ] TCPA: No data returned for month 2024-12 [2025-10-17T21:49:32.036613] [FATAL] [REMOTE ] TCPA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:49:32.059540] [FATAL] [MAIN ] TCPA: Failed to fetch primary data. [2025-10-17T21:49:32.084395] [WARN ] [MAIN ] TCPA: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:49:32.089003] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:49:32.089191] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-17T21:49:32.089543] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-17T21:49:32.089601] [INFO ] [LOCAL ] TCPA: Starting deletion of derivative data. [2025-10-17T21:49:32.089678] [DEBUG] [LOCAL ] TCPA: No derivative data file found to delete. [2025-10-17T21:49:32.089755] [INFO ] [MAIN ] Update Progress: 2051/2368 symbols completed. TCPA took 1.5s. Estimated remaining: 44m 44s. Rate: 7.1 symbols/min [2025-10-17T21:49:32.261054] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:49:32.306077] [DEBUG] [LOCAL ] TDC: Loaded 46906 existing records from primary storage. [2025-10-17T21:49:32.306423] [INFO ] [MAIN ] TDC: Loaded 46906 existing records. [2025-10-17T21:49:32.484145] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:49:32.484344] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-17T21:49:32.484390] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-17T21:49:32.484597] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-17T21:49:32.484704] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-17T21:49:32.547403] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-17T21:49:32.829485] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:49:33.291520] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T21:49:33.342297] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-10-17T21:49:34.142291] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-02. [2025-10-17T21:49:34.941060] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T21:49:34.949591] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-10-17T21:49:34.959578] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-17T21:49:35.742330] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-17T21:49:36.289323] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-17T21:49:36.542324] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-03. [2025-10-17T21:49:36.622977] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T21:49:37.342281] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-17T21:49:37.342195] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-17T21:49:38.142330] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-04. [2025-10-17T21:49:38.942323] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-17T21:49:39.181588] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T21:49:39.183224] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-17T21:49:39.742346] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-17T21:49:40.361846] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T21:49:40.542372] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-17T21:49:41.279316] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-17T21:49:41.347348] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-17T21:49:41.361490] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T21:49:42.142345] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-17T21:49:42.188000] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T21:49:42.190114] [INFO ] [REMOTE ] TBN: Full fetch complete (5964 records). [2025-10-17T21:49:42.190236] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-17T21:49:42.536899] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-17T21:49:42.536970] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-17T21:49:42.537124] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-17T21:49:42.537163] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-17T21:49:42.537521] [DEBUG] [LOCAL ] TBN: Trimmed 5964 records to 4058 (keeping 200 days of data) [2025-10-17T21:49:42.560345] [DEBUG] [LOCAL ] TBN: Primary data saved (4058 records). [2025-10-17T21:49:42.560411] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-17T21:49:42.560481] [INFO ] [MAIN ] Update Progress: 2052/2368 symbols completed. TBN took 24.9s. Estimated remaining: 44m 36s. Rate: 7.1 symbols/min [2025-10-17T21:49:42.725018] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:49:42.733705] [DEBUG] [LOCAL ] TDF: Loaded 6394 existing records from primary storage. [2025-10-17T21:49:42.733875] [INFO ] [MAIN ] TDF: Loaded 6394 existing records. [2025-10-17T21:49:42.905676] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:49:42.905879] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-17T21:49:42.905925] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-17T21:49:42.906081] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-17T21:49:42.906144] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-17T21:49:42.950821] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-17T21:49:43.258524] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:49:43.742259] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-10-17T21:49:43.811814] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T21:49:44.302346] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-17T21:49:44.542263] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-17T21:49:44.813491] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T21:49:45.293114] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T21:49:45.342260] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-17T21:49:46.083580] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-17T21:49:46.142297] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-17T21:49:46.942293] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-05. [2025-10-17T21:49:47.742279] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-17T21:49:47.854492] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T21:49:47.894707] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-17T21:49:48.542360] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-06. [2025-10-17T21:49:49.257222] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-17T21:49:49.342251] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-07. [2025-10-17T21:49:49.575211] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T21:49:49.965951] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-17T21:49:50.142289] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-08. [2025-10-17T21:49:50.924114] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T21:49:50.942241] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-09. [2025-10-17T21:49:51.706567] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T21:49:51.742264] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-10. [2025-10-17T21:49:52.499828] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-17T21:49:52.502378] [INFO ] [REMOTE ] TCBX: Full fetch complete (16008 records). [2025-10-17T21:49:52.502477] [DEBUG] [VALIDATOR ] TCBX: Validating primary data. [2025-10-17T21:49:52.547516] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-17T21:49:52.874250] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present. [2025-10-17T21:49:52.874352] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed. [2025-10-17T21:49:52.874779] [INFO ] [MAIN ] TCBX: Fetched primary data is valid. [2025-10-17T21:49:52.874841] [DEBUG] [LOCAL ] TCBX: Saving primary data. [2025-10-17T21:49:52.875343] [DEBUG] [LOCAL ] TCBX: Trimmed 16008 records to 10385 (keeping 200 days of data) [2025-10-17T21:49:52.936118] [DEBUG] [LOCAL ] TCBX: Primary data saved (10385 records). [2025-10-17T21:49:52.936224] [INFO ] [MAIN ] TCBX: Full history saved. [2025-10-17T21:49:52.936306] [INFO ] [MAIN ] Update Progress: 2053/2368 symbols completed. TCBX took 30.6s. Estimated remaining: 44m 28s. Rate: 7.1 symbols/min [2025-10-17T21:49:53.102120] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:49:53.125912] [DEBUG] [LOCAL ] TDG: Loaded 22358 existing records from primary storage. [2025-10-17T21:49:53.126179] [INFO ] [MAIN ] TDG: Loaded 22358 existing records. [2025-10-17T21:49:53.302697] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:49:53.302964] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-17T21:49:53.303073] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-17T21:49:53.303255] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-17T21:49:53.303294] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-17T21:49:53.347433] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-17T21:49:53.411395] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T21:49:53.678107] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:49:54.142298] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-17T21:49:54.942277] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-17T21:49:55.056830] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T21:49:55.092676] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-17T21:49:55.742272] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-17T21:49:56.458480] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-17T21:49:56.542270] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-17T21:49:56.717519] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T21:49:57.342322] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-10-17T21:49:58.142338] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-17T21:49:58.208634] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T21:49:58.575871] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-17T21:49:58.942279] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-17T21:49:59.742296] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-17T21:49:59.758578] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T21:49:59.798567] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T21:50:00.542293] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-17T21:50:01.320787] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T21:50:01.342250] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-17T21:50:01.796442] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-17T21:50:02.142290] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-17T21:50:02.942295] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-17T21:50:03.045285] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T21:50:03.546562] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T21:50:03.742344] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-17T21:50:04.542273] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-17T21:50:05.018194] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-10-17T21:50:05.146911] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-17T21:50:05.342281] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-17T21:50:05.396506] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T21:50:06.002757] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-17T21:50:06.142315] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-17T21:50:06.942369] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-17T21:50:07.742346] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-17T21:50:08.071175] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-17T21:50:08.104078] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T21:50:08.542309] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-17T21:50:09.083564] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T21:50:09.342313] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-17T21:50:10.142280] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-17T21:50:10.263124] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T21:50:10.919309] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-17T21:50:10.926069] [INFO ] [REMOTE ] TDC: Full fetch complete (67695 records). [2025-10-17T21:50:10.926156] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-17T21:50:10.947403] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-17T21:50:11.032325] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T21:50:11.317129] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-17T21:50:11.317208] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-17T21:50:11.318323] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-17T21:50:11.318396] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-17T21:50:11.319727] [DEBUG] [LOCAL ] TDC: Trimmed 67695 records to 47237 (keeping 200 days of data) [2025-10-17T21:50:11.595319] [DEBUG] [LOCAL ] TDC: Primary data saved (47237 records). [2025-10-17T21:50:11.595476] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-17T21:50:11.595579] [INFO ] [MAIN ] Update Progress: 2054/2368 symbols completed. TDC took 39.5s. Estimated remaining: 44m 21s. Rate: 7.1 symbols/min [2025-10-17T21:50:11.744679] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-17T21:50:11.767315] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:50:11.817339] [DEBUG] [LOCAL ] TDOC: Loaded 53755 existing records from primary storage. [2025-10-17T21:50:11.817753] [INFO ] [MAIN ] TDOC: Loaded 53755 existing records. [2025-10-17T21:50:11.991831] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:50:11.992024] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-17T21:50:11.992074] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-17T21:50:11.992296] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-17T21:50:11.992369] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-17T21:50:12.346813] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:50:12.351345] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-17T21:50:12.353042] [INFO ] [REMOTE ] TDF: Full fetch complete (10420 records). [2025-10-17T21:50:12.353174] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-17T21:50:12.460232] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T21:50:12.550271] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-17T21:50:12.737859] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-17T21:50:12.737948] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-17T21:50:12.738245] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-17T21:50:12.738283] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-17T21:50:12.738724] [DEBUG] [LOCAL ] TDF: Trimmed 10420 records to 6421 (keeping 200 days of data) [2025-10-17T21:50:12.776055] [DEBUG] [LOCAL ] TDF: Primary data saved (6421 records). [2025-10-17T21:50:12.776148] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-17T21:50:12.776225] [INFO ] [MAIN ] Update Progress: 2055/2368 symbols completed. TDF took 30.2s. Estimated remaining: 44m 12s. Rate: 7.1 symbols/min [2025-10-17T21:50:12.940276] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:50:12.977970] [DEBUG] [LOCAL ] TDS: Loaded 42828 existing records from primary storage. [2025-10-17T21:50:12.978310] [INFO ] [MAIN ] TDS: Loaded 42828 existing records. [2025-10-17T21:50:13.151159] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:50:13.151374] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-17T21:50:13.151420] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-17T21:50:13.151635] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-17T21:50:13.151726] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-17T21:50:13.353971] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-10-17T21:50:13.506534] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:50:14.142319] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-17T21:50:14.367733] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T21:50:14.375224] [INFO ] [REMOTE ] TD: Full fetch complete (75945 records). [2025-10-17T21:50:14.375587] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-17T21:50:14.762589] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-17T21:50:14.762707] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-17T21:50:14.763900] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-17T21:50:14.764004] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-17T21:50:14.765495] [DEBUG] [LOCAL ] TD: Trimmed 75945 records to 53086 (keeping 200 days of data) [2025-10-17T21:50:14.950224] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-10-17T21:50:15.096670] [DEBUG] [LOCAL ] TD: Primary data saved (53086 records). [2025-10-17T21:50:15.096818] [INFO ] [MAIN ] TD: Full history saved. [2025-10-17T21:50:15.096900] [INFO ] [MAIN ] Update Progress: 2056/2368 symbols completed. TD took 43.8s. Estimated remaining: 44m 2s. Rate: 7.1 symbols/min [2025-10-17T21:50:15.270803] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:50:15.312347] [DEBUG] [LOCAL ] TDW: Loaded 45348 existing records from primary storage. [2025-10-17T21:50:15.312756] [INFO ] [MAIN ] TDW: Loaded 45348 existing records. [2025-10-17T21:50:15.503454] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:50:15.503986] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-17T21:50:15.504257] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-17T21:50:15.509741] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-17T21:50:15.517963] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-17T21:50:15.524439] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-17T21:50:15.686429] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-10-17T21:50:15.748720] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-17T21:50:15.936191] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:50:16.508406] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T21:50:16.542259] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-17T21:50:16.950193] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T21:50:17.342298] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-17T21:50:18.142282] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-17T21:50:18.460850] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T21:50:18.524712] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-17T21:50:18.942306] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-17T21:50:19.651536] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T21:50:19.742276] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-17T21:50:19.921635] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-17T21:50:20.542302] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-17T21:50:21.210168] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T21:50:21.342294] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-17T21:50:21.714627] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-17T21:50:22.142342] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-17T21:50:22.942263] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-10-17T21:50:23.644205] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-17T21:50:23.742287] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-17T21:50:24.233703] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-17T21:50:24.332805] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-17T21:50:24.542299] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-17T21:50:25.094561] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-17T21:50:25.098737] [INFO ] [REMOTE ] TDG: Full fetch complete (32117 records). [2025-10-17T21:50:25.098876] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-17T21:50:25.347673] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-17T21:50:25.542363] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T21:50:25.542618] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-17T21:50:25.551763] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-17T21:50:25.553628] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-17T21:50:25.553746] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-17T21:50:25.555308] [DEBUG] [LOCAL ] TDG: Trimmed 32117 records to 22499 (keeping 200 days of data) [2025-10-17T21:50:25.729939] [DEBUG] [LOCAL ] TDG: Primary data saved (22499 records). [2025-10-17T21:50:25.730196] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-17T21:50:25.730352] [INFO ] [MAIN ] Update Progress: 2057/2368 symbols completed. TDG took 32.8s. Estimated remaining: 43m 54s. Rate: 7.1 symbols/min [2025-10-17T21:50:25.929844] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:50:25.955158] [DEBUG] [LOCAL ] TDY: Loaded 22418 existing records from primary storage. [2025-10-17T21:50:25.955480] [INFO ] [MAIN ] TDY: Loaded 22418 existing records. [2025-10-17T21:50:26.142056] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:50:26.142312] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-17T21:50:26.143958] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-17T21:50:26.144022] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-17T21:50:26.144207] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-17T21:50:26.144265] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-17T21:50:26.489715] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:50:26.942254] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-17T21:50:27.091325] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T21:50:27.750398] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-17T21:50:27.773243] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T21:50:28.258786] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-17T21:50:28.542300] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-17T21:50:29.342254] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-17T21:50:29.864716] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-17T21:50:30.021526] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T21:50:30.142279] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-17T21:50:30.942262] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-17T21:50:30.981918] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T21:50:31.742342] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-10-17T21:50:31.774427] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T21:50:32.542272] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-17T21:50:32.886807] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-17T21:50:33.154064] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T21:50:33.342408] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-17T21:50:34.152079] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-17T21:50:34.158173] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T21:50:34.942351] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-17T21:50:35.435783] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-17T21:50:35.733025] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T21:50:35.742299] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-17T21:50:36.542276] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-17T21:50:36.692291] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T21:50:37.342296] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-17T21:50:37.865384] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-17T21:50:38.078300] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-17T21:50:38.142260] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-17T21:50:38.708835] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-17T21:50:38.942280] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-17T21:50:39.742292] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-17T21:50:40.291551] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-17T21:50:40.525777] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T21:50:40.542243] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-17T21:50:41.106109] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T21:50:41.111830] [INFO ] [REMOTE ] TDS: Full fetch complete (61561 records). [2025-10-17T21:50:41.111955] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-17T21:50:41.347394] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-17T21:50:41.502513] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-17T21:50:41.502590] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-17T21:50:41.503658] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-17T21:50:41.503724] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-17T21:50:41.504975] [DEBUG] [LOCAL ] TDS: Trimmed 61561 records to 43099 (keeping 200 days of data) [2025-10-17T21:50:41.770757] [DEBUG] [LOCAL ] TDS: Primary data saved (43099 records). [2025-10-17T21:50:41.770893] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-17T21:50:41.771493] [INFO ] [MAIN ] Update Progress: 2058/2368 symbols completed. TDS took 29.0s. Estimated remaining: 43m 47s. Rate: 7.1 symbols/min [2025-10-17T21:50:41.942179] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:50:41.942342] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-17T21:50:41.942380] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-17T21:50:41.942490] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-17T21:50:41.942531] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-17T21:50:41.942571] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-17T21:50:41.942602] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-17T21:50:42.149767] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-17T21:50:42.304345] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:50:42.331784] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T21:50:42.392222] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T21:50:42.942296] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-17T21:50:43.742368] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-10-17T21:50:44.006129] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T21:50:44.177935] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:50:44.178254] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-10-17T21:50:44.178344] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:50:44.178390] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-17T21:50:44.178450] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:50:44.178521] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-17T21:50:44.178585] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-17T21:50:44.178620] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-17T21:50:44.178696] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-17T21:50:44.178760] [INFO ] [MAIN ] Update Progress: 2059/2368 symbols completed. TE took 2.4s. Estimated remaining: 43m 37s. Rate: 7.1 symbols/min [2025-10-17T21:50:44.349777] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:50:44.384313] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-17T21:50:44.402939] [DEBUG] [LOCAL ] TEAF: Loaded 7473 existing records from primary storage. [2025-10-17T21:50:44.403219] [INFO ] [MAIN ] TEAF: Loaded 7473 existing records. [2025-10-17T21:50:44.547406] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-17T21:50:44.587493] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:50:44.587729] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-17T21:50:44.587804] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-17T21:50:44.587974] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-17T21:50:44.588016] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-17T21:50:44.954126] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:50:45.342298] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-17T21:50:46.142330] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-10. [2025-10-17T21:50:46.266750] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-17T21:50:46.559748] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-17T21:50:46.942295] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-10-17T21:50:47.718369] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-17T21:50:47.742253] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-17T21:50:48.256925] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-17T21:50:48.264899] [INFO ] [REMOTE ] TDOC: Full fetch complete (77434 records). [2025-10-17T21:50:48.265072] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-17T21:50:48.547497] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-17T21:50:48.651267] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-17T21:50:48.651389] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-17T21:50:48.652575] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-17T21:50:48.652638] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-17T21:50:48.654132] [DEBUG] [LOCAL ] TDOC: Trimmed 77434 records to 54145 (keeping 200 days of data) [2025-10-17T21:50:48.953621] [DEBUG] [LOCAL ] TDOC: Primary data saved (54145 records). [2025-10-17T21:50:48.953847] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-17T21:50:48.953973] [INFO ] [MAIN ] Update Progress: 2060/2368 symbols completed. TDOC took 37.4s. Estimated remaining: 43m 28s. Rate: 7.1 symbols/min [2025-10-17T21:50:49.132269] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:50:49.180453] [DEBUG] [LOCAL ] TECK: Loaded 53824 existing records from primary storage. [2025-10-17T21:50:49.180803] [INFO ] [MAIN ] TECK: Loaded 53824 existing records. [2025-10-17T21:50:49.260422] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-17T21:50:49.348208] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-17T21:50:49.368945] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:50:49.370687] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-17T21:50:49.385675] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-17T21:50:49.395150] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-17T21:50:49.395562] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-17T21:50:49.428421] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T21:50:49.753136] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:50:50.142351] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-10-17T21:50:50.782069] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T21:50:50.942283] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-17T21:50:51.742272] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-17T21:50:51.862376] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-17T21:50:52.530249] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T21:50:52.540191] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T21:50:52.542150] [INFO ] [REMOTE ] TDW: Full fetch complete (66815 records). [2025-10-17T21:50:52.542280] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-17T21:50:52.542236] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-17T21:50:52.964097] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-17T21:50:52.964231] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-17T21:50:52.965361] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-17T21:50:52.965428] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-17T21:50:52.966778] [DEBUG] [LOCAL ] TDW: Trimmed 66815 records to 45635 (keeping 200 days of data) [2025-10-17T21:50:53.231133] [DEBUG] [LOCAL ] TDW: Primary data saved (45635 records). [2025-10-17T21:50:53.231268] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-17T21:50:53.231353] [INFO ] [MAIN ] Update Progress: 2061/2368 symbols completed. TDW took 38.1s. Estimated remaining: 43m 19s. Rate: 7.1 symbols/min [2025-10-17T21:50:53.342584] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-17T21:50:53.343290] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-17T21:50:53.412354] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:50:53.445923] [DEBUG] [LOCAL ] TEF: Loaded 37124 existing records from primary storage. [2025-10-17T21:50:53.446186] [INFO ] [MAIN ] TEF: Loaded 37124 existing records. [2025-10-17T21:50:53.622140] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:50:53.622356] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-17T21:50:53.622409] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-17T21:50:53.622617] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-17T21:50:53.622704] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-17T21:50:53.965933] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:50:54.142242] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-10-17T21:50:54.540411] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-17T21:50:54.942302] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-17T21:50:55.266483] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T21:50:55.742296] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-17T21:50:55.798440] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-17T21:50:56.542268] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-17T21:50:56.885786] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T21:50:57.342350] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-17T21:50:57.993084] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T21:50:58.142317] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-17T21:50:58.942366] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-17T21:50:59.116497] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T21:50:59.709576] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T21:50:59.742297] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-17T21:51:00.274495] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-17T21:51:00.542289] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-17T21:51:01.312900] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-17T21:51:01.342322] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-17T21:51:01.769991] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T21:51:02.142320] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-17T21:51:02.569411] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-17T21:51:02.942303] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-17T21:51:03.605066] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T21:51:03.742265] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-17T21:51:04.542326] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-17T21:51:04.703209] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T21:51:05.172953] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-17T21:51:05.199451] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-17T21:51:05.342277] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-17T21:51:06.142293] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-17T21:51:06.765339] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T21:51:06.873639] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-17T21:51:06.942315] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-17T21:51:07.596911] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-17T21:51:07.742326] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-17T21:51:08.542276] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-17T21:51:09.308140] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T21:51:09.342257] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-17T21:51:09.554797] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T21:51:10.066393] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T21:51:10.068061] [INFO ] [REMOTE ] TEAF: Full fetch complete (10111 records). [2025-10-17T21:51:10.068132] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-17T21:51:10.147431] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-17T21:51:10.419497] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-17T21:51:10.419575] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-17T21:51:10.419841] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-17T21:51:10.419902] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-17T21:51:10.420333] [DEBUG] [LOCAL ] TEAF: Trimmed 10111 records to 7531 (keeping 200 days of data) [2025-10-17T21:51:10.466545] [DEBUG] [LOCAL ] TEAF: Primary data saved (7531 records). [2025-10-17T21:51:10.466716] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-17T21:51:10.466810] [INFO ] [MAIN ] Update Progress: 2062/2368 symbols completed. TEAF took 26.3s. Estimated remaining: 43m 12s. Rate: 7.1 symbols/min [2025-10-17T21:51:10.637021] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:51:10.657528] [DEBUG] [LOCAL ] TEI: Loaded 21475 existing records from primary storage. [2025-10-17T21:51:10.657864] [INFO ] [MAIN ] TEI: Loaded 21475 existing records. [2025-10-17T21:51:10.838211] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:51:10.838483] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-17T21:51:10.838565] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-17T21:51:10.838901] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-17T21:51:10.838970] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-17T21:51:10.947623] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-17T21:51:11.212977] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:51:11.664223] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-17T21:51:11.742259] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-17T21:51:12.047063] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-17T21:51:12.542341] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-17T21:51:13.020452] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-17T21:51:13.023346] [INFO ] [REMOTE ] TDY: Full fetch complete (31989 records). [2025-10-17T21:51:13.023438] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-17T21:51:13.350464] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-17T21:51:13.398004] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T21:51:13.411137] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-17T21:51:13.418800] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-17T21:51:13.419586] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-17T21:51:13.419898] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-17T21:51:13.421029] [DEBUG] [LOCAL ] TDY: Trimmed 31989 records to 22564 (keeping 200 days of data) [2025-10-17T21:51:13.555196] [DEBUG] [LOCAL ] TDY: Primary data saved (22564 records). [2025-10-17T21:51:13.555315] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-17T21:51:13.555389] [INFO ] [MAIN ] Update Progress: 2063/2368 symbols completed. TDY took 47.8s. Estimated remaining: 43m 3s. Rate: 7.1 symbols/min [2025-10-17T21:51:13.725138] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:51:13.774522] [DEBUG] [LOCAL ] TEL: Loaded 51440 existing records from primary storage. [2025-10-17T21:51:13.774846] [INFO ] [MAIN ] TEL: Loaded 51440 existing records. [2025-10-17T21:51:13.946535] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:51:13.946770] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-17T21:51:13.946820] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-17T21:51:13.947004] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-17T21:51:13.947043] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-17T21:51:14.149197] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-17T21:51:14.297932] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:51:14.942266] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-10-17T21:51:15.103829] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T21:51:15.213961] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-17T21:51:15.219244] [INFO ] [REMOTE ] TEF: Full fetch complete (54644 records). [2025-10-17T21:51:15.219348] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-17T21:51:15.595285] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-17T21:51:15.595374] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-17T21:51:15.596883] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-17T21:51:15.596955] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-17T21:51:15.598429] [DEBUG] [LOCAL ] TEF: Trimmed 54644 records to 37415 (keeping 200 days of data) [2025-10-17T21:51:15.752399] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-17T21:51:15.813183] [DEBUG] [LOCAL ] TEF: Primary data saved (37415 records). [2025-10-17T21:51:15.813315] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-17T21:51:15.813480] [INFO ] [MAIN ] Update Progress: 2064/2368 symbols completed. TEF took 22.6s. Estimated remaining: 42m 53s. Rate: 7.1 symbols/min [2025-10-17T21:51:15.980952] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:51:16.011557] [DEBUG] [LOCAL ] TEN: Loaded 30779 existing records from primary storage. [2025-10-17T21:51:16.011848] [INFO ] [MAIN ] TEN: Loaded 30779 existing records. [2025-10-17T21:51:16.187245] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:51:16.187451] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-17T21:51:16.187506] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-17T21:51:16.187730] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-17T21:51:16.187821] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-17T21:51:16.549327] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-10-17T21:51:16.549224] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:51:16.702909] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T21:51:17.342269] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-10-17T21:51:17.577215] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-17T21:51:17.673924] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T21:51:18.142292] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-17T21:51:18.817984] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T21:51:18.942358] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-17T21:51:19.183829] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T21:51:19.742298] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-17T21:51:20.542291] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-17T21:51:20.779000] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-17T21:51:21.342260] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-17T21:51:21.537844] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-17T21:51:21.904106] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-17T21:51:22.142335] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-17T21:51:22.943082] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-17T21:51:22.945753] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-17T21:51:23.271610] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T21:51:23.742355] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-17T21:51:24.495119] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T21:51:24.542274] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-17T21:51:24.925408] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T21:51:25.342285] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-17T21:51:26.142256] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-17T21:51:26.349081] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T21:51:26.847588] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T21:51:26.942294] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-17T21:51:27.742355] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-17T21:51:27.947259] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T21:51:28.542340] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-17T21:51:29.342302] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-17T21:51:30.002307] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (3.06 seconds). [2025-10-17T21:51:30.142299] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-17T21:51:30.535468] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-17T21:51:30.797162] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-17T21:51:30.942255] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-17T21:51:31.130532] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (3.39 seconds). [2025-10-17T21:51:31.742334] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-17T21:51:31.783806] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T21:51:31.882490] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T21:51:32.542319] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-17T21:51:33.342313] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-17T21:51:33.467540] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T21:51:34.142310] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-17T21:51:34.287494] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T21:51:34.409062] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T21:51:34.942297] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-17T21:51:35.742266] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-17T21:51:35.846172] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-17T21:51:35.854710] [INFO ] [REMOTE ] TECK: Full fetch complete (77518 records). [2025-10-17T21:51:35.855044] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-17T21:51:36.301619] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-17T21:51:36.302759] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-17T21:51:36.306536] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-17T21:51:36.306664] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-17T21:51:36.304997] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T21:51:36.315968] [DEBUG] [LOCAL ] TECK: Trimmed 77518 records to 54213 (keeping 200 days of data) [2025-10-17T21:51:36.543691] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-17T21:51:36.658636] [DEBUG] [LOCAL ] TECK: Primary data saved (54213 records). [2025-10-17T21:51:36.658817] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-17T21:51:36.658917] [INFO ] [MAIN ] Update Progress: 2065/2368 symbols completed. TECK took 47.7s. Estimated remaining: 42m 47s. Rate: 7.1 symbols/min [2025-10-17T21:51:36.827896] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:51:36.851679] [DEBUG] [LOCAL ] TEO: Loaded 22784 existing records from primary storage. [2025-10-17T21:51:36.851968] [INFO ] [MAIN ] TEO: Loaded 22784 existing records. [2025-10-17T21:51:36.992804] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-17T21:51:37.057136] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:51:37.057424] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-17T21:51:37.057500] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-17T21:51:37.057723] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-17T21:51:37.057803] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-17T21:51:37.347411] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-17T21:51:37.409695] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:51:37.809755] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T21:51:38.142315] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-17T21:51:38.418535] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T21:51:38.942342] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-17T21:51:39.742255] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-10-17T21:51:39.986867] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T21:51:40.010110] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-17T21:51:40.542266] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-17T21:51:40.909738] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-17T21:51:41.342274] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-17T21:51:41.555087] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T21:51:42.142344] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-17T21:51:42.804895] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-17T21:51:42.942280] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-17T21:51:43.207900] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T21:51:43.742335] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-17T21:51:44.542312] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-17T21:51:44.761621] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T21:51:44.837445] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-17T21:51:44.841160] [INFO ] [REMOTE ] TEI: Full fetch complete (30824 records). [2025-10-17T21:51:44.841244] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-17T21:51:45.196589] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-17T21:51:45.196692] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-17T21:51:45.197305] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-17T21:51:45.197346] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-17T21:51:45.198141] [DEBUG] [LOCAL ] TEI: Trimmed 30824 records to 21545 (keeping 200 days of data) [2025-10-17T21:51:45.324136] [DEBUG] [LOCAL ] TEI: Primary data saved (21545 records). [2025-10-17T21:51:45.324267] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-17T21:51:45.324348] [INFO ] [MAIN ] Update Progress: 2066/2368 symbols completed. TEI took 34.9s. Estimated remaining: 42m 38s. Rate: 7.1 symbols/min [2025-10-17T21:51:45.347452] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-17T21:51:45.498512] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:51:45.553032] [DEBUG] [LOCAL ] TEVA: Loaded 54017 existing records from primary storage. [2025-10-17T21:51:45.553401] [INFO ] [MAIN ] TEVA: Loaded 54017 existing records. [2025-10-17T21:51:45.741299] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:51:45.741761] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-17T21:51:45.741876] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-17T21:51:45.742107] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-10-17T21:51:45.742162] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-17T21:51:45.860375] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-17T21:51:46.115225] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:51:46.142253] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-10-17T21:51:46.705258] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T21:51:46.942313] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-17T21:51:47.669754] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T21:51:47.677002] [INFO ] [REMOTE ] TEL: Full fetch complete (73708 records). [2025-10-17T21:51:47.677136] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-17T21:51:47.742544] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-17T21:51:48.082540] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-17T21:51:48.082625] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-17T21:51:48.083858] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-17T21:51:48.083923] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-17T21:51:48.085431] [DEBUG] [LOCAL ] TEL: Trimmed 73708 records to 51795 (keeping 200 days of data) [2025-10-17T21:51:48.333975] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-17T21:51:48.450487] [DEBUG] [LOCAL ] TEL: Primary data saved (51795 records). [2025-10-17T21:51:48.450617] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-17T21:51:48.450728] [INFO ] [MAIN ] Update Progress: 2067/2368 symbols completed. TEL took 34.9s. Estimated remaining: 42m 29s. Rate: 7.1 symbols/min [2025-10-17T21:51:48.547408] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-17T21:51:48.620914] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:51:48.659408] [DEBUG] [LOCAL ] TEX: Loaded 44119 existing records from primary storage. [2025-10-17T21:51:48.659739] [INFO ] [MAIN ] TEX: Loaded 44119 existing records. [2025-10-17T21:51:48.827263] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T21:51:48.861082] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:51:48.861318] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-17T21:51:48.861365] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-17T21:51:48.861632] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-17T21:51:48.861735] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-17T21:51:49.208145] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:51:49.342251] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-10-17T21:51:49.974608] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T21:51:50.142309] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-17T21:51:50.927572] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T21:51:50.942247] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-17T21:51:51.319501] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T21:51:51.326238] [INFO ] [REMOTE ] TEN: Full fetch complete (44121 records). [2025-10-17T21:51:51.326433] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-17T21:51:51.744720] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-17T21:51:51.907926] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-17T21:51:51.908154] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-17T21:51:51.909367] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-17T21:51:51.909452] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-17T21:51:51.928991] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-17T21:51:51.935424] [DEBUG] [LOCAL ] TEN: Trimmed 44121 records to 30927 (keeping 200 days of data) [2025-10-17T21:51:52.129169] [DEBUG] [LOCAL ] TEN: Primary data saved (30927 records). [2025-10-17T21:51:52.129318] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-17T21:51:52.129401] [INFO ] [MAIN ] Update Progress: 2068/2368 symbols completed. TEN took 36.3s. Estimated remaining: 42m 20s. Rate: 7.1 symbols/min [2025-10-17T21:51:52.298443] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:51:52.348269] [DEBUG] [LOCAL ] TFC: Loaded 54057 existing records from primary storage. [2025-10-17T21:51:52.348668] [INFO ] [MAIN ] TFC: Loaded 54057 existing records. [2025-10-17T21:51:52.524840] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:51:52.525053] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-17T21:51:52.525101] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-17T21:51:52.525307] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-17T21:51:52.525365] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-17T21:51:52.547448] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-17T21:51:52.889379] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:51:53.331418] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T21:51:53.342241] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-17T21:51:53.712721] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T21:51:54.142314] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-17T21:51:54.861750] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T21:51:54.942294] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-17T21:51:55.196533] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T21:51:55.742304] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-17T21:51:56.542284] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-17T21:51:56.784790] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-17T21:51:57.189059] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-17T21:51:57.342314] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-10-17T21:51:57.491050] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T21:51:58.142296] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-17T21:51:58.948460] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-10-17T21:51:58.951127] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-17T21:51:59.204303] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T21:51:59.742345] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-17T21:52:00.542313] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-17T21:52:00.905056] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-17T21:52:01.342266] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-17T21:52:01.600703] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T21:52:02.142282] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-17T21:52:02.202970] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T21:52:02.419595] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T21:52:02.942279] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-17T21:52:03.742328] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-17T21:52:03.855469] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T21:52:04.293477] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T21:52:04.542327] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-17T21:52:05.238416] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T21:52:05.342246] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-17T21:52:06.142326] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-17T21:52:06.371826] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T21:52:06.942303] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-17T21:52:06.977195] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T21:52:07.465262] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T21:52:07.469123] [INFO ] [REMOTE ] TEO: Full fetch complete (32801 records). [2025-10-17T21:52:07.469199] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-17T21:52:07.749366] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-17T21:52:07.848039] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-17T21:52:07.848117] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-17T21:52:07.848802] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-17T21:52:07.848863] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-17T21:52:07.849571] [DEBUG] [LOCAL ] TEO: Trimmed 32801 records to 22984 (keeping 200 days of data) [2025-10-17T21:52:07.978995] [DEBUG] [LOCAL ] TEO: Primary data saved (22984 records). [2025-10-17T21:52:07.979187] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-17T21:52:07.979302] [INFO ] [MAIN ] Update Progress: 2069/2368 symbols completed. TEO took 31.3s. Estimated remaining: 42m 12s. Rate: 7.1 symbols/min [2025-10-17T21:52:08.148226] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:52:08.180245] [DEBUG] [LOCAL ] TFII: Loaded 33095 existing records from primary storage. [2025-10-17T21:52:08.180519] [INFO ] [MAIN ] TFII: Loaded 33095 existing records. [2025-10-17T21:52:08.360882] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:52:08.361094] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-17T21:52:08.361144] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-17T21:52:08.361393] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-17T21:52:08.361450] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-17T21:52:08.546485] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-10-17T21:52:08.723886] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:52:08.918736] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-17T21:52:09.352224] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-10-17T21:52:09.357572] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T21:52:10.142280] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-17T21:52:10.689947] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-17T21:52:10.716890] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T21:52:10.942313] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-10-17T21:52:11.742281] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-17T21:52:11.884804] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T21:52:12.542341] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-17T21:52:13.001285] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T21:52:13.274348] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-17T21:52:13.342319] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-17T21:52:13.767960] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-17T21:52:14.142299] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-10-17T21:52:14.677102] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T21:52:14.942292] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-17T21:52:15.742290] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-17T21:52:16.262084] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-17T21:52:16.385610] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T21:52:16.542267] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-17T21:52:17.342294] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-10-17T21:52:17.541684] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T21:52:17.859536] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T21:52:17.865359] [INFO ] [REMOTE ] TEX: Full fetch complete (64470 records). [2025-10-17T21:52:17.865519] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-17T21:52:18.149331] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-17T21:52:18.243494] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-17T21:52:18.243573] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-17T21:52:18.244703] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-17T21:52:18.244767] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-17T21:52:18.246222] [DEBUG] [LOCAL ] TEX: Trimmed 64470 records to 44431 (keeping 200 days of data) [2025-10-17T21:52:18.510104] [DEBUG] [LOCAL ] TEX: Primary data saved (44431 records). [2025-10-17T21:52:18.510226] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-17T21:52:18.510304] [INFO ] [MAIN ] Update Progress: 2070/2368 symbols completed. TEX took 30.1s. Estimated remaining: 42m 4s. Rate: 7.1 symbols/min [2025-10-17T21:52:18.676555] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:52:18.700463] [DEBUG] [LOCAL ] TFIN: Loaded 23892 existing records from primary storage. [2025-10-17T21:52:18.700757] [INFO ] [MAIN ] TFIN: Loaded 23892 existing records. [2025-10-17T21:52:18.877913] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:52:18.878181] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-17T21:52:18.878232] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-17T21:52:18.878404] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-17T21:52:18.878461] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-17T21:52:18.949025] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-17T21:52:19.240759] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:52:19.269203] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-17T21:52:19.742308] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-10-17T21:52:19.784301] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T21:52:20.542298] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-10-17T21:52:20.947721] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-17T21:52:21.342334] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-17T21:52:21.394694] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T21:52:22.142301] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-17T21:52:22.343764] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-17T21:52:22.744862] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-17T21:52:22.942286] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-10-17T21:52:23.742324] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-17T21:52:24.024569] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-17T21:52:24.344463] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-17T21:52:24.542293] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-17T21:52:25.100005] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-17T21:52:25.342291] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-10-17T21:52:26.142280] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-17T21:52:26.374973] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T21:52:26.942292] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-10. [2025-10-17T21:52:27.387199] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-17T21:52:27.506085] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T21:52:27.623965] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T21:52:27.631612] [INFO ] [REMOTE ] TFC: Full fetch complete (77843 records). [2025-10-17T21:52:27.631783] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-17T21:52:27.742267] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-17T21:52:28.064625] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-17T21:52:28.064779] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-17T21:52:28.066168] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-17T21:52:28.066250] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-17T21:52:28.067860] [DEBUG] [LOCAL ] TFC: Trimmed 77843 records to 54447 (keeping 200 days of data) [2025-10-17T21:52:28.419304] [DEBUG] [LOCAL ] TFC: Primary data saved (54447 records). [2025-10-17T21:52:28.419453] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-17T21:52:28.419556] [INFO ] [MAIN ] Update Progress: 2071/2368 symbols completed. TFC took 36.3s. Estimated remaining: 41m 56s. Rate: 7.1 symbols/min [2025-10-17T21:52:28.546201] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-17T21:52:28.589135] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:52:28.625230] [DEBUG] [LOCAL ] TFPM: Loaded 39778 existing records from primary storage. [2025-10-17T21:52:28.625546] [INFO ] [MAIN ] TFPM: Loaded 39778 existing records. [2025-10-17T21:52:28.802800] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:52:28.813582] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-17T21:52:28.813701] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-17T21:52:28.814731] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-17T21:52:28.818465] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-17T21:52:28.819246] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-17T21:52:29.166689] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:52:29.342268] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-10-17T21:52:29.625270] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-17T21:52:30.142285] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-17T21:52:30.578258] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T21:52:30.942319] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-17T21:52:31.282719] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-17T21:52:31.742301] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-17T21:52:32.160591] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T21:52:32.542341] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-17T21:52:32.672601] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-17T21:52:33.342321] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-17T21:52:33.915775] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T21:52:34.136275] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-17T21:52:34.142236] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-17T21:52:34.942271] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-10. [2025-10-17T21:52:35.124318] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-17T21:52:35.742283] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-17T21:52:36.542268] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-17T21:52:37.119533] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-17T21:52:37.126897] [INFO ] [REMOTE ] TEVA: Full fetch complete (77790 records). [2025-10-17T21:52:37.127017] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-17T21:52:37.352422] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-17T21:52:37.434826] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T21:52:37.547176] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-17T21:52:37.547254] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-17T21:52:37.548439] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-17T21:52:37.548502] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-17T21:52:37.550004] [DEBUG] [LOCAL ] TEVA: Trimmed 77790 records to 54406 (keeping 200 days of data) [2025-10-17T21:52:37.877106] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-17T21:52:37.895118] [DEBUG] [LOCAL ] TEVA: Primary data saved (54406 records). [2025-10-17T21:52:37.895232] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-17T21:52:37.895809] [INFO ] [MAIN ] Update Progress: 2072/2368 symbols completed. TEVA took 52.6s. Estimated remaining: 41m 48s. Rate: 7.1 symbols/min [2025-10-17T21:52:38.061128] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:52:38.099013] [DEBUG] [LOCAL ] TFX: Loaded 36449 existing records from primary storage. [2025-10-17T21:52:38.099290] [INFO ] [MAIN ] TFX: Loaded 36449 existing records. [2025-10-17T21:52:38.151595] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-17T21:52:38.273485] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:52:38.273724] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-17T21:52:38.273778] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-17T21:52:38.273975] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-17T21:52:38.274032] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-17T21:52:38.617187] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:52:38.776140] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T21:52:38.942254] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-17T21:52:39.222898] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-17T21:52:39.742304] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-10-17T21:52:40.264323] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T21:52:40.542315] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-17T21:52:41.333285] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T21:52:41.342237] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-17T21:52:41.964094] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T21:52:42.142269] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-17T21:52:42.834949] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-17T21:52:42.942244] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-17T21:52:43.616097] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T21:52:43.742364] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-17T21:52:44.095416] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T21:52:44.542338] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-17T21:52:45.004021] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-17T21:52:45.342329] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-17T21:52:46.142267] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-17T21:52:46.218544] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T21:52:46.942367] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-17T21:52:47.182731] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T21:52:47.227719] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-17T21:52:47.232251] [INFO ] [REMOTE ] TFII: Full fetch complete (48051 records). [2025-10-17T21:52:47.232352] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-17T21:52:47.610465] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-17T21:52:47.610550] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-17T21:52:47.611523] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-17T21:52:47.611587] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-17T21:52:47.612670] [DEBUG] [LOCAL ] TFII: Trimmed 48051 records to 33349 (keeping 200 days of data) [2025-10-17T21:52:47.777387] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-17T21:52:47.827693] [DEBUG] [LOCAL ] TFII: Primary data saved (33349 records). [2025-10-17T21:52:47.827891] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-17T21:52:47.828002] [INFO ] [MAIN ] Update Progress: 2073/2368 symbols completed. TFII took 39.8s. Estimated remaining: 41m 39s. Rate: 7.1 symbols/min [2025-10-17T21:52:48.000387] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:52:48.012084] [DEBUG] [LOCAL ] TG: Loaded 10651 existing records from primary storage. [2025-10-17T21:52:48.012283] [INFO ] [MAIN ] TG: Loaded 10651 existing records. [2025-10-17T21:52:48.210613] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:52:48.210887] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-17T21:52:48.210935] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-17T21:52:48.211133] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-17T21:52:48.211190] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-17T21:52:48.278102] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-17T21:52:48.551133] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-17T21:52:48.582675] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:52:49.342301] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-10-17T21:52:49.374858] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-17T21:52:49.697949] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T21:52:49.701630] [INFO ] [REMOTE ] TFIN: Full fetch complete (32307 records). [2025-10-17T21:52:49.701747] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-17T21:52:50.066226] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-17T21:52:50.066308] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-17T21:52:50.066968] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-17T21:52:50.067032] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-17T21:52:50.067872] [DEBUG] [LOCAL ] TFIN: Trimmed 32307 records to 24116 (keeping 200 days of data) [2025-10-17T21:52:50.150024] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-17T21:52:50.209846] [DEBUG] [LOCAL ] TFIN: Primary data saved (24116 records). [2025-10-17T21:52:50.209971] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-17T21:52:50.210052] [INFO ] [MAIN ] Update Progress: 2074/2368 symbols completed. TFIN took 31.7s. Estimated remaining: 41m 30s. Rate: 7.1 symbols/min [2025-10-17T21:52:50.317307] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T21:52:50.391337] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:52:50.391505] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-17T21:52:50.391543] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-17T21:52:50.391683] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-17T21:52:50.391738] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-17T21:52:50.391783] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-17T21:52:50.391816] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-17T21:52:50.762012] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:52:50.942307] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-17T21:52:51.648323] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T21:52:51.742325] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-10-17T21:52:52.340541] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:52:52.340918] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-10-17T21:52:52.341008] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:52:52.341056] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-17T21:52:52.341127] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:52:52.341200] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-17T21:52:52.341265] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-17T21:52:52.341303] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-17T21:52:52.341343] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-17T21:52:52.341406] [INFO ] [MAIN ] Update Progress: 2075/2368 symbols completed. TGE took 2.1s. Estimated remaining: 41m 21s. Rate: 7.1 symbols/min [2025-10-17T21:52:52.510471] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T21:52:52.553070] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:52:52.549183] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-17T21:52:52.584497] [DEBUG] [LOCAL ] TGLS: Loaded 27778 existing records from primary storage. [2025-10-17T21:52:52.584827] [INFO ] [MAIN ] TGLS: Loaded 27778 existing records. [2025-10-17T21:52:52.763536] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:52:52.763774] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-17T21:52:52.763829] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-17T21:52:52.764030] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-17T21:52:52.764087] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-17T21:52:53.156750] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:52:53.344683] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-10-17T21:52:53.347539] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-17T21:52:54.142255] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-17T21:52:54.535568] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-17T21:52:54.942343] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-17T21:52:55.742376] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-17T21:52:55.771545] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T21:52:56.170506] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-17T21:52:56.542285] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-17T21:52:57.072491] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T21:52:57.342273] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-17T21:52:58.067413] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-17T21:52:58.142308] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-17T21:52:58.412806] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-17T21:52:58.942308] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-17T21:52:59.656943] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-17T21:52:59.742253] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-17T21:53:00.506530] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T21:53:00.514124] [INFO ] [REMOTE ] TFPM: Full fetch complete (52714 records). [2025-10-17T21:53:00.514285] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-17T21:53:00.547493] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-17T21:53:00.908270] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-17T21:53:00.908353] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-17T21:53:00.909435] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-17T21:53:00.909500] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-17T21:53:00.910619] [DEBUG] [LOCAL ] TFPM: Trimmed 52714 records to 40129 (keeping 200 days of data) [2025-10-17T21:53:01.156586] [DEBUG] [LOCAL ] TFPM: Primary data saved (40129 records). [2025-10-17T21:53:01.156738] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-17T21:53:01.156839] [INFO ] [MAIN ] Update Progress: 2076/2368 symbols completed. TFPM took 32.7s. Estimated remaining: 41m 12s. Rate: 7.1 symbols/min [2025-10-17T21:53:01.335080] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:53:01.342256] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-17T21:53:01.382903] [DEBUG] [LOCAL ] TGNA: Loaded 48978 existing records from primary storage. [2025-10-17T21:53:01.383191] [INFO ] [MAIN ] TGNA: Loaded 48978 existing records. [2025-10-17T21:53:01.564115] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:53:01.565338] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-17T21:53:01.565578] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-17T21:53:01.575260] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-17T21:53:01.580530] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-17T21:53:01.631320] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T21:53:01.757055] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T21:53:02.021834] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:53:02.142299] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-10-17T21:53:02.225053] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-17T21:53:02.942316] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-17T21:53:03.742287] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-17T21:53:03.817994] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T21:53:03.872926] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-17T21:53:04.542333] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-17T21:53:04.931798] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T21:53:05.342294] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-17T21:53:05.933621] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-17T21:53:06.142294] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-17T21:53:06.947631] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-17T21:53:06.963471] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T21:53:07.502305] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T21:53:07.742364] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-17T21:53:08.250399] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T21:53:08.255963] [INFO ] [REMOTE ] TFX: Full fetch complete (54696 records). [2025-10-17T21:53:08.256093] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-17T21:53:08.552145] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-17T21:53:08.656922] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-17T21:53:08.657035] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-17T21:53:08.658768] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-17T21:53:08.658840] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-17T21:53:08.660434] [DEBUG] [LOCAL ] TFX: Trimmed 54696 records to 36700 (keeping 200 days of data) [2025-10-17T21:53:08.917621] [DEBUG] [LOCAL ] TFX: Primary data saved (36700 records). [2025-10-17T21:53:08.918083] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-17T21:53:08.918880] [INFO ] [MAIN ] Update Progress: 2077/2368 symbols completed. TFX took 31.0s. Estimated remaining: 41m 4s. Rate: 7.1 symbols/min [2025-10-17T21:53:09.169267] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T21:53:09.342312] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-17T21:53:10.142300] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-17T21:53:10.234198] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T21:53:10.478719] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T21:53:10.926523] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-17T21:53:10.942250] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-17T21:53:11.594297] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-17T21:53:11.742286] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-17T21:53:12.522517] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-17T21:53:12.542248] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-17T21:53:13.342434] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-17T21:53:13.403538] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-17T21:53:14.142327] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-17T21:53:14.461736] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-17T21:53:14.942283] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-17T21:53:15.083926] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-17T21:53:15.742305] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-17T21:53:16.542298] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-17T21:53:16.590212] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T21:53:16.778964] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T21:53:16.781405] [INFO ] [REMOTE ] TG: Full fetch complete (15123 records). [2025-10-17T21:53:16.781480] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-17T21:53:17.132224] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-17T21:53:17.132311] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-17T21:53:17.132543] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-17T21:53:17.132580] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-17T21:53:17.133074] [DEBUG] [LOCAL ] TG: Trimmed 15123 records to 10766 (keeping 200 days of data) [2025-10-17T21:53:17.191906] [DEBUG] [LOCAL ] TG: Primary data saved (10766 records). [2025-10-17T21:53:17.192021] [INFO ] [MAIN ] TG: Full history saved. [2025-10-17T21:53:17.192110] [INFO ] [MAIN ] Update Progress: 2078/2368 symbols completed. TG took 29.4s. Estimated remaining: 40m 55s. Rate: 7.1 symbols/min [2025-10-17T21:53:17.342313] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-17T21:53:17.918512] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T21:53:18.142333] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-17T21:53:19.091472] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T21:53:19.102466] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-17T21:53:19.427425] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T21:53:19.742314] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-17T21:53:20.672115] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T21:53:20.682385] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-17T21:53:20.907953] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T21:53:20.911513] [INFO ] [REMOTE ] TGLS: Full fetch complete (40447 records). [2025-10-17T21:53:20.911612] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-17T21:53:21.301993] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-17T21:53:21.302092] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-17T21:53:21.302916] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-17T21:53:21.302978] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-17T21:53:21.303841] [DEBUG] [LOCAL ] TGLS: Trimmed 40447 records to 27901 (keeping 200 days of data) [2025-10-17T21:53:21.474167] [DEBUG] [LOCAL ] TGLS: Primary data saved (27901 records). [2025-10-17T21:53:21.474303] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-17T21:53:21.474424] [INFO ] [MAIN ] Update Progress: 2079/2368 symbols completed. TGLS took 29.1s. Estimated remaining: 40m 46s. Rate: 7.1 symbols/min [2025-10-17T21:53:22.285070] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T21:53:22.294511] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-17T21:53:23.941203] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T21:53:23.951405] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-17T21:53:25.883604] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-17T21:53:25.894810] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-17T21:53:27.510162] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T21:53:27.520895] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-17T21:53:29.148176] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T21:53:29.154773] [INFO ] [REMOTE ] TGNA: Full fetch complete (70099 records). [2025-10-17T21:53:29.154883] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-17T21:53:29.541067] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-17T21:53:29.541170] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-17T21:53:29.542284] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-17T21:53:29.542347] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-17T21:53:29.543760] [DEBUG] [LOCAL ] TGNA: Trimmed 70099 records to 49331 (keeping 200 days of data) [2025-10-17T21:53:29.853234] [DEBUG] [LOCAL ] TGNA: Primary data saved (49331 records). [2025-10-17T21:53:29.853378] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-17T21:53:29.853481] [INFO ] [MAIN ] Update Progress: 2080/2368 symbols completed. TGNA took 28.7s. Estimated remaining: 40m 38s. Rate: 7.1 symbols/min [2025-10-17T21:53:30.532407] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:53:30.536336] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:53:30.528851] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:53:30.560896] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:53:30.596518] [DEBUG] [LOCAL ] THG: Loaded 21941 existing records from primary storage. [2025-10-17T21:53:30.596851] [INFO ] [MAIN ] THG: Loaded 21941 existing records. [2025-10-17T21:53:30.702507] [DEBUG] [LOCAL ] TGS: Loaded 33802 existing records from primary storage. [2025-10-17T21:53:30.733703] [INFO ] [MAIN ] TGS: Loaded 33802 existing records. [2025-10-17T21:53:30.803307] [DEBUG] [LOCAL ] THC: Loaded 47312 existing records from primary storage. [2025-10-17T21:53:30.903607] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:53:30.897335] [INFO ] [MAIN ] THC: Loaded 47312 existing records. [2025-10-17T21:53:30.954334] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-17T21:53:30.969909] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-17T21:53:30.985693] [DEBUG] [LOCAL ] TGT: Loaded 54168 existing records from primary storage. [2025-10-17T21:53:31.034597] [INFO ] [MAIN ] TGT: Loaded 54168 existing records. [2025-10-17T21:53:31.034372] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-17T21:53:31.095297] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:53:31.092099] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-17T21:53:31.150234] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-17T21:53:31.170726] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-17T21:53:31.228838] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-17T21:53:31.265304] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-17T21:53:31.564465] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:53:31.646551] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-17T21:53:31.714308] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:53:31.710988] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-17T21:53:31.725721] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-17T21:53:31.753980] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-17T21:53:31.761117] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-17T21:53:31.778477] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-17T21:53:31.837330] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-17T21:53:31.962133] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-17T21:53:32.424492] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:53:32.549155] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-10-17T21:53:32.624276] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:53:32.656977] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-10-17T21:53:32.833492] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:53:32.847020] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-10-17T21:53:32.938566] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:53:32.938971] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-10-17T21:53:33.683759] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-17T21:53:33.688200] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-17T21:53:34.030308] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T21:53:34.037139] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-17T21:53:34.482498] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T21:53:34.492512] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-17T21:53:34.534802] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-17T21:53:34.543953] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-17T21:53:35.243251] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-17T21:53:35.255160] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-17T21:53:35.405585] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T21:53:35.413416] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-17T21:53:35.698161] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T21:53:35.704903] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-17T21:53:36.120131] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T21:53:36.130925] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-17T21:53:36.719009] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T21:53:36.725867] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-17T21:53:36.750240] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T21:53:36.756200] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-17T21:53:36.855793] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T21:53:36.866468] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-17T21:53:37.789688] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T21:53:37.800107] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-17T21:53:38.070713] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T21:53:38.089083] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-17T21:53:38.089524] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-17T21:53:38.142272] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-17T21:53:38.602633] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T21:53:38.942267] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-17T21:53:39.294024] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T21:53:39.293431] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T21:53:39.530233] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T21:53:39.742307] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-17T21:53:40.542357] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-17T21:53:41.096752] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-17T21:53:41.342266] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-17T21:53:41.552388] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-17T21:53:42.142345] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-17T21:53:42.471278] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T21:53:42.502889] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T21:53:42.942277] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-17T21:53:43.226758] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-17T21:53:43.742327] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-17T21:53:44.542322] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-17T21:53:45.040803] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-17T21:53:45.348498] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-17T21:53:45.377498] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-17T21:53:46.142325] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-17T21:53:46.281197] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T21:53:46.443059] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T21:53:46.942354] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-17T21:53:47.601515] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T21:53:47.742313] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-17T21:53:48.542294] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-17T21:53:49.309540] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-17T21:53:49.342240] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-17T21:53:49.488636] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-17T21:53:49.554714] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T21:53:50.142343] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-17T21:53:50.942351] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-17T21:53:51.757707] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-17T21:53:51.765731] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-17T21:53:52.293334] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-17T21:53:52.542403] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-17T21:53:52.651708] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T21:53:52.765587] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T21:53:52.769510] [INFO ] [REMOTE ] THG: Full fetch complete (31417 records). [2025-10-17T21:53:52.769791] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-17T21:53:53.192435] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-17T21:53:53.192541] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-17T21:53:53.193307] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-17T21:53:53.193374] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-17T21:53:53.194306] [DEBUG] [LOCAL ] THG: Trimmed 31417 records to 22090 (keeping 200 days of data) [2025-10-17T21:53:53.332406] [DEBUG] [LOCAL ] THG: Primary data saved (22090 records). [2025-10-17T21:53:53.332529] [INFO ] [MAIN ] THG: Full history saved. [2025-10-17T21:53:53.332608] [INFO ] [MAIN ] Update Progress: 2081/2368 symbols completed. THG took 23.4s. Estimated remaining: 40m 31s. Rate: 7.1 symbols/min [2025-10-17T21:53:53.347459] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-17T21:53:53.500093] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:53:53.505076] [DEBUG] [LOCAL ] THIR: Loaded 2404 existing records from primary storage. [2025-10-17T21:53:53.505242] [INFO ] [MAIN ] THIR: Loaded 2404 existing records. [2025-10-17T21:53:53.677574] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:53:53.677838] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-17T21:53:53.677900] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-17T21:53:53.678036] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-17T21:53:53.678075] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-17T21:53:54.028812] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:53:54.142342] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-10-17T21:53:54.571289] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-17T21:53:54.870220] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-17T21:53:54.942321] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-17T21:53:55.016240] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T21:53:55.277190] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-17T21:53:55.742330] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-17T21:53:56.542303] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-17T21:53:57.335081] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T21:53:57.344185] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-17T21:53:57.737390] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-17T21:53:57.857366] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T21:53:57.862723] [INFO ] [REMOTE ] TGS: Full fetch complete (48603 records). [2025-10-17T21:53:57.862817] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-17T21:53:58.147709] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-17T21:53:58.255495] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-17T21:53:58.255573] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-17T21:53:58.256579] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-17T21:53:58.256664] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-17T21:53:58.257764] [DEBUG] [LOCAL ] TGS: Trimmed 48603 records to 33978 (keeping 200 days of data) [2025-10-17T21:53:58.454973] [DEBUG] [LOCAL ] TGS: Primary data saved (33978 records). [2025-10-17T21:53:58.455112] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-17T21:53:58.455205] [INFO ] [MAIN ] Update Progress: 2082/2368 symbols completed. TGS took 28.6s. Estimated remaining: 40m 22s. Rate: 7.1 symbols/min [2025-10-17T21:53:58.620294] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:53:58.624179] [DEBUG] [LOCAL ] THLV: Loaded 1530 existing records from primary storage. [2025-10-17T21:53:58.624318] [INFO ] [MAIN ] THLV: Loaded 1530 existing records. [2025-10-17T21:53:58.796422] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:53:58.796637] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-17T21:53:58.796719] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-17T21:53:58.796847] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-17T21:53:58.796885] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-17T21:53:58.947377] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-17T21:53:59.151763] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:53:59.390878] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-17T21:53:59.609263] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T21:53:59.742287] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-17T21:54:00.542324] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-17T21:54:01.342320] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-17T21:54:01.769990] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-17T21:54:01.880466] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-17T21:54:01.887108] [INFO ] [REMOTE ] THC: Full fetch complete (68836 records). [2025-10-17T21:54:01.887308] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-17T21:54:02.144387] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-17T21:54:02.294278] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-17T21:54:02.359008] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-17T21:54:02.359093] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-17T21:54:02.360548] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-17T21:54:02.360639] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-17T21:54:02.362108] [DEBUG] [LOCAL ] THC: Trimmed 68836 records to 47601 (keeping 200 days of data) [2025-10-17T21:54:02.648254] [DEBUG] [LOCAL ] THC: Primary data saved (47601 records). [2025-10-17T21:54:02.648391] [INFO ] [MAIN ] THC: Full history saved. [2025-10-17T21:54:02.648487] [INFO ] [MAIN ] Update Progress: 2083/2368 symbols completed. THC took 32.8s. Estimated remaining: 40m 13s. Rate: 7.1 symbols/min [2025-10-17T21:54:02.714096] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-17T21:54:02.817661] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:54:02.855897] [DEBUG] [LOCAL ] THO: Loaded 41680 existing records from primary storage. [2025-10-17T21:54:02.856184] [INFO ] [MAIN ] THO: Loaded 41680 existing records. [2025-10-17T21:54:02.949438] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-17T21:54:03.030075] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:54:03.030311] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-17T21:54:03.030359] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-17T21:54:03.030583] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-17T21:54:03.030621] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-17T21:54:03.413069] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:54:03.429188] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-17T21:54:03.742309] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-17T21:54:04.542290] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-10-17T21:54:05.118203] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-17T21:54:05.342362] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-17T21:54:05.810239] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-17T21:54:06.142297] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-17T21:54:06.215721] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-17T21:54:06.451445] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-17T21:54:06.942315] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-10-17T21:54:07.742315] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-17T21:54:08.219264] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T21:54:08.247823] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-17T21:54:08.542309] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-17T21:54:09.084474] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-17T21:54:09.342296] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-17T21:54:10.023686] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T21:54:10.031080] [INFO ] [REMOTE ] TGT: Full fetch complete (77956 records). [2025-10-17T21:54:10.031200] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-17T21:54:10.147463] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-17T21:54:10.424155] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-17T21:54:10.424239] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-17T21:54:10.425418] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-17T21:54:10.425482] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-17T21:54:10.426929] [DEBUG] [LOCAL ] TGT: Trimmed 77956 records to 54558 (keeping 200 days of data) [2025-10-17T21:54:10.746083] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-17T21:54:10.773929] [DEBUG] [LOCAL ] TGT: Primary data saved (54558 records). [2025-10-17T21:54:10.774048] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-17T21:54:10.774129] [INFO ] [MAIN ] Update Progress: 2084/2368 symbols completed. TGT took 40.9s. Estimated remaining: 40m 5s. Rate: 7.1 symbols/min [2025-10-17T21:54:10.942130] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:54:10.942271] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-17T21:54:10.970497] [DEBUG] [LOCAL ] THQ: Loaded 25501 existing records from primary storage. [2025-10-17T21:54:10.970812] [INFO ] [MAIN ] THQ: Loaded 25501 existing records. [2025-10-17T21:54:11.144856] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:54:11.145073] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-17T21:54:11.145127] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-17T21:54:11.145292] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-17T21:54:11.145330] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-17T21:54:11.459450] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-17T21:54:11.499472] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:54:11.742271] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-10-17T21:54:12.542298] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-17T21:54:12.893756] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T21:54:13.342352] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-17T21:54:14.087954] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T21:54:14.142252] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-17T21:54:14.516370] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-17T21:54:14.942351] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-17T21:54:15.398051] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-17T21:54:15.399391] [INFO ] [REMOTE ] THIR: Full fetch complete (2892 records). [2025-10-17T21:54:15.399475] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-17T21:54:15.746794] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-17T21:54:15.774501] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-17T21:54:15.774769] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-17T21:54:15.774979] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-17T21:54:15.775066] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-17T21:54:15.775806] [DEBUG] [LOCAL ] THIR: Trimmed 2892 records to 2413 (keeping 200 days of data) [2025-10-17T21:54:15.814966] [DEBUG] [LOCAL ] THIR: Primary data saved (2413 records). [2025-10-17T21:54:15.815943] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-17T21:54:15.816065] [INFO ] [MAIN ] Update Progress: 2085/2368 symbols completed. THIR took 22.5s. Estimated remaining: 39m 56s. Rate: 7.1 symbols/min [2025-10-17T21:54:15.818168] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T21:54:15.997375] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:54:16.016890] [DEBUG] [LOCAL ] THR: Loaded 19933 existing records from primary storage. [2025-10-17T21:54:16.017192] [INFO ] [MAIN ] THR: Loaded 19933 existing records. [2025-10-17T21:54:16.189682] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:54:16.189891] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-17T21:54:16.189936] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-17T21:54:16.190099] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-17T21:54:16.190136] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-17T21:54:16.290509] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-17T21:54:16.535444] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:54:16.542245] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-10-17T21:54:17.342317] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-17T21:54:17.583078] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T21:54:18.142303] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-17T21:54:18.323119] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T21:54:18.942285] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-17T21:54:19.067055] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-17T21:54:19.742277] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-17T21:54:19.976873] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-17T21:54:20.542264] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-17T21:54:20.863330] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T21:54:20.965264] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-17T21:54:21.342346] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-17T21:54:22.142297] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-17T21:54:22.388231] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-17T21:54:22.478487] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-17T21:54:22.942290] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-17T21:54:23.742448] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-17T21:54:24.112344] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T21:54:24.542327] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-17T21:54:25.082016] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T21:54:25.342264] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-17T21:54:25.676809] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-17T21:54:25.706057] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T21:54:26.142322] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-17T21:54:26.590920] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-17T21:54:26.942272] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-17T21:54:27.742288] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-17T21:54:28.146137] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T21:54:28.542303] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-17T21:54:28.871429] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-17T21:54:29.103079] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T21:54:29.342291] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-17T21:54:29.625176] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-17T21:54:29.626045] [INFO ] [REMOTE ] THLV: Full fetch complete (2554 records). [2025-10-17T21:54:29.626116] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-17T21:54:29.987718] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-17T21:54:29.987813] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-17T21:54:29.987930] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-17T21:54:29.987970] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-17T21:54:29.988291] [DEBUG] [LOCAL ] THLV: Trimmed 2554 records to 1535 (keeping 200 days of data) [2025-10-17T21:54:29.997291] [DEBUG] [LOCAL ] THLV: Primary data saved (1535 records). [2025-10-17T21:54:29.997351] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-17T21:54:29.997429] [INFO ] [MAIN ] Update Progress: 2086/2368 symbols completed. THLV took 31.5s. Estimated remaining: 39m 48s. Rate: 7.1 symbols/min [2025-10-17T21:54:30.163846] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:54:30.160518] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-17T21:54:30.200777] [DEBUG] [LOCAL ] THS: Loaded 38873 existing records from primary storage. [2025-10-17T21:54:30.201049] [INFO ] [MAIN ] THS: Loaded 38873 existing records. [2025-10-17T21:54:30.372204] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:54:30.372418] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-17T21:54:30.372465] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-17T21:54:30.372674] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-17T21:54:30.372730] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-17T21:54:30.717942] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:54:30.942263] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-10-17T21:54:31.742321] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-17T21:54:31.945833] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T21:54:32.343187] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-17T21:54:32.542337] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-17T21:54:33.041007] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T21:54:33.342329] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-17T21:54:33.921705] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T21:54:34.142320] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-17T21:54:34.476826] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T21:54:34.942304] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-17T21:54:35.575842] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T21:54:35.742328] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-17T21:54:36.021307] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T21:54:36.026117] [INFO ] [REMOTE ] THQ: Full fetch complete (34932 records). [2025-10-17T21:54:36.026335] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-17T21:54:36.386204] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-17T21:54:36.386273] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-17T21:54:36.386908] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-17T21:54:36.386969] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-17T21:54:36.387731] [DEBUG] [LOCAL ] THQ: Trimmed 34932 records to 25643 (keeping 200 days of data) [2025-10-17T21:54:36.543152] [DEBUG] [LOCAL ] THQ: Primary data saved (25643 records). [2025-10-17T21:54:36.543231] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-17T21:54:36.544200] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-17T21:54:36.544307] [INFO ] [MAIN ] Update Progress: 2087/2368 symbols completed. THQ took 25.8s. Estimated remaining: 39m 39s. Rate: 7.1 symbols/min [2025-10-17T21:54:36.711144] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:54:36.731051] [DEBUG] [LOCAL ] THW: Loaded 19846 existing records from primary storage. [2025-10-17T21:54:36.731296] [INFO ] [MAIN ] THW: Loaded 19846 existing records. [2025-10-17T21:54:36.906625] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:54:36.906906] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-17T21:54:36.907028] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-17T21:54:36.907200] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-17T21:54:36.907239] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-17T21:54:37.266050] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:54:37.288067] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T21:54:37.342246] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-17T21:54:37.696355] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-17T21:54:38.142330] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-17T21:54:38.792607] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T21:54:38.844267] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-17T21:54:38.942253] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-17T21:54:39.742303] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-17T21:54:40.164512] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-17T21:54:40.542348] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-17T21:54:41.187330] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T21:54:41.342382] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-17T21:54:42.142274] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-10-17T21:54:42.226083] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T21:54:42.717085] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T21:54:42.942317] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-17T21:54:43.241683] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T21:54:43.742342] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-17T21:54:44.388772] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T21:54:44.542345] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-17T21:54:45.342357] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-10-17T21:54:45.413239] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T21:54:45.814607] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T21:54:46.142266] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-17T21:54:46.353505] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T21:54:46.942308] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-17T21:54:47.610584] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T21:54:47.742305] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-17T21:54:48.542338] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-10-17T21:54:48.579027] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T21:54:48.722276] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T21:54:49.342373] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-17T21:54:49.611957] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T21:54:50.142309] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-17T21:54:50.629210] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T21:54:50.942297] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-17T21:54:51.134706] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T21:54:51.742280] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-10. [2025-10-17T21:54:51.908077] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T21:54:52.542273] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-17T21:54:52.620189] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-17T21:54:52.623084] [INFO ] [REMOTE ] THR: Full fetch complete (28856 records). [2025-10-17T21:54:52.623157] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-17T21:54:52.997343] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-17T21:54:52.997423] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-17T21:54:52.998112] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-17T21:54:52.998177] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-17T21:54:52.998950] [DEBUG] [LOCAL ] THR: Trimmed 28856 records to 20074 (keeping 200 days of data) [2025-10-17T21:54:53.118756] [DEBUG] [LOCAL ] THR: Primary data saved (20074 records). [2025-10-17T21:54:53.118884] [INFO ] [MAIN ] THR: Full history saved. [2025-10-17T21:54:53.118963] [INFO ] [MAIN ] Update Progress: 2088/2368 symbols completed. THR took 37.3s. Estimated remaining: 39m 32s. Rate: 7.1 symbols/min [2025-10-17T21:54:53.297183] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:54:53.298050] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-17T21:54:53.298106] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-17T21:54:53.298334] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-17T21:54:53.298415] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-17T21:54:53.298494] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-17T21:54:53.298541] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-17T21:54:53.360189] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-17T21:54:53.570255] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-17T21:54:53.671312] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:54:54.142289] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-10-17T21:54:54.341375] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:54:54.341756] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-10-17T21:54:54.341863] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:54:54.341962] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-17T21:54:54.342041] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:54:54.342127] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-17T21:54:54.342202] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-17T21:54:54.342240] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-17T21:54:54.342281] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-17T21:54:54.342327] [INFO ] [MAIN ] Update Progress: 2089/2368 symbols completed. TIC took 1.2s. Estimated remaining: 39m 23s. Rate: 7.1 symbols/min [2025-10-17T21:54:54.511709] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:54:54.545894] [DEBUG] [LOCAL ] TIMB: Loaded 35551 existing records from primary storage. [2025-10-17T21:54:54.546174] [INFO ] [MAIN ] TIMB: Loaded 35551 existing records. [2025-10-17T21:54:54.727418] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:54:54.740624] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-17T21:54:54.740777] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-17T21:54:54.741761] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T21:54:54.741796] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-17T21:54:54.741910] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-17T21:54:54.810278] [INFO ] [REMOTE ] THS: Full fetch complete (54440 records). [2025-10-17T21:54:54.821464] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-17T21:54:54.947400] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-17T21:54:55.439220] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:54:55.501391] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-17T21:54:55.501467] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-17T21:54:55.502485] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-17T21:54:55.502548] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-17T21:54:55.503721] [DEBUG] [LOCAL ] THS: Trimmed 54440 records to 39102 (keeping 200 days of data) [2025-10-17T21:54:55.729502] [DEBUG] [LOCAL ] THS: Primary data saved (39102 records). [2025-10-17T21:54:55.729660] [INFO ] [MAIN ] THS: Full history saved. [2025-10-17T21:54:55.730412] [INFO ] [MAIN ] Update Progress: 2090/2368 symbols completed. THS took 25.7s. Estimated remaining: 39m 13s. Rate: 7.1 symbols/min [2025-10-17T21:54:55.750818] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-10-17T21:54:55.901892] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:54:55.908884] [DEBUG] [LOCAL ] TISI: Loaded 3349 existing records from primary storage. [2025-10-17T21:54:55.909098] [INFO ] [MAIN ] TISI: Loaded 3349 existing records. [2025-10-17T21:54:56.081710] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:54:56.081949] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-17T21:54:56.081996] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-17T21:54:56.082153] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-17T21:54:56.082208] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-17T21:54:56.434318] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:54:56.522544] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T21:54:56.542254] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-17T21:54:57.342298] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-17T21:54:57.387444] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T21:54:58.142265] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-17T21:54:58.365967] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-17T21:54:58.454744] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T21:54:58.942345] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-17T21:54:59.558634] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T21:54:59.742324] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-17T21:54:59.961134] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-17T21:55:00.542334] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-17T21:55:00.970166] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T21:55:01.342318] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-17T21:55:01.944210] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-17T21:55:01.949870] [INFO ] [REMOTE ] THO: Full fetch complete (60125 records). [2025-10-17T21:55:01.950023] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-17T21:55:02.142520] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-10-17T21:55:02.393375] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-17T21:55:02.393471] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-17T21:55:02.394567] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-17T21:55:02.394631] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-17T21:55:02.396070] [DEBUG] [LOCAL ] THO: Trimmed 60125 records to 41853 (keeping 200 days of data) [2025-10-17T21:55:02.653818] [DEBUG] [LOCAL ] THO: Primary data saved (41853 records). [2025-10-17T21:55:02.653947] [INFO ] [MAIN ] THO: Full history saved. [2025-10-17T21:55:02.654030] [INFO ] [MAIN ] Update Progress: 2091/2368 symbols completed. THO took 1m 0s. Estimated remaining: 39m 5s. Rate: 7.1 symbols/min [2025-10-17T21:55:02.846477] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:55:02.879221] [DEBUG] [LOCAL ] TIXT: Loaded 32709 existing records from primary storage. [2025-10-17T21:55:02.879526] [INFO ] [MAIN ] TIXT: Loaded 32709 existing records. [2025-10-17T21:55:02.948065] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-17T21:55:02.994738] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T21:55:03.104706] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T21:55:03.119377] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:55:03.129023] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-17T21:55:03.129578] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-17T21:55:03.129833] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-17T21:55:03.129965] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-17T21:55:03.487730] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:55:03.742301] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-17T21:55:04.086870] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T21:55:04.542367] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-10-17T21:55:05.355834] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-17T21:55:05.357705] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T21:55:05.844177] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T21:55:05.867305] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-17T21:55:06.142278] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-17T21:55:06.618529] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-17T21:55:06.942306] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-17T21:55:07.742267] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-17T21:55:07.754236] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-17T21:55:08.542269] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-17T21:55:08.755245] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-17T21:55:09.342292] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-17T21:55:09.892968] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T21:55:10.055672] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-17T21:55:10.142322] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-17T21:55:10.942364] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-17T21:55:11.545834] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T21:55:11.658753] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-17T21:55:11.742333] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-17T21:55:12.542323] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-17T21:55:12.888219] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T21:55:13.342297] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-17T21:55:13.539738] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-17T21:55:14.142302] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-17T21:55:14.866465] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T21:55:14.889190] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-17T21:55:14.942264] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-17T21:55:15.742272] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-17T21:55:16.184687] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-17T21:55:16.542339] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-17T21:55:16.994487] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-17T21:55:17.122138] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-17T21:55:17.342326] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-17T21:55:18.142290] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-17T21:55:18.436530] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-17T21:55:18.780309] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-17T21:55:18.942278] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-17T21:55:19.742309] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-17T21:55:20.169214] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-17T21:55:20.185134] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-17T21:55:20.542355] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-17T21:55:21.342255] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-17T21:55:21.656263] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-17T21:55:21.660694] [INFO ] [REMOTE ] TIMB: Full fetch complete (53362 records). [2025-10-17T21:55:21.660860] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-17T21:55:22.050117] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T21:55:22.050265] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-17T21:55:22.050366] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-17T21:55:22.054200] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-17T21:55:22.054410] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-17T21:55:22.054596] [INFO ] [REMOTE ] THW: Full fetch complete (28883 records). [2025-10-17T21:55:22.054698] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-17T21:55:22.132239] [DEBUG] [LOCAL ] TIMB: Trimmed 53362 records to 35736 (keeping 200 days of data) [2025-10-17T21:55:22.147459] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-17T21:55:22.558698] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-17T21:55:22.559091] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-17T21:55:22.560181] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-17T21:55:22.560264] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-17T21:55:22.568926] [DEBUG] [LOCAL ] THW: Trimmed 28883 records to 19941 (keeping 200 days of data) [2025-10-17T21:55:22.786632] [DEBUG] [LOCAL ] TIMB: Primary data saved (35736 records). [2025-10-17T21:55:22.793261] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-17T21:55:22.793173] [DEBUG] [LOCAL ] THW: Primary data saved (19941 records). [2025-10-17T21:55:22.793362] [INFO ] [MAIN ] THW: Full history saved. [2025-10-17T21:55:22.793529] [INFO ] [MAIN ] Update Progress: 2092/2368 symbols completed. THW took 46.2s. Estimated remaining: 38m 58s. Rate: 7.1 symbols/min [2025-10-17T21:55:22.793855] [INFO ] [MAIN ] Update Progress: 2093/2368 symbols completed. TIMB took 28.5s. Estimated remaining: 38m 48s. Rate: 7.1 symbols/min [2025-10-17T21:55:22.942472] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-17T21:55:23.191515] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:55:23.187990] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:55:23.250389] [DEBUG] [LOCAL ] TK: Loaded 39426 existing records from primary storage. [2025-10-17T21:55:23.250871] [INFO ] [MAIN ] TK: Loaded 39426 existing records. [2025-10-17T21:55:23.372186] [DEBUG] [LOCAL ] TJX: Loaded 54057 existing records from primary storage. [2025-10-17T21:55:23.390904] [INFO ] [MAIN ] TJX: Loaded 54057 existing records. [2025-10-17T21:55:23.521250] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-17T21:55:23.573378] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T21:55:23.604791] [INFO ] [REMOTE ] TISI: Full fetch complete (4886 records). [2025-10-17T21:55:23.603323] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:55:23.610638] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-17T21:55:23.610788] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-17T21:55:23.605235] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-17T21:55:23.653629] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-17T21:55:23.678112] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-17T21:55:23.745533] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-17T21:55:23.773577] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:55:23.856326] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-17T21:55:23.872305] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-17T21:55:23.924765] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-17T21:55:23.938822] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-17T21:55:24.614699] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-17T21:55:24.704300] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-17T21:55:24.754752] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:55:24.772059] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-10-17T21:55:24.772376] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-17T21:55:24.773288] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-17T21:55:24.802363] [DEBUG] [LOCAL ] TISI: Trimmed 4886 records to 3366 (keeping 200 days of data) [2025-10-17T21:55:24.856697] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:55:24.876623] [DEBUG] [LOCAL ] TISI: Primary data saved (3366 records). [2025-10-17T21:55:24.876717] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-17T21:55:24.876804] [INFO ] [MAIN ] Update Progress: 2094/2368 symbols completed. TISI took 29.1s. Estimated remaining: 38m 39s. Rate: 7.1 symbols/min [2025-10-17T21:55:25.010907] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-17T21:55:25.065187] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:55:25.108372] [DEBUG] [LOCAL ] TKC: Loaded 39841 existing records from primary storage. [2025-10-17T21:55:25.108701] [INFO ] [MAIN ] TKC: Loaded 39841 existing records. [2025-10-17T21:55:25.280279] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:55:25.280524] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-17T21:55:25.280571] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-17T21:55:25.280772] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-17T21:55:25.280828] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-17T21:55:25.347577] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-17T21:55:25.636431] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:55:26.142295] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-10-17T21:55:26.278036] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T21:55:26.696822] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-17T21:55:26.942325] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-17T21:55:27.742261] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-17T21:55:28.089789] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-17T21:55:28.503840] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T21:55:28.542244] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-17T21:55:28.662816] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-17T21:55:29.342301] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-10-17T21:55:29.912877] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-17T21:55:30.142311] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-17T21:55:30.708379] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-17T21:55:30.942337] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-17T21:55:31.316885] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-17T21:55:31.742294] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-17T21:55:32.345679] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T21:55:32.542293] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-10-17T21:55:33.342316] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-17T21:55:33.524061] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T21:55:34.053840] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T21:55:34.142269] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-10-17T21:55:34.721764] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-17T21:55:34.942288] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-17T21:55:35.709920] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T21:55:35.742298] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-10-17T21:55:36.094012] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-17T21:55:36.542302] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-17T21:55:37.227383] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T21:55:37.342358] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-10-17T21:55:38.067932] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-17T21:55:38.142284] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-17T21:55:38.786471] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-17T21:55:38.942348] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-17T21:55:39.642883] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-17T21:55:39.742301] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-17T21:55:40.542316] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-10-17T21:55:40.800347] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-17T21:55:41.318873] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T21:55:41.342300] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-17T21:55:42.139728] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T21:55:42.147035] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-17T21:55:42.944310] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-17T21:55:42.946562] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-17T21:55:43.742261] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-17T21:55:44.099591] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-17T21:55:44.426153] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T21:55:44.542255] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-17T21:55:45.306683] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T21:55:45.342268] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-17T21:55:45.756687] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T21:55:45.762050] [INFO ] [REMOTE ] TIXT: Full fetch complete (46169 records). [2025-10-17T21:55:45.762227] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-17T21:55:46.133377] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-17T21:55:46.133468] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-17T21:55:46.134396] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-17T21:55:46.134461] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-17T21:55:46.135522] [DEBUG] [LOCAL ] TIXT: Trimmed 46169 records to 32881 (keeping 200 days of data) [2025-10-17T21:55:46.183296] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-10-17T21:55:46.325419] [DEBUG] [LOCAL ] TIXT: Primary data saved (32881 records). [2025-10-17T21:55:46.325585] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-17T21:55:46.325706] [INFO ] [MAIN ] Update Progress: 2095/2368 symbols completed. TIXT took 43.7s. Estimated remaining: 38m 32s. Rate: 7.1 symbols/min [2025-10-17T21:55:46.492736] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:55:46.540213] [DEBUG] [LOCAL ] TKO: Loaded 44026 existing records from primary storage. [2025-10-17T21:55:46.540496] [INFO ] [MAIN ] TKO: Loaded 44026 existing records. [2025-10-17T21:55:46.725316] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:55:46.725566] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-17T21:55:46.725615] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-17T21:55:46.725855] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-10-17T21:55:46.725913] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-17T21:55:46.960945] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-17T21:55:47.134113] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:55:47.393820] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-17T21:55:47.427279] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-17T21:55:47.742281] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-17T21:55:48.497928] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T21:55:48.542264] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-17T21:55:49.342279] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-10-17T21:55:49.814273] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-17T21:55:50.142314] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-17T21:55:50.274866] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T21:55:50.621164] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T21:55:50.942299] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-10. [2025-10-17T21:55:51.742311] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-17T21:55:51.918886] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T21:55:52.245965] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T21:55:52.252273] [INFO ] [REMOTE ] TK: Full fetch complete (56309 records). [2025-10-17T21:55:52.252448] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-17T21:55:52.542270] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-10-17T21:55:52.653724] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-17T21:55:52.653807] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-17T21:55:52.654878] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-17T21:55:52.654941] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-17T21:55:52.656023] [DEBUG] [LOCAL ] TK: Trimmed 56309 records to 39692 (keeping 200 days of data) [2025-10-17T21:55:52.880526] [DEBUG] [LOCAL ] TK: Primary data saved (39692 records). [2025-10-17T21:55:52.880674] [INFO ] [MAIN ] TK: Full history saved. [2025-10-17T21:55:52.880771] [INFO ] [MAIN ] Update Progress: 2096/2368 symbols completed. TK took 30.1s. Estimated remaining: 38m 23s. Rate: 7.1 symbols/min [2025-10-17T21:55:53.053598] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:55:53.089407] [DEBUG] [LOCAL ] TKR: Loaded 39969 existing records from primary storage. [2025-10-17T21:55:53.089682] [INFO ] [MAIN ] TKR: Loaded 39969 existing records. [2025-10-17T21:55:53.288089] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:55:53.288477] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-17T21:55:53.288808] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-17T21:55:53.295268] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-17T21:55:53.306159] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-17T21:55:53.356611] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-17T21:55:53.356466] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T21:55:53.405572] [INFO ] [REMOTE ] TKC: Full fetch complete (54109 records). [2025-10-17T21:55:53.434908] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-17T21:55:54.007765] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:55:54.136723] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-17T21:55:54.136823] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-17T21:55:54.137946] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-17T21:55:54.138011] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-17T21:55:54.139319] [DEBUG] [LOCAL ] TKC: Trimmed 54109 records to 40157 (keeping 200 days of data) [2025-10-17T21:55:54.186605] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-10-17T21:55:54.367521] [DEBUG] [LOCAL ] TKC: Primary data saved (40157 records). [2025-10-17T21:55:54.367677] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-17T21:55:54.367996] [INFO ] [MAIN ] Update Progress: 2097/2368 symbols completed. TKC took 29.5s. Estimated remaining: 38m 14s. Rate: 7.1 symbols/min [2025-10-17T21:55:54.540528] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:55:54.578836] [DEBUG] [LOCAL ] TLK: Loaded 39006 existing records from primary storage. [2025-10-17T21:55:54.579164] [INFO ] [MAIN ] TLK: Loaded 39006 existing records. [2025-10-17T21:55:54.802975] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:55:54.798121] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-17T21:55:54.803668] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-17T21:55:54.815334] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-17T21:55:54.816282] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-17T21:55:54.816363] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-17T21:55:54.967605] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-10-17T21:55:55.175052] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:55:55.201623] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T21:55:55.579795] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-17T21:55:55.742367] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-17T21:55:56.542431] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-10-17T21:55:57.070397] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-17T21:55:57.253369] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T21:55:57.342283] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-17T21:55:58.142320] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-10-17T21:55:58.230475] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T21:55:58.813117] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T21:55:58.942268] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-17T21:55:59.742270] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-10-17T21:56:00.068668] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-17T21:56:00.414701] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T21:56:00.542250] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-10-17T21:56:01.342254] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-10. [2025-10-17T21:56:01.418291] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T21:56:02.023206] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T21:56:02.031146] [INFO ] [REMOTE ] TJX: Full fetch complete (77833 records). [2025-10-17T21:56:02.031285] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-17T21:56:02.147482] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-10-17T21:56:02.468397] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-17T21:56:02.468613] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-17T21:56:02.471577] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-17T21:56:02.471703] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-17T21:56:02.501617] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T21:56:02.512914] [DEBUG] [LOCAL ] TJX: Trimmed 77833 records to 54444 (keeping 200 days of data) [2025-10-17T21:56:02.886398] [DEBUG] [LOCAL ] TJX: Primary data saved (54444 records). [2025-10-17T21:56:02.886797] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-17T21:56:02.886926] [INFO ] [MAIN ] Update Progress: 2098/2368 symbols completed. TJX took 40.1s. Estimated remaining: 38m 5s. Rate: 7.1 symbols/min [2025-10-17T21:56:02.954290] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-10-17T21:56:03.069532] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:56:03.090603] [DEBUG] [LOCAL ] TLYS: Loaded 16632 existing records from primary storage. [2025-10-17T21:56:03.090986] [INFO ] [MAIN ] TLYS: Loaded 16632 existing records. [2025-10-17T21:56:03.277111] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:56:03.277433] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-17T21:56:03.277486] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-17T21:56:03.277728] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-17T21:56:03.277813] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-17T21:56:03.643599] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:56:03.742260] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-10-17T21:56:04.076023] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T21:56:04.542307] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-10-17T21:56:04.600370] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T21:56:04.674837] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-17T21:56:05.342296] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-17T21:56:06.142323] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-17T21:56:06.400491] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T21:56:06.743005] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-17T21:56:06.909724] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T21:56:06.942249] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-17T21:56:07.648103] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-17T21:56:07.742265] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-17T21:56:08.542296] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-10-17T21:56:09.192891] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T21:56:09.342354] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-10-17T21:56:09.639149] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T21:56:10.142300] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-10-17T21:56:10.949609] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-17T21:56:10.975334] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T21:56:11.742261] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-10-17T21:56:11.784227] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T21:56:11.872497] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-17T21:56:12.542311] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-10-17T21:56:13.314812] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T21:56:13.342270] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-17T21:56:13.511985] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T21:56:14.142349] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-17T21:56:14.939109] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-17T21:56:14.942400] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-17T21:56:15.064034] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T21:56:15.637763] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-17T21:56:15.742281] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-17T21:56:16.542307] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-10-17T21:56:17.043047] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-17T21:56:17.342304] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-10-17T21:56:18.142306] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-17T21:56:18.209732] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T21:56:18.842575] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T21:56:18.942250] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-10-17T21:56:19.662179] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T21:56:19.742265] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-10. [2025-10-17T21:56:20.542321] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-17T21:56:20.589256] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T21:56:21.058895] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T21:56:21.063925] [INFO ] [REMOTE ] TKR: Full fetch complete (58027 records). [2025-10-17T21:56:21.064009] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-17T21:56:21.352507] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-17T21:56:21.446511] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-17T21:56:21.446590] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-17T21:56:21.447617] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-17T21:56:21.447717] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-17T21:56:21.448839] [DEBUG] [LOCAL ] TKR: Trimmed 58027 records to 40207 (keeping 200 days of data) [2025-10-17T21:56:21.668102] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T21:56:21.705960] [DEBUG] [LOCAL ] TKR: Primary data saved (40207 records). [2025-10-17T21:56:21.706081] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-17T21:56:21.706160] [INFO ] [MAIN ] Update Progress: 2099/2368 symbols completed. TKR took 28.8s. Estimated remaining: 37m 58s. Rate: 7.1 symbols/min [2025-10-17T21:56:21.870531] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:56:21.905775] [DEBUG] [LOCAL ] TM: Loaded 36641 existing records from primary storage. [2025-10-17T21:56:21.906059] [INFO ] [MAIN ] TM: Loaded 36641 existing records. [2025-10-17T21:56:22.080820] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:56:22.081045] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-17T21:56:22.081092] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-17T21:56:22.081306] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-17T21:56:22.081362] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-17T21:56:22.147473] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-17T21:56:22.425738] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:56:22.942259] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-10-17T21:56:23.023543] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T21:56:23.033041] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T21:56:23.742338] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-10-17T21:56:24.542312] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-17T21:56:24.575251] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T21:56:24.629356] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-17T21:56:25.342353] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-10. [2025-10-17T21:56:26.013058] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-17T21:56:26.019832] [INFO ] [REMOTE ] TKO: Full fetch complete (65424 records). [2025-10-17T21:56:26.019955] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-17T21:56:26.146733] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-17T21:56:26.229726] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-17T21:56:26.453096] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-17T21:56:26.453188] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-17T21:56:26.454302] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-17T21:56:26.454366] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-17T21:56:26.455982] [DEBUG] [LOCAL ] TKO: Trimmed 65424 records to 44357 (keeping 200 days of data) [2025-10-17T21:56:26.725864] [DEBUG] [LOCAL ] TKO: Primary data saved (44357 records). [2025-10-17T21:56:26.725987] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-17T21:56:26.726068] [INFO ] [MAIN ] Update Progress: 2100/2368 symbols completed. TKO took 40.4s. Estimated remaining: 37m 49s. Rate: 7.1 symbols/min [2025-10-17T21:56:26.889848] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:56:26.939029] [DEBUG] [LOCAL ] TME: Loaded 53584 existing records from primary storage. [2025-10-17T21:56:26.939331] [INFO ] [MAIN ] TME: Loaded 53584 existing records. [2025-10-17T21:56:26.950581] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-17T21:56:27.122983] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:56:27.123186] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-17T21:56:27.123233] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-17T21:56:27.123431] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-17T21:56:27.123486] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-17T21:56:27.470143] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:56:27.742284] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-17T21:56:27.900967] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T21:56:28.542314] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-17T21:56:28.614151] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T21:56:28.730416] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-17T21:56:29.342317] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-17T21:56:30.071443] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T21:56:30.142364] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-17T21:56:30.777569] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-17T21:56:30.779463] [INFO ] [REMOTE ] TLYS: Full fetch complete (21207 records). [2025-10-17T21:56:30.779537] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-17T21:56:30.928934] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T21:56:30.948838] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-17T21:56:31.193047] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-17T21:56:31.193122] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-17T21:56:31.193561] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-17T21:56:31.193601] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-17T21:56:31.194208] [DEBUG] [LOCAL ] TLYS: Trimmed 21207 records to 16688 (keeping 200 days of data) [2025-10-17T21:56:31.285568] [DEBUG] [LOCAL ] TLYS: Primary data saved (16688 records). [2025-10-17T21:56:31.285731] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-17T21:56:31.285822] [INFO ] [MAIN ] Update Progress: 2101/2368 symbols completed. TLYS took 28.4s. Estimated remaining: 37m 40s. Rate: 7.1 symbols/min [2025-10-17T21:56:31.455164] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:56:31.497502] [DEBUG] [LOCAL ] TMHC: Loaded 45838 existing records from primary storage. [2025-10-17T21:56:31.497881] [INFO ] [MAIN ] TMHC: Loaded 45838 existing records. [2025-10-17T21:56:31.670105] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:56:31.670300] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-17T21:56:31.670346] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-17T21:56:31.670527] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-17T21:56:31.670564] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-17T21:56:31.747378] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-17T21:56:32.020204] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:56:32.542333] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-10-17T21:56:32.731682] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T21:56:33.299677] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T21:56:33.342255] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-10-17T21:56:34.142279] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-17T21:56:34.286619] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T21:56:34.942266] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-17T21:56:35.027711] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T21:56:35.521489] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T21:56:35.742316] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-17T21:56:36.385123] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T21:56:36.390768] [INFO ] [REMOTE ] TLK: Full fetch complete (57478 records). [2025-10-17T21:56:36.390879] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-17T21:56:36.545759] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-17T21:56:36.768819] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-17T21:56:36.768909] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-17T21:56:36.769976] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-17T21:56:36.770041] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-17T21:56:36.771329] [DEBUG] [LOCAL ] TLK: Trimmed 57478 records to 39277 (keeping 200 days of data) [2025-10-17T21:56:37.001328] [DEBUG] [LOCAL ] TLK: Primary data saved (39277 records). [2025-10-17T21:56:37.001490] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-17T21:56:37.002054] [INFO ] [MAIN ] Update Progress: 2102/2368 symbols completed. TLK took 42.6s. Estimated remaining: 37m 32s. Rate: 7.1 symbols/min [2025-10-17T21:56:37.177364] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:56:37.227412] [DEBUG] [LOCAL ] TMO: Loaded 52826 existing records from primary storage. [2025-10-17T21:56:37.227730] [INFO ] [MAIN ] TMO: Loaded 52826 existing records. [2025-10-17T21:56:37.344864] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-17T21:56:37.417233] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:56:37.418406] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-17T21:56:37.418493] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-17T21:56:37.426032] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-17T21:56:37.438886] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-17T21:56:37.462751] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T21:56:37.801716] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:56:38.129091] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T21:56:38.142257] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-10-17T21:56:38.942277] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-17T21:56:39.272219] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-17T21:56:39.742265] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-17T21:56:39.930064] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T21:56:40.512234] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T21:56:40.542250] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-17T21:56:41.342273] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-17T21:56:41.455723] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T21:56:42.142499] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-17T21:56:42.179157] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T21:56:42.942323] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-17T21:56:43.194437] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-17T21:56:43.742325] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-17T21:56:44.004441] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T21:56:44.127569] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-17T21:56:44.542349] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-17T21:56:45.342343] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-17T21:56:45.771321] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T21:56:46.142339] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-17T21:56:46.171289] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T21:56:46.942276] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-17T21:56:47.196742] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T21:56:47.742263] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-17T21:56:48.032718] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-17T21:56:48.542370] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-17T21:56:48.674811] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T21:56:49.157700] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T21:56:49.342254] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-17T21:56:50.128184] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T21:56:50.142255] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-17T21:56:50.942314] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-17T21:56:50.999914] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T21:56:51.657966] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T21:56:51.742307] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-17T21:56:52.542297] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-17T21:56:52.574870] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T21:56:53.322579] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T21:56:53.342243] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-17T21:56:53.540684] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T21:56:53.546937] [INFO ] [REMOTE ] TM: Full fetch complete (52219 records). [2025-10-17T21:56:53.547119] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-17T21:56:53.942521] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-17T21:56:53.942604] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-17T21:56:53.943745] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-17T21:56:53.943811] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-17T21:56:53.944967] [DEBUG] [LOCAL ] TM: Trimmed 52219 records to 36853 (keeping 200 days of data) [2025-10-17T21:56:54.154485] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-17T21:56:54.188531] [DEBUG] [LOCAL ] TM: Primary data saved (36853 records). [2025-10-17T21:56:54.188705] [INFO ] [MAIN ] TM: Full history saved. [2025-10-17T21:56:54.188801] [INFO ] [MAIN ] Update Progress: 2103/2368 symbols completed. TM took 32.5s. Estimated remaining: 37m 24s. Rate: 7.1 symbols/min [2025-10-17T21:56:54.355568] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:56:54.370478] [DEBUG] [LOCAL ] TNC: Loaded 14518 existing records from primary storage. [2025-10-17T21:56:54.370733] [INFO ] [MAIN ] TNC: Loaded 14518 existing records. [2025-10-17T21:56:54.542850] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:56:54.543046] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-17T21:56:54.543092] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-17T21:56:54.543239] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-17T21:56:54.543277] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-17T21:56:54.909760] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:56:54.942248] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-10-17T21:56:55.120516] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T21:56:55.743815] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T21:56:55.742844] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-17T21:56:56.022049] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T21:56:56.542291] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-17T21:56:57.342280] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-17T21:56:57.553903] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T21:56:57.646422] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T21:56:58.142354] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-17T21:56:58.942268] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-17T21:56:59.150744] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-17T21:56:59.298228] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-17T21:56:59.742291] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-17T21:57:00.542315] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-17T21:57:01.050233] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-17T21:57:01.342258] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-17T21:57:01.495729] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T21:57:02.142275] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-17T21:57:02.305849] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T21:57:02.434025] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T21:57:02.942348] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-17T21:57:03.742301] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-17T21:57:03.864998] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T21:57:04.542277] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-17T21:57:04.809081] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T21:57:04.966363] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-17T21:57:05.342346] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-17T21:57:06.142308] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-17T21:57:06.579521] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T21:57:06.819720] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T21:57:06.826454] [INFO ] [REMOTE ] TMHC: Full fetch complete (66416 records). [2025-10-17T21:57:06.826620] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-17T21:57:06.947388] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-17T21:57:07.214604] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-17T21:57:07.214718] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-17T21:57:07.215851] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-17T21:57:07.215914] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-17T21:57:07.217208] [DEBUG] [LOCAL ] TMHC: Trimmed 66416 records to 46217 (keeping 200 days of data) [2025-10-17T21:57:07.487164] [DEBUG] [LOCAL ] TMHC: Primary data saved (46217 records). [2025-10-17T21:57:07.487293] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-17T21:57:07.487372] [INFO ] [MAIN ] Update Progress: 2104/2368 symbols completed. TMHC took 36.2s. Estimated remaining: 37m 16s. Rate: 7.1 symbols/min [2025-10-17T21:57:07.661025] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:57:07.688992] [DEBUG] [LOCAL ] TNET: Loaded 28518 existing records from primary storage. [2025-10-17T21:57:07.689259] [INFO ] [MAIN ] TNET: Loaded 28518 existing records. [2025-10-17T21:57:07.751458] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-17T21:57:07.873337] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:57:07.874193] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-17T21:57:07.874476] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-17T21:57:07.874895] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-17T21:57:07.874958] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-17T21:57:08.033214] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-17T21:57:08.031598] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T21:57:08.078816] [INFO ] [REMOTE ] TME: Full fetch complete (77163 records). [2025-10-17T21:57:08.079199] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-17T21:57:08.507972] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:57:08.548207] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-17T21:57:08.724456] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-17T21:57:08.724547] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-17T21:57:08.725934] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-17T21:57:08.726002] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-17T21:57:08.727559] [DEBUG] [LOCAL ] TME: Trimmed 77163 records to 53970 (keeping 200 days of data) [2025-10-17T21:57:09.078565] [DEBUG] [LOCAL ] TME: Primary data saved (53970 records). [2025-10-17T21:57:09.078739] [INFO ] [MAIN ] TME: Full history saved. [2025-10-17T21:57:09.078835] [INFO ] [MAIN ] Update Progress: 2105/2368 symbols completed. TME took 42.4s. Estimated remaining: 37m 7s. Rate: 7.1 symbols/min [2025-10-17T21:57:09.254696] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:57:09.254866] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-17T21:57:09.254904] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-17T21:57:09.255013] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-17T21:57:09.255054] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-17T21:57:09.255095] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-17T21:57:09.255126] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-17T21:57:09.348745] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-10-17T21:57:09.636221] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:57:09.702099] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-17T21:57:09.703147] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T21:57:10.142290] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-17T21:57:10.613715] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T21:57:10.942306] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-10-17T21:57:11.149598] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T21:57:11.149950] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-10-17T21:57:11.150038] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T21:57:11.150085] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-17T21:57:11.150145] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T21:57:11.150216] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-17T21:57:11.150278] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-17T21:57:11.150314] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-17T21:57:11.150353] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-17T21:57:11.150398] [INFO ] [MAIN ] Update Progress: 2106/2368 symbols completed. TNGY took 2.1s. Estimated remaining: 36m 58s. Rate: 7.1 symbols/min [2025-10-17T21:57:11.322295] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:57:11.359668] [DEBUG] [LOCAL ] TNK: Loaded 35627 existing records from primary storage. [2025-10-17T21:57:11.360008] [INFO ] [MAIN ] TNK: Loaded 35627 existing records. [2025-10-17T21:57:11.541520] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:57:11.541772] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-17T21:57:11.541830] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-17T21:57:11.542242] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-17T21:57:11.542300] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-17T21:57:11.746455] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-17T21:57:11.900304] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:57:11.967675] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T21:57:12.542344] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-10-17T21:57:12.902498] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-17T21:57:13.342284] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-17T21:57:13.904514] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T21:57:14.076508] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T21:57:14.084081] [INFO ] [REMOTE ] TMO: Full fetch complete (75696 records). [2025-10-17T21:57:14.084244] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-17T21:57:14.150165] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-17T21:57:14.486233] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-17T21:57:14.486310] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-17T21:57:14.487487] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-17T21:57:14.487549] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-17T21:57:14.489012] [DEBUG] [LOCAL ] TMO: Trimmed 75696 records to 53193 (keeping 200 days of data) [2025-10-17T21:57:14.832414] [DEBUG] [LOCAL ] TMO: Primary data saved (53193 records). [2025-10-17T21:57:14.832607] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-17T21:57:14.833297] [INFO ] [MAIN ] Update Progress: 2107/2368 symbols completed. TMO took 37.8s. Estimated remaining: 36m 49s. Rate: 7.1 symbols/min [2025-10-17T21:57:14.947483] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-17T21:57:15.021515] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:57:15.066143] [DEBUG] [LOCAL ] TNL: Loaded 42043 existing records from primary storage. [2025-10-17T21:57:15.066455] [INFO ] [MAIN ] TNL: Loaded 42043 existing records. [2025-10-17T21:57:15.262249] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:57:15.262477] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-17T21:57:15.262525] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-17T21:57:15.262766] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-17T21:57:15.262825] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-17T21:57:15.644799] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:57:15.647005] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T21:57:15.742345] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-17T21:57:16.005551] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T21:57:16.542316] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-17T21:57:17.209348] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T21:57:17.342282] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-17T21:57:17.883250] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T21:57:18.142319] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-17T21:57:18.760140] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T21:57:18.942303] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-17T21:57:19.512961] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-17T21:57:19.742268] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-10-17T21:57:19.832139] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-17T21:57:20.542345] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-17T21:57:21.246829] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T21:57:21.342248] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-17T21:57:21.661698] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T21:57:22.142360] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-17T21:57:22.470568] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-17T21:57:22.942283] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-17T21:57:23.340288] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T21:57:23.742282] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-17T21:57:24.418524] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T21:57:24.542284] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-17T21:57:24.719214] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-17T21:57:25.342287] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-17T21:57:25.896480] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-17T21:57:26.060314] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-17T21:57:26.142272] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-17T21:57:26.942301] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-17T21:57:27.477949] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T21:57:27.724181] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T21:57:27.726239] [INFO ] [REMOTE ] TNC: Full fetch complete (22321 records). [2025-10-17T21:57:27.726341] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-17T21:57:27.747428] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-17T21:57:28.096149] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-17T21:57:28.096241] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-17T21:57:28.096809] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-17T21:57:28.096884] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-17T21:57:28.097539] [DEBUG] [LOCAL ] TNC: Trimmed 22321 records to 14601 (keeping 200 days of data) [2025-10-17T21:57:28.188929] [DEBUG] [LOCAL ] TNC: Primary data saved (14601 records). [2025-10-17T21:57:28.189062] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-17T21:57:28.189190] [INFO ] [MAIN ] Update Progress: 2108/2368 symbols completed. TNC took 34.0s. Estimated remaining: 36m 41s. Rate: 7.1 symbols/min [2025-10-17T21:57:28.354957] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:57:28.406417] [DEBUG] [LOCAL ] TOL: Loaded 51005 existing records from primary storage. [2025-10-17T21:57:28.406763] [INFO ] [MAIN ] TOL: Loaded 51005 existing records. [2025-10-17T21:57:28.547450] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-17T21:57:28.587517] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:57:28.587704] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-17T21:57:28.587760] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-17T21:57:28.587994] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-17T21:57:28.588062] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-17T21:57:28.942259] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:57:29.342276] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-10-17T21:57:29.575604] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T21:57:30.076097] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-17T21:57:30.142282] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-17T21:57:30.942253] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-17T21:57:31.215008] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-17T21:57:31.422994] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-17T21:57:31.742264] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-17T21:57:32.477474] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T21:57:32.542252] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-17T21:57:33.033768] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T21:57:33.342325] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-17T21:57:34.008055] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T21:57:34.142276] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-17T21:57:34.198942] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-17T21:57:34.942292] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-17T21:57:35.742328] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-17T21:57:35.777013] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T21:57:36.542326] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-17T21:57:36.710623] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T21:57:36.824510] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T21:57:36.828525] [INFO ] [REMOTE ] TNET: Full fetch complete (41818 records). [2025-10-17T21:57:36.828627] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-17T21:57:37.200176] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-17T21:57:37.200253] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-17T21:57:37.201096] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-17T21:57:37.201157] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-17T21:57:37.202042] [DEBUG] [LOCAL ] TNET: Trimmed 41818 records to 28661 (keeping 200 days of data) [2025-10-17T21:57:37.352468] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-17T21:57:37.384119] [DEBUG] [LOCAL ] TNET: Primary data saved (28661 records). [2025-10-17T21:57:37.384338] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-17T21:57:37.384453] [INFO ] [MAIN ] Update Progress: 2109/2368 symbols completed. TNET took 29.9s. Estimated remaining: 36m 33s. Rate: 7.1 symbols/min [2025-10-17T21:57:37.548912] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:57:37.597899] [DEBUG] [LOCAL ] TOST: Loaded 54080 existing records from primary storage. [2025-10-17T21:57:37.598228] [INFO ] [MAIN ] TOST: Loaded 54080 existing records. [2025-10-17T21:57:37.775845] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:57:37.776062] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-17T21:57:37.776121] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-17T21:57:37.776316] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-17T21:57:37.776367] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-17T21:57:38.153953] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:57:38.148553] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-17T21:57:38.148480] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T21:57:38.942310] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-10-17T21:57:39.241762] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T21:57:39.744490] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-17T21:57:39.753136] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-17T21:57:40.542349] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-17T21:57:40.780452] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-17T21:57:41.342274] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-17T21:57:41.543156] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T21:57:41.837235] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T21:57:42.142303] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-17T21:57:42.773375] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-17T21:57:42.942322] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-17T21:57:43.535852] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T21:57:43.542029] [INFO ] [REMOTE ] TNL: Full fetch complete (59595 records). [2025-10-17T21:57:43.542209] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-17T21:57:43.750317] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-17T21:57:43.920258] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-17T21:57:43.920345] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-17T21:57:43.921408] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-17T21:57:43.921472] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-17T21:57:43.922681] [DEBUG] [LOCAL ] TNL: Trimmed 59595 records to 42362 (keeping 200 days of data) [2025-10-17T21:57:44.188601] [DEBUG] [LOCAL ] TNL: Primary data saved (42362 records). [2025-10-17T21:57:44.188796] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-17T21:57:44.189451] [INFO ] [MAIN ] Update Progress: 2110/2368 symbols completed. TNL took 29.4s. Estimated remaining: 36m 24s. Rate: 7.1 symbols/min [2025-10-17T21:57:44.358461] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:57:44.387147] [DEBUG] [LOCAL ] TPB: Loaded 26306 existing records from primary storage. [2025-10-17T21:57:44.387416] [INFO ] [MAIN ] TPB: Loaded 26306 existing records. [2025-10-17T21:57:44.559892] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-17T21:57:44.566762] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:57:44.584731] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-17T21:57:44.587128] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-17T21:57:44.588420] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T21:57:44.595567] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-17T21:57:44.596503] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-17T21:57:44.942706] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:57:45.342365] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-17T21:57:45.798792] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-17T21:57:46.142330] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-17T21:57:46.329060] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-17T21:57:46.411757] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T21:57:46.942304] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-17T21:57:47.742280] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-17T21:57:48.091600] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-17T21:57:48.525360] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T21:57:48.542250] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-17T21:57:49.054168] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-17T21:57:49.059405] [INFO ] [REMOTE ] TNK: Full fetch complete (51919 records). [2025-10-17T21:57:49.059530] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-17T21:57:49.352474] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-17T21:57:49.452637] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-17T21:57:49.452762] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-17T21:57:49.453779] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-17T21:57:49.453843] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-17T21:57:49.454849] [DEBUG] [LOCAL ] TNK: Trimmed 51919 records to 35859 (keeping 200 days of data) [2025-10-17T21:57:49.671721] [DEBUG] [LOCAL ] TNK: Primary data saved (35859 records). [2025-10-17T21:57:49.671856] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-17T21:57:49.671950] [INFO ] [MAIN ] Update Progress: 2111/2368 symbols completed. TNK took 38.5s. Estimated remaining: 36m 15s. Rate: 7.1 symbols/min [2025-10-17T21:57:49.844996] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:57:49.881786] [DEBUG] [LOCAL ] TPC: Loaded 39334 existing records from primary storage. [2025-10-17T21:57:49.882076] [INFO ] [MAIN ] TPC: Loaded 39334 existing records. [2025-10-17T21:57:50.059712] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:57:50.059948] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-17T21:57:50.059995] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-17T21:57:50.060183] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-17T21:57:50.060240] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-17T21:57:50.149297] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-10-17T21:57:50.452609] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:57:50.457180] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-17T21:57:50.942320] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-17T21:57:51.110964] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T21:57:51.389753] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T21:57:51.742362] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-17T21:57:52.542325] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-17T21:57:52.925238] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-17T21:57:53.342318] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-17T21:57:53.635621] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T21:57:53.739778] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-17T21:57:54.142289] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-17T21:57:54.942257] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-17T21:57:55.073143] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T21:57:55.261316] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-17T21:57:55.742295] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-17T21:57:56.542288] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-10-17T21:57:56.967242] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-17T21:57:56.969363] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T21:57:57.342348] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-17T21:57:57.930094] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-17T21:57:58.142369] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-17T21:57:58.942306] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-17T21:57:59.300552] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-17T21:57:59.344807] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T21:57:59.742403] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-17T21:57:59.954076] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-17T21:58:00.542317] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-17T21:58:01.342262] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-17T21:58:01.659842] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T21:58:01.851726] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-17T21:58:02.142329] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-17T21:58:02.942273] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-17T21:58:03.239121] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-17T21:58:03.742326] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-17T21:58:04.201787] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-17T21:58:04.324339] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T21:58:04.542295] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-17T21:58:05.018205] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T21:58:05.024969] [INFO ] [REMOTE ] TOL: Full fetch complete (73771 records). [2025-10-17T21:58:05.025105] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-17T21:58:05.356845] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-17T21:58:05.414872] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-17T21:58:05.414993] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-17T21:58:05.416227] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-17T21:58:05.416306] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-17T21:58:05.417903] [DEBUG] [LOCAL ] TOL: Trimmed 73771 records to 51370 (keeping 200 days of data) [2025-10-17T21:58:05.765969] [DEBUG] [LOCAL ] TOL: Primary data saved (51370 records). [2025-10-17T21:58:05.766245] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-17T21:58:05.766368] [INFO ] [MAIN ] Update Progress: 2112/2368 symbols completed. TOL took 37.6s. Estimated remaining: 36m 7s. Rate: 7.1 symbols/min [2025-10-17T21:58:05.953191] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:58:05.975081] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T21:58:06.024363] [DEBUG] [LOCAL ] TPH: Loaded 45161 existing records from primary storage. [2025-10-17T21:58:06.024709] [INFO ] [MAIN ] TPH: Loaded 45161 existing records. [2025-10-17T21:58:06.147430] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-17T21:58:06.212939] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:58:06.213149] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-17T21:58:06.213198] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-17T21:58:06.213441] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-17T21:58:06.213485] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-17T21:58:06.612814] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:58:06.698589] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-17T21:58:06.942301] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-10-17T21:58:07.382882] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-17T21:58:07.742322] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-17T21:58:08.485159] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T21:58:08.542258] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-17T21:58:09.014952] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-17T21:58:09.342357] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-17T21:58:10.119129] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T21:58:10.142263] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-17T21:58:10.942357] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-17T21:58:11.331443] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T21:58:11.447423] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T21:58:11.742342] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-17T21:58:12.134896] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-17T21:58:12.542333] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-17T21:58:12.939795] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-17T21:58:13.342307] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-17T21:58:13.974200] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T21:58:14.142302] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-17T21:58:14.167635] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-17T21:58:14.172744] [INFO ] [REMOTE ] TPB: Full fetch complete (36053 records). [2025-10-17T21:58:14.172877] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-17T21:58:14.559293] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-17T21:58:14.559379] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-17T21:58:14.560154] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-17T21:58:14.560218] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-17T21:58:14.561239] [DEBUG] [LOCAL ] TPB: Trimmed 36053 records to 26442 (keeping 200 days of data) [2025-10-17T21:58:14.725731] [DEBUG] [LOCAL ] TPB: Primary data saved (26442 records). [2025-10-17T21:58:14.725865] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-17T21:58:14.725946] [INFO ] [MAIN ] Update Progress: 2113/2368 symbols completed. TPB took 30.5s. Estimated remaining: 35m 59s. Rate: 7.1 symbols/min [2025-10-17T21:58:14.892518] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:58:14.906630] [DEBUG] [LOCAL ] TPL: Loaded 12470 existing records from primary storage. [2025-10-17T21:58:14.906941] [INFO ] [MAIN ] TPL: Loaded 12470 existing records. [2025-10-17T21:58:14.948680] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-17T21:58:15.085153] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:58:15.085358] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-17T21:58:15.085405] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-17T21:58:15.085558] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-17T21:58:15.085596] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-17T21:58:15.438094] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:58:15.699372] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T21:58:15.742245] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-17T21:58:16.542354] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-10-17T21:58:16.584960] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T21:58:17.248267] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-17T21:58:17.301004] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-17T21:58:17.342251] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-17T21:58:18.142305] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-17T21:58:18.305726] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-17T21:58:18.942282] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-17T21:58:19.642544] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T21:58:19.742308] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-17T21:58:20.542352] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-17T21:58:20.719111] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-17T21:58:20.874683] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T21:58:20.882005] [INFO ] [REMOTE ] TOST: Full fetch complete (77852 records). [2025-10-17T21:58:20.882128] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-17T21:58:21.273177] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-17T21:58:21.273256] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-17T21:58:21.274444] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-17T21:58:21.274508] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-17T21:58:21.276021] [DEBUG] [LOCAL ] TOST: Trimmed 77852 records to 54470 (keeping 200 days of data) [2025-10-17T21:58:21.358020] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-17T21:58:21.596033] [DEBUG] [LOCAL ] TOST: Primary data saved (54470 records). [2025-10-17T21:58:21.596171] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-17T21:58:21.596253] [INFO ] [MAIN ] Update Progress: 2114/2368 symbols completed. TOST took 44.2s. Estimated remaining: 35m 50s. Rate: 7.1 symbols/min [2025-10-17T21:58:21.760154] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:58:21.811349] [DEBUG] [LOCAL ] TPR: Loaded 53806 existing records from primary storage. [2025-10-17T21:58:21.811668] [INFO ] [MAIN ] TPR: Loaded 53806 existing records. [2025-10-17T21:58:21.988866] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:58:21.989239] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-17T21:58:21.989299] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-17T21:58:21.989496] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-17T21:58:21.989537] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-17T21:58:22.164637] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-17T21:58:22.185588] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T21:58:22.375398] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:58:22.383794] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-17T21:58:22.942309] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-17T21:58:23.742343] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-10-17T21:58:23.875345] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T21:58:23.923782] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-17T21:58:24.542300] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-17T21:58:25.342277] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-17T21:58:25.507942] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T21:58:25.532974] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-17T21:58:26.142290] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-17T21:58:26.837511] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-17T21:58:26.942294] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-17T21:58:27.346427] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T21:58:27.742313] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-17T21:58:28.542289] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-17T21:58:28.600537] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-17T21:58:28.851359] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T21:58:29.342285] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-17T21:58:29.578025] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T21:58:30.142291] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-17T21:58:30.942328] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-17T21:58:31.098305] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T21:58:31.363165] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-17T21:58:31.742326] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-17T21:58:31.882343] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-17T21:58:32.542357] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-17T21:58:33.342331] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-17T21:58:33.652688] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T21:58:34.142362] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-17T21:58:34.170963] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T21:58:34.306990] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-17T21:58:34.313193] [INFO ] [REMOTE ] TPC: Full fetch complete (55412 records). [2025-10-17T21:58:34.313373] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-17T21:58:34.726748] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-17T21:58:34.726865] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-17T21:58:34.728522] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-17T21:58:34.728590] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-17T21:58:34.730260] [DEBUG] [LOCAL ] TPC: Trimmed 55412 records to 39604 (keeping 200 days of data) [2025-10-17T21:58:34.946138] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-17T21:58:34.990719] [DEBUG] [LOCAL ] TPC: Primary data saved (39604 records). [2025-10-17T21:58:34.990977] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-17T21:58:34.991096] [INFO ] [MAIN ] Update Progress: 2115/2368 symbols completed. TPC took 45.3s. Estimated remaining: 35m 43s. Rate: 7.1 symbols/min [2025-10-17T21:58:35.186164] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-17T21:58:35.185635] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:58:35.219944] [DEBUG] [LOCAL ] TPVG: Loaded 27498 existing records from primary storage. [2025-10-17T21:58:35.220299] [INFO ] [MAIN ] TPVG: Loaded 27498 existing records. [2025-10-17T21:58:35.402080] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:58:35.402370] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-17T21:58:35.402423] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-17T21:58:35.402711] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-17T21:58:35.402774] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-17T21:58:35.750787] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-17T21:58:35.791362] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:58:36.517332] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T21:58:36.542246] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-17T21:58:37.342285] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-10-17T21:58:37.666517] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T21:58:38.097718] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T21:58:38.104325] [INFO ] [REMOTE ] TPH: Full fetch complete (64908 records). [2025-10-17T21:58:38.104448] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-17T21:58:38.147584] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-17T21:58:38.512505] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-17T21:58:38.512678] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-17T21:58:38.513840] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-17T21:58:38.513937] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-17T21:58:38.515460] [DEBUG] [LOCAL ] TPH: Trimmed 64908 records to 45484 (keeping 200 days of data) [2025-10-17T21:58:38.798483] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-17T21:58:38.814801] [DEBUG] [LOCAL ] TPH: Primary data saved (45484 records). [2025-10-17T21:58:38.814871] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-17T21:58:38.814942] [INFO ] [MAIN ] Update Progress: 2116/2368 symbols completed. TPH took 33.0s. Estimated remaining: 35m 34s. Rate: 7.1 symbols/min [2025-10-17T21:58:38.949543] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-10. [2025-10-17T21:58:38.982723] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:58:38.992499] [DEBUG] [LOCAL ] TPYP: Loaded 7970 existing records from primary storage. [2025-10-17T21:58:38.993271] [INFO ] [MAIN ] TPYP: Loaded 7970 existing records. [2025-10-17T21:58:39.167610] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:58:39.167855] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-17T21:58:39.167908] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-17T21:58:39.168050] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-17T21:58:39.168087] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-17T21:58:39.461893] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-17T21:58:39.513139] [INFO ] [REMOTE ] TPL: Full fetch complete (17608 records). [2025-10-17T21:58:39.528855] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-17T21:58:39.533695] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:58:39.752745] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-17T21:58:39.909586] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-17T21:58:39.909767] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-17T21:58:39.910308] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-17T21:58:39.910382] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-17T21:58:39.911349] [DEBUG] [LOCAL ] TPL: Trimmed 17608 records to 12558 (keeping 200 days of data) [2025-10-17T21:58:40.022047] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T21:58:40.039012] [DEBUG] [LOCAL ] TPL: Primary data saved (12558 records). [2025-10-17T21:58:40.039253] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-17T21:58:40.039343] [INFO ] [MAIN ] Update Progress: 2117/2368 symbols completed. TPL took 25.3s. Estimated remaining: 35m 24s. Rate: 7.1 symbols/min [2025-10-17T21:58:40.542342] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-17T21:58:40.972902] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T21:58:41.342288] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-17T21:58:42.142273] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-10-17T21:58:42.356671] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T21:58:42.476870] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T21:58:42.870016] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T21:58:42.942316] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-17T21:58:43.742321] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-17T21:58:43.775465] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T21:58:44.542349] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-17T21:58:45.155892] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-17T21:58:45.169920] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T21:58:45.342285] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-17T21:58:46.142387] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-17T21:58:46.745273] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-17T21:58:46.891395] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-17T21:58:46.942307] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-17T21:58:47.742284] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-17T21:58:47.763687] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-17T21:58:48.542297] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-17T21:58:49.342321] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-17T21:58:49.706291] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T21:58:49.768719] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-17T21:58:50.095575] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-17T21:58:50.142313] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-17T21:58:50.942349] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-17T21:58:51.724450] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-17T21:58:51.742278] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-17T21:58:52.014874] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T21:58:52.149431] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-17T21:58:52.542293] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-17T21:58:53.282283] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-17T21:58:53.342304] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-17T21:58:54.119093] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-17T21:58:54.142247] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-17T21:58:54.859405] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T21:58:54.860910] [INFO ] [REMOTE ] TPYP: Full fetch complete (12466 records). [2025-10-17T21:58:54.860977] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-17T21:58:54.948345] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-17T21:58:55.216399] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-17T21:58:55.216492] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-17T21:58:55.216792] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-17T21:58:55.216851] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-17T21:58:55.217287] [DEBUG] [LOCAL ] TPYP: Trimmed 12466 records to 8009 (keeping 200 days of data) [2025-10-17T21:58:55.264463] [DEBUG] [LOCAL ] TPYP: Primary data saved (8009 records). [2025-10-17T21:58:55.264550] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-17T21:58:55.264626] [INFO ] [MAIN ] Update Progress: 2118/2368 symbols completed. TPYP took 16.4s. Estimated remaining: 35m 17s. Rate: 7.1 symbols/min [2025-10-17T21:58:55.742317] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-17T21:58:56.936783] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T21:58:56.948384] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-17T21:58:57.030028] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T21:58:57.342318] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-17T21:58:57.626094] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T21:58:57.633275] [INFO ] [REMOTE ] TPR: Full fetch complete (77524 records). [2025-10-17T21:58:57.633392] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-17T21:58:58.018057] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-17T21:58:58.018494] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-17T21:58:58.019705] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-17T21:58:58.019771] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-17T21:58:58.021193] [DEBUG] [LOCAL ] TPR: Trimmed 77524 records to 54177 (keeping 200 days of data) [2025-10-17T21:58:58.253389] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T21:58:58.265067] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-17T21:58:58.383460] [DEBUG] [LOCAL ] TPR: Primary data saved (54177 records). [2025-10-17T21:58:58.383588] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-17T21:58:58.383691] [INFO ] [MAIN ] Update Progress: 2119/2368 symbols completed. TPR took 36.8s. Estimated remaining: 35m 7s. Rate: 7.1 symbols/min [2025-10-17T21:58:59.448863] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-17T21:58:59.455037] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-17T21:59:00.779112] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-17T21:59:00.785624] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-17T21:59:01.998365] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T21:59:02.005117] [INFO ] [REMOTE ] TPVG: Full fetch complete (39438 records). [2025-10-17T21:59:02.005292] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-17T21:59:02.376865] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-17T21:59:02.376940] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-17T21:59:02.377728] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-17T21:59:02.377811] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-17T21:59:02.378632] [DEBUG] [LOCAL ] TPVG: Trimmed 39438 records to 27655 (keeping 200 days of data) [2025-10-17T21:59:02.536908] [DEBUG] [LOCAL ] TPVG: Primary data saved (27655 records). [2025-10-17T21:59:02.537041] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-17T21:59:02.537123] [INFO ] [MAIN ] Update Progress: 2120/2368 symbols completed. TPVG took 27.5s. Estimated remaining: 34m 58s. Rate: 7.1 symbols/min [2025-10-17T21:59:03.194696] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:59:03.183574] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:59:03.272777] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:59:03.299926] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:59:03.303569] [DEBUG] [LOCAL ] TPZ: Loaded 4722 existing records from primary storage. [2025-10-17T21:59:03.309310] [INFO ] [MAIN ] TPZ: Loaded 4722 existing records. [2025-10-17T21:59:03.422445] [DEBUG] [LOCAL ] TR: Loaded 19082 existing records from primary storage. [2025-10-17T21:59:03.434511] [DEBUG] [LOCAL ] TRC: Loaded 15667 existing records from primary storage. [2025-10-17T21:59:03.434789] [INFO ] [MAIN ] TR: Loaded 19082 existing records. [2025-10-17T21:59:03.435115] [INFO ] [MAIN ] TRC: Loaded 15667 existing records. [2025-10-17T21:59:03.466613] [DEBUG] [LOCAL ] TRAK: Loaded 9724 existing records from primary storage. [2025-10-17T21:59:03.610847] [INFO ] [MAIN ] TRAK: Loaded 9724 existing records. [2025-10-17T21:59:03.679190] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:59:03.743296] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-17T21:59:03.743438] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-17T21:59:03.763115] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-17T21:59:03.823096] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-17T21:59:04.036620] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:59:04.101266] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-17T21:59:04.080169] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:59:04.101370] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-17T21:59:04.112394] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-17T21:59:04.180857] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-17T21:59:04.189051] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:59:04.194486] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-17T21:59:04.177937] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-17T21:59:04.199768] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-17T21:59:04.210322] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-17T21:59:04.210218] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-17T21:59:04.205056] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-17T21:59:04.290373] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-17T21:59:04.299153] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-17T21:59:05.014061] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:59:05.058187] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-10-17T21:59:05.408096] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:59:05.449006] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-10-17T21:59:05.523425] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:59:05.524907] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-10-17T21:59:05.532043] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:59:05.532593] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-10-17T21:59:06.035294] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T21:59:06.037702] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-17T21:59:06.363763] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-17T21:59:06.366327] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-17T21:59:06.401980] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T21:59:06.405124] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-17T21:59:06.472769] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-17T21:59:06.476163] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-17T21:59:06.801167] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-17T21:59:06.878363] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-17T21:59:06.942301] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-17T21:59:07.141249] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-17T21:59:07.355572] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T21:59:07.693587] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T21:59:07.742282] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-17T21:59:08.540165] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-17T21:59:08.542574] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-17T21:59:09.342268] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-17T21:59:09.444909] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-17T21:59:10.142840] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-17T21:59:10.142449] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-17T21:59:10.942273] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-17T21:59:11.231624] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T21:59:11.742318] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-17T21:59:11.784594] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T21:59:12.446718] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-17T21:59:12.542321] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-17T21:59:13.342367] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-17T21:59:13.623915] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T21:59:14.111956] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-17T21:59:14.142287] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-17T21:59:14.942272] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-17T21:59:15.268834] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T21:59:15.725786] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-17T21:59:15.742246] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-17T21:59:16.503404] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-17T21:59:16.542301] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-17T21:59:17.282995] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-17T21:59:17.342327] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-17T21:59:18.145664] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-17T21:59:18.149186] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T21:59:18.868033] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-17T21:59:18.942294] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-17T21:59:19.742292] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-17T21:59:19.926792] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-17T21:59:20.424941] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-17T21:59:20.542328] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-17T21:59:21.342265] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-17T21:59:21.510316] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T21:59:21.910146] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-17T21:59:21.912482] [INFO ] [REMOTE ] TRAK: Full fetch complete (13728 records). [2025-10-17T21:59:21.912552] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-17T21:59:22.149996] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-17T21:59:22.270406] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-17T21:59:22.270498] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-17T21:59:22.270828] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-17T21:59:22.270890] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-17T21:59:22.271416] [DEBUG] [LOCAL ] TRAK: Trimmed 13728 records to 9840 (keeping 200 days of data) [2025-10-17T21:59:22.332251] [DEBUG] [LOCAL ] TRAK: Primary data saved (9840 records). [2025-10-17T21:59:22.332391] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-17T21:59:22.332500] [INFO ] [MAIN ] Update Progress: 2121/2368 symbols completed. TRAK took 19.8s. Estimated remaining: 34m 51s. Rate: 7.1 symbols/min [2025-10-17T21:59:22.505323] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:59:22.550808] [DEBUG] [LOCAL ] TREX: Loaded 50214 existing records from primary storage. [2025-10-17T21:59:22.551141] [INFO ] [MAIN ] TREX: Loaded 50214 existing records. [2025-10-17T21:59:22.726153] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:59:22.726379] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-17T21:59:22.726425] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-17T21:59:22.726606] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-17T21:59:22.726696] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-17T21:59:22.954632] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-17T21:59:23.080425] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:59:23.225871] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T21:59:23.598361] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-17T21:59:23.742359] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-17T21:59:24.410914] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T21:59:24.542526] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-17T21:59:25.342294] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-10-17T21:59:25.501011] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T21:59:26.142306] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-17T21:59:26.862515] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T21:59:26.942291] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-17T21:59:27.126883] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-17T21:59:27.742346] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-17T21:59:28.084441] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-17T21:59:28.542290] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-17T21:59:29.099596] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T21:59:29.342270] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-17T21:59:29.969011] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-17T21:59:30.142311] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-17T21:59:30.407994] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-17T21:59:30.749598] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-17T21:59:30.942262] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-17T21:59:31.742311] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-17T21:59:31.961668] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-17T21:59:32.153095] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-17T21:59:32.542298] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-17T21:59:33.342342] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-17T21:59:34.142275] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-17T21:59:34.226614] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T21:59:34.310760] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-17T21:59:34.313727] [INFO ] [REMOTE ] TR: Full fetch complete (25461 records). [2025-10-17T21:59:34.313829] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-17T21:59:34.604056] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-17T21:59:34.686877] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-17T21:59:34.686947] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-17T21:59:34.687468] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-17T21:59:34.687508] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-17T21:59:34.688188] [DEBUG] [LOCAL ] TR: Trimmed 25461 records to 19196 (keeping 200 days of data) [2025-10-17T21:59:34.805504] [DEBUG] [LOCAL ] TR: Primary data saved (19196 records). [2025-10-17T21:59:34.805633] [INFO ] [MAIN ] TR: Full history saved. [2025-10-17T21:59:34.805766] [INFO ] [MAIN ] Update Progress: 2122/2368 symbols completed. TR took 32.3s. Estimated remaining: 34m 43s. Rate: 7.1 symbols/min [2025-10-17T21:59:34.956322] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-17T21:59:34.991562] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:59:35.041901] [DEBUG] [LOCAL ] TRGP: Loaded 51196 existing records from primary storage. [2025-10-17T21:59:35.042201] [INFO ] [MAIN ] TRGP: Loaded 51196 existing records. [2025-10-17T21:59:35.216113] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:59:35.216324] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-17T21:59:35.216396] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-17T21:59:35.216628] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-17T21:59:35.216730] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-17T21:59:35.562160] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:59:35.742255] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-10-17T21:59:36.542349] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-17T21:59:36.676417] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T21:59:37.031871] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-17T21:59:37.032994] [INFO ] [REMOTE ] TPZ: Full fetch complete (8740 records). [2025-10-17T21:59:37.033064] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-17T21:59:37.347458] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-17T21:59:37.408122] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-17T21:59:37.408363] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-17T21:59:37.408619] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-17T21:59:37.408824] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-17T21:59:37.409416] [DEBUG] [LOCAL ] TPZ: Trimmed 8740 records to 4739 (keeping 200 days of data) [2025-10-17T21:59:37.439460] [DEBUG] [LOCAL ] TPZ: Primary data saved (4739 records). [2025-10-17T21:59:37.439705] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-17T21:59:37.439837] [INFO ] [MAIN ] Update Progress: 2123/2368 symbols completed. TPZ took 34.9s. Estimated remaining: 34m 34s. Rate: 7.1 symbols/min [2025-10-17T21:59:37.607580] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:59:37.647551] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T21:59:37.694235] [DEBUG] [LOCAL ] TRN: Loaded 36976 existing records from primary storage. [2025-10-17T21:59:37.694556] [INFO ] [MAIN ] TRN: Loaded 36976 existing records. [2025-10-17T21:59:37.869784] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:59:37.870048] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-17T21:59:37.870107] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-17T21:59:37.870294] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-17T21:59:37.870349] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-17T21:59:38.147410] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-17T21:59:38.217086] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:59:38.369098] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-17T21:59:38.942297] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-10-17T21:59:39.742278] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-10-17T21:59:39.952523] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T21:59:40.238888] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T21:59:40.542322] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-17T21:59:41.342279] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-17T21:59:41.494209] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T21:59:42.142262] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-10-17T21:59:42.175468] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T21:59:42.651184] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-17T21:59:42.942296] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-17T21:59:43.531977] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T21:59:43.742257] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-10-17T21:59:44.542310] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-17T21:59:44.717719] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T21:59:45.342268] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-17T21:59:45.528372] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T21:59:45.559869] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T21:59:46.142335] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-10-17T21:59:46.746007] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T21:59:46.942366] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-17T21:59:47.742331] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-17T21:59:47.983440] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T21:59:48.475985] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-17T21:59:48.542302] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-17T21:59:49.142549] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-17T21:59:49.342273] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-17T21:59:49.999141] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T21:59:50.142262] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-17T21:59:50.942249] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-17T21:59:51.047550] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T21:59:51.088871] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-17T21:59:51.742290] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-10-17T21:59:52.308877] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-17T21:59:52.542284] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-17T21:59:53.155553] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T21:59:53.342319] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-17T21:59:53.878598] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-17T21:59:54.142320] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-17T21:59:54.886685] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T21:59:54.893490] [INFO ] [REMOTE ] TREX: Full fetch complete (71612 records). [2025-10-17T21:59:54.893615] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-17T21:59:54.955727] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-17T21:59:55.014494] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-17T21:59:55.070732] [INFO ] [REMOTE ] TRC: Full fetch complete (21842 records). [2025-10-17T21:59:55.087835] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-17T21:59:55.481469] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-17T21:59:55.533108] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-17T21:59:55.560607] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-17T21:59:55.571738] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-17T21:59:55.659968] [DEBUG] [LOCAL ] TREX: Trimmed 71612 records to 50560 (keeping 200 days of data) [2025-10-17T21:59:55.686822] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-17T21:59:55.687108] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-17T21:59:55.687347] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-17T21:59:55.687391] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-17T21:59:55.688143] [DEBUG] [LOCAL ] TRC: Trimmed 21842 records to 15736 (keeping 200 days of data) [2025-10-17T21:59:55.771044] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-10-17T21:59:55.878967] [DEBUG] [LOCAL ] TRC: Primary data saved (15736 records). [2025-10-17T21:59:55.879931] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-17T21:59:55.880271] [INFO ] [MAIN ] Update Progress: 2124/2368 symbols completed. TRC took 53.3s. Estimated remaining: 34m 27s. Rate: 7.1 symbols/min [2025-10-17T21:59:56.065707] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:59:56.241190] [DEBUG] [LOCAL ] TRNO: Loaded 44252 existing records from primary storage. [2025-10-17T21:59:56.255234] [INFO ] [MAIN ] TRNO: Loaded 44252 existing records. [2025-10-17T21:59:56.453871] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:59:56.454823] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-17T21:59:56.455568] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-17T21:59:56.457421] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-17T21:59:56.457892] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-17T21:59:56.673581] [DEBUG] [LOCAL ] TREX: Primary data saved (50560 records). [2025-10-17T21:59:56.673844] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-17T21:59:56.697630] [INFO ] [MAIN ] Update Progress: 2125/2368 symbols completed. TREX took 34.4s. Estimated remaining: 34m 18s. Rate: 7.1 symbols/min [2025-10-17T21:59:56.919787] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-17T21:59:56.984065] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:59:57.000901] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-10-17T21:59:57.057104] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T21:59:57.108020] [DEBUG] [LOCAL ] TROX: Loaded 52556 existing records from primary storage. [2025-10-17T21:59:57.108326] [INFO ] [MAIN ] TROX: Loaded 52556 existing records. [2025-10-17T21:59:57.284978] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T21:59:57.285141] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-17T21:59:57.285188] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-17T21:59:57.285362] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-17T21:59:57.285400] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-17T21:59:57.347370] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-17T21:59:57.641185] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T21:59:57.709525] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-17T21:59:58.142295] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-10-17T21:59:58.697096] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T21:59:58.814025] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-17T21:59:58.942260] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-17T21:59:59.742285] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-10-17T21:59:59.910844] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T22:00:00.355454] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T22:00:00.542259] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-17T22:00:01.168436] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-17T22:00:01.342286] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-17T22:00:01.782032] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T22:00:01.787049] [INFO ] [REMOTE ] TRN: Full fetch complete (52679 records). [2025-10-17T22:00:01.787248] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-17T22:00:02.147451] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-10-17T22:00:02.226791] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-17T22:00:02.226881] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-17T22:00:02.228053] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-17T22:00:02.228119] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-17T22:00:02.229521] [DEBUG] [LOCAL ] TRN: Trimmed 52679 records to 37211 (keeping 200 days of data) [2025-10-17T22:00:02.467842] [DEBUG] [LOCAL ] TRN: Primary data saved (37211 records). [2025-10-17T22:00:02.467978] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-17T22:00:02.468606] [INFO ] [MAIN ] Update Progress: 2126/2368 symbols completed. TRN took 25.0s. Estimated remaining: 34m 9s. Rate: 7.1 symbols/min [2025-10-17T22:00:02.639887] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:00:02.694032] [DEBUG] [LOCAL ] TRP: Loaded 52524 existing records from primary storage. [2025-10-17T22:00:02.694480] [INFO ] [MAIN ] TRP: Loaded 52524 existing records. [2025-10-17T22:00:02.894425] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:00:02.894861] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-17T22:00:02.894966] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-17T22:00:02.895373] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-17T22:00:02.895604] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-17T22:00:02.950461] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-17T22:00:03.094220] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T22:00:03.288507] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:00:03.742269] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-17T22:00:04.105243] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T22:00:04.189718] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T22:00:04.542353] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-17T22:00:05.342318] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-10-17T22:00:05.467753] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-17T22:00:06.004111] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T22:00:06.142335] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-17T22:00:06.942312] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-10-17T22:00:07.275264] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-17T22:00:07.742287] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-17T22:00:08.140262] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-17T22:00:08.542323] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-17T22:00:08.709384] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T22:00:09.342276] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-10. [2025-10-17T22:00:09.405984] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T22:00:10.038392] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T22:00:10.048826] [INFO ] [REMOTE ] TRGP: Full fetch complete (73665 records). [2025-10-17T22:00:10.048984] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-17T22:00:10.145843] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-17T22:00:10.453192] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-17T22:00:10.453319] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-17T22:00:10.454909] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-17T22:00:10.455034] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-17T22:00:10.457135] [DEBUG] [LOCAL ] TRGP: Trimmed 73665 records to 51552 (keeping 200 days of data) [2025-10-17T22:00:10.554575] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-17T22:00:10.814006] [DEBUG] [LOCAL ] TRGP: Primary data saved (51552 records). [2025-10-17T22:00:10.814136] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-17T22:00:10.814215] [INFO ] [MAIN ] Update Progress: 2127/2368 symbols completed. TRGP took 36.0s. Estimated remaining: 34m 0s. Rate: 7.1 symbols/min [2025-10-17T22:00:10.952782] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-17T22:00:10.987318] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:00:11.021799] [DEBUG] [LOCAL ] TRTX: Loaded 37536 existing records from primary storage. [2025-10-17T22:00:11.022096] [INFO ] [MAIN ] TRTX: Loaded 37536 existing records. [2025-10-17T22:00:11.194124] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:00:11.194357] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-17T22:00:11.194406] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-17T22:00:11.194581] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-10-17T22:00:11.194619] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-17T22:00:11.546590] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:00:11.724519] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T22:00:11.742248] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-17T22:00:12.542299] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-10-17T22:00:12.687605] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-17T22:00:13.342267] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-17T22:00:13.455617] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T22:00:13.633928] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T22:00:14.142343] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-17T22:00:14.942323] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-17T22:00:15.184552] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T22:00:15.742324] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-17T22:00:16.178923] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-17T22:00:16.251041] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-17T22:00:16.542290] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-17T22:00:17.342365] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-17T22:00:17.472985] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T22:00:17.971302] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T22:00:18.142255] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-17T22:00:18.516838] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-17T22:00:18.942330] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-10-17T22:00:19.742268] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-17T22:00:20.043823] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-17T22:00:20.237444] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-17T22:00:20.542296] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-10-17T22:00:21.234001] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-17T22:00:21.342276] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-17T22:00:22.094153] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T22:00:22.142254] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-10-17T22:00:22.819272] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T22:00:22.942310] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-17T22:00:23.378314] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-17T22:00:23.742306] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-17T22:00:24.472891] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T22:00:24.542268] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-17T22:00:25.342270] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-17T22:00:25.593634] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T22:00:25.913517] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-17T22:00:26.142365] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-17T22:00:26.909801] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T22:00:26.942272] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-17T22:00:27.742317] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-10-17T22:00:27.924316] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-17T22:00:27.931503] [INFO ] [REMOTE ] TROX: Full fetch complete (74014 records). [2025-10-17T22:00:27.931613] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-17T22:00:28.319867] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-17T22:00:28.320030] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-17T22:00:28.321300] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-17T22:00:28.321384] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-17T22:00:28.322974] [DEBUG] [LOCAL ] TROX: Trimmed 74014 records to 52933 (keeping 200 days of data) [2025-10-17T22:00:28.438998] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T22:00:28.563164] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-17T22:00:28.675503] [DEBUG] [LOCAL ] TROX: Primary data saved (52933 records). [2025-10-17T22:00:28.675671] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-17T22:00:28.675774] [INFO ] [MAIN ] Update Progress: 2128/2368 symbols completed. TROX took 32.0s. Estimated remaining: 33m 53s. Rate: 7.1 symbols/min [2025-10-17T22:00:28.842684] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:00:28.889142] [DEBUG] [LOCAL ] TRU: Loaded 51815 existing records from primary storage. [2025-10-17T22:00:28.889452] [INFO ] [MAIN ] TRU: Loaded 51815 existing records. [2025-10-17T22:00:29.068055] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:00:29.068297] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-17T22:00:29.068355] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-17T22:00:29.068728] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-17T22:00:29.068789] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-17T22:00:29.187357] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T22:00:29.347500] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-17T22:00:29.440104] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:00:30.142333] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-10-17T22:00:30.499261] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-17T22:00:30.945262] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-17T22:00:30.951605] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T22:00:31.563976] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-17T22:00:31.742286] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-17T22:00:32.542257] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-10-17T22:00:32.750172] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T22:00:33.057614] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-17T22:00:33.063393] [INFO ] [REMOTE ] TRNO: Full fetch complete (63079 records). [2025-10-17T22:00:33.063524] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-17T22:00:33.348674] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-10-17T22:00:33.441297] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-17T22:00:33.441378] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-17T22:00:33.442552] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-17T22:00:33.442617] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-17T22:00:33.444178] [DEBUG] [LOCAL ] TRNO: Trimmed 63079 records to 44531 (keeping 200 days of data) [2025-10-17T22:00:33.738634] [DEBUG] [LOCAL ] TRNO: Primary data saved (44531 records). [2025-10-17T22:00:33.738793] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-17T22:00:33.738879] [INFO ] [MAIN ] Update Progress: 2129/2368 symbols completed. TRNO took 37.9s. Estimated remaining: 33m 44s. Rate: 7.1 symbols/min [2025-10-17T22:00:33.923548] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:00:33.968973] [DEBUG] [LOCAL ] TRV: Loaded 47824 existing records from primary storage. [2025-10-17T22:00:33.969301] [INFO ] [MAIN ] TRV: Loaded 47824 existing records. [2025-10-17T22:00:34.147135] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-17T22:00:34.173003] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:00:34.175310] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T22:00:34.184854] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-17T22:00:34.185146] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-17T22:00:34.185820] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-17T22:00:34.185887] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-17T22:00:34.555839] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:00:34.942323] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-10-17T22:00:35.080986] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T22:00:35.742317] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-17T22:00:35.911518] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T22:00:36.542282] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-10-17T22:00:36.705977] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T22:00:37.347415] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-17T22:00:37.362598] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T22:00:37.535284] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-17T22:00:38.142323] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-17T22:00:38.942339] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-17T22:00:39.067744] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T22:00:39.074816] [INFO ] [REMOTE ] TRP: Full fetch complete (75752 records). [2025-10-17T22:00:39.074928] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-17T22:00:39.461001] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-17T22:00:39.461078] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-17T22:00:39.462215] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-17T22:00:39.462279] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-17T22:00:39.463684] [DEBUG] [LOCAL ] TRP: Trimmed 75752 records to 52912 (keeping 200 days of data) [2025-10-17T22:00:39.744878] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-10-17T22:00:39.793425] [DEBUG] [LOCAL ] TRP: Primary data saved (52912 records). [2025-10-17T22:00:39.793531] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-17T22:00:39.794158] [INFO ] [MAIN ] Update Progress: 2130/2368 symbols completed. TRP took 37.3s. Estimated remaining: 33m 35s. Rate: 7.1 symbols/min [2025-10-17T22:00:39.968397] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:00:40.000222] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T22:00:40.062080] [DEBUG] [LOCAL ] TS: Loaded 52062 existing records from primary storage. [2025-10-17T22:00:40.062404] [INFO ] [MAIN ] TS: Loaded 52062 existing records. [2025-10-17T22:00:40.236264] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:00:40.236478] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-17T22:00:40.236571] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-17T22:00:40.236871] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-17T22:00:40.236918] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-17T22:00:40.545846] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-17T22:00:40.619561] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:00:40.622310] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T22:00:41.285952] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T22:00:41.342258] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-17T22:00:42.142276] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-10. [2025-10-17T22:00:42.309939] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T22:00:42.942319] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-17T22:00:43.167481] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T22:00:43.190700] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-17T22:00:43.195595] [INFO ] [REMOTE ] TRTX: Full fetch complete (53058 records). [2025-10-17T22:00:43.195713] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-17T22:00:43.566163] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-17T22:00:43.566241] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-17T22:00:43.567245] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-17T22:00:43.567309] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-17T22:00:43.568378] [DEBUG] [LOCAL ] TRTX: Trimmed 53058 records to 37790 (keeping 200 days of data) [2025-10-17T22:00:43.753825] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-10-17T22:00:43.784401] [DEBUG] [LOCAL ] TRTX: Primary data saved (37790 records). [2025-10-17T22:00:43.784517] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-17T22:00:43.784596] [INFO ] [MAIN ] Update Progress: 2131/2368 symbols completed. TRTX took 33.0s. Estimated remaining: 33m 26s. Rate: 7.1 symbols/min [2025-10-17T22:00:43.948251] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:00:43.974152] [DEBUG] [LOCAL ] TSE: Loaded 27928 existing records from primary storage. [2025-10-17T22:00:43.974404] [INFO ] [MAIN ] TSE: Loaded 27928 existing records. [2025-10-17T22:00:44.151701] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:00:44.152252] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-17T22:00:44.152311] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-17T22:00:44.152583] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-17T22:00:44.152639] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-17T22:00:44.498400] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:00:44.542245] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-10-17T22:00:44.977249] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T22:00:45.342384] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-17T22:00:45.535748] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T22:00:46.142320] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-17T22:00:46.194081] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T22:00:46.942348] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-17T22:00:47.165615] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T22:00:47.742303] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-17T22:00:47.830874] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T22:00:48.542283] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-17T22:00:48.867473] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T22:00:49.342266] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-17T22:00:49.501520] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T22:00:50.142262] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-17T22:00:50.296868] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-17T22:00:50.603999] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T22:00:50.942324] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-17T22:00:51.742256] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-17T22:00:51.930065] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-17T22:00:52.542320] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-17T22:00:52.826489] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T22:00:53.179717] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T22:00:53.342317] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-17T22:00:54.142258] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-17T22:00:54.305941] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-17T22:00:54.775099] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-17T22:00:54.942321] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-17T22:00:55.300809] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T22:00:55.742363] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-17T22:00:56.542306] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-17T22:00:56.599746] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T22:00:57.342361] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-17T22:00:57.806077] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-17T22:00:57.835305] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-17T22:00:58.142290] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-17T22:00:58.942261] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-17T22:00:59.115616] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T22:00:59.742278] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-17T22:00:59.781960] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T22:01:00.542279] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-17T22:01:00.749813] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-17T22:01:01.342267] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-17T22:01:01.589589] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-17T22:01:01.804782] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-17T22:01:02.142285] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-17T22:01:02.942308] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-17T22:01:03.118279] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T22:01:03.529321] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-17T22:01:03.742261] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-17T22:01:04.332256] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T22:01:04.339443] [INFO ] [REMOTE ] TRU: Full fetch complete (74022 records). [2025-10-17T22:01:04.339570] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-17T22:01:04.548118] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-17T22:01:04.735440] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-17T22:01:04.735529] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-17T22:01:04.736729] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-17T22:01:04.736795] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-17T22:01:04.738906] [DEBUG] [LOCAL ] TRU: Trimmed 74022 records to 52194 (keeping 200 days of data) [2025-10-17T22:01:05.062346] [DEBUG] [LOCAL ] TRU: Primary data saved (52194 records). [2025-10-17T22:01:05.062566] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-17T22:01:05.062766] [INFO ] [MAIN ] Update Progress: 2132/2368 symbols completed. TRU took 36.4s. Estimated remaining: 33m 19s. Rate: 7.1 symbols/min [2025-10-17T22:01:05.234319] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:01:05.279250] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T22:01:05.283336] [DEBUG] [LOCAL ] TSI: Loaded 8147 existing records from primary storage. [2025-10-17T22:01:05.310436] [INFO ] [MAIN ] TSI: Loaded 8147 existing records. [2025-10-17T22:01:05.335610] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T22:01:05.343631] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-17T22:01:05.417230] [INFO ] [REMOTE ] TRV: Full fetch complete (69890 records). [2025-10-17T22:01:05.420625] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-17T22:01:05.602395] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:01:05.605358] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-17T22:01:05.611197] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-17T22:01:05.621711] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-10-17T22:01:05.626915] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-17T22:01:06.146195] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-17T22:01:06.224976] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-17T22:01:06.230193] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-17T22:01:06.236664] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-17T22:01:06.249506] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-17T22:01:06.290835] [DEBUG] [LOCAL ] TRV: Trimmed 69890 records to 48191 (keeping 200 days of data) [2025-10-17T22:01:06.290729] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:01:06.598164] [DEBUG] [LOCAL ] TRV: Primary data saved (48191 records). [2025-10-17T22:01:06.598305] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-17T22:01:06.598393] [INFO ] [MAIN ] Update Progress: 2133/2368 symbols completed. TRV took 32.9s. Estimated remaining: 33m 10s. Rate: 7.1 symbols/min [2025-10-17T22:01:06.781833] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:01:06.834120] [DEBUG] [LOCAL ] TSLX: Loaded 36199 existing records from primary storage. [2025-10-17T22:01:06.834393] [INFO ] [MAIN ] TSLX: Loaded 36199 existing records. [2025-10-17T22:01:06.947360] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-10-17T22:01:07.013527] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:01:07.014170] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-17T22:01:07.014233] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-17T22:01:07.014462] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-17T22:01:07.014520] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-17T22:01:07.429573] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:01:07.433368] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-17T22:01:07.491535] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-17T22:01:07.733506] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-17T22:01:07.742239] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-17T22:01:08.542303] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-17T22:01:09.061324] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-17T22:01:09.342314] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-17T22:01:10.142367] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-10-17T22:01:10.321287] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T22:01:10.691609] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-17T22:01:10.942288] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-17T22:01:11.592062] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-17T22:01:11.742255] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-17T22:01:12.121346] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-17T22:01:12.380199] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-17T22:01:12.542289] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-17T22:01:13.342298] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-17T22:01:13.620696] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T22:01:13.624469] [INFO ] [REMOTE ] TSE: Full fetch complete (40710 records). [2025-10-17T22:01:13.624633] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-17T22:01:14.015202] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-17T22:01:14.015298] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-17T22:01:14.016142] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-17T22:01:14.016204] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-17T22:01:14.017084] [DEBUG] [LOCAL ] TSE: Trimmed 40710 records to 28113 (keeping 200 days of data) [2025-10-17T22:01:14.148613] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-17T22:01:14.177793] [DEBUG] [LOCAL ] TSE: Primary data saved (28113 records). [2025-10-17T22:01:14.177945] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-17T22:01:14.178031] [INFO ] [MAIN ] Update Progress: 2134/2368 symbols completed. TSE took 30.4s. Estimated remaining: 33m 1s. Rate: 7.1 symbols/min [2025-10-17T22:01:14.347770] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:01:14.399066] [DEBUG] [LOCAL ] TSM: Loaded 54209 existing records from primary storage. [2025-10-17T22:01:14.399412] [INFO ] [MAIN ] TSM: Loaded 54209 existing records. [2025-10-17T22:01:14.585244] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:01:14.585736] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-17T22:01:14.585870] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-17T22:01:14.601003] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-17T22:01:14.601185] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-17T22:01:14.607621] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-17T22:01:14.951679] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-17T22:01:14.956357] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:01:15.742310] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-10-17T22:01:16.058360] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T22:01:16.327243] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T22:01:16.349233] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-17T22:01:16.542304] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-10-17T22:01:17.342287] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-10-17T22:01:18.142267] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-17T22:01:18.255636] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T22:01:18.942256] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-17T22:01:19.351511] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.81 seconds). [2025-10-17T22:01:19.706712] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T22:01:19.742241] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-17T22:01:20.542257] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-17T22:01:20.706776] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-17T22:01:20.713929] [INFO ] [REMOTE ] TS: Full fetch complete (74771 records). [2025-10-17T22:01:20.714055] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-17T22:01:21.136759] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-17T22:01:21.137367] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-17T22:01:21.139759] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-17T22:01:21.138839] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-17T22:01:21.147476] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-17T22:01:21.149260] [DEBUG] [LOCAL ] TS: Trimmed 74771 records to 52431 (keeping 200 days of data) [2025-10-17T22:01:21.350120] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-17T22:01:21.454177] [DEBUG] [LOCAL ] TS: Primary data saved (52431 records). [2025-10-17T22:01:21.454303] [INFO ] [MAIN ] TS: Full history saved. [2025-10-17T22:01:21.455059] [INFO ] [MAIN ] Update Progress: 2135/2368 symbols completed. TS took 41.7s. Estimated remaining: 32m 53s. Rate: 7.1 symbols/min [2025-10-17T22:01:21.621099] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:01:21.672239] [DEBUG] [LOCAL ] TSN: Loaded 53431 existing records from primary storage. [2025-10-17T22:01:21.672555] [INFO ] [MAIN ] TSN: Loaded 53431 existing records. [2025-10-17T22:01:21.854574] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:01:21.854860] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-17T22:01:21.854922] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-17T22:01:21.855115] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-17T22:01:21.855167] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-17T22:01:22.147588] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-10-17T22:01:22.208809] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:01:22.775936] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T22:01:22.942246] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-10-17T22:01:22.949519] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-17T22:01:23.303192] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-10-17T22:01:23.742298] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-17T22:01:24.542262] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-17T22:01:24.744507] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T22:01:25.342338] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-10-17T22:01:26.046982] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T22:01:26.075023] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-17T22:01:26.142354] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-17T22:01:26.817466] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (3.08 seconds). [2025-10-17T22:01:26.942297] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-17T22:01:27.742312] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-10-17T22:01:27.918777] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-17T22:01:28.488886] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-17T22:01:28.542266] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-10-17T22:01:29.289386] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-17T22:01:29.342254] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-10-17T22:01:29.575144] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-10-17T22:01:29.857323] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-17T22:01:30.142339] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-17T22:01:30.942258] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-10-17T22:01:31.673108] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-17T22:01:31.742247] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-10. [2025-10-17T22:01:31.851609] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T22:01:32.329547] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T22:01:32.332001] [INFO ] [REMOTE ] TSI: Full fetch complete (14019 records). [2025-10-17T22:01:32.332092] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-17T22:01:32.547408] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-17T22:01:32.696298] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-17T22:01:32.696378] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-17T22:01:32.696752] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-17T22:01:32.696814] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-17T22:01:32.697338] [DEBUG] [LOCAL ] TSI: Trimmed 14019 records to 8285 (keeping 200 days of data) [2025-10-17T22:01:32.745103] [DEBUG] [LOCAL ] TSI: Primary data saved (8285 records). [2025-10-17T22:01:32.745226] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-17T22:01:32.745304] [INFO ] [MAIN ] Update Progress: 2136/2368 symbols completed. TSI took 27.7s. Estimated remaining: 32m 45s. Rate: 7.1 symbols/min [2025-10-17T22:01:32.914868] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:01:32.928588] [DEBUG] [LOCAL ] TSQ: Loaded 11747 existing records from primary storage. [2025-10-17T22:01:32.928891] [INFO ] [MAIN ] TSQ: Loaded 11747 existing records. [2025-10-17T22:01:33.107511] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:01:33.107814] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-17T22:01:33.107887] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-17T22:01:33.108065] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-17T22:01:33.108117] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-17T22:01:33.347822] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-17T22:01:33.486294] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:01:34.142364] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-17T22:01:34.512795] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-17T22:01:34.942296] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-17T22:01:35.619024] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-17T22:01:35.742296] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-17T22:01:36.274301] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-10-17T22:01:36.542293] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-17T22:01:36.780185] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T22:01:36.829450] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T22:01:37.342316] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-17T22:01:38.142304] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-17T22:01:38.694034] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T22:01:38.942319] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-10-17T22:01:39.439334] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.90 seconds). [2025-10-17T22:01:39.742284] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-17T22:01:39.800323] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-17T22:01:40.002730] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T22:01:40.542291] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-17T22:01:41.342317] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-17T22:01:42.142289] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-17T22:01:42.283201] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T22:01:42.419026] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-17T22:01:42.718106] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T22:01:42.725499] [INFO ] [REMOTE ] TSLX: Full fetch complete (50523 records). [2025-10-17T22:01:42.725679] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-17T22:01:42.885905] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-17T22:01:42.947375] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-17T22:01:43.136062] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-17T22:01:43.136160] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-17T22:01:43.137187] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-17T22:01:43.137250] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-17T22:01:43.138535] [DEBUG] [LOCAL ] TSLX: Trimmed 50523 records to 36454 (keeping 200 days of data) [2025-10-17T22:01:43.363493] [DEBUG] [LOCAL ] TSLX: Primary data saved (36454 records). [2025-10-17T22:01:43.363629] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-17T22:01:43.363757] [INFO ] [MAIN ] Update Progress: 2137/2368 symbols completed. TSLX took 36.8s. Estimated remaining: 32m 36s. Rate: 7.1 symbols/min [2025-10-17T22:01:43.535443] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:01:43.580617] [DEBUG] [LOCAL ] TT: Loaded 47661 existing records from primary storage. [2025-10-17T22:01:43.580964] [INFO ] [MAIN ] TT: Loaded 47661 existing records. [2025-10-17T22:01:43.772997] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:01:43.748568] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-17T22:01:43.773434] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-17T22:01:43.774539] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-17T22:01:43.780756] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-17T22:01:43.781199] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-17T22:01:43.781450] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-17T22:01:44.163109] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:01:44.542301] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-10-17T22:01:45.342312] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-17T22:01:45.785415] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T22:01:46.142262] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-17T22:01:46.268682] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T22:01:46.942367] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-17T22:01:47.742364] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-17T22:01:47.974029] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T22:01:48.280759] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-10-17T22:01:48.524931] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-17T22:01:48.542243] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-17T22:01:48.761115] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-17T22:01:49.342294] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-17T22:01:50.142275] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-17T22:01:50.344287] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T22:01:50.942316] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-17T22:01:51.228432] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T22:01:51.697390] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-17T22:01:51.704717] [INFO ] [REMOTE ] TSN: Full fetch complete (76659 records). [2025-10-17T22:01:51.704905] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-17T22:01:51.747390] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-17T22:01:52.098975] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-17T22:01:52.099061] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-17T22:01:52.100249] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-17T22:01:52.100315] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-17T22:01:52.101865] [DEBUG] [LOCAL ] TSN: Trimmed 76659 records to 53821 (keeping 200 days of data) [2025-10-17T22:01:52.440040] [DEBUG] [LOCAL ] TSN: Primary data saved (53821 records). [2025-10-17T22:01:52.440330] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-17T22:01:52.441178] [INFO ] [MAIN ] Update Progress: 2138/2368 symbols completed. TSN took 31.0s. Estimated remaining: 32m 28s. Rate: 7.1 symbols/min [2025-10-17T22:01:52.545475] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-17T22:01:52.624749] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:01:52.630461] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-17T22:01:52.633818] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-17T22:01:52.635846] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-17T22:01:52.637082] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-17T22:01:52.636959] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-17T22:01:52.641467] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-17T22:01:52.641904] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-17T22:01:53.025558] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-10-17T22:01:53.030401] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:01:53.342302] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-10-17T22:01:53.537743] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T22:01:53.538099] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-10-17T22:01:53.538189] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T22:01:53.538236] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-17T22:01:53.538298] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T22:01:53.538371] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-17T22:01:53.538437] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-17T22:01:53.538473] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-17T22:01:53.538512] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-17T22:01:53.538573] [INFO ] [MAIN ] Update Progress: 2139/2368 symbols completed. TTAM took 1.1s. Estimated remaining: 32m 19s. Rate: 7.1 symbols/min [2025-10-17T22:01:53.706976] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:01:53.746078] [DEBUG] [LOCAL ] TTC: Loaded 42274 existing records from primary storage. [2025-10-17T22:01:53.746403] [INFO ] [MAIN ] TTC: Loaded 42274 existing records. [2025-10-17T22:01:53.917457] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:01:53.917632] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-17T22:01:53.917710] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-17T22:01:53.917934] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-17T22:01:53.917990] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-17T22:01:54.150765] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-17T22:01:54.268328] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:01:54.484515] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-17T22:01:54.942302] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-17T22:01:55.149801] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-17T22:01:55.742290] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-17T22:01:56.542393] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-17T22:01:56.879397] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-17T22:01:56.916538] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-17T22:01:57.342342] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-17T22:01:58.142293] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-10-17T22:01:58.224822] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-17T22:01:58.946930] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-17T22:01:58.952740] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-17T22:01:59.262743] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T22:01:59.524391] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-17T22:01:59.742347] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-17T22:02:00.542384] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-17T22:02:01.330461] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T22:02:01.342268] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-17T22:02:01.584080] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T22:02:01.992308] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-17T22:02:01.994926] [INFO ] [REMOTE ] TSQ: Full fetch complete (16377 records). [2025-10-17T22:02:01.995051] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-17T22:02:02.147482] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-17T22:02:02.398194] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-17T22:02:02.398271] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-17T22:02:02.398606] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-17T22:02:02.398667] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-17T22:02:02.399259] [DEBUG] [LOCAL ] TSQ: Trimmed 16377 records to 11828 (keeping 200 days of data) [2025-10-17T22:02:02.466234] [DEBUG] [LOCAL ] TSQ: Primary data saved (11828 records). [2025-10-17T22:02:02.466373] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-17T22:02:02.466456] [INFO ] [MAIN ] Update Progress: 2140/2368 symbols completed. TSQ took 29.7s. Estimated remaining: 32m 10s. Rate: 7.1 symbols/min [2025-10-17T22:02:02.631612] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:02:02.681810] [DEBUG] [LOCAL ] TTE: Loaded 51968 existing records from primary storage. [2025-10-17T22:02:02.682152] [INFO ] [MAIN ] TTE: Loaded 51968 existing records. [2025-10-17T22:02:02.864870] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:02:02.865170] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-17T22:02:02.865226] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-17T22:02:02.865438] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-17T22:02:02.865495] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-17T22:02:02.947403] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-17T22:02:03.237229] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:02:03.742300] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-10-17T22:02:03.784048] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T22:02:04.542328] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-17T22:02:04.638106] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T22:02:05.342271] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-17T22:02:05.668585] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-17T22:02:06.142282] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-17T22:02:06.432463] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T22:02:06.942300] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-17T22:02:07.646686] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-17T22:02:07.742253] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-17T22:02:08.078429] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-17T22:02:08.086507] [INFO ] [REMOTE ] TSM: Full fetch complete (77999 records). [2025-10-17T22:02:08.086660] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-17T22:02:08.477632] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-17T22:02:08.477801] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-17T22:02:08.479296] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-17T22:02:08.479385] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-17T22:02:08.481532] [DEBUG] [LOCAL ] TSM: Trimmed 77999 records to 54599 (keeping 200 days of data) [2025-10-17T22:02:08.547557] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-17T22:02:08.639120] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T22:02:08.875905] [DEBUG] [LOCAL ] TSM: Primary data saved (54599 records). [2025-10-17T22:02:08.876054] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-17T22:02:08.876137] [INFO ] [MAIN ] Update Progress: 2141/2368 symbols completed. TSM took 54.7s. Estimated remaining: 32m 2s. Rate: 7.1 symbols/min [2025-10-17T22:02:09.052778] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:02:09.099618] [DEBUG] [LOCAL ] TTI: Loaded 46751 existing records from primary storage. [2025-10-17T22:02:09.099971] [INFO ] [MAIN ] TTI: Loaded 46751 existing records. [2025-10-17T22:02:09.283126] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:02:09.283477] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-17T22:02:09.283616] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-17T22:02:09.292800] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-17T22:02:09.308788] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-17T22:02:09.341999] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T22:02:09.353675] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-17T22:02:09.676621] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:02:10.142259] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-10-17T22:02:10.313185] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T22:02:10.763225] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-17T22:02:10.942311] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-17T22:02:11.660736] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T22:02:11.742262] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-17T22:02:12.547987] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-17T22:02:12.559429] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T22:02:13.211222] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-17T22:02:13.218277] [INFO ] [REMOTE ] TT: Full fetch complete (69985 records). [2025-10-17T22:02:13.218403] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-17T22:02:13.343011] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-17T22:02:13.578105] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-17T22:02:13.675204] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-17T22:02:13.675279] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-17T22:02:13.676393] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-17T22:02:13.676456] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-17T22:02:13.677904] [DEBUG] [LOCAL ] TT: Trimmed 69985 records to 47906 (keeping 200 days of data) [2025-10-17T22:02:13.967963] [DEBUG] [LOCAL ] TT: Primary data saved (47906 records). [2025-10-17T22:02:13.968090] [INFO ] [MAIN ] TT: Full history saved. [2025-10-17T22:02:13.968171] [INFO ] [MAIN ] Update Progress: 2142/2368 symbols completed. TT took 30.6s. Estimated remaining: 31m 53s. Rate: 7.1 symbols/min [2025-10-17T22:02:14.131330] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:02:14.142379] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-17T22:02:14.178990] [DEBUG] [LOCAL ] TU: Loaded 50192 existing records from primary storage. [2025-10-17T22:02:14.179285] [INFO ] [MAIN ] TU: Loaded 50192 existing records. [2025-10-17T22:02:14.352145] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:02:14.352317] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-17T22:02:14.352363] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-17T22:02:14.352563] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-17T22:02:14.352619] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-17T22:02:14.696533] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:02:14.942293] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-10-17T22:02:14.976483] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T22:02:15.742277] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-17T22:02:16.036033] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T22:02:16.542277] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-17T22:02:16.692392] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T22:02:17.282451] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T22:02:17.342283] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-17T22:02:18.142283] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-17T22:02:18.449196] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-17T22:02:18.942351] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-17T22:02:18.998760] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T22:02:19.742262] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-17T22:02:19.858146] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T22:02:20.542278] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-17T22:02:20.763669] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T22:02:21.343206] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-17T22:02:21.348214] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T22:02:22.142289] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-17T22:02:22.193402] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-17T22:02:22.942303] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-17T22:02:23.141205] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-17T22:02:23.653006] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T22:02:23.742263] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-17T22:02:24.510157] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T22:02:24.542241] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-17T22:02:25.350116] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-17T22:02:25.355593] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T22:02:26.084345] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T22:02:26.142302] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-17T22:02:26.942349] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-17T22:02:27.098197] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T22:02:27.674006] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T22:02:27.742243] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-17T22:02:28.542338] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-17T22:02:28.711416] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T22:02:29.342335] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-17T22:02:29.528049] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-17T22:02:30.142289] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-17T22:02:30.225731] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T22:02:30.566010] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T22:02:30.571953] [INFO ] [REMOTE ] TTC: Full fetch complete (62081 records). [2025-10-17T22:02:30.572055] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-17T22:02:30.951541] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-17T22:02:30.948119] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-17T22:02:30.951996] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-17T22:02:30.954209] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-17T22:02:30.954387] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-17T22:02:30.955798] [DEBUG] [LOCAL ] TTC: Trimmed 62081 records to 42525 (keeping 200 days of data) [2025-10-17T22:02:31.226619] [DEBUG] [LOCAL ] TTC: Primary data saved (42525 records). [2025-10-17T22:02:31.226772] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-17T22:02:31.227483] [INFO ] [MAIN ] Update Progress: 2143/2368 symbols completed. TTC took 37.7s. Estimated remaining: 31m 45s. Rate: 7.1 symbols/min [2025-10-17T22:02:31.398432] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:02:31.441391] [DEBUG] [LOCAL ] TUYA: Loaded 46284 existing records from primary storage. [2025-10-17T22:02:31.441720] [INFO ] [MAIN ] TUYA: Loaded 46284 existing records. [2025-10-17T22:02:31.621943] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:02:31.622142] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-17T22:02:31.622189] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-17T22:02:31.622414] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-17T22:02:31.622470] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-17T22:02:31.761609] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-17T22:02:31.979160] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T22:02:32.031873] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:02:32.542265] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-17T22:02:32.632544] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T22:02:33.342318] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-17T22:02:33.669340] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-17T22:02:34.142352] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-17T22:02:34.193491] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T22:02:34.947427] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-10-17T22:02:34.960897] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T22:02:35.742272] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-17T22:02:36.043936] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T22:02:36.487082] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T22:02:36.542247] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-17T22:02:37.325059] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T22:02:37.342244] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-17T22:02:37.988269] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T22:02:38.142336] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-17T22:02:38.741800] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T22:02:38.942308] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-17T22:02:39.742291] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-17T22:02:39.822562] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T22:02:39.829945] [INFO ] [REMOTE ] TTI: Full fetch complete (66236 records). [2025-10-17T22:02:39.830116] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-17T22:02:40.233529] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-17T22:02:40.233626] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-17T22:02:40.234953] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-17T22:02:40.235032] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-17T22:02:40.236492] [DEBUG] [LOCAL ] TTI: Trimmed 66236 records to 47129 (keeping 200 days of data) [2025-10-17T22:02:40.508866] [DEBUG] [LOCAL ] TTI: Primary data saved (47129 records). [2025-10-17T22:02:40.509003] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-17T22:02:40.509205] [INFO ] [MAIN ] Update Progress: 2144/2368 symbols completed. TTI took 31.6s. Estimated remaining: 31m 37s. Rate: 7.1 symbols/min [2025-10-17T22:02:40.551188] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-17T22:02:40.681312] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:02:40.718734] [DEBUG] [LOCAL ] TV: Loaded 41831 existing records from primary storage. [2025-10-17T22:02:40.719152] [INFO ] [MAIN ] TV: Loaded 41831 existing records. [2025-10-17T22:02:40.922689] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:02:40.922961] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-17T22:02:40.923065] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-17T22:02:40.925323] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-17T22:02:40.925256] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-17T22:02:40.925510] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-17T22:02:41.290308] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:02:41.348422] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-17T22:02:41.367019] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T22:02:42.142343] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-17T22:02:42.388623] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T22:02:42.942355] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-17T22:02:43.174030] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T22:02:43.749475] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-17T22:02:43.770591] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T22:02:44.542342] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-17T22:02:44.763901] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T22:02:44.771214] [INFO ] [REMOTE ] TTE: Full fetch complete (75121 records). [2025-10-17T22:02:44.771392] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-17T22:02:45.162286] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-17T22:02:45.162374] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-17T22:02:45.163557] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-17T22:02:45.163622] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-17T22:02:45.165097] [DEBUG] [LOCAL ] TTE: Trimmed 75121 records to 52350 (keeping 200 days of data) [2025-10-17T22:02:45.343334] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-10-17T22:02:45.506957] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T22:02:45.535675] [DEBUG] [LOCAL ] TTE: Primary data saved (52350 records). [2025-10-17T22:02:45.535828] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-17T22:02:45.535913] [INFO ] [MAIN ] Update Progress: 2145/2368 symbols completed. TTE took 43.1s. Estimated remaining: 31m 28s. Rate: 7.1 symbols/min [2025-10-17T22:02:45.705216] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:02:45.711025] [DEBUG] [LOCAL ] TVC: Loaded 3226 existing records from primary storage. [2025-10-17T22:02:45.711198] [INFO ] [MAIN ] TVC: Loaded 3226 existing records. [2025-10-17T22:02:45.890329] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:02:45.890541] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-17T22:02:45.890589] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-17T22:02:45.890743] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-17T22:02:45.890799] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-17T22:02:46.146327] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-17T22:02:46.282172] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-17T22:02:46.288066] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:02:46.296760] [INFO ] [REMOTE ] TU: Full fetch complete (72909 records). [2025-10-17T22:02:46.296948] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-17T22:02:46.728188] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-17T22:02:46.728398] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-17T22:02:46.730639] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-17T22:02:46.730733] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-17T22:02:46.733083] [DEBUG] [LOCAL ] TU: Trimmed 72909 records to 50563 (keeping 200 days of data) [2025-10-17T22:02:46.966949] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-10-17T22:02:47.025838] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T22:02:47.144889] [DEBUG] [LOCAL ] TU: Primary data saved (50563 records). [2025-10-17T22:02:47.145049] [INFO ] [MAIN ] TU: Full history saved. [2025-10-17T22:02:47.145136] [INFO ] [MAIN ] Update Progress: 2146/2368 symbols completed. TU took 33.2s. Estimated remaining: 31m 19s. Rate: 7.1 symbols/min [2025-10-17T22:02:47.343394] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:02:47.348876] [DEBUG] [LOCAL ] TVE: Loaded 2647 existing records from primary storage. [2025-10-17T22:02:47.349114] [INFO ] [MAIN ] TVE: Loaded 2647 existing records. [2025-10-17T22:02:47.570576] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:02:47.571398] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-17T22:02:47.571516] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-17T22:02:47.571760] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-17T22:02:47.571825] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-17T22:02:47.754725] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-17T22:02:47.771183] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-17T22:02:47.989356] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-17T22:02:48.014666] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:02:48.542297] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-10-17T22:02:49.135059] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-17T22:02:49.342341] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-17T22:02:49.387477] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T22:02:49.927733] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T22:02:50.142329] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-17T22:02:50.713498] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-17T22:02:50.942348] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-10-17T22:02:51.512960] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-17T22:02:51.742360] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-17T22:02:52.329860] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T22:02:52.542281] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-17T22:02:53.342328] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-17T22:02:53.995518] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T22:02:54.142264] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-17T22:02:54.635437] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T22:02:54.762599] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-17T22:02:54.942291] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-10-17T22:02:55.518111] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-17T22:02:55.742272] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-17T22:02:56.542291] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-17T22:02:57.123154] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-17T22:02:57.356299] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-17T22:02:57.395459] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T22:02:57.954902] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T22:02:58.142285] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-17T22:02:58.942280] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-17T22:02:59.426897] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-17T22:02:59.742265] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-17T22:02:59.807371] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T22:03:00.542299] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-17T22:03:01.280264] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T22:03:01.342282] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-17T22:03:02.149279] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-17T22:03:02.168342] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T22:03:02.743823] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-17T22:03:02.942385] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-17T22:03:03.047961] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-17T22:03:03.499887] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T22:03:03.742291] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-10-17T22:03:04.252358] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-17T22:03:04.542333] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-10-17T22:03:05.066727] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-17T22:03:05.342287] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-17T22:03:05.824215] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-17T22:03:06.142355] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-17T22:03:06.942352] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-10-17T22:03:07.666788] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T22:03:07.665906] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-17T22:03:07.742254] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-10-17T22:03:08.214387] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-17T22:03:08.542297] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-17T22:03:09.342285] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-10-17T22:03:09.802283] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-17T22:03:10.142289] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-10-17T22:03:10.197312] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-17T22:03:10.803937] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-17T22:03:10.942350] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-17T22:03:11.419617] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-17T22:03:11.421139] [INFO ] [REMOTE ] TVC: Full fetch complete (5197 records). [2025-10-17T22:03:11.421287] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-17T22:03:11.747507] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-17T22:03:11.907733] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-17T22:03:11.907868] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-17T22:03:11.908050] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-17T22:03:11.908091] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-17T22:03:11.908570] [DEBUG] [LOCAL ] TVC: Trimmed 5197 records to 3240 (keeping 200 days of data) [2025-10-17T22:03:11.931693] [DEBUG] [LOCAL ] TVC: Primary data saved (3240 records). [2025-10-17T22:03:11.931875] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-17T22:03:11.931989] [INFO ] [MAIN ] Update Progress: 2147/2368 symbols completed. TVC took 26.4s. Estimated remaining: 31m 12s. Rate: 7.1 symbols/min [2025-10-17T22:03:12.104180] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:03:12.138391] [DEBUG] [LOCAL ] TWI: Loaded 34191 existing records from primary storage. [2025-10-17T22:03:12.138779] [INFO ] [MAIN ] TWI: Loaded 34191 existing records. [2025-10-17T22:03:12.310809] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:03:12.311030] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-17T22:03:12.311098] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-17T22:03:12.311443] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-17T22:03:12.311523] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-17T22:03:12.547435] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-10. [2025-10-17T22:03:12.663840] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:03:13.059155] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-17T22:03:13.060049] [INFO ] [REMOTE ] TVE: Full fetch complete (4253 records). [2025-10-17T22:03:13.060118] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-17T22:03:13.350085] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-10-17T22:03:13.430429] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-17T22:03:13.430669] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-17T22:03:13.431142] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-17T22:03:13.431812] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-17T22:03:13.431915] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-17T22:03:13.438374] [DEBUG] [LOCAL ] TVE: Trimmed 4253 records to 2658 (keeping 200 days of data) [2025-10-17T22:03:13.438727] [INFO ] [REMOTE ] TUYA: Full fetch complete (66574 records). [2025-10-17T22:03:13.438957] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-17T22:03:13.559723] [DEBUG] [LOCAL ] TVE: Primary data saved (2658 records). [2025-10-17T22:03:13.559836] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-17T22:03:13.559981] [INFO ] [MAIN ] Update Progress: 2148/2368 symbols completed. TVE took 26.4s. Estimated remaining: 31m 3s. Rate: 7.1 symbols/min [2025-10-17T22:03:13.960494] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:03:14.037471] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-17T22:03:14.037588] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-17T22:03:14.039379] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-17T22:03:14.039574] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-17T22:03:14.041662] [DEBUG] [LOCAL ] TUYA: Trimmed 66574 records to 46657 (keeping 200 days of data) [2025-10-17T22:03:14.144212] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-17T22:03:14.183949] [DEBUG] [LOCAL ] TWLO: Loaded 53217 existing records from primary storage. [2025-10-17T22:03:14.194997] [INFO ] [MAIN ] TWLO: Loaded 53217 existing records. [2025-10-17T22:03:14.477775] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:03:14.479017] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-17T22:03:14.480214] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-17T22:03:14.482218] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-17T22:03:14.483115] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-17T22:03:14.911054] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:03:14.922067] [DEBUG] [LOCAL ] TUYA: Primary data saved (46657 records). [2025-10-17T22:03:14.922837] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-17T22:03:14.922963] [INFO ] [MAIN ] Update Progress: 2149/2368 symbols completed. TUYA took 43.7s. Estimated remaining: 30m 54s. Rate: 7.1 symbols/min [2025-10-17T22:03:14.947451] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-10-17T22:03:15.121821] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:03:15.148717] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T22:03:15.151025] [DEBUG] [LOCAL ] TWN: Loaded 3306 existing records from primary storage. [2025-10-17T22:03:15.160222] [INFO ] [MAIN ] TWN: Loaded 3306 existing records. [2025-10-17T22:03:15.336892] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:03:15.337117] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-17T22:03:15.337166] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-17T22:03:15.337344] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-17T22:03:15.337398] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-17T22:03:15.692286] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:03:15.744238] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-17T22:03:15.746753] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-17T22:03:16.542276] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-17T22:03:16.986582] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-17T22:03:17.181074] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T22:03:17.342295] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-10-17T22:03:18.035686] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T22:03:18.142283] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-17T22:03:18.791057] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-17T22:03:18.942280] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-10-17T22:03:19.742272] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-10-17T22:03:20.215990] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-17T22:03:20.528220] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-17T22:03:20.547358] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-17T22:03:20.560541] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T22:03:21.342311] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-10-17T22:03:22.085140] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T22:03:22.142327] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-17T22:03:22.423174] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-17T22:03:22.942330] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-10-17T22:03:23.397820] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T22:03:23.403016] [INFO ] [REMOTE ] TV: Full fetch complete (61233 records). [2025-10-17T22:03:23.403148] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-17T22:03:23.748742] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-17T22:03:23.806464] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-17T22:03:23.806567] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-17T22:03:23.807809] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-17T22:03:23.807875] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-17T22:03:23.809301] [DEBUG] [LOCAL ] TV: Trimmed 61233 records to 42121 (keeping 200 days of data) [2025-10-17T22:03:24.052740] [DEBUG] [LOCAL ] TV: Primary data saved (42121 records). [2025-10-17T22:03:24.052867] [INFO ] [MAIN ] TV: Full history saved. [2025-10-17T22:03:24.052965] [INFO ] [MAIN ] Update Progress: 2150/2368 symbols completed. TV took 43.5s. Estimated remaining: 30m 45s. Rate: 7.1 symbols/min [2025-10-17T22:03:24.230846] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:03:24.276166] [DEBUG] [LOCAL ] TWO: Loaded 49008 existing records from primary storage. [2025-10-17T22:03:24.276493] [INFO ] [MAIN ] TWO: Loaded 49008 existing records. [2025-10-17T22:03:24.383741] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-17T22:03:24.488423] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:03:24.490012] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T22:03:24.490114] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-17T22:03:24.490307] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-17T22:03:24.497402] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-17T22:03:24.497507] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-17T22:03:24.551128] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-17T22:03:24.857774] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:03:25.342352] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-10-17T22:03:26.142331] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-10-17T22:03:26.551217] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-17T22:03:26.942331] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-17T22:03:27.157099] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-17T22:03:27.428579] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T22:03:27.742297] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-10-17T22:03:28.542300] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-17T22:03:28.816304] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T22:03:28.991307] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-17T22:03:29.184740] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-17T22:03:29.342291] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-17T22:03:30.142318] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-10-17T22:03:30.954925] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-17T22:03:30.958447] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T22:03:31.501267] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T22:03:31.586853] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-17T22:03:31.742272] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-10-17T22:03:32.542361] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-17T22:03:32.961911] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-17T22:03:33.133091] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-17T22:03:33.342360] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-17T22:03:34.142359] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-17T22:03:34.773374] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T22:03:34.942353] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-17T22:03:35.312379] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T22:03:35.742338] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-17T22:03:36.208871] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-17T22:03:36.491261] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T22:03:36.542251] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-17T22:03:37.342358] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-10. [2025-10-17T22:03:38.142321] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-17T22:03:38.310155] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T22:03:38.606595] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T22:03:38.612083] [INFO ] [REMOTE ] TWI: Full fetch complete (52229 records). [2025-10-17T22:03:38.612239] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-17T22:03:38.787987] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-17T22:03:38.947395] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-17T22:03:38.996011] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-17T22:03:38.996097] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-17T22:03:38.997129] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-17T22:03:38.997194] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-17T22:03:38.998382] [DEBUG] [LOCAL ] TWI: Trimmed 52229 records to 34457 (keeping 200 days of data) [2025-10-17T22:03:39.191871] [DEBUG] [LOCAL ] TWI: Primary data saved (34457 records). [2025-10-17T22:03:39.192003] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-17T22:03:39.192107] [INFO ] [MAIN ] Update Progress: 2151/2368 symbols completed. TWI took 27.3s. Estimated remaining: 30m 38s. Rate: 7.1 symbols/min [2025-10-17T22:03:39.362203] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:03:39.362438] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-17T22:03:39.362494] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-17T22:03:39.362666] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-17T22:03:39.362758] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-17T22:03:39.362857] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-17T22:03:39.362921] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-17T22:03:39.715196] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:03:39.742251] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-10-17T22:03:39.954027] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T22:03:39.954394] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-10-17T22:03:39.954487] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T22:03:39.954535] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-17T22:03:39.954570] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T22:03:39.954609] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-17T22:03:39.954692] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-17T22:03:39.954781] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-17T22:03:39.954847] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-17T22:03:39.954898] [INFO ] [MAIN ] Update Progress: 2152/2368 symbols completed. TWOD took 0.8s. Estimated remaining: 30m 28s. Rate: 7.1 symbols/min [2025-10-17T22:03:40.121181] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:03:40.121387] [DEBUG] [LOCAL ] TX: No existing data file found in primary storage. [2025-10-17T22:03:40.121440] [WARN ] [MAIN ] TX: No existing data found, performing full refresh instead. [2025-10-17T22:03:40.121555] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-17T22:03:40.121596] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-17T22:03:40.121637] [DEBUG] [LOCAL ] TX: No primary data file found to delete. [2025-10-17T22:03:40.121710] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-17T22:03:40.499374] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:03:40.538556] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T22:03:40.548371] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-17T22:03:41.342308] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-17T22:03:41.800106] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-17T22:03:42.142295] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-17T22:03:42.544734] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T22:03:42.692275] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-17T22:03:42.942353] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-17T22:03:43.532138] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T22:03:43.533450] [INFO ] [REMOTE ] TWN: Full fetch complete (5222 records). [2025-10-17T22:03:43.533518] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-17T22:03:43.747519] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-10-17T22:03:43.894416] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-17T22:03:43.894495] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-17T22:03:43.894672] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-17T22:03:43.894734] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-17T22:03:43.895095] [DEBUG] [LOCAL ] TWN: Trimmed 5222 records to 3361 (keeping 200 days of data) [2025-10-17T22:03:43.915498] [DEBUG] [LOCAL ] TWN: Primary data saved (3361 records). [2025-10-17T22:03:43.915562] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-17T22:03:43.915661] [INFO ] [MAIN ] Update Progress: 2153/2368 symbols completed. TWN took 29.0s. Estimated remaining: 30m 19s. Rate: 7.1 symbols/min [2025-10-17T22:03:44.087552] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:03:44.128035] [DEBUG] [LOCAL ] TXNM: Loaded 43712 existing records from primary storage. [2025-10-17T22:03:44.128325] [INFO ] [MAIN ] TXNM: Loaded 43712 existing records. [2025-10-17T22:03:44.334245] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:03:44.334475] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-17T22:03:44.334521] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-17T22:03:44.334750] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-10-17T22:03:44.334809] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-17T22:03:44.547594] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-17T22:03:44.680435] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:03:45.342343] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-10-17T22:03:45.602572] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-17T22:03:46.142350] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-10-17T22:03:46.375527] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-17T22:03:46.523006] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T22:03:46.942322] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-10-17T22:03:47.742328] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-10-17T22:03:48.200137] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-17T22:03:48.479120] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T22:03:48.542437] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-10-17T22:03:48.546368] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-17T22:03:49.342293] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-17T22:03:49.798402] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T22:03:50.142342] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-10-17T22:03:50.942333] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-10-17T22:03:51.124585] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T22:03:51.742335] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-10-17T22:03:52.116447] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-17T22:03:52.233921] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-17T22:03:52.542347] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-17T22:03:53.100804] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-17T22:03:53.342381] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-10-17T22:03:54.142365] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-10-17T22:03:54.468600] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-17T22:03:54.947896] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-10-17T22:03:54.970288] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T22:03:55.742325] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-10-17T22:03:56.138204] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-17T22:03:56.308969] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-17T22:03:56.542347] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-10-17T22:03:57.342340] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-17T22:03:57.442840] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T22:03:57.769958] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-17T22:03:58.142318] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-10-17T22:03:58.942259] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-10. [2025-10-17T22:03:59.111454] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T22:03:59.286447] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T22:03:59.742284] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-17T22:04:00.542269] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-10-17T22:04:00.868973] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-17T22:04:00.876459] [INFO ] [REMOTE ] TWLO: Full fetch complete (76639 records). [2025-10-17T22:04:00.876588] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-17T22:04:01.275190] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-17T22:04:01.275270] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-17T22:04:01.276489] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-17T22:04:01.276553] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-17T22:04:01.278192] [DEBUG] [LOCAL ] TWLO: Trimmed 76639 records to 53590 (keeping 200 days of data) [2025-10-17T22:04:01.363334] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-10-17T22:04:01.578605] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T22:04:01.579817] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T22:04:01.700499] [DEBUG] [LOCAL ] TWLO: Primary data saved (53590 records). [2025-10-17T22:04:01.700734] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-17T22:04:01.700858] [INFO ] [MAIN ] Update Progress: 2154/2368 symbols completed. TWLO took 48.1s. Estimated remaining: 30m 12s. Rate: 7.1 symbols/min [2025-10-17T22:04:01.908570] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:04:01.929994] [DEBUG] [LOCAL ] TXO: Loaded 19992 existing records from primary storage. [2025-10-17T22:04:01.930244] [INFO ] [MAIN ] TXO: Loaded 19992 existing records. [2025-10-17T22:04:02.109435] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:04:02.109681] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-17T22:04:02.109742] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-17T22:04:02.109917] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-17T22:04:02.109958] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-17T22:04:02.147465] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-10-17T22:04:02.485827] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:04:02.942294] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-10-17T22:04:02.968989] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-17T22:04:03.292330] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-17T22:04:03.565397] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-17T22:04:03.742296] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-10-17T22:04:04.542342] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-10-17T22:04:04.984725] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T22:04:05.342315] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-10-17T22:04:05.684589] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T22:04:06.142288] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-10-17T22:04:06.946815] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-17T22:04:06.951631] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T22:04:07.295832] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-17T22:04:07.742275] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-10-17T22:04:07.778975] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T22:04:08.542312] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-17T22:04:08.983460] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T22:04:09.210043] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-17T22:04:09.342302] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-17T22:04:10.142378] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-10-17T22:04:10.942298] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-10. [2025-10-17T22:04:11.074408] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T22:04:11.081246] [INFO ] [REMOTE ] TWO: Full fetch complete (69331 records). [2025-10-17T22:04:11.081388] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-17T22:04:11.365902] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T22:04:11.499951] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-17T22:04:11.500036] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-17T22:04:11.501197] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-17T22:04:11.501264] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-17T22:04:11.502700] [DEBUG] [LOCAL ] TWO: Trimmed 69331 records to 49363 (keeping 200 days of data) [2025-10-17T22:04:11.743155] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-17T22:04:11.812148] [DEBUG] [LOCAL ] TWO: Primary data saved (49363 records). [2025-10-17T22:04:11.812292] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-17T22:04:11.812396] [INFO ] [MAIN ] Update Progress: 2155/2368 symbols completed. TWO took 47.8s. Estimated remaining: 30m 4s. Rate: 7.1 symbols/min [2025-10-17T22:04:11.980121] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:04:12.025127] [DEBUG] [LOCAL ] TXT: Loaded 49959 existing records from primary storage. [2025-10-17T22:04:12.025505] [INFO ] [MAIN ] TXT: Loaded 49959 existing records. [2025-10-17T22:04:12.208485] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:04:12.208743] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-17T22:04:12.208799] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-17T22:04:12.208985] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-17T22:04:12.209026] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-17T22:04:12.422704] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T22:04:12.508043] [INFO ] [REMOTE ] TXNM: Full fetch complete (63040 records). [2025-10-17T22:04:12.523260] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-17T22:04:12.532534] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T22:04:12.549146] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-10. [2025-10-17T22:04:12.724188] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:04:13.003047] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-17T22:04:13.003128] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-17T22:04:13.004213] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-17T22:04:13.004277] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-17T22:04:13.005508] [DEBUG] [LOCAL ] TXNM: Trimmed 63040 records to 43953 (keeping 200 days of data) [2025-10-17T22:04:13.272695] [DEBUG] [LOCAL ] TXNM: Primary data saved (43953 records). [2025-10-17T22:04:13.272970] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-17T22:04:13.273894] [INFO ] [MAIN ] Update Progress: 2156/2368 symbols completed. TXNM took 29.4s. Estimated remaining: 29m 54s. Rate: 7.1 symbols/min [2025-10-17T22:04:13.347426] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-10-17T22:04:13.444882] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:04:13.455840] [DEBUG] [LOCAL ] TY: Loaded 7643 existing records from primary storage. [2025-10-17T22:04:13.456064] [INFO ] [MAIN ] TY: Loaded 7643 existing records. [2025-10-17T22:04:13.635895] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:04:13.636093] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-17T22:04:13.636141] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-17T22:04:13.636324] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-17T22:04:13.636385] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-17T22:04:13.818310] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T22:04:13.915250] [INFO ] [REMOTE ] TX: Full fetch complete (35690 records). [2025-10-17T22:04:13.935876] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-17T22:04:14.134507] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:04:14.145391] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-17T22:04:14.404802] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-17T22:04:14.404888] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-17T22:04:14.405607] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-17T22:04:14.405674] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-17T22:04:14.406506] [DEBUG] [LOCAL ] TX: Trimmed 35690 records to 23667 (keeping 200 days of data) [2025-10-17T22:04:14.546247] [DEBUG] [LOCAL ] TX: Primary data saved (23667 records). [2025-10-17T22:04:14.546380] [INFO ] [MAIN ] TX: Full history saved. [2025-10-17T22:04:14.546463] [INFO ] [MAIN ] Update Progress: 2157/2368 symbols completed. TX took 34.6s. Estimated remaining: 29m 45s. Rate: 7.1 symbols/min [2025-10-17T22:04:14.762217] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T22:04:14.942276] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-10-17T22:04:15.020357] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-17T22:04:15.486103] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-17T22:04:15.742280] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-17T22:04:16.510921] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T22:04:16.542295] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-17T22:04:17.343407] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-17T22:04:17.344987] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T22:04:18.142253] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-17T22:04:18.465524] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T22:04:18.932901] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T22:04:18.942234] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-17T22:04:19.632535] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-17T22:04:19.742296] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-17T22:04:20.451608] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-17T22:04:20.542367] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-17T22:04:21.284069] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-17T22:04:21.342348] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-10-17T22:04:21.864341] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-17T22:04:22.142354] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-10-17T22:04:22.901084] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-17T22:04:22.942242] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-10-17T22:04:23.660947] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-17T22:04:23.742336] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-10. [2025-10-17T22:04:24.455749] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T22:04:24.457254] [INFO ] [REMOTE ] TY: Full fetch complete (11419 records). [2025-10-17T22:04:24.457325] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-17T22:04:24.547476] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-17T22:04:24.817331] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-17T22:04:24.817407] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-17T22:04:24.817711] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-17T22:04:24.817802] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-17T22:04:24.818258] [DEBUG] [LOCAL ] TY: Trimmed 11419 records to 7674 (keeping 200 days of data) [2025-10-17T22:04:24.864763] [DEBUG] [LOCAL ] TY: Primary data saved (7674 records). [2025-10-17T22:04:24.864877] [INFO ] [MAIN ] TY: Full history saved. [2025-10-17T22:04:24.864967] [INFO ] [MAIN ] Update Progress: 2158/2368 symbols completed. TY took 11.6s. Estimated remaining: 29m 37s. Rate: 7.1 symbols/min [2025-10-17T22:04:25.342305] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-17T22:04:26.288800] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T22:04:26.298798] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-17T22:04:26.456112] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T22:04:26.942351] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-17T22:04:27.932247] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T22:04:27.937511] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-17T22:04:28.064553] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-17T22:04:28.542325] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-17T22:04:28.973634] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T22:04:29.342341] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-17T22:04:30.177102] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-17T22:04:30.181896] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-17T22:04:30.281153] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T22:04:30.942326] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-17T22:04:31.221791] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T22:04:31.225922] [INFO ] [REMOTE ] TXO: Full fetch complete (27024 records). [2025-10-17T22:04:31.226032] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-17T22:04:31.582130] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-17T22:04:31.582205] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-17T22:04:31.582739] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-17T22:04:31.582800] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-17T22:04:31.583408] [DEBUG] [LOCAL ] TXO: Trimmed 27024 records to 20129 (keeping 200 days of data) [2025-10-17T22:04:31.704482] [DEBUG] [LOCAL ] TXO: Primary data saved (20129 records). [2025-10-17T22:04:31.704610] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-17T22:04:31.704712] [INFO ] [MAIN ] Update Progress: 2159/2368 symbols completed. TXO took 30.0s. Estimated remaining: 29m 28s. Rate: 7.1 symbols/min [2025-10-17T22:04:32.587279] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T22:04:32.598270] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-17T22:04:34.454051] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T22:04:34.464378] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-17T22:04:36.186779] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T22:04:36.196869] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-10-17T22:04:38.083688] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T22:04:38.095032] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-10-17T22:04:39.782121] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T22:04:39.792286] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-10-17T22:04:41.287420] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T22:04:41.297762] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-10. [2025-10-17T22:04:41.982413] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T22:04:41.989260] [INFO ] [REMOTE ] TXT: Full fetch complete (72378 records). [2025-10-17T22:04:41.989385] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-17T22:04:42.375198] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-17T22:04:42.375277] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-17T22:04:42.376416] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-17T22:04:42.376480] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-17T22:04:42.377899] [DEBUG] [LOCAL ] TXT: Trimmed 72378 records to 50302 (keeping 200 days of data) [2025-10-17T22:04:42.675370] [DEBUG] [LOCAL ] TXT: Primary data saved (50302 records). [2025-10-17T22:04:42.675497] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-17T22:04:42.675605] [INFO ] [MAIN ] Update Progress: 2160/2368 symbols completed. TXT took 30.9s. Estimated remaining: 29m 20s. Rate: 7.1 symbols/min [2025-10-17T22:04:43.293068] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:04:43.346698] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:04:43.408854] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:04:43.410130] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:04:43.434486] [DEBUG] [LOCAL ] TYG: Loaded 13989 existing records from primary storage. [2025-10-17T22:04:43.434889] [INFO ] [MAIN ] TYG: Loaded 13989 existing records. [2025-10-17T22:04:43.555160] [DEBUG] [LOCAL ] TYL: Loaded 22523 existing records from primary storage. [2025-10-17T22:04:43.574989] [INFO ] [MAIN ] TYL: Loaded 22523 existing records. [2025-10-17T22:04:43.723470] [DEBUG] [LOCAL ] UA: Loaded 50852 existing records from primary storage. [2025-10-17T22:04:43.810920] [INFO ] [MAIN ] UA: Loaded 50852 existing records. [2025-10-17T22:04:43.827769] [DEBUG] [LOCAL ] U: Loaded 54189 existing records from primary storage. [2025-10-17T22:04:43.798008] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:04:43.856106] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-17T22:04:43.895275] [INFO ] [MAIN ] U: Loaded 54189 existing records. [2025-10-17T22:04:43.895116] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-17T22:04:43.950458] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-17T22:04:43.957870] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-17T22:04:43.960866] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:04:44.055925] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-17T22:04:44.072107] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-17T22:04:44.123612] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-17T22:04:44.148737] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-17T22:04:44.368151] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:04:44.421676] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-17T22:04:44.453142] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-17T22:04:44.526839] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-17T22:04:44.582629] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-17T22:04:44.615738] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:04:44.707024] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-17T22:04:44.707194] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-17T22:04:44.770121] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-17T22:04:44.859821] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-17T22:04:45.260594] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:04:45.326181] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-10-17T22:04:45.352851] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:04:45.374616] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-10-17T22:04:45.744226] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:04:45.755584] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-10-17T22:04:45.833584] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:04:45.834041] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-10-17T22:04:46.703785] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-17T22:04:46.708756] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-17T22:04:47.076892] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T22:04:47.080181] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-17T22:04:47.434498] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T22:04:47.444835] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-17T22:04:47.663612] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T22:04:47.668284] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-17T22:04:48.140737] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T22:04:48.145825] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-17T22:04:48.279446] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-17T22:04:48.290365] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-17T22:04:48.761236] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T22:04:48.765688] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-17T22:04:48.968317] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T22:04:48.978010] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-17T22:04:49.112577] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T22:04:49.116323] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-17T22:04:49.811758] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-17T22:04:49.815982] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-17T22:04:49.937132] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-17T22:04:49.944919] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-17T22:04:50.402313] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-17T22:04:50.412990] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-17T22:04:50.647077] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-17T22:04:50.656546] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-17T22:04:50.714115] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T22:04:50.717966] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-17T22:04:51.219203] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T22:04:51.225174] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-17T22:04:51.637217] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-17T22:04:51.742306] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-17T22:04:52.347567] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T22:04:52.542260] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-17T22:04:52.608581] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-17T22:04:52.646704] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-17T22:04:52.664530] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-17T22:04:53.342264] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-17T22:04:53.663214] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-17T22:04:54.142321] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-17T22:04:54.942306] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-17T22:04:55.584341] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-17T22:04:55.742270] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-17T22:04:56.007766] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T22:04:56.468856] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T22:04:56.542253] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-17T22:04:57.342330] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-17T22:04:57.713715] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-17T22:04:58.142350] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-17T22:04:58.438791] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-17T22:04:58.942282] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-17T22:04:59.062516] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-17T22:04:59.263980] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T22:04:59.742318] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-17T22:05:00.542333] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-17T22:05:01.315837] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T22:05:01.347713] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-17T22:05:01.373318] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-17T22:05:01.729396] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-17T22:05:02.142363] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-17T22:05:02.204285] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-17T22:05:02.942265] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-17T22:05:03.247565] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-17T22:05:03.742291] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-17T22:05:04.308292] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-17T22:05:04.311911] [INFO ] [REMOTE ] TYL: Full fetch complete (31637 records). [2025-10-17T22:05:04.312055] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-17T22:05:04.542538] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-17T22:05:04.727013] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-17T22:05:04.725437] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-17T22:05:04.736467] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-17T22:05:04.737269] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-17T22:05:04.737346] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-17T22:05:04.738859] [DEBUG] [LOCAL ] TYL: Trimmed 31637 records to 22658 (keeping 200 days of data) [2025-10-17T22:05:04.871445] [DEBUG] [LOCAL ] TYL: Primary data saved (22658 records). [2025-10-17T22:05:04.871575] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-17T22:05:04.871672] [INFO ] [MAIN ] Update Progress: 2161/2368 symbols completed. TYL took 22.2s. Estimated remaining: 29m 13s. Rate: 7.1 symbols/min [2025-10-17T22:05:05.036087] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:05:05.083559] [DEBUG] [LOCAL ] UAA: Loaded 53890 existing records from primary storage. [2025-10-17T22:05:05.083945] [INFO ] [MAIN ] UAA: Loaded 53890 existing records. [2025-10-17T22:05:05.258747] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:05:05.259046] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-17T22:05:05.259093] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-17T22:05:05.259300] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-17T22:05:05.259355] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-17T22:05:05.347578] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-17T22:05:05.553465] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T22:05:05.576883] [INFO ] [REMOTE ] TYG: Full fetch complete (22290 records). [2025-10-17T22:05:05.582093] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-17T22:05:05.736461] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:05:06.004205] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-17T22:05:06.004289] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-17T22:05:06.004816] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-17T22:05:06.004879] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-17T22:05:06.005517] [DEBUG] [LOCAL ] TYG: Trimmed 22290 records to 14089 (keeping 200 days of data) [2025-10-17T22:05:06.090914] [DEBUG] [LOCAL ] TYG: Primary data saved (14089 records). [2025-10-17T22:05:06.091049] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-17T22:05:06.091129] [INFO ] [MAIN ] Update Progress: 2162/2368 symbols completed. TYG took 23.4s. Estimated remaining: 29m 4s. Rate: 7.1 symbols/min [2025-10-17T22:05:06.153340] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-10-17T22:05:06.267756] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:05:06.275974] [DEBUG] [LOCAL ] UAN: Loaded 5451 existing records from primary storage. [2025-10-17T22:05:06.276144] [INFO ] [MAIN ] UAN: Loaded 5451 existing records. [2025-10-17T22:05:06.447638] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:05:06.447929] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-17T22:05:06.447989] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-17T22:05:06.448600] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-17T22:05:06.448696] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-17T22:05:06.794416] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:05:06.942250] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-10-17T22:05:07.673142] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-17T22:05:07.742287] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-17T22:05:08.017912] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T22:05:08.542257] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-17T22:05:08.781166] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-17T22:05:09.288618] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T22:05:09.342276] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-17T22:05:10.034391] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-17T22:05:10.142258] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-17T22:05:10.333537] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-17T22:05:10.942307] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-17T22:05:11.742269] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-17T22:05:11.908347] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-17T22:05:12.429137] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T22:05:12.542339] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-17T22:05:13.342301] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-17T22:05:13.903541] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-17T22:05:13.963896] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-17T22:05:14.142292] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-17T22:05:14.345196] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-17T22:05:14.910596] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-17T22:05:14.942250] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-17T22:05:15.730391] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-17T22:05:15.742266] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-17T22:05:16.154511] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-17T22:05:16.542315] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-17T22:05:17.342302] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-17T22:05:18.142317] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-17T22:05:18.601749] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T22:05:18.789677] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-17T22:05:18.942271] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-17T22:05:19.277458] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T22:05:19.583878] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T22:05:19.742298] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-17T22:05:20.542347] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-17T22:05:21.136371] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-17T22:05:21.342323] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-17T22:05:22.103550] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-17T22:05:22.105331] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-17T22:05:22.106608] [INFO ] [REMOTE ] UAN: Full fetch complete (7960 records). [2025-10-17T22:05:22.117249] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-17T22:05:22.152566] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-17T22:05:22.488180] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-17T22:05:22.488264] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-17T22:05:22.488486] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-17T22:05:22.488534] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-17T22:05:22.489040] [DEBUG] [LOCAL ] UAN: Trimmed 7960 records to 5477 (keeping 200 days of data) [2025-10-17T22:05:22.523983] [DEBUG] [LOCAL ] UAN: Primary data saved (5477 records). [2025-10-17T22:05:22.524106] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-17T22:05:22.524192] [INFO ] [MAIN ] Update Progress: 2163/2368 symbols completed. UAN took 16.4s. Estimated remaining: 28m 56s. Rate: 7.1 symbols/min [2025-10-17T22:05:22.696386] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:05:22.745665] [DEBUG] [LOCAL ] UBER: Loaded 54196 existing records from primary storage. [2025-10-17T22:05:22.745977] [INFO ] [MAIN ] UBER: Loaded 54196 existing records. [2025-10-17T22:05:22.922624] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:05:22.922851] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-17T22:05:22.922904] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-17T22:05:22.923114] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-17T22:05:22.923171] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-17T22:05:22.952949] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-17T22:05:23.270874] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:05:23.742293] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-17T22:05:24.150280] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-17T22:05:24.542326] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-10-17T22:05:25.342295] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-17T22:05:25.396347] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-17T22:05:25.402252] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T22:05:25.414180] [INFO ] [REMOTE ] UA: Full fetch complete (73186 records). [2025-10-17T22:05:25.414065] [INFO ] [REMOTE ] U: Full fetch complete (77975 records). [2025-10-17T22:05:25.414440] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-17T22:05:25.414367] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-17T22:05:26.196573] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-17T22:05:26.200134] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-17T22:05:26.200258] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-17T22:05:26.200384] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-17T22:05:26.201177] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-17T22:05:26.201287] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-17T22:05:26.202692] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-17T22:05:26.202986] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-17T22:05:26.205164] [DEBUG] [LOCAL ] UA: Trimmed 73186 records to 51219 (keeping 200 days of data) [2025-10-17T22:05:26.205776] [DEBUG] [LOCAL ] U: Trimmed 77975 records to 54579 (keeping 200 days of data) [2025-10-17T22:05:26.803398] [DEBUG] [LOCAL ] UA: Primary data saved (51219 records). [2025-10-17T22:05:26.804385] [INFO ] [MAIN ] UA: Full history saved. [2025-10-17T22:05:26.804791] [INFO ] [MAIN ] Update Progress: 2164/2368 symbols completed. UA took 44.1s. Estimated remaining: 28m 47s. Rate: 7.1 symbols/min [2025-10-17T22:05:26.987835] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:05:26.994224] [DEBUG] [LOCAL ] U: Primary data saved (54579 records). [2025-10-17T22:05:26.994336] [INFO ] [MAIN ] U: Full history saved. [2025-10-17T22:05:26.994507] [INFO ] [MAIN ] Update Progress: 2165/2368 symbols completed. U took 44.3s. Estimated remaining: 28m 38s. Rate: 7.1 symbols/min [2025-10-17T22:05:27.176825] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:05:27.177210] [DEBUG] [LOCAL ] UCB: No existing data file found in primary storage. [2025-10-17T22:05:27.177306] [WARN ] [MAIN ] UCB: No existing data found, performing full refresh instead. [2025-10-17T22:05:27.177592] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-17T22:05:27.177825] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-17T22:05:27.178193] [DEBUG] [LOCAL ] UCB: No primary data file found to delete. [2025-10-17T22:05:27.178516] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-17T22:05:27.357121] [DEBUG] [LOCAL ] UBS: Loaded 52699 existing records from primary storage. [2025-10-17T22:05:27.374704] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.83 seconds). [2025-10-17T22:05:27.417305] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-17T22:05:27.393156] [INFO ] [MAIN ] UBS: Loaded 52699 existing records. [2025-10-17T22:05:27.741948] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-17T22:05:27.827894] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:05:27.828766] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-10-17T22:05:27.846899] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-17T22:05:27.883067] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:05:27.883502] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-17T22:05:27.883581] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-17T22:05:27.883908] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-17T22:05:27.884015] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-17T22:05:28.259236] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:05:28.542344] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-10-17T22:05:29.316366] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-17T22:05:29.342257] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-17T22:05:29.422250] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T22:05:29.564608] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-17T22:05:30.142338] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-17T22:05:30.372068] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-17T22:05:30.437994] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-17T22:05:30.942340] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-17T22:05:31.742254] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-17T22:05:32.109745] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-17T22:05:32.414060] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-17T22:05:32.542324] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-17T22:05:33.342296] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-17T22:05:33.502551] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T22:05:34.152446] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-17T22:05:34.178979] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-17T22:05:34.942326] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-17T22:05:35.229125] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T22:05:35.670380] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T22:05:35.742272] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-17T22:05:36.542296] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-17T22:05:37.266589] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-17T22:05:37.333127] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T22:05:37.342207] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-17T22:05:38.142408] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-17T22:05:38.705604] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-17T22:05:38.790259] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T22:05:38.942364] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-17T22:05:39.742251] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-17T22:05:40.090372] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-17T22:05:40.160910] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T22:05:40.542351] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-17T22:05:41.342310] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-17T22:05:42.142358] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-17T22:05:42.208026] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-17T22:05:42.536376] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-17T22:05:42.765754] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T22:05:42.942288] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-17T22:05:43.289125] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-17T22:05:43.742347] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-17T22:05:44.542286] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-17T22:05:44.636481] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T22:05:44.647670] [INFO ] [REMOTE ] UAA: Full fetch complete (77646 records). [2025-10-17T22:05:44.647884] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-17T22:05:45.047556] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-17T22:05:45.047690] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-17T22:05:45.049519] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-17T22:05:45.049599] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-17T22:05:45.051499] [DEBUG] [LOCAL ] UAA: Trimmed 77646 records to 54277 (keeping 200 days of data) [2025-10-17T22:05:45.343481] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-10-17T22:05:45.365452] [DEBUG] [LOCAL ] UAA: Primary data saved (54277 records). [2025-10-17T22:05:45.365599] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-17T22:05:45.366241] [INFO ] [MAIN ] Update Progress: 2166/2368 symbols completed. UAA took 40.5s. Estimated remaining: 28m 31s. Rate: 7.1 symbols/min [2025-10-17T22:05:45.535199] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:05:45.587478] [DEBUG] [LOCAL ] UDR: Loaded 52444 existing records from primary storage. [2025-10-17T22:05:45.587839] [INFO ] [MAIN ] UDR: Loaded 52444 existing records. [2025-10-17T22:05:45.768200] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:05:45.768439] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-17T22:05:45.768502] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-17T22:05:45.768788] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-17T22:05:45.768854] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-17T22:05:46.131333] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:05:46.142251] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-10-17T22:05:46.256526] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-17T22:05:46.451508] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-17T22:05:46.858365] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T22:05:46.942353] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-17T22:05:47.555784] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T22:05:47.742348] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-17T22:05:48.542307] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-10-17T22:05:48.649501] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T22:05:49.342299] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-17T22:05:49.966052] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T22:05:50.142269] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-10. [2025-10-17T22:05:50.223413] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-17T22:05:50.942361] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-17T22:05:51.104539] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-17T22:05:51.157587] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T22:05:51.163268] [INFO ] [REMOTE ] UCB: Full fetch complete (54913 records). [2025-10-17T22:05:51.163407] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-10-17T22:05:51.538178] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-10-17T22:05:51.538258] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-10-17T22:05:51.539291] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-10-17T22:05:51.539355] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-10-17T22:05:51.540450] [DEBUG] [LOCAL ] UCB: Trimmed 54913 records to 38433 (keeping 200 days of data) [2025-10-17T22:05:51.748437] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-17T22:05:51.785457] [DEBUG] [LOCAL ] UCB: Primary data saved (38433 records). [2025-10-17T22:05:51.785600] [INFO ] [MAIN ] UCB: Full history saved. [2025-10-17T22:05:51.785733] [INFO ] [MAIN ] Update Progress: 2167/2368 symbols completed. UCB took 24.8s. Estimated remaining: 28m 22s. Rate: 7.1 symbols/min [2025-10-17T22:05:51.958887] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:05:51.999894] [DEBUG] [LOCAL ] UE: Loaded 42905 existing records from primary storage. [2025-10-17T22:05:52.000275] [INFO ] [MAIN ] UE: Loaded 42905 existing records. [2025-10-17T22:05:52.180616] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:05:52.180894] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-17T22:05:52.180956] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-17T22:05:52.181140] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-17T22:05:52.181182] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-17T22:05:52.535115] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:05:52.542233] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-10-17T22:05:52.892480] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T22:05:53.342290] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-17T22:05:53.373390] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-17T22:05:53.766328] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T22:05:54.142297] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-17T22:05:54.942272] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-17T22:05:55.117559] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T22:05:55.742299] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-17T22:05:56.542271] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-17T22:05:56.671001] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T22:05:56.790618] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-17T22:05:57.215615] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-17T22:05:57.342320] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-17T22:05:58.017338] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-17T22:05:58.142282] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-17T22:05:58.942302] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-17T22:05:59.266819] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-17T22:05:59.274545] [INFO ] [REMOTE ] UBS: Full fetch complete (75965 records). [2025-10-17T22:05:59.274797] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-17T22:05:59.680470] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-17T22:05:59.680568] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-17T22:05:59.681944] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-17T22:05:59.682011] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-17T22:05:59.683549] [DEBUG] [LOCAL ] UBS: Trimmed 75965 records to 53087 (keeping 200 days of data) [2025-10-17T22:05:59.767337] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-17T22:06:00.003430] [DEBUG] [LOCAL ] UBS: Primary data saved (53087 records). [2025-10-17T22:06:00.003609] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-17T22:06:00.003788] [INFO ] [MAIN ] Update Progress: 2168/2368 symbols completed. UBS took 33.2s. Estimated remaining: 28m 13s. Rate: 7.1 symbols/min [2025-10-17T22:06:00.172867] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:06:00.182582] [DEBUG] [LOCAL ] UFI: Loaded 8215 existing records from primary storage. [2025-10-17T22:06:00.182814] [INFO ] [MAIN ] UFI: Loaded 8215 existing records. [2025-10-17T22:06:00.364057] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:06:00.364274] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-17T22:06:00.364322] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-17T22:06:00.364467] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-17T22:06:00.364525] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-17T22:06:00.718773] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:06:00.719200] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-10-17T22:06:00.776113] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-10-17T22:06:01.342282] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-17T22:06:02.298847] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-10-17T22:06:02.310319] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-17T22:06:02.348711] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (3.41 seconds). [2025-10-17T22:06:02.420668] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T22:06:02.571735] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T22:06:02.942277] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-17T22:06:03.052414] [DEBUG] [REMOTE ] UE: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-17T22:06:03.052634] [WARN ] [REMOTE ] UE: No data returned for month 2025-04 [2025-10-17T22:06:03.052750] [FATAL] [REMOTE ] UE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T22:06:03.052827] [FATAL] [MAIN ] UE: Failed to fetch primary data. [2025-10-17T22:06:03.052889] [WARN ] [MAIN ] UE: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T22:06:03.052960] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-17T22:06:03.053020] [DEBUG] [LOCAL ] UE: No primary data file found to delete. [2025-10-17T22:06:03.053055] [INFO ] [LOCAL ] UE: Starting deletion of derivative data. [2025-10-17T22:06:03.053219] [DEBUG] [LOCAL ] UE: Deleted derivative data file. [2025-10-17T22:06:03.053300] [INFO ] [MAIN ] Update Progress: 2169/2368 symbols completed. UE took 11.3s. Estimated remaining: 28m 4s. Rate: 7.1 symbols/min [2025-10-17T22:06:03.218276] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:06:03.289254] [DEBUG] [LOCAL ] UGI: Loaded 50994 existing records from primary storage. [2025-10-17T22:06:03.289558] [INFO ] [MAIN ] UGI: Loaded 50994 existing records. [2025-10-17T22:06:03.461202] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:06:03.461429] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-17T22:06:03.461476] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-17T22:06:03.461758] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-17T22:06:03.461814] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-17T22:06:03.745281] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-17T22:06:03.821448] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:06:03.856542] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T22:06:04.542342] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-10-17T22:06:05.342381] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-17T22:06:06.048519] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-17T22:06:06.142297] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-17T22:06:06.235708] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T22:06:06.361549] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-17T22:06:06.942357] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-17T22:06:07.742284] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-17T22:06:07.809913] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T22:06:08.327444] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T22:06:08.542339] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-17T22:06:08.809014] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T22:06:09.342294] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-17T22:06:09.797739] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-17T22:06:10.142301] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-17T22:06:10.824857] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T22:06:10.832477] [INFO ] [REMOTE ] UBER: Full fetch complete (77986 records). [2025-10-17T22:06:10.832615] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-17T22:06:10.942922] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-17T22:06:11.238430] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-17T22:06:11.267204] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-17T22:06:11.267603] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-17T22:06:11.268929] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-17T22:06:11.268997] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-17T22:06:11.270465] [DEBUG] [LOCAL ] UBER: Trimmed 77986 records to 54586 (keeping 200 days of data) [2025-10-17T22:06:11.610056] [DEBUG] [LOCAL ] UBER: Primary data saved (54586 records). [2025-10-17T22:06:11.610263] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-17T22:06:11.610377] [INFO ] [MAIN ] Update Progress: 2170/2368 symbols completed. UBER took 49.1s. Estimated remaining: 27m 56s. Rate: 7.1 symbols/min [2025-10-17T22:06:11.750707] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-17T22:06:11.784520] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:06:11.826825] [DEBUG] [LOCAL ] UGP: Loaded 43205 existing records from primary storage. [2025-10-17T22:06:11.827183] [INFO ] [MAIN ] UGP: Loaded 43205 existing records. [2025-10-17T22:06:12.028030] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:06:12.036173] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-17T22:06:12.036066] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-17T22:06:12.036366] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-17T22:06:12.039899] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-17T22:06:12.039959] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-17T22:06:12.397143] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:06:12.542317] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-10-17T22:06:13.342302] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-17T22:06:14.142284] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-17T22:06:14.256234] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-17T22:06:14.456251] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T22:06:14.571700] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-10-17T22:06:14.942286] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-17T22:06:15.742326] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-17T22:06:15.850322] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T22:06:16.158164] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T22:06:16.228733] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-17T22:06:16.542300] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-17T22:06:17.342296] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-17T22:06:18.142354] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-17T22:06:18.447019] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T22:06:18.763790] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T22:06:18.824621] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T22:06:18.832054] [INFO ] [REMOTE ] UDR: Full fetch complete (75088 records). [2025-10-17T22:06:18.832213] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-17T22:06:18.943662] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-17T22:06:19.243419] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-17T22:06:19.243511] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-17T22:06:19.244742] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-17T22:06:19.244814] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-17T22:06:19.246339] [DEBUG] [LOCAL ] UDR: Trimmed 75088 records to 52826 (keeping 200 days of data) [2025-10-17T22:06:19.577188] [DEBUG] [LOCAL ] UDR: Primary data saved (52826 records). [2025-10-17T22:06:19.577333] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-17T22:06:19.577926] [INFO ] [MAIN ] Update Progress: 2171/2368 symbols completed. UDR took 34.2s. Estimated remaining: 27m 47s. Rate: 7.1 symbols/min [2025-10-17T22:06:19.747438] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-17T22:06:19.781133] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:06:19.800736] [DEBUG] [LOCAL ] UHAL: Loaded 16985 existing records from primary storage. [2025-10-17T22:06:19.801017] [INFO ] [MAIN ] UHAL: Loaded 16985 existing records. [2025-10-17T22:06:19.974774] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:06:19.975011] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-17T22:06:19.975060] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-17T22:06:19.975219] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-17T22:06:19.975257] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-17T22:06:20.322426] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:06:20.329554] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-17T22:06:20.542256] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-10-17T22:06:20.665871] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-17T22:06:21.246267] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-17T22:06:21.342249] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-17T22:06:21.961568] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T22:06:22.142337] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-17T22:06:22.942332] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-17T22:06:23.041354] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-17T22:06:23.578579] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-17T22:06:23.742343] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-17T22:06:24.383408] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-17T22:06:24.542314] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-17T22:06:25.269678] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-17T22:06:25.342287] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-17T22:06:26.132366] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T22:06:26.142253] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-10. [2025-10-17T22:06:26.618773] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-17T22:06:26.620681] [INFO ] [REMOTE ] UFI: Full fetch complete (12355 records). [2025-10-17T22:06:26.620778] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-17T22:06:26.947426] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-17T22:06:26.979783] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-17T22:06:26.979911] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-17T22:06:26.980247] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-17T22:06:26.980289] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-17T22:06:26.980774] [DEBUG] [LOCAL ] UFI: Trimmed 12355 records to 8274 (keeping 200 days of data) [2025-10-17T22:06:27.029390] [DEBUG] [LOCAL ] UFI: Primary data saved (8274 records). [2025-10-17T22:06:27.029497] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-17T22:06:27.029580] [INFO ] [MAIN ] Update Progress: 2172/2368 symbols completed. UFI took 27.0s. Estimated remaining: 27m 39s. Rate: 7.1 symbols/min [2025-10-17T22:06:27.197569] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:06:27.236775] [DEBUG] [LOCAL ] UHS: Loaded 40374 existing records from primary storage. [2025-10-17T22:06:27.237101] [INFO ] [MAIN ] UHS: Loaded 40374 existing records. [2025-10-17T22:06:27.410468] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:06:27.410699] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-17T22:06:27.410758] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-17T22:06:27.410935] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-17T22:06:27.410973] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-17T22:06:27.752283] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-17T22:06:27.757182] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:06:28.542316] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-10-17T22:06:28.719730] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-17T22:06:29.342340] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-17T22:06:29.458193] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T22:06:30.109415] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-17T22:06:30.142260] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-17T22:06:30.942270] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-17T22:06:31.145996] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T22:06:31.223293] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-17T22:06:31.742336] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-17T22:06:32.542263] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-17T22:06:32.701076] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T22:06:33.017448] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-17T22:06:33.342308] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-17T22:06:34.142274] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-17T22:06:34.361992] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T22:06:34.460798] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T22:06:34.942292] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-17T22:06:35.672028] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T22:06:35.742338] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-17T22:06:36.542315] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-17T22:06:36.646347] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T22:06:37.216202] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-17T22:06:37.342274] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-17T22:06:38.048900] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T22:06:38.142276] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-17T22:06:38.942284] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-17T22:06:38.985421] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T22:06:39.747428] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-17T22:06:39.760846] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T22:06:39.902110] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-17T22:06:40.542291] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-17T22:06:41.289596] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-17T22:06:41.296521] [INFO ] [REMOTE ] UGI: Full fetch complete (73494 records). [2025-10-17T22:06:41.296680] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-17T22:06:41.350847] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-17T22:06:41.684251] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-17T22:06:41.684331] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-17T22:06:41.685500] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-17T22:06:41.685563] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-17T22:06:41.687063] [DEBUG] [LOCAL ] UGI: Trimmed 73494 records to 51333 (keeping 200 days of data) [2025-10-17T22:06:42.020440] [DEBUG] [LOCAL ] UGI: Primary data saved (51333 records). [2025-10-17T22:06:42.020713] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-17T22:06:42.020818] [INFO ] [MAIN ] Update Progress: 2173/2368 symbols completed. UGI took 39.0s. Estimated remaining: 27m 31s. Rate: 7.1 symbols/min [2025-10-17T22:06:42.147390] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-17T22:06:42.243094] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:06:42.275856] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T22:06:42.295774] [DEBUG] [LOCAL ] UHT: Loaded 10250 existing records from primary storage. [2025-10-17T22:06:42.296029] [INFO ] [MAIN ] UHT: Loaded 10250 existing records. [2025-10-17T22:06:42.421235] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T22:06:42.496357] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:06:42.496623] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-17T22:06:42.496713] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-17T22:06:42.496889] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-17T22:06:42.496930] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-17T22:06:42.863914] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:06:42.942300] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-17T22:06:43.742281] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-17T22:06:43.790006] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T22:06:44.526630] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T22:06:44.542253] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-17T22:06:44.844673] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T22:06:45.342348] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-17T22:06:46.127142] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T22:06:46.142249] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-17T22:06:46.290228] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T22:06:46.942293] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-17T22:06:47.470778] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T22:06:47.477039] [INFO ] [REMOTE ] UGP: Full fetch complete (62171 records). [2025-10-17T22:06:47.477154] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-17T22:06:47.747491] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-10-17T22:06:47.864361] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-17T22:06:47.864439] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-17T22:06:47.865661] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-17T22:06:47.865726] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-17T22:06:47.866908] [DEBUG] [LOCAL ] UGP: Trimmed 62171 records to 43519 (keeping 200 days of data) [2025-10-17T22:06:48.108544] [DEBUG] [LOCAL ] UGP: Primary data saved (43519 records). [2025-10-17T22:06:48.108690] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-17T22:06:48.108782] [INFO ] [MAIN ] Update Progress: 2174/2368 symbols completed. UGP took 36.5s. Estimated remaining: 27m 22s. Rate: 7.1 symbols/min [2025-10-17T22:06:48.286983] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:06:48.302686] [DEBUG] [LOCAL ] UI: Loaded 14120 existing records from primary storage. [2025-10-17T22:06:48.302906] [INFO ] [MAIN ] UI: Loaded 14120 existing records. [2025-10-17T22:06:48.494188] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:06:48.494582] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-17T22:06:48.494777] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-17T22:06:48.495266] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-17T22:06:48.495511] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-17T22:06:48.558130] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-17T22:06:48.658928] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-17T22:06:48.682511] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T22:06:48.902524] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:06:49.342304] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-17T22:06:49.713297] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-17T22:06:50.142373] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-17T22:06:50.168969] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T22:06:50.942322] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-10-17T22:06:51.067706] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T22:06:51.070663] [INFO ] [REMOTE ] UHAL: Full fetch complete (23380 records). [2025-10-17T22:06:51.070740] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-17T22:06:51.449710] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-17T22:06:51.449794] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-17T22:06:51.450268] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-17T22:06:51.450307] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-17T22:06:51.451143] [DEBUG] [LOCAL ] UHAL: Trimmed 23380 records to 17102 (keeping 200 days of data) [2025-10-17T22:06:51.549748] [DEBUG] [LOCAL ] UHAL: Primary data saved (17102 records). [2025-10-17T22:06:51.549996] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-17T22:06:51.550247] [INFO ] [MAIN ] Update Progress: 2175/2368 symbols completed. UHAL took 32.0s. Estimated remaining: 27m 13s. Rate: 7.1 symbols/min [2025-10-17T22:06:51.637462] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-17T22:06:51.735221] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:06:51.742294] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-17T22:06:51.770078] [DEBUG] [LOCAL ] UIS: Loaded 37124 existing records from primary storage. [2025-10-17T22:06:51.770344] [INFO ] [MAIN ] UIS: Loaded 37124 existing records. [2025-10-17T22:06:51.948298] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:06:51.948492] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-17T22:06:51.948557] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-17T22:06:51.948764] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-17T22:06:51.948821] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-17T22:06:52.294298] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:06:52.542255] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-10-17T22:06:52.720033] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-17T22:06:53.342343] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-17T22:06:53.902671] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T22:06:54.142344] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-17T22:06:54.677685] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T22:06:54.941049] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T22:06:54.943133] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-17T22:06:55.742295] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-17T22:06:55.941779] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T22:06:56.542288] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-17T22:06:56.555986] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-17T22:06:57.342318] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-17T22:06:57.806331] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-17T22:06:57.995458] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-17T22:06:58.142366] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-17T22:06:58.942318] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-17T22:06:59.431258] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T22:06:59.602137] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-17T22:06:59.742292] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-17T22:07:00.413480] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-17T22:07:00.542286] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-17T22:07:01.342311] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-17T22:07:02.122070] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-17T22:07:02.142254] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-17T22:07:02.802167] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-17T22:07:02.895544] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-17T22:07:02.942251] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-17T22:07:03.533510] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T22:07:03.538489] [INFO ] [REMOTE ] UHS: Full fetch complete (58301 records). [2025-10-17T22:07:03.538580] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-17T22:07:03.751719] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-17T22:07:03.931228] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-17T22:07:03.931307] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-17T22:07:03.932362] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-17T22:07:03.932425] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-17T22:07:03.933556] [DEBUG] [LOCAL ] UHS: Trimmed 58301 records to 40593 (keeping 200 days of data) [2025-10-17T22:07:04.180817] [DEBUG] [LOCAL ] UHS: Primary data saved (40593 records). [2025-10-17T22:07:04.180938] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-17T22:07:04.181015] [INFO ] [MAIN ] Update Progress: 2176/2368 symbols completed. UHS took 37.2s. Estimated remaining: 27m 5s. Rate: 7.1 symbols/min [2025-10-17T22:07:04.356197] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:07:04.404686] [DEBUG] [LOCAL ] UL: Loaded 53468 existing records from primary storage. [2025-10-17T22:07:04.405005] [INFO ] [MAIN ] UL: Loaded 53468 existing records. [2025-10-17T22:07:04.550772] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-17T22:07:04.583402] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:07:04.583705] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-17T22:07:04.583765] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-17T22:07:04.584035] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-17T22:07:04.584092] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-17T22:07:04.771036] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-17T22:07:04.952086] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:07:05.300486] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-17T22:07:05.342279] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-10-17T22:07:06.142981] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-17T22:07:06.143879] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-17T22:07:06.942267] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-17T22:07:07.742276] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-10-17T22:07:07.771443] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-17T22:07:07.820341] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-17T22:07:08.542285] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-17T22:07:09.342275] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-10-17T22:07:09.546341] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T22:07:09.833505] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-17T22:07:10.142295] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-17T22:07:10.171233] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-17T22:07:10.942297] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-17T22:07:11.742315] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-17T22:07:11.965493] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-17T22:07:12.335573] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T22:07:12.542279] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-17T22:07:12.817442] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T22:07:13.342337] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-17T22:07:14.142304] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-10-17T22:07:14.433259] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T22:07:14.707745] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-17T22:07:14.942358] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-17T22:07:14.953798] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-17T22:07:15.742320] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-17T22:07:16.093556] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-17T22:07:16.542293] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-17T22:07:17.342268] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-10-17T22:07:17.397986] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T22:07:17.565334] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T22:07:17.568956] [INFO ] [REMOTE ] UI: Full fetch complete (19575 records). [2025-10-17T22:07:17.569087] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-17T22:07:17.945348] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-17T22:07:17.945518] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-17T22:07:17.946438] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-17T22:07:17.946534] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-17T22:07:17.947926] [DEBUG] [LOCAL ] UI: Trimmed 19575 records to 14297 (keeping 200 days of data) [2025-10-17T22:07:18.045832] [DEBUG] [LOCAL ] UI: Primary data saved (14297 records). [2025-10-17T22:07:18.046051] [INFO ] [MAIN ] UI: Full history saved. [2025-10-17T22:07:18.046161] [INFO ] [MAIN ] Update Progress: 2177/2368 symbols completed. UI took 29.9s. Estimated remaining: 26m 57s. Rate: 7.1 symbols/min [2025-10-17T22:07:18.147535] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-17T22:07:18.233580] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:07:18.275320] [DEBUG] [LOCAL ] ULS: Loaded 39279 existing records from primary storage. [2025-10-17T22:07:18.275756] [INFO ] [MAIN ] ULS: Loaded 39279 existing records. [2025-10-17T22:07:18.470354] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:07:18.471665] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-17T22:07:18.471736] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-17T22:07:18.472546] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-17T22:07:18.472608] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-17T22:07:18.850752] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:07:18.942274] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-10-17T22:07:19.231510] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T22:07:19.298349] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-17T22:07:19.737551] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T22:07:19.742238] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-10-17T22:07:20.510100] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T22:07:20.542245] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-10. [2025-10-17T22:07:21.057578] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-17T22:07:21.059850] [INFO ] [REMOTE ] UHT: Full fetch complete (15094 records). [2025-10-17T22:07:21.059921] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-17T22:07:21.347493] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-10-17T22:07:21.423249] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-17T22:07:21.423335] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-17T22:07:21.423725] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-17T22:07:21.423807] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-17T22:07:21.424301] [DEBUG] [LOCAL ] UHT: Trimmed 15094 records to 10371 (keeping 200 days of data) [2025-10-17T22:07:21.486897] [DEBUG] [LOCAL ] UHT: Primary data saved (10371 records). [2025-10-17T22:07:21.487038] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-17T22:07:21.487122] [INFO ] [MAIN ] Update Progress: 2178/2368 symbols completed. UHT took 39.5s. Estimated remaining: 26m 48s. Rate: 7.1 symbols/min [2025-10-17T22:07:21.654921] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:07:21.702732] [DEBUG] [LOCAL ] UMC: Loaded 53073 existing records from primary storage. [2025-10-17T22:07:21.703044] [INFO ] [MAIN ] UMC: Loaded 53073 existing records. [2025-10-17T22:07:21.876311] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:07:21.876522] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-17T22:07:21.876568] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-17T22:07:21.876920] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-17T22:07:21.876977] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-17T22:07:22.150268] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-17T22:07:22.232947] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:07:22.907995] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-17T22:07:22.942253] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-17T22:07:23.430991] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-17T22:07:23.436305] [INFO ] [REMOTE ] UIS: Full fetch complete (52023 records). [2025-10-17T22:07:23.436432] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-17T22:07:23.747440] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-10-17T22:07:23.849400] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-17T22:07:23.849510] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-17T22:07:23.850569] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-17T22:07:23.850638] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-17T22:07:23.852064] [DEBUG] [LOCAL ] UIS: Trimmed 52023 records to 37313 (keeping 200 days of data) [2025-10-17T22:07:24.063218] [DEBUG] [LOCAL ] UIS: Primary data saved (37313 records). [2025-10-17T22:07:24.063430] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-17T22:07:24.064072] [INFO ] [MAIN ] Update Progress: 2179/2368 symbols completed. UIS took 32.5s. Estimated remaining: 26m 39s. Rate: 7.1 symbols/min [2025-10-17T22:07:24.251883] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:07:24.257006] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-17T22:07:24.297184] [DEBUG] [LOCAL ] UMH: Loaded 34443 existing records from primary storage. [2025-10-17T22:07:24.297456] [INFO ] [MAIN ] UMH: Loaded 34443 existing records. [2025-10-17T22:07:24.476078] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:07:24.476276] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-17T22:07:24.476324] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-17T22:07:24.476535] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-17T22:07:24.476607] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-17T22:07:24.549560] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-10-17T22:07:24.824454] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:07:25.342279] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-17T22:07:25.874401] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-17T22:07:26.142253] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-10-17T22:07:26.328221] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-17T22:07:26.567593] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-17T22:07:26.942271] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-17T22:07:27.571851] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-17T22:07:27.742291] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-10-17T22:07:28.542274] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-17T22:07:28.846494] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-17T22:07:29.342289] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-10-17T22:07:29.574442] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T22:07:29.700792] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-17T22:07:30.142321] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-10-17T22:07:30.682926] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-17T22:07:30.942303] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-17T22:07:31.742351] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-17T22:07:32.107413] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-17T22:07:32.238256] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T22:07:32.542312] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-10-17T22:07:32.991678] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-17T22:07:33.342291] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-17T22:07:34.142298] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-17T22:07:34.195016] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-17T22:07:34.508260] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T22:07:34.942336] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-17T22:07:35.254444] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T22:07:35.742317] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-17T22:07:36.542319] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-10-17T22:07:36.752518] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-17T22:07:37.201096] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T22:07:37.342261] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-17T22:07:38.142252] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-17T22:07:38.340391] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T22:07:38.422735] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T22:07:38.942308] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-17T22:07:39.201402] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-17T22:07:39.742312] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-17T22:07:40.428985] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T22:07:40.542265] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-17T22:07:41.267762] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T22:07:41.342317] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-10. [2025-10-17T22:07:42.142272] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-17T22:07:42.411894] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T22:07:42.874591] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T22:07:42.882180] [INFO ] [REMOTE ] UL: Full fetch complete (77088 records). [2025-10-17T22:07:42.882397] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-17T22:07:42.949196] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-17T22:07:43.298252] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-17T22:07:43.298358] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-17T22:07:43.299867] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-17T22:07:43.300026] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-17T22:07:43.321519] [DEBUG] [LOCAL ] UL: Trimmed 77088 records to 53858 (keeping 200 days of data) [2025-10-17T22:07:43.322526] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-17T22:07:43.654538] [DEBUG] [LOCAL ] UL: Primary data saved (53858 records). [2025-10-17T22:07:43.654707] [INFO ] [MAIN ] UL: Full history saved. [2025-10-17T22:07:43.654813] [INFO ] [MAIN ] Update Progress: 2180/2368 symbols completed. UL took 39.5s. Estimated remaining: 26m 32s. Rate: 7.1 symbols/min [2025-10-17T22:07:43.749985] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-17T22:07:43.823359] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:07:43.838575] [DEBUG] [LOCAL ] UNF: Loaded 11978 existing records from primary storage. [2025-10-17T22:07:43.838846] [INFO ] [MAIN ] UNF: Loaded 11978 existing records. [2025-10-17T22:07:44.017094] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:07:44.017341] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-17T22:07:44.017408] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-17T22:07:44.017587] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-17T22:07:44.017638] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-17T22:07:44.364090] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:07:44.542282] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-10-17T22:07:44.837287] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-17T22:07:45.253860] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T22:07:45.345489] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-17T22:07:45.348815] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-17T22:07:46.142287] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-17T22:07:46.419196] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-17T22:07:46.942319] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-17T22:07:47.194264] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-17T22:07:47.742347] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-17T22:07:48.001358] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-17T22:07:48.006320] [INFO ] [REMOTE ] ULS: Full fetch complete (54086 records). [2025-10-17T22:07:48.006418] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-17T22:07:48.423126] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-17T22:07:48.423248] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-17T22:07:48.424298] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-17T22:07:48.424361] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-17T22:07:48.425461] [DEBUG] [LOCAL ] ULS: Trimmed 54086 records to 39538 (keeping 200 days of data) [2025-10-17T22:07:48.544141] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-17T22:07:48.669312] [DEBUG] [LOCAL ] ULS: Primary data saved (39538 records). [2025-10-17T22:07:48.669447] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-17T22:07:48.669545] [INFO ] [MAIN ] Update Progress: 2181/2368 symbols completed. ULS took 30.6s. Estimated remaining: 26m 23s. Rate: 7.1 symbols/min [2025-10-17T22:07:48.839764] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:07:48.877335] [DEBUG] [LOCAL ] UNFI: Loaded 42911 existing records from primary storage. [2025-10-17T22:07:48.877688] [INFO ] [MAIN ] UNFI: Loaded 42911 existing records. [2025-10-17T22:07:49.050785] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:07:49.050998] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-17T22:07:49.051057] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-17T22:07:49.051227] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-17T22:07:49.051265] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-17T22:07:49.347527] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-17T22:07:49.408627] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:07:49.416272] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-17T22:07:49.531991] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-17T22:07:50.142298] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-10-17T22:07:50.337483] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-17T22:07:50.942364] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-17T22:07:51.645778] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T22:07:51.742281] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-17T22:07:52.542323] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-17T22:07:52.814455] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-17T22:07:53.065827] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-17T22:07:53.342260] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-17T22:07:53.430744] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-17T22:07:54.142339] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-17T22:07:54.942269] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-17T22:07:55.104998] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T22:07:55.637353] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-17T22:07:55.742272] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-17T22:07:56.318411] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-17T22:07:56.542289] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-17T22:07:57.342257] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-17T22:07:57.876568] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-17T22:07:58.036491] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T22:07:58.142285] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-17T22:07:58.905368] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T22:07:58.942252] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-17T22:07:59.501067] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T22:07:59.506522] [INFO ] [REMOTE ] UMH: Full fetch complete (47254 records). [2025-10-17T22:07:59.506614] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-17T22:07:59.755473] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-17T22:07:59.884627] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-17T22:07:59.884747] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-17T22:07:59.885741] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-17T22:07:59.885867] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-17T22:07:59.887067] [DEBUG] [LOCAL ] UMH: Trimmed 47254 records to 34724 (keeping 200 days of data) [2025-10-17T22:08:00.095348] [DEBUG] [LOCAL ] UMH: Primary data saved (34724 records). [2025-10-17T22:08:00.095474] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-17T22:08:00.096026] [INFO ] [MAIN ] Update Progress: 2182/2368 symbols completed. UMH took 36.0s. Estimated remaining: 26m 15s. Rate: 7.1 symbols/min [2025-10-17T22:08:00.267861] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:08:00.324024] [DEBUG] [LOCAL ] UNH: Loaded 54208 existing records from primary storage. [2025-10-17T22:08:00.324483] [INFO ] [MAIN ] UNH: Loaded 54208 existing records. [2025-10-17T22:08:00.502263] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:08:00.502566] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-17T22:08:00.502685] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-17T22:08:00.503002] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-17T22:08:00.503120] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-17T22:08:00.545276] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-17T22:08:00.659228] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T22:08:00.899677] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:08:01.007766] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-17T22:08:01.342317] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-17T22:08:02.142277] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-17T22:08:02.535868] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-17T22:08:02.543941] [INFO ] [REMOTE ] UMC: Full fetch complete (76675 records). [2025-10-17T22:08:02.544085] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-17T22:08:02.702235] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-17T22:08:02.959629] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-10-17T22:08:02.959908] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-17T22:08:02.960054] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-17T22:08:02.962234] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-17T22:08:02.962564] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-17T22:08:02.988504] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T22:08:02.992002] [DEBUG] [LOCAL ] UMC: Trimmed 76675 records to 53463 (keeping 200 days of data) [2025-10-17T22:08:03.319913] [DEBUG] [LOCAL ] UMC: Primary data saved (53463 records). [2025-10-17T22:08:03.320065] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-17T22:08:03.320171] [INFO ] [MAIN ] Update Progress: 2183/2368 symbols completed. UMC took 41.8s. Estimated remaining: 26m 6s. Rate: 7.1 symbols/min [2025-10-17T22:08:03.497823] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:08:03.541842] [DEBUG] [LOCAL ] UNM: Loaded 48472 existing records from primary storage. [2025-10-17T22:08:03.542194] [INFO ] [MAIN ] UNM: Loaded 48472 existing records. [2025-10-17T22:08:03.722460] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:08:03.722693] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-17T22:08:03.722753] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-17T22:08:03.722962] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-17T22:08:03.723020] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-17T22:08:03.753967] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-17T22:08:04.088203] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:08:04.542292] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-10-17T22:08:05.332856] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T22:08:05.342253] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-10-17T22:08:05.501724] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-10-17T22:08:06.142348] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-17T22:08:06.176862] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T22:08:06.274372] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T22:08:06.942316] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-10-17T22:08:07.742299] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-17T22:08:07.988485] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T22:08:08.007093] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T22:08:08.542301] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-10-17T22:08:09.314682] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-17T22:08:09.342266] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-10-17T22:08:09.923734] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-17T22:08:10.142268] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-17T22:08:10.151160] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T22:08:10.942281] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-10. [2025-10-17T22:08:11.742345] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-17T22:08:11.780412] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T22:08:12.025411] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T22:08:12.027853] [INFO ] [REMOTE ] UNF: Full fetch complete (17709 records). [2025-10-17T22:08:12.027929] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-17T22:08:12.397937] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-17T22:08:12.398010] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-17T22:08:12.398376] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-17T22:08:12.398415] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-17T22:08:12.399021] [DEBUG] [LOCAL ] UNF: Trimmed 17709 records to 12140 (keeping 200 days of data) [2025-10-17T22:08:12.473419] [DEBUG] [LOCAL ] UNF: Primary data saved (12140 records). [2025-10-17T22:08:12.473546] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-17T22:08:12.473623] [INFO ] [MAIN ] Update Progress: 2184/2368 symbols completed. UNF took 28.8s. Estimated remaining: 25m 58s. Rate: 7.1 symbols/min [2025-10-17T22:08:12.547567] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-17T22:08:12.642569] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:08:12.648396] [DEBUG] [LOCAL ] UNMA: Loaded 3537 existing records from primary storage. [2025-10-17T22:08:12.648599] [INFO ] [MAIN ] UNMA: Loaded 3537 existing records. [2025-10-17T22:08:12.824797] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:08:12.825030] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-17T22:08:12.825087] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-17T22:08:12.825239] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-17T22:08:12.825301] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-17T22:08:13.170212] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:08:13.342283] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-10-17T22:08:13.926478] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-17T22:08:13.959302] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-17T22:08:14.020134] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T22:08:14.142252] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-17T22:08:14.942280] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-17T22:08:15.742260] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-17T22:08:15.780321] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-17T22:08:16.542291] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-17T22:08:17.033101] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-17T22:08:17.237635] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-17T22:08:17.342271] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-17T22:08:17.462100] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T22:08:17.908812] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-17T22:08:18.142303] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-17T22:08:18.754312] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-17T22:08:18.942276] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-17T22:08:19.742374] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-17T22:08:20.542358] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-17T22:08:21.342356] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-17T22:08:21.475933] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-10-17T22:08:21.521697] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T22:08:21.899185] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-17T22:08:22.145739] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-17T22:08:22.148186] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T22:08:22.942338] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-17T22:08:23.742325] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-17T22:08:24.327766] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-17T22:08:24.547442] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-17T22:08:24.564300] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T22:08:24.616015] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-17T22:08:25.342351] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-17T22:08:25.747529] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-17T22:08:26.142300] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-17T22:08:26.942328] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-17T22:08:27.054527] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T22:08:27.062547] [INFO ] [REMOTE ] UNFI: Full fetch complete (59791 records). [2025-10-17T22:08:27.062895] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-17T22:08:27.446629] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-17T22:08:27.446761] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-17T22:08:27.448117] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-17T22:08:27.448181] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-17T22:08:27.449599] [DEBUG] [LOCAL ] UNFI: Trimmed 59791 records to 43232 (keeping 200 days of data) [2025-10-17T22:08:27.702339] [DEBUG] [LOCAL ] UNFI: Primary data saved (43232 records). [2025-10-17T22:08:27.702478] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-17T22:08:27.702576] [INFO ] [MAIN ] Update Progress: 2185/2368 symbols completed. UNFI took 39.0s. Estimated remaining: 25m 50s. Rate: 7.1 symbols/min [2025-10-17T22:08:27.765827] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-17T22:08:27.872518] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:08:27.921414] [DEBUG] [LOCAL ] UNP: Loaded 53718 existing records from primary storage. [2025-10-17T22:08:27.921747] [INFO ] [MAIN ] UNP: Loaded 53718 existing records. [2025-10-17T22:08:28.097919] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:08:28.098153] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-17T22:08:28.098200] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-17T22:08:28.098406] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-17T22:08:28.098461] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-17T22:08:28.467618] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:08:28.473097] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-17T22:08:28.513227] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-17T22:08:28.548312] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-17T22:08:28.554191] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-17T22:08:29.233491] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-17T22:08:29.342377] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-10-17T22:08:30.142355] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-17T22:08:30.942294] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-17T22:08:31.254849] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T22:08:31.742352] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-17T22:08:32.542309] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-17T22:08:32.698103] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-17T22:08:32.835176] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-17T22:08:33.130974] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-17T22:08:33.342369] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-17T22:08:33.623410] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-17T22:08:34.142271] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-17T22:08:34.704634] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-17T22:08:34.942305] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-17T22:08:35.311344] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-17T22:08:35.312365] [INFO ] [REMOTE ] UNMA: Full fetch complete (5558 records). [2025-10-17T22:08:35.312432] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-17T22:08:35.690754] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-17T22:08:35.690852] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-17T22:08:35.691028] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-17T22:08:35.691069] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-17T22:08:35.691452] [DEBUG] [LOCAL ] UNMA: Trimmed 5558 records to 3559 (keeping 200 days of data) [2025-10-17T22:08:35.712755] [DEBUG] [LOCAL ] UNMA: Primary data saved (3559 records). [2025-10-17T22:08:35.712882] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-17T22:08:35.712963] [INFO ] [MAIN ] Update Progress: 2186/2368 symbols completed. UNMA took 23.2s. Estimated remaining: 25m 41s. Rate: 7.1 symbols/min [2025-10-17T22:08:35.752700] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-17T22:08:35.881912] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:08:35.923751] [DEBUG] [LOCAL ] UP: Loaded 44555 existing records from primary storage. [2025-10-17T22:08:35.924052] [INFO ] [MAIN ] UP: Loaded 44555 existing records. [2025-10-17T22:08:36.102114] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:08:36.102468] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-17T22:08:36.102596] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-17T22:08:36.102901] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-17T22:08:36.102967] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-17T22:08:36.430002] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (3.09 seconds). [2025-10-17T22:08:36.508862] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:08:36.542244] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-10-17T22:08:37.342330] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-17T22:08:37.560781] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T22:08:38.142355] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-17T22:08:38.225691] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T22:08:38.942289] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-17T22:08:39.742340] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-17T22:08:39.910232] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-17T22:08:40.025115] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-10-17T22:08:40.494375] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-17T22:08:40.542299] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-17T22:08:41.174099] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-17T22:08:41.342320] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-17T22:08:41.957956] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-17T22:08:42.142290] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-17T22:08:42.911350] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T22:08:42.917925] [INFO ] [REMOTE ] UNM: Full fetch complete (70033 records). [2025-10-17T22:08:42.918071] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-17T22:08:42.949109] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-17T22:08:43.321289] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-17T22:08:43.321447] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-17T22:08:43.322711] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-17T22:08:43.322773] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-17T22:08:43.324316] [DEBUG] [LOCAL ] UNM: Trimmed 70033 records to 48817 (keeping 200 days of data) [2025-10-17T22:08:43.628740] [DEBUG] [LOCAL ] UNM: Primary data saved (48817 records). [2025-10-17T22:08:43.629060] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-17T22:08:43.629172] [INFO ] [MAIN ] Update Progress: 2187/2368 symbols completed. UNM took 40.3s. Estimated remaining: 25m 33s. Rate: 7.1 symbols/min [2025-10-17T22:08:43.760450] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-17T22:08:43.825024] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:08:43.853473] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-17T22:08:43.859284] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-17T22:08:43.875610] [INFO ] [REMOTE ] UNH: Full fetch complete (77960 records). [2025-10-17T22:08:43.875951] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-17T22:08:44.207837] [DEBUG] [LOCAL ] UPS: Loaded 54109 existing records from primary storage. [2025-10-17T22:08:44.235064] [INFO ] [MAIN ] UPS: Loaded 54109 existing records. [2025-10-17T22:08:44.510887] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-17T22:08:44.511994] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-17T22:08:44.528946] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-17T22:08:44.558495] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-17T22:08:44.563285] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:08:44.563903] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-17T22:08:44.563725] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-17T22:08:44.564291] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-17T22:08:44.565865] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-10-17T22:08:44.565938] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-17T22:08:44.586675] [DEBUG] [LOCAL ] UNH: Trimmed 77960 records to 54598 (keeping 200 days of data) [2025-10-17T22:08:45.171043] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:08:45.294193] [DEBUG] [LOCAL ] UNH: Primary data saved (54598 records). [2025-10-17T22:08:45.294344] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-17T22:08:45.295046] [INFO ] [MAIN ] Update Progress: 2188/2368 symbols completed. UNH took 45.2s. Estimated remaining: 25m 24s. Rate: 7.1 symbols/min [2025-10-17T22:08:45.342371] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-10-17T22:08:45.478116] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:08:45.513946] [DEBUG] [LOCAL ] URI: Loaded 34979 existing records from primary storage. [2025-10-17T22:08:45.514234] [INFO ] [MAIN ] URI: Loaded 34979 existing records. [2025-10-17T22:08:45.693233] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:08:45.693507] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-17T22:08:45.693668] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-17T22:08:45.693934] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-17T22:08:45.694001] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-17T22:08:46.018933] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-17T22:08:46.106917] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:08:46.131271] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T22:08:46.142243] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-17T22:08:46.942309] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-10-17T22:08:47.584766] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-17T22:08:47.674367] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T22:08:47.742251] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-17T22:08:48.082600] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-17T22:08:48.542295] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-17T22:08:49.342334] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-17T22:08:49.736476] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-17T22:08:50.142312] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-17T22:08:50.513905] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T22:08:50.948410] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-17T22:08:50.963498] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-17T22:08:51.742321] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-17T22:08:51.852102] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T22:08:52.491688] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-17T22:08:52.542243] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-17T22:08:53.342284] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-17T22:08:53.614242] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T22:08:54.142332] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-17T22:08:54.187794] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T22:08:54.942291] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-17T22:08:55.191899] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-17T22:08:55.742285] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-10-17T22:08:55.860525] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T22:08:56.542302] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-17T22:08:56.613489] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T22:08:57.265557] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T22:08:57.342319] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-10-17T22:08:58.129608] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T22:08:58.142245] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-17T22:08:58.942328] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-17T22:08:59.001941] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T22:08:59.742351] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-10-17T22:09:00.483122] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T22:09:00.525952] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-17T22:09:00.542258] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-10-17T22:09:01.342296] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-17T22:09:01.562578] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T22:09:02.142884] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-17T22:09:02.707761] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-17T22:09:02.942265] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-10-17T22:09:03.458540] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-17T22:09:03.746297] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-17T22:09:03.752674] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-17T22:09:04.434048] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-17T22:09:04.542285] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-10-17T22:09:04.647008] [DEBUG] [REMOTE ] URI: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-17T22:09:04.647303] [WARN ] [REMOTE ] URI: No data returned for month 2025-06 [2025-10-17T22:09:04.647392] [FATAL] [REMOTE ] URI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T22:09:04.647468] [FATAL] [MAIN ] URI: Failed to fetch primary data. [2025-10-17T22:09:04.647531] [WARN ] [MAIN ] URI: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T22:09:04.647604] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-17T22:09:04.647719] [DEBUG] [LOCAL ] URI: No primary data file found to delete. [2025-10-17T22:09:04.647781] [INFO ] [LOCAL ] URI: Starting deletion of derivative data. [2025-10-17T22:09:04.647932] [DEBUG] [LOCAL ] URI: Deleted derivative data file. [2025-10-17T22:09:04.648469] [INFO ] [MAIN ] Update Progress: 2189/2368 symbols completed. URI took 19.4s. Estimated remaining: 25m 16s. Rate: 7.1 symbols/min [2025-10-17T22:09:04.814168] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:09:04.852686] [DEBUG] [LOCAL ] USA: Loaded 36692 existing records from primary storage. [2025-10-17T22:09:04.852961] [INFO ] [MAIN ] USA: Loaded 36692 existing records. [2025-10-17T22:09:05.025680] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:09:05.025880] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-17T22:09:05.025926] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-17T22:09:05.026091] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-17T22:09:05.026129] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-17T22:09:05.351485] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-17T22:09:05.373548] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:09:05.763001] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-17T22:09:05.770325] [INFO ] [REMOTE ] UP: Full fetch complete (63028 records). [2025-10-17T22:09:05.770522] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-17T22:09:06.155862] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-10-17T22:09:06.177292] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-17T22:09:06.177392] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-17T22:09:06.178547] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-17T22:09:06.178693] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-17T22:09:06.199045] [DEBUG] [LOCAL ] UP: Trimmed 63028 records to 44937 (keeping 200 days of data) [2025-10-17T22:09:06.200316] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T22:09:06.209601] [INFO ] [REMOTE ] UNP: Full fetch complete (77105 records). [2025-10-17T22:09:06.209747] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-17T22:09:06.847172] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-17T22:09:06.847833] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-17T22:09:06.849390] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-17T22:09:06.849772] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-17T22:09:06.854577] [DEBUG] [LOCAL ] UNP: Trimmed 77105 records to 54105 (keeping 200 days of data) [2025-10-17T22:09:06.944475] [DEBUG] [LOCAL ] UP: Primary data saved (44937 records). [2025-10-17T22:09:06.945123] [INFO ] [MAIN ] UP: Full history saved. [2025-10-17T22:09:06.944715] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-10-17T22:09:06.953886] [INFO ] [MAIN ] Update Progress: 2190/2368 symbols completed. UP took 31.2s. Estimated remaining: 25m 7s. Rate: 7.1 symbols/min [2025-10-17T22:09:07.267134] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:09:07.293757] [DEBUG] [LOCAL ] USAC: Loaded 21905 existing records from primary storage. [2025-10-17T22:09:07.294818] [INFO ] [MAIN ] USAC: Loaded 21905 existing records. [2025-10-17T22:09:07.552178] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:09:07.552803] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-17T22:09:07.552882] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-17T22:09:07.554032] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-17T22:09:07.554405] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-17T22:09:07.735033] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T22:09:07.792628] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-17T22:09:07.929852] [DEBUG] [LOCAL ] UNP: Primary data saved (54105 records). [2025-10-17T22:09:07.943084] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-17T22:09:07.944478] [INFO ] [MAIN ] Update Progress: 2191/2368 symbols completed. UNP took 40.2s. Estimated remaining: 24m 58s. Rate: 7.1 symbols/min [2025-10-17T22:09:08.044989] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:09:08.134180] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:09:08.184760] [DEBUG] [LOCAL ] USB: Loaded 54078 existing records from primary storage. [2025-10-17T22:09:08.185061] [INFO ] [MAIN ] USB: Loaded 54078 existing records. [2025-10-17T22:09:08.359021] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:09:08.359244] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-17T22:09:08.359290] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-17T22:09:08.359471] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-17T22:09:08.359513] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-17T22:09:08.565141] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-10-17T22:09:08.726637] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:09:09.150149] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-17T22:09:09.317163] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T22:09:09.342244] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-17T22:09:09.794680] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-17T22:09:10.142315] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-17T22:09:10.571737] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T22:09:10.942297] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-17T22:09:11.046461] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-17T22:09:11.742289] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-17T22:09:12.453509] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T22:09:12.542311] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-17T22:09:13.182061] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T22:09:13.342266] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-17T22:09:14.006298] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T22:09:14.142298] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-17T22:09:14.188460] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T22:09:14.942310] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-10-17T22:09:15.207260] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T22:09:15.742348] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-17T22:09:16.542269] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-17T22:09:16.791491] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T22:09:16.940291] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-17T22:09:17.342324] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-17T22:09:17.487684] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-17T22:09:18.142297] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-17T22:09:18.573456] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-17T22:09:18.942303] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-17T22:09:19.681562] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T22:09:19.742254] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-17T22:09:20.542321] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-17T22:09:20.685809] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T22:09:21.169693] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T22:09:21.342399] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-10-17T22:09:21.610975] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T22:09:22.142306] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-17T22:09:22.942315] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-17T22:09:23.068879] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T22:09:23.604942] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-17T22:09:23.742255] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-10-17T22:09:24.542264] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-17T22:09:24.643807] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T22:09:25.342310] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-17T22:09:25.545431] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-17T22:09:26.142280] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-17T22:09:26.295011] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-17T22:09:26.942278] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-17T22:09:27.056217] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-17T22:09:27.333438] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T22:09:27.742339] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-17T22:09:28.494083] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-17T22:09:28.542245] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-17T22:09:28.716875] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-17T22:09:28.719939] [INFO ] [REMOTE ] USAC: Full fetch complete (35099 records). [2025-10-17T22:09:28.720014] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-17T22:09:29.082351] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-17T22:09:29.082427] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-17T22:09:29.083077] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-17T22:09:29.083139] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-17T22:09:29.083890] [DEBUG] [LOCAL ] USAC: Trimmed 35099 records to 22019 (keeping 200 days of data) [2025-10-17T22:09:29.214592] [DEBUG] [LOCAL ] USAC: Primary data saved (22019 records). [2025-10-17T22:09:29.214739] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-17T22:09:29.214835] [INFO ] [MAIN ] Update Progress: 2192/2368 symbols completed. USAC took 22.3s. Estimated remaining: 24m 51s. Rate: 7.1 symbols/min [2025-10-17T22:09:29.350952] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-17T22:09:29.382221] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:09:29.428214] [DEBUG] [LOCAL ] USFD: Loaded 51565 existing records from primary storage. [2025-10-17T22:09:29.428510] [INFO ] [MAIN ] USFD: Loaded 51565 existing records. [2025-10-17T22:09:29.601611] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:09:29.601807] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-17T22:09:29.601860] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-17T22:09:29.602030] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-17T22:09:29.602068] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-17T22:09:29.956025] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:09:29.970849] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T22:09:29.976400] [INFO ] [REMOTE ] USA: Full fetch complete (52481 records). [2025-10-17T22:09:29.976489] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-17T22:09:30.161544] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-10-17T22:09:30.352210] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-17T22:09:30.352288] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-17T22:09:30.353420] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-17T22:09:30.353485] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-17T22:09:30.354580] [DEBUG] [LOCAL ] USA: Trimmed 52481 records to 36917 (keeping 200 days of data) [2025-10-17T22:09:30.570105] [DEBUG] [LOCAL ] USA: Primary data saved (36917 records). [2025-10-17T22:09:30.570236] [INFO ] [MAIN ] USA: Full history saved. [2025-10-17T22:09:30.570877] [INFO ] [MAIN ] Update Progress: 2193/2368 symbols completed. USA took 25.9s. Estimated remaining: 24m 42s. Rate: 7.1 symbols/min [2025-10-17T22:09:30.737471] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:09:30.756989] [DEBUG] [LOCAL ] USNA: Loaded 18138 existing records from primary storage. [2025-10-17T22:09:30.757255] [INFO ] [MAIN ] USNA: Loaded 18138 existing records. [2025-10-17T22:09:30.933402] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:09:30.933606] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-17T22:09:30.933677] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-17T22:09:30.933854] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-17T22:09:30.933893] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-17T22:09:30.947338] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-10-17T22:09:31.288173] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:09:31.317329] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-17T22:09:31.742253] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-17T22:09:31.950500] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T22:09:32.542355] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-17T22:09:33.342326] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-10-17T22:09:33.522320] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-17T22:09:33.711958] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-17T22:09:33.866204] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-17T22:09:34.142261] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-10. [2025-10-17T22:09:34.301319] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-17T22:09:34.819689] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T22:09:34.827080] [INFO ] [REMOTE ] UPS: Full fetch complete (77880 records). [2025-10-17T22:09:34.827197] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-17T22:09:34.947432] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-17T22:09:35.239613] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-17T22:09:35.239776] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-17T22:09:35.241011] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-17T22:09:35.241073] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-17T22:09:35.242715] [DEBUG] [LOCAL ] UPS: Trimmed 77880 records to 54499 (keeping 200 days of data) [2025-10-17T22:09:35.575784] [DEBUG] [LOCAL ] UPS: Primary data saved (54499 records). [2025-10-17T22:09:35.575928] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-17T22:09:35.576023] [INFO ] [MAIN ] Update Progress: 2194/2368 symbols completed. UPS took 51.9s. Estimated remaining: 24m 33s. Rate: 7.1 symbols/min [2025-10-17T22:09:35.747566] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:09:35.747723] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-17T22:09:35.765944] [DEBUG] [LOCAL ] USPH: Loaded 17259 existing records from primary storage. [2025-10-17T22:09:35.766296] [INFO ] [MAIN ] USPH: Loaded 17259 existing records. [2025-10-17T22:09:35.945405] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:09:35.945629] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-17T22:09:35.945709] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-17T22:09:35.945879] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-17T22:09:35.945918] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-17T22:09:36.319585] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:09:36.542257] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-10-17T22:09:36.931981] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-17T22:09:37.037375] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-17T22:09:37.342323] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-17T22:09:37.517501] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-17T22:09:38.142290] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-17T22:09:38.942323] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-17T22:09:39.194315] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-17T22:09:39.383282] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-17T22:09:39.742289] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-17T22:09:40.240060] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-17T22:09:40.542261] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-17T22:09:40.680958] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-17T22:09:41.342300] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-17T22:09:42.142332] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-17T22:09:42.521881] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-17T22:09:42.942373] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-17T22:09:43.448794] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-17T22:09:43.747413] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-17T22:09:43.754286] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-17T22:09:44.420570] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-17T22:09:44.542304] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-17T22:09:44.678362] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-17T22:09:45.342267] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-17T22:09:45.397955] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-17T22:09:46.142311] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-17T22:09:46.942321] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-17T22:09:47.001785] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T22:09:47.233401] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T22:09:47.742344] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-17T22:09:48.542254] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-17T22:09:48.797558] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T22:09:48.828218] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T22:09:49.342385] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-17T22:09:49.360970] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T22:09:50.142350] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-17T22:09:50.492898] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T22:09:50.942320] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-17T22:09:51.617424] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-17T22:09:51.742361] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-17T22:09:52.020894] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-17T22:09:52.542295] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-17T22:09:53.342265] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-17T22:09:53.462114] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T22:09:53.502690] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T22:09:54.142317] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-17T22:09:54.168378] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T22:09:54.942289] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-17T22:09:55.737224] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-17T22:09:55.747685] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-17T22:09:55.790638] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T22:09:56.542354] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-17T22:09:56.791354] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T22:09:57.342328] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-17T22:09:57.624627] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T22:09:57.628099] [INFO ] [REMOTE ] USNA: Full fetch complete (26971 records). [2025-10-17T22:09:57.628178] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-17T22:09:58.047291] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-17T22:09:58.047939] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-17T22:09:58.048723] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T22:09:58.049439] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-17T22:09:58.056017] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-17T22:09:58.057174] [INFO ] [REMOTE ] USB: Full fetch complete (77867 records). [2025-10-17T22:09:58.057611] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-17T22:09:58.057925] [DEBUG] [LOCAL ] USNA: Trimmed 26971 records to 18290 (keeping 200 days of data) [2025-10-17T22:09:58.145825] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-17T22:09:58.595918] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-17T22:09:58.596549] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-17T22:09:58.598269] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-17T22:09:58.598598] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-17T22:09:58.608818] [DEBUG] [LOCAL ] USNA: Primary data saved (18290 records). [2025-10-17T22:09:58.609106] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-17T22:09:58.609194] [INFO ] [MAIN ] Update Progress: 2195/2368 symbols completed. USNA took 28.0s. Estimated remaining: 24m 26s. Rate: 7.1 symbols/min [2025-10-17T22:09:58.642428] [DEBUG] [LOCAL ] USB: Trimmed 77867 records to 54468 (keeping 200 days of data) [2025-10-17T22:09:58.885410] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:09:58.922832] [DEBUG] [LOCAL ] UTF: Loaded 31127 existing records from primary storage. [2025-10-17T22:09:58.926411] [INFO ] [MAIN ] UTF: Loaded 31127 existing records. [2025-10-17T22:09:58.947380] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-17T22:09:59.205945] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:09:59.206939] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-17T22:09:59.207264] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-17T22:09:59.208477] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-17T22:09:59.208819] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-17T22:09:59.583789] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:09:59.685721] [DEBUG] [LOCAL ] USB: Primary data saved (54468 records). [2025-10-17T22:09:59.685913] [INFO ] [MAIN ] USB: Full history saved. [2025-10-17T22:09:59.686010] [INFO ] [MAIN ] Update Progress: 2196/2368 symbols completed. USB took 51.7s. Estimated remaining: 24m 16s. Rate: 7.1 symbols/min [2025-10-17T22:09:59.749270] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-10-17T22:09:59.864756] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:09:59.901975] [DEBUG] [LOCAL ] UTI: Loaded 40786 existing records from primary storage. [2025-10-17T22:09:59.902258] [INFO ] [MAIN ] UTI: Loaded 40786 existing records. [2025-10-17T22:10:00.093762] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:10:00.094203] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-17T22:10:00.094302] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-17T22:10:00.094626] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-17T22:10:00.094796] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-17T22:10:00.237979] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-17T22:10:00.242829] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T22:10:00.524576] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:10:00.542248] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-10-17T22:10:00.745993] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-17T22:10:01.342303] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-17T22:10:02.045375] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-17T22:10:02.142296] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-17T22:10:02.646177] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-17T22:10:02.942292] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-17T22:10:03.567873] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T22:10:03.742299] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-17T22:10:04.542306] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-17T22:10:04.667028] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T22:10:05.322334] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T22:10:05.342253] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-17T22:10:05.747211] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T22:10:06.142294] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-17T22:10:06.942259] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-17T22:10:06.991064] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T22:10:06.998048] [INFO ] [REMOTE ] USFD: Full fetch complete (74340 records). [2025-10-17T22:10:06.998163] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-17T22:10:07.281477] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T22:10:07.413401] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-17T22:10:07.413476] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-17T22:10:07.414664] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-17T22:10:07.414725] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-17T22:10:07.416098] [DEBUG] [LOCAL ] USFD: Trimmed 74340 records to 51936 (keeping 200 days of data) [2025-10-17T22:10:07.742284] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-17T22:10:07.748612] [DEBUG] [LOCAL ] USFD: Primary data saved (51936 records). [2025-10-17T22:10:07.748706] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-17T22:10:07.748788] [INFO ] [MAIN ] Update Progress: 2197/2368 symbols completed. USFD took 38.5s. Estimated remaining: 24m 8s. Rate: 7.1 symbols/min [2025-10-17T22:10:08.545681] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-17T22:10:08.547980] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T22:10:09.231807] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T22:10:09.342264] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-17T22:10:09.481347] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-17T22:10:09.484253] [INFO ] [REMOTE ] USPH: Full fetch complete (23018 records). [2025-10-17T22:10:09.484324] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-17T22:10:09.869399] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-17T22:10:09.869485] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-17T22:10:09.869963] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-17T22:10:09.870028] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-17T22:10:09.870594] [DEBUG] [LOCAL ] USPH: Trimmed 23018 records to 17392 (keeping 200 days of data) [2025-10-17T22:10:09.974315] [DEBUG] [LOCAL ] USPH: Primary data saved (17392 records). [2025-10-17T22:10:09.974454] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-17T22:10:09.974534] [INFO ] [MAIN ] Update Progress: 2198/2368 symbols completed. USPH took 34.4s. Estimated remaining: 23m 59s. Rate: 7.1 symbols/min [2025-10-17T22:10:10.142341] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-17T22:10:10.473931] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-17T22:10:10.942295] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-17T22:10:11.683152] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-17T22:10:11.742246] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-17T22:10:11.886163] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-17T22:10:12.542294] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-17T22:10:13.077481] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-17T22:10:13.342288] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-10-17T22:10:13.829606] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-17T22:10:14.142339] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-17T22:10:14.842315] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-17T22:10:14.942260] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-10-17T22:10:15.284096] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-17T22:10:15.742349] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-17T22:10:16.503415] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T22:10:16.542247] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-10-17T22:10:16.834114] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T22:10:17.342336] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-17T22:10:17.703521] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-17T22:10:18.142325] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-10-17T22:10:18.980742] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T22:10:18.989158] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-17T22:10:19.290748] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-17T22:10:19.742384] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-10. [2025-10-17T22:10:20.506937] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-17T22:10:20.513158] [INFO ] [REMOTE ] UTF: Full fetch complete (43496 records). [2025-10-17T22:10:20.513289] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-17T22:10:20.888148] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-17T22:10:20.888246] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-17T22:10:20.889134] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-17T22:10:20.889198] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-17T22:10:20.890338] [DEBUG] [LOCAL ] UTF: Trimmed 43496 records to 31389 (keeping 200 days of data) [2025-10-17T22:10:21.077969] [DEBUG] [LOCAL ] UTF: Primary data saved (31389 records). [2025-10-17T22:10:21.078098] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-17T22:10:21.078229] [INFO ] [MAIN ] Update Progress: 2199/2368 symbols completed. UTF took 22.5s. Estimated remaining: 23m 51s. Rate: 7.1 symbols/min [2025-10-17T22:10:21.215396] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T22:10:21.221030] [INFO ] [REMOTE ] UTI: Full fetch complete (58749 records). [2025-10-17T22:10:21.221140] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-17T22:10:21.591021] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-17T22:10:21.591125] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-17T22:10:21.592221] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-17T22:10:21.592288] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-17T22:10:21.593560] [DEBUG] [LOCAL ] UTI: Trimmed 58749 records to 41052 (keeping 200 days of data) [2025-10-17T22:10:21.852473] [DEBUG] [LOCAL ] UTI: Primary data saved (41052 records). [2025-10-17T22:10:21.852663] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-17T22:10:21.852861] [INFO ] [MAIN ] Update Progress: 2200/2368 symbols completed. UTI took 22.2s. Estimated remaining: 23m 42s. Rate: 7.1 symbols/min [2025-10-17T22:10:22.416014] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:10:22.487206] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:10:22.549829] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:10:22.553349] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:10:22.577008] [DEBUG] [LOCAL ] UTL: Loaded 11917 existing records from primary storage. [2025-10-17T22:10:22.581790] [INFO ] [MAIN ] UTL: Loaded 11917 existing records. [2025-10-17T22:10:22.629453] [DEBUG] [LOCAL ] UVV: Loaded 22878 existing records from primary storage. [2025-10-17T22:10:22.715637] [DEBUG] [LOCAL ] UVE: Loaded 22150 existing records from primary storage. [2025-10-17T22:10:22.702273] [INFO ] [MAIN ] UVV: Loaded 22878 existing records. [2025-10-17T22:10:22.743847] [INFO ] [MAIN ] UVE: Loaded 22150 existing records. [2025-10-17T22:10:22.760582] [DEBUG] [LOCAL ] UTZ: Loaded 44886 existing records from primary storage. [2025-10-17T22:10:22.837087] [INFO ] [MAIN ] UTZ: Loaded 44886 existing records. [2025-10-17T22:10:22.880550] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:10:22.982820] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-17T22:10:22.991953] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-17T22:10:23.087412] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-17T22:10:23.087567] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-17T22:10:23.354271] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:10:23.439527] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-17T22:10:23.472095] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:10:23.510908] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:10:23.521359] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-17T22:10:23.562905] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-17T22:10:23.572475] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-17T22:10:23.581384] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-17T22:10:23.546232] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-17T22:10:23.592313] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-17T22:10:23.597625] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-17T22:10:23.597790] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-17T22:10:23.619190] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-17T22:10:23.619502] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-17T22:10:23.619108] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-17T22:10:24.213959] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:10:24.230853] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-10-17T22:10:24.814213] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:10:24.862344] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:10:24.851973] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-10-17T22:10:24.858249] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:10:24.862855] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-10-17T22:10:24.863108] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-10-17T22:10:25.191579] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-17T22:10:25.194221] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-17T22:10:25.824493] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-17T22:10:25.828282] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-17T22:10:25.932071] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T22:10:25.939501] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-17T22:10:25.949944] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T22:10:25.959937] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-17T22:10:26.142315] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-17T22:10:26.871592] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T22:10:26.942256] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-17T22:10:27.212737] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T22:10:27.663369] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T22:10:27.742261] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-17T22:10:27.999997] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T22:10:28.542304] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-17T22:10:29.210178] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T22:10:29.342274] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-17T22:10:29.488063] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-17T22:10:30.142331] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-17T22:10:30.942577] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-17T22:10:30.945119] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-17T22:10:31.220608] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-17T22:10:31.742263] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-17T22:10:32.064286] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-17T22:10:32.542294] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-17T22:10:33.007466] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T22:10:33.085552] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-17T22:10:33.342275] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-17T22:10:34.142262] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-17T22:10:34.506371] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-17T22:10:34.942298] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-17T22:10:35.241508] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-17T22:10:35.742268] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-17T22:10:35.820137] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-17T22:10:36.542305] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-17T22:10:36.913157] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T22:10:37.342312] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-17T22:10:37.890869] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-17T22:10:38.118122] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-17T22:10:38.142259] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-17T22:10:38.942366] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-17T22:10:39.028457] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-17T22:10:39.742315] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-17T22:10:40.139180] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-17T22:10:40.542328] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-17T22:10:41.342326] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-17T22:10:41.380101] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T22:10:41.421274] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T22:10:42.142258] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-17T22:10:42.244828] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T22:10:42.942338] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-17T22:10:43.742322] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-17T22:10:43.843357] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T22:10:44.027156] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T22:10:44.030535] [INFO ] [REMOTE ] UVV: Full fetch complete (30144 records). [2025-10-17T22:10:44.030698] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-17T22:10:44.544542] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-17T22:10:44.545109] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-17T22:10:44.545269] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-17T22:10:44.546508] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-17T22:10:44.547848] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-17T22:10:44.549681] [DEBUG] [LOCAL ] UVV: Trimmed 30144 records to 22980 (keeping 200 days of data) [2025-10-17T22:10:44.748045] [DEBUG] [LOCAL ] UVV: Primary data saved (22980 records). [2025-10-17T22:10:44.748234] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-17T22:10:44.748444] [INFO ] [MAIN ] Update Progress: 2201/2368 symbols completed. UVV took 22.9s. Estimated remaining: 23m 34s. Rate: 7.1 symbols/min [2025-10-17T22:10:44.935569] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:10:44.988931] [DEBUG] [LOCAL ] UWMC: Loaded 53342 existing records from primary storage. [2025-10-17T22:10:44.989279] [INFO ] [MAIN ] UWMC: Loaded 53342 existing records. [2025-10-17T22:10:45.208873] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:10:45.209741] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-17T22:10:45.210686] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T22:10:45.210868] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-17T22:10:45.216123] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-17T22:10:45.216309] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-17T22:10:45.370271] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-17T22:10:45.581751] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T22:10:45.646466] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:10:46.142342] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-17T22:10:46.662272] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-17T22:10:46.681327] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-17T22:10:46.942332] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-10-17T22:10:47.742298] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-10-17T22:10:48.542338] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-17T22:10:48.833152] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T22:10:48.849947] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-17T22:10:49.342324] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-17T22:10:49.867728] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T22:10:50.142330] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-17T22:10:50.942283] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-10-17T22:10:51.059309] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T22:10:51.744713] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-17T22:10:51.762397] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T22:10:51.973804] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-17T22:10:52.542298] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-10. [2025-10-17T22:10:53.342301] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-17T22:10:53.421689] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T22:10:53.473922] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T22:10:53.477549] [INFO ] [REMOTE ] UVE: Full fetch complete (30249 records). [2025-10-17T22:10:53.477716] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-17T22:10:53.853504] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-17T22:10:53.853580] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-17T22:10:53.854208] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-17T22:10:53.854269] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-17T22:10:53.855071] [DEBUG] [LOCAL ] UVE: Trimmed 30249 records to 22261 (keeping 200 days of data) [2025-10-17T22:10:53.987282] [DEBUG] [LOCAL ] UVE: Primary data saved (22261 records). [2025-10-17T22:10:53.987406] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-17T22:10:53.987485] [INFO ] [MAIN ] Update Progress: 2202/2368 symbols completed. UVE took 32.1s. Estimated remaining: 23m 26s. Rate: 7.1 symbols/min [2025-10-17T22:10:54.154210] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-17T22:10:54.158206] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:10:54.167359] [DEBUG] [LOCAL ] UZD: Loaded 6131 existing records from primary storage. [2025-10-17T22:10:54.167541] [INFO ] [MAIN ] UZD: Loaded 6131 existing records. [2025-10-17T22:10:54.353024] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:10:54.353287] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-17T22:10:54.353346] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-17T22:10:54.353509] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-17T22:10:54.353564] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-17T22:10:54.701552] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:10:54.901797] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T22:10:54.942246] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-17T22:10:55.139954] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-17T22:10:55.742303] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-17T22:10:56.513732] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T22:10:56.542315] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-17T22:10:57.342277] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-10-17T22:10:57.538110] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-17T22:10:57.971524] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T22:10:57.978673] [INFO ] [REMOTE ] UTZ: Full fetch complete (64668 records). [2025-10-17T22:10:57.978844] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-17T22:10:58.090181] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-17T22:10:58.146412] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-17T22:10:58.386061] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-17T22:10:58.386143] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-17T22:10:58.387541] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-17T22:10:58.387604] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-17T22:10:58.388960] [DEBUG] [LOCAL ] UTZ: Trimmed 64668 records to 45179 (keeping 200 days of data) [2025-10-17T22:10:58.665135] [DEBUG] [LOCAL ] UTZ: Primary data saved (45179 records). [2025-10-17T22:10:58.665290] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-17T22:10:58.665378] [INFO ] [MAIN ] Update Progress: 2203/2368 symbols completed. UTZ took 36.8s. Estimated remaining: 23m 17s. Rate: 7.1 symbols/min [2025-10-17T22:10:58.834835] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:10:58.844486] [DEBUG] [LOCAL ] UZE: Loaded 7288 existing records from primary storage. [2025-10-17T22:10:58.844857] [INFO ] [MAIN ] UZE: Loaded 7288 existing records. [2025-10-17T22:10:58.944360] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-17T22:10:59.040262] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:10:59.041155] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-17T22:10:59.041218] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-17T22:10:59.041361] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-17T22:10:59.043482] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-17T22:10:59.043346] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T22:10:59.452333] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:10:59.742343] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-10-17T22:11:00.476700] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-17T22:11:00.542245] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-17T22:11:00.749708] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T22:11:01.104353] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-17T22:11:01.342283] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-17T22:11:01.933542] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T22:11:02.142299] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-17T22:11:02.942289] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-17T22:11:03.038082] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-17T22:11:03.040537] [INFO ] [REMOTE ] UTL: Full fetch complete (15788 records). [2025-10-17T22:11:03.040612] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-17T22:11:03.411421] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-17T22:11:03.411518] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-17T22:11:03.411935] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-17T22:11:03.411996] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-17T22:11:03.412708] [DEBUG] [LOCAL ] UTL: Trimmed 15788 records to 12006 (keeping 200 days of data) [2025-10-17T22:11:03.487735] [DEBUG] [LOCAL ] UTL: Primary data saved (12006 records). [2025-10-17T22:11:03.487886] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-17T22:11:03.487971] [INFO ] [MAIN ] Update Progress: 2204/2368 symbols completed. UTL took 41.6s. Estimated remaining: 23m 8s. Rate: 7.1 symbols/min [2025-10-17T22:11:03.663016] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:11:03.663172] [DEBUG] [LOCAL ] UZF: No existing data file found in primary storage. [2025-10-17T22:11:03.663210] [WARN ] [MAIN ] UZF: No existing data found, performing full refresh instead. [2025-10-17T22:11:03.663322] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-17T22:11:03.663364] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-17T22:11:03.663407] [DEBUG] [LOCAL ] UZF: No primary data file found to delete. [2025-10-17T22:11:03.663441] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-17T22:11:03.751141] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-17T22:11:03.780632] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-17T22:11:04.043090] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:11:04.542297] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-10-17T22:11:04.586547] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T22:11:05.085359] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-17T22:11:05.342349] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-17T22:11:05.959381] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-17T22:11:06.142307] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-17T22:11:06.928806] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-17T22:11:06.942243] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-17T22:11:07.333829] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-17T22:11:07.742312] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-17T22:11:08.406169] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-17T22:11:08.542301] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-17T22:11:09.335757] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-17T22:11:09.342237] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-17T22:11:09.917803] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-17T22:11:10.142285] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-17T22:11:10.699670] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-17T22:11:10.942301] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-17T22:11:11.543974] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T22:11:11.742297] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-17T22:11:12.447025] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-17T22:11:12.542356] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-17T22:11:13.342329] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-17T22:11:14.077952] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-17T22:11:14.142280] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-17T22:11:14.399235] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T22:11:14.758830] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-17T22:11:14.942296] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-17T22:11:15.742291] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-17T22:11:16.479069] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-17T22:11:16.542248] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-17T22:11:16.823761] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-17T22:11:17.150521] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-17T22:11:17.342309] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-17T22:11:17.912611] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-17T22:11:18.142353] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-17T22:11:18.942350] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-17T22:11:19.581815] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T22:11:19.742332] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-17T22:11:20.542341] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-17T22:11:20.733271] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T22:11:21.342340] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-17T22:11:21.604631] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-17T22:11:22.068430] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-17T22:11:22.084978] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-17T22:11:22.142308] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-17T22:11:22.749855] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-17T22:11:22.942341] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-17T22:11:23.503046] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-17T22:11:23.504346] [INFO ] [REMOTE ] UZE: Full fetch complete (9899 records). [2025-10-17T22:11:23.504416] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-17T22:11:23.747507] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-17T22:11:23.864861] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-17T22:11:23.864930] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-17T22:11:23.865165] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-17T22:11:23.865202] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-17T22:11:23.865617] [DEBUG] [LOCAL ] UZE: Trimmed 9899 records to 7329 (keeping 200 days of data) [2025-10-17T22:11:23.909890] [DEBUG] [LOCAL ] UZE: Primary data saved (7329 records). [2025-10-17T22:11:23.910039] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-17T22:11:23.910179] [INFO ] [MAIN ] Update Progress: 2205/2368 symbols completed. UZE took 25.2s. Estimated remaining: 23m 1s. Rate: 7.1 symbols/min [2025-10-17T22:11:24.076341] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:11:24.125514] [DEBUG] [LOCAL ] V: Loaded 54143 existing records from primary storage. [2025-10-17T22:11:24.125853] [INFO ] [MAIN ] V: Loaded 54143 existing records. [2025-10-17T22:11:24.302195] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:11:24.302394] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-17T22:11:24.302439] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-17T22:11:24.302814] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-17T22:11:24.302869] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-17T22:11:24.545425] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-17T22:11:24.630032] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-17T22:11:24.692091] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:11:25.342323] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-17T22:11:25.392759] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-17T22:11:25.950241] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-17T22:11:26.142302] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-17T22:11:26.648631] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-17T22:11:26.649753] [INFO ] [REMOTE ] UZF: Full fetch complete (8569 records). [2025-10-17T22:11:26.649829] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-17T22:11:26.826137] [WARN ] [VALIDATOR ] UZF: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T22:11:26.826369] [FATAL] [MAIN ] UZF: Fetched primary data is invalid. Refusing to save it. [2025-10-17T22:11:26.826439] [WARN ] [MAIN ] UZF: Deleting existing primary and derivative data due to validation failure. [2025-10-17T22:11:26.826511] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-17T22:11:26.826574] [DEBUG] [LOCAL ] UZF: No primary data file found to delete. [2025-10-17T22:11:26.826611] [INFO ] [LOCAL ] UZF: Starting deletion of derivative data. [2025-10-17T22:11:26.826682] [DEBUG] [LOCAL ] UZF: No derivative data file found to delete. [2025-10-17T22:11:26.826768] [INFO ] [MAIN ] Update Progress: 2206/2368 symbols completed. UZF took 23.3s. Estimated remaining: 22m 52s. Rate: 7.1 symbols/min [2025-10-17T22:11:26.947469] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-17T22:11:26.996106] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:11:27.029418] [DEBUG] [LOCAL ] VAC: Loaded 34301 existing records from primary storage. [2025-10-17T22:11:27.029754] [INFO ] [MAIN ] VAC: Loaded 34301 existing records. [2025-10-17T22:11:27.200487] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:11:27.200758] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-17T22:11:27.200816] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-17T22:11:27.201035] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-17T22:11:27.201092] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-17T22:11:27.542640] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:11:27.562662] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-17T22:11:27.742358] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-10-17T22:11:28.542321] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-10-17T22:11:29.342254] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-17T22:11:29.416277] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T22:11:29.507284] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T22:11:30.142355] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-17T22:11:30.942269] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-17T22:11:31.384196] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-17T22:11:31.415883] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-17T22:11:31.416742] [INFO ] [REMOTE ] UZD: Full fetch complete (9062 records). [2025-10-17T22:11:31.416811] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-17T22:11:31.744854] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-17T22:11:31.783079] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-17T22:11:31.783208] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-17T22:11:31.783466] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-17T22:11:31.783510] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-17T22:11:31.784284] [DEBUG] [LOCAL ] UZD: Trimmed 9062 records to 6137 (keeping 200 days of data) [2025-10-17T22:11:31.829072] [DEBUG] [LOCAL ] UZD: Primary data saved (6137 records). [2025-10-17T22:11:31.829214] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-17T22:11:31.829303] [INFO ] [MAIN ] Update Progress: 2207/2368 symbols completed. UZD took 37.8s. Estimated remaining: 22m 43s. Rate: 7.1 symbols/min [2025-10-17T22:11:31.999529] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:11:32.045289] [DEBUG] [LOCAL ] VAL: Loaded 50523 existing records from primary storage. [2025-10-17T22:11:32.045621] [INFO ] [MAIN ] VAL: Loaded 50523 existing records. [2025-10-17T22:11:32.218554] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:11:32.218764] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-17T22:11:32.218813] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-17T22:11:32.218988] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-17T22:11:32.219027] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-17T22:11:32.550767] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-17T22:11:32.572714] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:11:33.136598] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T22:11:33.342259] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-10-17T22:11:34.142295] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-17T22:11:34.637058] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-17T22:11:34.942350] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-17T22:11:35.007679] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T22:11:35.368908] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (6.03 seconds). [2025-10-17T22:11:35.584144] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-17T22:11:35.742288] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-17T22:11:36.542479] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-17T22:11:36.851342] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-17T22:11:37.251434] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-17T22:11:37.342377] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-17T22:11:38.142340] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-17T22:11:38.942347] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-17T22:11:39.491518] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-10-17T22:11:39.558604] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T22:11:39.742256] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-17T22:11:39.851014] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-17T22:11:40.542348] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-17T22:11:41.343238] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-17T22:11:41.361334] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-17T22:11:41.586166] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-17T22:11:41.593524] [INFO ] [REMOTE ] UWMC: Full fetch complete (75906 records). [2025-10-17T22:11:41.593637] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-17T22:11:41.979514] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-17T22:11:41.979590] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-17T22:11:41.980795] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-17T22:11:41.980858] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-17T22:11:41.982276] [DEBUG] [LOCAL ] UWMC: Trimmed 75906 records to 53731 (keeping 200 days of data) [2025-10-17T22:11:42.149131] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-17T22:11:42.315446] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-17T22:11:42.335737] [DEBUG] [LOCAL ] UWMC: Primary data saved (53731 records). [2025-10-17T22:11:42.335828] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-17T22:11:42.335901] [INFO ] [MAIN ] Update Progress: 2208/2368 symbols completed. UWMC took 57.6s. Estimated remaining: 22m 35s. Rate: 7.1 symbols/min [2025-10-17T22:11:42.502434] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:11:42.551096] [DEBUG] [LOCAL ] VALE: Loaded 54083 existing records from primary storage. [2025-10-17T22:11:42.551394] [INFO ] [MAIN ] VALE: Loaded 54083 existing records. [2025-10-17T22:11:42.728630] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:11:42.728881] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-17T22:11:42.728938] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-17T22:11:42.729117] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-17T22:11:42.729157] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-17T22:11:42.867262] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T22:11:42.949028] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-17T22:11:43.104061] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:11:43.742356] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-10-17T22:11:44.543991] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-17T22:11:44.547049] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-17T22:11:45.166261] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-17T22:11:45.342378] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-17T22:11:45.929579] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T22:11:45.967583] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-17T22:11:46.142359] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-17T22:11:46.942299] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-17T22:11:47.423174] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-17T22:11:47.742314] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-17T22:11:48.542326] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-17T22:11:48.975140] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-17T22:11:49.260820] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-17T22:11:49.342333] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-17T22:11:49.438840] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (4.10 seconds). [2025-10-17T22:11:50.142350] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-17T22:11:50.184417] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T22:11:50.344524] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T22:11:50.349635] [INFO ] [REMOTE ] VAC: Full fetch complete (48765 records). [2025-10-17T22:11:50.349805] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-17T22:11:50.728021] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-17T22:11:50.728095] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-17T22:11:50.728951] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-17T22:11:50.729046] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-17T22:11:50.730047] [DEBUG] [LOCAL ] VAC: Trimmed 48765 records to 34464 (keeping 200 days of data) [2025-10-17T22:11:50.935167] [DEBUG] [LOCAL ] VAC: Primary data saved (34464 records). [2025-10-17T22:11:50.935293] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-17T22:11:50.935370] [INFO ] [MAIN ] Update Progress: 2209/2368 symbols completed. VAC took 24.1s. Estimated remaining: 22m 26s. Rate: 7.1 symbols/min [2025-10-17T22:11:50.947538] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-17T22:11:51.114743] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:11:51.121740] [DEBUG] [LOCAL ] VATE: Loaded 5231 existing records from primary storage. [2025-10-17T22:11:51.121913] [INFO ] [MAIN ] VATE: Loaded 5231 existing records. [2025-10-17T22:11:51.295290] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:11:51.295494] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-17T22:11:51.295540] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-17T22:11:51.295708] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-17T22:11:51.295764] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-17T22:11:51.641299] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:11:51.742255] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-10-17T22:11:52.342541] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-17T22:11:52.359590] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-17T22:11:52.542278] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-17T22:11:52.830496] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-17T22:11:53.342357] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-17T22:11:54.142348] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-17T22:11:54.942274] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-17T22:11:55.006198] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T22:11:55.133485] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-17T22:11:55.257140] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-17T22:11:55.742341] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-17T22:11:56.542288] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-17T22:11:57.342343] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-17T22:11:57.827578] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (2.89 seconds). [2025-10-17T22:11:57.961864] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-17T22:11:58.142345] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-17T22:11:58.594887] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-17T22:11:58.730375] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.99 seconds). [2025-10-17T22:11:58.942283] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-17T22:11:59.742300] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-17T22:12:00.174706] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-17T22:12:00.542291] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-17T22:12:00.575540] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-17T22:12:01.325481] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-17T22:12:01.342260] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-17T22:12:02.053484] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-17T22:12:02.143439] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-17T22:12:02.142394] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-17T22:12:02.942330] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-17T22:12:03.600289] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-17T22:12:03.742277] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-17T22:12:03.856464] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T22:12:04.542346] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-17T22:12:05.134329] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-17T22:12:05.342304] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-17T22:12:06.142289] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-17T22:12:06.944933] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-17T22:12:06.944435] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-17T22:12:06.946322] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-17T22:12:06.956278] [INFO ] [REMOTE ] VAL: Full fetch complete (73113 records). [2025-10-17T22:12:06.956409] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-17T22:12:07.369985] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-17T22:12:07.370125] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-17T22:12:07.371324] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-17T22:12:07.371389] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-17T22:12:07.372827] [DEBUG] [LOCAL ] VAL: Trimmed 73113 records to 50829 (keeping 200 days of data) [2025-10-17T22:12:07.675840] [DEBUG] [LOCAL ] VAL: Primary data saved (50829 records). [2025-10-17T22:12:07.675994] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-17T22:12:07.676874] [INFO ] [MAIN ] Update Progress: 2210/2368 symbols completed. VAL took 35.8s. Estimated remaining: 22m 19s. Rate: 7.1 symbols/min [2025-10-17T22:12:07.745616] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-17T22:12:07.869717] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:12:07.871358] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T22:12:07.879905] [INFO ] [REMOTE ] V: Full fetch complete (77928 records). [2025-10-17T22:12:07.880066] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-17T22:12:07.983775] [DEBUG] [LOCAL ] VBF: Loaded 7296 existing records from primary storage. [2025-10-17T22:12:07.986769] [INFO ] [MAIN ] VBF: Loaded 7296 existing records. [2025-10-17T22:12:08.361948] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:12:08.385353] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T22:12:08.388852] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-17T22:12:08.391248] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-17T22:12:08.412607] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-17T22:12:08.412725] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-17T22:12:08.546325] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-17T22:12:08.593867] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-17T22:12:08.594786] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-17T22:12:08.596100] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-17T22:12:08.612522] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-17T22:12:08.664243] [DEBUG] [LOCAL ] V: Trimmed 77928 records to 54532 (keeping 200 days of data) [2025-10-17T22:12:08.971506] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:12:09.213681] [DEBUG] [LOCAL ] V: Primary data saved (54532 records). [2025-10-17T22:12:09.213823] [INFO ] [MAIN ] V: Full history saved. [2025-10-17T22:12:09.213905] [INFO ] [MAIN ] Update Progress: 2211/2368 symbols completed. V took 45.3s. Estimated remaining: 22m 10s. Rate: 7.1 symbols/min [2025-10-17T22:12:09.344228] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-10-17T22:12:09.339026] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-17T22:12:09.398862] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:12:09.414755] [DEBUG] [LOCAL ] VCV: Loaded 13732 existing records from primary storage. [2025-10-17T22:12:09.414984] [INFO ] [MAIN ] VCV: Loaded 13732 existing records. [2025-10-17T22:12:09.592022] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:12:09.592278] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-17T22:12:09.592326] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-17T22:12:09.592685] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-17T22:12:09.592742] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-17T22:12:09.940825] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:12:10.142297] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-10-17T22:12:10.145537] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-17T22:12:10.942398] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-17T22:12:11.742384] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-17T22:12:12.357755] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-17T22:12:12.358974] [INFO ] [REMOTE ] VATE: Full fetch complete (10527 records). [2025-10-17T22:12:12.359042] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-17T22:12:12.730519] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-17T22:12:12.730616] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-17T22:12:12.730976] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-17T22:12:12.731046] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-17T22:12:12.731741] [DEBUG] [LOCAL ] VATE: Trimmed 10527 records to 5266 (keeping 200 days of data) [2025-10-17T22:12:12.768773] [DEBUG] [LOCAL ] VATE: Primary data saved (5266 records). [2025-10-17T22:12:12.768922] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-17T22:12:12.769011] [INFO ] [MAIN ] Update Progress: 2212/2368 symbols completed. VATE took 21.8s. Estimated remaining: 22m 1s. Rate: 7.1 symbols/min [2025-10-17T22:12:12.941246] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:12:12.986958] [DEBUG] [LOCAL ] VEEV: Loaded 47681 existing records from primary storage. [2025-10-17T22:12:12.987260] [INFO ] [MAIN ] VEEV: Loaded 47681 existing records. [2025-10-17T22:12:13.172983] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:12:13.173247] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-17T22:12:13.173299] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-17T22:12:13.173544] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-17T22:12:13.173601] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-17T22:12:13.528749] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:12:13.529070] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-10-17T22:12:20.212189] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (16.47 seconds). [2025-10-17T22:12:20.224267] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-17T22:12:22.283161] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-17T22:12:22.294691] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-17T22:12:26.053963] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (15.91 seconds). [2025-10-17T22:12:26.058568] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-17T22:12:26.844452] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T22:12:26.847907] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-17T22:12:27.594587] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-17T22:12:27.597365] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-17T22:12:28.240090] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (17.30 seconds). [2025-10-17T22:12:28.241805] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-17T22:12:28.468684] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-17T22:12:28.472139] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-17T22:12:30.719968] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-17T22:12:30.722831] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-17T22:12:32.016864] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (3.54 seconds). [2025-10-17T22:12:32.020428] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-17T22:12:32.835690] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-17T22:12:32.838745] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-17T22:12:33.812044] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (20.28 seconds). [2025-10-17T22:12:33.822111] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-17T22:12:34.477747] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T22:12:34.481984] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-17T22:12:35.360079] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T22:12:35.369833] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-17T22:12:35.411141] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-17T22:12:35.416392] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-10-17T22:12:36.420531] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-17T22:12:36.424147] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-10-17T22:12:37.133980] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T22:12:37.143965] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-17T22:12:38.762588] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T22:12:38.772858] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-17T22:12:39.778698] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (17.48 seconds). [2025-10-17T22:12:39.791850] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-17T22:12:39.969845] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (9.25 seconds). [2025-10-17T22:12:39.972615] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-17T22:12:40.460058] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T22:12:40.470686] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-17T22:12:40.592835] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (4.17 seconds). [2025-10-17T22:12:40.599870] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-10. [2025-10-17T22:12:40.755306] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-17T22:12:40.757325] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-17T22:12:41.357412] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T22:12:41.359314] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-17T22:12:41.434607] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-17T22:12:41.436829] [INFO ] [REMOTE ] VCV: Full fetch complete (18471 records). [2025-10-17T22:12:41.436919] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-17T22:12:41.839041] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-17T22:12:41.839217] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-17T22:12:41.839937] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-17T22:12:41.840125] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-17T22:12:41.841883] [DEBUG] [LOCAL ] VCV: Trimmed 18471 records to 13798 (keeping 200 days of data) [2025-10-17T22:12:41.920769] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-17T22:12:41.954188] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-17T22:12:41.970217] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-17T22:12:41.987311] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-17T22:12:42.000888] [DEBUG] [LOCAL ] VCV: Primary data saved (13798 records). [2025-10-17T22:12:42.001032] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-17T22:12:42.001142] [INFO ] [MAIN ] Update Progress: 2213/2368 symbols completed. VCV took 32.8s. Estimated remaining: 21m 54s. Rate: 7.1 symbols/min [2025-10-17T22:12:42.170434] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:12:42.187271] [DEBUG] [LOCAL ] VEL: Loaded 12291 existing records from primary storage. [2025-10-17T22:12:42.187615] [INFO ] [MAIN ] VEL: Loaded 12291 existing records. [2025-10-17T22:12:42.405735] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-17T22:12:42.414082] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:12:42.424595] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-17T22:12:42.424985] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-17T22:12:42.426036] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-17T22:12:42.426272] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-17T22:12:42.426347] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-17T22:12:42.827822] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:12:42.828604] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-10-17T22:12:42.860996] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T22:12:42.863688] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-17T22:12:43.568693] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-17T22:12:43.570908] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-17T22:12:43.647153] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T22:12:43.650230] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-17T22:12:43.950738] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-17T22:12:43.963579] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-17T22:12:44.361610] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-17T22:12:44.365949] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-17T22:12:44.366239] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-17T22:12:44.380610] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-17T22:12:44.384578] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-17T22:12:44.385520] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-17T22:12:45.159850] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T22:12:45.173115] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-17T22:12:45.174809] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T22:12:45.180623] [INFO ] [REMOTE ] VBF: Full fetch complete (10949 records). [2025-10-17T22:12:45.180814] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-17T22:12:45.601506] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-17T22:12:45.601629] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-17T22:12:45.602054] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-17T22:12:45.602131] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-17T22:12:45.603474] [DEBUG] [LOCAL ] VBF: Trimmed 10949 records to 7375 (keeping 200 days of data) [2025-10-17T22:12:45.682163] [DEBUG] [LOCAL ] VBF: Primary data saved (7375 records). [2025-10-17T22:12:45.682467] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-17T22:12:45.682638] [INFO ] [MAIN ] Update Progress: 2214/2368 symbols completed. VBF took 38.0s. Estimated remaining: 21m 45s. Rate: 7.1 symbols/min [2025-10-17T22:12:45.969889] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:12:46.032324] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-17T22:12:46.060877] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-17T22:12:46.083433] [DEBUG] [LOCAL ] VET: Loaded 44441 existing records from primary storage. [2025-10-17T22:12:46.084065] [INFO ] [MAIN ] VET: Loaded 44441 existing records. [2025-10-17T22:12:46.286150] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:12:46.291828] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-17T22:12:46.295905] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-17T22:12:46.299021] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-17T22:12:46.297849] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-17T22:12:46.303408] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-17T22:12:46.304303] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-17T22:12:46.442231] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-17T22:12:46.496251] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-17T22:12:46.714736] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:12:46.715114] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-10-17T22:12:47.644250] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-17T22:12:47.647341] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-17T22:12:48.106080] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-17T22:12:48.113665] [INFO ] [REMOTE ] VALE: Full fetch complete (77873 records). [2025-10-17T22:12:48.113783] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-17T22:12:48.433465] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-17T22:12:48.478094] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-17T22:12:48.538127] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-17T22:12:48.571455] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-17T22:12:48.572146] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-17T22:12:48.572364] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-17T22:12:48.575202] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-17T22:12:48.575483] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-17T22:12:48.603256] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-17T22:12:48.602069] [DEBUG] [LOCAL ] VALE: Trimmed 77873 records to 54473 (keeping 200 days of data) [2025-10-17T22:12:48.614044] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-17T22:12:48.944499] [DEBUG] [LOCAL ] VALE: Primary data saved (54473 records). [2025-10-17T22:12:48.944633] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-17T22:12:48.944750] [INFO ] [MAIN ] Update Progress: 2215/2368 symbols completed. VALE took 1m 7s. Estimated remaining: 21m 36s. Rate: 7.1 symbols/min [2025-10-17T22:12:49.108861] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:12:49.159238] [DEBUG] [LOCAL ] VFC: Loaded 53995 existing records from primary storage. [2025-10-17T22:12:49.159573] [INFO ] [MAIN ] VFC: Loaded 53995 existing records. [2025-10-17T22:12:49.339771] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:12:49.340037] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-17T22:12:49.340108] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-17T22:12:49.340328] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-17T22:12:49.340397] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-17T22:12:49.522662] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-17T22:12:49.543512] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-17T22:12:49.728733] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:12:49.729065] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-10-17T22:12:49.784261] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T22:12:49.793445] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-17T22:12:50.359146] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T22:12:50.369376] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-17T22:12:50.596478] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T22:12:50.942346] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-17T22:12:51.468352] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T22:12:51.619623] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T22:12:51.626431] [INFO ] [REMOTE ] VEEV: Full fetch complete (68452 records). [2025-10-17T22:12:51.626573] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-17T22:12:51.745844] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-17T22:12:51.873237] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T22:12:52.060543] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-17T22:12:52.081602] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-17T22:12:52.083254] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-17T22:12:52.083556] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-17T22:12:52.085898] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-17T22:12:52.095152] [DEBUG] [LOCAL ] VEEV: Trimmed 68452 records to 48056 (keeping 200 days of data) [2025-10-17T22:12:52.390048] [DEBUG] [LOCAL ] VEEV: Primary data saved (48056 records). [2025-10-17T22:12:52.390200] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-17T22:12:52.390292] [INFO ] [MAIN ] Update Progress: 2216/2368 symbols completed. VEEV took 39.6s. Estimated remaining: 21m 27s. Rate: 7.1 symbols/min [2025-10-17T22:12:52.553959] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-17T22:12:52.556461] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:12:52.556689] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-17T22:12:52.556763] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-17T22:12:52.557790] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-17T22:12:52.557867] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-17T22:12:52.557917] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-17T22:12:52.557955] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-17T22:12:52.903803] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:12:53.342338] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-17T22:12:53.711579] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-17T22:12:54.142321] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-10-17T22:12:54.224394] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-17T22:12:54.224028] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T22:12:54.343356] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T22:12:54.343720] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-10-17T22:12:54.343835] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T22:12:54.343926] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-10-17T22:12:54.344012] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T22:12:54.344107] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-17T22:12:54.344232] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-17T22:12:54.344292] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-17T22:12:54.344350] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-17T22:12:54.344431] [INFO ] [MAIN ] Update Progress: 2217/2368 symbols completed. VG took 2.0s. Estimated remaining: 21m 18s. Rate: 7.1 symbols/min [2025-10-17T22:12:54.513023] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:12:54.520228] [DEBUG] [LOCAL ] VGI: Loaded 5246 existing records from primary storage. [2025-10-17T22:12:54.520397] [INFO ] [MAIN ] VGI: Loaded 5246 existing records. [2025-10-17T22:12:54.695638] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:12:54.695952] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-17T22:12:54.696008] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-17T22:12:54.696161] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-17T22:12:54.696224] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-17T22:12:54.947475] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-17T22:12:55.040436] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:12:55.742346] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-17T22:12:56.527012] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-17T22:12:56.529063] [INFO ] [REMOTE ] VEL: Full fetch complete (17198 records). [2025-10-17T22:12:56.529132] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-17T22:12:56.551459] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-10-17T22:12:56.911621] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-17T22:12:56.911878] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-17T22:12:56.912281] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-17T22:12:56.912463] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-17T22:12:56.913346] [DEBUG] [LOCAL ] VEL: Trimmed 17198 records to 12350 (keeping 200 days of data) [2025-10-17T22:12:56.940799] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-17T22:12:57.020441] [DEBUG] [LOCAL ] VEL: Primary data saved (12350 records). [2025-10-17T22:12:57.020562] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-17T22:12:57.020674] [INFO ] [MAIN ] Update Progress: 2218/2368 symbols completed. VEL took 15.0s. Estimated remaining: 21m 10s. Rate: 7.1 symbols/min [2025-10-17T22:12:57.135611] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-17T22:12:57.192961] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:12:57.211161] [DEBUG] [LOCAL ] VGM: Loaded 18717 existing records from primary storage. [2025-10-17T22:12:57.211383] [INFO ] [MAIN ] VGM: Loaded 18717 existing records. [2025-10-17T22:12:57.358732] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-17T22:12:57.410471] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:12:57.411046] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-17T22:12:57.411150] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-17T22:12:57.411489] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-17T22:12:57.411548] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-17T22:12:57.793880] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:12:58.077323] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-17T22:12:58.142252] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-17T22:12:58.942286] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-10-17T22:12:59.742291] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-17T22:12:59.823683] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T22:12:59.976222] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-17T22:13:00.542346] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-17T22:13:01.342290] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-17T22:13:01.618229] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T22:13:01.931718] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-17T22:13:02.142317] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-17T22:13:02.296606] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T22:13:02.942275] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-17T22:13:03.742312] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-17T22:13:04.318858] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-17T22:13:04.542296] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-17T22:13:04.602474] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T22:13:04.622903] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-17T22:13:05.342301] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-17T22:13:06.142269] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-17T22:13:06.572164] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-17T22:13:06.635063] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T22:13:06.798470] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-17T22:13:06.942300] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-17T22:13:07.742347] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-17T22:13:08.360349] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-17T22:13:08.542265] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-17T22:13:08.969329] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-17T22:13:09.169572] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-17T22:13:09.342299] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-17T22:13:10.142292] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-17T22:13:10.942269] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-17T22:13:11.418888] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-17T22:13:11.745677] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-17T22:13:11.748543] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T22:13:11.822578] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-17T22:13:12.113010] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-17T22:13:12.542347] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-17T22:13:13.342359] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-17T22:13:13.930834] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-17T22:13:14.082091] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T22:13:14.142260] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-17T22:13:14.756178] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-17T22:13:14.942282] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-17T22:13:15.476505] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-17T22:13:15.742323] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-17T22:13:16.486203] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-17T22:13:16.542251] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-17T22:13:17.071084] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-17T22:13:17.072267] [INFO ] [REMOTE ] VGI: Full fetch complete (7631 records). [2025-10-17T22:13:17.072337] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-17T22:13:17.343801] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-17T22:13:17.423256] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-17T22:13:17.423330] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-17T22:13:17.423525] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-17T22:13:17.423564] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-17T22:13:17.423977] [DEBUG] [LOCAL ] VGI: Trimmed 7631 records to 5280 (keeping 200 days of data) [2025-10-17T22:13:17.454248] [DEBUG] [LOCAL ] VGI: Primary data saved (5280 records). [2025-10-17T22:13:17.454331] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-17T22:13:17.454410] [INFO ] [MAIN ] Update Progress: 2219/2368 symbols completed. VGI took 23.1s. Estimated remaining: 21m 2s. Rate: 7.1 symbols/min [2025-10-17T22:13:17.636879] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:13:17.642910] [DEBUG] [LOCAL ] VHI: Loaded 2792 existing records from primary storage. [2025-10-17T22:13:17.643178] [INFO ] [MAIN ] VHI: Loaded 2792 existing records. [2025-10-17T22:13:17.827830] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:13:17.828082] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-17T22:13:17.828139] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-17T22:13:17.828286] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-17T22:13:17.828339] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-17T22:13:18.151670] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-17T22:13:18.192293] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:13:18.357881] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T22:13:18.942343] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-17T22:13:19.742286] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-10-17T22:13:20.091999] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T22:13:20.148992] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-17T22:13:20.542320] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-17T22:13:20.728059] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-17T22:13:20.734497] [INFO ] [REMOTE ] VET: Full fetch complete (64609 records). [2025-10-17T22:13:20.734597] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-17T22:13:21.113747] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-17T22:13:21.113910] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-17T22:13:21.115091] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-17T22:13:21.115154] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-17T22:13:21.116534] [DEBUG] [LOCAL ] VET: Trimmed 64609 records to 44787 (keeping 200 days of data) [2025-10-17T22:13:21.210319] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-17T22:13:21.344706] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-17T22:13:21.390631] [DEBUG] [LOCAL ] VET: Primary data saved (44787 records). [2025-10-17T22:13:21.390796] [INFO ] [MAIN ] VET: Full history saved. [2025-10-17T22:13:21.391510] [INFO ] [MAIN ] Update Progress: 2220/2368 symbols completed. VET took 35.7s. Estimated remaining: 20m 53s. Rate: 7.1 symbols/min [2025-10-17T22:13:21.561208] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:13:21.561415] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-17T22:13:21.561466] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-17T22:13:21.561577] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-17T22:13:21.561617] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-17T22:13:21.561700] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-17T22:13:21.561745] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-17T22:13:21.906375] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:13:22.142282] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-10-17T22:13:22.352789] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T22:13:22.353108] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-10-17T22:13:22.353208] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T22:13:22.353258] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-17T22:13:22.353323] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T22:13:22.353418] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-17T22:13:22.353506] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-17T22:13:22.353553] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-17T22:13:22.353592] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-17T22:13:22.353694] [INFO ] [MAIN ] Update Progress: 2221/2368 symbols completed. VIA took 1.0s. Estimated remaining: 20m 44s. Rate: 7.1 symbols/min [2025-10-17T22:13:22.523884] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:13:22.577498] [DEBUG] [LOCAL ] VICI: Loaded 54043 existing records from primary storage. [2025-10-17T22:13:22.577859] [INFO ] [MAIN ] VICI: Loaded 54043 existing records. [2025-10-17T22:13:22.765171] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:13:22.765520] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-17T22:13:22.765581] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-17T22:13:22.765815] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-17T22:13:22.765873] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-17T22:13:22.948035] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-17T22:13:23.126487] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:13:23.549000] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-17T22:13:23.742344] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-17T22:13:24.071591] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T22:13:24.542269] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-10-17T22:13:25.250758] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T22:13:25.258188] [INFO ] [REMOTE ] VFC: Full fetch complete (77749 records). [2025-10-17T22:13:25.258323] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-17T22:13:25.347357] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-17T22:13:25.646440] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-17T22:13:25.646530] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-17T22:13:25.648047] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-17T22:13:25.648118] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-17T22:13:25.649639] [DEBUG] [LOCAL ] VFC: Trimmed 77749 records to 54384 (keeping 200 days of data) [2025-10-17T22:13:25.986405] [DEBUG] [LOCAL ] VFC: Primary data saved (54384 records). [2025-10-17T22:13:25.986679] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-17T22:13:25.986781] [INFO ] [MAIN ] Update Progress: 2222/2368 symbols completed. VFC took 37.0s. Estimated remaining: 20m 35s. Rate: 7.1 symbols/min [2025-10-17T22:13:26.146119] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-17T22:13:26.163089] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:13:26.212080] [DEBUG] [LOCAL ] VIK: Loaded 52852 existing records from primary storage. [2025-10-17T22:13:26.212391] [INFO ] [MAIN ] VIK: Loaded 52852 existing records. [2025-10-17T22:13:26.392412] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:13:26.392809] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-17T22:13:26.392869] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-17T22:13:26.393058] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-17T22:13:26.393115] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-17T22:13:26.599193] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-17T22:13:26.625918] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-17T22:13:26.810539] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:13:26.812261] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-17T22:13:26.942265] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-10-17T22:13:27.742294] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-17T22:13:28.542318] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-17T22:13:28.686272] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T22:13:29.342269] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-17T22:13:29.362219] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-17T22:13:29.876941] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-17T22:13:30.142283] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-17T22:13:30.942259] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-17T22:13:31.063415] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T22:13:31.602262] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-17T22:13:31.742342] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-17T22:13:32.029865] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-17T22:13:32.542270] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-17T22:13:32.744583] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-17T22:13:33.342301] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-17T22:13:34.142275] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-17T22:13:34.181182] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T22:13:34.942300] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-17T22:13:35.329242] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T22:13:35.352036] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-17T22:13:35.742309] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-17T22:13:36.505033] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T22:13:36.542316] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-17T22:13:37.108895] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-17T22:13:37.342269] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-17T22:13:37.788262] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-17T22:13:37.980020] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-17T22:13:37.985170] [INFO ] [REMOTE ] VGM: Full fetch complete (25878 records). [2025-10-17T22:13:37.985411] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-17T22:13:38.147572] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-17T22:13:38.469825] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-17T22:13:38.469927] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-17T22:13:38.470742] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-17T22:13:38.470812] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-17T22:13:38.471935] [DEBUG] [LOCAL ] VGM: Trimmed 25878 records to 18936 (keeping 200 days of data) [2025-10-17T22:13:38.589248] [DEBUG] [LOCAL ] VGM: Primary data saved (18936 records). [2025-10-17T22:13:38.589407] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-17T22:13:38.589492] [INFO ] [MAIN ] Update Progress: 2223/2368 symbols completed. VGM took 41.6s. Estimated remaining: 20m 27s. Rate: 7.1 symbols/min [2025-10-17T22:13:38.754519] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:13:38.807031] [DEBUG] [LOCAL ] VIPS: Loaded 51666 existing records from primary storage. [2025-10-17T22:13:38.807351] [INFO ] [MAIN ] VIPS: Loaded 51666 existing records. [2025-10-17T22:13:38.952543] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-17T22:13:38.985152] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:13:38.985369] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-17T22:13:38.985417] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-17T22:13:38.985815] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-17T22:13:38.985876] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-17T22:13:39.355795] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:13:39.502377] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-17T22:13:39.742319] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-10-17T22:13:39.911901] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T22:13:40.542295] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-17T22:13:41.342289] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-17T22:13:41.494832] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-17T22:13:42.142256] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-17T22:13:42.293986] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T22:13:42.942267] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-17T22:13:43.340340] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-17T22:13:43.570330] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-17T22:13:43.742267] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-17T22:13:43.895009] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T22:13:44.326312] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-17T22:13:44.542276] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-17T22:13:45.342301] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-17T22:13:45.810241] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-17T22:13:46.142353] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-17T22:13:46.182686] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T22:13:46.687030] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-17T22:13:46.942303] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-17T22:13:47.742313] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-17T22:13:48.542261] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-17T22:13:48.761018] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-17T22:13:49.342255] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-17T22:13:49.466363] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T22:13:49.665820] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-17T22:13:49.666789] [INFO ] [REMOTE ] VHI: Full fetch complete (4350 records). [2025-10-17T22:13:49.666856] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-17T22:13:50.017801] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-17T22:13:50.017908] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-17T22:13:50.018053] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-17T22:13:50.018100] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-17T22:13:50.018443] [DEBUG] [LOCAL ] VHI: Trimmed 4350 records to 2811 (keeping 200 days of data) [2025-10-17T22:13:50.034993] [DEBUG] [LOCAL ] VHI: Primary data saved (2811 records). [2025-10-17T22:13:50.035052] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-17T22:13:50.035131] [INFO ] [MAIN ] Update Progress: 2224/2368 symbols completed. VHI took 32.6s. Estimated remaining: 20m 19s. Rate: 7.1 symbols/min [2025-10-17T22:13:50.147254] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-17T22:13:50.203447] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:13:50.247219] [DEBUG] [LOCAL ] VIRT: Loaded 47005 existing records from primary storage. [2025-10-17T22:13:50.247514] [INFO ] [MAIN ] VIRT: Loaded 47005 existing records. [2025-10-17T22:13:50.424707] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:13:50.424949] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-17T22:13:50.425020] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-17T22:13:50.425260] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-17T22:13:50.425344] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-17T22:13:50.737598] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-17T22:13:50.828940] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:13:50.942254] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-10-17T22:13:51.742294] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-17T22:13:52.287616] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-17T22:13:52.431683] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-17T22:13:52.542323] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-17T22:13:53.342293] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-17T22:13:53.799838] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-17T22:13:54.142337] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-17T22:13:54.246164] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T22:13:54.942385] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-10-17T22:13:55.096915] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T22:13:55.742317] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-17T22:13:56.126252] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-17T22:13:56.542299] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-17T22:13:56.719770] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T22:13:56.926729] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T22:13:57.342308] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-10-17T22:13:58.142306] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-17T22:13:58.593883] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T22:13:58.907933] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T22:13:58.942288] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-17T22:13:59.671522] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T22:13:59.745447] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-10-17T22:13:59.749600] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T22:13:59.757146] [INFO ] [REMOTE ] VICI: Full fetch complete (77801 records). [2025-10-17T22:13:59.757255] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-17T22:14:00.145559] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-17T22:14:00.145637] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-17T22:14:00.146890] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-17T22:14:00.146987] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-17T22:14:00.148457] [DEBUG] [LOCAL ] VICI: Trimmed 77801 records to 54433 (keeping 200 days of data) [2025-10-17T22:14:00.481009] [DEBUG] [LOCAL ] VICI: Primary data saved (54433 records). [2025-10-17T22:14:00.481166] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-17T22:14:00.481775] [INFO ] [MAIN ] Update Progress: 2225/2368 symbols completed. VICI took 38.1s. Estimated remaining: 20m 11s. Rate: 7.1 symbols/min [2025-10-17T22:14:00.547480] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-17T22:14:00.654208] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:14:00.699487] [DEBUG] [LOCAL ] VIST: Loaded 46887 existing records from primary storage. [2025-10-17T22:14:00.699837] [INFO ] [MAIN ] VIST: Loaded 46887 existing records. [2025-10-17T22:14:00.873513] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:14:00.873754] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-17T22:14:00.873806] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-17T22:14:00.873991] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-17T22:14:00.874029] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-17T22:14:01.261289] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:14:01.342310] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-10-17T22:14:01.676612] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T22:14:02.142316] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-10-17T22:14:02.278944] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-17T22:14:02.286028] [INFO ] [REMOTE ] VIK: Full fetch complete (76037 records). [2025-10-17T22:14:02.286146] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-17T22:14:02.675701] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-17T22:14:02.675904] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-17T22:14:02.677187] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-17T22:14:02.677325] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-17T22:14:02.679211] [DEBUG] [LOCAL ] VIK: Trimmed 76037 records to 53232 (keeping 200 days of data) [2025-10-17T22:14:02.785532] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T22:14:02.946182] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-17T22:14:03.024421] [DEBUG] [LOCAL ] VIK: Primary data saved (53232 records). [2025-10-17T22:14:03.024558] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-17T22:14:03.024640] [INFO ] [MAIN ] Update Progress: 2226/2368 symbols completed. VIK took 37.0s. Estimated remaining: 20m 2s. Rate: 7.1 symbols/min [2025-10-17T22:14:03.191288] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:14:03.231006] [DEBUG] [LOCAL ] VIV: Loaded 45156 existing records from primary storage. [2025-10-17T22:14:03.231293] [INFO ] [MAIN ] VIV: Loaded 45156 existing records. [2025-10-17T22:14:03.404293] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:14:03.404520] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-17T22:14:03.404567] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-17T22:14:03.404774] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-17T22:14:03.404830] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-17T22:14:03.743282] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-10-17T22:14:03.763933] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:14:03.794288] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T22:14:04.542285] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-10-17T22:14:04.802725] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-17T22:14:05.342297] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-10-17T22:14:05.616611] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-17T22:14:06.142322] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-10-17T22:14:06.202042] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-17T22:14:06.922119] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T22:14:06.942240] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-17T22:14:07.747415] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-10-17T22:14:07.759502] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T22:14:08.538171] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-17T22:14:08.546424] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-17T22:14:09.342315] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-17T22:14:09.550030] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-17T22:14:10.111391] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T22:14:10.142240] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-17T22:14:10.820623] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T22:14:10.942325] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-10-17T22:14:11.742267] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-17T22:14:11.791483] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T22:14:12.467815] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-17T22:14:12.542297] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-10-17T22:14:12.941837] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-17T22:14:13.342350] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-17T22:14:14.142332] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-10-17T22:14:14.356491] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T22:14:14.942283] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-17T22:14:15.106603] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T22:14:15.598584] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T22:14:15.742391] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-10. [2025-10-17T22:14:16.519769] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-17T22:14:16.542244] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-17T22:14:17.203405] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T22:14:17.210733] [INFO ] [REMOTE ] VIPS: Full fetch complete (74860 records). [2025-10-17T22:14:17.210892] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-17T22:14:17.353702] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-17T22:14:17.646916] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-17T22:14:17.647084] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-17T22:14:17.648748] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-17T22:14:17.648881] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-17T22:14:17.650855] [DEBUG] [LOCAL ] VIPS: Trimmed 74860 records to 52050 (keeping 200 days of data) [2025-10-17T22:14:17.967476] [DEBUG] [LOCAL ] VIPS: Primary data saved (52050 records). [2025-10-17T22:14:17.967631] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-17T22:14:17.967804] [INFO ] [MAIN ] Update Progress: 2227/2368 symbols completed. VIPS took 39.4s. Estimated remaining: 19m 54s. Rate: 7.1 symbols/min [2025-10-17T22:14:18.136098] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:14:18.146126] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-10-17T22:14:18.155215] [DEBUG] [LOCAL ] VKQ: Loaded 17804 existing records from primary storage. [2025-10-17T22:14:18.155446] [INFO ] [MAIN ] VKQ: Loaded 17804 existing records. [2025-10-17T22:14:18.362364] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T22:14:18.360686] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:14:18.371521] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-17T22:14:18.371792] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-17T22:14:18.372323] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-17T22:14:18.372387] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-17T22:14:18.736155] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:14:18.942281] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-10-17T22:14:19.036911] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T22:14:19.432809] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-17T22:14:19.742308] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-10-17T22:14:19.891796] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T22:14:20.542364] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-17T22:14:21.342273] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-17T22:14:21.490459] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T22:14:22.142367] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-10. [2025-10-17T22:14:22.240162] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T22:14:22.686706] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-17T22:14:22.942319] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-17T22:14:23.621283] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-17T22:14:23.636778] [INFO ] [REMOTE ] VIRT: Full fetch complete (67611 records). [2025-10-17T22:14:23.637407] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-17T22:14:23.637832] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-17T22:14:23.742857] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-17T22:14:24.032413] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-17T22:14:24.032489] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-17T22:14:24.033659] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-17T22:14:24.033723] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-17T22:14:24.034989] [DEBUG] [LOCAL ] VIRT: Trimmed 67611 records to 47324 (keeping 200 days of data) [2025-10-17T22:14:24.324303] [DEBUG] [LOCAL ] VIRT: Primary data saved (47324 records). [2025-10-17T22:14:24.324436] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-17T22:14:24.324518] [INFO ] [MAIN ] Update Progress: 2228/2368 symbols completed. VIRT took 34.3s. Estimated remaining: 19m 45s. Rate: 7.1 symbols/min [2025-10-17T22:14:24.496446] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:14:24.525396] [DEBUG] [LOCAL ] VLN: Loaded 31015 existing records from primary storage. [2025-10-17T22:14:24.525673] [INFO ] [MAIN ] VLN: Loaded 31015 existing records. [2025-10-17T22:14:24.547391] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-17T22:14:24.706000] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:14:24.706208] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-17T22:14:24.706273] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-17T22:14:24.706500] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-17T22:14:24.706566] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-17T22:14:25.059022] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:14:25.342268] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-10-17T22:14:25.411428] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T22:14:26.142293] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-17T22:14:26.363090] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T22:14:26.942271] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-17T22:14:26.968608] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T22:14:27.742316] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-17T22:14:27.815933] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T22:14:27.868837] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-17T22:14:28.542306] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-17T22:14:29.342318] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-17T22:14:29.407848] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T22:14:29.792338] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T22:14:30.142357] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-17T22:14:30.955265] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-17T22:14:30.958188] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-17T22:14:31.244526] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T22:14:31.742323] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-17T22:14:31.924539] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-17T22:14:32.542299] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-17T22:14:33.342289] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-17T22:14:33.631820] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-17T22:14:33.994339] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T22:14:34.000595] [INFO ] [REMOTE ] VIV: Full fetch complete (64477 records). [2025-10-17T22:14:34.000757] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-17T22:14:34.147370] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-17T22:14:34.416173] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-17T22:14:34.416254] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-17T22:14:34.417373] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-17T22:14:34.417555] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-17T22:14:34.429952] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T22:14:34.434573] [DEBUG] [LOCAL ] VIV: Trimmed 64477 records to 45447 (keeping 200 days of data) [2025-10-17T22:14:34.702268] [DEBUG] [LOCAL ] VIV: Primary data saved (45447 records). [2025-10-17T22:14:34.702395] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-17T22:14:34.702472] [INFO ] [MAIN ] Update Progress: 2229/2368 symbols completed. VIV took 31.7s. Estimated remaining: 19m 37s. Rate: 7.1 symbols/min [2025-10-17T22:14:34.871832] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:14:34.921399] [DEBUG] [LOCAL ] VLO: Loaded 53400 existing records from primary storage. [2025-10-17T22:14:34.921726] [INFO ] [MAIN ] VLO: Loaded 53400 existing records. [2025-10-17T22:14:34.950125] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-17T22:14:35.098268] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:14:35.098500] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-17T22:14:35.098549] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-17T22:14:35.098843] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-17T22:14:35.098902] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-17T22:14:35.462285] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:14:35.457979] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T22:14:35.742314] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-17T22:14:35.987861] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T22:14:36.542351] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-10-17T22:14:36.656342] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-17T22:14:37.342271] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-10-17T22:14:37.571844] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-17T22:14:38.142307] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-17T22:14:38.942307] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-10-17T22:14:39.189782] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-17T22:14:39.191615] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T22:14:39.742312] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-17T22:14:39.931359] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T22:14:40.542343] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-17T22:14:40.887345] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T22:14:41.342351] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-10-17T22:14:42.142294] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-17T22:14:42.265384] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T22:14:42.359116] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-17T22:14:42.942346] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-10-17T22:14:43.616143] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T22:14:43.742264] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-17T22:14:43.947419] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T22:14:44.542391] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-17T22:14:45.297826] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T22:14:45.342330] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-17T22:14:46.151671] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-17T22:14:46.153727] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T22:14:46.161316] [INFO ] [REMOTE ] VIST: Full fetch complete (67374 records). [2025-10-17T22:14:46.161448] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-17T22:14:46.554847] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-17T22:14:46.554954] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-17T22:14:46.556159] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-17T22:14:46.556228] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-17T22:14:46.557931] [DEBUG] [LOCAL ] VIST: Trimmed 67374 records to 47252 (keeping 200 days of data) [2025-10-17T22:14:46.855555] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T22:14:46.871138] [DEBUG] [LOCAL ] VIST: Primary data saved (47252 records). [2025-10-17T22:14:46.871286] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-17T22:14:46.872080] [INFO ] [MAIN ] Update Progress: 2230/2368 symbols completed. VIST took 46.4s. Estimated remaining: 19m 29s. Rate: 7.1 symbols/min [2025-10-17T22:14:46.947355] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-10. [2025-10-17T22:14:47.041543] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:14:47.079452] [DEBUG] [LOCAL ] VLRS: Loaded 40013 existing records from primary storage. [2025-10-17T22:14:47.079795] [INFO ] [MAIN ] VLRS: Loaded 40013 existing records. [2025-10-17T22:14:47.252565] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:14:47.252792] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-17T22:14:47.252841] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-17T22:14:47.253033] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-17T22:14:47.253098] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-17T22:14:47.612933] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:14:47.742245] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-17T22:14:47.933538] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T22:14:47.937100] [INFO ] [REMOTE ] VKQ: Full fetch complete (24664 records). [2025-10-17T22:14:47.938919] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T22:14:47.939000] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-17T22:14:48.313998] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-17T22:14:48.314149] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-17T22:14:48.314691] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-17T22:14:48.314752] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-17T22:14:48.315550] [DEBUG] [LOCAL ] VKQ: Trimmed 24664 records to 18083 (keeping 200 days of data) [2025-10-17T22:14:48.420852] [DEBUG] [LOCAL ] VKQ: Primary data saved (18083 records). [2025-10-17T22:14:48.420976] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-17T22:14:48.421068] [INFO ] [MAIN ] Update Progress: 2231/2368 symbols completed. VKQ took 30.5s. Estimated remaining: 19m 20s. Rate: 7.1 symbols/min [2025-10-17T22:14:48.547452] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-17T22:14:48.603976] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:14:48.611571] [DEBUG] [LOCAL ] VLT: Loaded 4434 existing records from primary storage. [2025-10-17T22:14:48.611801] [INFO ] [MAIN ] VLT: Loaded 4434 existing records. [2025-10-17T22:14:48.789796] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:14:48.790006] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-17T22:14:48.790077] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-17T22:14:48.790245] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-17T22:14:48.790311] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-17T22:14:49.186465] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T22:14:49.191704] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:14:49.198049] [INFO ] [REMOTE ] VLN: Full fetch complete (43558 records). [2025-10-17T22:14:49.198137] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-17T22:14:49.347385] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-10-17T22:14:49.579259] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-17T22:14:49.579349] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-17T22:14:49.580592] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-17T22:14:49.580686] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-17T22:14:49.581966] [DEBUG] [LOCAL ] VLN: Trimmed 43558 records to 31295 (keeping 200 days of data) [2025-10-17T22:14:49.770930] [DEBUG] [LOCAL ] VLN: Primary data saved (31295 records). [2025-10-17T22:14:49.771139] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-17T22:14:49.771273] [INFO ] [MAIN ] Update Progress: 2232/2368 symbols completed. VLN took 25.4s. Estimated remaining: 19m 11s. Rate: 7.1 symbols/min [2025-10-17T22:14:49.948321] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:14:49.955266] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-17T22:14:50.011725] [DEBUG] [LOCAL ] VLTO: Loaded 46553 existing records from primary storage. [2025-10-17T22:14:50.012124] [INFO ] [MAIN ] VLTO: Loaded 46553 existing records. [2025-10-17T22:14:50.147462] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-10-17T22:14:50.210040] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:14:50.210310] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-17T22:14:50.210366] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-17T22:14:50.210583] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-17T22:14:50.210675] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-17T22:14:50.583843] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:14:50.613205] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-17T22:14:50.942286] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-17T22:14:51.680799] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T22:14:51.742277] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-17T22:14:52.541806] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-17T22:14:52.543955] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-10-17T22:14:52.805674] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T22:14:53.342339] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-17T22:14:54.142324] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-17T22:14:54.206506] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T22:14:54.766176] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-17T22:14:54.942269] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-17T22:14:55.106281] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T22:14:55.341413] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-17T22:14:55.742314] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-17T22:14:56.478696] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-17T22:14:56.542283] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-17T22:14:57.342352] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-17T22:14:58.142306] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-17T22:14:58.370181] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-17T22:14:58.767603] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T22:14:58.942262] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-17T22:14:59.528100] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-17T22:14:59.742293] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-17T22:15:00.542297] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-17T22:15:00.864571] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-17T22:15:01.179303] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-17T22:15:01.342285] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-17T22:15:01.513090] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-17T22:15:02.142307] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-17T22:15:02.752606] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-17T22:15:02.942356] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-17T22:15:02.982980] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T22:15:03.742271] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-17T22:15:04.508203] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T22:15:04.542248] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-17T22:15:05.342305] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-17T22:15:05.669392] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-17T22:15:06.073410] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-17T22:15:06.142286] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-17T22:15:06.405164] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T22:15:06.863190] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T22:15:06.870843] [INFO ] [REMOTE ] VLO: Full fetch complete (76957 records). [2025-10-17T22:15:06.871047] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-17T22:15:06.947388] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-17T22:15:07.270308] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-17T22:15:07.270397] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-17T22:15:07.271735] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-17T22:15:07.271803] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-17T22:15:07.273517] [DEBUG] [LOCAL ] VLO: Trimmed 76957 records to 53782 (keeping 200 days of data) [2025-10-17T22:15:07.607845] [DEBUG] [LOCAL ] VLO: Primary data saved (53782 records). [2025-10-17T22:15:07.607983] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-17T22:15:07.608081] [INFO ] [MAIN ] Update Progress: 2233/2368 symbols completed. VLO took 32.9s. Estimated remaining: 19m 3s. Rate: 7.1 symbols/min [2025-10-17T22:15:07.746375] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-17T22:15:07.776861] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:15:07.822736] [DEBUG] [LOCAL ] VMC: Loaded 42844 existing records from primary storage. [2025-10-17T22:15:07.823030] [INFO ] [MAIN ] VMC: Loaded 42844 existing records. [2025-10-17T22:15:08.000720] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:15:08.000980] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-17T22:15:08.001042] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-17T22:15:08.001238] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-17T22:15:08.001274] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-17T22:15:08.406685] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:15:08.412193] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-17T22:15:08.542304] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-10-17T22:15:08.682029] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T22:15:09.342317] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-17T22:15:10.147477] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-17T22:15:10.164853] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-17T22:15:10.942349] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-17T22:15:10.972473] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T22:15:11.011413] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T22:15:11.742337] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-17T22:15:12.472158] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-17T22:15:12.542263] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-17T22:15:13.116333] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-17T22:15:13.117482] [INFO ] [REMOTE ] VLT: Full fetch complete (7485 records). [2025-10-17T22:15:13.117551] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-17T22:15:13.356929] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-17T22:15:13.485449] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-17T22:15:13.494153] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-17T22:15:13.509805] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-17T22:15:13.509981] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-17T22:15:13.512808] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T22:15:13.511246] [DEBUG] [LOCAL ] VLT: Trimmed 7485 records to 4468 (keeping 200 days of data) [2025-10-17T22:15:13.549773] [DEBUG] [LOCAL ] VLT: Primary data saved (4468 records). [2025-10-17T22:15:13.549913] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-17T22:15:13.550002] [INFO ] [MAIN ] Update Progress: 2234/2368 symbols completed. VLT took 25.1s. Estimated remaining: 18m 54s. Rate: 7.1 symbols/min [2025-10-17T22:15:13.721300] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:15:13.737341] [DEBUG] [LOCAL ] VMI: Loaded 15183 existing records from primary storage. [2025-10-17T22:15:13.737567] [INFO ] [MAIN ] VMI: Loaded 15183 existing records. [2025-10-17T22:15:13.911130] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:15:13.911338] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-17T22:15:13.911410] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-17T22:15:13.911601] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-17T22:15:13.911690] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-17T22:15:14.148077] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-17T22:15:14.267945] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:15:14.942319] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-17T22:15:15.268501] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T22:15:15.532687] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T22:15:15.742294] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-17T22:15:16.452077] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T22:15:16.542325] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-17T22:15:17.276892] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T22:15:17.342254] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-17T22:15:18.018297] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T22:15:18.142250] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-17T22:15:18.706550] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-17T22:15:18.942319] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-10-17T22:15:19.742299] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-17T22:15:19.966142] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-17T22:15:20.401474] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-17T22:15:20.542285] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-17T22:15:20.799352] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-17T22:15:21.342302] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-17T22:15:22.147729] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-17T22:15:22.164789] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-17T22:15:22.589771] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-17T22:15:22.595260] [INFO ] [REMOTE ] VLRS: Full fetch complete (58433 records). [2025-10-17T22:15:22.595468] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-17T22:15:22.947477] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-17T22:15:23.106177] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-17T22:15:23.106303] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-17T22:15:23.108612] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-17T22:15:23.108751] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-17T22:15:23.110194] [DEBUG] [LOCAL ] VLRS: Trimmed 58433 records to 40231 (keeping 200 days of data) [2025-10-17T22:15:23.424758] [DEBUG] [LOCAL ] VLRS: Primary data saved (40231 records). [2025-10-17T22:15:23.424914] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-17T22:15:23.425869] [INFO ] [MAIN ] Update Progress: 2235/2368 symbols completed. VLRS took 36.6s. Estimated remaining: 18m 46s. Rate: 7.1 symbols/min [2025-10-17T22:15:23.647562] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:15:23.670455] [DEBUG] [LOCAL ] VMO: Loaded 20913 existing records from primary storage. [2025-10-17T22:15:23.670783] [INFO ] [MAIN ] VMO: Loaded 20913 existing records. [2025-10-17T22:15:23.745520] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-17T22:15:23.868829] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:15:23.869146] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-17T22:15:23.869201] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-17T22:15:23.869473] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-17T22:15:23.869593] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-17T22:15:24.218258] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-17T22:15:24.312290] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:15:24.541913] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T22:15:24.550274] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-17T22:15:24.593775] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-17T22:15:25.342283] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-17T22:15:26.142326] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-10-17T22:15:26.200421] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-17T22:15:26.305935] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T22:15:26.942366] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-17T22:15:27.219429] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T22:15:27.742292] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-17T22:15:28.542322] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-17T22:15:28.675535] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T22:15:28.794541] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-17T22:15:29.342305] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-17T22:15:30.115919] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T22:15:30.142301] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-17T22:15:30.467848] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T22:15:30.942302] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-17T22:15:31.357363] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T22:15:31.742309] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-17T22:15:32.176046] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T22:15:32.542355] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-17T22:15:32.792619] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T22:15:33.332344] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-17T22:15:33.342250] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-17T22:15:34.142302] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-17T22:15:34.487428] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-17T22:15:34.942313] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-17T22:15:35.750728] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-17T22:15:35.784912] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T22:15:35.822062] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-17T22:15:36.542357] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-17T22:15:37.342306] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-17T22:15:37.389894] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T22:15:37.442530] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T22:15:38.142336] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-17T22:15:38.409187] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-17T22:15:38.837449] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T22:15:38.844162] [INFO ] [REMOTE ] VLTO: Full fetch complete (67338 records). [2025-10-17T22:15:38.844317] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-17T22:15:38.944859] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-17T22:15:39.234189] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-17T22:15:39.234335] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-17T22:15:39.235516] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-17T22:15:39.235583] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-17T22:15:39.236976] [DEBUG] [LOCAL ] VLTO: Trimmed 67338 records to 46842 (keeping 200 days of data) [2025-10-17T22:15:39.528189] [DEBUG] [LOCAL ] VLTO: Primary data saved (46842 records). [2025-10-17T22:15:39.528325] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-17T22:15:39.528410] [INFO ] [MAIN ] Update Progress: 2236/2368 symbols completed. VLTO took 49.8s. Estimated remaining: 18m 38s. Rate: 7.1 symbols/min [2025-10-17T22:15:39.699580] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:15:39.710119] [DEBUG] [LOCAL ] VNCE: Loaded 9103 existing records from primary storage. [2025-10-17T22:15:39.710302] [INFO ] [MAIN ] VNCE: Loaded 9103 existing records. [2025-10-17T22:15:39.751397] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-17T22:15:39.889344] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:15:39.889625] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-10-17T22:15:39.889721] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-10-17T22:15:39.889926] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-10-17T22:15:39.889985] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-10-17T22:15:40.089910] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-17T22:15:40.271940] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:15:40.459774] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-17T22:15:40.542273] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-10-17T22:15:41.342326] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-17T22:15:41.722210] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-17T22:15:41.932023] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-17T22:15:41.939833] [INFO ] [REMOTE ] VMC: Full fetch complete (62331 records). [2025-10-17T22:15:41.939982] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-17T22:15:42.151314] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-10-17T22:15:42.323939] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-17T22:15:42.324023] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-17T22:15:42.325140] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-17T22:15:42.325206] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-17T22:15:42.326469] [DEBUG] [LOCAL ] VMC: Trimmed 62331 records to 43121 (keeping 200 days of data) [2025-10-17T22:15:42.598904] [DEBUG] [LOCAL ] VMC: Primary data saved (43121 records). [2025-10-17T22:15:42.599043] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-17T22:15:42.599130] [INFO ] [MAIN ] Update Progress: 2237/2368 symbols completed. VMC took 35.0s. Estimated remaining: 18m 29s. Rate: 7.1 symbols/min [2025-10-17T22:15:42.943011] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-17T22:15:43.201373] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T22:15:43.646107] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-17T22:15:43.742285] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-10-17T22:15:44.542296] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-17T22:15:44.963335] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-17T22:15:45.342269] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-10. [2025-10-17T22:15:45.539082] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-17T22:15:46.142270] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-17T22:15:46.332907] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-17T22:15:46.336017] [INFO ] [REMOTE ] VMO: Full fetch complete (30931 records). [2025-10-17T22:15:46.336088] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-17T22:15:46.695170] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-17T22:15:46.695254] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-17T22:15:46.695895] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-17T22:15:46.695957] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-17T22:15:46.696772] [DEBUG] [LOCAL ] VMO: Trimmed 30931 records to 21084 (keeping 200 days of data) [2025-10-17T22:15:46.821487] [DEBUG] [LOCAL ] VMO: Primary data saved (21084 records). [2025-10-17T22:15:46.821613] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-17T22:15:46.821727] [INFO ] [MAIN ] Update Progress: 2238/2368 symbols completed. VMO took 23.4s. Estimated remaining: 18m 20s. Rate: 7.1 symbols/min [2025-10-17T22:15:46.942325] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-10-17T22:15:47.218980] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T22:15:47.742305] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-17T22:15:48.236721] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T22:15:48.542331] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-10-17T22:15:48.720700] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-17T22:15:49.342316] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-17T22:15:49.417112] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-17T22:15:50.142345] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-10-17T22:15:50.261399] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-17T22:15:50.263607] [INFO ] [REMOTE ] VMI: Full fetch complete (21234 records). [2025-10-17T22:15:50.263704] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-17T22:15:50.553174] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-17T22:15:50.634536] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-17T22:15:50.634620] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-17T22:15:50.635123] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-17T22:15:50.635178] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-17T22:15:50.635847] [DEBUG] [LOCAL ] VMI: Trimmed 21234 records to 15248 (keeping 200 days of data) [2025-10-17T22:15:50.729213] [DEBUG] [LOCAL ] VMI: Primary data saved (15248 records). [2025-10-17T22:15:50.729357] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-17T22:15:50.729441] [INFO ] [MAIN ] Update Progress: 2239/2368 symbols completed. VMI took 37.2s. Estimated remaining: 18m 12s. Rate: 7.1 symbols/min [2025-10-17T22:15:50.942359] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-10-17T22:15:51.543095] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-17T22:15:51.742351] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-10-17T22:15:52.409280] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-17T22:15:52.542328] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-10-17T22:15:53.294908] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-17T22:15:53.342310] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-10-17T22:15:53.948792] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-17T22:15:54.142365] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-10-17T22:15:54.706624] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-17T22:15:54.942321] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-10-17T22:15:56.425389] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T22:15:56.431210] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-10. [2025-10-17T22:15:57.604702] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T22:15:57.607771] [INFO ] [REMOTE ] VNCE: Full fetch complete (15205 records). [2025-10-17T22:15:57.607883] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-10-17T22:15:57.977078] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-10-17T22:15:57.977158] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-10-17T22:15:57.977526] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-10-17T22:15:57.977567] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-10-17T22:15:57.978178] [DEBUG] [LOCAL ] VNCE: Trimmed 15205 records to 9180 (keeping 200 days of data) [2025-10-17T22:15:58.029960] [DEBUG] [LOCAL ] VNCE: Primary data saved (9180 records). [2025-10-17T22:15:58.030095] [INFO ] [MAIN ] VNCE: Full history saved. [2025-10-17T22:15:58.030181] [INFO ] [MAIN ] Update Progress: 2240/2368 symbols completed. VNCE took 18.5s. Estimated remaining: 18m 3s. Rate: 7.1 symbols/min [2025-10-17T22:15:58.698930] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:15:58.755203] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:15:58.737061] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:15:58.759349] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:15:58.773349] [DEBUG] [LOCAL ] VOC: Loaded 9054 existing records from primary storage. [2025-10-17T22:15:58.773695] [INFO ] [MAIN ] VOC: Loaded 9054 existing records. [2025-10-17T22:15:59.010493] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:15:59.025342] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-17T22:15:59.025457] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-17T22:15:59.025033] [DEBUG] [LOCAL ] VOYA: Loaded 42544 existing records from primary storage. [2025-10-17T22:15:59.027911] [INFO ] [MAIN ] VOYA: Loaded 42544 existing records. [2025-10-17T22:15:59.050575] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-17T22:15:59.033974] [DEBUG] [LOCAL ] VNO: Loaded 49317 existing records from primary storage. [2025-10-17T22:15:59.061292] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-17T22:15:59.115814] [DEBUG] [LOCAL ] VNT: Loaded 44321 existing records from primary storage. [2025-10-17T22:15:59.115188] [INFO ] [MAIN ] VNO: Loaded 49317 existing records. [2025-10-17T22:15:59.160467] [INFO ] [MAIN ] VNT: Loaded 44321 existing records. [2025-10-17T22:15:59.590279] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:15:59.663757] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-17T22:15:59.763674] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-17T22:15:59.835788] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-17T22:15:59.868259] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:15:59.864355] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:15:59.879110] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-17T22:15:59.873685] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-17T22:15:59.884506] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-17T22:15:59.884659] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-17T22:15:59.884764] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-17T22:15:59.898857] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-17T22:15:59.924979] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-17T22:15:59.925108] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-17T22:15:59.930299] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-17T22:16:00.359894] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:16:00.363358] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-10-17T22:16:01.149354] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:16:01.165564] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-10-17T22:16:01.191920] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:16:01.201618] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-10-17T22:16:01.234345] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:16:01.235206] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-10-17T22:16:01.389192] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-17T22:16:01.392482] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-17T22:16:02.175392] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-17T22:16:02.178095] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-17T22:16:02.746275] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T22:16:02.776417] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-17T22:16:02.786161] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-17T22:16:02.792345] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T22:16:02.790920] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-17T22:16:02.840024] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-17T22:16:02.942283] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-17T22:16:03.592881] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-17T22:16:03.742307] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-17T22:16:04.425388] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T22:16:04.542299] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-17T22:16:04.575338] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-17T22:16:04.715475] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T22:16:05.342277] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-17T22:16:05.996884] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-17T22:16:06.142343] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-17T22:16:06.225228] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-17T22:16:06.942345] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-17T22:16:07.695062] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T22:16:07.742275] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-17T22:16:08.542345] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-17T22:16:08.620714] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T22:16:09.342353] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-17T22:16:09.474260] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-17T22:16:09.506272] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T22:16:10.142317] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-17T22:16:10.928450] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T22:16:10.942248] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-17T22:16:11.742330] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-17T22:16:11.804278] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T22:16:11.849364] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-17T22:16:12.542325] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-17T22:16:13.262365] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T22:16:13.342268] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-17T22:16:13.890437] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-17T22:16:14.142268] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-17T22:16:14.942302] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-17T22:16:15.000278] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T22:16:15.647763] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-17T22:16:15.701472] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T22:16:15.742256] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-17T22:16:16.542293] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-17T22:16:16.561401] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T22:16:17.342338] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-17T22:16:18.057158] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T22:16:18.056982] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T22:16:18.066869] [INFO ] [REMOTE ] VOC: Full fetch complete (13156 records). [2025-10-17T22:16:18.067147] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-17T22:16:18.147469] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-17T22:16:18.423476] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-17T22:16:18.423550] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-17T22:16:18.423857] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-17T22:16:18.423918] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-17T22:16:18.424357] [DEBUG] [LOCAL ] VOC: Trimmed 13156 records to 9096 (keeping 200 days of data) [2025-10-17T22:16:18.476585] [DEBUG] [LOCAL ] VOC: Primary data saved (9096 records). [2025-10-17T22:16:18.476750] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-17T22:16:18.476841] [INFO ] [MAIN ] Update Progress: 2241/2368 symbols completed. VOC took 20.4s. Estimated remaining: 17m 55s. Rate: 7.1 symbols/min [2025-10-17T22:16:18.656621] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:16:18.656824] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-17T22:16:18.656876] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-17T22:16:18.657015] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-17T22:16:18.657056] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-17T22:16:18.657097] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-17T22:16:18.657129] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-17T22:16:18.950771] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-17T22:16:19.041677] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:16:19.742276] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-10-17T22:16:19.903338] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T22:16:19.942605] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T22:16:19.942946] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-10-17T22:16:19.943072] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T22:16:19.943155] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-17T22:16:19.943237] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T22:16:19.943350] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-17T22:16:19.943427] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-17T22:16:19.943464] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-17T22:16:19.943502] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-17T22:16:19.943546] [INFO ] [MAIN ] Update Progress: 2242/2368 symbols completed. VOYG took 1.5s. Estimated remaining: 17m 46s. Rate: 7.1 symbols/min [2025-10-17T22:16:20.108720] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:16:20.126158] [DEBUG] [LOCAL ] VPG: Loaded 17336 existing records from primary storage. [2025-10-17T22:16:20.126390] [INFO ] [MAIN ] VPG: Loaded 17336 existing records. [2025-10-17T22:16:20.298750] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:16:20.298985] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-17T22:16:20.299042] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-17T22:16:20.299199] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-17T22:16:20.299237] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-17T22:16:20.545180] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-17T22:16:20.655222] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:16:20.761788] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-17T22:16:21.342299] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-17T22:16:22.142306] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-17T22:16:22.226080] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T22:16:22.424773] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-17T22:16:22.942343] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-17T22:16:23.742309] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-10-17T22:16:23.840314] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T22:16:24.542266] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-17T22:16:24.587165] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-17T22:16:24.775956] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-17T22:16:25.342275] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-17T22:16:25.979085] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T22:16:26.032659] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-17T22:16:26.142277] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-17T22:16:26.940315] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T22:16:26.943121] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-17T22:16:27.742321] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-17T22:16:28.542344] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-17T22:16:28.587381] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-17T22:16:28.632576] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-17T22:16:29.342317] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-17T22:16:29.898462] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T22:16:30.142326] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-17T22:16:30.878336] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T22:16:30.942278] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-17T22:16:31.327902] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-17T22:16:31.742296] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-17T22:16:32.553050] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-17T22:16:32.556097] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T22:16:32.855280] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-17T22:16:33.342303] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-17T22:16:33.921695] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-17T22:16:34.142400] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-17T22:16:34.806611] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T22:16:34.813912] [INFO ] [REMOTE ] VNT: Full fetch complete (64237 records). [2025-10-17T22:16:34.814093] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-17T22:16:34.947397] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-17T22:16:35.235183] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-17T22:16:35.235272] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-17T22:16:35.236534] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-17T22:16:35.236603] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-17T22:16:35.238026] [DEBUG] [LOCAL ] VNT: Trimmed 64237 records to 44708 (keeping 200 days of data) [2025-10-17T22:16:35.523296] [DEBUG] [LOCAL ] VNT: Primary data saved (44708 records). [2025-10-17T22:16:35.523695] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-17T22:16:35.523795] [INFO ] [MAIN ] Update Progress: 2243/2368 symbols completed. VNT took 37.5s. Estimated remaining: 17m 38s. Rate: 7.1 symbols/min [2025-10-17T22:16:35.690546] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:16:35.706435] [DEBUG] [LOCAL ] VPV: Loaded 5476 existing records from primary storage. [2025-10-17T22:16:35.706612] [INFO ] [MAIN ] VPV: Loaded 5476 existing records. [2025-10-17T22:16:35.747959] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-17T22:16:35.885772] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:16:35.886064] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-17T22:16:35.886128] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-17T22:16:35.886730] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-17T22:16:35.886806] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-17T22:16:36.091710] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-17T22:16:36.289420] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:16:36.542277] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-17T22:16:36.628883] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T22:16:36.818480] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-17T22:16:37.342296] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-17T22:16:37.870570] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T22:16:37.877118] [INFO ] [REMOTE ] VNO: Full fetch complete (70617 records). [2025-10-17T22:16:37.877227] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-17T22:16:38.143008] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-10-17T22:16:38.268296] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-17T22:16:38.268384] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-17T22:16:38.269616] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-17T22:16:38.269704] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-17T22:16:38.271179] [DEBUG] [LOCAL ] VNO: Trimmed 70617 records to 49695 (keeping 200 days of data) [2025-10-17T22:16:38.367507] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-17T22:16:38.574734] [DEBUG] [LOCAL ] VNO: Primary data saved (49695 records). [2025-10-17T22:16:38.574867] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-17T22:16:38.574948] [INFO ] [MAIN ] Update Progress: 2244/2368 symbols completed. VNO took 40.5s. Estimated remaining: 17m 30s. Rate: 7.1 symbols/min [2025-10-17T22:16:38.742321] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:16:38.803682] [DEBUG] [LOCAL ] VRE: Loaded 35522 existing records from primary storage. [2025-10-17T22:16:38.803962] [INFO ] [MAIN ] VRE: Loaded 35522 existing records. [2025-10-17T22:16:38.950383] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-17T22:16:38.989367] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-17T22:16:38.988857] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:16:38.992811] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-17T22:16:38.992865] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-17T22:16:38.993066] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-17T22:16:38.993121] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-17T22:16:39.342514] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:16:39.742288] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-10-17T22:16:39.923904] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-17T22:16:40.542337] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-17T22:16:40.975311] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-17T22:16:41.342294] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-17T22:16:41.406189] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-17T22:16:42.142291] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-17T22:16:42.683298] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T22:16:42.942316] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-17T22:16:43.157917] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-17T22:16:43.163796] [INFO ] [REMOTE ] VOYA: Full fetch complete (61835 records). [2025-10-17T22:16:43.163911] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-17T22:16:43.564325] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-17T22:16:43.564424] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-17T22:16:43.565523] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-17T22:16:43.565586] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-17T22:16:43.566817] [DEBUG] [LOCAL ] VOYA: Trimmed 61835 records to 42815 (keeping 200 days of data) [2025-10-17T22:16:43.750169] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-17T22:16:43.830275] [DEBUG] [LOCAL ] VOYA: Primary data saved (42815 records). [2025-10-17T22:16:43.830422] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-17T22:16:43.830505] [INFO ] [MAIN ] Update Progress: 2245/2368 symbols completed. VOYA took 45.8s. Estimated remaining: 17m 21s. Rate: 7.1 symbols/min [2025-10-17T22:16:43.938847] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T22:16:43.952687] [INFO ] [REMOTE ] VPG: Full fetch complete (22973 records). [2025-10-17T22:16:43.968274] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-17T22:16:44.083737] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:16:44.430201] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-17T22:16:44.431360] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-17T22:16:44.432034] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-17T22:16:44.432142] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-17T22:16:44.433072] [DEBUG] [LOCAL ] VRT: Loaded 54143 existing records from primary storage. [2025-10-17T22:16:44.433862] [INFO ] [MAIN ] VRT: Loaded 54143 existing records. [2025-10-17T22:16:44.464834] [DEBUG] [LOCAL ] VPG: Trimmed 22973 records to 17444 (keeping 200 days of data) [2025-10-17T22:16:44.603874] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-17T22:16:44.643614] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-17T22:16:44.709018] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:16:44.710488] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-17T22:16:44.712846] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-17T22:16:44.714510] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-17T22:16:44.714912] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-17T22:16:44.841869] [DEBUG] [LOCAL ] VPG: Primary data saved (17444 records). [2025-10-17T22:16:44.852326] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-17T22:16:44.852484] [INFO ] [MAIN ] Update Progress: 2246/2368 symbols completed. VPG took 24.9s. Estimated remaining: 17m 12s. Rate: 7.1 symbols/min [2025-10-17T22:16:45.221792] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:16:45.263512] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:16:45.273414] [DEBUG] [LOCAL ] VRTS: Loaded 9431 existing records from primary storage. [2025-10-17T22:16:45.273635] [INFO ] [MAIN ] VRTS: Loaded 9431 existing records. [2025-10-17T22:16:45.347477] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-17T22:16:45.463626] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:16:45.463845] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-17T22:16:45.463906] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-17T22:16:45.464056] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-17T22:16:45.464093] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-17T22:16:45.807770] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:16:45.833489] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T22:16:45.896564] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-17T22:16:46.142274] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-17T22:16:46.942258] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-10-17T22:16:47.429941] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-17T22:16:47.742289] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-17T22:16:48.542288] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-17T22:16:49.194126] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-17T22:16:49.301040] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-17T22:16:49.332243] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-17T22:16:49.343114] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-17T22:16:50.142300] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-10-17T22:16:50.767330] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-17T22:16:50.942293] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-17T22:16:51.620038] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T22:16:51.669334] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-17T22:16:51.742320] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-17T22:16:52.379050] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-17T22:16:52.542269] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-17T22:16:53.342340] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-17T22:16:54.083296] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-17T22:16:54.142262] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-17T22:16:54.942267] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-17T22:16:55.072262] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-17T22:16:55.547569] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T22:16:55.662551] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-17T22:16:55.742255] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-17T22:16:56.542322] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-17T22:16:56.764812] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-17T22:16:57.342334] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-17T22:16:58.142309] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-17T22:16:58.675676] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-17T22:16:58.787371] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-17T22:16:58.947423] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-17T22:16:58.968555] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-17T22:16:59.742300] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-17T22:17:00.437829] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-17T22:17:00.455250] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-17T22:17:00.542278] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-17T22:17:01.342361] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-17T22:17:01.958738] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T22:17:02.142282] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-17T22:17:02.443111] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-17T22:17:02.942312] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-17T22:17:03.666201] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T22:17:03.742313] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-17T22:17:04.539287] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-17T22:17:04.542279] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-17T22:17:05.270902] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-17T22:17:05.342275] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-17T22:17:05.394475] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T22:17:06.142292] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-17T22:17:06.740190] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-17T22:17:06.942294] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-17T22:17:07.545165] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T22:17:07.742281] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-17T22:17:07.890520] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-17T22:17:08.462795] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T22:17:08.464471] [INFO ] [REMOTE ] VRTS: Full fetch complete (11668 records). [2025-10-17T22:17:08.464575] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-17T22:17:08.547394] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-17T22:17:08.872829] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-17T22:17:08.872948] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-17T22:17:08.873301] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-17T22:17:08.873346] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-17T22:17:08.873884] [DEBUG] [LOCAL ] VRTS: Trimmed 11668 records to 9481 (keeping 200 days of data) [2025-10-17T22:17:08.938766] [DEBUG] [LOCAL ] VRTS: Primary data saved (9481 records). [2025-10-17T22:17:08.938908] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-17T22:17:08.939022] [INFO ] [MAIN ] Update Progress: 2247/2368 symbols completed. VRTS took 24.1s. Estimated remaining: 17m 4s. Rate: 7.1 symbols/min [2025-10-17T22:17:09.127223] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:17:09.183903] [DEBUG] [LOCAL ] VSCO: Loaded 53126 existing records from primary storage. [2025-10-17T22:17:09.184266] [INFO ] [MAIN ] VSCO: Loaded 53126 existing records. [2025-10-17T22:17:09.347540] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-17T22:17:09.393248] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:17:09.393814] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-17T22:17:09.393890] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-17T22:17:09.394171] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-17T22:17:09.394229] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-17T22:17:09.793025] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:17:09.985978] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T22:17:09.991289] [INFO ] [REMOTE ] VRE: Full fetch complete (48590 records). [2025-10-17T22:17:09.991421] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-17T22:17:10.146873] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-17T22:17:10.365320] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-17T22:17:10.365404] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-17T22:17:10.366382] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-17T22:17:10.366468] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-17T22:17:10.367557] [DEBUG] [LOCAL ] VRE: Trimmed 48590 records to 35807 (keeping 200 days of data) [2025-10-17T22:17:10.589598] [DEBUG] [LOCAL ] VRE: Primary data saved (35807 records). [2025-10-17T22:17:10.589780] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-17T22:17:10.589916] [INFO ] [MAIN ] Update Progress: 2248/2368 symbols completed. VRE took 32.0s. Estimated remaining: 16m 56s. Rate: 7.1 symbols/min [2025-10-17T22:17:10.787985] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:17:10.789153] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-17T22:17:10.844354] [DEBUG] [LOCAL ] VSH: Loaded 48605 existing records from primary storage. [2025-10-17T22:17:10.844957] [INFO ] [MAIN ] VSH: Loaded 48605 existing records. [2025-10-17T22:17:10.949241] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-10-17T22:17:11.039735] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:17:11.040036] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-17T22:17:11.040089] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-17T22:17:11.040331] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-17T22:17:11.040373] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-17T22:17:11.409131] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:17:11.742302] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-10-17T22:17:11.873444] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-17T22:17:12.542322] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-17T22:17:12.858706] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-17T22:17:12.968327] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-17T22:17:13.342307] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-17T22:17:14.142306] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-17T22:17:14.744398] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-17T22:17:14.942335] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-17T22:17:15.092205] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T22:17:15.158019] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-17T22:17:15.405861] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-17T22:17:15.742304] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-17T22:17:16.542330] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-17T22:17:17.218143] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T22:17:17.219877] [INFO ] [REMOTE ] VPV: Full fetch complete (8976 records). [2025-10-17T22:17:17.219952] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-17T22:17:17.345728] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-17T22:17:17.641429] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-17T22:17:17.679912] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-17T22:17:17.680341] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-17T22:17:17.680627] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-17T22:17:17.680716] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-17T22:17:17.681353] [DEBUG] [LOCAL ] VPV: Trimmed 8976 records to 5502 (keeping 200 days of data) [2025-10-17T22:17:17.717738] [DEBUG] [LOCAL ] VPV: Primary data saved (5502 records). [2025-10-17T22:17:17.717900] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-17T22:17:17.717993] [INFO ] [MAIN ] Update Progress: 2249/2368 symbols completed. VPV took 42.2s. Estimated remaining: 16m 47s. Rate: 7.1 symbols/min [2025-10-17T22:17:17.890557] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:17:17.948969] [DEBUG] [LOCAL ] VST: Loaded 54101 existing records from primary storage. [2025-10-17T22:17:17.949389] [INFO ] [MAIN ] VST: Loaded 54101 existing records. [2025-10-17T22:17:18.129355] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:17:18.129566] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-17T22:17:18.129615] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-17T22:17:18.129832] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-17T22:17:18.129902] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-17T22:17:18.150736] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-17T22:17:18.502592] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:17:18.942352] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-10-17T22:17:19.742287] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-17T22:17:19.893065] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T22:17:19.982273] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-17T22:17:20.542308] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-17T22:17:21.326552] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T22:17:21.342246] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-17T22:17:21.435374] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-17T22:17:22.142343] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-17T22:17:22.859346] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T22:17:22.942332] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-17T22:17:23.059714] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-17T22:17:23.313406] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T22:17:23.742317] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-17T22:17:24.542302] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-17T22:17:25.283366] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-17T22:17:25.342245] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-10-17T22:17:25.884177] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T22:17:26.142293] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-17T22:17:26.243861] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-17T22:17:26.251271] [INFO ] [REMOTE ] VRT: Full fetch complete (77932 records). [2025-10-17T22:17:26.251406] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-17T22:17:26.673177] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-17T22:17:26.673292] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-17T22:17:26.674740] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-17T22:17:26.674821] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-17T22:17:26.676553] [DEBUG] [LOCAL ] VRT: Trimmed 77932 records to 54533 (keeping 200 days of data) [2025-10-17T22:17:26.971238] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-17T22:17:27.161324] [DEBUG] [LOCAL ] VRT: Primary data saved (54533 records). [2025-10-17T22:17:27.161511] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-17T22:17:27.161620] [INFO ] [MAIN ] Update Progress: 2250/2368 symbols completed. VRT took 43.3s. Estimated remaining: 16m 39s. Rate: 7.1 symbols/min [2025-10-17T22:17:27.455695] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:17:27.509046] [DEBUG] [LOCAL ] VSTS: Loaded 49292 existing records from primary storage. [2025-10-17T22:17:27.509394] [INFO ] [MAIN ] VSTS: Loaded 49292 existing records. [2025-10-17T22:17:27.713017] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:17:27.713561] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-17T22:17:27.713683] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-17T22:17:27.714111] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-17T22:17:27.714191] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-17T22:17:28.084025] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:17:28.084482] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-10-17T22:17:28.140717] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-10-17T22:17:28.142626] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-17T22:17:28.421935] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T22:17:28.542327] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-17T22:17:29.342330] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-10-17T22:17:29.784529] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T22:17:29.967120] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-17T22:17:30.142319] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-17T22:17:30.942310] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-17T22:17:31.473874] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-17T22:17:31.590870] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-17T22:17:31.742273] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-10-17T22:17:32.503309] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T22:17:32.542284] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-17T22:17:33.342328] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-17T22:17:34.094504] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T22:17:34.142301] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-17T22:17:34.306088] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-17T22:17:34.942306] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-10-17T22:17:35.066558] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T22:17:35.742308] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-17T22:17:35.813556] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-17T22:17:36.542355] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-17T22:17:37.288725] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-17T22:17:37.342299] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-10-17T22:17:37.628484] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T22:17:38.142363] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-17T22:17:38.205593] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T22:17:38.942346] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-10-17T22:17:39.745545] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-17T22:17:39.742353] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-17T22:17:39.794803] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T22:17:40.391026] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T22:17:40.542307] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-17T22:17:41.197040] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-17T22:17:41.342303] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-17T22:17:42.142359] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-10-17T22:17:42.255314] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T22:17:42.942348] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-10-17T22:17:43.133915] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T22:17:43.742358] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-17T22:17:44.542283] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-17T22:17:44.654549] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T22:17:44.697165] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-17T22:17:45.282485] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T22:17:45.342266] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-17T22:17:46.142257] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-10-17T22:17:46.307510] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-17T22:17:46.314817] [INFO ] [REMOTE ] VSCO: Full fetch complete (76443 records). [2025-10-17T22:17:46.314947] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-17T22:17:46.701251] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-17T22:17:46.701332] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-17T22:17:46.702548] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-17T22:17:46.702612] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-17T22:17:46.704180] [DEBUG] [LOCAL ] VSCO: Trimmed 76443 records to 53511 (keeping 200 days of data) [2025-10-17T22:17:46.936855] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-17T22:17:46.946086] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-10-17T22:17:46.948091] [INFO ] [REMOTE ] VSH: Full fetch complete (70914 records). [2025-10-17T22:17:46.948703] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-17T22:17:47.267218] [DEBUG] [LOCAL ] VSCO: Primary data saved (53511 records). [2025-10-17T22:17:47.300489] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-17T22:17:47.311585] [INFO ] [MAIN ] Update Progress: 2251/2368 symbols completed. VSCO took 38.4s. Estimated remaining: 16m 31s. Rate: 7.1 symbols/min [2025-10-17T22:17:47.628480] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:17:47.645884] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-17T22:17:47.645941] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-17T22:17:47.647101] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-17T22:17:47.647250] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-17T22:17:47.648982] [DEBUG] [LOCAL ] VSH: Trimmed 70914 records to 48966 (keeping 200 days of data) [2025-10-17T22:17:47.781535] [DEBUG] [LOCAL ] VTEX: Loaded 43293 existing records from primary storage. [2025-10-17T22:17:47.783588] [INFO ] [MAIN ] VTEX: Loaded 43293 existing records. [2025-10-17T22:17:47.969951] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:17:47.973432] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-17T22:17:47.973554] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-17T22:17:47.973830] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-17T22:17:47.973887] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-17T22:17:48.438058] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:17:48.439891] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-10-17T22:17:48.511781] [DEBUG] [LOCAL ] VSH: Primary data saved (48966 records). [2025-10-17T22:17:48.512125] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-17T22:17:48.513226] [INFO ] [MAIN ] Update Progress: 2252/2368 symbols completed. VSH took 37.9s. Estimated remaining: 16m 22s. Rate: 7.1 symbols/min [2025-10-17T22:17:48.714875] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-17T22:17:48.717370] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:17:48.730241] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-10-17T22:17:48.768251] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T22:17:48.826347] [DEBUG] [LOCAL ] VTLE: Loaded 48338 existing records from primary storage. [2025-10-17T22:17:48.826889] [INFO ] [MAIN ] VTLE: Loaded 48338 existing records. [2025-10-17T22:17:49.001998] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:17:49.002295] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-17T22:17:49.002350] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-17T22:17:49.002536] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-17T22:17:49.002576] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-17T22:17:49.349542] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:17:49.349705] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-10-17T22:17:49.969545] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T22:17:50.142265] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-17T22:17:50.951856] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-10-17T22:17:50.965935] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-17T22:17:51.015774] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T22:17:51.172032] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-17T22:17:51.742309] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-10. [2025-10-17T22:17:52.498102] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-17T22:17:52.505761] [INFO ] [REMOTE ] VST: Full fetch complete (77888 records). [2025-10-17T22:17:52.505877] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-17T22:17:52.547460] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-10-17T22:17:52.838887] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-17T22:17:52.941575] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-17T22:17:52.941672] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-17T22:17:52.942915] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-17T22:17:52.942978] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-17T22:17:52.944457] [DEBUG] [LOCAL ] VST: Trimmed 77888 records to 54489 (keeping 200 days of data) [2025-10-17T22:17:53.282393] [DEBUG] [LOCAL ] VST: Primary data saved (54489 records). [2025-10-17T22:17:53.282533] [INFO ] [MAIN ] VST: Full history saved. [2025-10-17T22:17:53.283237] [INFO ] [MAIN ] Update Progress: 2253/2368 symbols completed. VST took 35.6s. Estimated remaining: 16m 13s. Rate: 7.1 symbols/min [2025-10-17T22:17:53.347527] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-17T22:17:53.452817] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:17:53.472310] [DEBUG] [LOCAL ] VTMX: Loaded 17721 existing records from primary storage. [2025-10-17T22:17:53.472555] [INFO ] [MAIN ] VTMX: Loaded 17721 existing records. [2025-10-17T22:17:53.654309] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:17:53.654549] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-17T22:17:53.654598] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-17T22:17:53.654811] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-17T22:17:53.654867] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-17T22:17:54.000512] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:17:54.142288] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-10-17T22:17:54.258638] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-17T22:17:54.351789] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T22:17:54.799283] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-17T22:17:54.942301] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-17T22:17:55.742298] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-17T22:17:56.546101] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-10. [2025-10-17T22:17:56.551328] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-17T22:17:57.317180] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T22:17:57.342262] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-17T22:17:57.776036] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-17T22:17:57.782673] [INFO ] [REMOTE ] VSTS: Full fetch complete (69759 records). [2025-10-17T22:17:57.782797] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-17T22:17:58.149903] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-17T22:17:58.174667] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-17T22:17:58.174776] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-17T22:17:58.176323] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-17T22:17:58.176391] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-17T22:17:58.177996] [DEBUG] [LOCAL ] VSTS: Trimmed 69759 records to 49618 (keeping 200 days of data) [2025-10-17T22:17:58.431179] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-17T22:17:58.499003] [DEBUG] [LOCAL ] VSTS: Primary data saved (49618 records). [2025-10-17T22:17:58.499158] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-17T22:17:58.499247] [INFO ] [MAIN ] Update Progress: 2254/2368 symbols completed. VSTS took 31.3s. Estimated remaining: 16m 5s. Rate: 7.1 symbols/min [2025-10-17T22:17:58.668288] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:17:58.677383] [DEBUG] [LOCAL ] VTN: Loaded 7094 existing records from primary storage. [2025-10-17T22:17:58.677571] [INFO ] [MAIN ] VTN: Loaded 7094 existing records. [2025-10-17T22:17:58.851723] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:17:58.851921] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-17T22:17:58.851968] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-17T22:17:58.852107] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-17T22:17:58.852145] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-17T22:17:58.948869] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-17T22:17:59.202173] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:17:59.707907] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T22:17:59.742253] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-17T22:18:00.136638] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-17T22:18:00.542287] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-17T22:18:01.342284] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-17T22:18:01.743788] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-17T22:18:01.771055] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T22:18:02.142306] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-10-17T22:18:02.942273] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-17T22:18:02.989729] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-17T22:18:03.007333] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T22:18:03.742287] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-17T22:18:04.491039] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T22:18:04.542243] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-17T22:18:04.699733] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T22:18:04.970009] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-17T22:18:05.342342] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-17T22:18:06.058621] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-17T22:18:06.142273] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-17T22:18:06.937552] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-17T22:18:06.942244] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-17T22:18:07.642516] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-17T22:18:07.742338] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-17T22:18:08.542359] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-17T22:18:09.003543] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-17T22:18:09.342344] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-17T22:18:09.552066] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T22:18:10.142316] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-17T22:18:10.791849] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-17T22:18:10.942258] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-17T22:18:11.206036] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-17T22:18:11.666351] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-17T22:18:11.742327] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-17T22:18:12.542321] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-17T22:18:13.281874] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-17T22:18:13.343112] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-17T22:18:13.350382] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T22:18:14.096922] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-17T22:18:14.142262] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-17T22:18:14.942281] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-17T22:18:15.700499] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T22:18:15.742258] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-17T22:18:16.059273] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-17T22:18:16.542316] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-17T22:18:17.312022] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T22:18:17.347462] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-17T22:18:17.350719] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-17T22:18:18.142323] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-17T22:18:18.942289] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-17T22:18:18.944874] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T22:18:19.640975] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-17T22:18:19.644046] [INFO ] [REMOTE ] VTN: Full fetch complete (10785 records). [2025-10-17T22:18:19.644260] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-17T22:18:19.749149] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-17T22:18:20.120361] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-17T22:18:20.152632] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-17T22:18:20.153381] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-17T22:18:20.153798] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-17T22:18:20.154033] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-17T22:18:20.155367] [DEBUG] [LOCAL ] VTN: Trimmed 10785 records to 7166 (keeping 200 days of data) [2025-10-17T22:18:20.204722] [DEBUG] [LOCAL ] VTN: Primary data saved (7166 records). [2025-10-17T22:18:20.204882] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-17T22:18:20.205010] [INFO ] [MAIN ] Update Progress: 2255/2368 symbols completed. VTN took 21.7s. Estimated remaining: 15m 57s. Rate: 7.1 symbols/min [2025-10-17T22:18:20.376333] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:18:20.395610] [DEBUG] [LOCAL ] VTOL: Loaded 19752 existing records from primary storage. [2025-10-17T22:18:20.395899] [INFO ] [MAIN ] VTOL: Loaded 19752 existing records. [2025-10-17T22:18:20.547815] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-17T22:18:20.579738] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:18:20.579923] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-17T22:18:20.580004] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-17T22:18:20.580198] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-17T22:18:20.580256] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-17T22:18:20.938139] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:18:21.279619] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-17T22:18:21.285476] [INFO ] [REMOTE ] VTEX: Full fetch complete (60831 records). [2025-10-17T22:18:21.285583] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-17T22:18:21.349593] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-17T22:18:21.670986] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-17T22:18:21.671066] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-17T22:18:21.672182] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-17T22:18:21.672244] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-17T22:18:21.673493] [DEBUG] [LOCAL ] VTEX: Trimmed 60831 records to 43610 (keeping 200 days of data) [2025-10-17T22:18:21.917634] [DEBUG] [LOCAL ] VTEX: Primary data saved (43610 records). [2025-10-17T22:18:21.917875] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-17T22:18:21.918006] [INFO ] [MAIN ] Update Progress: 2256/2368 symbols completed. VTEX took 34.6s. Estimated remaining: 15m 48s. Rate: 7.1 symbols/min [2025-10-17T22:18:22.088093] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:18:22.119343] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-17T22:18:22.151279] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-17T22:18:22.172732] [DEBUG] [LOCAL ] VTR: Loaded 53155 existing records from primary storage. [2025-10-17T22:18:22.173047] [INFO ] [MAIN ] VTR: Loaded 53155 existing records. [2025-10-17T22:18:22.347803] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:18:22.348004] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-17T22:18:22.348055] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-17T22:18:22.348433] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-17T22:18:22.348493] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-17T22:18:22.583473] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-17T22:18:22.722830] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:18:22.942287] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-10-17T22:18:23.727897] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-17T22:18:23.742243] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-17T22:18:23.896985] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T22:18:24.542319] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-10-17T22:18:25.212552] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-17T22:18:25.218461] [INFO ] [REMOTE ] VTLE: Full fetch complete (68642 records). [2025-10-17T22:18:25.218603] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-17T22:18:25.355338] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-17T22:18:25.615821] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-17T22:18:25.615910] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-17T22:18:25.617368] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-17T22:18:25.617512] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-17T22:18:25.622532] [DEBUG] [LOCAL ] VTLE: Trimmed 68642 records to 48615 (keeping 200 days of data) [2025-10-17T22:18:25.938139] [DEBUG] [LOCAL ] VTLE: Primary data saved (48615 records). [2025-10-17T22:18:25.938281] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-17T22:18:25.938369] [INFO ] [MAIN ] Update Progress: 2257/2368 symbols completed. VTLE took 37.4s. Estimated remaining: 15m 39s. Rate: 7.1 symbols/min [2025-10-17T22:18:26.125008] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:18:26.142564] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-17T22:18:26.158381] [DEBUG] [LOCAL ] VTS: Loaded 30212 existing records from primary storage. [2025-10-17T22:18:26.158752] [INFO ] [MAIN ] VTS: Loaded 30212 existing records. [2025-10-17T22:18:26.362837] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:18:26.363328] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-17T22:18:26.363528] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-17T22:18:26.374844] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-17T22:18:26.374958] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-17T22:18:26.465156] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-17T22:18:26.481674] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T22:18:26.787004] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:18:26.942331] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-10-17T22:18:27.033143] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-17T22:18:27.742268] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-17T22:18:27.903428] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-17T22:18:28.542351] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-17T22:18:29.342278] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-17T22:18:29.362040] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-17T22:18:29.453124] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-17T22:18:30.142264] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-17T22:18:30.287224] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T22:18:30.942335] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-17T22:18:31.742269] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-17T22:18:31.847432] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T22:18:31.957280] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T22:18:32.542308] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-17T22:18:32.894132] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T22:18:33.342339] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-17T22:18:34.142355] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-17T22:18:34.420437] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-17T22:18:34.443038] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-17T22:18:34.942335] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-17T22:18:35.040913] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-17T22:18:35.044411] [INFO ] [REMOTE ] VTMX: Full fetch complete (25621 records). [2025-10-17T22:18:35.044616] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-17T22:18:35.428137] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-17T22:18:35.428259] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-17T22:18:35.429201] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-17T22:18:35.429315] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-17T22:18:35.430551] [DEBUG] [LOCAL ] VTMX: Trimmed 25621 records to 17871 (keeping 200 days of data) [2025-10-17T22:18:35.549440] [DEBUG] [LOCAL ] VTMX: Primary data saved (17871 records). [2025-10-17T22:18:35.549679] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-17T22:18:35.549809] [INFO ] [MAIN ] Update Progress: 2258/2368 symbols completed. VTMX took 42.3s. Estimated remaining: 15m 31s. Rate: 7.1 symbols/min [2025-10-17T22:18:35.725934] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:18:35.749954] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-17T22:18:35.769290] [DEBUG] [LOCAL ] VVR: Loaded 31476 existing records from primary storage. [2025-10-17T22:18:35.769789] [INFO ] [MAIN ] VVR: Loaded 31476 existing records. [2025-10-17T22:18:35.991166] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:18:35.991484] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-17T22:18:35.991565] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-17T22:18:35.991843] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-17T22:18:35.991902] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-17T22:18:36.377184] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:18:36.542316] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-17T22:18:36.785064] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T22:18:36.836281] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-17T22:18:37.342265] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-17T22:18:37.597867] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T22:18:38.142327] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-17T22:18:38.942362] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-17T22:18:39.259607] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T22:18:39.312383] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-17T22:18:39.742352] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-17T22:18:40.309187] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T22:18:40.542274] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-17T22:18:40.631969] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T22:18:41.342270] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-17T22:18:41.965450] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T22:18:42.142308] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-17T22:18:42.391975] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-17T22:18:42.942279] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-17T22:18:43.468289] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-17T22:18:43.742303] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-10-17T22:18:43.902156] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T22:18:44.542293] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-17T22:18:45.052221] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-17T22:18:45.342316] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-17T22:18:46.142288] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-17T22:18:46.244997] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-17T22:18:46.397168] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-17T22:18:46.942275] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-17T22:18:47.544893] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-17T22:18:47.742288] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-17T22:18:48.542332] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-17T22:18:48.551091] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-17T22:18:48.553936] [INFO ] [REMOTE ] VTOL: Full fetch complete (26293 records). [2025-10-17T22:18:48.554013] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-17T22:18:48.962262] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-17T22:18:48.962757] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-17T22:18:48.963893] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-17T22:18:48.964537] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-17T22:18:48.975144] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-17T22:18:48.976462] [DEBUG] [LOCAL ] VTOL: Trimmed 26293 records to 19920 (keeping 200 days of data) [2025-10-17T22:18:49.092467] [DEBUG] [LOCAL ] VTOL: Primary data saved (19920 records). [2025-10-17T22:18:49.092603] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-17T22:18:49.092704] [INFO ] [MAIN ] Update Progress: 2259/2368 symbols completed. VTOL took 28.9s. Estimated remaining: 15m 23s. Rate: 7.1 symbols/min [2025-10-17T22:18:49.259116] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:18:49.305346] [DEBUG] [LOCAL ] VVV: Loaded 50661 existing records from primary storage. [2025-10-17T22:18:49.305710] [INFO ] [MAIN ] VVV: Loaded 50661 existing records. [2025-10-17T22:18:49.348268] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-17T22:18:49.487066] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:18:49.487293] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-17T22:18:49.487342] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-17T22:18:49.488060] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-17T22:18:49.488171] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-17T22:18:49.846832] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:18:49.965905] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T22:18:50.142287] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-10-17T22:18:50.686375] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-17T22:18:50.942342] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-17T22:18:51.754224] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-17T22:18:51.778933] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-17T22:18:52.275479] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-17T22:18:52.542328] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-17T22:18:53.342323] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-17T22:18:53.601941] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-17T22:18:53.870466] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-17T22:18:54.142341] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-17T22:18:54.942334] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-17T22:18:55.061497] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T22:18:55.477113] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-17T22:18:55.742251] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-17T22:18:56.196857] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-17T22:18:56.542290] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-17T22:18:57.342363] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-17T22:18:57.577567] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T22:18:58.065234] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T22:18:58.142299] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-17T22:18:58.780403] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T22:18:58.942291] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-17T22:18:59.438732] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-17T22:18:59.742265] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-17T22:19:00.122929] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T22:19:00.127734] [INFO ] [REMOTE ] VTS: Full fetch complete (41609 records). [2025-10-17T22:19:00.127900] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-17T22:19:00.277273] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-17T22:19:00.329972] [INFO ] [REMOTE ] VTR: Full fetch complete (76496 records). [2025-10-17T22:19:00.330606] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-17T22:19:00.547438] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-17T22:19:00.849746] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-17T22:19:00.857549] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-17T22:19:00.861022] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-17T22:19:00.866762] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-17T22:19:00.938078] [DEBUG] [LOCAL ] VTS: Trimmed 41609 records to 30394 (keeping 200 days of data) [2025-10-17T22:19:00.957817] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-17T22:19:00.958193] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-17T22:19:00.958979] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-17T22:19:00.959089] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-17T22:19:00.960688] [DEBUG] [LOCAL ] VTR: Trimmed 76496 records to 53526 (keeping 200 days of data) [2025-10-17T22:19:01.366286] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-17T22:19:01.403450] [DEBUG] [LOCAL ] VTS: Primary data saved (30394 records). [2025-10-17T22:19:01.404426] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-17T22:19:01.404606] [INFO ] [MAIN ] Update Progress: 2260/2368 symbols completed. VTS took 35.5s. Estimated remaining: 15m 15s. Rate: 7.1 symbols/min [2025-10-17T22:19:01.618177] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:19:01.707511] [DEBUG] [LOCAL ] VVX: Loaded 23115 existing records from primary storage. [2025-10-17T22:19:01.709507] [INFO ] [MAIN ] VVX: Loaded 23115 existing records. [2025-10-17T22:19:01.899241] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:19:01.900320] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-17T22:19:01.900784] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-17T22:19:01.904679] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-17T22:19:01.906823] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-17T22:19:02.077089] [DEBUG] [LOCAL ] VTR: Primary data saved (53526 records). [2025-10-17T22:19:02.095113] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-17T22:19:02.112567] [INFO ] [MAIN ] Update Progress: 2261/2368 symbols completed. VTR took 40.2s. Estimated remaining: 15m 6s. Rate: 7.1 symbols/min [2025-10-17T22:19:02.393407] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:19:02.404514] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-10-17T22:19:02.463839] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:19:02.497768] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-17T22:19:02.545612] [DEBUG] [LOCAL ] VYX: Loaded 48829 existing records from primary storage. [2025-10-17T22:19:02.545942] [INFO ] [MAIN ] VYX: Loaded 48829 existing records. [2025-10-17T22:19:02.741621] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-17T22:19:02.745020] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:19:02.752404] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-17T22:19:02.752773] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-17T22:19:02.753014] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-17T22:19:02.753076] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-17T22:19:02.947482] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-17T22:19:03.100534] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:19:03.687304] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T22:19:03.742241] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-17T22:19:04.330219] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-17T22:19:04.542264] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-10-17T22:19:04.715249] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T22:19:05.342313] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-17T22:19:06.081230] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-17T22:19:06.142266] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-17T22:19:06.338362] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T22:19:06.942294] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-17T22:19:07.679388] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T22:19:07.742253] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-17T22:19:08.542297] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-17T22:19:08.635492] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T22:19:09.293135] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-17T22:19:09.347352] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-17T22:19:09.357185] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-17T22:19:10.142370] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-17T22:19:10.676761] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-17T22:19:10.942290] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-17T22:19:11.751634] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-17T22:19:11.759507] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T22:19:12.426548] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T22:19:12.542342] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-17T22:19:13.019513] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-17T22:19:13.342266] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-17T22:19:13.720065] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-17T22:19:13.725577] [INFO ] [REMOTE ] VVR: Full fetch complete (46890 records). [2025-10-17T22:19:13.725742] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-17T22:19:14.116194] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-17T22:19:14.116291] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-17T22:19:14.117243] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-17T22:19:14.117308] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-17T22:19:14.118487] [DEBUG] [LOCAL ] VVR: Trimmed 46890 records to 31776 (keeping 200 days of data) [2025-10-17T22:19:14.166579] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-17T22:19:14.322600] [DEBUG] [LOCAL ] VVR: Primary data saved (31776 records). [2025-10-17T22:19:14.322817] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-17T22:19:14.322949] [INFO ] [MAIN ] Update Progress: 2262/2368 symbols completed. VVR took 38.8s. Estimated remaining: 14m 57s. Rate: 7.1 symbols/min [2025-10-17T22:19:14.504253] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:19:14.553544] [DEBUG] [LOCAL ] VZ: Loaded 54181 existing records from primary storage. [2025-10-17T22:19:14.553883] [INFO ] [MAIN ] VZ: Loaded 54181 existing records. [2025-10-17T22:19:14.732937] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-17T22:19:14.774182] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:19:14.774584] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-17T22:19:14.774684] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-17T22:19:14.775336] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-17T22:19:14.775394] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-17T22:19:14.947423] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-17T22:19:15.138778] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:19:15.738702] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T22:19:15.748794] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-10-17T22:19:16.170766] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T22:19:16.542330] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-17T22:19:17.342317] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-17T22:19:18.114926] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T22:19:18.148103] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-17T22:19:18.163511] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-17T22:19:18.476144] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T22:19:18.942319] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-17T22:19:19.727458] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T22:19:19.742285] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-17T22:19:20.275867] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-17T22:19:20.542301] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-17T22:19:21.342357] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-17T22:19:22.081290] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-17T22:19:22.142365] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-17T22:19:22.246885] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T22:19:22.526594] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-17T22:19:22.942288] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-17T22:19:23.742353] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-17T22:19:24.249518] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-17T22:19:24.542324] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-17T22:19:24.639287] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T22:19:25.352283] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-17T22:19:25.357731] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T22:19:26.142298] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-17T22:19:26.881213] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T22:19:26.947622] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-17T22:19:26.976761] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-17T22:19:27.303503] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-17T22:19:27.742316] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-17T22:19:28.542320] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-17T22:19:28.584594] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T22:19:29.008584] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-17T22:19:29.342380] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-17T22:19:30.055005] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T22:19:30.061509] [INFO ] [REMOTE ] VYX: Full fetch complete (70237 records). [2025-10-17T22:19:30.061627] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-17T22:19:30.152349] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-17T22:19:30.457132] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-17T22:19:30.457284] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-17T22:19:30.458962] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-17T22:19:30.459111] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-17T22:19:30.460681] [DEBUG] [LOCAL ] VYX: Trimmed 70237 records to 49165 (keeping 200 days of data) [2025-10-17T22:19:30.578677] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-17T22:19:30.586796] [INFO ] [REMOTE ] VVV: Full fetch complete (72598 records). [2025-10-17T22:19:30.587446] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-17T22:19:30.943316] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-17T22:19:31.160085] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-17T22:19:31.161069] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-17T22:19:31.162634] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-17T22:19:31.163026] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-17T22:19:31.168146] [DEBUG] [LOCAL ] VVV: Trimmed 72598 records to 51015 (keeping 200 days of data) [2025-10-17T22:19:31.259525] [DEBUG] [LOCAL ] VYX: Primary data saved (49165 records). [2025-10-17T22:19:31.260265] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-17T22:19:31.260378] [INFO ] [MAIN ] Update Progress: 2263/2368 symbols completed. VYX took 29.1s. Estimated remaining: 14m 49s. Rate: 7.1 symbols/min [2025-10-17T22:19:31.441100] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:19:31.588595] [DEBUG] [LOCAL ] W: Loaded 53825 existing records from primary storage. [2025-10-17T22:19:31.590223] [INFO ] [MAIN ] W: Loaded 53825 existing records. [2025-10-17T22:19:31.877545] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:19:31.878847] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-17T22:19:31.879847] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-17T22:19:31.880204] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-17T22:19:31.881145] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-17T22:19:31.981942] [DEBUG] [LOCAL ] VVV: Primary data saved (51015 records). [2025-10-17T22:19:31.987328] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-17T22:19:31.997934] [INFO ] [MAIN ] Update Progress: 2264/2368 symbols completed. VVV took 42.9s. Estimated remaining: 14m 41s. Rate: 7.1 symbols/min [2025-10-17T22:19:32.397475] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:19:32.477763] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:19:32.484889] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-10-17T22:19:32.498761] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-17T22:19:32.543859] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-17T22:19:32.545609] [DEBUG] [LOCAL ] WAB: Loaded 44289 existing records from primary storage. [2025-10-17T22:19:32.545888] [INFO ] [MAIN ] WAB: Loaded 44289 existing records. [2025-10-17T22:19:32.724388] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:19:32.724730] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-17T22:19:32.724848] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-17T22:19:32.725129] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-17T22:19:32.725213] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-17T22:19:32.859172] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-17T22:19:33.132459] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:19:33.342353] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-10-17T22:19:33.666784] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-17T22:19:33.670131] [INFO ] [REMOTE ] VVX: Full fetch complete (33168 records). [2025-10-17T22:19:33.670243] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-17T22:19:34.065219] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-17T22:19:34.065335] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-17T22:19:34.066203] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-17T22:19:34.066268] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-17T22:19:34.067098] [DEBUG] [LOCAL ] VVX: Trimmed 33168 records to 23319 (keeping 200 days of data) [2025-10-17T22:19:34.153752] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-17T22:19:34.206725] [DEBUG] [LOCAL ] VVX: Primary data saved (23319 records). [2025-10-17T22:19:34.206852] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-17T22:19:34.206959] [INFO ] [MAIN ] Update Progress: 2265/2368 symbols completed. VVX took 32.8s. Estimated remaining: 14m 32s. Rate: 7.1 symbols/min [2025-10-17T22:19:34.377933] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:19:34.419634] [DEBUG] [LOCAL ] WAL: Loaded 45902 existing records from primary storage. [2025-10-17T22:19:34.420062] [INFO ] [MAIN ] WAL: Loaded 45902 existing records. [2025-10-17T22:19:34.604602] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:19:34.605731] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-17T22:19:34.605808] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-17T22:19:34.616550] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-17T22:19:34.635967] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-17T22:19:34.681117] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-17T22:19:34.942977] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-17T22:19:35.008808] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:19:35.104839] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T22:19:35.742276] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-10-17T22:19:36.416284] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-17T22:19:36.542270] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-17T22:19:36.796479] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T22:19:37.342333] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-17T22:19:37.420412] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-17T22:19:38.142286] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-17T22:19:38.753590] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-17T22:19:38.942258] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-17T22:19:39.103078] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T22:19:39.742320] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-17T22:19:39.890555] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-17T22:19:40.542299] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-17T22:19:41.243548] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T22:19:41.342264] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-17T22:19:41.423201] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-17T22:19:42.142281] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-17T22:19:42.218678] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T22:19:42.942264] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-17T22:19:43.049167] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T22:19:43.742298] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-17T22:19:44.415255] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-17T22:19:44.542268] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-17T22:19:44.581820] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T22:19:45.342313] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-17T22:19:45.876719] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-17T22:19:46.142294] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-17T22:19:46.821451] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-17T22:19:46.866066] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-17T22:19:46.942277] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-17T22:19:47.742263] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-17T22:19:47.777019] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T22:19:48.475687] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-17T22:19:48.483694] [INFO ] [REMOTE ] VZ: Full fetch complete (77971 records). [2025-10-17T22:19:48.483865] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-17T22:19:48.548732] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-17T22:19:48.868491] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-17T22:19:48.920419] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-17T22:19:48.920532] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-17T22:19:48.921936] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-17T22:19:48.922039] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-17T22:19:48.924105] [DEBUG] [LOCAL ] VZ: Trimmed 77971 records to 54571 (keeping 200 days of data) [2025-10-17T22:19:49.256719] [DEBUG] [LOCAL ] VZ: Primary data saved (54571 records). [2025-10-17T22:19:49.256873] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-17T22:19:49.257508] [INFO ] [MAIN ] Update Progress: 2266/2368 symbols completed. VZ took 34.9s. Estimated remaining: 14m 24s. Rate: 7.1 symbols/min [2025-10-17T22:19:49.347517] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-17T22:19:49.470191] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:19:49.506355] [DEBUG] [LOCAL ] WAT: Loaded 36136 existing records from primary storage. [2025-10-17T22:19:49.506777] [INFO ] [MAIN ] WAT: Loaded 36136 existing records. [2025-10-17T22:19:49.683778] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:19:49.684060] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-17T22:19:49.684111] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-17T22:19:49.684330] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-17T22:19:49.684391] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-17T22:19:50.035437] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:19:50.142316] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-17T22:19:50.601718] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-17T22:19:50.705172] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T22:19:50.942310] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-17T22:19:51.742353] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-10-17T22:19:51.890610] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T22:19:52.493804] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T22:19:52.542245] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-17T22:19:52.781918] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T22:19:53.342346] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-17T22:19:53.968191] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T22:19:54.142338] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-17T22:19:54.948891] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-17T22:19:54.968975] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-17T22:19:55.742327] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-17T22:19:56.042252] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T22:19:56.542278] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-17T22:19:56.822841] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-17T22:19:57.161198] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T22:19:57.342314] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-17T22:19:58.142322] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-17T22:19:58.405090] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T22:19:58.942267] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-17T22:19:59.163496] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T22:19:59.526576] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-17T22:19:59.742260] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-17T22:20:00.542266] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-17T22:20:00.702523] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T22:20:01.233118] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-17T22:20:01.342265] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-17T22:20:02.142262] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-17T22:20:02.220842] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T22:20:02.942285] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-17T22:20:03.000245] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-17T22:20:03.742276] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-17T22:20:04.155531] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-17T22:20:04.542321] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-17T22:20:04.617941] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T22:20:05.230232] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-17T22:20:05.342298] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-17T22:20:06.142306] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-17T22:20:06.208821] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-17T22:20:06.278729] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-17T22:20:06.942291] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-17T22:20:07.742311] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-17T22:20:07.893420] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T22:20:08.542276] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-17T22:20:08.739259] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T22:20:08.892619] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-17T22:20:08.901294] [INFO ] [REMOTE ] WAB: Full fetch complete (64359 records). [2025-10-17T22:20:08.901455] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-17T22:20:09.343413] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-17T22:20:09.366429] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-17T22:20:09.366540] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-17T22:20:09.367872] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-17T22:20:09.367952] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-17T22:20:09.369260] [DEBUG] [LOCAL ] WAB: Trimmed 64359 records to 44602 (keeping 200 days of data) [2025-10-17T22:20:09.605797] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-17T22:20:09.641149] [INFO ] [REMOTE ] WAL: Full fetch complete (67138 records). [2025-10-17T22:20:09.653844] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-17T22:20:09.796064] [DEBUG] [LOCAL ] WAB: Primary data saved (44602 records). [2025-10-17T22:20:09.799508] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-17T22:20:09.799616] [INFO ] [MAIN ] Update Progress: 2267/2368 symbols completed. WAB took 37.8s. Estimated remaining: 14m 16s. Rate: 7.1 symbols/min [2025-10-17T22:20:10.148899] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-17T22:20:10.171309] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:20:10.171466] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-17T22:20:10.176736] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-17T22:20:10.191812] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-17T22:20:10.196001] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-17T22:20:10.206992] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-17T22:20:10.212260] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-17T22:20:10.376980] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-17T22:20:10.382228] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-17T22:20:10.404600] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-17T22:20:10.404758] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-17T22:20:10.496710] [DEBUG] [LOCAL ] WAL: Trimmed 67138 records to 46291 (keeping 200 days of data) [2025-10-17T22:20:10.916268] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:20:10.944217] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-10-17T22:20:10.993824] [DEBUG] [LOCAL ] WAL: Primary data saved (46291 records). [2025-10-17T22:20:10.994071] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-17T22:20:10.994275] [INFO ] [MAIN ] Update Progress: 2268/2368 symbols completed. WAL took 36.8s. Estimated remaining: 14m 7s. Rate: 7.1 symbols/min [2025-10-17T22:20:11.117402] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T22:20:11.182539] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T22:20:11.200729] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:20:11.200863] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-10-17T22:20:11.201111] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T22:20:11.201484] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-17T22:20:11.201567] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T22:20:11.201680] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-17T22:20:11.201761] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-17T22:20:11.201802] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-17T22:20:11.201842] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-17T22:20:11.201893] [INFO ] [MAIN ] Update Progress: 2269/2368 symbols completed. WBI took 1.4s. Estimated remaining: 13m 58s. Rate: 7.1 symbols/min [2025-10-17T22:20:11.392591] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:20:11.423864] [DEBUG] [LOCAL ] WBS: Loaded 49129 existing records from primary storage. [2025-10-17T22:20:11.424235] [INFO ] [MAIN ] WBS: Loaded 49129 existing records. [2025-10-17T22:20:11.470791] [DEBUG] [LOCAL ] WBX: Loaded 10474 existing records from primary storage. [2025-10-17T22:20:11.497211] [INFO ] [MAIN ] WBX: Loaded 10474 existing records. [2025-10-17T22:20:11.725672] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:20:11.759250] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-17T22:20:11.789634] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:20:11.767778] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-17T22:20:11.789966] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-17T22:20:11.791471] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-17T22:20:11.791572] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-17T22:20:11.791728] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-17T22:20:11.791858] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-17T22:20:11.803229] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-17T22:20:11.810946] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-17T22:20:12.514560] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-17T22:20:12.559337] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:20:12.587354] [INFO ] [REMOTE ] W: Full fetch complete (77530 records). [2025-10-17T22:20:12.635232] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:20:12.628268] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-17T22:20:12.599270] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-10-17T22:20:13.025590] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-17T22:20:13.025712] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-17T22:20:13.027292] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-17T22:20:13.027366] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-17T22:20:13.029006] [DEBUG] [LOCAL ] W: Trimmed 77530 records to 54205 (keeping 200 days of data) [2025-10-17T22:20:13.347726] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-10-17T22:20:13.354535] [DEBUG] [LOCAL ] W: Primary data saved (54205 records). [2025-10-17T22:20:13.355605] [INFO ] [MAIN ] W: Full history saved. [2025-10-17T22:20:13.355853] [INFO ] [MAIN ] Update Progress: 2270/2368 symbols completed. W took 42.1s. Estimated remaining: 13m 49s. Rate: 7.1 symbols/min [2025-10-17T22:20:13.498565] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T22:20:13.553909] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:20:13.591800] [DEBUG] [LOCAL ] WCC: Loaded 39326 existing records from primary storage. [2025-10-17T22:20:13.592087] [INFO ] [MAIN ] WCC: Loaded 39326 existing records. [2025-10-17T22:20:13.761967] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:20:13.762174] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-17T22:20:13.762221] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-17T22:20:13.762400] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-17T22:20:13.762437] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-17T22:20:14.108773] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:20:14.142281] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-10-17T22:20:14.301551] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-17T22:20:14.942341] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-17T22:20:15.010817] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T22:20:15.227383] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T22:20:15.742347] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-17T22:20:16.542256] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-17T22:20:16.659095] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-17T22:20:16.713899] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T22:20:16.758867] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (0.22 seconds). [2025-10-17T22:20:16.764081] [INFO ] [REMOTE ] WAT: Full fetch complete (50658 records). [2025-10-17T22:20:16.764183] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-17T22:20:17.133847] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-17T22:20:17.133923] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-17T22:20:17.134915] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-17T22:20:17.134976] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-17T22:20:17.136077] [DEBUG] [LOCAL ] WAT: Trimmed 50658 records to 36355 (keeping 200 days of data) [2025-10-17T22:20:17.342524] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-17T22:20:17.357871] [DEBUG] [LOCAL ] WAT: Primary data saved (36355 records). [2025-10-17T22:20:17.357966] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-17T22:20:17.358541] [INFO ] [MAIN ] Update Progress: 2271/2368 symbols completed. WAT took 28.1s. Estimated remaining: 13m 41s. Rate: 7.1 symbols/min [2025-10-17T22:20:17.523953] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:20:17.570141] [DEBUG] [LOCAL ] WCN: Loaded 48419 existing records from primary storage. [2025-10-17T22:20:17.570450] [INFO ] [MAIN ] WCN: Loaded 48419 existing records. [2025-10-17T22:20:17.744065] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:20:17.744289] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-17T22:20:17.744338] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-17T22:20:17.744517] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-17T22:20:17.744556] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-17T22:20:18.103578] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:20:18.142256] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-10-17T22:20:18.573510] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T22:20:18.942306] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-17T22:20:19.742285] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-17T22:20:19.904720] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-17T22:20:20.119194] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-17T22:20:20.542351] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-17T22:20:21.258572] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T22:20:21.342345] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-17T22:20:21.540700] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-17T22:20:22.142332] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-17T22:20:22.766050] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-17T22:20:22.942297] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-17T22:20:23.666298] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-17T22:20:23.742270] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-17T22:20:24.452480] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-17T22:20:24.542292] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-17T22:20:25.342297] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-17T22:20:25.485983] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T22:20:26.142265] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-17T22:20:26.302241] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T22:20:26.942267] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-17T22:20:27.044742] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-17T22:20:27.742344] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-17T22:20:27.780924] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T22:20:28.542292] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-17T22:20:28.608105] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T22:20:29.342265] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-17T22:20:29.534744] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-17T22:20:30.104594] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-17T22:20:30.142262] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-17T22:20:30.523893] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T22:20:30.942295] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-17T22:20:31.720777] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T22:20:31.742282] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-17T22:20:32.542268] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-17T22:20:32.845563] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-17T22:20:33.342323] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-17T22:20:33.368908] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T22:20:34.142331] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-17T22:20:34.205109] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T22:20:34.942303] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-17T22:20:35.102777] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T22:20:35.164530] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-17T22:20:35.742305] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-17T22:20:36.542338] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-17T22:20:36.574058] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T22:20:36.783275] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-17T22:20:37.342304] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-17T22:20:38.147419] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-17T22:20:38.165539] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-17T22:20:38.942296] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-17T22:20:39.129065] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-17T22:20:39.634176] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T22:20:39.742268] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-17T22:20:39.954552] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T22:20:40.542288] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-17T22:20:41.124747] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-17T22:20:41.129512] [INFO ] [REMOTE ] WCC: Full fetch complete (57406 records). [2025-10-17T22:20:41.129604] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-17T22:20:41.347436] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-17T22:20:41.504338] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-17T22:20:41.504413] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-17T22:20:41.505481] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-17T22:20:41.505563] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-17T22:20:41.507593] [DEBUG] [LOCAL ] WCC: Trimmed 57406 records to 39530 (keeping 200 days of data) [2025-10-17T22:20:41.750123] [DEBUG] [LOCAL ] WCC: Primary data saved (39530 records). [2025-10-17T22:20:41.750250] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-17T22:20:41.750330] [INFO ] [MAIN ] Update Progress: 2272/2368 symbols completed. WCC took 28.4s. Estimated remaining: 13m 33s. Rate: 7.1 symbols/min [2025-10-17T22:20:41.925889] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:20:41.949207] [DEBUG] [LOCAL ] WD: Loaded 23265 existing records from primary storage. [2025-10-17T22:20:41.949480] [INFO ] [MAIN ] WD: Loaded 23265 existing records. [2025-10-17T22:20:42.155628] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-17T22:20:42.145081] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:20:42.169174] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-17T22:20:42.178171] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-17T22:20:42.179877] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-17T22:20:42.179295] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-17T22:20:42.180447] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-17T22:20:42.182569] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-17T22:20:42.548804] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:20:42.942320] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-17T22:20:43.610948] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-17T22:20:43.742260] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-17T22:20:43.854875] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-17T22:20:44.071114] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-17T22:20:44.542324] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-17T22:20:45.251023] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-17T22:20:45.252797] [INFO ] [REMOTE ] WBX: Full fetch complete (22617 records). [2025-10-17T22:20:45.252870] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-17T22:20:45.347945] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-17T22:20:45.611328] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-17T22:20:45.611405] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-17T22:20:45.611886] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-17T22:20:45.611949] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-17T22:20:45.612494] [DEBUG] [LOCAL ] WBX: Trimmed 22617 records to 10496 (keeping 200 days of data) [2025-10-17T22:20:45.667758] [DEBUG] [LOCAL ] WBX: Primary data saved (10496 records). [2025-10-17T22:20:45.667875] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-17T22:20:45.667953] [INFO ] [MAIN ] Update Progress: 2273/2368 symbols completed. WBX took 34.5s. Estimated remaining: 13m 24s. Rate: 7.1 symbols/min [2025-10-17T22:20:45.857363] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:20:45.876454] [DEBUG] [LOCAL ] WDH: Loaded 18241 existing records from primary storage. [2025-10-17T22:20:45.876700] [INFO ] [MAIN ] WDH: Loaded 18241 existing records. [2025-10-17T22:20:46.048769] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:20:46.049031] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-17T22:20:46.049090] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-17T22:20:46.049770] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-17T22:20:46.049829] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-17T22:20:46.147443] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-17T22:20:46.431275] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:20:46.942289] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-10-17T22:20:47.025132] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T22:20:47.742275] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-17T22:20:47.937128] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-17T22:20:47.970674] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-17T22:20:47.977783] [INFO ] [REMOTE ] WBS: Full fetch complete (70246 records). [2025-10-17T22:20:47.977918] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-17T22:20:48.373424] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-17T22:20:48.373518] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-17T22:20:48.374775] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-17T22:20:48.374845] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-17T22:20:48.376260] [DEBUG] [LOCAL ] WBS: Trimmed 70246 records to 49516 (keeping 200 days of data) [2025-10-17T22:20:48.553954] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-10-17T22:20:48.678671] [DEBUG] [LOCAL ] WBS: Primary data saved (49516 records). [2025-10-17T22:20:48.678809] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-17T22:20:48.678890] [INFO ] [MAIN ] Update Progress: 2274/2368 symbols completed. WBS took 37.7s. Estimated remaining: 13m 16s. Rate: 7.1 symbols/min [2025-10-17T22:20:48.851436] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:20:48.873850] [DEBUG] [LOCAL ] WDI: Loaded 21363 existing records from primary storage. [2025-10-17T22:20:48.874134] [INFO ] [MAIN ] WDI: Loaded 21363 existing records. [2025-10-17T22:20:49.045556] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:20:49.045777] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-17T22:20:49.045828] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-17T22:20:49.046023] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-17T22:20:49.046079] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-17T22:20:49.343555] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-17T22:20:49.405338] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:20:49.433845] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-17T22:20:49.525100] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-17T22:20:50.137898] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-17T22:20:50.142687] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-10-17T22:20:50.942277] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-17T22:20:51.261999] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-17T22:20:51.742277] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-17T22:20:51.782519] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-17T22:20:52.542285] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-17T22:20:53.342332] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-17T22:20:53.403208] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T22:20:53.418254] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-17T22:20:53.418419] [INFO ] [REMOTE ] WCN: Full fetch complete (69494 records). [2025-10-17T22:20:53.421499] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-17T22:20:53.853621] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-17T22:20:53.853732] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-17T22:20:53.855001] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-17T22:20:53.855068] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-17T22:20:53.856441] [DEBUG] [LOCAL ] WCN: Trimmed 69494 records to 48725 (keeping 200 days of data) [2025-10-17T22:20:54.157013] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-17T22:20:54.194456] [DEBUG] [LOCAL ] WCN: Primary data saved (48725 records). [2025-10-17T22:20:54.194599] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-17T22:20:54.195304] [INFO ] [MAIN ] Update Progress: 2275/2368 symbols completed. WCN took 36.8s. Estimated remaining: 13m 7s. Rate: 7.1 symbols/min [2025-10-17T22:20:54.393673] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:20:54.407913] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-17T22:20:54.455370] [DEBUG] [LOCAL ] WDS: Loaded 43496 existing records from primary storage. [2025-10-17T22:20:54.455779] [INFO ] [MAIN ] WDS: Loaded 43496 existing records. [2025-10-17T22:20:54.654040] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:20:54.654292] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-17T22:20:54.654368] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-17T22:20:54.654597] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-17T22:20:54.654704] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-17T22:20:54.951925] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-17T22:20:55.056155] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:20:55.187602] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-17T22:20:55.742302] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-10-17T22:20:55.926734] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-17T22:20:56.542292] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-17T22:20:57.342292] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-17T22:20:57.401291] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-17T22:20:57.724526] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-17T22:20:58.142307] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-17T22:20:58.188634] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-17T22:20:58.942319] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-17T22:20:59.437561] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-17T22:20:59.742366] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-17T22:20:59.936554] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-17T22:21:00.299875] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-17T22:21:00.542268] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-17T22:21:01.342298] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-17T22:21:01.715117] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-17T22:21:02.142310] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-17T22:21:02.685978] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-17T22:21:02.942259] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-17T22:21:03.007873] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-17T22:21:03.742334] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-17T22:21:04.086768] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-17T22:21:04.542332] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-17T22:21:05.314315] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-17T22:21:05.342242] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-17T22:21:05.579356] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T22:21:06.142307] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-17T22:21:06.942310] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-17T22:21:07.097473] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T22:21:07.291083] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T22:21:07.742318] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-17T22:21:07.845007] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-17T22:21:08.542302] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-17T22:21:09.106347] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-17T22:21:09.307434] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-17T22:21:09.342265] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-17T22:21:10.142341] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-17T22:21:10.665422] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-17T22:21:10.942287] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-17T22:21:11.742336] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-17T22:21:11.920959] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-17T22:21:12.001769] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-17T22:21:12.542326] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-17T22:21:12.862758] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T22:21:13.342344] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-17T22:21:14.096707] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-17T22:21:14.142283] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-17T22:21:14.343399] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-17T22:21:14.348066] [INFO ] [REMOTE ] WD: Full fetch complete (33212 records). [2025-10-17T22:21:14.348322] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-17T22:21:14.939134] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-17T22:21:14.939276] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-17T22:21:14.940805] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-17T22:21:14.940914] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-17T22:21:14.942255] [DEBUG] [LOCAL ] WD: Trimmed 33212 records to 23354 (keeping 200 days of data) [2025-10-17T22:21:14.942406] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-17T22:21:15.148392] [DEBUG] [LOCAL ] WD: Primary data saved (23354 records). [2025-10-17T22:21:15.148579] [INFO ] [MAIN ] WD: Full history saved. [2025-10-17T22:21:15.148729] [INFO ] [MAIN ] Update Progress: 2276/2368 symbols completed. WD took 33.4s. Estimated remaining: 12m 59s. Rate: 7.1 symbols/min [2025-10-17T22:21:15.381712] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:21:15.394474] [DEBUG] [LOCAL ] WEA: Loaded 7830 existing records from primary storage. [2025-10-17T22:21:15.394768] [INFO ] [MAIN ] WEA: Loaded 7830 existing records. [2025-10-17T22:21:15.596169] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:21:15.596393] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-17T22:21:15.596460] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-17T22:21:15.596880] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-17T22:21:15.597021] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-17T22:21:15.744693] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-17T22:21:15.923833] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-17T22:21:16.011262] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:21:16.108343] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-17T22:21:16.542270] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-17T22:21:16.891890] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-17T22:21:17.342309] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-17T22:21:17.682246] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-17T22:21:18.142346] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-17T22:21:18.689828] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-17T22:21:18.942326] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-10-17T22:21:19.685870] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T22:21:19.702897] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-17T22:21:19.742248] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-17T22:21:20.542299] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-17T22:21:21.297297] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-17T22:21:21.342253] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-17T22:21:21.550048] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-17T22:21:22.142344] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-17T22:21:22.876468] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T22:21:22.942250] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-17T22:21:23.309681] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T22:21:23.313469] [INFO ] [REMOTE ] WDH: Full fetch complete (23785 records). [2025-10-17T22:21:23.313561] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-17T22:21:23.666873] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-17T22:21:23.666998] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-17T22:21:23.667534] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-17T22:21:23.667606] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-17T22:21:23.668517] [DEBUG] [LOCAL ] WDH: Trimmed 23785 records to 18351 (keeping 200 days of data) [2025-10-17T22:21:23.747504] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-17T22:21:23.780714] [DEBUG] [LOCAL ] WDH: Primary data saved (18351 records). [2025-10-17T22:21:23.780822] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-17T22:21:23.780919] [INFO ] [MAIN ] Update Progress: 2277/2368 symbols completed. WDH took 38.1s. Estimated remaining: 12m 51s. Rate: 7.1 symbols/min [2025-10-17T22:21:24.229097] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-17T22:21:24.432517] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-17T22:21:24.438825] [INFO ] [REMOTE ] WDS: Full fetch complete (64236 records). [2025-10-17T22:21:24.438934] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-17T22:21:24.547439] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-17T22:21:24.821306] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-17T22:21:24.821391] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-17T22:21:24.822510] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-17T22:21:24.822574] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-17T22:21:24.823903] [DEBUG] [LOCAL ] WDS: Trimmed 64236 records to 43811 (keeping 200 days of data) [2025-10-17T22:21:25.090709] [DEBUG] [LOCAL ] WDS: Primary data saved (43811 records). [2025-10-17T22:21:25.090838] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-17T22:21:25.091623] [INFO ] [MAIN ] Update Progress: 2278/2368 symbols completed. WDS took 30.9s. Estimated remaining: 12m 42s. Rate: 7.1 symbols/min [2025-10-17T22:21:25.210439] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-17T22:21:25.342269] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-17T22:21:25.941071] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-17T22:21:26.142343] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-17T22:21:26.797292] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-17T22:21:26.942319] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-17T22:21:27.742378] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-17T22:21:27.890569] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-17T22:21:27.893739] [INFO ] [REMOTE ] WDI: Full fetch complete (30261 records). [2025-10-17T22:21:27.893819] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-17T22:21:28.257916] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-17T22:21:28.257996] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-17T22:21:28.258525] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-17T22:21:28.258563] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-17T22:21:28.259344] [DEBUG] [LOCAL ] WDI: Trimmed 30261 records to 21497 (keeping 200 days of data) [2025-10-17T22:21:28.354975] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-17T22:21:28.398612] [DEBUG] [LOCAL ] WDI: Primary data saved (21497 records). [2025-10-17T22:21:28.398743] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-17T22:21:28.398839] [INFO ] [MAIN ] Update Progress: 2279/2368 symbols completed. WDI took 39.7s. Estimated remaining: 12m 33s. Rate: 7.1 symbols/min [2025-10-17T22:21:28.542253] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-17T22:21:29.340184] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-17T22:21:29.342465] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-17T22:21:30.214724] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-17T22:21:30.217636] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-17T22:21:30.834800] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-17T22:21:30.942354] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-17T22:21:31.702595] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T22:21:31.742309] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-17T22:21:32.408795] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-17T22:21:32.410529] [INFO ] [REMOTE ] WEA: Full fetch complete (10077 records). [2025-10-17T22:21:32.410597] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-17T22:21:32.761015] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-17T22:21:32.761095] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-17T22:21:32.761363] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-17T22:21:32.761424] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-17T22:21:32.761920] [DEBUG] [LOCAL ] WEA: Trimmed 10077 records to 7901 (keeping 200 days of data) [2025-10-17T22:21:32.808105] [DEBUG] [LOCAL ] WEA: Primary data saved (7901 records). [2025-10-17T22:21:32.808221] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-17T22:21:32.808312] [INFO ] [MAIN ] Update Progress: 2280/2368 symbols completed. WEA took 17.7s. Estimated remaining: 12m 24s. Rate: 7.1 symbols/min [2025-10-17T22:21:33.394454] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:21:33.500394] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:21:33.557276] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:21:33.562487] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:21:33.599122] [DEBUG] [LOCAL ] WEAV: Loaded 42602 existing records from primary storage. [2025-10-17T22:21:33.599708] [INFO ] [MAIN ] WEAV: Loaded 42602 existing records. [2025-10-17T22:21:33.790110] [DEBUG] [LOCAL ] WELL: Loaded 52706 existing records from primary storage. [2025-10-17T22:21:33.849806] [INFO ] [MAIN ] WELL: Loaded 52706 existing records. [2025-10-17T22:21:33.852263] [DEBUG] [LOCAL ] WES: Loaded 48881 existing records from primary storage. [2025-10-17T22:21:33.881322] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:21:33.914508] [INFO ] [MAIN ] WES: Loaded 48881 existing records. [2025-10-17T22:21:33.914256] [DEBUG] [LOCAL ] WEC: Loaded 52558 existing records from primary storage. [2025-10-17T22:21:33.920526] [INFO ] [MAIN ] WEC: Loaded 52558 existing records. [2025-10-17T22:21:33.914346] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-17T22:21:34.018999] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-17T22:21:34.138874] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-17T22:21:34.156057] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-17T22:21:34.523355] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:21:34.558132] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-17T22:21:34.564801] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:21:34.569979] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-17T22:21:34.614587] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-17T22:21:34.625530] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:21:34.633387] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-17T22:21:34.636125] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-17T22:21:34.622272] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-17T22:21:34.678839] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-17T22:21:34.692809] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-17T22:21:34.673476] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-17T22:21:34.678760] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-17T22:21:34.724148] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-17T22:21:34.782527] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-17T22:21:35.228281] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:21:35.254250] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-10-17T22:21:35.845341] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:21:35.896355] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:21:35.907233] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-10-17T22:21:35.922998] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-10-17T22:21:35.977041] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:21:35.977465] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-10-17T22:21:36.841351] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T22:21:36.850237] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-17T22:21:37.458239] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T22:21:37.468948] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-17T22:21:37.629184] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-17T22:21:37.639457] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-17T22:21:37.834380] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-17T22:21:37.905679] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-17T22:21:38.142354] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-17T22:21:38.942297] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-17T22:21:39.156093] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T22:21:39.293748] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T22:21:39.585741] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-17T22:21:39.742294] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-17T22:21:40.171354] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-17T22:21:40.542301] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-17T22:21:41.342277] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-17T22:21:41.466909] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-17T22:21:42.142348] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-17T22:21:42.255006] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T22:21:42.937190] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T22:21:42.947164] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-17T22:21:43.734574] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T22:21:43.743089] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-17T22:21:44.542296] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-17T22:21:44.874422] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-17T22:21:45.342318] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-17T22:21:45.581491] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T22:21:45.762324] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-17T22:21:46.142336] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-17T22:21:46.942274] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-17T22:21:47.294708] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-17T22:21:47.742370] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-17T22:21:47.906823] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T22:21:48.165732] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-17T22:21:48.542304] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-17T22:21:49.342336] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-17T22:21:49.615289] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T22:21:50.142269] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-17T22:21:50.251752] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T22:21:50.942302] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-17T22:21:51.157386] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-17T22:21:51.227496] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-17T22:21:51.742330] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-17T22:21:52.542349] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-17T22:21:52.681316] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-17T22:21:53.342254] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-17T22:21:53.479276] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T22:21:54.122011] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T22:21:54.142244] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-17T22:21:54.757978] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-17T22:21:54.942304] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-17T22:21:55.667899] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-17T22:21:55.742306] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-17T22:21:56.542368] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-17T22:21:56.729732] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-17T22:21:57.342260] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-17T22:21:57.473891] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T22:21:58.036614] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-17T22:21:58.142292] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-17T22:21:58.942271] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-17T22:21:59.234460] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-17T22:21:59.742276] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-17T22:21:59.866921] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-17T22:22:00.404150] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-17T22:22:00.412342] [INFO ] [REMOTE ] WEAV: Full fetch complete (61859 records). [2025-10-17T22:22:00.412613] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-17T22:22:00.553626] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-17T22:22:00.797996] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-17T22:22:00.798088] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-17T22:22:00.799228] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-17T22:22:00.799302] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-17T22:22:00.800732] [DEBUG] [LOCAL ] WEAV: Trimmed 61859 records to 42907 (keeping 200 days of data) [2025-10-17T22:22:01.052403] [DEBUG] [LOCAL ] WEAV: Primary data saved (42907 records). [2025-10-17T22:22:01.052533] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-17T22:22:01.052617] [INFO ] [MAIN ] Update Progress: 2281/2368 symbols completed. WEAV took 28.2s. Estimated remaining: 12m 17s. Rate: 7.1 symbols/min [2025-10-17T22:22:01.227526] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:22:01.260921] [DEBUG] [LOCAL ] WEX: Loaded 33254 existing records from primary storage. [2025-10-17T22:22:01.261177] [INFO ] [MAIN ] WEX: Loaded 33254 existing records. [2025-10-17T22:22:01.348826] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-17T22:22:01.438758] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:22:01.438994] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-17T22:22:01.439064] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-17T22:22:01.439367] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-17T22:22:01.439454] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-17T22:22:01.623194] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-17T22:22:01.829952] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:22:02.142342] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-17T22:22:02.372980] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T22:22:02.942267] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-17T22:22:03.053322] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-17T22:22:03.742263] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-17T22:22:03.975943] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-17T22:22:04.542316] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-10-17T22:22:04.711435] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T22:22:05.342277] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-17T22:22:05.417360] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T22:22:05.652122] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-17T22:22:05.659530] [INFO ] [REMOTE ] WEC: Full fetch complete (75835 records). [2025-10-17T22:22:05.659700] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-17T22:22:06.073020] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-17T22:22:06.073145] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-17T22:22:06.074553] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-17T22:22:06.074639] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-17T22:22:06.076337] [DEBUG] [LOCAL ] WEC: Trimmed 75835 records to 52934 (keeping 200 days of data) [2025-10-17T22:22:06.147009] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-17T22:22:06.188588] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-17T22:22:06.425818] [DEBUG] [LOCAL ] WEC: Primary data saved (52934 records). [2025-10-17T22:22:06.425939] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-17T22:22:06.426551] [INFO ] [MAIN ] Update Progress: 2282/2368 symbols completed. WEC took 33.6s. Estimated remaining: 12m 8s. Rate: 7.1 symbols/min [2025-10-17T22:22:06.620930] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:22:06.634491] [DEBUG] [LOCAL ] WF: Loaded 11033 existing records from primary storage. [2025-10-17T22:22:06.634745] [INFO ] [MAIN ] WF: Loaded 11033 existing records. [2025-10-17T22:22:06.809501] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:22:06.810240] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-17T22:22:06.810290] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-17T22:22:06.810447] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-17T22:22:06.810503] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-17T22:22:06.942770] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-17T22:22:06.966579] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-17T22:22:07.066789] [INFO ] [REMOTE ] WELL: Full fetch complete (75988 records). [2025-10-17T22:22:07.099804] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-17T22:22:07.341028] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:22:07.602008] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-17T22:22:07.602104] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-17T22:22:07.603375] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-17T22:22:07.603451] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-17T22:22:07.605081] [DEBUG] [LOCAL ] WELL: Trimmed 75988 records to 53089 (keeping 200 days of data) [2025-10-17T22:22:07.788425] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-17T22:22:07.941386] [DEBUG] [LOCAL ] WELL: Primary data saved (53089 records). [2025-10-17T22:22:07.941513] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-17T22:22:07.941593] [INFO ] [MAIN ] Update Progress: 2283/2368 symbols completed. WELL took 35.1s. Estimated remaining: 11m 59s. Rate: 7.1 symbols/min [2025-10-17T22:22:08.107811] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:22:08.155917] [DEBUG] [LOCAL ] WFC: Loaded 54138 existing records from primary storage. [2025-10-17T22:22:08.156220] [INFO ] [MAIN ] WFC: Loaded 54138 existing records. [2025-10-17T22:22:08.331831] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:22:08.332242] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-17T22:22:08.332314] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-17T22:22:08.332693] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-17T22:22:08.332754] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-17T22:22:08.527662] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-17T22:22:08.551597] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-10-17T22:22:08.713367] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:22:09.342317] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-17T22:22:09.586358] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-17T22:22:09.586759] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T22:22:10.142340] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-17T22:22:10.598705] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-17T22:22:10.944226] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-10-17T22:22:10.945202] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-17T22:22:11.045751] [DEBUG] [REMOTE ] WFC: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-17T22:22:11.045988] [WARN ] [REMOTE ] WFC: No data returned for month 2024-12 [2025-10-17T22:22:11.046072] [FATAL] [REMOTE ] WFC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T22:22:11.046121] [FATAL] [MAIN ] WFC: Failed to fetch primary data. [2025-10-17T22:22:11.046180] [WARN ] [MAIN ] WFC: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T22:22:11.046251] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-17T22:22:11.046309] [DEBUG] [LOCAL ] WFC: No primary data file found to delete. [2025-10-17T22:22:11.046344] [INFO ] [LOCAL ] WFC: Starting deletion of derivative data. [2025-10-17T22:22:11.046502] [DEBUG] [LOCAL ] WFC: Deleted derivative data file. [2025-10-17T22:22:11.046592] [INFO ] [MAIN ] Update Progress: 2284/2368 symbols completed. WFC took 3.1s. Estimated remaining: 11m 51s. Rate: 7.1 symbols/min [2025-10-17T22:22:11.209558] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:22:11.231718] [DEBUG] [LOCAL ] WFG: Loaded 24996 existing records from primary storage. [2025-10-17T22:22:11.231951] [INFO ] [MAIN ] WFG: Loaded 24996 existing records. [2025-10-17T22:22:11.401988] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:22:11.402144] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-17T22:22:11.402189] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-17T22:22:11.402356] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-17T22:22:11.402393] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-17T22:22:11.740112] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:22:11.742241] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-10-17T22:22:12.542265] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-17T22:22:12.824284] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-17T22:22:13.342280] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-17T22:22:13.405319] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-17T22:22:14.142341] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-17T22:22:14.881718] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-17T22:22:14.942308] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-17T22:22:15.642426] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T22:22:15.652173] [INFO ] [REMOTE ] WES: Full fetch complete (70563 records). [2025-10-17T22:22:15.652354] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-17T22:22:15.742586] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-17T22:22:16.100856] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-17T22:22:16.101135] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-17T22:22:16.102617] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-17T22:22:16.108060] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-17T22:22:16.117593] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T22:22:16.124311] [DEBUG] [LOCAL ] WES: Trimmed 70563 records to 49260 (keeping 200 days of data) [2025-10-17T22:22:16.434433] [DEBUG] [LOCAL ] WES: Primary data saved (49260 records). [2025-10-17T22:22:16.434601] [INFO ] [MAIN ] WES: Full history saved. [2025-10-17T22:22:16.434726] [INFO ] [MAIN ] Update Progress: 2285/2368 symbols completed. WES took 43.6s. Estimated remaining: 11m 42s. Rate: 7.1 symbols/min [2025-10-17T22:22:16.547535] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-17T22:22:16.624023] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:22:16.661158] [DEBUG] [LOCAL ] WGO: Loaded 38394 existing records from primary storage. [2025-10-17T22:22:16.661495] [INFO ] [MAIN ] WGO: Loaded 38394 existing records. [2025-10-17T22:22:16.854746] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:22:16.855041] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-17T22:22:16.855131] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-17T22:22:16.855377] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-17T22:22:16.855443] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-17T22:22:17.213662] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:22:17.306697] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T22:22:17.342247] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-17T22:22:17.786815] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-17T22:22:18.142365] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-10-17T22:22:18.749592] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T22:22:18.942296] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-17T22:22:19.734595] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T22:22:19.745829] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-17T22:22:20.303720] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-17T22:22:20.542309] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-17T22:22:20.962880] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-17T22:22:21.342379] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-17T22:22:22.021920] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-17T22:22:22.142314] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-17T22:22:22.252560] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-17T22:22:22.942293] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-17T22:22:23.452086] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T22:22:23.742298] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-17T22:22:23.867507] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-17T22:22:24.542334] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-17T22:22:25.342318] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-17T22:22:25.459832] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T22:22:25.764879] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-17T22:22:26.143261] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-17T22:22:26.144955] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-17T22:22:26.942356] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-17T22:22:27.526207] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-17T22:22:27.742262] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-17T22:22:28.541272] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-17T22:22:28.549761] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-17T22:22:29.045590] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T22:22:29.342292] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-17T22:22:29.913119] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-17T22:22:30.142344] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-17T22:22:30.474138] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-17T22:22:30.942276] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-17T22:22:31.541259] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T22:22:31.742260] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-17T22:22:32.144161] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-17T22:22:32.542321] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-17T22:22:32.627986] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-17T22:22:33.342326] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-17T22:22:33.708005] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T22:22:33.712189] [INFO ] [REMOTE ] WEX: Full fetch complete (50521 records). [2025-10-17T22:22:33.712298] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-17T22:22:34.080071] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-17T22:22:34.080143] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-17T22:22:34.081125] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-17T22:22:34.081187] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-17T22:22:34.082136] [DEBUG] [LOCAL ] WEX: Trimmed 50521 records to 33480 (keeping 200 days of data) [2025-10-17T22:22:34.165044] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-17T22:22:34.278620] [DEBUG] [LOCAL ] WEX: Primary data saved (33480 records). [2025-10-17T22:22:34.278772] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-17T22:22:34.278856] [INFO ] [MAIN ] Update Progress: 2286/2368 symbols completed. WEX took 33.2s. Estimated remaining: 11m 34s. Rate: 7.1 symbols/min [2025-10-17T22:22:34.447833] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:22:34.489198] [DEBUG] [LOCAL ] WH: Loaded 45585 existing records from primary storage. [2025-10-17T22:22:34.489707] [INFO ] [MAIN ] WH: Loaded 45585 existing records. [2025-10-17T22:22:34.673170] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:22:34.673541] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-17T22:22:34.673675] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-17T22:22:34.679155] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-17T22:22:34.688173] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-17T22:22:34.755356] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-17T22:22:34.959191] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-17T22:22:34.949179] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-17T22:22:35.118522] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:22:35.742320] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-17T22:22:36.169030] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T22:22:36.542365] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-17T22:22:37.239487] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-17T22:22:37.342322] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-17T22:22:37.402550] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T22:22:38.114419] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-17T22:22:38.142260] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-17T22:22:38.936328] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-17T22:22:38.938426] [INFO ] [REMOTE ] WF: Full fetch complete (16198 records). [2025-10-17T22:22:38.938497] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-17T22:22:38.949490] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-17T22:22:39.304492] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-17T22:22:39.304618] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-17T22:22:39.305044] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-17T22:22:39.305093] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-17T22:22:39.305589] [DEBUG] [LOCAL ] WF: Trimmed 16198 records to 11094 (keeping 200 days of data) [2025-10-17T22:22:39.370571] [DEBUG] [LOCAL ] WF: Primary data saved (11094 records). [2025-10-17T22:22:39.370723] [INFO ] [MAIN ] WF: Full history saved. [2025-10-17T22:22:39.370811] [INFO ] [MAIN ] Update Progress: 2287/2368 symbols completed. WF took 32.9s. Estimated remaining: 11m 26s. Rate: 7.1 symbols/min [2025-10-17T22:22:39.539282] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:22:39.575637] [DEBUG] [LOCAL ] WHD: Loaded 40434 existing records from primary storage. [2025-10-17T22:22:39.575939] [INFO ] [MAIN ] WHD: Loaded 40434 existing records. [2025-10-17T22:22:39.747572] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-17T22:22:39.753888] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:22:39.754942] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-17T22:22:39.754993] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-17T22:22:39.755164] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-17T22:22:39.755202] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-17T22:22:40.121248] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:22:40.482673] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-17T22:22:40.542241] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-17T22:22:41.060329] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T22:22:41.342325] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-17T22:22:41.851049] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T22:22:42.142270] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-17T22:22:42.493595] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T22:22:42.497271] [INFO ] [REMOTE ] WFG: Full fetch complete (36361 records). [2025-10-17T22:22:42.497364] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-17T22:22:42.859294] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-17T22:22:42.859358] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-17T22:22:42.860077] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-17T22:22:42.860137] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-17T22:22:42.860932] [DEBUG] [LOCAL ] WFG: Trimmed 36361 records to 25178 (keeping 200 days of data) [2025-10-17T22:22:42.948126] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-10-17T22:22:43.015029] [DEBUG] [LOCAL ] WFG: Primary data saved (25178 records). [2025-10-17T22:22:43.015124] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-17T22:22:43.015204] [INFO ] [MAIN ] Update Progress: 2288/2368 symbols completed. WFG took 32.0s. Estimated remaining: 11m 17s. Rate: 7.1 symbols/min [2025-10-17T22:22:43.182613] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:22:43.188052] [DEBUG] [LOCAL ] WHG: Loaded 3162 existing records from primary storage. [2025-10-17T22:22:43.188207] [INFO ] [MAIN ] WHG: Loaded 3162 existing records. [2025-10-17T22:22:43.358956] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:22:43.359172] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-17T22:22:43.359219] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-17T22:22:43.359344] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-17T22:22:43.359383] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-17T22:22:43.726159] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:22:43.727871] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T22:22:43.742244] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-17T22:22:44.536005] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T22:22:44.544081] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-10-17T22:22:45.020214] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-17T22:22:45.035278] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-17T22:22:45.040553] [INFO ] [REMOTE ] WGO: Full fetch complete (57116 records). [2025-10-17T22:22:45.040731] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-17T22:22:45.350049] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-10-17T22:22:45.447000] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-17T22:22:45.447133] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-17T22:22:45.448249] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-17T22:22:45.448311] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-17T22:22:45.449417] [DEBUG] [LOCAL ] WGO: Trimmed 57116 records to 38653 (keeping 200 days of data) [2025-10-17T22:22:45.680467] [DEBUG] [LOCAL ] WGO: Primary data saved (38653 records). [2025-10-17T22:22:45.680610] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-17T22:22:45.680724] [INFO ] [MAIN ] Update Progress: 2289/2368 symbols completed. WGO took 29.2s. Estimated remaining: 11m 8s. Rate: 7.1 symbols/min [2025-10-17T22:22:45.844230] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:22:45.888519] [DEBUG] [LOCAL ] WHR: Loaded 49168 existing records from primary storage. [2025-10-17T22:22:45.888904] [INFO ] [MAIN ] WHR: Loaded 49168 existing records. [2025-10-17T22:22:46.069763] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:22:46.070003] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-17T22:22:46.070053] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-17T22:22:46.070407] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-17T22:22:46.070465] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-17T22:22:46.147389] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-17T22:22:46.430940] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:22:46.761742] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-17T22:22:46.942299] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-17T22:22:47.665580] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-17T22:22:47.742251] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-17T22:22:48.404356] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T22:22:48.542272] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-17T22:22:49.271117] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T22:22:49.342258] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-17T22:22:49.815690] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-17T22:22:49.898729] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-17T22:22:50.142290] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-17T22:22:50.942315] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-17T22:22:51.742291] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-10-17T22:22:51.831338] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T22:22:52.542266] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-17T22:22:52.682052] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T22:22:53.342290] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-17T22:22:54.142312] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-17T22:23:05.668718] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (11.53 seconds). [2025-10-17T22:23:05.670177] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-17T22:23:05.705706] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (12.36 seconds). [2025-10-17T22:23:05.715760] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-17T22:23:06.022004] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (13.48 seconds). [2025-10-17T22:23:06.031552] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-17T22:23:06.153052] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (14.41 seconds). [2025-10-17T22:23:06.161667] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-17T22:23:06.494097] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-17T22:23:06.495637] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-17T22:23:07.316756] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-17T22:23:07.319005] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-17T22:23:07.359431] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T22:23:07.372947] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-17T22:23:07.560398] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-17T22:23:07.572619] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-17T22:23:07.902531] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-17T22:23:07.913139] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-17T22:23:07.945407] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T22:23:07.947128] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-17T22:23:08.545156] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-17T22:23:08.546966] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-17T22:23:08.935038] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-17T22:23:08.945464] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-17T22:23:09.044987] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T22:23:09.053078] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-17T22:23:09.180507] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-17T22:23:09.182081] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-17T22:23:09.648718] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T22:23:09.657474] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-17T22:23:09.670639] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-17T22:23:09.672147] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-17T22:23:10.044887] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-17T22:23:10.046017] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-17T22:23:10.443741] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-17T22:23:10.444467] [INFO ] [REMOTE ] WHG: Full fetch complete (4455 records). [2025-10-17T22:23:10.444533] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-17T22:23:10.727367] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T22:23:10.784300] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-17T22:23:10.846370] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-17T22:23:10.846470] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-17T22:23:10.846637] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-17T22:23:10.846798] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-17T22:23:10.847396] [DEBUG] [LOCAL ] WHG: Trimmed 4455 records to 3165 (keeping 200 days of data) [2025-10-17T22:23:10.883865] [DEBUG] [LOCAL ] WHG: Primary data saved (3165 records). [2025-10-17T22:23:10.895322] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-17T22:23:10.895471] [INFO ] [MAIN ] Update Progress: 2290/2368 symbols completed. WHG took 27.9s. Estimated remaining: 11m 0s. Rate: 7.1 symbols/min [2025-10-17T22:23:10.897222] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-17T22:23:10.998448] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-17T22:23:11.077995] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:23:11.085411] [DEBUG] [LOCAL ] WIA: Loaded 5036 existing records from primary storage. [2025-10-17T22:23:11.085583] [INFO ] [MAIN ] WIA: Loaded 5036 existing records. [2025-10-17T22:23:11.270467] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:23:11.270767] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-17T22:23:11.270819] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-17T22:23:11.271206] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-17T22:23:11.271267] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-17T22:23:11.646015] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T22:23:11.675750] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:23:11.676403] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-10-17T22:23:11.677397] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-17T22:23:11.993277] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-17T22:23:12.001935] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-17T22:23:12.092733] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-17T22:23:12.125967] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-17T22:23:12.542419] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-17T22:23:13.175626] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-17T22:23:13.312954] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-17T22:23:13.342255] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-17T22:23:13.441230] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-17T22:23:14.142359] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-17T22:23:14.942289] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-17T22:23:15.262737] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-17T22:23:15.506259] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-17T22:23:15.512005] [INFO ] [REMOTE ] WHD: Full fetch complete (57897 records). [2025-10-17T22:23:15.512112] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-17T22:23:15.606568] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-17T22:23:15.747582] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-17T22:23:15.900005] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-17T22:23:15.900084] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-17T22:23:15.901688] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-17T22:23:15.901752] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-17T22:23:15.902963] [DEBUG] [LOCAL ] WHD: Trimmed 57897 records to 40730 (keeping 200 days of data) [2025-10-17T22:23:16.150130] [DEBUG] [LOCAL ] WHD: Primary data saved (40730 records). [2025-10-17T22:23:16.150252] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-17T22:23:16.151014] [INFO ] [MAIN ] Update Progress: 2291/2368 symbols completed. WHD took 36.8s. Estimated remaining: 10m 52s. Rate: 7.1 symbols/min [2025-10-17T22:23:16.320301] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:23:16.333963] [DEBUG] [LOCAL ] WINN: Loaded 11615 existing records from primary storage. [2025-10-17T22:23:16.334182] [INFO ] [MAIN ] WINN: Loaded 11615 existing records. [2025-10-17T22:23:16.513995] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:23:16.514203] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-17T22:23:16.514251] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-17T22:23:16.514425] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-17T22:23:16.514493] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-17T22:23:16.547378] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-17T22:23:16.871262] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:23:17.342321] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-10-17T22:23:17.571068] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-17T22:23:17.795002] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-17T22:23:18.142301] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-17T22:23:18.209490] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-17T22:23:18.774244] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-17T22:23:18.942398] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-17T22:23:19.742289] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-17T22:23:20.542260] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-17T22:23:20.690399] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-17T22:23:20.804729] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-17T22:23:21.342303] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-17T22:23:21.981700] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T22:23:21.987861] [INFO ] [REMOTE ] WH: Full fetch complete (65374 records). [2025-10-17T22:23:21.987973] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-17T22:23:22.144848] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-17T22:23:22.302888] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-17T22:23:22.390485] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-17T22:23:22.390574] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-17T22:23:22.391884] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-17T22:23:22.391949] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-17T22:23:22.393247] [DEBUG] [LOCAL ] WH: Trimmed 65374 records to 45923 (keeping 200 days of data) [2025-10-17T22:23:22.672756] [DEBUG] [LOCAL ] WH: Primary data saved (45923 records). [2025-10-17T22:23:22.672878] [INFO ] [MAIN ] WH: Full history saved. [2025-10-17T22:23:22.672978] [INFO ] [MAIN ] Update Progress: 2292/2368 symbols completed. WH took 48.4s. Estimated remaining: 10m 43s. Rate: 7.1 symbols/min [2025-10-17T22:23:22.794020] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-17T22:23:22.849913] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:23:22.896984] [DEBUG] [LOCAL ] WIT: Loaded 52880 existing records from primary storage. [2025-10-17T22:23:22.897316] [INFO ] [MAIN ] WIT: Loaded 52880 existing records. [2025-10-17T22:23:22.949257] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-17T22:23:23.077103] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:23:23.077305] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-17T22:23:23.077352] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-17T22:23:23.077525] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-17T22:23:23.077562] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-17T22:23:23.435432] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:23:23.615938] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-17T22:23:23.742287] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-10-17T22:23:24.542342] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-17T22:23:25.342328] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-17T22:23:25.428439] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-17T22:23:26.142266] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-17T22:23:26.207248] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-17T22:23:26.271491] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-17T22:23:26.942289] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-17T22:23:27.524941] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T22:23:27.742275] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-17T22:23:27.930847] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T22:23:28.425160] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-17T22:23:28.542307] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-17T22:23:29.342299] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-17T22:23:30.131766] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T22:23:30.142243] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-17T22:23:30.315566] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-17T22:23:30.942344] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-17T22:23:31.581883] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-17T22:23:31.742303] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-17T22:23:31.950530] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T22:23:32.223226] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-17T22:23:32.542303] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-17T22:23:33.342317] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-17T22:23:34.142265] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-17T22:23:34.289951] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T22:23:34.938575] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-17T22:23:34.942233] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-17T22:23:35.035124] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T22:23:35.742369] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-17T22:23:35.767858] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-17T22:23:36.542267] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-17T22:23:37.340426] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-17T22:23:37.342942] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-17T22:23:37.490846] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-17T22:23:37.497584] [INFO ] [REMOTE ] WHR: Full fetch complete (69442 records). [2025-10-17T22:23:37.497930] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-17T22:23:37.879782] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-17T22:23:37.879954] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-17T22:23:37.881143] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-17T22:23:37.881206] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-17T22:23:37.882662] [DEBUG] [LOCAL ] WHR: Trimmed 69442 records to 49531 (keeping 200 days of data) [2025-10-17T22:23:37.978021] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-17T22:23:37.984865] [INFO ] [REMOTE ] WIA: Full fetch complete (7152 records). [2025-10-17T22:23:37.986144] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-17T22:23:38.163230] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-17T22:23:38.576430] [DEBUG] [LOCAL ] WHR: Primary data saved (49531 records). [2025-10-17T22:23:38.582279] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-17T22:23:38.582363] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-17T22:23:38.582498] [INFO ] [MAIN ] Update Progress: 2293/2368 symbols completed. WHR took 52.9s. Estimated remaining: 10m 35s. Rate: 7.1 symbols/min [2025-10-17T22:23:38.582568] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-17T22:23:38.582966] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-17T22:23:38.594060] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-17T22:23:38.646493] [DEBUG] [LOCAL ] WIA: Trimmed 7152 records to 5051 (keeping 200 days of data) [2025-10-17T22:23:38.758289] [DEBUG] [LOCAL ] WIA: Primary data saved (5051 records). [2025-10-17T22:23:38.764392] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-17T22:23:38.765500] [INFO ] [MAIN ] Update Progress: 2294/2368 symbols completed. WIA took 27.9s. Estimated remaining: 10m 26s. Rate: 7.1 symbols/min [2025-10-17T22:23:38.826585] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:23:38.958047] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-17T22:23:38.961622] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:23:38.971904] [DEBUG] [LOCAL ] WIW: Loaded 20407 existing records from primary storage. [2025-10-17T22:23:38.972246] [INFO ] [MAIN ] WIW: Loaded 20407 existing records. [2025-10-17T22:23:39.089284] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-17T22:23:39.187522] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:23:39.201971] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-17T22:23:39.202510] [DEBUG] [LOCAL ] WK: Loaded 37595 existing records from primary storage. [2025-10-17T22:23:39.202603] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-17T22:23:39.202877] [INFO ] [MAIN ] WK: Loaded 37595 existing records. [2025-10-17T22:23:39.202944] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-17T22:23:39.245567] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-17T22:23:39.531282] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:23:39.538321] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-17T22:23:39.538708] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-17T22:23:39.553816] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-17T22:23:39.588575] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-17T22:23:39.746300] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-17T22:23:39.917138] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:23:40.094764] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:23:40.542258] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-10-17T22:23:40.648493] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T22:23:40.647070] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-17T22:23:41.342304] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-17T22:23:41.630853] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-17T22:23:42.102119] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-17T22:23:42.104063] [INFO ] [REMOTE ] WINN: Full fetch complete (17381 records). [2025-10-17T22:23:42.104134] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-17T22:23:42.147397] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-17T22:23:42.474671] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-17T22:23:42.474757] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-17T22:23:42.475121] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-17T22:23:42.475160] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-17T22:23:42.475786] [DEBUG] [LOCAL ] WINN: Trimmed 17381 records to 11678 (keeping 200 days of data) [2025-10-17T22:23:42.543550] [DEBUG] [LOCAL ] WINN: Primary data saved (11678 records). [2025-10-17T22:23:42.543704] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-17T22:23:42.543829] [INFO ] [MAIN ] Update Progress: 2295/2368 symbols completed. WINN took 26.4s. Estimated remaining: 10m 18s. Rate: 7.1 symbols/min [2025-10-17T22:23:42.708101] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:23:42.740890] [DEBUG] [LOCAL ] WKC: Loaded 34850 existing records from primary storage. [2025-10-17T22:23:42.741176] [INFO ] [MAIN ] WKC: Loaded 34850 existing records. [2025-10-17T22:23:42.915134] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:23:42.915385] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-17T22:23:42.915441] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-17T22:23:42.915758] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-17T22:23:42.915827] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-17T22:23:42.947410] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-10-17T22:23:43.269202] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:23:43.742324] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-10-17T22:23:43.826185] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T22:23:44.327411] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T22:23:44.542296] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-17T22:23:44.898073] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T22:23:45.342307] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-17T22:23:45.718607] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-17T22:23:46.142315] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-17T22:23:46.380010] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-17T22:23:46.942292] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-17T22:23:47.586327] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T22:23:47.742304] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-17T22:23:48.041592] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-17T22:23:48.542302] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-17T22:23:49.248481] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-17T22:23:49.342243] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-17T22:23:50.142285] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-17T22:23:50.332432] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T22:23:50.927483] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T22:23:50.942240] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-17T22:23:51.012222] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-17T22:23:51.742294] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-17T22:23:52.413481] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T22:23:52.472694] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-17T22:23:52.542247] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-17T22:23:53.342287] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-17T22:23:53.629238] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-17T22:23:54.142268] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-17T22:23:54.172882] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-17T22:23:54.942293] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-17T22:23:55.742338] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-17T22:23:55.947401] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T22:23:56.172249] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-17T22:23:56.542294] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-17T22:23:56.947526] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T22:23:57.342287] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-17T22:23:58.142258] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-17T22:23:58.330661] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T22:23:58.943308] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-17T22:23:58.943439] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-17T22:23:59.150363] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T22:23:59.742311] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-17T22:24:00.542302] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-17T22:24:00.589480] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-17T22:24:00.648709] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-17T22:24:00.656179] [INFO ] [REMOTE ] WIT: Full fetch complete (75927 records). [2025-10-17T22:24:00.656340] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-17T22:24:01.034270] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-17T22:24:01.034370] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-17T22:24:01.036003] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-17T22:24:01.036078] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-17T22:24:01.037560] [DEBUG] [LOCAL ] WIT: Trimmed 75927 records to 53266 (keeping 200 days of data) [2025-10-17T22:24:01.342816] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-17T22:24:01.347893] [DEBUG] [LOCAL ] WIT: Primary data saved (53266 records). [2025-10-17T22:24:01.348771] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-17T22:24:01.348880] [INFO ] [MAIN ] Update Progress: 2296/2368 symbols completed. WIT took 38.7s. Estimated remaining: 10m 10s. Rate: 7.1 symbols/min [2025-10-17T22:24:01.529810] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:24:01.550518] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-17T22:24:01.596451] [DEBUG] [LOCAL ] WLK: Loaded 46068 existing records from primary storage. [2025-10-17T22:24:01.596804] [INFO ] [MAIN ] WLK: Loaded 46068 existing records. [2025-10-17T22:24:01.814729] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:24:01.815035] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-17T22:24:01.815101] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-17T22:24:01.815366] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-17T22:24:01.815435] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-17T22:24:02.147412] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-17T22:24:02.188923] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:24:02.756375] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T22:24:02.942292] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-10-17T22:24:03.610577] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-17T22:24:03.742280] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-17T22:24:04.461298] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T22:24:04.542263] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-17T22:24:04.700573] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T22:24:05.342295] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-17T22:24:05.624465] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T22:24:06.142355] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-17T22:24:06.872595] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-17T22:24:06.942261] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-17T22:24:07.591888] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-17T22:24:07.742255] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-17T22:24:08.164441] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-17T22:24:08.542356] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-17T22:24:09.151215] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-17T22:24:09.342273] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-17T22:24:09.634053] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-17T22:24:10.142326] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-17T22:24:10.942317] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-17T22:24:10.969714] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-17T22:24:11.747454] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-17T22:24:11.761709] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-17T22:24:11.831041] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-17T22:24:11.833888] [INFO ] [REMOTE ] WIW: Full fetch complete (29145 records). [2025-10-17T22:24:11.833963] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-17T22:24:12.187665] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-17T22:24:12.187773] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-17T22:24:12.188361] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-17T22:24:12.188401] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-17T22:24:12.189083] [DEBUG] [LOCAL ] WIW: Trimmed 29145 records to 20553 (keeping 200 days of data) [2025-10-17T22:24:12.310506] [DEBUG] [LOCAL ] WIW: Primary data saved (20553 records). [2025-10-17T22:24:12.310674] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-17T22:24:12.310792] [INFO ] [MAIN ] Update Progress: 2297/2368 symbols completed. WIW took 33.7s. Estimated remaining: 10m 1s. Rate: 7.1 symbols/min [2025-10-17T22:24:12.473352] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:24:12.482439] [DEBUG] [LOCAL ] WLKP: Loaded 7090 existing records from primary storage. [2025-10-17T22:24:12.482684] [INFO ] [MAIN ] WLKP: Loaded 7090 existing records. [2025-10-17T22:24:12.547511] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-17T22:24:12.656881] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:24:12.657070] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-17T22:24:12.657115] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-17T22:24:12.657251] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-17T22:24:12.657287] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-17T22:24:13.008557] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:24:13.016082] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-17T22:24:13.020472] [INFO ] [REMOTE ] WKC: Full fetch complete (50143 records). [2025-10-17T22:24:13.020555] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-17T22:24:13.347476] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-10-17T22:24:13.401614] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-17T22:24:13.401735] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-17T22:24:13.403363] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-17T22:24:13.403490] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-17T22:24:13.404809] [DEBUG] [LOCAL ] WKC: Trimmed 50143 records to 35103 (keeping 200 days of data) [2025-10-17T22:24:13.623311] [DEBUG] [LOCAL ] WKC: Primary data saved (35103 records). [2025-10-17T22:24:13.623424] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-17T22:24:13.623972] [INFO ] [MAIN ] Update Progress: 2298/2368 symbols completed. WKC took 31.1s. Estimated remaining: 9m 52s. Rate: 7.1 symbols/min [2025-10-17T22:24:13.798088] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:24:13.798260] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-17T22:24:13.798467] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-17T22:24:13.798621] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-17T22:24:13.798807] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-17T22:24:13.798984] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-17T22:24:13.799105] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-17T22:24:13.962684] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T22:24:14.147472] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-17T22:24:14.186169] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:24:14.234136] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-17T22:24:14.942297] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-10-17T22:24:15.305345] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-17T22:24:15.747442] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-17T22:24:15.761698] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T22:24:16.496117] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-17T22:24:16.542367] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-17T22:24:17.342344] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-17T22:24:18.125390] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-17T22:24:18.142256] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-17T22:24:18.235000] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T22:24:18.769678] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-17T22:24:18.942303] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-17T22:24:19.742300] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-17T22:24:20.091221] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-17T22:24:20.520104] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T22:24:20.542240] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-17T22:24:21.342298] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-17T22:24:22.078349] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-17T22:24:22.142279] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-17T22:24:22.207290] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T22:24:22.705223] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-17T22:24:22.942318] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-17T22:24:23.293191] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-17T22:24:23.742295] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-17T22:24:24.164978] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-17T22:24:24.542339] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-17T22:24:24.968115] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-17T22:24:25.342317] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-17T22:24:26.142341] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-17T22:24:26.816800] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-17T22:24:26.842682] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T22:24:26.942333] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-17T22:24:27.742306] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-17T22:24:28.542318] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-17T22:24:28.604399] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-17T22:24:29.173580] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T22:24:29.179299] [INFO ] [REMOTE ] WK: Full fetch complete (53322 records). [2025-10-17T22:24:29.179471] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-17T22:24:29.348998] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-17T22:24:29.392172] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T22:24:29.591685] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-17T22:24:29.591798] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-17T22:24:29.593011] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-17T22:24:29.593076] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-17T22:24:29.594387] [DEBUG] [LOCAL ] WK: Trimmed 53322 records to 37823 (keeping 200 days of data) [2025-10-17T22:24:29.794127] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-17T22:24:29.824169] [DEBUG] [LOCAL ] WK: Primary data saved (37823 records). [2025-10-17T22:24:29.824275] [INFO ] [MAIN ] WK: Full history saved. [2025-10-17T22:24:29.824353] [INFO ] [MAIN ] Update Progress: 2299/2368 symbols completed. WK took 51.1s. Estimated remaining: 9m 44s. Rate: 7.1 symbols/min [2025-10-17T22:24:29.993462] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:24:30.022552] [DEBUG] [LOCAL ] WLY: Loaded 30121 existing records from primary storage. [2025-10-17T22:24:30.022855] [INFO ] [MAIN ] WLY: Loaded 30121 existing records. [2025-10-17T22:24:30.147420] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-17T22:24:30.202985] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:24:30.203161] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-17T22:24:30.203276] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-17T22:24:30.203477] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-17T22:24:30.203527] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-17T22:24:30.550421] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:24:30.909423] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-17T22:24:30.942265] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-17T22:24:31.742277] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-17T22:24:32.510297] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T22:24:32.542284] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-17T22:24:32.580349] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-17T22:24:33.342336] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-17T22:24:34.066467] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-17T22:24:34.151723] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-17T22:24:34.153669] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-17T22:24:34.160742] [INFO ] [REMOTE ] WLK: Full fetch complete (63877 records). [2025-10-17T22:24:34.160890] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-17T22:24:34.538934] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-17T22:24:34.539010] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-17T22:24:34.540104] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-17T22:24:34.540177] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-17T22:24:34.541433] [DEBUG] [LOCAL ] WLK: Trimmed 63877 records to 46398 (keeping 200 days of data) [2025-10-17T22:24:34.644311] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-17T22:24:34.828936] [DEBUG] [LOCAL ] WLK: Primary data saved (46398 records). [2025-10-17T22:24:34.829069] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-17T22:24:34.829188] [INFO ] [MAIN ] Update Progress: 2300/2368 symbols completed. WLK took 33.5s. Estimated remaining: 9m 36s. Rate: 7.1 symbols/min [2025-10-17T22:24:34.947466] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-17T22:24:34.996497] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:24:35.043592] [DEBUG] [LOCAL ] WM: Loaded 51360 existing records from primary storage. [2025-10-17T22:24:35.043922] [INFO ] [MAIN ] WM: Loaded 51360 existing records. [2025-10-17T22:24:35.219072] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:24:35.219306] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-17T22:24:35.219353] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-17T22:24:35.219555] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-17T22:24:35.219611] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-17T22:24:35.562968] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:24:35.669817] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-17T22:24:35.671415] [INFO ] [REMOTE ] WLKP: Full fetch complete (10068 records). [2025-10-17T22:24:35.671485] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-17T22:24:35.747343] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-10-17T22:24:36.029514] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-17T22:24:36.029589] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-17T22:24:36.029848] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-17T22:24:36.029908] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-17T22:24:36.030320] [DEBUG] [LOCAL ] WLKP: Trimmed 10068 records to 7181 (keeping 200 days of data) [2025-10-17T22:24:36.071772] [DEBUG] [LOCAL ] WLKP: Primary data saved (7181 records). [2025-10-17T22:24:36.071912] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-17T22:24:36.072016] [INFO ] [MAIN ] Update Progress: 2301/2368 symbols completed. WLKP took 23.8s. Estimated remaining: 9m 27s. Rate: 7.1 symbols/min [2025-10-17T22:24:36.235386] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:24:36.284807] [DEBUG] [LOCAL ] WMB: Loaded 54062 existing records from primary storage. [2025-10-17T22:24:36.285131] [INFO ] [MAIN ] WMB: Loaded 54062 existing records. [2025-10-17T22:24:36.457969] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:24:36.458208] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-17T22:24:36.458265] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-17T22:24:36.458477] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-17T22:24:36.458532] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-17T22:24:36.552073] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-10-17T22:24:36.802063] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:24:37.342305] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-17T22:24:37.596447] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T22:24:37.782911] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-17T22:24:37.916121] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-17T22:24:38.142270] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-17T22:24:38.942272] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-17T22:24:39.509934] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-17T22:24:39.742321] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-17T22:24:40.105139] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-17T22:24:40.542309] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-17T22:24:40.868154] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-17T22:24:41.342304] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-17T22:24:41.726705] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-17T22:24:41.748583] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-17T22:24:41.749252] [INFO ] [REMOTE ] WLTG: Full fetch complete (1678 records). [2025-10-17T22:24:41.749318] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-17T22:24:41.921664] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T22:24:41.921824] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-17T22:24:41.921888] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-17T22:24:41.921935] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-17T22:24:41.921989] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-17T22:24:41.922033] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-17T22:24:41.922072] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-17T22:24:41.922123] [INFO ] [MAIN ] Update Progress: 2302/2368 symbols completed. WLTG took 28.3s. Estimated remaining: 9m 18s. Rate: 7.1 symbols/min [2025-10-17T22:24:42.085477] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:24:42.102117] [DEBUG] [LOCAL ] WMK: Loaded 14814 existing records from primary storage. [2025-10-17T22:24:42.102378] [INFO ] [MAIN ] WMK: Loaded 14814 existing records. [2025-10-17T22:24:42.147482] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-17T22:24:42.281815] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:24:42.282019] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-17T22:24:42.282065] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-17T22:24:42.282242] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-17T22:24:42.282299] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-17T22:24:42.629637] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:24:42.942311] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-17T22:24:43.563305] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-17T22:24:43.742317] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-10-17T22:24:44.498420] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T22:24:44.542246] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-17T22:24:45.342321] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-10-17T22:24:45.511091] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T22:24:45.848425] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-17T22:24:46.142317] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-17T22:24:46.488919] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-17T22:24:46.942272] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-17T22:24:47.742264] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-17T22:24:47.757720] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T22:24:48.058615] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-17T22:24:48.542286] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-17T22:24:48.644341] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-17T22:24:49.342327] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-17T22:24:49.366262] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-17T22:24:50.142284] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-17T22:24:50.942320] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-17T22:24:51.078020] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-17T22:24:51.533212] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-17T22:24:51.742288] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-17T22:24:52.542290] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-17T22:24:52.862557] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-17T22:24:53.342334] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-17T22:24:53.615460] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T22:24:53.871505] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-17T22:24:54.142295] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-17T22:24:54.942315] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-17T22:24:55.163506] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-17T22:24:55.549556] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T22:24:55.742305] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-17T22:24:55.953367] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-17T22:24:56.542346] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-17T22:24:57.342278] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-17T22:24:57.591449] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T22:24:58.130501] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T22:24:58.142244] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-17T22:24:58.713027] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-17T22:24:58.942265] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-17T22:24:59.185767] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-17T22:24:59.742333] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-17T22:25:00.542310] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-17T22:25:00.585539] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-17T22:25:00.619700] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-17T22:25:01.342287] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-17T22:25:02.142346] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-17T22:25:02.512579] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-17T22:25:02.786189] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-17T22:25:02.942257] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-17T22:25:02.995618] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-17T22:25:03.742409] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-17T22:25:04.542277] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-17T22:25:04.790097] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-17T22:25:05.320361] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-17T22:25:05.342254] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-17T22:25:06.142281] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-17T22:25:06.479473] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T22:25:06.874975] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-17T22:25:06.942250] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-17T22:25:07.460594] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-17T22:25:07.742305] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-17T22:25:08.542332] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-17T22:25:09.193456] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-17T22:25:09.199460] [INFO ] [REMOTE ] WLY: Full fetch complete (42957 records). [2025-10-17T22:25:09.199698] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-17T22:25:09.346691] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-17T22:25:09.771199] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-17T22:25:09.771514] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-17T22:25:09.775759] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-10-17T22:25:09.773703] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-17T22:25:09.787503] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-17T22:25:09.789856] [DEBUG] [LOCAL ] WLY: Trimmed 42957 records to 30295 (keeping 200 days of data) [2025-10-17T22:25:09.999771] [DEBUG] [LOCAL ] WLY: Primary data saved (30295 records). [2025-10-17T22:25:09.999921] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-17T22:25:10.000005] [INFO ] [MAIN ] Update Progress: 2303/2368 symbols completed. WLY took 40.2s. Estimated remaining: 9m 11s. Rate: 7.1 symbols/min [2025-10-17T22:25:10.146024] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-17T22:25:10.169618] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:25:10.209676] [DEBUG] [LOCAL ] WMS: Loaded 39953 existing records from primary storage. [2025-10-17T22:25:10.209969] [INFO ] [MAIN ] WMS: Loaded 39953 existing records. [2025-10-17T22:25:10.390751] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-17T22:25:10.395993] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:25:10.399298] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-17T22:25:10.399364] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-17T22:25:10.399551] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-17T22:25:10.399636] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-17T22:25:10.399502] [INFO ] [REMOTE ] WMK: Full fetch complete (20019 records). [2025-10-17T22:25:10.441790] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-17T22:25:11.062817] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:25:11.066745] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-10-17T22:25:11.156980] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-17T22:25:11.166891] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-17T22:25:11.181327] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-17T22:25:11.181481] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-17T22:25:11.186857] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-17T22:25:11.190909] [DEBUG] [LOCAL ] WMK: Trimmed 20019 records to 14886 (keeping 200 days of data) [2025-10-17T22:25:11.288992] [DEBUG] [LOCAL ] WMK: Primary data saved (14886 records). [2025-10-17T22:25:11.289144] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-17T22:25:11.289226] [INFO ] [MAIN ] Update Progress: 2304/2368 symbols completed. WMK took 29.4s. Estimated remaining: 9m 2s. Rate: 7.1 symbols/min [2025-10-17T22:25:11.462145] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:25:11.512097] [DEBUG] [LOCAL ] WMT: Loaded 54190 existing records from primary storage. [2025-10-17T22:25:11.512484] [INFO ] [MAIN ] WMT: Loaded 54190 existing records. [2025-10-17T22:25:11.690063] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:25:11.690472] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-17T22:25:11.690530] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-17T22:25:11.690820] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-17T22:25:11.690892] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-17T22:25:11.745108] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-17T22:25:12.049608] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:25:12.085200] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-17T22:25:12.117722] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-17T22:25:12.125311] [INFO ] [REMOTE ] WM: Full fetch complete (73889 records). [2025-10-17T22:25:12.125439] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-17T22:25:12.521189] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-17T22:25:12.521302] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-17T22:25:12.522682] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-17T22:25:12.522845] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-17T22:25:12.542548] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-10-17T22:25:12.546846] [DEBUG] [LOCAL ] WM: Trimmed 73889 records to 51698 (keeping 200 days of data) [2025-10-17T22:25:12.547984] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T22:25:12.875915] [DEBUG] [LOCAL ] WM: Primary data saved (51698 records). [2025-10-17T22:25:12.876052] [INFO ] [MAIN ] WM: Full history saved. [2025-10-17T22:25:12.876136] [INFO ] [MAIN ] Update Progress: 2305/2368 symbols completed. WM took 38.0s. Estimated remaining: 8m 53s. Rate: 7.1 symbols/min [2025-10-17T22:25:13.040833] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:25:13.076194] [DEBUG] [LOCAL ] WNC: Loaded 38772 existing records from primary storage. [2025-10-17T22:25:13.076467] [INFO ] [MAIN ] WNC: Loaded 38772 existing records. [2025-10-17T22:25:13.250239] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:25:13.250468] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-17T22:25:13.250536] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-17T22:25:13.250799] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-17T22:25:13.250857] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-17T22:25:13.347443] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-17T22:25:13.600580] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:25:14.142309] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-17T22:25:14.889073] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T22:25:14.942293] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-17T22:25:15.205155] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-17T22:25:15.665037] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-17T22:25:15.742275] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-17T22:25:16.398823] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-17T22:25:16.477308] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-17T22:25:16.484966] [INFO ] [REMOTE ] WMB: Full fetch complete (77851 records). [2025-10-17T22:25:16.485110] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-17T22:25:16.548826] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-17T22:25:16.872052] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-17T22:25:16.872131] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-17T22:25:16.873353] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-17T22:25:16.873418] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-17T22:25:16.874881] [DEBUG] [LOCAL ] WMB: Trimmed 77851 records to 54452 (keeping 200 days of data) [2025-10-17T22:25:17.207921] [DEBUG] [LOCAL ] WMB: Primary data saved (54452 records). [2025-10-17T22:25:17.208054] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-17T22:25:17.208132] [INFO ] [MAIN ] Update Progress: 2306/2368 symbols completed. WMB took 41.1s. Estimated remaining: 8m 45s. Rate: 7.1 symbols/min [2025-10-17T22:25:17.349303] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-17T22:25:17.380852] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:25:17.432994] [DEBUG] [LOCAL ] WOLF: Loaded 53549 existing records from primary storage. [2025-10-17T22:25:17.433469] [INFO ] [MAIN ] WOLF: Loaded 53549 existing records. [2025-10-17T22:25:17.606440] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:25:17.606744] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-17T22:25:17.606805] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-17T22:25:17.607327] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-17T22:25:17.607386] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-17T22:25:17.967800] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:25:18.142299] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-10-17T22:25:18.905562] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-17T22:25:18.942267] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-17T22:25:19.020632] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-17T22:25:19.742307] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-17T22:25:20.109452] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-17T22:25:20.208357] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-17T22:25:20.542321] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-17T22:25:21.342361] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-17T22:25:22.142316] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-10-17T22:25:22.310355] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-10-17T22:25:22.412483] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-17T22:25:22.942340] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-17T22:25:23.291808] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-17T22:25:23.465533] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-17T22:25:23.742311] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-17T22:25:24.194363] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T22:25:24.542354] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-17T22:25:25.342433] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-17T22:25:25.906450] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-17T22:25:26.142257] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-17T22:25:26.487915] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T22:25:26.942344] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-17T22:25:27.155169] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-17T22:25:27.742315] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-17T22:25:28.414934] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-17T22:25:28.453157] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-17T22:25:28.542265] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-17T22:25:29.278462] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-17T22:25:29.342256] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-17T22:25:30.142304] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-17T22:25:30.751721] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-17T22:25:30.942259] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-17T22:25:31.336412] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-17T22:25:31.742355] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-17T22:25:32.542332] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-17T22:25:32.748727] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-17T22:25:33.352520] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-17T22:25:33.351016] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-17T22:25:33.561282] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-17T22:25:34.142340] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-17T22:25:34.231359] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T22:25:34.942298] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-17T22:25:35.742272] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-17T22:25:35.881966] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-17T22:25:36.523527] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-17T22:25:36.546235] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-17T22:25:36.552390] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-17T22:25:37.328104] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-17T22:25:37.342252] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-17T22:25:38.142322] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-17T22:25:38.940624] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-17T22:25:38.945435] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-10-17T22:25:38.946841] [INFO ] [REMOTE ] WMS: Full fetch complete (57139 records). [2025-10-17T22:25:38.946921] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-17T22:25:39.372753] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.83 seconds). [2025-10-17T22:25:39.387543] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-17T22:25:39.398057] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-17T22:25:39.400080] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-17T22:25:39.400674] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-17T22:25:39.403805] [DEBUG] [LOCAL ] WMS: Trimmed 57139 records to 40206 (keeping 200 days of data) [2025-10-17T22:25:39.516250] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-17T22:25:39.683881] [DEBUG] [LOCAL ] WMS: Primary data saved (40206 records). [2025-10-17T22:25:39.684011] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-17T22:25:39.684940] [INFO ] [MAIN ] Update Progress: 2307/2368 symbols completed. WMS took 29.7s. Estimated remaining: 8m 37s. Rate: 7.1 symbols/min [2025-10-17T22:25:39.747470] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-17T22:25:39.854031] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:25:39.878626] [DEBUG] [LOCAL ] WOR: Loaded 24158 existing records from primary storage. [2025-10-17T22:25:39.878941] [INFO ] [MAIN ] WOR: Loaded 24158 existing records. [2025-10-17T22:25:40.053086] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:25:40.053343] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-17T22:25:40.053396] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-17T22:25:40.053560] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-17T22:25:40.053598] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-17T22:25:40.403966] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:25:40.542245] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-10-17T22:25:41.347827] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-17T22:25:41.370810] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T22:25:41.749749] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-17T22:25:41.775223] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-17T22:25:42.142298] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-17T22:25:42.942359] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-10-17T22:25:43.535633] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-17T22:25:43.742344] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-17T22:25:43.919269] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-17T22:25:44.542319] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-17T22:25:44.566964] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-17T22:25:44.914455] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-17T22:25:45.342330] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-17T22:25:45.780174] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-17T22:25:46.142348] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-17T22:25:46.942361] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-10-17T22:25:47.442447] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T22:25:47.448033] [INFO ] [REMOTE ] WNC: Full fetch complete (57772 records). [2025-10-17T22:25:47.448255] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-17T22:25:47.753981] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-17T22:25:47.853255] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-17T22:25:47.853335] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-17T22:25:47.854415] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-17T22:25:47.854496] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-17T22:25:47.856105] [DEBUG] [LOCAL ] WNC: Trimmed 57772 records to 39048 (keeping 200 days of data) [2025-10-17T22:25:47.974263] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-17T22:25:48.131808] [DEBUG] [LOCAL ] WNC: Primary data saved (39048 records). [2025-10-17T22:25:48.131952] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-17T22:25:48.132065] [INFO ] [MAIN ] Update Progress: 2308/2368 symbols completed. WNC took 35.3s. Estimated remaining: 8m 28s. Rate: 7.1 symbols/min [2025-10-17T22:25:48.296798] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:25:48.326564] [DEBUG] [LOCAL ] WOW: Loaded 31268 existing records from primary storage. [2025-10-17T22:25:48.326864] [INFO ] [MAIN ] WOW: Loaded 31268 existing records. [2025-10-17T22:25:48.503950] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:25:48.504264] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-17T22:25:48.504329] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-17T22:25:48.504535] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-17T22:25:48.504609] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-17T22:25:48.567201] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-17T22:25:48.880696] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:25:49.008951] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-17T22:25:49.342276] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-10-17T22:25:49.471961] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-17T22:25:50.142295] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-10. [2025-10-17T22:25:50.541536] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-17T22:25:50.942254] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-17T22:25:51.022276] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-17T22:25:51.742328] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-17T22:25:52.166391] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-17T22:25:52.430844] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-17T22:25:52.438615] [INFO ] [REMOTE ] WMT: Full fetch complete (77980 records). [2025-10-17T22:25:52.438786] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-17T22:25:52.547123] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-17T22:25:52.662752] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-17T22:25:52.747364] [INFO ] [REMOTE ] WOLF: Full fetch complete (77318 records). [2025-10-17T22:25:52.763547] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-17T22:25:53.038882] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-17T22:25:53.042035] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-17T22:25:53.059297] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-17T22:25:53.062347] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-17T22:25:53.175635] [DEBUG] [LOCAL ] WMT: Trimmed 77980 records to 54580 (keeping 200 days of data) [2025-10-17T22:25:53.353484] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-17T22:25:53.374996] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-17T22:25:53.375388] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-17T22:25:53.377548] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-17T22:25:53.380102] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-17T22:25:53.388223] [DEBUG] [LOCAL ] WOLF: Trimmed 77318 records to 53926 (keeping 200 days of data) [2025-10-17T22:25:53.744236] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T22:25:53.954615] [DEBUG] [LOCAL ] WOLF: Primary data saved (53926 records). [2025-10-17T22:25:53.958308] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-17T22:25:53.958796] [INFO ] [MAIN ] Update Progress: 2309/2368 symbols completed. WOLF took 36.8s. Estimated remaining: 8m 20s. Rate: 7.1 symbols/min [2025-10-17T22:25:54.083768] [DEBUG] [LOCAL ] WMT: Primary data saved (54580 records). [2025-10-17T22:25:54.099296] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-17T22:25:54.112277] [INFO ] [MAIN ] Update Progress: 2310/2368 symbols completed. WMT took 42.8s. Estimated remaining: 8m 11s. Rate: 7.1 symbols/min [2025-10-17T22:25:54.143223] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-17T22:25:54.143148] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:25:54.319764] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:25:54.353921] [DEBUG] [LOCAL ] WPC: Loaded 48619 existing records from primary storage. [2025-10-17T22:25:54.354312] [INFO ] [MAIN ] WPC: Loaded 48619 existing records. [2025-10-17T22:25:54.547746] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:25:54.548274] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-17T22:25:54.548476] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-17T22:25:54.563914] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-17T22:25:54.564032] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-17T22:25:54.600379] [DEBUG] [LOCAL ] WPM: Loaded 53164 existing records from primary storage. [2025-10-17T22:25:54.625484] [INFO ] [MAIN ] WPM: Loaded 53164 existing records. [2025-10-17T22:25:54.692555] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-17T22:25:54.951525] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-17T22:25:55.016489] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:25:55.032222] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-17T22:25:55.039705] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-17T22:25:55.042757] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-17T22:25:55.043152] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-17T22:25:55.210175] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:25:55.472800] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:25:55.513757] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-17T22:25:55.742316] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-10-17T22:25:56.216980] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-17T22:25:56.542276] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-10-17T22:25:57.342322] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-17T22:25:57.522978] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T22:25:57.788606] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T22:25:58.142246] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-17T22:25:58.700397] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-17T22:25:58.942283] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-17T22:25:59.742286] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-17T22:26:00.008777] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-17T22:26:00.307204] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-17T22:26:00.542348] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-17T22:26:01.342261] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-17T22:26:01.665484] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-17T22:26:01.696467] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-17T22:26:02.142366] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-17T22:26:02.538335] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-17T22:26:02.942353] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-17T22:26:03.742293] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-17T22:26:04.058566] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-17T22:26:04.480703] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-17T22:26:04.542293] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-17T22:26:04.714511] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-17T22:26:05.342297] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-17T22:26:05.577353] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-17T22:26:06.142310] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-17T22:26:06.477168] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-17T22:26:06.942345] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-17T22:26:07.742277] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-17T22:26:07.984159] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-17T22:26:08.255377] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-17T22:26:08.542262] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-17T22:26:09.342261] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-17T22:26:09.512520] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-17T22:26:10.142336] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-17T22:26:10.280706] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-17T22:26:10.431573] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-17T22:26:10.942372] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-17T22:26:11.742396] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-17T22:26:12.180194] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-17T22:26:12.542280] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-17T22:26:12.727108] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-17T22:26:12.931384] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-17T22:26:13.342370] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-17T22:26:14.037018] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-17T22:26:14.142254] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-17T22:26:14.830948] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T22:26:14.942267] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-17T22:26:15.742336] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-17T22:26:16.009829] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-17T22:26:16.542320] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-17T22:26:16.964753] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T22:26:16.968398] [INFO ] [REMOTE ] WOR: Full fetch complete (36343 records). [2025-10-17T22:26:16.968482] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-17T22:26:17.145203] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-17T22:26:17.349470] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-17T22:26:17.383211] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-17T22:26:17.383275] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-17T22:26:17.384046] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-17T22:26:17.384126] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-17T22:26:17.384986] [DEBUG] [LOCAL ] WOR: Trimmed 36343 records to 24332 (keeping 200 days of data) [2025-10-17T22:26:17.532733] [DEBUG] [LOCAL ] WOR: Primary data saved (24332 records). [2025-10-17T22:26:17.532855] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-17T22:26:17.532934] [INFO ] [MAIN ] Update Progress: 2311/2368 symbols completed. WOR took 37.8s. Estimated remaining: 8m 3s. Rate: 7.1 symbols/min [2025-10-17T22:26:17.699951] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:26:17.700108] [DEBUG] [LOCAL ] WPP: No existing data file found in primary storage. [2025-10-17T22:26:17.700145] [WARN ] [MAIN ] WPP: No existing data found, performing full refresh instead. [2025-10-17T22:26:17.700262] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-17T22:26:17.700302] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-17T22:26:17.700342] [DEBUG] [LOCAL ] WPP: No primary data file found to delete. [2025-10-17T22:26:17.700374] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-17T22:26:18.051034] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:26:18.142250] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-10-17T22:26:18.735434] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-17T22:26:18.825580] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T22:26:18.942305] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-17T22:26:19.300698] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-17T22:26:19.742402] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-17T22:26:20.542356] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-17T22:26:20.948108] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-17T22:26:21.342265] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-17T22:26:21.450118] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-17T22:26:21.895503] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T22:26:22.142312] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-17T22:26:22.942262] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-17T22:26:23.219765] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-17T22:26:23.253962] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-17T22:26:23.742270] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-17T22:26:24.542318] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-17T22:26:24.688125] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T22:26:25.127826] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-17T22:26:25.342323] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-17T22:26:25.801210] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-17T22:26:25.806148] [INFO ] [REMOTE ] WOW: Full fetch complete (42827 records). [2025-10-17T22:26:25.806236] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-17T22:26:26.147707] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-17T22:26:26.180092] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-17T22:26:26.180175] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-17T22:26:26.181146] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-17T22:26:26.181231] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-17T22:26:26.182311] [DEBUG] [LOCAL ] WOW: Trimmed 42827 records to 31535 (keeping 200 days of data) [2025-10-17T22:26:26.353342] [DEBUG] [LOCAL ] WOW: Primary data saved (31535 records). [2025-10-17T22:26:26.353460] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-17T22:26:26.353534] [INFO ] [MAIN ] Update Progress: 2312/2368 symbols completed. WOW took 38.2s. Estimated remaining: 7m 54s. Rate: 7.1 symbols/min [2025-10-17T22:26:26.521206] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:26:26.568604] [DEBUG] [LOCAL ] WRB: Loaded 51168 existing records from primary storage. [2025-10-17T22:26:26.568938] [INFO ] [MAIN ] WRB: Loaded 51168 existing records. [2025-10-17T22:26:26.757799] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:26:26.758101] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-17T22:26:26.758242] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-17T22:26:26.758598] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-17T22:26:26.758721] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-17T22:26:26.930373] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T22:26:26.956867] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-17T22:26:27.147173] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:26:27.538984] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T22:26:27.545510] [INFO ] [REMOTE ] WPC: Full fetch complete (70587 records). [2025-10-17T22:26:27.545619] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-17T22:26:27.750716] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-10-17T22:26:27.936473] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-17T22:26:27.936549] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-17T22:26:27.937745] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-17T22:26:27.937809] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-17T22:26:27.939309] [DEBUG] [LOCAL ] WPC: Trimmed 70587 records to 48956 (keeping 200 days of data) [2025-10-17T22:26:28.234521] [DEBUG] [LOCAL ] WPC: Primary data saved (48956 records). [2025-10-17T22:26:28.234673] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-17T22:26:28.234771] [INFO ] [MAIN ] Update Progress: 2313/2368 symbols completed. WPC took 34.3s. Estimated remaining: 7m 46s. Rate: 7.1 symbols/min [2025-10-17T22:26:28.398789] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:26:28.447960] [DEBUG] [LOCAL ] WRBY: Loaded 51103 existing records from primary storage. [2025-10-17T22:26:28.448366] [INFO ] [MAIN ] WRBY: Loaded 51103 existing records. [2025-10-17T22:26:28.546133] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-17T22:26:28.625515] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:26:28.625732] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-17T22:26:28.625784] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-17T22:26:28.626028] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-17T22:26:28.626085] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-17T22:26:28.973845] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:26:29.002302] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-17T22:26:29.009525] [INFO ] [REMOTE ] WPM: Full fetch complete (76351 records). [2025-10-17T22:26:29.009637] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-17T22:26:29.347151] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-10-17T22:26:29.410379] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-17T22:26:29.410503] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-17T22:26:29.412007] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-17T22:26:29.412105] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-17T22:26:29.414355] [DEBUG] [LOCAL ] WPM: Trimmed 76351 records to 53554 (keeping 200 days of data) [2025-10-17T22:26:29.534492] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-17T22:26:29.785498] [DEBUG] [LOCAL ] WPM: Primary data saved (53554 records). [2025-10-17T22:26:29.785631] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-17T22:26:29.786289] [INFO ] [MAIN ] Update Progress: 2314/2368 symbols completed. WPM took 35.7s. Estimated remaining: 7m 37s. Rate: 7.1 symbols/min [2025-10-17T22:26:30.010276] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:26:30.013350] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T22:26:30.040132] [DEBUG] [LOCAL ] WS: Loaded 23549 existing records from primary storage. [2025-10-17T22:26:30.040380] [INFO ] [MAIN ] WS: Loaded 23549 existing records. [2025-10-17T22:26:30.147430] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-17T22:26:30.224730] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:26:30.224964] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-17T22:26:30.225015] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-17T22:26:30.225192] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-17T22:26:30.225232] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-17T22:26:30.594945] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:26:30.948534] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-17T22:26:30.974506] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-17T22:26:31.742331] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-17T22:26:32.171808] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-17T22:26:32.400670] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-17T22:26:32.542368] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-17T22:26:33.330170] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T22:26:33.342256] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-17T22:26:34.142314] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-17T22:26:34.199980] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T22:26:34.945183] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-10-17T22:26:34.950834] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-17T22:26:35.747347] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-17T22:26:35.761549] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T22:26:36.245554] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-17T22:26:36.542316] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-17T22:26:37.342252] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-17T22:26:37.620091] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-17T22:26:38.030975] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T22:26:38.142254] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-17T22:26:38.942326] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-17T22:26:39.150715] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-17T22:26:39.742264] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-17T22:26:39.837253] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-17T22:26:39.899703] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-17T22:26:40.542287] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-17T22:26:41.342274] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-17T22:26:41.415209] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T22:26:41.484604] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-17T22:26:42.142283] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-10-17T22:26:42.942319] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-17T22:26:43.142077] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-17T22:26:43.651462] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-17T22:26:43.742248] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-10. [2025-10-17T22:26:44.542264] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-17T22:26:44.735293] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-17T22:26:45.167447] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-17T22:26:45.172871] [INFO ] [REMOTE ] WPP: Full fetch complete (47299 records). [2025-10-17T22:26:45.172978] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-17T22:26:45.346529] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-17T22:26:45.553501] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-17T22:26:45.553668] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-17T22:26:45.554631] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-17T22:26:45.554730] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-17T22:26:45.555880] [DEBUG] [LOCAL ] WPP: Trimmed 47299 records to 34978 (keeping 200 days of data) [2025-10-17T22:26:45.764412] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-17T22:26:45.794805] [DEBUG] [LOCAL ] WPP: Primary data saved (34978 records). [2025-10-17T22:26:45.794950] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-17T22:26:45.795026] [INFO ] [MAIN ] Update Progress: 2315/2368 symbols completed. WPP took 28.3s. Estimated remaining: 7m 29s. Rate: 7.1 symbols/min [2025-10-17T22:26:45.957947] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:26:46.006351] [DEBUG] [LOCAL ] WSM: Loaded 49435 existing records from primary storage. [2025-10-17T22:26:46.006693] [INFO ] [MAIN ] WSM: Loaded 49435 existing records. [2025-10-17T22:26:46.145621] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-17T22:26:46.181939] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:26:46.182952] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-17T22:26:46.183001] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-17T22:26:46.183212] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-17T22:26:46.183267] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-17T22:26:46.549497] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:26:46.942316] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-10-17T22:26:47.399611] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-17T22:26:47.430677] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-17T22:26:47.742300] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-17T22:26:48.542265] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-17T22:26:48.609875] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T22:26:49.342273] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-17T22:26:49.425634] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-17T22:26:50.142322] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-17T22:26:50.203308] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-17T22:26:50.942282] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-17T22:26:51.046192] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-17T22:26:51.151269] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T22:26:51.742335] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-17T22:26:52.542282] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-17T22:26:52.643237] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T22:26:53.342338] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-17T22:26:53.587058] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T22:26:53.642497] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T22:26:54.142308] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-17T22:26:54.942331] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-17T22:26:55.021697] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T22:26:55.059618] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-17T22:26:55.742286] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-17T22:26:56.542301] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-17T22:26:56.622159] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-17T22:26:57.272393] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T22:26:57.342279] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-17T22:26:57.649423] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-17T22:26:58.142299] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-17T22:26:58.942345] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-17T22:26:59.173694] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-17T22:26:59.742256] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-17T22:26:59.761950] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-17T22:26:59.833974] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-17T22:26:59.843429] [INFO ] [REMOTE ] WRBY: Full fetch complete (73723 records). [2025-10-17T22:26:59.843552] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-17T22:27:00.237137] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-17T22:27:00.237232] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-17T22:27:00.238584] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-17T22:27:00.238692] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-17T22:27:00.240340] [DEBUG] [LOCAL ] WRBY: Trimmed 73723 records to 51470 (keeping 200 days of data) [2025-10-17T22:27:00.542413] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-17T22:27:00.546851] [DEBUG] [LOCAL ] WRBY: Primary data saved (51470 records). [2025-10-17T22:27:00.548312] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-17T22:27:00.548453] [INFO ] [MAIN ] Update Progress: 2316/2368 symbols completed. WRBY took 32.3s. Estimated remaining: 7m 20s. Rate: 7.1 symbols/min [2025-10-17T22:27:00.768791] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:27:00.794545] [DEBUG] [LOCAL ] WSO: Loaded 25974 existing records from primary storage. [2025-10-17T22:27:00.794854] [INFO ] [MAIN ] WSO: Loaded 25974 existing records. [2025-10-17T22:27:00.966284] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:27:00.966475] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-17T22:27:00.966523] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-17T22:27:00.966754] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-17T22:27:00.966812] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-17T22:27:01.314312] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:27:01.342240] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-10-17T22:27:01.624178] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T22:27:01.741760] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-17T22:27:01.745167] [INFO ] [REMOTE ] WS: Full fetch complete (35789 records). [2025-10-17T22:27:01.745245] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-17T22:27:02.112913] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-17T22:27:02.113011] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-17T22:27:02.113723] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-17T22:27:02.113783] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-17T22:27:02.114530] [DEBUG] [LOCAL ] WS: Trimmed 35789 records to 23730 (keeping 200 days of data) [2025-10-17T22:27:02.168572] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-17T22:27:02.262105] [DEBUG] [LOCAL ] WS: Primary data saved (23730 records). [2025-10-17T22:27:02.262229] [INFO ] [MAIN ] WS: Full history saved. [2025-10-17T22:27:02.262306] [INFO ] [MAIN ] Update Progress: 2317/2368 symbols completed. WS took 32.5s. Estimated remaining: 7m 12s. Rate: 7.1 symbols/min [2025-10-17T22:27:02.292356] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-17T22:27:02.942265] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-17T22:27:03.742313] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-17T22:27:04.071082] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-17T22:27:04.116385] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-17T22:27:04.542295] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-17T22:27:05.342319] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-17T22:27:05.526950] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T22:27:05.597776] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-17T22:27:06.142388] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-17T22:27:06.836671] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-17T22:27:06.942258] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-17T22:27:07.347792] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-17T22:27:07.632826] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-17T22:27:07.640302] [INFO ] [REMOTE ] WRB: Full fetch complete (73746 records). [2025-10-17T22:27:07.640421] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-17T22:27:07.747465] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-17T22:27:08.033501] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-17T22:27:08.033628] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-17T22:27:08.034895] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-17T22:27:08.034959] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-17T22:27:08.036508] [DEBUG] [LOCAL ] WRB: Trimmed 73746 records to 51552 (keeping 200 days of data) [2025-10-17T22:27:08.348368] [DEBUG] [LOCAL ] WRB: Primary data saved (51552 records). [2025-10-17T22:27:08.348499] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-17T22:27:08.348581] [INFO ] [MAIN ] Update Progress: 2318/2368 symbols completed. WRB took 42.0s. Estimated remaining: 7m 3s. Rate: 7.1 symbols/min [2025-10-17T22:27:08.542285] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-17T22:27:09.211670] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-17T22:27:09.342349] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-17T22:27:10.340632] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-17T22:27:10.351670] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-17T22:27:10.465068] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-17T22:27:10.942305] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-17T22:27:12.072214] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-17T22:27:12.077546] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-17T22:27:12.180788] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T22:27:12.542345] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-17T22:27:13.224179] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-17T22:27:13.342364] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-17T22:27:14.191611] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T22:27:14.202563] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-17T22:27:14.580015] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-17T22:27:14.882449] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T22:27:14.888779] [INFO ] [REMOTE ] WSM: Full fetch complete (71552 records). [2025-10-17T22:27:14.888923] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-17T22:27:14.951782] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-17T22:27:15.276182] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-17T22:27:15.276268] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-17T22:27:15.277538] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-17T22:27:15.277603] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-17T22:27:15.279024] [DEBUG] [LOCAL ] WSM: Trimmed 71552 records to 49738 (keeping 200 days of data) [2025-10-17T22:27:15.593842] [DEBUG] [LOCAL ] WSM: Primary data saved (49738 records). [2025-10-17T22:27:15.593997] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-17T22:27:15.594835] [INFO ] [MAIN ] Update Progress: 2319/2368 symbols completed. WSM took 29.8s. Estimated remaining: 6m 55s. Rate: 7.1 symbols/min [2025-10-17T22:27:16.367322] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-17T22:27:16.374103] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-17T22:27:17.596574] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-17T22:27:17.601054] [INFO ] [REMOTE ] WSO: Full fetch complete (35664 records). [2025-10-17T22:27:17.601136] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-17T22:27:17.989666] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-17T22:27:17.989752] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-17T22:27:17.990530] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-17T22:27:17.990570] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-17T22:27:17.991381] [DEBUG] [LOCAL ] WSO: Trimmed 35664 records to 26167 (keeping 200 days of data) [2025-10-17T22:27:18.151778] [DEBUG] [LOCAL ] WSO: Primary data saved (26167 records). [2025-10-17T22:27:18.151905] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-17T22:27:18.151986] [INFO ] [MAIN ] Update Progress: 2320/2368 symbols completed. WSO took 17.6s. Estimated remaining: 6m 46s. Rate: 7.1 symbols/min [2025-10-17T22:27:18.804978] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:27:18.787229] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:27:18.839601] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:27:18.840424] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:27:18.867442] [DEBUG] [LOCAL ] WSR: Loaded 23098 existing records from primary storage. [2025-10-17T22:27:18.879283] [INFO ] [MAIN ] WSR: Loaded 23098 existing records. [2025-10-17T22:27:19.024609] [DEBUG] [LOCAL ] WST: Loaded 37051 existing records from primary storage. [2025-10-17T22:27:19.030825] [DEBUG] [LOCAL ] WT: Loaded 48467 existing records from primary storage. [2025-10-17T22:27:19.051832] [INFO ] [MAIN ] WST: Loaded 37051 existing records. [2025-10-17T22:27:19.051964] [INFO ] [MAIN ] WT: Loaded 48467 existing records. [2025-10-17T22:27:19.137586] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:27:19.206677] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-17T22:27:19.206525] [DEBUG] [LOCAL ] WTI: Loaded 44979 existing records from primary storage. [2025-10-17T22:27:19.221107] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-17T22:27:19.246466] [INFO ] [MAIN ] WTI: Loaded 44979 existing records. [2025-10-17T22:27:19.331545] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-17T22:27:19.398427] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-17T22:27:19.553789] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:27:19.636193] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:27:19.664140] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-17T22:27:19.669438] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-17T22:27:19.669537] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-17T22:27:19.690534] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-17T22:27:19.695950] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-17T22:27:19.695883] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-17T22:27:19.745255] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-17T22:27:19.782444] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-17T22:27:20.050992] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:27:20.107910] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-17T22:27:20.126860] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-17T22:27:20.187975] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-17T22:27:20.188863] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-17T22:27:20.859796] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:27:20.937635] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:27:20.956109] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-10-17T22:27:21.005857] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-10-17T22:27:21.119103] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:27:21.138081] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-10-17T22:27:21.218586] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:27:21.218905] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-10-17T22:27:22.195339] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-17T22:27:22.200289] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-17T22:27:22.539610] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-17T22:27:22.546039] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-17T22:27:22.770603] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-17T22:27:22.780856] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-17T22:27:22.808516] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-17T22:27:22.818486] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-17T22:27:22.877185] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-17T22:27:22.942258] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-17T22:27:24.021996] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-17T22:27:24.029785] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-17T22:27:24.047905] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-17T22:27:24.287421] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T22:27:24.462673] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-17T22:27:24.542268] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-17T22:27:25.342303] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-17T22:27:25.666377] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-17T22:27:26.069996] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T22:27:26.142256] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-17T22:27:26.513247] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-17T22:27:26.942310] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-17T22:27:27.707438] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-17T22:27:27.742272] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-17T22:27:28.542340] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-17T22:27:28.635482] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-17T22:27:29.342265] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-17T22:27:29.426765] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-17T22:27:29.733930] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-17T22:27:30.142274] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-17T22:27:30.887535] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-17T22:27:30.942254] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-17T22:27:31.326891] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-17T22:27:31.742301] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-17T22:27:32.547441] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-17T22:27:32.565434] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-17T22:27:33.342322] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-17T22:27:33.395817] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-17T22:27:34.148713] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-17T22:27:34.153972] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T22:27:34.216942] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-17T22:27:34.942304] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-17T22:27:35.742263] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-17T22:27:35.887504] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-17T22:27:36.542259] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-17T22:27:36.665283] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-17T22:27:36.929098] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-17T22:27:37.342287] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-17T22:27:37.771227] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-17T22:27:38.142306] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-17T22:27:38.456968] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-17T22:27:38.942306] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-17T22:27:39.656725] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-17T22:27:39.742290] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-17T22:27:40.146459] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-17T22:27:40.542309] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-17T22:27:41.247314] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-17T22:27:41.342254] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-17T22:27:41.573151] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-17T22:27:42.142302] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-17T22:27:42.913358] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T22:27:42.942235] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-17T22:27:43.261483] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-17T22:27:43.742350] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-17T22:27:44.420941] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-17T22:27:44.542285] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-17T22:27:45.342305] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-17T22:27:45.465064] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T22:27:45.998938] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-17T22:27:46.142337] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-17T22:27:46.942366] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-17T22:27:47.023320] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T22:27:47.742320] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-17T22:27:47.806776] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-17T22:27:47.813948] [INFO ] [REMOTE ] WT: Full fetch complete (69745 records). [2025-10-17T22:27:47.814092] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-17T22:27:48.073843] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-17T22:27:48.118123] [INFO ] [REMOTE ] WSR: Full fetch complete (32750 records). [2025-10-17T22:27:48.118257] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-17T22:27:48.421717] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-17T22:27:48.454581] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-17T22:27:48.482557] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-17T22:27:48.489059] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-17T22:27:48.538902] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-17T22:27:48.556081] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-17T22:27:48.585754] [DEBUG] [LOCAL ] WT: Trimmed 69745 records to 48844 (keeping 200 days of data) [2025-10-17T22:27:48.621995] [INFO ] [REMOTE ] WST: Full fetch complete (54294 records). [2025-10-17T22:27:48.632444] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-17T22:27:48.780359] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-17T22:27:48.790619] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-17T22:27:48.791338] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-17T22:27:48.796563] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-17T22:27:48.867481] [DEBUG] [LOCAL ] WSR: Trimmed 32750 records to 23238 (keeping 200 days of data) [2025-10-17T22:27:49.301478] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-17T22:27:49.351463] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-17T22:27:49.364134] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-17T22:27:49.365032] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-17T22:27:49.405258] [DEBUG] [LOCAL ] WST: Trimmed 54294 records to 37318 (keeping 200 days of data) [2025-10-17T22:27:49.665603] [DEBUG] [LOCAL ] WSR: Primary data saved (23238 records). [2025-10-17T22:27:49.685476] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-17T22:27:49.690850] [INFO ] [MAIN ] Update Progress: 2321/2368 symbols completed. WSR took 31.5s. Estimated remaining: 6m 38s. Rate: 7.1 symbols/min [2025-10-17T22:27:49.694985] [DEBUG] [LOCAL ] WST: Primary data saved (37318 records). [2025-10-17T22:27:49.696589] [INFO ] [MAIN ] WST: Full history saved. [2025-10-17T22:27:49.702978] [INFO ] [MAIN ] Update Progress: 2322/2368 symbols completed. WST took 31.5s. Estimated remaining: 6m 30s. Rate: 7.1 symbols/min [2025-10-17T22:27:50.015168] [DEBUG] [LOCAL ] WT: Primary data saved (48844 records). [2025-10-17T22:27:50.020578] [INFO ] [MAIN ] WT: Full history saved. [2025-10-17T22:27:50.031075] [INFO ] [MAIN ] Update Progress: 2323/2368 symbols completed. WT took 31.9s. Estimated remaining: 6m 21s. Rate: 7.1 symbols/min [2025-10-17T22:27:50.174830] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:27:50.179520] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:27:50.192467] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-17T22:27:50.198196] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-17T22:27:50.242396] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-17T22:27:50.255164] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-17T22:27:50.266459] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-17T22:27:50.287292] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-17T22:27:50.361247] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:27:50.560688] [DEBUG] [LOCAL ] WTRG: Loaded 51347 existing records from primary storage. [2025-10-17T22:27:50.568006] [INFO ] [MAIN ] WTRG: Loaded 51347 existing records. [2025-10-17T22:27:50.752020] [DEBUG] [LOCAL ] WTS: Loaded 17528 existing records from primary storage. [2025-10-17T22:27:50.736569] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-17T22:27:50.757563] [INFO ] [MAIN ] WTS: Loaded 17528 existing records. [2025-10-17T22:27:50.919299] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-17T22:27:51.146480] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:27:51.165733] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-17T22:27:51.172689] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:27:51.189005] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-17T22:27:51.195543] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-17T22:27:51.195449] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:27:51.195735] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-17T22:27:51.192135] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-17T22:27:51.201888] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-10-17T22:27:51.201958] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-17T22:27:51.221013] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-17T22:27:51.221140] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-17T22:27:51.756625] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-17T22:27:51.795520] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-17T22:27:51.929199] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:27:51.951445] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-10-17T22:27:51.951114] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:27:52.318719] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-17T22:27:52.542283] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-17T22:27:52.747206] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-17T22:27:52.955992] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-17T22:27:53.342272] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-17T22:27:53.740408] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-17T22:27:53.829563] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-17T22:27:54.142295] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-17T22:27:54.942298] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-10-17T22:27:55.742351] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-17T22:27:55.834040] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-17T22:27:55.951157] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T22:27:56.542303] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-17T22:27:57.342278] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-17T22:27:57.382343] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T22:27:57.884610] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T22:27:58.142258] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-10-17T22:27:58.315441] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-17T22:27:58.658866] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-17T22:27:58.942308] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-17T22:27:59.742306] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-17T22:28:00.542304] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-17T22:28:00.601902] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-17T22:28:01.342273] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-10-17T22:28:01.543783] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-17T22:28:01.551125] [INFO ] [REMOTE ] WTI: Full fetch complete (64064 records). [2025-10-17T22:28:01.551530] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-17T22:28:01.669951] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-17T22:28:01.864803] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-17T22:28:01.965474] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-17T22:28:01.965560] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-17T22:28:01.966693] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-17T22:28:01.966758] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-17T22:28:01.968245] [DEBUG] [LOCAL ] WTI: Trimmed 64064 records to 45285 (keeping 200 days of data) [2025-10-17T22:28:02.166934] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-17T22:28:02.233495] [DEBUG] [LOCAL ] WTI: Primary data saved (45285 records). [2025-10-17T22:28:02.233686] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-17T22:28:02.233841] [INFO ] [MAIN ] Update Progress: 2324/2368 symbols completed. WTI took 44.1s. Estimated remaining: 6m 13s. Rate: 7.1 symbols/min [2025-10-17T22:28:02.401228] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:28:02.445301] [DEBUG] [LOCAL ] WTTR: Loaded 44977 existing records from primary storage. [2025-10-17T22:28:02.445620] [INFO ] [MAIN ] WTTR: Loaded 44977 existing records. [2025-10-17T22:28:02.626748] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:28:02.626965] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-17T22:28:02.627015] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-17T22:28:02.627197] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-17T22:28:02.627236] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-17T22:28:02.947581] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-17T22:28:03.006529] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:28:03.742288] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-10-17T22:28:03.857959] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-17T22:28:04.074141] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-17T22:28:04.232725] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-17T22:28:04.542359] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-17T22:28:05.342293] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-17T22:28:05.781152] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-17T22:28:06.142310] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-10-17T22:28:06.942332] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-17T22:28:07.099042] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-17T22:28:07.718409] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T22:28:07.742239] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-17T22:28:08.032609] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-17T22:28:08.542356] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-17T22:28:09.247086] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T22:28:09.342277] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-17T22:28:09.506064] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-17T22:28:10.142346] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-10-17T22:28:10.632867] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-17T22:28:10.924553] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-17T22:28:10.942261] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-17T22:28:11.742309] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-10-17T22:28:12.330662] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-17T22:28:12.542308] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-17T22:28:12.690890] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-17T22:28:13.342332] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-10-17T22:28:13.604400] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-17T22:28:14.046046] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-17T22:28:14.142254] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-17T22:28:14.942293] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-10. [2025-10-17T22:28:15.620552] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T22:28:15.621851] [INFO ] [REMOTE ] WTM: Full fetch complete (2749 records). [2025-10-17T22:28:15.621922] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-17T22:28:15.747529] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-17T22:28:15.810241] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-17T22:28:15.810570] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-17T22:28:15.810674] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-17T22:28:15.810752] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-17T22:28:15.810831] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-17T22:28:15.810874] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-17T22:28:15.810914] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-17T22:28:15.811027] [INFO ] [MAIN ] Update Progress: 2325/2368 symbols completed. WTM took 26.1s. Estimated remaining: 6m 4s. Rate: 7.1 symbols/min [2025-10-17T22:28:15.989937] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:28:16.044528] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-17T22:28:16.073271] [DEBUG] [LOCAL ] WU: Loaded 53869 existing records from primary storage. [2025-10-17T22:28:16.073604] [INFO ] [MAIN ] WU: Loaded 53869 existing records. [2025-10-17T22:28:16.258952] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:28:16.259168] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-17T22:28:16.259217] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-17T22:28:16.259416] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-17T22:28:16.259477] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-17T22:28:16.548454] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-17T22:28:16.634929] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:28:16.826549] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-17T22:28:17.342360] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-17T22:28:18.142313] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-17T22:28:18.197036] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-17T22:28:18.929259] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-17T22:28:18.946427] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-10-17T22:28:18.948946] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-17T22:28:19.742268] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-17T22:28:20.542265] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-17T22:28:20.574469] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-17T22:28:20.576613] [INFO ] [REMOTE ] WTS: Full fetch complete (25669 records). [2025-10-17T22:28:20.576707] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-17T22:28:20.973159] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T22:28:20.996737] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-17T22:28:20.996800] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-17T22:28:20.997401] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-17T22:28:20.997466] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-17T22:28:20.998295] [DEBUG] [LOCAL ] WTS: Trimmed 25669 records to 17595 (keeping 200 days of data) [2025-10-17T22:28:21.111913] [DEBUG] [LOCAL ] WTS: Primary data saved (17595 records). [2025-10-17T22:28:21.112048] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-17T22:28:21.112129] [INFO ] [MAIN ] Update Progress: 2326/2368 symbols completed. WTS took 31.1s. Estimated remaining: 5m 56s. Rate: 7.1 symbols/min [2025-10-17T22:28:21.304673] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:28:21.349753] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-17T22:28:21.353494] [DEBUG] [LOCAL ] WWW: Loaded 49601 existing records from primary storage. [2025-10-17T22:28:21.353933] [INFO ] [MAIN ] WWW: Loaded 49601 existing records. [2025-10-17T22:28:21.585234] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:28:21.585478] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-17T22:28:21.585528] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-17T22:28:21.585751] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-17T22:28:21.585807] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-17T22:28:21.957412] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:28:22.148520] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-17T22:28:22.154213] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-17T22:28:22.942316] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-17T22:28:23.138758] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-17T22:28:23.742354] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-17T22:28:23.901546] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T22:28:24.405491] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T22:28:24.542300] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-10-17T22:28:25.342270] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-17T22:28:25.522396] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-17T22:28:25.640989] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-17T22:28:26.142296] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-17T22:28:26.942262] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-17T22:28:27.116149] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-17T22:28:27.709493] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-17T22:28:27.742252] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-17T22:28:28.542342] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-17T22:28:28.843622] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T22:28:28.936791] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-17T22:28:29.342303] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-17T22:28:30.120693] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-17T22:28:30.127706] [INFO ] [REMOTE ] WTRG: Full fetch complete (73821 records). [2025-10-17T22:28:30.127821] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-17T22:28:30.149751] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-17T22:28:30.530204] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-17T22:28:30.530319] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-17T22:28:30.531762] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-17T22:28:30.531835] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-17T22:28:30.533449] [DEBUG] [LOCAL ] WTRG: Trimmed 73821 records to 51704 (keeping 200 days of data) [2025-10-17T22:28:30.850610] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-17T22:28:30.875670] [DEBUG] [LOCAL ] WTRG: Primary data saved (51704 records). [2025-10-17T22:28:30.875769] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-17T22:28:30.875844] [INFO ] [MAIN ] Update Progress: 2327/2368 symbols completed. WTRG took 41.1s. Estimated remaining: 5m 47s. Rate: 7.1 symbols/min [2025-10-17T22:28:30.949921] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-17T22:28:31.050467] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:28:31.098884] [DEBUG] [LOCAL ] WY: Loaded 53609 existing records from primary storage. [2025-10-17T22:28:31.099193] [INFO ] [MAIN ] WY: Loaded 53609 existing records. [2025-10-17T22:28:31.275372] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:28:31.275594] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-17T22:28:31.275675] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-17T22:28:31.275903] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-17T22:28:31.275967] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-17T22:28:31.623187] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:28:31.742283] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-17T22:28:32.060462] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-17T22:28:32.542304] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-17T22:28:32.706976] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T22:28:33.338574] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-17T22:28:33.347430] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-17T22:28:34.142267] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-10-17T22:28:34.310302] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-17T22:28:34.942311] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-17T22:28:35.092302] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-17T22:28:35.608997] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-17T22:28:35.742276] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-17T22:28:36.542309] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-17T22:28:36.751634] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-17T22:28:36.899031] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-17T22:28:36.905809] [INFO ] [REMOTE ] WTTR: Full fetch complete (65636 records). [2025-10-17T22:28:36.905933] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-17T22:28:37.298122] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-17T22:28:37.298204] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-17T22:28:37.299325] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-17T22:28:37.299388] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-17T22:28:37.300852] [DEBUG] [LOCAL ] WTTR: Trimmed 65636 records to 45312 (keeping 200 days of data) [2025-10-17T22:28:37.352081] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-17T22:28:37.571876] [DEBUG] [LOCAL ] WTTR: Primary data saved (45312 records). [2025-10-17T22:28:37.572021] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-17T22:28:37.572137] [INFO ] [MAIN ] Update Progress: 2328/2368 symbols completed. WTTR took 35.3s. Estimated remaining: 5m 39s. Rate: 7.1 symbols/min [2025-10-17T22:28:37.758362] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:28:37.788209] [DEBUG] [LOCAL ] XFLT: Loaded 30243 existing records from primary storage. [2025-10-17T22:28:37.788483] [INFO ] [MAIN ] XFLT: Loaded 30243 existing records. [2025-10-17T22:28:37.964612] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:28:37.965044] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-17T22:28:37.965156] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-17T22:28:37.965432] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-17T22:28:37.965491] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-17T22:28:38.160822] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-17T22:28:38.348253] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T22:28:38.352756] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:28:38.942270] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-10-17T22:28:39.321668] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-17T22:28:39.742278] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-17T22:28:40.035893] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-17T22:28:40.382851] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-17T22:28:40.542309] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-17T22:28:41.342325] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-17T22:28:41.434394] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-17T22:28:41.942989] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T22:28:42.142323] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-17T22:28:42.942295] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-17T22:28:43.089629] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T22:28:43.549946] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-17T22:28:43.742296] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-17T22:28:44.542282] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-17T22:28:44.702598] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-17T22:28:44.946983] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-17T22:28:45.342323] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-17T22:28:46.142355] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-17T22:28:46.486383] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-17T22:28:46.563388] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-17T22:28:46.942382] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-17T22:28:47.742343] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-17T22:28:47.983976] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-17T22:28:48.542305] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-17T22:28:48.672486] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T22:28:48.699159] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-17T22:28:49.342310] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-17T22:28:50.142266] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-17T22:28:50.346372] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-17T22:28:50.734188] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-17T22:28:50.942287] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-17T22:28:51.742279] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-17T22:28:52.013688] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-17T22:28:52.020889] [INFO ] [REMOTE ] WU: Full fetch complete (77511 records). [2025-10-17T22:28:52.021001] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-17T22:28:52.406870] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-17T22:28:52.407018] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-17T22:28:52.408392] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-17T22:28:52.408495] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-17T22:28:52.410100] [DEBUG] [LOCAL ] WU: Trimmed 77511 records to 54258 (keeping 200 days of data) [2025-10-17T22:28:52.582257] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-17T22:28:52.739785] [DEBUG] [LOCAL ] WU: Primary data saved (54258 records). [2025-10-17T22:28:52.739963] [INFO ] [MAIN ] WU: Full history saved. [2025-10-17T22:28:52.740524] [INFO ] [MAIN ] Update Progress: 2329/2368 symbols completed. WU took 36.9s. Estimated remaining: 5m 30s. Rate: 7.1 symbols/min [2025-10-17T22:28:52.914761] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-17T22:28:52.950165] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:28:52.993437] [DEBUG] [LOCAL ] XHR: Loaded 43863 existing records from primary storage. [2025-10-17T22:28:52.993898] [INFO ] [MAIN ] XHR: Loaded 43863 existing records. [2025-10-17T22:28:53.171229] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:28:53.171525] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-17T22:28:53.171573] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-17T22:28:53.171807] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-17T22:28:53.171864] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-17T22:28:53.353493] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-17T22:28:53.382785] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T22:28:53.567423] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:28:53.989221] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-17T22:28:54.142283] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-17T22:28:54.942310] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-17T22:28:55.147352] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-17T22:28:55.678936] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-17T22:28:55.742314] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-17T22:28:55.808879] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-17T22:28:56.542294] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-17T22:28:57.342316] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-10-17T22:28:57.374110] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-17T22:28:57.383224] [INFO ] [REMOTE ] WWW: Full fetch complete (70521 records). [2025-10-17T22:28:57.383360] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-17T22:28:57.763042] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-17T22:28:57.763118] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-17T22:28:57.764271] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-17T22:28:57.764336] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-17T22:28:57.765606] [DEBUG] [LOCAL ] WWW: Trimmed 70521 records to 49933 (keeping 200 days of data) [2025-10-17T22:28:58.063048] [DEBUG] [LOCAL ] WWW: Primary data saved (49933 records). [2025-10-17T22:28:58.063169] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-17T22:28:58.063249] [INFO ] [MAIN ] Update Progress: 2330/2368 symbols completed. WWW took 37.0s. Estimated remaining: 5m 22s. Rate: 7.1 symbols/min [2025-10-17T22:28:58.159367] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-17T22:28:58.233882] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:28:58.234093] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-17T22:28:58.234145] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-17T22:28:58.234354] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-17T22:28:58.234550] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-17T22:28:58.234637] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-17T22:28:58.234729] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-17T22:28:58.567947] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-17T22:28:58.638145] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:28:58.858580] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T22:28:58.942328] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-17T22:28:59.136827] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-17T22:28:59.742282] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-17T22:29:00.289619] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-17T22:29:00.542311] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-10-17T22:29:00.863079] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T22:29:00.863372] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-10-17T22:29:00.863463] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T22:29:00.863549] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-17T22:29:00.863626] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T22:29:00.863733] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-17T22:29:00.863813] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-17T22:29:00.863863] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-17T22:29:00.863922] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-17T22:29:00.863990] [INFO ] [MAIN ] Update Progress: 2331/2368 symbols completed. XIFR took 2.8s. Estimated remaining: 5m 13s. Rate: 7.1 symbols/min [2025-10-17T22:29:01.036705] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:29:01.087798] [DEBUG] [LOCAL ] XOM: Loaded 54183 existing records from primary storage. [2025-10-17T22:29:01.088105] [INFO ] [MAIN ] XOM: Loaded 54183 existing records. [2025-10-17T22:29:01.275503] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:29:01.275814] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-17T22:29:01.275876] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-17T22:29:01.276058] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-17T22:29:01.276098] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-17T22:29:01.344746] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-17T22:29:01.425274] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T22:29:01.661985] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:29:02.142356] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-10-17T22:29:02.942349] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-17T22:29:03.184006] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-17T22:29:03.742272] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-17T22:29:04.542348] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-17T22:29:04.748122] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-17T22:29:04.755532] [INFO ] [REMOTE ] WY: Full fetch complete (77036 records). [2025-10-17T22:29:04.755685] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-17T22:29:05.049913] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-17T22:29:05.206019] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-17T22:29:05.206101] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-17T22:29:05.207466] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-17T22:29:05.207545] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-17T22:29:05.209171] [DEBUG] [LOCAL ] WY: Trimmed 77036 records to 53997 (keeping 200 days of data) [2025-10-17T22:29:05.391086] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-17T22:29:05.583798] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (3.44 seconds). [2025-10-17T22:29:05.583979] [DEBUG] [LOCAL ] WY: Primary data saved (53997 records). [2025-10-17T22:29:05.610008] [INFO ] [MAIN ] WY: Full history saved. [2025-10-17T22:29:05.613230] [INFO ] [MAIN ] Update Progress: 2332/2368 symbols completed. WY took 34.7s. Estimated remaining: 5m 5s. Rate: 7.1 symbols/min [2025-10-17T22:29:05.613077] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T22:29:05.794239] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:29:05.825455] [DEBUG] [LOCAL ] XPER: Loaded 30698 existing records from primary storage. [2025-10-17T22:29:05.825776] [INFO ] [MAIN ] XPER: Loaded 30698 existing records. [2025-10-17T22:29:06.001134] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:29:06.001425] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-17T22:29:06.001474] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-17T22:29:06.001766] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-17T22:29:06.001824] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-17T22:29:06.148384] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-17T22:29:06.351524] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:29:06.942316] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-10-17T22:29:07.000325] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-17T22:29:07.742347] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-17T22:29:07.986935] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T22:29:08.107141] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-17T22:29:08.542333] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-17T22:29:09.347443] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-17T22:29:09.353190] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T22:29:09.748267] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-17T22:29:09.752746] [INFO ] [REMOTE ] XFLT: Full fetch complete (43913 records). [2025-10-17T22:29:09.752835] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-17T22:29:10.127742] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-17T22:29:10.127854] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-17T22:29:10.128902] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-17T22:29:10.128966] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-17T22:29:10.130103] [DEBUG] [LOCAL ] XFLT: Trimmed 43913 records to 30459 (keeping 200 days of data) [2025-10-17T22:29:10.177101] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-17T22:29:10.311087] [DEBUG] [LOCAL ] XFLT: Primary data saved (30459 records). [2025-10-17T22:29:10.311218] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-17T22:29:10.311300] [INFO ] [MAIN ] Update Progress: 2333/2368 symbols completed. XFLT took 32.7s. Estimated remaining: 4m 56s. Rate: 7.1 symbols/min [2025-10-17T22:29:10.478426] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:29:10.500042] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-17T22:29:10.550976] [DEBUG] [LOCAL ] XPEV: Loaded 54020 existing records from primary storage. [2025-10-17T22:29:10.551311] [INFO ] [MAIN ] XPEV: Loaded 54020 existing records. [2025-10-17T22:29:10.723866] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:29:10.724078] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-17T22:29:10.724126] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-17T22:29:10.724353] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-17T22:29:10.724409] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-17T22:29:10.952345] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-17T22:29:11.079604] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:29:11.742349] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-10-17T22:29:12.462669] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-17T22:29:12.542283] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-17T22:29:12.640460] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-17T22:29:13.342320] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-17T22:29:14.106306] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-17T22:29:14.142246] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-17T22:29:14.556976] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-17T22:29:14.781780] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-17T22:29:14.942276] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-17T22:29:15.742277] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-17T22:29:16.209752] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-17T22:29:16.244094] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-17T22:29:16.542279] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-17T22:29:17.342293] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-17T22:29:17.879935] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-17T22:29:18.142289] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-17T22:29:18.752700] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-17T22:29:18.802010] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T22:29:18.942325] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-17T22:29:19.496102] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-17T22:29:19.742296] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-17T22:29:20.542342] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-17T22:29:21.342326] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-17T22:29:21.473855] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-17T22:29:21.943845] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-17T22:29:22.142271] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-17T22:29:22.191802] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-17T22:29:22.227143] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-17T22:29:22.942289] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-17T22:29:23.742264] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-17T22:29:24.101341] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-17T22:29:24.552442] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-17T22:29:24.574968] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-17T22:29:25.342289] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-17T22:29:26.143136] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-17T22:29:26.145723] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-17T22:29:26.238257] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-17T22:29:26.583850] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-17T22:29:26.942303] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-17T22:29:27.742271] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-17T22:29:28.384309] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-17T22:29:28.542250] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-17T22:29:28.604671] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-17T22:29:29.342295] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-17T22:29:29.857198] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-17T22:29:30.142264] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-17T22:29:30.246682] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-17T22:29:30.942294] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-17T22:29:31.445202] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-17T22:29:31.508383] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-17T22:29:31.514722] [INFO ] [REMOTE ] XHR: Full fetch complete (61873 records). [2025-10-17T22:29:31.514886] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-17T22:29:31.751979] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-17T22:29:31.905900] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-17T22:29:31.905984] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-17T22:29:31.907098] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-17T22:29:31.907185] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-17T22:29:31.908500] [DEBUG] [LOCAL ] XHR: Trimmed 61873 records to 44119 (keeping 200 days of data) [2025-10-17T22:29:32.202815] [DEBUG] [LOCAL ] XHR: Primary data saved (44119 records). [2025-10-17T22:29:32.202944] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-17T22:29:32.203546] [INFO ] [MAIN ] Update Progress: 2334/2368 symbols completed. XHR took 39.5s. Estimated remaining: 4m 48s. Rate: 7.1 symbols/min [2025-10-17T22:29:32.375285] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:29:32.421578] [DEBUG] [LOCAL ] XPO: Loaded 48000 existing records from primary storage. [2025-10-17T22:29:32.421920] [INFO ] [MAIN ] XPO: Loaded 48000 existing records. [2025-10-17T22:29:32.547557] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-17T22:29:32.600982] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:29:32.601193] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-17T22:29:32.601240] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-17T22:29:32.601500] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-17T22:29:32.601558] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-17T22:29:32.959839] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:29:33.301058] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-17T22:29:33.342253] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-17T22:29:33.948037] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T22:29:34.055174] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-17T22:29:34.142254] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-17T22:29:34.942293] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-10-17T22:29:35.440365] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-17T22:29:35.445945] [INFO ] [REMOTE ] XPER: Full fetch complete (43686 records). [2025-10-17T22:29:35.446059] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-17T22:29:35.747046] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-17T22:29:35.837885] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-17T22:29:35.837990] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-17T22:29:35.839061] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-17T22:29:35.839140] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-17T22:29:35.867756] [DEBUG] [LOCAL ] XPER: Trimmed 43686 records to 31034 (keeping 200 days of data) [2025-10-17T22:29:35.874062] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-17T22:29:36.054797] [DEBUG] [LOCAL ] XPER: Primary data saved (31034 records). [2025-10-17T22:29:36.054940] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-17T22:29:36.055054] [INFO ] [MAIN ] Update Progress: 2335/2368 symbols completed. XPER took 30.4s. Estimated remaining: 4m 39s. Rate: 7.1 symbols/min [2025-10-17T22:29:36.218589] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:29:36.252247] [DEBUG] [LOCAL ] XPOF: Loaded 37670 existing records from primary storage. [2025-10-17T22:29:36.252535] [INFO ] [MAIN ] XPOF: Loaded 37670 existing records. [2025-10-17T22:29:36.465143] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:29:36.465536] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-17T22:29:36.465672] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-17T22:29:36.465893] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-17T22:29:36.465950] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-17T22:29:36.542379] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-17T22:29:36.864403] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:29:36.897489] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-17T22:29:37.291254] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-17T22:29:37.298887] [INFO ] [REMOTE ] XOM: Full fetch complete (77973 records). [2025-10-17T22:29:37.299048] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-17T22:29:37.347398] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-10-17T22:29:37.732234] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-17T22:29:37.732319] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-17T22:29:37.733781] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-17T22:29:37.733850] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-17T22:29:37.735437] [DEBUG] [LOCAL ] XOM: Trimmed 77973 records to 54573 (keeping 200 days of data) [2025-10-17T22:29:38.115375] [DEBUG] [LOCAL ] XOM: Primary data saved (54573 records). [2025-10-17T22:29:38.115700] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-17T22:29:38.116512] [INFO ] [MAIN ] Update Progress: 2336/2368 symbols completed. XOM took 37.3s. Estimated remaining: 4m 31s. Rate: 7.1 symbols/min [2025-10-17T22:29:38.149289] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-17T22:29:38.323186] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:29:38.340073] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-17T22:29:38.368707] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-17T22:29:38.415299] [DEBUG] [LOCAL ] XPRO: Loaded 46247 existing records from primary storage. [2025-10-17T22:29:38.415691] [INFO ] [MAIN ] XPRO: Loaded 46247 existing records. [2025-10-17T22:29:38.625675] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:29:38.625965] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-17T22:29:38.626027] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-17T22:29:38.626276] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-17T22:29:38.626334] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-17T22:29:38.947506] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-17T22:29:39.002271] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:29:39.742289] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-17T22:29:39.851614] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-17T22:29:40.237441] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-17T22:29:40.542346] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-17T22:29:41.342305] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-17T22:29:42.074361] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-17T22:29:42.142260] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-17T22:29:42.161912] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-17T22:29:42.231932] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T22:29:42.942299] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-10-17T22:29:43.742362] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-17T22:29:44.463600] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-17T22:29:44.471278] [INFO ] [REMOTE ] XPEV: Full fetch complete (77783 records). [2025-10-17T22:29:44.471427] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-17T22:29:44.549978] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-17T22:29:44.793615] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-17T22:29:44.895777] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-17T22:29:44.895848] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-17T22:29:44.897088] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-17T22:29:44.897151] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-17T22:29:44.898682] [DEBUG] [LOCAL ] XPEV: Trimmed 77783 records to 54409 (keeping 200 days of data) [2025-10-17T22:29:45.220240] [DEBUG] [LOCAL ] XPEV: Primary data saved (54409 records). [2025-10-17T22:29:45.220363] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-17T22:29:45.220472] [INFO ] [MAIN ] Update Progress: 2337/2368 symbols completed. XPEV took 34.9s. Estimated remaining: 4m 22s. Rate: 7.1 symbols/min [2025-10-17T22:29:45.344741] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-17T22:29:45.417586] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:29:45.419827] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-17T22:29:45.454903] [DEBUG] [LOCAL ] XYF: Loaded 28000 existing records from primary storage. [2025-10-17T22:29:45.455159] [INFO ] [MAIN ] XYF: Loaded 28000 existing records. [2025-10-17T22:29:45.626022] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:29:45.626196] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-17T22:29:45.626255] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-17T22:29:45.626469] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-17T22:29:45.626537] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-17T22:29:45.969823] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:29:46.142249] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-10-17T22:29:46.329884] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T22:29:46.789437] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-17T22:29:46.942301] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-17T22:29:47.189790] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-17T22:29:47.532015] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-17T22:29:47.742299] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-17T22:29:48.542341] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-17T22:29:49.149410] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-17T22:29:49.342310] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-17T22:29:50.023337] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-17T22:29:50.142287] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-17T22:29:50.814520] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T22:29:50.942302] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-17T22:29:51.734418] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-17T22:29:51.744437] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-17T22:29:52.211912] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-17T22:29:52.542288] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-17T22:29:53.141448] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-17T22:29:53.342286] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-17T22:29:54.148452] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-17T22:29:54.176951] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T22:29:54.177578] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-17T22:29:54.942275] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-17T22:29:55.742304] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-17T22:29:55.869992] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-17T22:29:56.042545] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-17T22:29:56.542297] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-17T22:29:57.342301] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-17T22:29:57.475488] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-17T22:29:58.063946] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-17T22:29:58.142271] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-17T22:29:58.630080] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-17T22:29:58.942305] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-17T22:29:59.751199] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-17T22:29:59.753691] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-17T22:29:59.877826] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-17T22:30:00.542340] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-17T22:30:01.342272] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-17T22:30:01.433708] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-17T22:30:02.142329] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-17T22:30:02.360397] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-17T22:30:02.438711] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-17T22:30:02.942334] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-17T22:30:03.675533] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-17T22:30:03.742270] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-17T22:30:04.542268] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-17T22:30:04.717942] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-17T22:30:05.301849] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-17T22:30:05.306921] [INFO ] [REMOTE ] XPOF: Full fetch complete (52943 records). [2025-10-17T22:30:05.307068] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-17T22:30:05.351441] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-17T22:30:05.695555] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-17T22:30:05.695662] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-17T22:30:05.696756] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-17T22:30:05.696818] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-17T22:30:05.697917] [DEBUG] [LOCAL ] XPOF: Trimmed 52943 records to 37953 (keeping 200 days of data) [2025-10-17T22:30:05.911945] [DEBUG] [LOCAL ] XPOF: Primary data saved (37953 records). [2025-10-17T22:30:05.912210] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-17T22:30:05.912300] [INFO ] [MAIN ] Update Progress: 2338/2368 symbols completed. XPOF took 29.9s. Estimated remaining: 4m 14s. Rate: 7.1 symbols/min [2025-10-17T22:30:06.092373] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:30:06.121414] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-17T22:30:06.149048] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-17T22:30:06.171131] [DEBUG] [LOCAL ] XYL: Loaded 48164 existing records from primary storage. [2025-10-17T22:30:06.171498] [INFO ] [MAIN ] XYL: Loaded 48164 existing records. [2025-10-17T22:30:06.342158] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:30:06.342353] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-17T22:30:06.342399] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-17T22:30:06.342597] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-17T22:30:06.342678] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-17T22:30:06.689105] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:30:06.942322] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-17T22:30:06.976908] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T22:30:07.742286] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-10-17T22:30:07.891511] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-17T22:30:08.542265] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-17T22:30:08.735209] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-17T22:30:09.024475] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-17T22:30:09.342323] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-17T22:30:10.083709] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T22:30:10.142264] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-17T22:30:10.639491] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-17T22:30:10.942255] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-17T22:30:11.221102] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-17T22:30:11.742347] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-17T22:30:12.077206] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-17T22:30:12.542315] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-17T22:30:12.821811] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-17T22:30:12.825239] [INFO ] [REMOTE ] XYF: Full fetch complete (33381 records). [2025-10-17T22:30:12.825327] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-17T22:30:13.194382] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-17T22:30:13.194472] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-17T22:30:13.195194] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-17T22:30:13.195258] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-17T22:30:13.196274] [DEBUG] [LOCAL ] XYF: Trimmed 33381 records to 28115 (keeping 200 days of data) [2025-10-17T22:30:13.351458] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-17T22:30:13.367420] [DEBUG] [LOCAL ] XYF: Primary data saved (28115 records). [2025-10-17T22:30:13.367507] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-17T22:30:13.367596] [INFO ] [MAIN ] Update Progress: 2339/2368 symbols completed. XYF took 28.1s. Estimated remaining: 4m 6s. Rate: 7.1 symbols/min [2025-10-17T22:30:13.529899] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:30:13.530055] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-17T22:30:13.530091] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-17T22:30:13.530201] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-17T22:30:13.530242] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-17T22:30:13.530282] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-17T22:30:13.530314] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-17T22:30:13.872964] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:30:14.088957] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-17T22:30:14.098159] [INFO ] [REMOTE ] XPRO: Full fetch complete (66485 records). [2025-10-17T22:30:14.098376] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-17T22:30:14.147472] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-10-17T22:30:14.451041] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-17T22:30:14.505354] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-10-17T22:30:14.508900] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-17T22:30:14.509487] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-10-17T22:30:14.509255] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-17T22:30:14.509861] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-17T22:30:14.509760] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-17T22:30:14.510104] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-17T22:30:14.511457] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-17T22:30:14.512021] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-17T22:30:14.512114] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-17T22:30:14.512205] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-17T22:30:14.511946] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-17T22:30:14.512381] [INFO ] [MAIN ] Update Progress: 2340/2368 symbols completed. XYZ took 1.1s. Estimated remaining: 3m 57s. Rate: 7.1 symbols/min [2025-10-17T22:30:14.589482] [DEBUG] [LOCAL ] XPRO: Trimmed 66485 records to 46552 (keeping 200 days of data) [2025-10-17T22:30:14.788143] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:30:14.792437] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-17T22:30:14.801497] [INFO ] [REMOTE ] XPO: Full fetch complete (69738 records). [2025-10-17T22:30:14.803799] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-17T22:30:14.942296] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-17T22:30:15.001876] [DEBUG] [LOCAL ] YALA: Loaded 37013 existing records from primary storage. [2025-10-17T22:30:15.006393] [INFO ] [MAIN ] YALA: Loaded 37013 existing records. [2025-10-17T22:30:15.359503] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:30:15.371160] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-17T22:30:15.376948] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-17T22:30:15.408899] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-17T22:30:15.430056] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-17T22:30:15.530218] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-17T22:30:15.588557] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-17T22:30:15.631577] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-17T22:30:15.632006] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-17T22:30:15.751551] [DEBUG] [LOCAL ] XPO: Trimmed 69738 records to 48306 (keeping 200 days of data) [2025-10-17T22:30:15.992005] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:30:15.995384] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-10-17T22:30:16.080127] [DEBUG] [LOCAL ] XPRO: Primary data saved (46552 records). [2025-10-17T22:30:16.080751] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-17T22:30:16.081141] [INFO ] [MAIN ] Update Progress: 2341/2368 symbols completed. XPRO took 38.0s. Estimated remaining: 3m 49s. Rate: 7.1 symbols/min [2025-10-17T22:30:16.347012] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:30:16.399258] [DEBUG] [LOCAL ] YELP: Loaded 45813 existing records from primary storage. [2025-10-17T22:30:16.400300] [INFO ] [MAIN ] YELP: Loaded 45813 existing records. [2025-10-17T22:30:16.635315] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:30:16.637251] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-17T22:30:16.637955] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-17T22:30:16.639111] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-17T22:30:16.639191] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-17T22:30:16.772340] [DEBUG] [LOCAL ] XPO: Primary data saved (48306 records). [2025-10-17T22:30:16.785516] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-17T22:30:16.796405] [INFO ] [MAIN ] Update Progress: 2342/2368 symbols completed. XPO took 44.6s. Estimated remaining: 3m 40s. Rate: 7.1 symbols/min [2025-10-17T22:30:16.977902] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-17T22:30:17.049890] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-17T22:30:17.204621] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:30:17.242739] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:30:17.252445] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-17T22:30:17.313090] [DEBUG] [LOCAL ] YETI: Loaded 52880 existing records from primary storage. [2025-10-17T22:30:17.313495] [INFO ] [MAIN ] YETI: Loaded 52880 existing records. [2025-10-17T22:30:17.347372] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-17T22:30:17.494389] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:30:17.494663] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-17T22:30:17.494729] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-17T22:30:17.494967] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-17T22:30:17.495038] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-17T22:30:17.874192] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:30:18.142267] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-10-17T22:30:18.378809] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-17T22:30:18.819097] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-17T22:30:18.942290] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-17T22:30:19.396589] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-17T22:30:19.742302] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-17T22:30:20.445735] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-17T22:30:20.542295] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-10-17T22:30:20.587981] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-17T22:30:21.342359] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-17T22:30:22.135568] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-17T22:30:22.143722] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-17T22:30:22.279110] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-17T22:30:22.942366] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-17T22:30:23.734344] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-17T22:30:23.743948] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-17T22:30:24.367980] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-17T22:30:24.542349] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-17T22:30:25.352737] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-17T22:30:25.358208] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-17T22:30:25.964848] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-17T22:30:26.142299] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-17T22:30:26.824056] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T22:30:26.942263] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-17T22:30:27.742344] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-17T22:30:27.814327] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-17T22:30:28.520795] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T22:30:28.542250] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-17T22:30:29.342305] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-17T22:30:29.439030] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-17T22:30:30.098604] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T22:30:30.142248] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-17T22:30:30.857426] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-17T22:30:30.942282] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-17T22:30:31.364000] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-17T22:30:31.742314] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-17T22:30:32.542310] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-17T22:30:32.570683] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-17T22:30:33.342364] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-17T22:30:33.540619] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T22:30:34.136477] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-17T22:30:34.145463] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-17T22:30:34.753376] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-17T22:30:34.942338] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-17T22:30:35.742341] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-17T22:30:35.825394] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-17T22:30:36.542379] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-17T22:30:36.642743] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-17T22:30:37.320258] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-17T22:30:37.342292] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-17T22:30:38.142276] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-17T22:30:38.267182] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-17T22:30:38.942329] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-17T22:30:39.158809] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T22:30:39.214106] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-17T22:30:39.742302] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-17T22:30:40.547431] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-17T22:30:40.561191] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T22:30:41.342337] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-17T22:30:41.462228] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-17T22:30:42.142293] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-17T22:30:42.345892] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-17T22:30:42.494004] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-17T22:30:42.498493] [INFO ] [REMOTE ] YALA: Full fetch complete (47165 records). [2025-10-17T22:30:42.498625] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-17T22:30:42.869697] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-17T22:30:42.869781] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-17T22:30:42.870811] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-17T22:30:42.870876] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-17T22:30:42.872002] [DEBUG] [LOCAL ] YALA: Trimmed 47165 records to 37162 (keeping 200 days of data) [2025-10-17T22:30:42.949911] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-17T22:30:43.080376] [DEBUG] [LOCAL ] YALA: Primary data saved (37162 records). [2025-10-17T22:30:43.080500] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-17T22:30:43.080579] [INFO ] [MAIN ] Update Progress: 2343/2368 symbols completed. YALA took 28.6s. Estimated remaining: 3m 32s. Rate: 7.1 symbols/min [2025-10-17T22:30:43.246080] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:30:43.284751] [DEBUG] [LOCAL ] YEXT: Loaded 43500 existing records from primary storage. [2025-10-17T22:30:43.285038] [INFO ] [MAIN ] YEXT: Loaded 43500 existing records. [2025-10-17T22:30:43.474876] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:30:43.475088] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-17T22:30:43.475137] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-17T22:30:43.475302] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-17T22:30:43.475340] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-17T22:30:43.745911] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-17T22:30:43.841697] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:30:43.870730] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T22:30:44.502337] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-17T22:30:44.509383] [INFO ] [REMOTE ] XYL: Full fetch complete (70015 records). [2025-10-17T22:30:44.509553] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-17T22:30:44.547394] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-17T22:30:44.939774] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-17T22:30:44.941750] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-17T22:30:44.941635] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-17T22:30:44.953558] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-17T22:30:44.953706] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-17T22:30:44.955874] [DEBUG] [LOCAL ] XYL: Trimmed 70015 records to 48469 (keeping 200 days of data) [2025-10-17T22:30:45.260050] [DEBUG] [LOCAL ] XYL: Primary data saved (48469 records). [2025-10-17T22:30:45.260189] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-17T22:30:45.260272] [INFO ] [MAIN ] Update Progress: 2344/2368 symbols completed. XYL took 39.3s. Estimated remaining: 3m 23s. Rate: 7.1 symbols/min [2025-10-17T22:30:45.348238] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-10-17T22:30:45.433599] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:30:45.485430] [DEBUG] [LOCAL ] YMM: Loaded 52990 existing records from primary storage. [2025-10-17T22:30:45.485788] [INFO ] [MAIN ] YMM: Loaded 52990 existing records. [2025-10-17T22:30:45.661788] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:30:45.662052] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-17T22:30:45.662101] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-17T22:30:45.662301] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-17T22:30:45.662357] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-17T22:30:46.046519] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:30:46.047520] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-17T22:30:46.054809] [INFO ] [REMOTE ] YELP: Full fetch complete (64788 records). [2025-10-17T22:30:46.054996] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-17T22:30:46.148154] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-17T22:30:46.459613] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-17T22:30:46.459722] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-17T22:30:46.460863] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-17T22:30:46.460931] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-17T22:30:46.462439] [DEBUG] [LOCAL ] YELP: Trimmed 64788 records to 46079 (keeping 200 days of data) [2025-10-17T22:30:46.744225] [DEBUG] [LOCAL ] YELP: Primary data saved (46079 records). [2025-10-17T22:30:46.744400] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-17T22:30:46.744600] [INFO ] [MAIN ] Update Progress: 2345/2368 symbols completed. YELP took 30.7s. Estimated remaining: 3m 15s. Rate: 7.1 symbols/min [2025-10-17T22:30:46.871268] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-17T22:30:46.948414] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-10-17T22:30:46.952155] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:30:46.996808] [DEBUG] [LOCAL ] YOU: Loaded 50016 existing records from primary storage. [2025-10-17T22:30:46.997096] [INFO ] [MAIN ] YOU: Loaded 50016 existing records. [2025-10-17T22:30:47.168020] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:30:47.168207] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-17T22:30:47.168254] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-17T22:30:47.168445] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-17T22:30:47.168500] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-17T22:30:47.514155] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:30:47.742334] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-17T22:30:47.814578] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-17T22:30:48.542284] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-10-17T22:30:48.805522] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-17T22:30:49.283685] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-17T22:30:49.342264] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-17T22:30:50.142276] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-17T22:30:50.259986] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-17T22:30:50.942320] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-17T22:30:50.993321] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-17T22:30:51.611432] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-17T22:30:51.742261] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-17T22:30:52.542256] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-17T22:30:52.612742] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-17T22:30:53.272364] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-17T22:30:53.342259] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-17T22:30:53.935510] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T22:30:54.142282] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-17T22:30:54.866986] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T22:30:54.942248] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-17T22:30:55.742320] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-17T22:30:55.898949] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-17T22:30:56.416498] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-17T22:30:56.542250] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-17T22:30:57.054736] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-17T22:30:57.342325] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-17T22:30:58.142285] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-17T22:30:58.292544] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-17T22:30:58.774365] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-17T22:30:58.942302] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-17T22:30:59.742261] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-17T22:30:59.936216] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-17T22:31:00.231041] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-17T22:31:00.542288] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-17T22:31:01.342279] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-17T22:31:01.633209] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-17T22:31:02.142327] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-17T22:31:02.192274] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-17T22:31:02.202988] [INFO ] [REMOTE ] YETI: Full fetch complete (75542 records). [2025-10-17T22:31:02.203176] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-17T22:31:02.613124] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-17T22:31:02.613238] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-17T22:31:02.614613] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-17T22:31:02.614768] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-17T22:31:02.634777] [DEBUG] [LOCAL ] YETI: Trimmed 75542 records to 53250 (keeping 200 days of data) [2025-10-17T22:31:02.655995] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-17T22:31:02.963986] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-17T22:31:03.014730] [DEBUG] [LOCAL ] YETI: Primary data saved (53250 records). [2025-10-17T22:31:03.014885] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-17T22:31:03.014970] [INFO ] [MAIN ] Update Progress: 2346/2368 symbols completed. YETI took 46.2s. Estimated remaining: 3m 6s. Rate: 7.1 symbols/min [2025-10-17T22:31:03.188211] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:31:03.235149] [DEBUG] [LOCAL ] YPF: Loaded 51053 existing records from primary storage. [2025-10-17T22:31:03.235475] [INFO ] [MAIN ] YPF: Loaded 51053 existing records. [2025-10-17T22:31:03.409963] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:31:03.410175] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-17T22:31:03.410223] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-17T22:31:03.410430] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-17T22:31:03.410486] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-17T22:31:03.768676] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-17T22:31:03.774961] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:31:03.890456] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T22:31:04.542269] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-10-17T22:31:04.736697] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-17T22:31:05.342328] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-17T22:31:05.416855] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-17T22:31:06.142331] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-17T22:31:06.279148] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-17T22:31:06.942266] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-17T22:31:07.303263] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-17T22:31:07.655568] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-17T22:31:07.742294] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-17T22:31:08.456345] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-17T22:31:08.462801] [INFO ] [REMOTE ] YEXT: Full fetch complete (63282 records). [2025-10-17T22:31:08.462916] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-17T22:31:08.547436] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-17T22:31:08.891475] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-17T22:31:08.891591] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-17T22:31:08.892943] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-17T22:31:08.893008] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-17T22:31:08.894705] [DEBUG] [LOCAL ] YEXT: Trimmed 63282 records to 43806 (keeping 200 days of data) [2025-10-17T22:31:09.168528] [DEBUG] [LOCAL ] YEXT: Primary data saved (43806 records). [2025-10-17T22:31:09.168813] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-17T22:31:09.168939] [INFO ] [MAIN ] Update Progress: 2347/2368 symbols completed. YEXT took 26.1s. Estimated remaining: 2m 58s. Rate: 7.1 symbols/min [2025-10-17T22:31:09.355046] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-17T22:31:09.358818] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:31:09.373315] [DEBUG] [LOCAL ] YRD: Loaded 11610 existing records from primary storage. [2025-10-17T22:31:09.373532] [INFO ] [MAIN ] YRD: Loaded 11610 existing records. [2025-10-17T22:31:09.594563] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:31:09.594844] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-17T22:31:09.594931] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-17T22:31:09.595525] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-17T22:31:09.597175] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T22:31:09.597257] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-17T22:31:09.955962] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:31:10.142309] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-17T22:31:10.414680] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-17T22:31:10.942325] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-17T22:31:10.992672] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-17T22:31:11.742311] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-10-17T22:31:11.874979] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-17T22:31:12.280492] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-17T22:31:12.542310] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-17T22:31:12.756491] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-17T22:31:13.342327] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-10-17T22:31:14.142351] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-17T22:31:14.273586] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-17T22:31:14.942349] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-17T22:31:15.189561] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-17T22:31:15.742301] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-10-17T22:31:16.078059] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-17T22:31:16.542400] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-17T22:31:16.696720] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-17T22:31:17.342353] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-17T22:31:17.495447] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-17T22:31:17.531573] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-17T22:31:18.142308] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-17T22:31:18.915511] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-17T22:31:18.942266] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-17T22:31:19.742288] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-17T22:31:20.043346] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-17T22:31:20.397600] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T22:31:20.542317] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-10-17T22:31:20.738670] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T22:31:21.342354] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-17T22:31:22.142320] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-17T22:31:22.267901] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-17T22:31:22.942376] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-17T22:31:23.115117] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-17T22:31:23.155455] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-17T22:31:23.742370] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-17T22:31:24.542362] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-17T22:31:24.701765] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-17T22:31:24.725766] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-17T22:31:25.342384] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-17T22:31:25.954590] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-17T22:31:26.139688] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-17T22:31:26.142289] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-10. [2025-10-17T22:31:26.942314] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-17T22:31:27.742359] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-17T22:31:27.782074] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-17T22:31:27.796802] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-17T22:31:27.796418] [INFO ] [REMOTE ] YOU: Full fetch complete (72332 records). [2025-10-17T22:31:27.799547] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-17T22:31:28.206187] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-17T22:31:28.206304] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-17T22:31:28.207555] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-17T22:31:28.207667] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-17T22:31:28.209267] [DEBUG] [LOCAL ] YOU: Trimmed 72332 records to 50363 (keeping 200 days of data) [2025-10-17T22:31:28.521444] [DEBUG] [LOCAL ] YOU: Primary data saved (50363 records). [2025-10-17T22:31:28.521577] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-17T22:31:28.521680] [INFO ] [MAIN ] Update Progress: 2348/2368 symbols completed. YOU took 41.8s. Estimated remaining: 2m 49s. Rate: 7.1 symbols/min [2025-10-17T22:31:28.550987] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-17T22:31:28.714016] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:31:28.738839] [DEBUG] [LOCAL ] YSG: Loaded 25729 existing records from primary storage. [2025-10-17T22:31:28.739100] [INFO ] [MAIN ] YSG: Loaded 25729 existing records. [2025-10-17T22:31:28.921896] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:31:28.922143] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-17T22:31:28.922199] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-17T22:31:28.922391] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-17T22:31:28.922447] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-17T22:31:29.290757] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:31:29.311222] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-17T22:31:29.318623] [INFO ] [REMOTE ] YMM: Full fetch complete (76488 records). [2025-10-17T22:31:29.318833] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-17T22:31:29.349347] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-17T22:31:29.558486] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-17T22:31:29.727285] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-17T22:31:29.727369] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-17T22:31:29.728896] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-17T22:31:29.728964] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-17T22:31:29.730414] [DEBUG] [LOCAL ] YMM: Trimmed 76488 records to 53373 (keeping 200 days of data) [2025-10-17T22:31:30.058889] [DEBUG] [LOCAL ] YMM: Primary data saved (53373 records). [2025-10-17T22:31:30.059311] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-17T22:31:30.059404] [INFO ] [MAIN ] Update Progress: 2349/2368 symbols completed. YMM took 44.8s. Estimated remaining: 2m 41s. Rate: 7.1 symbols/min [2025-10-17T22:31:30.150990] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-17T22:31:30.233702] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:31:30.285180] [DEBUG] [LOCAL ] YUM: Loaded 51556 existing records from primary storage. [2025-10-17T22:31:30.285492] [INFO ] [MAIN ] YUM: Loaded 51556 existing records. [2025-10-17T22:31:30.481465] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:31:30.481768] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-17T22:31:30.481820] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-17T22:31:30.482327] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-17T22:31:30.482384] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-17T22:31:30.850266] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:31:30.942269] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-10-17T22:31:31.108531] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-17T22:31:31.273082] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-17T22:31:31.742260] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-17T22:31:32.163631] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-17T22:31:32.542293] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-17T22:31:33.342326] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-17T22:31:33.389104] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-17T22:31:33.460405] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-17T22:31:33.467529] [INFO ] [REMOTE ] YPF: Full fetch complete (73821 records). [2025-10-17T22:31:33.467719] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-17T22:31:33.874706] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-17T22:31:33.874792] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-17T22:31:33.875966] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-17T22:31:33.876030] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-17T22:31:33.877368] [DEBUG] [LOCAL ] YPF: Trimmed 73821 records to 51423 (keeping 200 days of data) [2025-10-17T22:31:34.155863] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-10-17T22:31:34.170750] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-17T22:31:34.192240] [DEBUG] [LOCAL ] YPF: Primary data saved (51423 records). [2025-10-17T22:31:34.192365] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-17T22:31:34.193123] [INFO ] [MAIN ] Update Progress: 2350/2368 symbols completed. YPF took 31.2s. Estimated remaining: 2m 32s. Rate: 7.1 symbols/min [2025-10-17T22:31:34.364670] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:31:34.414900] [DEBUG] [LOCAL ] YUMC: Loaded 52976 existing records from primary storage. [2025-10-17T22:31:34.415225] [INFO ] [MAIN ] YUMC: Loaded 52976 existing records. [2025-10-17T22:31:34.589638] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:31:34.589883] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-17T22:31:34.589934] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-17T22:31:34.590153] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-17T22:31:34.590211] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-17T22:31:34.942055] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:31:34.942438] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-10-17T22:31:35.742417] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-17T22:31:35.926123] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-17T22:31:36.539185] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-17T22:31:36.542236] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-17T22:31:36.822883] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-17T22:31:37.342328] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-17T22:31:37.572097] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-17T22:31:38.142299] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-17T22:31:38.942281] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-17T22:31:39.019178] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-17T22:31:39.021626] [INFO ] [REMOTE ] YRD: Full fetch complete (19003 records). [2025-10-17T22:31:39.021725] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-17T22:31:39.420516] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-17T22:31:39.420911] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-17T22:31:39.421501] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-17T22:31:39.421580] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-17T22:31:39.424115] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-17T22:31:39.434759] [DEBUG] [LOCAL ] YRD: Trimmed 19003 records to 11657 (keeping 200 days of data) [2025-10-17T22:31:39.503337] [DEBUG] [LOCAL ] YRD: Primary data saved (11657 records). [2025-10-17T22:31:39.503486] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-17T22:31:39.503594] [INFO ] [MAIN ] Update Progress: 2351/2368 symbols completed. YRD took 30.3s. Estimated remaining: 2m 24s. Rate: 7.1 symbols/min [2025-10-17T22:31:39.675712] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:31:39.724186] [DEBUG] [LOCAL ] ZBH: Loaded 51201 existing records from primary storage. [2025-10-17T22:31:39.724505] [INFO ] [MAIN ] ZBH: Loaded 51201 existing records. [2025-10-17T22:31:39.754812] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-17T22:31:39.900985] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:31:39.901171] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-17T22:31:39.901217] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-17T22:31:39.901398] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-17T22:31:39.901435] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-17T22:31:40.245572] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:31:40.542407] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-10-17T22:31:40.745545] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-17T22:31:40.796050] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-17T22:31:41.342306] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-17T22:31:42.142303] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-17T22:31:42.274522] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-17T22:31:42.942312] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-17T22:31:42.986150] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-17T22:31:43.080094] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-17T22:31:43.742260] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-17T22:31:44.542275] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-17T22:31:44.751163] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-17T22:31:45.342263] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-17T22:31:45.524431] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-17T22:31:45.979079] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-17T22:31:46.142294] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-17T22:31:46.936853] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-17T22:31:46.945969] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-17T22:31:47.742366] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-17T22:31:47.807114] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-17T22:31:47.969727] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-17T22:31:48.542341] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-17T22:31:49.342324] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-17T22:31:49.568186] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-17T22:31:50.142367] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-10-17T22:31:50.446536] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-17T22:31:50.942299] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-17T22:31:51.206495] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-17T22:31:51.365927] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-17T22:31:51.742294] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-17T22:31:52.512304] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-17T22:31:52.542257] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-17T22:31:53.236180] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-17T22:31:53.342244] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-17T22:31:54.142257] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-17T22:31:54.627247] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-17T22:31:54.942305] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-17T22:31:55.128923] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-17T22:31:55.742283] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-10-17T22:31:55.892430] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-17T22:31:56.542229] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-17T22:31:56.656841] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-17T22:31:56.879752] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-17T22:31:57.342310] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-17T22:31:58.142296] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-17T22:31:58.223639] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T22:31:58.942317] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-10. [2025-10-17T22:31:59.021395] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-17T22:31:59.742260] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-17T22:31:59.947490] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-17T22:32:00.078497] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-17T22:32:00.082620] [INFO ] [REMOTE ] YSG: Full fetch complete (32506 records). [2025-10-17T22:32:00.082998] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-17T22:32:00.463108] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-17T22:32:00.463207] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-17T22:32:00.463964] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-17T22:32:00.464038] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-17T22:32:00.465251] [DEBUG] [LOCAL ] YSG: Trimmed 32506 records to 25852 (keeping 200 days of data) [2025-10-17T22:32:00.547308] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-17T22:32:00.616016] [DEBUG] [LOCAL ] YSG: Primary data saved (25852 records). [2025-10-17T22:32:00.616158] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-17T22:32:00.616265] [INFO ] [MAIN ] Update Progress: 2352/2368 symbols completed. YSG took 32.1s. Estimated remaining: 2m 15s. Rate: 7.1 symbols/min [2025-10-17T22:32:00.800397] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:32:00.822300] [DEBUG] [LOCAL ] ZEPP: Loaded 19177 existing records from primary storage. [2025-10-17T22:32:00.822582] [INFO ] [MAIN ] ZEPP: Loaded 19177 existing records. [2025-10-17T22:32:01.006816] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:32:01.007039] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-17T22:32:01.007125] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-17T22:32:01.007339] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-17T22:32:01.007415] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-17T22:32:01.371168] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:32:01.365452] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-17T22:32:01.586775] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-17T22:32:01.933952] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T22:32:02.142306] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-10-17T22:32:02.663292] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-17T22:32:02.942300] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-10-17T22:32:03.250637] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-17T22:32:03.440961] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-17T22:32:03.742330] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-17T22:32:04.542319] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-17T22:32:05.342325] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-17T22:32:05.583696] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-17T22:32:06.142259] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-10-17T22:32:06.324057] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T22:32:06.636878] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-17T22:32:06.942297] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-10-17T22:32:07.210330] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-17T22:32:07.558542] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-17T22:32:07.742350] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-10-17T22:32:08.374354] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-17T22:32:08.542327] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-17T22:32:09.342334] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-17T22:32:10.098660] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-17T22:32:10.142307] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-17T22:32:10.319565] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-17T22:32:10.813925] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-17T22:32:10.820427] [INFO ] [REMOTE ] ZBH: Full fetch complete (73880 records). [2025-10-17T22:32:10.820546] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-17T22:32:10.947370] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-17T22:32:11.217025] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-17T22:32:11.217135] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-17T22:32:11.218319] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-17T22:32:11.218381] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-17T22:32:11.219881] [DEBUG] [LOCAL ] ZBH: Trimmed 73880 records to 51528 (keeping 200 days of data) [2025-10-17T22:32:11.542921] [DEBUG] [LOCAL ] ZBH: Primary data saved (51528 records). [2025-10-17T22:32:11.543059] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-17T22:32:11.543142] [INFO ] [MAIN ] Update Progress: 2353/2368 symbols completed. ZBH took 32.0s. Estimated remaining: 2m 7s. Rate: 7.1 symbols/min [2025-10-17T22:32:11.714936] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:32:11.742583] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-10-17T22:32:11.773164] [DEBUG] [LOCAL ] ZETA: Loaded 54007 existing records from primary storage. [2025-10-17T22:32:11.784612] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-17T22:32:11.784777] [INFO ] [MAIN ] ZETA: Loaded 54007 existing records. [2025-10-17T22:32:11.854205] [INFO ] [REMOTE ] YUM: Full fetch complete (74676 records). [2025-10-17T22:32:11.865042] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-17T22:32:12.124745] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:32:12.166042] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-17T22:32:12.206380] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-17T22:32:12.232127] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-17T22:32:12.237807] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-17T22:32:12.472175] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-17T22:32:12.477588] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-17T22:32:12.488475] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-17T22:32:12.523335] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-17T22:32:12.531586] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-17T22:32:12.543836] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-17T22:32:12.694233] [DEBUG] [LOCAL ] YUM: Trimmed 74676 records to 51918 (keeping 200 days of data) [2025-10-17T22:32:12.860960] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:32:13.099514] [DEBUG] [LOCAL ] YUM: Primary data saved (51918 records). [2025-10-17T22:32:13.099732] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-17T22:32:13.099850] [INFO ] [MAIN ] Update Progress: 2354/2368 symbols completed. YUM took 43.0s. Estimated remaining: 1m 59s. Rate: 7.1 symbols/min [2025-10-17T22:32:13.265220] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:32:13.303609] [DEBUG] [LOCAL ] ZGN: Loaded 41214 existing records from primary storage. [2025-10-17T22:32:13.303954] [INFO ] [MAIN ] ZGN: Loaded 41214 existing records. [2025-10-17T22:32:13.347544] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-10-17T22:32:13.479671] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:32:13.479885] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-17T22:32:13.479931] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-17T22:32:13.480131] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-17T22:32:13.480187] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-17T22:32:13.828226] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:32:14.016441] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-17T22:32:14.142294] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-10-17T22:32:14.355849] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-17T22:32:14.363335] [INFO ] [REMOTE ] YUMC: Full fetch complete (76407 records). [2025-10-17T22:32:14.363495] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-17T22:32:14.748214] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-17T22:32:14.748301] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-17T22:32:14.749681] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-17T22:32:14.749745] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-17T22:32:14.751427] [DEBUG] [LOCAL ] YUMC: Trimmed 76407 records to 53359 (keeping 200 days of data) [2025-10-17T22:32:14.963375] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-10-17T22:32:15.079297] [DEBUG] [LOCAL ] YUMC: Primary data saved (53359 records). [2025-10-17T22:32:15.079439] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-17T22:32:15.080094] [INFO ] [MAIN ] Update Progress: 2355/2368 symbols completed. YUMC took 40.9s. Estimated remaining: 1m 50s. Rate: 7.1 symbols/min [2025-10-17T22:32:15.250331] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:32:15.276787] [DEBUG] [LOCAL ] ZH: Loaded 25479 existing records from primary storage. [2025-10-17T22:32:15.277088] [INFO ] [MAIN ] ZH: Loaded 25479 existing records. [2025-10-17T22:32:15.458752] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:32:15.458990] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-17T22:32:15.459046] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-17T22:32:15.459250] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-17T22:32:15.459319] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-17T22:32:15.748097] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-10-17T22:32:15.812176] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-17T22:32:15.859838] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:32:16.387796] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-17T22:32:16.542308] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-10-17T22:32:17.342309] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-17T22:32:17.588506] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-17T22:32:18.113129] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-17T22:32:18.142244] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-17T22:32:18.800535] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T22:32:18.942296] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-17T22:32:19.742325] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-17T22:32:20.334115] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-17T22:32:20.446395] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-17T22:32:20.542298] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-17T22:32:20.739989] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-17T22:32:21.342301] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-10-17T22:32:22.142296] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-17T22:32:22.843160] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-17T22:32:22.942289] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-17T22:32:23.012937] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-17T22:32:23.388372] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-17T22:32:23.742361] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-10-17T22:32:24.542316] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-17T22:32:25.145535] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-17T22:32:25.245746] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-17T22:32:25.342297] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-17T22:32:26.064735] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-17T22:32:26.142299] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-17T22:32:26.942290] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-10. [2025-10-17T22:32:27.037710] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-17T22:32:27.668565] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-17T22:32:27.742263] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-17T22:32:27.787933] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-17T22:32:27.791444] [INFO ] [REMOTE ] ZEPP: Full fetch complete (20827 records). [2025-10-17T22:32:27.791521] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-17T22:32:28.156189] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-17T22:32:28.156281] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-17T22:32:28.156740] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-17T22:32:28.156800] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-17T22:32:28.157488] [DEBUG] [LOCAL ] ZEPP: Trimmed 20827 records to 19285 (keeping 200 days of data) [2025-10-17T22:32:28.267149] [DEBUG] [LOCAL ] ZEPP: Primary data saved (19285 records). [2025-10-17T22:32:28.267283] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-17T22:32:28.267384] [INFO ] [MAIN ] Update Progress: 2356/2368 symbols completed. ZEPP took 27.7s. Estimated remaining: 1m 42s. Rate: 7.1 symbols/min [2025-10-17T22:32:28.435390] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:32:28.488340] [DEBUG] [LOCAL ] ZIM: Loaded 53881 existing records from primary storage. [2025-10-17T22:32:28.488717] [INFO ] [MAIN ] ZIM: Loaded 53881 existing records. [2025-10-17T22:32:28.552173] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-17T22:32:28.678472] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:32:28.678727] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-17T22:32:28.678794] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-17T22:32:28.679012] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-17T22:32:28.679065] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-17T22:32:29.023261] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:32:29.342336] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-10-17T22:32:29.865946] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-17T22:32:30.142378] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-17T22:32:30.901208] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-17T22:32:30.942318] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-17T22:32:31.624367] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-17T22:32:31.742314] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-17T22:32:32.280779] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-17T22:32:32.354043] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-17T22:32:32.542302] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-17T22:32:33.167602] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-17T22:32:33.342282] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-17T22:32:34.142284] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-17T22:32:34.633734] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-17T22:32:34.746551] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-17T22:32:34.942308] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-17T22:32:35.634338] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-17T22:32:35.742330] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-17T22:32:36.542305] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-17T22:32:36.635740] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-17T22:32:36.803042] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-17T22:32:37.342353] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-17T22:32:38.142290] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-17T22:32:38.942584] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-17T22:32:38.959297] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-17T22:32:39.023566] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-17T22:32:39.167118] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-17T22:32:39.742305] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-17T22:32:40.542305] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-17T22:32:41.004674] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-17T22:32:41.342301] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-17T22:32:41.929908] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T22:32:42.097340] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-17T22:32:42.142274] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-17T22:32:42.908497] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-17T22:32:42.942336] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-17T22:32:43.742404] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-17T22:32:44.488883] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-17T22:32:44.542252] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-17T22:32:44.809420] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-17T22:32:45.342274] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-17T22:32:45.488700] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-17T22:32:46.142279] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-17T22:32:46.628138] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-17T22:32:46.942273] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-17T22:32:47.059438] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-17T22:32:47.066943] [INFO ] [REMOTE ] ZETA: Full fetch complete (77734 records). [2025-10-17T22:32:47.067067] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-17T22:32:47.466792] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-17T22:32:47.466879] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-17T22:32:47.468180] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-17T22:32:47.468246] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-17T22:32:47.469815] [DEBUG] [LOCAL ] ZETA: Trimmed 77734 records to 54397 (keeping 200 days of data) [2025-10-17T22:32:47.746606] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-17T22:32:47.791543] [DEBUG] [LOCAL ] ZETA: Primary data saved (54397 records). [2025-10-17T22:32:47.791639] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-17T22:32:47.791759] [INFO ] [MAIN ] Update Progress: 2357/2368 symbols completed. ZETA took 36.2s. Estimated remaining: 1m 33s. Rate: 7.1 symbols/min [2025-10-17T22:32:48.116795] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-17T22:32:48.122762] [INFO ] [REMOTE ] ZGN: Full fetch complete (58694 records). [2025-10-17T22:32:48.122875] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-17T22:32:48.507180] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-17T22:32:48.507284] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-17T22:32:48.508853] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-17T22:32:48.508974] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-17T22:32:48.510620] [DEBUG] [LOCAL ] ZGN: Trimmed 58694 records to 41539 (keeping 200 days of data) [2025-10-17T22:32:48.633245] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-17T22:32:48.657094] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-17T22:32:48.662406] [INFO ] [REMOTE ] ZH: Full fetch complete (39868 records). [2025-10-17T22:32:48.662888] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-17T22:32:48.662289] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-17T22:32:49.216173] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-17T22:32:49.217755] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-17T22:32:49.219207] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-17T22:32:49.219291] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-17T22:32:49.228082] [DEBUG] [LOCAL ] ZH: Trimmed 39868 records to 25565 (keeping 200 days of data) [2025-10-17T22:32:49.329432] [DEBUG] [LOCAL ] ZGN: Primary data saved (41539 records). [2025-10-17T22:32:49.330165] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-17T22:32:49.331333] [INFO ] [MAIN ] Update Progress: 2358/2368 symbols completed. ZGN took 36.2s. Estimated remaining: 1m 25s. Rate: 7.1 symbols/min [2025-10-17T22:32:49.383950] [DEBUG] [LOCAL ] ZH: Primary data saved (25565 records). [2025-10-17T22:32:49.384088] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-17T22:32:49.384169] [INFO ] [MAIN ] Update Progress: 2359/2368 symbols completed. ZH took 34.3s. Estimated remaining: 1m 16s. Rate: 7.1 symbols/min [2025-10-17T22:32:50.865320] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-17T22:32:50.876508] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-17T22:32:53.205760] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-17T22:32:53.218027] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-10-17T22:32:55.572538] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-17T22:32:55.584718] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-10-17T22:32:57.833702] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-17T22:32:57.845035] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-10. [2025-10-17T22:32:59.970819] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-17T22:32:59.978611] [INFO ] [REMOTE ] ZIM: Full fetch complete (77598 records). [2025-10-17T22:32:59.978833] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-17T22:33:00.382690] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-17T22:33:00.382773] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-17T22:33:00.384005] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-17T22:33:00.384068] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-17T22:33:00.385476] [DEBUG] [LOCAL ] ZIM: Trimmed 77598 records to 54263 (keeping 200 days of data) [2025-10-17T22:33:00.710284] [DEBUG] [LOCAL ] ZIM: Primary data saved (54263 records). [2025-10-17T22:33:00.710413] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-17T22:33:00.710491] [INFO ] [MAIN ] Update Progress: 2360/2368 symbols completed. ZIM took 32.4s. Estimated remaining: 1m 8s. Rate: 7.1 symbols/min [2025-10-17T22:33:01.336142] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:33:01.389146] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:33:01.488569] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:33:01.493754] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:33:01.505535] [DEBUG] [LOCAL ] ZKH: Loaded 7484 existing records from primary storage. [2025-10-17T22:33:01.506039] [INFO ] [MAIN ] ZKH: Loaded 7484 existing records. [2025-10-17T22:33:01.693370] [DEBUG] [LOCAL ] ZK: Loaded 39387 existing records from primary storage. [2025-10-17T22:33:01.781793] [INFO ] [MAIN ] ZK: Loaded 39387 existing records. [2025-10-17T22:33:01.792915] [DEBUG] [LOCAL ] ZTO: Loaded 49876 existing records from primary storage. [2025-10-17T22:33:01.792046] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:33:01.788224] [DEBUG] [LOCAL ] ZIP: Loaded 43935 existing records from primary storage. [2025-10-17T22:33:01.799626] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-17T22:33:01.799921] [INFO ] [MAIN ] ZIP: Loaded 43935 existing records. [2025-10-17T22:33:01.798819] [INFO ] [MAIN ] ZTO: Loaded 49876 existing records. [2025-10-17T22:33:01.821781] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-17T22:33:01.907699] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-17T22:33:02.000617] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-17T22:33:02.444360] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:33:02.524788] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-17T22:33:02.514352] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:33:02.530342] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-17T22:33:02.545730] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-17T22:33:02.549038] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-17T22:33:02.574710] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-17T22:33:02.591378] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-17T22:33:02.609755] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:33:02.642100] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-17T22:33:02.634370] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-17T22:33:02.708330] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-17T22:33:02.834407] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-17T22:33:02.935730] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-17T22:33:02.990196] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-17T22:33:03.106469] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:33:03.216914] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-10-17T22:33:03.747740] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:33:03.784981] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-10-17T22:33:03.904964] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:33:03.927159] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-10-17T22:33:03.949565] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:33:03.950022] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-10-17T22:33:03.983785] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-17T22:33:03.985440] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-17T22:33:04.718111] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-17T22:33:04.722491] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-17T22:33:05.291597] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-17T22:33:05.307441] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-17T22:33:05.327198] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-17T22:33:05.335515] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-17T22:33:05.348306] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-17T22:33:05.352282] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-17T22:33:05.403102] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-17T22:33:05.414784] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-17T22:33:06.186002] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-17T22:33:06.188633] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-17T22:33:06.587331] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-17T22:33:06.597305] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-17T22:33:06.762601] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-17T22:33:06.774239] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-17T22:33:06.781492] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-17T22:33:06.783949] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-17T22:33:07.234159] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-17T22:33:07.244292] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-17T22:33:07.374676] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-17T22:33:07.376432] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-17T22:33:07.600931] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-17T22:33:07.609946] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-17T22:33:07.956826] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-17T22:33:07.958419] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-17T22:33:08.215562] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-17T22:33:08.223326] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-17T22:33:08.800156] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-17T22:33:08.810047] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-17T22:33:08.950616] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-17T22:33:08.952599] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-17T22:33:08.956904] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-17T22:33:09.342312] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-17T22:33:09.605139] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-17T22:33:09.734461] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-17T22:33:10.142322] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-17T22:33:10.373354] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-17T22:33:10.927232] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-17T22:33:10.942246] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-17T22:33:11.542254] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-17T22:33:11.742320] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-17T22:33:12.542833] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-17T22:33:12.543698] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-17T22:33:12.648761] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-17T22:33:13.342340] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-17T22:33:13.877094] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-17T22:33:13.926717] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-17T22:33:13.927945] [INFO ] [REMOTE ] ZKH: Full fetch complete (11870 records). [2025-10-17T22:33:13.928015] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-17T22:33:14.147535] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-17T22:33:14.313913] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-17T22:33:14.314024] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-17T22:33:14.314402] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-17T22:33:14.314488] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-17T22:33:14.315386] [DEBUG] [LOCAL ] ZKH: Trimmed 11870 records to 7505 (keeping 200 days of data) [2025-10-17T22:33:14.361364] [DEBUG] [LOCAL ] ZKH: Primary data saved (7505 records). [2025-10-17T22:33:14.361483] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-17T22:33:14.361572] [INFO ] [MAIN ] Update Progress: 2361/2368 symbols completed. ZKH took 13.6s. Estimated remaining: 59.3s. Rate: 7.1 symbols/min [2025-10-17T22:33:14.555176] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:33:14.571702] [DEBUG] [LOCAL ] ZTR: Loaded 16776 existing records from primary storage. [2025-10-17T22:33:14.571929] [INFO ] [MAIN ] ZTR: Loaded 16776 existing records. [2025-10-17T22:33:14.768613] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:33:14.768899] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-17T22:33:14.768957] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-17T22:33:14.769148] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-17T22:33:14.769216] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-17T22:33:14.943363] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-17T22:33:15.168959] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:33:15.744331] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-17T22:33:15.746342] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-17T22:33:16.083762] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-17T22:33:16.542297] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-17T22:33:17.342365] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-17T22:33:17.381299] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-17T22:33:18.015006] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-17T22:33:18.142400] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-10-17T22:33:18.844843] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-17T22:33:18.942253] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-17T22:33:19.186606] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-17T22:33:19.742297] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-17T22:33:20.371556] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-17T22:33:20.542261] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-17T22:33:20.953393] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-17T22:33:21.342297] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-17T22:33:21.918292] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-17T22:33:22.142270] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-17T22:33:22.499999] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-17T22:33:22.942308] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-17T22:33:23.467304] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-17T22:33:23.472859] [INFO ] [REMOTE ] ZK: Full fetch complete (56931 records). [2025-10-17T22:33:23.472956] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-17T22:33:23.742388] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-17T22:33:23.892498] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-17T22:33:23.892678] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-17T22:33:23.894093] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-17T22:33:23.894224] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-17T22:33:23.895572] [DEBUG] [LOCAL ] ZK: Trimmed 56931 records to 39593 (keeping 200 days of data) [2025-10-17T22:33:23.996950] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-17T22:33:24.143550] [DEBUG] [LOCAL ] ZK: Primary data saved (39593 records). [2025-10-17T22:33:24.143733] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-17T22:33:24.143842] [INFO ] [MAIN ] Update Progress: 2362/2368 symbols completed. ZK took 23.4s. Estimated remaining: 50.8s. Rate: 7.1 symbols/min [2025-10-17T22:33:24.314473] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:33:24.363803] [DEBUG] [LOCAL ] ZTS: Loaded 53529 existing records from primary storage. [2025-10-17T22:33:24.364135] [INFO ] [MAIN ] ZTS: Loaded 53529 existing records. [2025-10-17T22:33:24.534992] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:33:24.535185] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-17T22:33:24.535230] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-17T22:33:24.535421] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-17T22:33:24.535458] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-17T22:33:24.547988] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-17T22:33:24.885200] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:33:25.300239] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-17T22:33:25.342246] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-17T22:33:26.142278] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-17T22:33:26.347963] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-17T22:33:26.765772] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-17T22:33:26.853890] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-17T22:33:26.942282] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-17T22:33:27.742310] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-17T22:33:28.485897] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-17T22:33:28.542255] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-17T22:33:29.342284] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-10-17T22:33:29.474278] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-17T22:33:29.959929] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-17T22:33:29.965846] [INFO ] [REMOTE ] ZIP: Full fetch complete (60478 records). [2025-10-17T22:33:29.965985] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-17T22:33:30.142783] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-17T22:33:30.356138] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-17T22:33:30.356298] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-17T22:33:30.357477] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-17T22:33:30.357546] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-17T22:33:30.358946] [DEBUG] [LOCAL ] ZIP: Trimmed 60478 records to 44273 (keeping 200 days of data) [2025-10-17T22:33:30.599904] [DEBUG] [LOCAL ] ZIP: Primary data saved (44273 records). [2025-10-17T22:33:30.600041] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-17T22:33:30.600123] [INFO ] [MAIN ] Update Progress: 2363/2368 symbols completed. ZIP took 29.9s. Estimated remaining: 42.3s. Rate: 7.1 symbols/min [2025-10-17T22:33:30.765697] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:33:30.798860] [DEBUG] [LOCAL ] ZVIA: Loaded 36071 existing records from primary storage. [2025-10-17T22:33:30.799155] [INFO ] [MAIN ] ZVIA: Loaded 36071 existing records. [2025-10-17T22:33:30.946880] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-17T22:33:30.974175] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:33:30.976209] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-17T22:33:30.976279] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-17T22:33:30.976602] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-17T22:33:30.976686] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-17T22:33:31.330436] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:33:31.372374] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-17T22:33:31.576926] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-17T22:33:31.742300] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-10-17T22:33:31.964798] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-17T22:33:32.542282] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-17T22:33:33.321766] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-17T22:33:33.342257] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-17T22:33:34.142308] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-17T22:33:34.180082] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-17T22:33:34.904848] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-17T22:33:34.942319] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-17T22:33:35.086172] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-17T22:33:35.742336] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-17T22:33:36.344820] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-17T22:33:36.542348] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-17T22:33:37.263810] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-17T22:33:37.271430] [INFO ] [REMOTE ] ZTO: Full fetch complete (72881 records). [2025-10-17T22:33:37.271608] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-17T22:33:37.347378] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-17T22:33:37.653715] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-17T22:33:37.653805] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-17T22:33:37.654976] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-17T22:33:37.655039] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-17T22:33:37.656390] [DEBUG] [LOCAL ] ZTO: Trimmed 72881 records to 50253 (keeping 200 days of data) [2025-10-17T22:33:37.968413] [DEBUG] [LOCAL ] ZTO: Primary data saved (50253 records). [2025-10-17T22:33:37.968562] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-17T22:33:37.968669] [INFO ] [MAIN ] Update Progress: 2364/2368 symbols completed. ZTO took 37.3s. Estimated remaining: 33.9s. Rate: 7.1 symbols/min [2025-10-17T22:33:38.142518] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-10-09 to 2025-10-17. [2025-10-17T22:33:38.142771] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-17T22:33:38.182494] [DEBUG] [LOCAL ] ZWS: Loaded 42718 existing records from primary storage. [2025-10-17T22:33:38.182841] [INFO ] [MAIN ] ZWS: Loaded 42718 existing records. [2025-10-17T22:33:38.363862] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-31, but need from 2024-12-31 for 200 day retention. Performing full refresh. [2025-10-17T22:33:38.364319] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-17T22:33:38.364388] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-17T22:33:38.364699] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-17T22:33:38.364809] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-17T22:33:38.474297] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-17T22:33:38.737590] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-17T22:33:38.821984] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-31 to 2025-10-17 (requires 11 months of data pull). [2025-10-17T22:33:38.942304] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-17T22:33:39.623104] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-17T22:33:39.742348] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-17T22:33:40.542311] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-17T22:33:40.699465] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-17T22:33:40.695610] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-17T22:33:41.342255] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-17T22:33:41.435700] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-17T22:33:42.142305] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-17T22:33:42.372979] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-17T22:33:42.942293] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-17T22:33:43.742333] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-17T22:33:43.872849] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-17T22:33:43.875888] [INFO ] [REMOTE ] ZTR: Full fetch complete (26804 records). [2025-10-17T22:33:43.876086] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-17T22:33:44.266029] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-17T22:33:44.288147] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-17T22:33:44.288835] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-17T22:33:44.289441] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-17T22:33:44.289865] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-17T22:33:44.290556] [DEBUG] [LOCAL ] ZTR: Trimmed 26804 records to 16868 (keeping 200 days of data) [2025-10-17T22:33:44.387770] [DEBUG] [LOCAL ] ZTR: Primary data saved (16868 records). [2025-10-17T22:33:44.387916] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-17T22:33:44.387996] [INFO ] [MAIN ] Update Progress: 2365/2368 symbols completed. ZTR took 30.0s. Estimated remaining: 25.4s. Rate: 7.1 symbols/min [2025-10-17T22:33:44.542273] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-17T22:33:45.282109] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-17T22:33:45.342260] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-10-17T22:33:46.142262] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-17T22:33:46.397524] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-17T22:33:46.942278] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-17T22:33:47.138736] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-17T22:33:47.602068] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-17T22:33:47.742281] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-17T22:33:48.542267] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-17T22:33:48.794203] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-17T22:33:49.230860] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-17T22:33:49.342247] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-17T22:33:50.044236] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-17T22:33:50.142301] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-17T22:33:50.831604] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-17T22:33:50.942270] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-17T22:33:51.742269] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-17T22:33:51.990032] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-17T22:33:52.346377] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-17T22:33:52.542287] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-17T22:33:53.303481] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-17T22:33:53.342246] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-17T22:33:54.142287] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-17T22:33:54.506732] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-17T22:33:54.942272] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-17T22:33:54.974991] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-17T22:33:55.119816] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-17T22:33:55.124991] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52826 records). [2025-10-17T22:33:55.125088] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-17T22:33:55.491225] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-17T22:33:55.491300] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-17T22:33:55.492294] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-17T22:33:55.492355] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-17T22:33:55.493363] [DEBUG] [LOCAL ] ZVIA: Trimmed 52826 records to 36311 (keeping 200 days of data) [2025-10-17T22:33:55.686725] [DEBUG] [LOCAL ] ZVIA: Primary data saved (36311 records). [2025-10-17T22:33:55.686853] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-17T22:33:55.686930] [INFO ] [MAIN ] Update Progress: 2366/2368 symbols completed. ZVIA took 25.1s. Estimated remaining: 16.9s. Rate: 7.1 symbols/min [2025-10-17T22:33:55.742307] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-17T22:33:56.753503] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-17T22:33:56.764760] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-17T22:33:57.416746] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-17T22:33:57.426966] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-17T22:33:58.813549] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-17T22:33:58.825386] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-17T22:33:58.873884] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-17T22:33:58.942281] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-17T22:33:59.503424] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-17T22:33:59.510836] [INFO ] [REMOTE ] ZTS: Full fetch complete (76876 records). [2025-10-17T22:33:59.510984] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-17T22:33:59.916675] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-17T22:33:59.916859] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-17T22:33:59.918277] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-17T22:33:59.918344] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-17T22:33:59.919806] [DEBUG] [LOCAL ] ZTS: Trimmed 76876 records to 53916 (keeping 200 days of data) [2025-10-17T22:34:00.187495] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-17T22:34:00.254358] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-17T22:34:00.281894] [DEBUG] [LOCAL ] ZTS: Primary data saved (53916 records). [2025-10-17T22:34:00.282007] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-17T22:34:00.282089] [INFO ] [MAIN ] Update Progress: 2367/2368 symbols completed. ZTS took 36.1s. Estimated remaining: 8.5s. Rate: 7.1 symbols/min [2025-10-17T22:34:01.876342] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-17T22:34:01.886727] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-17T22:34:03.421902] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-17T22:34:03.431326] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-17T22:34:04.915009] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-17T22:34:04.924424] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-17T22:34:06.313515] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-17T22:34:06.319554] [INFO ] [REMOTE ] ZWS: Full fetch complete (62111 records). [2025-10-17T22:34:06.319727] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-17T22:34:06.708071] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-17T22:34:06.708170] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-17T22:34:06.709372] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-17T22:34:06.709437] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-17T22:34:06.710856] [DEBUG] [LOCAL ] ZWS: Trimmed 62111 records to 43041 (keeping 200 days of data) [2025-10-17T22:34:06.975776] [DEBUG] [LOCAL ] ZWS: Primary data saved (43041 records). [2025-10-17T22:34:06.975907] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-17T22:34:06.975987] [INFO ] [MAIN ] Update Progress: 2368/2368 symbols completed. ZWS took 29.0s. Estimated remaining: 0.0s. Rate: 7.1 symbols/min [2025-10-17T22:34:06.977319] [INFO ] [MAIN ] Parallel update completed in 5h 34m 3s [2025-10-17T22:34:06.977517] [WARN ] [MAIN ] Failed symbols (285): AAMI, AAM, AAUC, AB, ABT, ACP, AD, ACVA, ADCT, AEE... [2025-10-17T22:34:06.977635] [INFO ] [MAIN ] Update success rate: 88.0% (2083/2368 symbols) [2025-10-17T22:34:07.782301] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2083/2368 @ 87.96%)' [2025-10-17T22:34:07.782830] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-17T22:34:07.782896] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-17T22:34:07.782932] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-17T22:34:07.783016] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-17T22:34:07.783052] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-17T22:34:09.432782] [DEBUG] [SYMBOL ] Found 2420 valid NYSE symbols. [2025-10-17T22:34:09.432940] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-17T22:34:09.433140] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-17T22:34:09.433711] [INFO ] [LOCAL ] Symbols cache updated with 2368 symbols. [2025-10-17T22:34:09.433771] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-17T22:34:09.433804] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-17T22:34:09.433859] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-17T22:34:09.433891] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-17T22:34:09.433921] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-17T22:34:09.434289] [DEBUG] [LOCAL ] Found 2368 symbols in cached list. [2025-10-17T22:34:09.434342] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-17T22:34:09.434519] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-17T22:34:09.434552] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2368 valid symbols. [2025-10-17T22:34:09.434611] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-17T22:34:09.434693] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-17T22:34:09.461395] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-17T22:34:09.483290] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-17T22:34:09.483349] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-17T22:34:09.483381] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-17T22:34:09.483410] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-17T22:34:09.483461] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-17T22:34:09.483490] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-17T22:34:09.483522] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-17T22:34:09.484559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-10-17T22:34:09.484716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-17T22:34:09.484827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-17T22:34:09.484924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-17T22:34:09.485017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-17T22:34:09.485125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-10-17T22:34:09.485259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-10-17T22:34:09.485381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-17T22:34:09.485471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-17T22:34:09.485559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-10-17T22:34:09.485675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-17T22:34:09.485769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-10-17T22:34:09.485837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-10-17T22:34:09.485931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-10-17T22:34:09.486024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-17T22:34:09.486118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-17T22:34:09.486236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-17T22:34:09.486346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-10-17T22:34:09.486451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-10-17T22:34:09.486579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-17T22:34:09.486724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-10-17T22:34:09.486854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-10-17T22:34:09.487002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-10-17T22:34:09.487118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-10-17T22:34:09.487250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-17T22:34:09.487347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-10-17T22:34:09.487419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-17T22:34:09.487488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-17T22:34:09.487564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-10-17T22:34:09.487718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-10-17T22:34:09.487843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-17T22:34:09.487938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-10-17T22:34:09.488011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-17T22:34:09.488100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-10-17T22:34:09.488193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-10-17T22:34:09.488280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-10-17T22:34:09.488371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-10-17T22:34:09.488441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-17T22:34:09.488549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-17T22:34:09.488692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-10-17T22:34:09.488790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-10-17T22:34:09.488908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-10-17T22:34:09.489032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-17T22:34:09.489150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-17T22:34:09.489240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-17T22:34:09.489357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-17T22:34:09.489452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-17T22:34:09.489521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-17T22:34:09.489590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-17T22:34:09.489693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-17T22:34:09.489805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-17T22:34:09.489912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-10-17T22:34:09.490006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-10-17T22:34:09.490079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-17T22:34:09.490193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-10-17T22:34:09.490301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-17T22:34:09.490407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-17T22:34:09.490481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-17T22:34:09.490567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-10-17T22:34:09.490693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-17T22:34:09.490785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-17T22:34:09.490853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-17T22:34:09.490919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-17T22:34:09.491001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-10-17T22:34:09.491091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-17T22:34:09.491174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-17T22:34:09.491296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-17T22:34:09.491417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-10-17T22:34:09.491507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-10-17T22:34:09.491603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-17T22:34:09.491736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-17T22:34:09.491827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-17T22:34:09.491899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-17T22:34:09.491978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-10-17T22:34:09.492056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-17T22:34:09.492121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-17T22:34:09.492213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-10-17T22:34:09.492306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-17T22:34:09.492386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-17T22:34:09.492453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-17T22:34:09.492545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-17T22:34:09.492635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-17T22:34:09.492770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-17T22:34:09.492877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-17T22:34:09.492971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-10-17T22:34:09.493064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-17T22:34:09.493156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-10-17T22:34:09.493244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-17T22:34:09.493334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-17T22:34:09.493416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-10-17T22:34:09.493544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-17T22:34:09.493678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-10-17T22:34:09.493774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-17T22:34:09.493870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-17T22:34:09.493974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-17T22:34:09.494071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-17T22:34:09.494171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-17T22:34:09.494291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-10-17T22:34:09.494383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-17T22:34:09.494456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-17T22:34:09.494527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-10-17T22:34:09.494629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-17T22:34:09.494802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-17T22:34:09.494880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-17T22:34:09.494968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-10-17T22:34:09.495070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-17T22:34:09.495159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-10-17T22:34:09.495253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-10-17T22:34:09.495326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-17T22:34:09.495394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-17T22:34:09.495481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-17T22:34:09.495575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-17T22:34:09.495683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-17T22:34:09.495786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-10-17T22:34:09.495859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-17T22:34:09.495928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-10-17T22:34:09.495995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-17T22:34:09.496062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-17T22:34:09.496130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-17T22:34:09.496198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-17T22:34:09.496280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-10-17T22:34:09.496375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-17T22:34:09.496446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-10-17T22:34:09.496513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-17T22:34:09.496577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-17T22:34:09.496675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-17T22:34:09.496779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-10-17T22:34:09.496848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-17T22:34:09.496916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-17T22:34:09.496993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-17T22:34:09.497060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-17T22:34:09.497124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-10-17T22:34:09.497202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-10-17T22:34:09.497267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-17T22:34:09.497331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-10-17T22:34:09.497395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-17T22:34:09.497461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-10-17T22:34:09.497541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-10-17T22:34:09.497632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-17T22:34:09.497793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-17T22:34:09.497882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-10-17T22:34:09.497961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-17T22:34:09.498028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-17T22:34:09.498108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-17T22:34:09.498208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-17T22:34:09.498291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-17T22:34:09.498373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-17T22:34:09.498475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-17T22:34:09.498566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-17T22:34:09.498632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-17T22:34:09.498820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-17T22:34:09.498909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-17T22:34:09.498999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-17T22:34:09.499066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-17T22:34:09.499139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-17T22:34:09.499220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-17T22:34:09.499326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-17T22:34:09.499416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-17T22:34:09.499483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-10-17T22:34:09.499563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-17T22:34:09.499730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-17T22:34:09.499855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-17T22:34:09.499931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-17T22:34:09.499999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-10-17T22:34:09.500069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-10-17T22:34:09.500135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-10-17T22:34:09.500204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-10-17T22:34:09.500271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-17T22:34:09.500338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-17T22:34:09.500403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-10-17T22:34:09.500467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-17T22:34:09.500558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-10-17T22:34:09.500690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-10-17T22:34:09.500782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-17T22:34:09.500864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-10-17T22:34:09.500947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-17T22:34:09.501014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-17T22:34:09.501096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-17T22:34:09.501203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-10-17T22:34:09.501309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-10-17T22:34:09.501397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-10-17T22:34:09.501471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-17T22:34:09.501537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-10-17T22:34:09.501598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-17T22:34:09.501699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-10-17T22:34:09.501792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-17T22:34:09.501859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-10-17T22:34:09.501927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-10-17T22:34:09.502003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-10-17T22:34:09.502097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-17T22:34:09.502241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-10-17T22:34:09.502375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-17T22:34:09.502505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-10-17T22:34:09.502682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-17T22:34:09.502837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-17T22:34:09.502977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-17T22:34:09.503123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-17T22:34:09.503268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-17T22:34:09.503417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-10-17T22:34:09.503560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-10-17T22:34:09.503703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-10-17T22:34:09.503847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-10-17T22:34:09.503978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-17T22:34:09.504115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-17T22:34:09.504250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-10-17T22:34:09.504395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-10-17T22:34:09.504533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-17T22:34:09.504692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-10-17T22:34:09.504823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-17T22:34:09.504975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-10-17T22:34:09.505107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-17T22:34:09.505243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-10-17T22:34:09.505380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-17T22:34:09.505511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-10-17T22:34:09.505623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-10-17T22:34:09.505806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-17T22:34:09.505940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-17T22:34:09.506028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-17T22:34:09.506167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-17T22:34:09.506285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-10-17T22:34:09.506427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-17T22:34:09.506569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-17T22:34:09.506923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-17T22:34:09.507064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-10-17T22:34:09.507157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-17T22:34:09.507228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-17T22:34:09.507294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-10-17T22:34:09.507434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-17T22:34:09.507578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-17T22:34:09.507759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-17T22:34:09.507900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-10-17T22:34:09.508052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-10-17T22:34:09.508186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-17T22:34:09.508267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-17T22:34:09.508355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-17T22:34:09.508448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-10-17T22:34:09.508524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-17T22:34:09.508610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-17T22:34:09.508739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-17T22:34:09.508822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-10-17T22:34:09.508912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-17T22:34:09.509008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-10-17T22:34:09.509083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-17T22:34:09.509153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-17T22:34:09.509224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-17T22:34:09.509292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-17T22:34:09.509380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-10-17T22:34:09.509475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-17T22:34:09.509545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-17T22:34:09.509616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-10-17T22:34:09.509735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-17T22:34:09.509821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-17T22:34:09.509894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-17T22:34:09.509978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-10-17T22:34:09.510072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-17T22:34:09.510142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-17T22:34:09.510230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-17T22:34:09.510351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-17T22:34:09.510437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-10-17T22:34:09.510507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-17T22:34:09.510576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-10-17T22:34:09.510669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-17T22:34:09.510767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-10-17T22:34:09.510858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-17T22:34:09.510952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-17T22:34:09.511023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-17T22:34:09.511091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-17T22:34:09.511160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-17T22:34:09.511230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-10-17T22:34:09.511301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-17T22:34:09.511370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-10-17T22:34:09.511435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-17T22:34:09.511502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-17T22:34:09.511570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-17T22:34:09.511638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-17T22:34:09.511784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-10-17T22:34:09.511870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-17T22:34:09.512008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-10-17T22:34:09.512095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-10-17T22:34:09.512186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-17T22:34:09.512269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-17T22:34:09.512362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-17T22:34:09.512429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-17T22:34:09.512513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-10-17T22:34:09.512603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-17T22:34:09.512709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-17T22:34:09.512802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-17T22:34:09.512868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-17T22:34:09.512934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-17T22:34:09.512999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-17T22:34:09.513064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-10-17T22:34:09.513126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-10-17T22:34:09.513191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-10-17T22:34:09.513257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-17T22:34:09.513320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-17T22:34:09.513383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-17T22:34:09.513484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-17T22:34:09.513567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-10-17T22:34:09.513673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-10-17T22:34:09.513768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-10-17T22:34:09.513834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-10-17T22:34:09.513901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-17T22:34:09.513982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-10-17T22:34:09.514100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-17T22:34:09.514174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-17T22:34:09.514242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-10-17T22:34:09.514315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-17T22:34:09.514383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-10-17T22:34:09.514466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-17T22:34:09.514570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-17T22:34:09.514639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-10-17T22:34:09.514811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-10-17T22:34:09.514882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-10-17T22:34:09.514949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-10-17T22:34:09.515037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-17T22:34:09.515124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-10-17T22:34:09.515194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-17T22:34:09.515262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-17T22:34:09.515329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETSY.csv [2025-10-17T22:34:09.515396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-10-17T22:34:09.515461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-10-17T22:34:09.515528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-10-17T22:34:09.515617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-17T22:34:09.515740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-17T22:34:09.515838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-17T22:34:09.515933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-17T22:34:09.516041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-10-17T22:34:09.516135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-10-17T22:34:09.516222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-10-17T22:34:09.516314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-10-17T22:34:09.516383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-17T22:34:09.516452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-17T22:34:09.516519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-10-17T22:34:09.516585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-17T22:34:09.516689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-17T22:34:09.516782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-17T22:34:09.516850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-17T22:34:09.516912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-17T22:34:09.516978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-10-17T22:34:09.517044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-17T22:34:09.517106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-10-17T22:34:09.517189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-17T22:34:09.517276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-17T22:34:09.517342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-10-17T22:34:09.517407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-17T22:34:09.517489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-17T22:34:09.517576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-17T22:34:09.517705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-17T22:34:09.517799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-17T22:34:09.517866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-17T22:34:09.517929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-17T22:34:09.517993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-10-17T22:34:09.518055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-17T22:34:09.518116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-10-17T22:34:09.518178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-10-17T22:34:09.518240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-10-17T22:34:09.518303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-17T22:34:09.518366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-17T22:34:09.518429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-17T22:34:09.518493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-17T22:34:09.518560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-10-17T22:34:09.518623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-17T22:34:09.518736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-17T22:34:09.518812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-17T22:34:09.518891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-17T22:34:09.518954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-17T22:34:09.519035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-17T22:34:09.519123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-17T22:34:09.519191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-17T22:34:09.519255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-17T22:34:09.519345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-17T22:34:09.519412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-10-17T22:34:09.519484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-17T22:34:09.519555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-10-17T22:34:09.519687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-17T22:34:09.519783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-10-17T22:34:09.519856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-10-17T22:34:09.519924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-17T22:34:09.520019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-17T22:34:09.520103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-10-17T22:34:09.520175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-17T22:34:09.520244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-17T22:34:09.520353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-17T22:34:09.520431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-17T22:34:09.520502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-17T22:34:09.520572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-17T22:34:09.520638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-17T22:34:09.520774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-10-17T22:34:09.520860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-10-17T22:34:09.520929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-17T22:34:09.521017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-17T22:34:09.521109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-17T22:34:09.521179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-17T22:34:09.521249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-10-17T22:34:09.521319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-17T22:34:09.521388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-17T22:34:09.521454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-17T22:34:09.521520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-10-17T22:34:09.521587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-17T22:34:09.521705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-10-17T22:34:09.521813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-10-17T22:34:09.521885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-10-17T22:34:09.521953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-10-17T22:34:09.522025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-10-17T22:34:09.522096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-10-17T22:34:09.522197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-10-17T22:34:09.522287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-10-17T22:34:09.522385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-10-17T22:34:09.522471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-17T22:34:09.522563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-17T22:34:09.522780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-17T22:34:09.522874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-17T22:34:09.522944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-10-17T22:34:09.523009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-10-17T22:34:09.523074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-10-17T22:34:09.523138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-17T22:34:09.523221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-17T22:34:09.523313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-17T22:34:09.523379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-10-17T22:34:09.523470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-10-17T22:34:09.523569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-17T22:34:09.523637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-17T22:34:09.523753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-10-17T22:34:09.523827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-17T22:34:09.523893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-17T22:34:09.523956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-10-17T22:34:09.524021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-17T22:34:09.524092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-10-17T22:34:09.524175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-17T22:34:09.524255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-10-17T22:34:09.524344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-17T22:34:09.524411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-17T22:34:09.524476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-10-17T22:34:09.524541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-17T22:34:09.524618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-17T22:34:09.524736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-10-17T22:34:09.524811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-10-17T22:34:09.524876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-10-17T22:34:09.524943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-17T22:34:09.525008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-10-17T22:34:09.525082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-17T22:34:09.525147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-17T22:34:09.525210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-17T22:34:09.525281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-10-17T22:34:09.525345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-10-17T22:34:09.525455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-17T22:34:09.525532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-17T22:34:09.525600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-17T22:34:09.525724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-10-17T22:34:09.525808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-17T22:34:09.525876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-10-17T22:34:09.525958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-10-17T22:34:09.526025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-17T22:34:09.526092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-17T22:34:09.526158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-17T22:34:09.526222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-17T22:34:09.526314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-10-17T22:34:09.526406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-17T22:34:09.526478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-17T22:34:09.526557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-17T22:34:09.526675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-10-17T22:34:09.526782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-17T22:34:09.526889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-17T22:34:09.526969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-17T22:34:09.527049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-17T22:34:09.527146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-10-17T22:34:09.527221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-17T22:34:09.527288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-10-17T22:34:09.527353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-17T22:34:09.527418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-10-17T22:34:09.527500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-17T22:34:09.527589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-17T22:34:09.527718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-17T22:34:09.527820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-17T22:34:09.527889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-17T22:34:09.527952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-17T22:34:09.528017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-17T22:34:09.528082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-17T22:34:09.528180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-10-17T22:34:09.528268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-17T22:34:09.528334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-17T22:34:09.528398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-17T22:34:09.528469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-17T22:34:09.528532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-17T22:34:09.528594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-17T22:34:09.528694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-17T22:34:09.528784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-17T22:34:09.528856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-17T22:34:09.528940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-17T22:34:09.529032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-17T22:34:09.529099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-10-17T22:34:09.529164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-17T22:34:09.529240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-17T22:34:09.529307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-17T22:34:09.529376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-17T22:34:09.529439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-17T22:34:09.529503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-17T22:34:09.529564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-10-17T22:34:09.529629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-17T22:34:09.529746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-10-17T22:34:09.529822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-17T22:34:09.529890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-17T22:34:09.529957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-17T22:34:09.530022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-10-17T22:34:09.530085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-10-17T22:34:09.530150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-17T22:34:09.530213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-17T22:34:09.530278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-10-17T22:34:09.530345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-17T22:34:09.530412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-17T22:34:09.530495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-17T22:34:09.530608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-10-17T22:34:09.530852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-17T22:34:09.530932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-17T22:34:09.531001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-10-17T22:34:09.531066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-17T22:34:09.531175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-17T22:34:09.531252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-10-17T22:34:09.531321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-10-17T22:34:09.531391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-17T22:34:09.531461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-17T22:34:09.531529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-10-17T22:34:09.531599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-17T22:34:09.531695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-10-17T22:34:09.531786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-17T22:34:09.531863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-10-17T22:34:09.531932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-17T22:34:09.532002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-17T22:34:09.532069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-10-17T22:34:09.532135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-17T22:34:09.532221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-17T22:34:09.532312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-17T22:34:09.532384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-17T22:34:09.532451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-10-17T22:34:09.532520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-17T22:34:09.532587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-17T22:34:09.532681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-17T22:34:09.532787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-17T22:34:09.532879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-10-17T22:34:09.532950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-17T22:34:09.533017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-10-17T22:34:09.533085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-17T22:34:09.533150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-17T22:34:09.533216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-17T22:34:09.533284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-10-17T22:34:09.533369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-17T22:34:09.533460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-17T22:34:09.533542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-17T22:34:09.533636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-17T22:34:09.533765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-17T22:34:09.533836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-10-17T22:34:09.533902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-10-17T22:34:09.533966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-10-17T22:34:09.534030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-10-17T22:34:09.534094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-17T22:34:09.534159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-17T22:34:09.534224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-10-17T22:34:09.534288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-17T22:34:09.534352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-17T22:34:09.534416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-17T22:34:09.534479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-17T22:34:09.534544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-17T22:34:09.534607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-10-17T22:34:09.534722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-17T22:34:09.534807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-17T22:34:09.534875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-17T22:34:09.534939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-17T22:34:09.535003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-17T22:34:09.535066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-17T22:34:09.535131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-17T22:34:09.535214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-17T22:34:09.535302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-17T22:34:09.535368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-17T22:34:09.535449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-10-17T22:34:09.535541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-17T22:34:09.535610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-17T22:34:09.535715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-10-17T22:34:09.535798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-17T22:34:09.535864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-17T22:34:09.535928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-17T22:34:09.535996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-17T22:34:09.536062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-10-17T22:34:09.536125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-10-17T22:34:09.536206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-17T22:34:09.536293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-17T22:34:09.536359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-17T22:34:09.536422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-17T22:34:09.536577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-17T22:34:09.536703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-17T22:34:09.536809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-17T22:34:09.536879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-10-17T22:34:09.536947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-10-17T22:34:09.537066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-10-17T22:34:09.537133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-10-17T22:34:09.537210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-17T22:34:09.537315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-17T22:34:09.537385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-17T22:34:09.537453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-17T22:34:09.537533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-17T22:34:09.537624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-17T22:34:09.537779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-17T22:34:09.537903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-17T22:34:09.537987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-17T22:34:09.538054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-10-17T22:34:09.538117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-10-17T22:34:09.538183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-10-17T22:34:09.538247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-17T22:34:09.538310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-17T22:34:09.538375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-17T22:34:09.538436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-17T22:34:09.538504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-17T22:34:09.538572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-17T22:34:09.538639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-17T22:34:09.538866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-17T22:34:09.538940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-10-17T22:34:09.539008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-10-17T22:34:09.539077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-10-17T22:34:09.539144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-17T22:34:09.539221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-17T22:34:09.539284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-17T22:34:09.539366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-10-17T22:34:09.539456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-10-17T22:34:09.539525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-17T22:34:09.539590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-10-17T22:34:09.539718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-17T22:34:09.539813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-17T22:34:09.539880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-10-17T22:34:09.539947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-17T22:34:09.540011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-10-17T22:34:09.540081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-17T22:34:09.540146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-10-17T22:34:09.540216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-10-17T22:34:09.540281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-17T22:34:09.540346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-10-17T22:34:09.540409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-17T22:34:09.540471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-17T22:34:09.540533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-10-17T22:34:09.540597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-17T22:34:09.540691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-10-17T22:34:09.540790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-17T22:34:09.540860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-17T22:34:09.540925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-10-17T22:34:09.540989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-17T22:34:09.541065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-17T22:34:09.541131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-17T22:34:09.541194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-17T22:34:09.541268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-10-17T22:34:09.541332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-17T22:34:09.541397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-17T22:34:09.541462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-17T22:34:09.541526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-10-17T22:34:09.541590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-17T22:34:09.541689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-10-17T22:34:09.541789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-17T22:34:09.541857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-10-17T22:34:09.541926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-10-17T22:34:09.541990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-17T22:34:09.542054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-10-17T22:34:09.542169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-17T22:34:09.542245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-10-17T22:34:09.542313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-17T22:34:09.542379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-10-17T22:34:09.542448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-17T22:34:09.542513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-17T22:34:09.542577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-10-17T22:34:09.542666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-17T22:34:09.542764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-10-17T22:34:09.542834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-17T22:34:09.542901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-17T22:34:09.542966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-17T22:34:09.543030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-17T22:34:09.543093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-10-17T22:34:09.543157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-17T22:34:09.543220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-17T22:34:09.543283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-10-17T22:34:09.543349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-10-17T22:34:09.543463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-10-17T22:34:09.543532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-10-17T22:34:09.543619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-10-17T22:34:09.543728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-10-17T22:34:09.543810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-17T22:34:09.543878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-10-17T22:34:09.543947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-10-17T22:34:09.544013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-17T22:34:09.544082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-17T22:34:09.544148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-17T22:34:09.544213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-17T22:34:09.544278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-17T22:34:09.544341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-10-17T22:34:09.544405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-17T22:34:09.544470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-17T22:34:09.544532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-10-17T22:34:09.544599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-17T22:34:09.544698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-17T22:34:09.544787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-10-17T22:34:09.544862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-10-17T22:34:09.544928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-17T22:34:09.544991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-17T22:34:09.545053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-10-17T22:34:09.545117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-10-17T22:34:09.545181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-17T22:34:09.545244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-17T22:34:09.545309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-10-17T22:34:09.545423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-17T22:34:09.545490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-10-17T22:34:09.545553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-17T22:34:09.545616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-10-17T22:34:09.545719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-17T22:34:09.545810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-17T22:34:09.545876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-17T22:34:09.545940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-10-17T22:34:09.546021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-17T22:34:09.546119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-10-17T22:34:09.546186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-17T22:34:09.546250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-17T22:34:09.546313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-17T22:34:09.546388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-10-17T22:34:09.546457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-17T22:34:09.546522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-17T22:34:09.546586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-17T22:34:09.546793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-17T22:34:09.546885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-10-17T22:34:09.546959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-17T22:34:09.547040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-17T22:34:09.547109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-17T22:34:09.547174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-10-17T22:34:09.547254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-17T22:34:09.547354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-17T22:34:09.547423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-10-17T22:34:09.547531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-17T22:34:09.547608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-17T22:34:09.547745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-17T22:34:09.547839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-10-17T22:34:09.547915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-17T22:34:09.547985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-17T22:34:09.548055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-17T22:34:09.548122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-17T22:34:09.548190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-17T22:34:09.548257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-17T22:34:09.548324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-17T22:34:09.548389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-17T22:34:09.548456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-17T22:34:09.548522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-10-17T22:34:09.548589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-17T22:34:09.548689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-17T22:34:09.548783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-17T22:34:09.548853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-17T22:34:09.548922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-10-17T22:34:09.548987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-10-17T22:34:09.549055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-17T22:34:09.549132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-10-17T22:34:09.549198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-17T22:34:09.549263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-10-17T22:34:09.549330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-10-17T22:34:09.549403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-10-17T22:34:09.549490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-17T22:34:09.549581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-17T22:34:09.549679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-10-17T22:34:09.549772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-10-17T22:34:09.549843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-10-17T22:34:09.549911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-10-17T22:34:09.549976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-17T22:34:09.550077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-10-17T22:34:09.550142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-17T22:34:09.550207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-17T22:34:09.550270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-17T22:34:09.550335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-17T22:34:09.550400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-17T22:34:09.550465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-17T22:34:09.550530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-17T22:34:09.550595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-17T22:34:09.550818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-17T22:34:09.550915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-10-17T22:34:09.550984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-10-17T22:34:09.551049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-17T22:34:09.551115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-17T22:34:09.551180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-10-17T22:34:09.551244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-17T22:34:09.551308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-10-17T22:34:09.551370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-10-17T22:34:09.551441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-10-17T22:34:09.551507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-17T22:34:09.551571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-17T22:34:09.551636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-10-17T22:34:09.551754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-10-17T22:34:09.551824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-17T22:34:09.551890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-17T22:34:09.551954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-10-17T22:34:09.552019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-17T22:34:09.552083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-10-17T22:34:09.552146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-10-17T22:34:09.552210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-17T22:34:09.552281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-17T22:34:09.552351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-17T22:34:09.552415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-17T22:34:09.552480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-17T22:34:09.552543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-17T22:34:09.552608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-10-17T22:34:09.552703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-10-17T22:34:09.552788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-17T22:34:09.552907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-17T22:34:09.552983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-17T22:34:09.553050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-17T22:34:09.553152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-10-17T22:34:09.553217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-17T22:34:09.553298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-17T22:34:09.553364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-17T22:34:09.553440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-10-17T22:34:09.553506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-17T22:34:09.553576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-10-17T22:34:09.553700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-10-17T22:34:09.553793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-17T22:34:09.553861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-10-17T22:34:09.553932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-10-17T22:34:09.553997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-10-17T22:34:09.554060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-10-17T22:34:09.554126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-17T22:34:09.554190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-17T22:34:09.554258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-17T22:34:09.554323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-10-17T22:34:09.554387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-10-17T22:34:09.554451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-17T22:34:09.554516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-17T22:34:09.554581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-10-17T22:34:09.554687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-17T22:34:09.554780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-10-17T22:34:09.554863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-10-17T22:34:09.554947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-17T22:34:09.555038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-17T22:34:09.555112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-17T22:34:09.555215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-10-17T22:34:09.555303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-17T22:34:09.555372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-17T22:34:09.555439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-10-17T22:34:09.555505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-17T22:34:09.555573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-17T22:34:09.555668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-17T22:34:09.555768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-10-17T22:34:09.555839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-17T22:34:09.555906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-10-17T22:34:09.555973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-10-17T22:34:09.556038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-10-17T22:34:09.556106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-17T22:34:09.556172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-10-17T22:34:09.556239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-17T22:34:09.556310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-17T22:34:09.556377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-10-17T22:34:09.556442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-17T22:34:09.556506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-10-17T22:34:09.556570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-17T22:34:09.556694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-17T22:34:09.556787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-17T22:34:09.556855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-17T22:34:09.556937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-17T22:34:09.557030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-17T22:34:09.557105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-10-17T22:34:09.557174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-10-17T22:34:09.557242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-17T22:34:09.557307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-10-17T22:34:09.557373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-17T22:34:09.557439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-17T22:34:09.557506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-17T22:34:09.557569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-10-17T22:34:09.557635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-17T22:34:09.557784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-17T22:34:09.557859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-17T22:34:09.557927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-10-17T22:34:09.557992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-17T22:34:09.558055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-10-17T22:34:09.558125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-17T22:34:09.558188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-17T22:34:09.558293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-10-17T22:34:09.558364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-17T22:34:09.558430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-10-17T22:34:09.558502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-10-17T22:34:09.558569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-17T22:34:09.558634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-17T22:34:09.558894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-17T22:34:09.558966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-10-17T22:34:09.559034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-17T22:34:09.559100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-17T22:34:09.559176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-17T22:34:09.559240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-17T22:34:09.559304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-17T22:34:09.559363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-17T22:34:09.559426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-17T22:34:09.559489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-10-17T22:34:09.559551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-10-17T22:34:09.559612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-17T22:34:09.559709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-17T22:34:09.559794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-17T22:34:09.559863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-17T22:34:09.559929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-10-17T22:34:09.560009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-17T22:34:09.560074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-17T22:34:09.560136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-10-17T22:34:09.560197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-17T22:34:09.560272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-17T22:34:09.560336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-17T22:34:09.560408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-17T22:34:09.560473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-17T22:34:09.560534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-17T22:34:09.560596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-17T22:34:09.560687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-17T22:34:09.560776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-10-17T22:34:09.560842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-17T22:34:09.560904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-10-17T22:34:09.560972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-17T22:34:09.561050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-10-17T22:34:09.561112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-10-17T22:34:09.561174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-10-17T22:34:09.561249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-10-17T22:34:09.561310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-10-17T22:34:09.561372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-17T22:34:09.561434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-17T22:34:09.561493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-17T22:34:09.561560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-17T22:34:09.561621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-17T22:34:09.561737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-10-17T22:34:09.561815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-17T22:34:09.561879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-17T22:34:09.561940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-17T22:34:09.562001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-17T22:34:09.562062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-17T22:34:09.562122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-17T22:34:09.562183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-10-17T22:34:09.562243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-10-17T22:34:09.562303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-17T22:34:09.562363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-17T22:34:09.562422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-17T22:34:09.562481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-17T22:34:09.562539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-17T22:34:09.562597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-17T22:34:09.562688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-10-17T22:34:09.562779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-10-17T22:34:09.562846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-17T22:34:09.562908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-17T22:34:09.562969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-10-17T22:34:09.563033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-17T22:34:09.563102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-17T22:34:09.563166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-17T22:34:09.563232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-17T22:34:09.563340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-10-17T22:34:09.563414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-10-17T22:34:09.563480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-10-17T22:34:09.563591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-10-17T22:34:09.563705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-17T22:34:09.563794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-17T22:34:09.563865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-17T22:34:09.563941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-10-17T22:34:09.564007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-10-17T22:34:09.564075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-10-17T22:34:09.564142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-17T22:34:09.564207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-10-17T22:34:09.564272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-17T22:34:09.564336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-17T22:34:09.564402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-10-17T22:34:09.564470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-17T22:34:09.564537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-17T22:34:09.564601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-10-17T22:34:09.564694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-17T22:34:09.564783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-10-17T22:34:09.564849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-17T22:34:09.564917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-17T22:34:09.564989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-10-17T22:34:09.565054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-17T22:34:09.565117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-10-17T22:34:09.565184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-10-17T22:34:09.565247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-17T22:34:09.565314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-17T22:34:09.565395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-17T22:34:09.565461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-17T22:34:09.565524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-17T22:34:09.565589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-17T22:34:09.565691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-10-17T22:34:09.565783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-17T22:34:09.565849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-10-17T22:34:09.565913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-17T22:34:09.565974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-17T22:34:09.566035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-17T22:34:09.566098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-17T22:34:09.566161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-17T22:34:09.566223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-17T22:34:09.566292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-10-17T22:34:09.566357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-10-17T22:34:09.566419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-10-17T22:34:09.566483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-17T22:34:09.566544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-17T22:34:09.566606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-17T22:34:09.566772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-17T22:34:09.566862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-17T22:34:09.566928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-10-17T22:34:09.566989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-10-17T22:34:09.567052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-17T22:34:09.567114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-17T22:34:09.567175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-17T22:34:09.567251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-10-17T22:34:09.567314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-17T22:34:09.567375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-17T22:34:09.567435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-17T22:34:09.567495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-17T22:34:09.567556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-17T22:34:09.567617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-17T22:34:09.567745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-17T22:34:09.567830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-10-17T22:34:09.567894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-17T22:34:09.567958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-17T22:34:09.568019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-10-17T22:34:09.568079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-10-17T22:34:09.568141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-10-17T22:34:09.568202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-17T22:34:09.568273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-17T22:34:09.568335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-10-17T22:34:09.568450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-10-17T22:34:09.568539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-10-17T22:34:09.568629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-17T22:34:09.568755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-10-17T22:34:09.568832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-10-17T22:34:09.568897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-17T22:34:09.568961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-17T22:34:09.569024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-17T22:34:09.569139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-17T22:34:09.569210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-17T22:34:09.569274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-10-17T22:34:09.569336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-17T22:34:09.569397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-10-17T22:34:09.569478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-10-17T22:34:09.569541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-17T22:34:09.569604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-17T22:34:09.569706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-17T22:34:09.569797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-17T22:34:09.569863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-17T22:34:09.569928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-17T22:34:09.569993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-10-17T22:34:09.570057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-10-17T22:34:09.570118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-17T22:34:09.570187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-17T22:34:09.570252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-10-17T22:34:09.570318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-10-17T22:34:09.570382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-17T22:34:09.570443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-17T22:34:09.570528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-17T22:34:09.570589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-17T22:34:09.570793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-10-17T22:34:09.570884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-17T22:34:09.570949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-17T22:34:09.571010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-17T22:34:09.571075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-10-17T22:34:09.571136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-10-17T22:34:09.571201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-10-17T22:34:09.571267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-17T22:34:09.571330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-17T22:34:09.571395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-17T22:34:09.571458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-17T22:34:09.571520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-17T22:34:09.571582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-17T22:34:09.571671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-17T22:34:09.571767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-17T22:34:09.571833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-10-17T22:34:09.571900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-17T22:34:09.571973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-17T22:34:09.572040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-17T22:34:09.572103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-17T22:34:09.572185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-10-17T22:34:09.572275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-10-17T22:34:09.572343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-17T22:34:09.572412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-17T22:34:09.572480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-17T22:34:09.572560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-17T22:34:09.572675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-10-17T22:34:09.572767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-10-17T22:34:09.572833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-10-17T22:34:09.572898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-17T22:34:09.572963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-17T22:34:09.573025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-17T22:34:09.573088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-17T22:34:09.573149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-17T22:34:09.573214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-17T22:34:09.573288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-17T22:34:09.573381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-10-17T22:34:09.573448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-10-17T22:34:09.573511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-10-17T22:34:09.573577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-17T22:34:09.573639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-17T22:34:09.573784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-17T22:34:09.573860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-10-17T22:34:09.573931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-17T22:34:09.573999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-10-17T22:34:09.574065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-17T22:34:09.574128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-17T22:34:09.574193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-17T22:34:09.574259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-17T22:34:09.574325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-17T22:34:09.574388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-17T22:34:09.574450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-17T22:34:09.574516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-17T22:34:09.574579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-10-17T22:34:09.574670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-17T22:34:09.574771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-17T22:34:09.574855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-10-17T22:34:09.574920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-17T22:34:09.574985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-17T22:34:09.575050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-10-17T22:34:09.575115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-17T22:34:09.575179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-10-17T22:34:09.575242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-17T22:34:09.575316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-10-17T22:34:09.575382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-17T22:34:09.575445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-10-17T22:34:09.575517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-17T22:34:09.575579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-10-17T22:34:09.575667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-17T22:34:09.575762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-17T22:34:09.575830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-17T22:34:09.575893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-10-17T22:34:09.575985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-17T22:34:09.576073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-17T22:34:09.576139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-10-17T22:34:09.576204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-10-17T22:34:09.576266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-17T22:34:09.576333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-10-17T22:34:09.576395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-17T22:34:09.576473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-10-17T22:34:09.576534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-17T22:34:09.576596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-17T22:34:09.576696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-17T22:34:09.576784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-10-17T22:34:09.576850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-17T22:34:09.576926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-17T22:34:09.576990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-17T22:34:09.577053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-17T22:34:09.577114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-10-17T22:34:09.577175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-17T22:34:09.577236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-10-17T22:34:09.577311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-17T22:34:09.577373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-17T22:34:09.577470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-17T22:34:09.577551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-10-17T22:34:09.577616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-10-17T22:34:09.581761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-17T22:34:09.581945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-17T22:34:09.582036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-10-17T22:34:09.582104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-17T22:34:09.582181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-17T22:34:09.582245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-10-17T22:34:09.582309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-17T22:34:09.582371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-17T22:34:09.582433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-10-17T22:34:09.582496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-10-17T22:34:09.582558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-10-17T22:34:09.582631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-10-17T22:34:09.582833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-17T22:34:09.582910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-10-17T22:34:09.582974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-10-17T22:34:09.583038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-17T22:34:09.583151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-17T22:34:09.583239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-17T22:34:09.583345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-17T22:34:09.583421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-10-17T22:34:09.583486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-10-17T22:34:09.583564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-17T22:34:09.583628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-10-17T22:34:09.583733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-10-17T22:34:09.583809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-10-17T22:34:09.583874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-17T22:34:09.583938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-17T22:34:09.584001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-17T22:34:09.584101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-10-17T22:34:09.584172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-17T22:34:09.584241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-10-17T22:34:09.584305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-17T22:34:09.584370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-17T22:34:09.584439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-17T22:34:09.584505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-10-17T22:34:09.584613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-10-17T22:34:09.584735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-10-17T22:34:09.584811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-17T22:34:09.584877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-17T22:34:09.584945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-17T22:34:09.585016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-17T22:34:09.585083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-17T22:34:09.585150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-10-17T22:34:09.585213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-17T22:34:09.585276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-17T22:34:09.585339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-10-17T22:34:09.585405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-10-17T22:34:09.585469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-17T22:34:09.585557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-10-17T22:34:09.585683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-17T22:34:09.585776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-17T22:34:09.585847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-17T22:34:09.585912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-10-17T22:34:09.585976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-17T22:34:09.586042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-10-17T22:34:09.586104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-10-17T22:34:09.586170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-17T22:34:09.586236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-17T22:34:09.586302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-17T22:34:09.586365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-10-17T22:34:09.586429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-17T22:34:09.586492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-17T22:34:09.586600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-17T22:34:09.586700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-17T22:34:09.586790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-17T22:34:09.586857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-17T22:34:09.586922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-10-17T22:34:09.586993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-17T22:34:09.587057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-10-17T22:34:09.587121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-17T22:34:09.587185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-17T22:34:09.587248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-10-17T22:34:09.587313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-17T22:34:09.587376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-17T22:34:09.587449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-17T22:34:09.587514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-17T22:34:09.587626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-10-17T22:34:09.587763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-17T22:34:09.587856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-17T22:34:09.587924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-10-17T22:34:09.587991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-10-17T22:34:09.588057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-10-17T22:34:09.588123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-10-17T22:34:09.588190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-17T22:34:09.588255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-10-17T22:34:09.588320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-17T22:34:09.588383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-17T22:34:09.588496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-17T22:34:09.588609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-10-17T22:34:09.588731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-10-17T22:34:09.588812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-17T22:34:09.588879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-17T22:34:09.588945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-10-17T22:34:09.589013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-17T22:34:09.589079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-10-17T22:34:09.589168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-10-17T22:34:09.589288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-10-17T22:34:09.589389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-10-17T22:34:09.589485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-17T22:34:09.589557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-10-17T22:34:09.589635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-17T22:34:09.589767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-17T22:34:09.589951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-10-17T22:34:09.590052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TCBX.csv [2025-10-17T22:34:09.590144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-10-17T22:34:09.590253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-10-17T22:34:09.590336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-10-17T22:34:09.590407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-10-17T22:34:09.590477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-17T22:34:09.590545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-17T22:34:09.590610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-10-17T22:34:09.590913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-17T22:34:09.591010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-17T22:34:09.591079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-17T22:34:09.591145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-17T22:34:09.591208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-10-17T22:34:09.591272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-17T22:34:09.591337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-10-17T22:34:09.591402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-17T22:34:09.591467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-17T22:34:09.591531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-17T22:34:09.591595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-17T22:34:09.591696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-17T22:34:09.591786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-17T22:34:09.591852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-17T22:34:09.591917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-17T22:34:09.591981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-17T22:34:09.592043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-17T22:34:09.592107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-10-17T22:34:09.592169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-10-17T22:34:09.592233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-17T22:34:09.592298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-17T22:34:09.592382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-17T22:34:09.592489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-10-17T22:34:09.592576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-10-17T22:34:09.592666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-17T22:34:09.592760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-10-17T22:34:09.592827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-10-17T22:34:09.592894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-17T22:34:09.592957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-17T22:34:09.593021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-17T22:34:09.593089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-10-17T22:34:09.593154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-10-17T22:34:09.593218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-17T22:34:09.593282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-17T22:34:09.593349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-10-17T22:34:09.593414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-17T22:34:09.593478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-17T22:34:09.593541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-17T22:34:09.593605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-17T22:34:09.593735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-10-17T22:34:09.593817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-10-17T22:34:09.593881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-17T22:34:09.593963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-17T22:34:09.594043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-17T22:34:09.594109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-17T22:34:09.594175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-10-17T22:34:09.594241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-10-17T22:34:09.594380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-10-17T22:34:09.594461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-17T22:34:09.594529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-10-17T22:34:09.594599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-10-17T22:34:09.594699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-17T22:34:09.594794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-17T22:34:09.594877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-10-17T22:34:09.594997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-10-17T22:34:09.595067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-17T22:34:09.595137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-17T22:34:09.595205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-10-17T22:34:09.595277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-17T22:34:09.595346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-10-17T22:34:09.595413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-17T22:34:09.595480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-17T22:34:09.595547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-17T22:34:09.595612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-10-17T22:34:09.595718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-17T22:34:09.595802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-17T22:34:09.595870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-17T22:34:09.595936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-10-17T22:34:09.596004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-10-17T22:34:09.596069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-10-17T22:34:09.596137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-10-17T22:34:09.596203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-10-17T22:34:09.596268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-10-17T22:34:09.596333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-17T22:34:09.596419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-17T22:34:09.596511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-10-17T22:34:09.596697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-10-17T22:34:09.596799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-17T22:34:09.596881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-17T22:34:09.596976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-17T22:34:09.597047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-10-17T22:34:09.597115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-17T22:34:09.597181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-17T22:34:09.597246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-17T22:34:09.597311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-10-17T22:34:09.597379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-17T22:34:09.597445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-10-17T22:34:09.597510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-17T22:34:09.597573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-17T22:34:09.597721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-10-17T22:34:09.597814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-10-17T22:34:09.597882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-17T22:34:09.597948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-17T22:34:09.598014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-17T22:34:09.598080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-17T22:34:09.598143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-10-17T22:34:09.598207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-17T22:34:09.598272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-10-17T22:34:09.598338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-17T22:34:09.598403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-17T22:34:09.598480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-17T22:34:09.598545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-17T22:34:09.598609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-17T22:34:09.598738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-10-17T22:34:09.598824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-17T22:34:09.598894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-17T22:34:09.598959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-17T22:34:09.599025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-10-17T22:34:09.599089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-10-17T22:34:09.599153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-10-17T22:34:09.599216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-17T22:34:09.599281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-10-17T22:34:09.599346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-10-17T22:34:09.599412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-10-17T22:34:09.599490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-17T22:34:09.599562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-17T22:34:09.599627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-17T22:34:09.599743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-10-17T22:34:09.599868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-10-17T22:34:09.599943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-17T22:34:09.600009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-17T22:34:09.600075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-17T22:34:09.600156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-10-17T22:34:09.600223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-17T22:34:09.600286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-17T22:34:09.600353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-17T22:34:09.600418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-10-17T22:34:09.600482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-10-17T22:34:09.600547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-10-17T22:34:09.600610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-17T22:34:09.600711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-10-17T22:34:09.600799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-17T22:34:09.600867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-17T22:34:09.600933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-17T22:34:09.600997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-10-17T22:34:09.601073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-17T22:34:09.601137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-10-17T22:34:09.601204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-10-17T22:34:09.601267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-17T22:34:09.601335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-10-17T22:34:09.601398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-10-17T22:34:09.601464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-17T22:34:09.601554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-10-17T22:34:09.601639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-17T22:34:09.601765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-10-17T22:34:09.601838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-17T22:34:09.601906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-17T22:34:09.601975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-10-17T22:34:09.602040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-17T22:34:09.602104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-10-17T22:34:09.602190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-10-17T22:34:09.602255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-10-17T22:34:09.602322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-17T22:34:09.602386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-17T22:34:09.602457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-10-17T22:34:09.602524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-17T22:34:09.602590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-10-17T22:34:09.602847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-17T22:34:09.602940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-17T22:34:09.603009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-17T22:34:09.603072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-17T22:34:09.603136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-17T22:34:09.603208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-17T22:34:09.603273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-17T22:34:09.603338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-17T22:34:09.603406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-17T22:34:09.603472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-10-17T22:34:09.603554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-10-17T22:34:09.603669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-10-17T22:34:09.603763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-17T22:34:09.603831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-17T22:34:09.603895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-10-17T22:34:09.603961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-17T22:34:09.604027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-17T22:34:09.604093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-17T22:34:09.604158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-17T22:34:09.604220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-10-17T22:34:09.604284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-17T22:34:09.604348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-17T22:34:09.604413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-17T22:34:09.604477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-10-17T22:34:09.604538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-17T22:34:09.604603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-17T22:34:09.604693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-10-17T22:34:09.604783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-10-17T22:34:09.604851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-10-17T22:34:09.604917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-10-17T22:34:09.604983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-17T22:34:09.605070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-10-17T22:34:09.605189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-10-17T22:34:09.605263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-17T22:34:09.605332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-17T22:34:09.605406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-10-17T22:34:09.605478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-10-17T22:34:09.605564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-10-17T22:34:09.605689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-17T22:34:09.605785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-17T22:34:09.605855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-17T22:34:09.605921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-17T22:34:09.605985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-10-17T22:34:09.606050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-10-17T22:34:09.606115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-17T22:34:09.606181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-10-17T22:34:09.606246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-17T22:34:09.606310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-17T22:34:09.606375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-17T22:34:09.606438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-17T22:34:09.606503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-17T22:34:09.606567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-10-17T22:34:09.606634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-17T22:34:09.606748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-10-17T22:34:09.606823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-17T22:34:09.606888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-17T22:34:09.606953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-17T22:34:09.607018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-17T22:34:09.607082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-17T22:34:09.607149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-10-17T22:34:09.607214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-17T22:34:09.607280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-17T22:34:09.607344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-17T22:34:09.607408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-17T22:34:09.607490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-17T22:34:09.607577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-17T22:34:09.607706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-10-17T22:34:09.607802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-17T22:34:09.607869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-10-17T22:34:09.607933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-17T22:34:09.607997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-17T22:34:09.608059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-17T22:34:09.608121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-17T22:34:09.608192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-17T22:34:09.608256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-17T22:34:09.608333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-17T22:34:09.608396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-10-17T22:34:09.608470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-10-17T22:34:09.608536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-10-17T22:34:09.608602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-10-17T22:34:09.608829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-17T22:34:09.608926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-17T22:34:09.608994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-17T22:34:09.609058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-17T22:34:09.609124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-17T22:34:09.609189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-17T22:34:09.609256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-10-17T22:34:09.609318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-17T22:34:09.609381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-10-17T22:34:09.609443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-17T22:34:09.609505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-17T22:34:09.609578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-10-17T22:34:09.609672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-10-17T22:34:09.609778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-10-17T22:34:09.609848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-10-17T22:34:09.609919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-17T22:34:09.609989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-17T22:34:09.610054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-17T22:34:09.610122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-10-17T22:34:09.610190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-10-17T22:34:09.610256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-17T22:34:09.610323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-17T22:34:09.610388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-17T22:34:09.610512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-10-17T22:34:09.610588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-10-17T22:34:09.610820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-17T22:34:09.610916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-17T22:34:09.610989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-17T22:34:09.611092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-10-17T22:34:09.611188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-10-17T22:34:09.611259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-10-17T22:34:09.611335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-17T22:34:09.611405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-17T22:34:09.611481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-17T22:34:09.611546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-17T22:34:09.611610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-17T22:34:09.611714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-17T22:34:09.611803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-10-17T22:34:09.611873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-10-17T22:34:09.611939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-17T22:34:09.612008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-17T22:34:09.612082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-10-17T22:34:09.612149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-17T22:34:09.612216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-10-17T22:34:09.612283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-10-17T22:34:09.612350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-10-17T22:34:09.612421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-17T22:34:09.612490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-10-17T22:34:09.612557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-10-17T22:34:09.612668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-17T22:34:09.612767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-17T22:34:09.612857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-17T22:34:09.612949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-17T22:34:09.613073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-17T22:34:09.613140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-17T22:34:09.613205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-10-17T22:34:09.613272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-17T22:34:09.613335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-10-17T22:34:09.613400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-17T22:34:09.613464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-17T22:34:09.613534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-10-17T22:34:09.613604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-10-17T22:34:09.613706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-10-17T22:34:09.613795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-10-17T22:34:09.613862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-17T22:34:09.613929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-10-17T22:34:09.613993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-10-17T22:34:09.614060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-17T22:34:09.614123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-17T22:34:09.614195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-10-17T22:34:09.614275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-17T22:34:09.614341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-17T22:34:09.614406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-17T22:34:09.614470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-10-17T22:34:09.614537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-17T22:34:09.614608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-17T22:34:09.614798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-17T22:34:09.614891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-17T22:34:09.614959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-17T22:34:09.615024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-10-17T22:34:09.615094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-10-17T22:34:09.615179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-17T22:34:09.615266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-10-17T22:34:09.615331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-17T22:34:09.615412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-17T22:34:09.615479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-17T22:34:09.615545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-10-17T22:34:09.615611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-10-17T22:34:09.615711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-17T22:34:09.615793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-17T22:34:09.615873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-10-17T22:34:09.615979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-10-17T22:34:09.616044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-17T22:34:09.616108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-10-17T22:34:09.616223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-10-17T22:34:09.616309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-10-17T22:34:09.616377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-17T22:34:09.616442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-17T22:34:09.616506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-17T22:34:09.616570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-17T22:34:09.616635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-10-17T22:34:09.616749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-10-17T22:34:09.616823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-17T22:34:09.616890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-17T22:34:09.616959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-17T22:34:09.617026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-17T22:34:09.617092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-17T22:34:09.617157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-17T22:34:09.617229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-17T22:34:09.617294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-17T22:34:09.617360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-17T22:34:09.617423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-17T22:34:09.617487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-10-17T22:34:09.617550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-10-17T22:34:09.617613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-17T22:34:09.617735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-10-17T22:34:09.617825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-17T22:34:09.617896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-17T22:34:09.617964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-17T22:34:09.618031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-17T22:34:09.618131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-10-17T22:34:09.618199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-10-17T22:34:09.618264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-17T22:34:09.618331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-17T22:34:09.618397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-10-17T22:34:09.618462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-17T22:34:09.618526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-10-17T22:34:09.618595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-17T22:34:09.618807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-17T22:34:09.618902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-10-17T22:34:09.618973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-10-17T22:34:09.619038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-17T22:34:09.619105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-17T22:34:09.619170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-10-17T22:34:09.619236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-10-17T22:34:09.619302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-10-17T22:34:09.619366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-17T22:34:09.619442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-10-17T22:34:09.619508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-17T22:34:09.619572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-17T22:34:09.619636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-17T22:34:09.619758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-17T22:34:09.619828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-17T22:34:09.619893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-17T22:34:09.619957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-17T22:34:09.620023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-10-17T22:34:09.620123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-17T22:34:09.620205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-10-17T22:34:09.620274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-17T22:34:09.620340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-10-17T22:34:09.620404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-10-17T22:34:09.620466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-17T22:34:09.620531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-10-17T22:34:09.620596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-17T22:34:09.620687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-17T22:34:09.620776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-17T22:34:09.620845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-10-17T22:34:09.620912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-17T22:34:09.620978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-17T22:34:09.621042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-10-17T22:34:09.621106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-17T22:34:09.621169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-17T22:34:09.621234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-10-17T22:34:09.621298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-17T22:34:09.621361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-10-17T22:34:09.621484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-10-17T22:34:09.621560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-17T22:34:09.621625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-17T22:34:09.621750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-10-17T22:34:09.621826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-17T22:34:09.621892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-17T22:34:09.621956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-17T22:34:09.622036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-17T22:34:09.622105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-17T22:34:09.622169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-17T22:34:09.622234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-17T22:34:09.622313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-17T22:34:09.622379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-10-17T22:34:09.622444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-10-17T22:34:09.622506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-17T22:34:09.622584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-17T22:34:09.622705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-17T22:34:09.622794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-17T22:34:09.622867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-17T22:34:09.622940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-10-17T22:34:09.623018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-10-17T22:34:09.623085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-17T22:34:09.623151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-17T22:34:09.623214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-10-17T22:34:09.623280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-10-17T22:34:09.623357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-17T22:34:09.623422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-17T22:34:09.623484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-17T22:34:09.623549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-17T22:34:09.623613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-10-17T22:34:09.623720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-10-17T22:34:09.623801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-17T22:34:09.623868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-10-17T22:34:09.623931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-17T22:34:09.623994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-17T22:34:09.624058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-17T22:34:09.624122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-17T22:34:09.624185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-17T22:34:09.624249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-17T22:34:09.624312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-17T22:34:09.624381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-10-17T22:34:09.624445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-17T22:34:09.624508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-17T22:34:09.624571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-17T22:34:09.624665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-10-17T22:34:09.624758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-17T22:34:09.624845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-17T22:34:09.624934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-17T22:34:09.624999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-17T22:34:09.625063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-10-17T22:34:09.625179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-17T22:34:09.625275] [INFO ] [LOCAL ] Deleted 1703 derivative data files. [2025-10-17T22:34:09.625313] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-17T22:34:09.627542] [INFO ] [LOCAL ] Found 2083 symbols with primary data. [2025-10-17T22:34:09.627820] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2083 symbols [2025-10-17T22:34:09.630268] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:09.631470] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:09.629966] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:09.712559] [DEBUG] [LOCAL ] AA: Loaded 54401 existing records from primary storage. [2025-10-17T22:34:09.726792] [INFO ] [MAIN ] AA: Loaded 54401 primary data records. [2025-10-17T22:34:09.749068] [DEBUG] [LOCAL ] A: Loaded 51523 existing records from primary storage. [2025-10-17T22:34:09.774117] [INFO ] [MAIN ] A: Loaded 51523 primary data records. [2025-10-17T22:34:09.884605] [DEBUG] [LOCAL ] AAP: Loaded 52578 existing records from primary storage. [2025-10-17T22:34:09.914946] [INFO ] [MAIN ] AAP: Loaded 52578 primary data records. [2025-10-17T22:34:10.779101] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:10.780818] [INFO ] [MAIN ] AA: Generated 1820 derivative records from 54401 primary records. [2025-10-17T22:34:10.779930] [DEBUG] [MAIN ] A: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:10.781747] [INFO ] [MAIN ] A: Generated 1820 derivative records from 51523 primary records. [2025-10-17T22:34:10.781923] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-17T22:34:10.782044] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-17T22:34:10.822742] [DEBUG] [LOCAL ] A: Derivative data saved (1820 records). [2025-10-17T22:34:10.828314] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-17T22:34:10.829392] [DEBUG] [MAIN ] AAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:10.832507] [INFO ] [MAIN ] Derivative Progress: 1/2083 symbols completed. A took 1.2s. Estimated remaining: 41m 49s. Rate: 49.8 symbols/min [2025-10-17T22:34:10.832987] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:10.830348] [INFO ] [MAIN ] AAP: Generated 1820 derivative records from 52578 primary records. [2025-10-17T22:34:10.834399] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-17T22:34:10.834921] [DEBUG] [LOCAL ] AA: Derivative data saved (1820 records). [2025-10-17T22:34:10.844867] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-17T22:34:10.850260] [INFO ] [MAIN ] Derivative Progress: 2/2083 symbols completed. AA took 1.2s. Estimated remaining: 21m 12s. Rate: 98.1 symbols/min [2025-10-17T22:34:10.852931] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:10.855920] [DEBUG] [LOCAL ] AAP: Derivative data saved (1820 records). [2025-10-17T22:34:10.856012] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-17T22:34:10.859349] [INFO ] [MAIN ] Derivative Progress: 3/2083 symbols completed. AAP took 1.2s. Estimated remaining: 14m 14s. Rate: 146.1 symbols/min [2025-10-17T22:34:10.859863] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:10.906335] [DEBUG] [LOCAL ] AAT: Loaded 30862 existing records from primary storage. [2025-10-17T22:34:10.906924] [INFO ] [MAIN ] AAT: Loaded 30862 primary data records. [2025-10-17T22:34:10.906848] [DEBUG] [LOCAL ] ABCB: Loaded 31020 existing records from primary storage. [2025-10-17T22:34:10.975739] [INFO ] [MAIN ] ABCB: Loaded 31020 primary data records. [2025-10-17T22:34:11.131238] [DEBUG] [LOCAL ] ABBV: Loaded 54465 existing records from primary storage. [2025-10-17T22:34:11.152768] [INFO ] [MAIN ] ABBV: Loaded 54465 primary data records. [2025-10-17T22:34:11.940431] [DEBUG] [MAIN ] AAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:11.942005] [INFO ] [MAIN ] AAT: Generated 1820 derivative records from 30862 primary records. [2025-10-17T22:34:11.942254] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-17T22:34:11.971014] [DEBUG] [LOCAL ] AAT: Derivative data saved (1820 records). [2025-10-17T22:34:11.971423] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-10-17T22:34:11.971340] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:11.972404] [INFO ] [MAIN ] ABCB: Generated 1820 derivative records from 31020 primary records. [2025-10-17T22:34:11.974227] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-17T22:34:11.974149] [INFO ] [MAIN ] Derivative Progress: 4/2083 symbols completed. AAT took 1.1s. Estimated remaining: 20m 20s. Rate: 102.3 symbols/min [2025-10-17T22:34:11.975360] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:11.994075] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1820 records). [2025-10-17T22:34:11.994379] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-10-17T22:34:11.996445] [INFO ] [MAIN ] Derivative Progress: 5/2083 symbols completed. ABCB took 1.1s. Estimated remaining: 16m 24s. Rate: 126.6 symbols/min [2025-10-17T22:34:12.004169] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:12.009840] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:12.010595] [INFO ] [MAIN ] ABBV: Generated 1820 derivative records from 54465 primary records. [2025-10-17T22:34:12.010825] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-10-17T22:34:12.032420] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1820 records). [2025-10-17T22:34:12.032593] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-10-17T22:34:12.036180] [INFO ] [MAIN ] Derivative Progress: 6/2083 symbols completed. ABBV took 1.2s. Estimated remaining: 13m 54s. Rate: 149.5 symbols/min [2025-10-17T22:34:12.042963] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:12.042779] [DEBUG] [LOCAL ] ABG: Loaded 18603 existing records from primary storage. [2025-10-17T22:34:12.043449] [INFO ] [MAIN ] ABG: Loaded 18603 primary data records. [2025-10-17T22:34:12.249182] [DEBUG] [LOCAL ] ABEV: Loaded 54055 existing records from primary storage. [2025-10-17T22:34:12.270623] [INFO ] [MAIN ] ABEV: Loaded 54055 primary data records. [2025-10-17T22:34:12.467915] [DEBUG] [LOCAL ] ABM: Loaded 32640 existing records from primary storage. [2025-10-17T22:34:12.494564] [INFO ] [MAIN ] ABM: Loaded 32640 primary data records. [2025-10-17T22:34:13.067266] [DEBUG] [MAIN ] ABG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:13.068866] [INFO ] [MAIN ] ABG: Generated 1820 derivative records from 18603 primary records. [2025-10-17T22:34:13.069048] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-10-17T22:34:13.092300] [DEBUG] [LOCAL ] ABG: Derivative data saved (1820 records). [2025-10-17T22:34:13.105022] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-10-17T22:34:13.105280] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:13.107452] [INFO ] [MAIN ] Derivative Progress: 7/2083 symbols completed. ABG took 1.1s. Estimated remaining: 17m 12s. Rate: 120.7 symbols/min [2025-10-17T22:34:13.108685] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:13.108554] [INFO ] [MAIN ] ABEV: Generated 1820 derivative records from 54055 primary records. [2025-10-17T22:34:13.108993] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-17T22:34:13.139926] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:13.141370] [INFO ] [MAIN ] ABM: Generated 1820 derivative records from 32640 primary records. [2025-10-17T22:34:13.142449] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-10-17T22:34:13.143054] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1820 records). [2025-10-17T22:34:13.144197] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-17T22:34:13.146297] [INFO ] [MAIN ] Derivative Progress: 8/2083 symbols completed. ABEV took 1.2s. Estimated remaining: 15m 13s. Rate: 136.4 symbols/min [2025-10-17T22:34:13.154875] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:13.163203] [DEBUG] [LOCAL ] ABM: Derivative data saved (1820 records). [2025-10-17T22:34:13.163457] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-10-17T22:34:13.165867] [INFO ] [MAIN ] Derivative Progress: 9/2083 symbols completed. ABM took 1.1s. Estimated remaining: 13m 35s. Rate: 152.6 symbols/min [2025-10-17T22:34:13.166142] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:13.196808] [DEBUG] [LOCAL ] ACA: Loaded 23255 existing records from primary storage. [2025-10-17T22:34:13.196949] [INFO ] [MAIN ] ACA: Loaded 23255 primary data records. [2025-10-17T22:34:13.317191] [DEBUG] [LOCAL ] ABR: Loaded 52735 existing records from primary storage. [2025-10-17T22:34:13.320570] [INFO ] [MAIN ] ABR: Loaded 52735 primary data records. [2025-10-17T22:34:13.636504] [DEBUG] [LOCAL ] ACCO: Loaded 37509 existing records from primary storage. [2025-10-17T22:34:13.636733] [INFO ] [MAIN ] ACCO: Loaded 37509 primary data records. [2025-10-17T22:34:14.215629] [DEBUG] [MAIN ] ACA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:14.218329] [INFO ] [MAIN ] ACA: Generated 1820 derivative records from 23255 primary records. [2025-10-17T22:34:14.218676] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-10-17T22:34:14.253929] [DEBUG] [LOCAL ] ACA: Derivative data saved (1820 records). [2025-10-17T22:34:14.254766] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:14.255842] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-10-17T22:34:14.258317] [INFO ] [MAIN ] ABR: Generated 1820 derivative records from 52735 primary records. [2025-10-17T22:34:14.258135] [INFO ] [MAIN ] Derivative Progress: 10/2083 symbols completed. ACA took 1.1s. Estimated remaining: 15m 60s. Rate: 129.6 symbols/min [2025-10-17T22:34:14.258483] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-10-17T22:34:14.259457] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:14.297587] [DEBUG] [LOCAL ] ABR: Derivative data saved (1820 records). [2025-10-17T22:34:14.298073] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-10-17T22:34:14.300336] [INFO ] [MAIN ] Derivative Progress: 11/2083 symbols completed. ABR took 1.2s. Estimated remaining: 14m 40s. Rate: 141.2 symbols/min [2025-10-17T22:34:14.300815] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:14.300610] [DEBUG] [MAIN ] ACCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:14.302106] [INFO ] [MAIN ] ACCO: Generated 1820 derivative records from 37509 primary records. [2025-10-17T22:34:14.302181] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-10-17T22:34:14.334935] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1820 records). [2025-10-17T22:34:14.335211] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-10-17T22:34:14.338189] [INFO ] [MAIN ] Derivative Progress: 12/2083 symbols completed. ACCO took 1.2s. Estimated remaining: 13m 33s. Rate: 152.8 symbols/min [2025-10-17T22:34:14.338510] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:14.339400] [DEBUG] [LOCAL ] ACEL: Loaded 27028 existing records from primary storage. [2025-10-17T22:34:14.339713] [INFO ] [MAIN ] ACEL: Loaded 27028 primary data records. [2025-10-17T22:34:14.666341] [DEBUG] [LOCAL ] ACHR: Loaded 54598 existing records from primary storage. [2025-10-17T22:34:14.680745] [INFO ] [MAIN ] ACHR: Loaded 54598 primary data records. [2025-10-17T22:34:14.830415] [DEBUG] [LOCAL ] ACI: Loaded 54062 existing records from primary storage. [2025-10-17T22:34:14.850365] [INFO ] [MAIN ] ACI: Loaded 54062 primary data records. [2025-10-17T22:34:15.208460] [DEBUG] [MAIN ] ACEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:15.321908] [INFO ] [MAIN ] ACEL: Generated 1820 derivative records from 27028 primary records. [2025-10-17T22:34:15.331137] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-10-17T22:34:15.350923] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1820 records). [2025-10-17T22:34:15.351815] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-10-17T22:34:15.354106] [INFO ] [MAIN ] Derivative Progress: 13/2083 symbols completed. ACEL took 1.1s. Estimated remaining: 15m 12s. Rate: 136.2 symbols/min [2025-10-17T22:34:15.376235] [DEBUG] [MAIN ] ACHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:15.377260] [INFO ] [MAIN ] ACHR: Generated 1820 derivative records from 54598 primary records. [2025-10-17T22:34:15.377463] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-17T22:34:15.406935] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:15.409911] [INFO ] [MAIN ] ACI: Generated 1820 derivative records from 54062 primary records. [2025-10-17T22:34:15.411307] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-17T22:34:15.411210] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1820 records). [2025-10-17T22:34:15.411498] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-10-17T22:34:15.413701] [INFO ] [MAIN ] Derivative Progress: 14/2083 symbols completed. ACHR took 1.1s. Estimated remaining: 14m 15s. Rate: 145.2 symbols/min [2025-10-17T22:34:15.430408] [DEBUG] [LOCAL ] ACI: Derivative data saved (1820 records). [2025-10-17T22:34:15.430483] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-10-17T22:34:15.432454] [INFO ] [MAIN ] Derivative Progress: 15/2083 symbols completed. ACI took 1.1s. Estimated remaining: 13m 20s. Rate: 155.0 symbols/min [2025-10-17T22:34:15.433052] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:15.433176] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:15.433320] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:15.442670] [DEBUG] [LOCAL ] ACR: Loaded 5512 existing records from primary storage. [2025-10-17T22:34:15.442878] [INFO ] [MAIN ] ACR: Loaded 5512 primary data records. [2025-10-17T22:34:15.778941] [DEBUG] [LOCAL ] ACM: Loaded 43560 existing records from primary storage. [2025-10-17T22:34:15.779678] [INFO ] [MAIN ] ACM: Loaded 43560 primary data records. [2025-10-17T22:34:15.888513] [DEBUG] [LOCAL ] ACN: Loaded 54216 existing records from primary storage. [2025-10-17T22:34:15.896028] [INFO ] [MAIN ] ACN: Loaded 54216 primary data records. [2025-10-17T22:34:16.447861] [DEBUG] [MAIN ] ACR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:16.452220] [INFO ] [MAIN ] ACR: Generated 1820 derivative records from 5512 primary records. [2025-10-17T22:34:16.452708] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-17T22:34:16.472620] [DEBUG] [LOCAL ] ACR: Derivative data saved (1820 records). [2025-10-17T22:34:16.473773] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-10-17T22:34:16.476942] [INFO ] [MAIN ] Derivative Progress: 16/2083 symbols completed. ACR took 1.0s. Estimated remaining: 14m 45s. Rate: 140.2 symbols/min [2025-10-17T22:34:16.477836] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:16.492357] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:16.493091] [INFO ] [MAIN ] ACM: Generated 1820 derivative records from 43560 primary records. [2025-10-17T22:34:16.493306] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-10-17T22:34:16.510714] [DEBUG] [LOCAL ] ACM: Derivative data saved (1820 records). [2025-10-17T22:34:16.512282] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-10-17T22:34:16.514420] [INFO ] [MAIN ] Derivative Progress: 17/2083 symbols completed. ACM took 1.1s. Estimated remaining: 13m 57s. Rate: 148.1 symbols/min [2025-10-17T22:34:16.514600] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:16.528477] [DEBUG] [MAIN ] ACN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:16.529329] [INFO ] [MAIN ] ACN: Generated 1820 derivative records from 54216 primary records. [2025-10-17T22:34:16.531438] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-10-17T22:34:16.561898] [DEBUG] [LOCAL ] ACN: Derivative data saved (1820 records). [2025-10-17T22:34:16.558688] [DEBUG] [LOCAL ] ACV: Loaded 7718 existing records from primary storage. [2025-10-17T22:34:16.562112] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-10-17T22:34:16.564460] [INFO ] [MAIN ] Derivative Progress: 18/2083 symbols completed. ACN took 1.1s. Estimated remaining: 13m 16s. Rate: 155.7 symbols/min [2025-10-17T22:34:16.564685] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:16.564806] [INFO ] [MAIN ] ACV: Loaded 7718 primary data records. [2025-10-17T22:34:16.653138] [DEBUG] [LOCAL ] ACRE: Loaded 34100 existing records from primary storage. [2025-10-17T22:34:16.680221] [INFO ] [MAIN ] ACRE: Loaded 34100 primary data records. [2025-10-17T22:34:17.057173] [DEBUG] [LOCAL ] ADC: Loaded 47056 existing records from primary storage. [2025-10-17T22:34:17.104824] [INFO ] [MAIN ] ADC: Loaded 47056 primary data records. [2025-10-17T22:34:17.565710] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:17.566777] [INFO ] [MAIN ] ACV: Generated 1820 derivative records from 7718 primary records. [2025-10-17T22:34:17.579190] [DEBUG] [MAIN ] ACRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:17.580009] [INFO ] [MAIN ] ACRE: Generated 1820 derivative records from 34100 primary records. [2025-10-17T22:34:17.580099] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-17T22:34:17.579299] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-10-17T22:34:17.612444] [DEBUG] [LOCAL ] ACV: Derivative data saved (1820 records). [2025-10-17T22:34:17.612820] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1820 records). [2025-10-17T22:34:17.613033] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-10-17T22:34:17.613114] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-10-17T22:34:17.614997] [INFO ] [MAIN ] Derivative Progress: 19/2083 symbols completed. ACRE took 1.1s. Estimated remaining: 14m 28s. Rate: 142.7 symbols/min [2025-10-17T22:34:17.617185] [INFO ] [MAIN ] Derivative Progress: 20/2083 symbols completed. ACV took 1.1s. Estimated remaining: 13m 44s. Rate: 150.2 symbols/min [2025-10-17T22:34:17.617364] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:17.617091] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:17.635668] [DEBUG] [MAIN ] ADC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:17.636417] [INFO ] [MAIN ] ADC: Generated 1820 derivative records from 47056 primary records. [2025-10-17T22:34:17.636528] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-10-17T22:34:17.652743] [DEBUG] [LOCAL ] ADC: Derivative data saved (1820 records). [2025-10-17T22:34:17.652852] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-10-17T22:34:17.655150] [INFO ] [MAIN ] Derivative Progress: 21/2083 symbols completed. ADC took 1.1s. Estimated remaining: 13m 8s. Rate: 157.0 symbols/min [2025-10-17T22:34:17.655466] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:17.701698] [DEBUG] [LOCAL ] ADNT: Loaded 47379 existing records from primary storage. [2025-10-17T22:34:17.702029] [INFO ] [MAIN ] ADNT: Loaded 47379 primary data records. [2025-10-17T22:34:17.784344] [DEBUG] [LOCAL ] ADM: Loaded 54178 existing records from primary storage. [2025-10-17T22:34:17.813538] [INFO ] [MAIN ] ADM: Loaded 54178 primary data records. [2025-10-17T22:34:18.006876] [DEBUG] [LOCAL ] ADT: Loaded 54217 existing records from primary storage. [2025-10-17T22:34:18.020070] [INFO ] [MAIN ] ADT: Loaded 54217 primary data records. [2025-10-17T22:34:18.718904] [DEBUG] [MAIN ] ADNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:18.718488] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:18.719637] [INFO ] [MAIN ] ADM: Generated 1820 derivative records from 54178 primary records. [2025-10-17T22:34:18.720311] [INFO ] [MAIN ] ADNT: Generated 1820 derivative records from 47379 primary records. [2025-10-17T22:34:18.720536] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-10-17T22:34:18.720584] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-17T22:34:18.750619] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1820 records). [2025-10-17T22:34:18.751608] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-10-17T22:34:18.754362] [INFO ] [MAIN ] Derivative Progress: 22/2083 symbols completed. ADNT took 1.1s. Estimated remaining: 14m 15s. Rate: 144.6 symbols/min [2025-10-17T22:34:18.754871] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:18.770694] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:18.772274] [INFO ] [MAIN ] ADT: Generated 1820 derivative records from 54217 primary records. [2025-10-17T22:34:18.772858] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-17T22:34:18.786345] [DEBUG] [LOCAL ] ADM: Derivative data saved (1820 records). [2025-10-17T22:34:18.787767] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-17T22:34:18.791096] [INFO ] [MAIN ] Derivative Progress: 23/2083 symbols completed. ADM took 1.2s. Estimated remaining: 13m 41s. Rate: 150.6 symbols/min [2025-10-17T22:34:18.791495] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:18.793438] [DEBUG] [LOCAL ] ADT: Derivative data saved (1820 records). [2025-10-17T22:34:18.793514] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-17T22:34:18.796173] [INFO ] [MAIN ] Derivative Progress: 24/2083 symbols completed. ADT took 1.1s. Estimated remaining: 13m 7s. Rate: 157.1 symbols/min [2025-10-17T22:34:18.804050] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:18.822426] [DEBUG] [LOCAL ] AEFC: Loaded 8348 existing records from primary storage. [2025-10-17T22:34:18.823137] [DEBUG] [LOCAL ] ADX: Loaded 28160 existing records from primary storage. [2025-10-17T22:34:18.823223] [INFO ] [MAIN ] AEFC: Loaded 8348 primary data records. [2025-10-17T22:34:18.828741] [INFO ] [MAIN ] ADX: Loaded 28160 primary data records. [2025-10-17T22:34:19.482039] [DEBUG] [LOCAL ] AEG: Loaded 50300 existing records from primary storage. [2025-10-17T22:34:19.483194] [INFO ] [MAIN ] AEG: Loaded 50300 primary data records. [2025-10-17T22:34:19.889257] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:19.888850] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:19.892123] [INFO ] [MAIN ] ADX: Generated 1820 derivative records from 28160 primary records. [2025-10-17T22:34:19.891299] [INFO ] [MAIN ] AEFC: Generated 1820 derivative records from 8348 primary records. [2025-10-17T22:34:19.892383] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-17T22:34:19.892634] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-17T22:34:19.925902] [DEBUG] [LOCAL ] ADX: Derivative data saved (1820 records). [2025-10-17T22:34:19.927853] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1820 records). [2025-10-17T22:34:19.928215] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-17T22:34:19.930415] [INFO ] [MAIN ] Derivative Progress: 25/2083 symbols completed. ADX took 1.2s. Estimated remaining: 14m 8s. Rate: 145.6 symbols/min [2025-10-17T22:34:19.928133] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-10-17T22:34:19.930612] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:19.932818] [INFO ] [MAIN ] Derivative Progress: 26/2083 symbols completed. AEFC took 1.1s. Estimated remaining: 13m 35s. Rate: 151.4 symbols/min [2025-10-17T22:34:19.933831] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:19.951495] [DEBUG] [MAIN ] AEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:19.952266] [INFO ] [MAIN ] AEG: Generated 1820 derivative records from 50300 primary records. [2025-10-17T22:34:19.952437] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-10-17T22:34:19.968033] [DEBUG] [LOCAL ] AEG: Derivative data saved (1820 records). [2025-10-17T22:34:19.968204] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-10-17T22:34:19.971013] [INFO ] [MAIN ] Derivative Progress: 27/2083 symbols completed. AEG took 1.2s. Estimated remaining: 13m 8s. Rate: 156.6 symbols/min [2025-10-17T22:34:19.971359] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:20.036909] [DEBUG] [LOCAL ] AER: Loaded 48795 existing records from primary storage. [2025-10-17T22:34:20.038699] [INFO ] [MAIN ] AER: Loaded 48795 primary data records. [2025-10-17T22:34:20.039511] [DEBUG] [LOCAL ] AEO: Loaded 54346 existing records from primary storage. [2025-10-17T22:34:20.086943] [INFO ] [MAIN ] AEO: Loaded 54346 primary data records. [2025-10-17T22:34:20.338940] [DEBUG] [LOCAL ] AES: Loaded 54448 existing records from primary storage. [2025-10-17T22:34:20.381430] [INFO ] [MAIN ] AES: Loaded 54448 primary data records. [2025-10-17T22:34:21.079184] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:21.080202] [INFO ] [MAIN ] AER: Generated 1820 derivative records from 48795 primary records. [2025-10-17T22:34:21.080730] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-17T22:34:21.115980] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:21.116858] [INFO ] [MAIN ] AEO: Generated 1820 derivative records from 54346 primary records. [2025-10-17T22:34:21.117077] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-17T22:34:21.115809] [DEBUG] [LOCAL ] AER: Derivative data saved (1820 records). [2025-10-17T22:34:21.118157] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-17T22:34:21.127866] [INFO ] [MAIN ] Derivative Progress: 28/2083 symbols completed. AER took 1.2s. Estimated remaining: 14m 4s. Rate: 146.1 symbols/min [2025-10-17T22:34:21.139100] [DEBUG] [LOCAL ] AEO: Derivative data saved (1820 records). [2025-10-17T22:34:21.140094] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-17T22:34:21.142433] [INFO ] [MAIN ] Derivative Progress: 29/2083 symbols completed. AEO took 1.2s. Estimated remaining: 13m 36s. Rate: 151.1 symbols/min [2025-10-17T22:34:21.156786] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:21.157423] [INFO ] [MAIN ] AES: Generated 1820 derivative records from 54448 primary records. [2025-10-17T22:34:21.157503] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-17T22:34:21.174360] [DEBUG] [LOCAL ] AES: Derivative data saved (1820 records). [2025-10-17T22:34:21.174422] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-17T22:34:21.177947] [INFO ] [MAIN ] Derivative Progress: 30/2083 symbols completed. AES took 1.2s. Estimated remaining: 13m 10s. Rate: 155.8 symbols/min [2025-10-17T22:34:21.178359] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:21.178471] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:21.178572] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:21.185381] [DEBUG] [LOCAL ] AFGC: Loaded 2584 existing records from primary storage. [2025-10-17T22:34:21.185527] [INFO ] [MAIN ] AFGC: Loaded 2584 primary data records. [2025-10-17T22:34:21.281617] [DEBUG] [LOCAL ] AFB: Loaded 11315 existing records from primary storage. [2025-10-17T22:34:21.313721] [INFO ] [MAIN ] AFB: Loaded 11315 primary data records. [2025-10-17T22:34:21.707869] [DEBUG] [LOCAL ] AESI: Loaded 50515 existing records from primary storage. [2025-10-17T22:34:21.717421] [INFO ] [MAIN ] AESI: Loaded 50515 primary data records. [2025-10-17T22:34:22.249803] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:34:22.250709] [INFO ] [MAIN ] AFGC: Generated 1819 derivative records from 2584 primary records. [2025-10-17T22:34:22.251703] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-17T22:34:22.279971] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:22.282243] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1819 records). [2025-10-17T22:34:22.281293] [INFO ] [MAIN ] AFB: Generated 1820 derivative records from 11315 primary records. [2025-10-17T22:34:22.282541] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-17T22:34:22.284773] [INFO ] [MAIN ] Derivative Progress: 31/2083 symbols completed. AFGC took 1.1s. Estimated remaining: 13m 58s. Rate: 147.0 symbols/min [2025-10-17T22:34:22.282687] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-17T22:34:22.284926] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:22.304342] [DEBUG] [LOCAL ] AFB: Derivative data saved (1820 records). [2025-10-17T22:34:22.303442] [DEBUG] [LOCAL ] AFGD: Loaded 1791 existing records from primary storage. [2025-10-17T22:34:22.305246] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-17T22:34:22.308010] [INFO ] [MAIN ] Derivative Progress: 32/2083 symbols completed. AFB took 1.1s. Estimated remaining: 13m 33s. Rate: 151.4 symbols/min [2025-10-17T22:34:22.305370] [INFO ] [MAIN ] AFGD: Loaded 1791 primary data records. [2025-10-17T22:34:22.320294] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:22.398072] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:22.415214] [INFO ] [MAIN ] AESI: Generated 1820 derivative records from 50515 primary records. [2025-10-17T22:34:22.415354] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-17T22:34:22.429504] [DEBUG] [LOCAL ] AFGE: Loaded 2387 existing records from primary storage. [2025-10-17T22:34:22.429825] [INFO ] [MAIN ] AFGE: Loaded 2387 primary data records. [2025-10-17T22:34:22.627205] [DEBUG] [LOCAL ] AESI: Derivative data saved (1820 records). [2025-10-17T22:34:22.627344] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-17T22:34:22.742308] [INFO ] [MAIN ] Derivative Progress: 33/2083 symbols completed. AESI took 1.6s. Estimated remaining: 13m 35s. Rate: 151.0 symbols/min [2025-10-17T22:34:22.759394] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:22.976896] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-10-17T22:34:22.977947] [INFO ] [MAIN ] AFGD: Generated 1817 derivative records from 1791 primary records. [2025-10-17T22:34:22.989845] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-10-17T22:34:22.991134] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:23.005734] [INFO ] [MAIN ] AFGE: Generated 1820 derivative records from 2387 primary records. [2025-10-17T22:34:23.006205] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-17T22:34:23.031172] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1817 records). [2025-10-17T22:34:23.032771] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-10-17T22:34:23.035712] [INFO ] [MAIN ] Derivative Progress: 34/2083 symbols completed. AFGD took 0.8s. Estimated remaining: 13m 28s. Rate: 152.1 symbols/min [2025-10-17T22:34:23.037915] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1820 records). [2025-10-17T22:34:23.038282] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-17T22:34:23.038130] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:23.040955] [INFO ] [MAIN ] Derivative Progress: 35/2083 symbols completed. AFGE took 0.7s. Estimated remaining: 13m 5s. Rate: 156.6 symbols/min [2025-10-17T22:34:23.056354] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:23.058045] [DEBUG] [LOCAL ] AFL: Loaded 53965 existing records from primary storage. [2025-10-17T22:34:23.058303] [INFO ] [MAIN ] AFL: Loaded 53965 primary data records. [2025-10-17T22:34:23.407953] [DEBUG] [LOCAL ] AGCO: Loaded 42964 existing records from primary storage. [2025-10-17T22:34:23.408950] [INFO ] [MAIN ] AGCO: Loaded 42964 primary data records. [2025-10-17T22:34:23.486502] [DEBUG] [LOCAL ] AG: Loaded 54423 existing records from primary storage. [2025-10-17T22:34:23.509513] [INFO ] [MAIN ] AG: Loaded 54423 primary data records. [2025-10-17T22:34:23.930791] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:24.082235] [INFO ] [MAIN ] AFL: Generated 1820 derivative records from 53965 primary records. [2025-10-17T22:34:24.082405] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-17T22:34:24.116449] [DEBUG] [LOCAL ] AFL: Derivative data saved (1820 records). [2025-10-17T22:34:24.116928] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-17T22:34:24.119436] [INFO ] [MAIN ] Derivative Progress: 36/2083 symbols completed. AFL took 1.4s. Estimated remaining: 13m 44s. Rate: 149.0 symbols/min [2025-10-17T22:34:24.119795] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:24.140438] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:24.141201] [INFO ] [MAIN ] AGCO: Generated 1820 derivative records from 42964 primary records. [2025-10-17T22:34:24.141465] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-17T22:34:24.188600] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1820 records). [2025-10-17T22:34:24.188968] [DEBUG] [MAIN ] AG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:24.189990] [INFO ] [MAIN ] AG: Generated 1820 derivative records from 54423 primary records. [2025-10-17T22:34:24.189142] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-17T22:34:24.192000] [INFO ] [MAIN ] Derivative Progress: 37/2083 symbols completed. AGCO took 1.1s. Estimated remaining: 13m 25s. Rate: 152.4 symbols/min [2025-10-17T22:34:24.190094] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-17T22:34:24.193580] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:24.193422] [DEBUG] [LOCAL ] AGD: Loaded 19496 existing records from primary storage. [2025-10-17T22:34:24.194989] [INFO ] [MAIN ] AGD: Loaded 19496 primary data records. [2025-10-17T22:34:24.217460] [DEBUG] [LOCAL ] AG: Derivative data saved (1820 records). [2025-10-17T22:34:24.247546] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-17T22:34:24.275735] [INFO ] [MAIN ] Derivative Progress: 38/2083 symbols completed. AG took 1.2s. Estimated remaining: 13m 8s. Rate: 155.7 symbols/min [2025-10-17T22:34:24.276033] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:24.396038] [DEBUG] [LOCAL ] AGM: Loaded 10847 existing records from primary storage. [2025-10-17T22:34:24.398588] [INFO ] [MAIN ] AGM: Loaded 10847 primary data records. [2025-10-17T22:34:24.690868] [DEBUG] [LOCAL ] AGL: Loaded 53357 existing records from primary storage. [2025-10-17T22:34:24.696868] [INFO ] [MAIN ] AGL: Loaded 53357 primary data records. [2025-10-17T22:34:25.220519] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:25.222325] [INFO ] [MAIN ] AGD: Generated 1820 derivative records from 19496 primary records. [2025-10-17T22:34:25.222564] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-17T22:34:25.242535] [DEBUG] [LOCAL ] AGD: Derivative data saved (1820 records). [2025-10-17T22:34:25.243255] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-17T22:34:25.258161] [INFO ] [MAIN ] Derivative Progress: 39/2083 symbols completed. AGD took 1.1s. Estimated remaining: 13m 39s. Rate: 149.7 symbols/min [2025-10-17T22:34:25.258696] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:25.259612] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:25.261863] [INFO ] [MAIN ] AGM: Generated 1820 derivative records from 10847 primary records. [2025-10-17T22:34:25.262958] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-17T22:34:25.294605] [DEBUG] [LOCAL ] AGM: Derivative data saved (1820 records). [2025-10-17T22:34:25.294916] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-17T22:34:25.294465] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:25.296818] [INFO ] [MAIN ] Derivative Progress: 40/2083 symbols completed. AGM took 1.0s. Estimated remaining: 13m 20s. Rate: 153.2 symbols/min [2025-10-17T22:34:25.298008] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:25.297794] [INFO ] [MAIN ] AGL: Generated 1820 derivative records from 53357 primary records. [2025-10-17T22:34:25.298709] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-17T22:34:25.323058] [DEBUG] [LOCAL ] AGL: Derivative data saved (1820 records). [2025-10-17T22:34:25.323180] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-17T22:34:25.325315] [INFO ] [MAIN ] Derivative Progress: 41/2083 symbols completed. AGL took 1.1s. Estimated remaining: 13m 2s. Rate: 156.7 symbols/min [2025-10-17T22:34:25.325611] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:25.340255] [DEBUG] [LOCAL ] AGO: Loaded 28374 existing records from primary storage. [2025-10-17T22:34:25.340600] [INFO ] [MAIN ] AGO: Loaded 28374 primary data records. [2025-10-17T22:34:25.548518] [DEBUG] [LOCAL ] AGRO: Loaded 33606 existing records from primary storage. [2025-10-17T22:34:25.551725] [INFO ] [MAIN ] AGRO: Loaded 33606 primary data records. [2025-10-17T22:34:25.750292] [DEBUG] [LOCAL ] AGX: Loaded 33316 existing records from primary storage. [2025-10-17T22:34:25.768361] [INFO ] [MAIN ] AGX: Loaded 33316 primary data records. [2025-10-17T22:34:26.375842] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:26.377312] [INFO ] [MAIN ] AGO: Generated 1820 derivative records from 28374 primary records. [2025-10-17T22:34:26.379213] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-17T22:34:26.399189] [DEBUG] [LOCAL ] AGO: Derivative data saved (1820 records). [2025-10-17T22:34:26.399777] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-17T22:34:26.403107] [INFO ] [MAIN ] Derivative Progress: 42/2083 symbols completed. AGO took 1.1s. Estimated remaining: 13m 35s. Rate: 150.2 symbols/min [2025-10-17T22:34:26.404203] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:26.420087] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:26.421085] [INFO ] [MAIN ] AGRO: Generated 1820 derivative records from 33606 primary records. [2025-10-17T22:34:26.421322] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-17T22:34:26.439250] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1820 records). [2025-10-17T22:34:26.440978] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-17T22:34:26.443063] [INFO ] [MAIN ] Derivative Progress: 43/2083 symbols completed. AGRO took 1.1s. Estimated remaining: 13m 18s. Rate: 153.4 symbols/min [2025-10-17T22:34:26.456121] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:34:26.456818] [INFO ] [MAIN ] AGX: Generated 1819 derivative records from 33316 primary records. [2025-10-17T22:34:26.456956] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-17T22:34:26.482549] [DEBUG] [LOCAL ] AGX: Derivative data saved (1819 records). [2025-10-17T22:34:26.482615] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-17T22:34:26.484718] [INFO ] [MAIN ] Derivative Progress: 44/2083 symbols completed. AGX took 1.2s. Estimated remaining: 13m 1s. Rate: 156.6 symbols/min [2025-10-17T22:34:26.497348] [DEBUG] [LOCAL ] AHH: Loaded 41118 existing records from primary storage. [2025-10-17T22:34:26.497490] [INFO ] [MAIN ] AHH: Loaded 41118 primary data records. [2025-10-17T22:34:26.796345] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:26.796996] [INFO ] [MAIN ] AHH: Generated 1820 derivative records from 41118 primary records. [2025-10-17T22:34:26.797057] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-17T22:34:26.811635] [DEBUG] [LOCAL ] AHH: Derivative data saved (1820 records). [2025-10-17T22:34:26.811720] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-17T22:34:26.813827] [INFO ] [MAIN ] Derivative Progress: 45/2083 symbols completed. AHH took 0.4s. Estimated remaining: 12m 58s. Rate: 157.1 symbols/min [2025-10-17T22:34:26.814532] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:26.814463] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:26.814373] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:26.825353] [DEBUG] [LOCAL ] AHT: Loaded 6493 existing records from primary storage. [2025-10-17T22:34:26.825733] [INFO ] [MAIN ] AHT: Loaded 6493 primary data records. [2025-10-17T22:34:27.199521] [DEBUG] [LOCAL ] AIG: Loaded 54247 existing records from primary storage. [2025-10-17T22:34:27.214505] [INFO ] [MAIN ] AIG: Loaded 54247 primary data records. [2025-10-17T22:34:27.227044] [DEBUG] [LOCAL ] AI: Loaded 54545 existing records from primary storage. [2025-10-17T22:34:27.251874] [INFO ] [MAIN ] AI: Loaded 54545 primary data records. [2025-10-17T22:34:27.689300] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:27.708010] [INFO ] [MAIN ] AHT: Generated 1820 derivative records from 6493 primary records. [2025-10-17T22:34:27.732488] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-17T22:34:28.049805] [DEBUG] [LOCAL ] AHT: Derivative data saved (1820 records). [2025-10-17T22:34:28.050092] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-17T22:34:28.052472] [INFO ] [MAIN ] Derivative Progress: 46/2083 symbols completed. AHT took 1.2s. Estimated remaining: 13m 36s. Rate: 149.8 symbols/min [2025-10-17T22:34:28.053386] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:28.080204] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:28.081346] [INFO ] [MAIN ] AIG: Generated 1820 derivative records from 54247 primary records. [2025-10-17T22:34:28.081623] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-17T22:34:28.107528] [DEBUG] [LOCAL ] AIG: Derivative data saved (1820 records). [2025-10-17T22:34:28.115632] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-17T22:34:28.117715] [INFO ] [MAIN ] Derivative Progress: 47/2083 symbols completed. AIG took 1.3s. Estimated remaining: 13m 21s. Rate: 152.5 symbols/min [2025-10-17T22:34:28.118086] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:28.119113] [DEBUG] [LOCAL ] AIN: Loaded 24822 existing records from primary storage. [2025-10-17T22:34:28.120935] [INFO ] [MAIN ] AIN: Loaded 24822 primary data records. [2025-10-17T22:34:28.190769] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:28.223367] [INFO ] [MAIN ] AI: Generated 1820 derivative records from 54545 primary records. [2025-10-17T22:34:28.246030] [DEBUG] [LOCAL ] AIO: Loaded 13513 existing records from primary storage. [2025-10-17T22:34:28.251396] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-17T22:34:28.258072] [INFO ] [MAIN ] AIO: Loaded 13513 primary data records. [2025-10-17T22:34:28.383802] [DEBUG] [LOCAL ] AI: Derivative data saved (1820 records). [2025-10-17T22:34:28.431107] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-17T22:34:28.444443] [INFO ] [MAIN ] Derivative Progress: 48/2083 symbols completed. AI took 1.6s. Estimated remaining: 13m 18s. Rate: 153.1 symbols/min [2025-10-17T22:34:28.473854] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:28.891573] [DEBUG] [LOCAL ] AIR: Loaded 29335 existing records from primary storage. [2025-10-17T22:34:28.893060] [INFO ] [MAIN ] AIR: Loaded 29335 primary data records. [2025-10-17T22:34:29.206837] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:29.219163] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:29.221023] [INFO ] [MAIN ] AIO: Generated 1820 derivative records from 13513 primary records. [2025-10-17T22:34:29.219939] [INFO ] [MAIN ] AIN: Generated 1820 derivative records from 24822 primary records. [2025-10-17T22:34:29.221243] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-17T22:34:29.221313] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-17T22:34:29.248988] [DEBUG] [LOCAL ] AIN: Derivative data saved (1820 records). [2025-10-17T22:34:29.255297] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-17T22:34:29.257522] [INFO ] [MAIN ] Derivative Progress: 49/2083 symbols completed. AIN took 1.2s. Estimated remaining: 13m 35s. Rate: 149.8 symbols/min [2025-10-17T22:34:29.258560] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:29.259625] [DEBUG] [LOCAL ] AIO: Derivative data saved (1820 records). [2025-10-17T22:34:29.260015] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-10-17T22:34:29.262437] [INFO ] [MAIN ] Derivative Progress: 50/2083 symbols completed. AIO took 1.1s. Estimated remaining: 13m 18s. Rate: 152.8 symbols/min [2025-10-17T22:34:29.262828] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:29.281790] [DEBUG] [MAIN ] AIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:29.282593] [INFO ] [MAIN ] AIR: Generated 1820 derivative records from 29335 primary records. [2025-10-17T22:34:29.282818] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-10-17T22:34:29.306432] [DEBUG] [LOCAL ] AIR: Derivative data saved (1820 records). [2025-10-17T22:34:29.306558] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-10-17T22:34:29.308742] [INFO ] [MAIN ] Derivative Progress: 51/2083 symbols completed. AIR took 0.8s. Estimated remaining: 13m 4s. Rate: 155.5 symbols/min [2025-10-17T22:34:29.317290] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:29.330093] [DEBUG] [LOCAL ] AIT: Loaded 27357 existing records from primary storage. [2025-10-17T22:34:29.342359] [INFO ] [MAIN ] AIT: Loaded 27357 primary data records. [2025-10-17T22:34:29.344738] [DEBUG] [LOCAL ] AIZN: Loaded 3995 existing records from primary storage. [2025-10-17T22:34:29.345000] [INFO ] [MAIN ] AIZN: Loaded 3995 primary data records. [2025-10-17T22:34:29.393361] [DEBUG] [LOCAL ] AIV: Loaded 42194 existing records from primary storage. [2025-10-17T22:34:29.478447] [INFO ] [MAIN ] AIV: Loaded 42194 primary data records. [2025-10-17T22:34:30.379292] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:30.392706] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:30.393941] [INFO ] [MAIN ] AIT: Generated 1820 derivative records from 27357 primary records. [2025-10-17T22:34:30.394526] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-17T22:34:30.395277] [INFO ] [MAIN ] AIZN: Generated 1820 derivative records from 3995 primary records. [2025-10-17T22:34:30.396360] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-10-17T22:34:30.439872] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1820 records). [2025-10-17T22:34:30.439051] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:30.443323] [DEBUG] [LOCAL ] AIT: Derivative data saved (1820 records). [2025-10-17T22:34:30.444278] [INFO ] [MAIN ] AIV: Generated 1820 derivative records from 42194 primary records. [2025-10-17T22:34:30.443423] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-10-17T22:34:30.444499] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-17T22:34:30.446665] [INFO ] [MAIN ] Derivative Progress: 52/2083 symbols completed. AIZN took 1.1s. Estimated remaining: 13m 33s. Rate: 149.9 symbols/min [2025-10-17T22:34:30.449138] [INFO ] [MAIN ] Derivative Progress: 53/2083 symbols completed. AIT took 1.2s. Estimated remaining: 13m 18s. Rate: 152.7 symbols/min [2025-10-17T22:34:30.449335] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-17T22:34:30.449051] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:30.449898] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:30.467279] [DEBUG] [LOCAL ] AIV: Derivative data saved (1820 records). [2025-10-17T22:34:30.467434] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-17T22:34:30.469718] [INFO ] [MAIN ] Derivative Progress: 54/2083 symbols completed. AIV took 1.2s. Estimated remaining: 13m 3s. Rate: 155.5 symbols/min [2025-10-17T22:34:30.470027] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:30.528100] [DEBUG] [LOCAL ] AJG: Loaded 47258 existing records from primary storage. [2025-10-17T22:34:30.552017] [INFO ] [MAIN ] AJG: Loaded 47258 primary data records. [2025-10-17T22:34:30.574817] [DEBUG] [LOCAL ] AKR: Loaded 46788 existing records from primary storage. [2025-10-17T22:34:30.575459] [DEBUG] [LOCAL ] AL: Loaded 45438 existing records from primary storage. [2025-10-17T22:34:30.590972] [INFO ] [MAIN ] AL: Loaded 45438 primary data records. [2025-10-17T22:34:30.597715] [INFO ] [MAIN ] AKR: Loaded 46788 primary data records. [2025-10-17T22:34:31.505387] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:31.506278] [INFO ] [MAIN ] AJG: Generated 1820 derivative records from 47258 primary records. [2025-10-17T22:34:31.506582] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-17T22:34:31.523257] [DEBUG] [LOCAL ] AJG: Derivative data saved (1820 records). [2025-10-17T22:34:31.528029] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-17T22:34:31.529819] [INFO ] [MAIN ] Derivative Progress: 55/2083 symbols completed. AJG took 1.1s. Estimated remaining: 13m 28s. Rate: 150.7 symbols/min [2025-10-17T22:34:31.530158] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:31.556210] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:31.556819] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:31.557626] [INFO ] [MAIN ] AL: Generated 1820 derivative records from 45438 primary records. [2025-10-17T22:34:31.557787] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-17T22:34:31.559169] [INFO ] [MAIN ] AKR: Generated 1820 derivative records from 46788 primary records. [2025-10-17T22:34:31.568159] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-17T22:34:31.589394] [DEBUG] [LOCAL ] AL: Derivative data saved (1820 records). [2025-10-17T22:34:31.591637] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-17T22:34:31.594135] [INFO ] [MAIN ] Derivative Progress: 56/2083 symbols completed. AL took 1.1s. Estimated remaining: 13m 15s. Rate: 153.0 symbols/min [2025-10-17T22:34:31.595411] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:31.597380] [DEBUG] [LOCAL ] AKR: Derivative data saved (1820 records). [2025-10-17T22:34:31.597534] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-17T22:34:31.599568] [INFO ] [MAIN ] Derivative Progress: 57/2083 symbols completed. AKR took 1.1s. Estimated remaining: 13m 1s. Rate: 155.7 symbols/min [2025-10-17T22:34:31.599853] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:31.658987] [DEBUG] [LOCAL ] ALB: Loaded 54123 existing records from primary storage. [2025-10-17T22:34:31.659282] [INFO ] [MAIN ] ALB: Loaded 54123 primary data records. [2025-10-17T22:34:31.789233] [DEBUG] [LOCAL ] ALE: Loaded 32507 existing records from primary storage. [2025-10-17T22:34:31.800874] [INFO ] [MAIN ] ALE: Loaded 32507 primary data records. [2025-10-17T22:34:31.800758] [DEBUG] [LOCAL ] ALC: Loaded 51959 existing records from primary storage. [2025-10-17T22:34:31.821737] [INFO ] [MAIN ] ALC: Loaded 51959 primary data records. [2025-10-17T22:34:32.676026] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:32.677012] [INFO ] [MAIN ] ALB: Generated 1820 derivative records from 54123 primary records. [2025-10-17T22:34:32.677216] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-17T22:34:32.695376] [DEBUG] [LOCAL ] ALB: Derivative data saved (1820 records). [2025-10-17T22:34:32.695627] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-17T22:34:32.697460] [INFO ] [MAIN ] Derivative Progress: 58/2083 symbols completed. ALB took 1.2s. Estimated remaining: 13m 25s. Rate: 150.8 symbols/min [2025-10-17T22:34:32.713062] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:32.714965] [INFO ] [MAIN ] ALE: Generated 1820 derivative records from 32507 primary records. [2025-10-17T22:34:32.716007] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-17T22:34:32.739427] [DEBUG] [MAIN ] ALC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:32.745394] [INFO ] [MAIN ] ALC: Generated 1820 derivative records from 51959 primary records. [2025-10-17T22:34:32.745710] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-10-17T22:34:32.747898] [DEBUG] [LOCAL ] ALE: Derivative data saved (1820 records). [2025-10-17T22:34:32.748209] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-17T22:34:32.750445] [INFO ] [MAIN ] Derivative Progress: 59/2083 symbols completed. ALE took 1.2s. Estimated remaining: 13m 13s. Rate: 153.1 symbols/min [2025-10-17T22:34:32.765969] [DEBUG] [LOCAL ] ALC: Derivative data saved (1820 records). [2025-10-17T22:34:32.766063] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-10-17T22:34:32.768526] [INFO ] [MAIN ] Derivative Progress: 60/2083 symbols completed. ALC took 1.2s. Estimated remaining: 13m 0s. Rate: 155.6 symbols/min [2025-10-17T22:34:32.768942] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:32.769016] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:32.769147] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:32.782844] [DEBUG] [LOCAL ] ALG: Loaded 9877 existing records from primary storage. [2025-10-17T22:34:32.783078] [INFO ] [MAIN ] ALG: Loaded 9877 primary data records. [2025-10-17T22:34:32.908306] [DEBUG] [LOCAL ] ALEX: Loaded 31633 existing records from primary storage. [2025-10-17T22:34:32.913970] [INFO ] [MAIN ] ALEX: Loaded 31633 primary data records. [2025-10-17T22:34:33.331110] [DEBUG] [LOCAL ] ALIT: Loaded 53560 existing records from primary storage. [2025-10-17T22:34:33.331685] [INFO ] [MAIN ] ALIT: Loaded 53560 primary data records. [2025-10-17T22:34:33.812694] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:33.814162] [INFO ] [MAIN ] ALG: Generated 1820 derivative records from 9877 primary records. [2025-10-17T22:34:33.815567] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-17T22:34:33.834403] [DEBUG] [LOCAL ] ALG: Derivative data saved (1820 records). [2025-10-17T22:34:33.835425] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-17T22:34:33.837413] [INFO ] [MAIN ] Derivative Progress: 61/2083 symbols completed. ALG took 1.1s. Estimated remaining: 13m 22s. Rate: 151.2 symbols/min [2025-10-17T22:34:33.837872] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:33.852927] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:33.854138] [INFO ] [MAIN ] ALEX: Generated 1820 derivative records from 31633 primary records. [2025-10-17T22:34:33.854279] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-17T22:34:33.886144] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:33.887560] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1820 records). [2025-10-17T22:34:33.888042] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-17T22:34:33.889108] [INFO ] [MAIN ] ALIT: Generated 1820 derivative records from 53560 primary records. [2025-10-17T22:34:33.891431] [INFO ] [MAIN ] Derivative Progress: 62/2083 symbols completed. ALEX took 1.1s. Estimated remaining: 13m 11s. Rate: 153.3 symbols/min [2025-10-17T22:34:33.889203] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-17T22:34:33.892083] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:33.926089] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1820 records). [2025-10-17T22:34:33.926190] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-17T22:34:33.928395] [INFO ] [MAIN ] Derivative Progress: 63/2083 symbols completed. ALIT took 1.2s. Estimated remaining: 12m 59s. Rate: 155.6 symbols/min [2025-10-17T22:34:33.928764] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:33.953907] [DEBUG] [LOCAL ] ALK: Loaded 53860 existing records from primary storage. [2025-10-17T22:34:33.954283] [INFO ] [MAIN ] ALK: Loaded 53860 primary data records. [2025-10-17T22:34:34.136813] [DEBUG] [LOCAL ] ALL: Loaded 50503 existing records from primary storage. [2025-10-17T22:34:34.153693] [INFO ] [MAIN ] ALL: Loaded 50503 primary data records. [2025-10-17T22:34:34.390712] [DEBUG] [LOCAL ] ALLE: Loaded 44772 existing records from primary storage. [2025-10-17T22:34:34.425709] [INFO ] [MAIN ] ALLE: Loaded 44772 primary data records. [2025-10-17T22:34:34.995430] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:34.997341] [INFO ] [MAIN ] ALK: Generated 1820 derivative records from 53860 primary records. [2025-10-17T22:34:34.998302] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-17T22:34:35.030606] [DEBUG] [LOCAL ] ALK: Derivative data saved (1820 records). [2025-10-17T22:34:35.030877] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-17T22:34:35.032830] [INFO ] [MAIN ] Derivative Progress: 64/2083 symbols completed. ALK took 1.2s. Estimated remaining: 13m 21s. Rate: 151.2 symbols/min [2025-10-17T22:34:35.033401] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:35.033223] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:35.034362] [INFO ] [MAIN ] ALL: Generated 1820 derivative records from 50503 primary records. [2025-10-17T22:34:35.034797] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-17T22:34:35.067673] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:35.069284] [INFO ] [MAIN ] ALLE: Generated 1820 derivative records from 44772 primary records. [2025-10-17T22:34:35.070006] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-17T22:34:35.070567] [DEBUG] [LOCAL ] ALL: Derivative data saved (1820 records). [2025-10-17T22:34:35.070927] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-17T22:34:35.073123] [INFO ] [MAIN ] Derivative Progress: 65/2083 symbols completed. ALL took 1.2s. Estimated remaining: 13m 10s. Rate: 153.3 symbols/min [2025-10-17T22:34:35.084750] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:35.089565] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1820 records). [2025-10-17T22:34:35.089731] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-10-17T22:34:35.092806] [INFO ] [MAIN ] Derivative Progress: 66/2083 symbols completed. ALLE took 1.2s. Estimated remaining: 12m 58s. Rate: 155.5 symbols/min [2025-10-17T22:34:35.093079] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:35.144234] [DEBUG] [LOCAL ] ALLY: Loaded 54000 existing records from primary storage. [2025-10-17T22:34:35.144539] [INFO ] [MAIN ] ALLY: Loaded 54000 primary data records. [2025-10-17T22:34:35.153419] [DEBUG] [LOCAL ] ALTG: Loaded 23632 existing records from primary storage. [2025-10-17T22:34:35.153688] [INFO ] [MAIN ] ALTG: Loaded 23632 primary data records. [2025-10-17T22:34:35.372068] [DEBUG] [LOCAL ] ALSN: Loaded 44062 existing records from primary storage. [2025-10-17T22:34:35.388410] [INFO ] [MAIN ] ALSN: Loaded 44062 primary data records. [2025-10-17T22:34:36.176367] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:36.189352] [INFO ] [MAIN ] ALLY: Generated 1820 derivative records from 54000 primary records. [2025-10-17T22:34:36.190045] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-17T22:34:36.189982] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:36.191388] [INFO ] [MAIN ] ALTG: Generated 1820 derivative records from 23632 primary records. [2025-10-17T22:34:36.199492] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-17T22:34:36.216805] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1820 records). [2025-10-17T22:34:36.217797] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-17T22:34:36.219796] [INFO ] [MAIN ] Derivative Progress: 67/2083 symbols completed. ALLY took 1.2s. Estimated remaining: 13m 20s. Rate: 151.2 symbols/min [2025-10-17T22:34:36.219981] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:36.227595] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1820 records). [2025-10-17T22:34:36.227733] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-17T22:34:36.229941] [INFO ] [MAIN ] Derivative Progress: 68/2083 symbols completed. ALTG took 1.1s. Estimated remaining: 13m 8s. Rate: 153.4 symbols/min [2025-10-17T22:34:36.230217] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:36.249545] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:36.250382] [INFO ] [MAIN ] ALSN: Generated 1820 derivative records from 44062 primary records. [2025-10-17T22:34:36.250581] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-17T22:34:36.263178] [DEBUG] [LOCAL ] ALUR: Loaded 9640 existing records from primary storage. [2025-10-17T22:34:36.266914] [INFO ] [MAIN ] ALUR: Loaded 9640 primary data records. [2025-10-17T22:34:36.327043] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1820 records). [2025-10-17T22:34:36.357428] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-10-17T22:34:36.359903] [INFO ] [MAIN ] Derivative Progress: 69/2083 symbols completed. ALSN took 1.3s. Estimated remaining: 13m 0s. Rate: 154.9 symbols/min [2025-10-17T22:34:36.374558] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:36.507055] [DEBUG] [LOCAL ] ALX: Loaded 7141 existing records from primary storage. [2025-10-17T22:34:36.508127] [DEBUG] [LOCAL ] ALV: Loaded 42843 existing records from primary storage. [2025-10-17T22:34:36.549810] [INFO ] [MAIN ] ALV: Loaded 42843 primary data records. [2025-10-17T22:34:36.549724] [INFO ] [MAIN ] ALX: Loaded 7141 primary data records. [2025-10-17T22:34:37.271193] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:37.272454] [INFO ] [MAIN ] ALUR: Generated 1820 derivative records from 9640 primary records. [2025-10-17T22:34:37.272721] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-17T22:34:37.291410] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1820 records). [2025-10-17T22:34:37.291816] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-17T22:34:37.293819] [INFO ] [MAIN ] Derivative Progress: 70/2083 symbols completed. ALUR took 1.1s. Estimated remaining: 13m 16s. Rate: 151.8 symbols/min [2025-10-17T22:34:37.294119] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:37.322618] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:37.328916] [INFO ] [MAIN ] ALV: Generated 1820 derivative records from 42843 primary records. [2025-10-17T22:34:37.328015] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:37.329060] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-17T22:34:37.330017] [INFO ] [MAIN ] ALX: Generated 1820 derivative records from 7141 primary records. [2025-10-17T22:34:37.330933] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-17T22:34:37.354143] [DEBUG] [LOCAL ] ALV: Derivative data saved (1820 records). [2025-10-17T22:34:37.361820] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-17T22:34:37.362713] [DEBUG] [LOCAL ] ALX: Derivative data saved (1820 records). [2025-10-17T22:34:37.362875] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-17T22:34:37.365027] [INFO ] [MAIN ] Derivative Progress: 71/2083 symbols completed. ALX took 1.0s. Estimated remaining: 13m 6s. Rate: 153.6 symbols/min [2025-10-17T22:34:37.367601] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:37.367774] [INFO ] [MAIN ] Derivative Progress: 72/2083 symbols completed. ALV took 1.1s. Estimated remaining: 12m 55s. Rate: 155.7 symbols/min [2025-10-17T22:34:37.368313] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:37.410399] [DEBUG] [LOCAL ] AM: Loaded 52670 existing records from primary storage. [2025-10-17T22:34:37.410632] [INFO ] [MAIN ] AM: Loaded 52670 primary data records. [2025-10-17T22:34:37.543942] [DEBUG] [LOCAL ] AMBC: Loaded 36767 existing records from primary storage. [2025-10-17T22:34:37.556600] [INFO ] [MAIN ] AMBC: Loaded 36767 primary data records. [2025-10-17T22:34:37.577998] [DEBUG] [LOCAL ] AMBP: Loaded 45132 existing records from primary storage. [2025-10-17T22:34:37.627857] [INFO ] [MAIN ] AMBP: Loaded 45132 primary data records. [2025-10-17T22:34:38.443944] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:38.445261] [INFO ] [MAIN ] AM: Generated 1820 derivative records from 52670 primary records. [2025-10-17T22:34:38.445509] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-17T22:34:38.462906] [DEBUG] [LOCAL ] AM: Derivative data saved (1820 records). [2025-10-17T22:34:38.463173] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-17T22:34:38.465442] [INFO ] [MAIN ] Derivative Progress: 73/2083 symbols completed. AM took 1.2s. Estimated remaining: 13m 14s. Rate: 151.9 symbols/min [2025-10-17T22:34:38.482588] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:38.484180] [INFO ] [MAIN ] AMBC: Generated 1820 derivative records from 36767 primary records. [2025-10-17T22:34:38.484298] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-17T22:34:38.516037] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1820 records). [2025-10-17T22:34:38.516157] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-17T22:34:38.518360] [INFO ] [MAIN ] Derivative Progress: 74/2083 symbols completed. AMBC took 1.2s. Estimated remaining: 13m 4s. Rate: 153.7 symbols/min [2025-10-17T22:34:38.515304] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:38.519350] [INFO ] [MAIN ] AMBP: Generated 1820 derivative records from 45132 primary records. [2025-10-17T22:34:38.519521] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-17T22:34:38.535331] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1820 records). [2025-10-17T22:34:38.535394] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-17T22:34:38.541529] [INFO ] [MAIN ] Derivative Progress: 75/2083 symbols completed. AMBP took 1.2s. Estimated remaining: 12m 54s. Rate: 155.6 symbols/min [2025-10-17T22:34:38.542017] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:38.542122] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:38.542617] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:38.615775] [DEBUG] [LOCAL ] AMC: Loaded 54542 existing records from primary storage. [2025-10-17T22:34:38.615976] [INFO ] [MAIN ] AMC: Loaded 54542 primary data records. [2025-10-17T22:34:38.750833] [DEBUG] [LOCAL ] AME: Loaded 49338 existing records from primary storage. [2025-10-17T22:34:38.757349] [INFO ] [MAIN ] AME: Loaded 49338 primary data records. [2025-10-17T22:34:38.751575] [DEBUG] [LOCAL ] AMCR: Loaded 54449 existing records from primary storage. [2025-10-17T22:34:38.757691] [INFO ] [MAIN ] AMCR: Loaded 54449 primary data records. [2025-10-17T22:34:39.599446] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:39.600299] [INFO ] [MAIN ] AMC: Generated 1820 derivative records from 54542 primary records. [2025-10-17T22:34:39.600552] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-17T22:34:39.635451] [DEBUG] [LOCAL ] AMC: Derivative data saved (1820 records). [2025-10-17T22:34:39.635866] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:39.649019] [INFO ] [MAIN ] AME: Generated 1820 derivative records from 49338 primary records. [2025-10-17T22:34:39.649529] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:39.650293] [INFO ] [MAIN ] AMCR: Generated 1820 derivative records from 54449 primary records. [2025-10-17T22:34:39.650400] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-17T22:34:39.649227] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-17T22:34:39.650525] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-17T22:34:39.653812] [INFO ] [MAIN ] Derivative Progress: 76/2083 symbols completed. AMC took 1.1s. Estimated remaining: 13m 13s. Rate: 151.9 symbols/min [2025-10-17T22:34:39.663015] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:39.677742] [DEBUG] [LOCAL ] AME: Derivative data saved (1820 records). [2025-10-17T22:34:39.681675] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-17T22:34:39.685291] [INFO ] [MAIN ] Derivative Progress: 77/2083 symbols completed. AME took 1.1s. Estimated remaining: 13m 3s. Rate: 153.7 symbols/min [2025-10-17T22:34:39.685991] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:39.692822] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1820 records). [2025-10-17T22:34:39.693127] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-17T22:34:39.695600] [INFO ] [MAIN ] Derivative Progress: 78/2083 symbols completed. AMCR took 1.2s. Estimated remaining: 12m 53s. Rate: 155.6 symbols/min [2025-10-17T22:34:39.695952] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:39.713857] [DEBUG] [LOCAL ] AMG: Loaded 20485 existing records from primary storage. [2025-10-17T22:34:39.714002] [INFO ] [MAIN ] AMG: Loaded 20485 primary data records. [2025-10-17T22:34:39.956949] [DEBUG] [LOCAL ] AMP: Loaded 32543 existing records from primary storage. [2025-10-17T22:34:40.088543] [DEBUG] [LOCAL ] AMH: Loaded 52597 existing records from primary storage. [2025-10-17T22:34:40.089556] [INFO ] [MAIN ] AMP: Loaded 32543 primary data records. [2025-10-17T22:34:40.089480] [INFO ] [MAIN ] AMH: Loaded 52597 primary data records. [2025-10-17T22:34:40.775220] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:40.776112] [INFO ] [MAIN ] AMG: Generated 1820 derivative records from 20485 primary records. [2025-10-17T22:34:40.776307] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-17T22:34:40.795407] [DEBUG] [LOCAL ] AMG: Derivative data saved (1820 records). [2025-10-17T22:34:40.795934] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-17T22:34:40.798133] [INFO ] [MAIN ] Derivative Progress: 79/2083 symbols completed. AMG took 1.1s. Estimated remaining: 13m 11s. Rate: 152.1 symbols/min [2025-10-17T22:34:40.798303] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:40.815809] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:40.818224] [INFO ] [MAIN ] AMH: Generated 1820 derivative records from 52597 primary records. [2025-10-17T22:34:40.819134] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-17T22:34:40.845993] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:34:40.848080] [DEBUG] [LOCAL ] AMH: Derivative data saved (1820 records). [2025-10-17T22:34:40.848785] [INFO ] [MAIN ] AMP: Generated 1819 derivative records from 32543 primary records. [2025-10-17T22:34:40.848842] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-17T22:34:40.850984] [INFO ] [MAIN ] Derivative Progress: 80/2083 symbols completed. AMH took 1.2s. Estimated remaining: 13m 2s. Rate: 153.7 symbols/min [2025-10-17T22:34:40.851213] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:40.851110] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-17T22:34:40.868900] [DEBUG] [LOCAL ] AMP: Derivative data saved (1819 records). [2025-10-17T22:34:40.869199] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-17T22:34:40.871526] [INFO ] [MAIN ] Derivative Progress: 81/2083 symbols completed. AMP took 1.2s. Estimated remaining: 12m 52s. Rate: 155.6 symbols/min [2025-10-17T22:34:40.871744] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:40.917772] [DEBUG] [LOCAL ] AMPX: Loaded 53118 existing records from primary storage. [2025-10-17T22:34:40.920196] [INFO ] [MAIN ] AMPX: Loaded 53118 primary data records. [2025-10-17T22:34:40.950930] [DEBUG] [LOCAL ] AMPY: Loaded 39876 existing records from primary storage. [2025-10-17T22:34:40.962559] [INFO ] [MAIN ] AMPY: Loaded 39876 primary data records. [2025-10-17T22:34:41.123047] [DEBUG] [LOCAL ] AMR: Loaded 29322 existing records from primary storage. [2025-10-17T22:34:41.130433] [INFO ] [MAIN ] AMR: Loaded 29322 primary data records. [2025-10-17T22:34:41.893089] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:41.894144] [INFO ] [MAIN ] AMPX: Generated 1820 derivative records from 53118 primary records. [2025-10-17T22:34:41.894492] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-10-17T22:34:41.937769] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:41.939619] [INFO ] [MAIN ] AMR: Generated 1820 derivative records from 29322 primary records. [2025-10-17T22:34:41.940205] [DEBUG] [MAIN ] AMPY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:41.941333] [INFO ] [MAIN ] AMPY: Generated 1820 derivative records from 39876 primary records. [2025-10-17T22:34:41.942048] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-17T22:34:41.941710] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-17T22:34:41.944193] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1820 records). [2025-10-17T22:34:41.944326] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-10-17T22:34:41.954472] [INFO ] [MAIN ] Derivative Progress: 82/2083 symbols completed. AMPX took 1.2s. Estimated remaining: 13m 9s. Rate: 152.2 symbols/min [2025-10-17T22:34:41.965453] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:41.980284] [DEBUG] [LOCAL ] AMR: Derivative data saved (1820 records). [2025-10-17T22:34:41.980391] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-17T22:34:41.983863] [INFO ] [MAIN ] Derivative Progress: 83/2083 symbols completed. AMR took 1.1s. Estimated remaining: 12m 60s. Rate: 153.9 symbols/min [2025-10-17T22:34:41.984249] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:41.989088] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1820 records). [2025-10-17T22:34:41.989261] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-17T22:34:41.993228] [INFO ] [MAIN ] Derivative Progress: 84/2083 symbols completed. AMPY took 1.1s. Estimated remaining: 12m 50s. Rate: 155.7 symbols/min [2025-10-17T22:34:41.993383] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:42.029530] [DEBUG] [LOCAL ] AMRC: Loaded 39116 existing records from primary storage. [2025-10-17T22:34:42.029751] [INFO ] [MAIN ] AMRC: Loaded 39116 primary data records. [2025-10-17T22:34:42.149339] [DEBUG] [LOCAL ] AMTB: Loaded 20848 existing records from primary storage. [2025-10-17T22:34:42.159992] [INFO ] [MAIN ] AMTB: Loaded 20848 primary data records. [2025-10-17T22:34:42.491599] [DEBUG] [LOCAL ] AMT: Loaded 53232 existing records from primary storage. [2025-10-17T22:34:42.512351] [INFO ] [MAIN ] AMT: Loaded 53232 primary data records. [2025-10-17T22:34:43.054582] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:43.056103] [INFO ] [MAIN ] AMRC: Generated 1820 derivative records from 39116 primary records. [2025-10-17T22:34:43.056282] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-17T22:34:43.079025] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:43.085508] [INFO ] [MAIN ] AMTB: Generated 1820 derivative records from 20848 primary records. [2025-10-17T22:34:43.086704] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-17T22:34:43.086622] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1820 records). [2025-10-17T22:34:43.088414] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-17T22:34:43.101605] [INFO ] [MAIN ] Derivative Progress: 85/2083 symbols completed. AMRC took 1.1s. Estimated remaining: 13m 7s. Rate: 152.4 symbols/min [2025-10-17T22:34:43.109159] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:43.109008] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1820 records). [2025-10-17T22:34:43.109384] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-17T22:34:43.111565] [INFO ] [MAIN ] Derivative Progress: 86/2083 symbols completed. AMTB took 1.1s. Estimated remaining: 12m 58s. Rate: 154.1 symbols/min [2025-10-17T22:34:43.111712] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:43.124899] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:43.125760] [INFO ] [MAIN ] AMT: Generated 1820 derivative records from 53232 primary records. [2025-10-17T22:34:43.125912] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-17T22:34:43.144458] [DEBUG] [LOCAL ] AMTD: Loaded 3828 existing records from primary storage. [2025-10-17T22:34:43.145139] [INFO ] [MAIN ] AMTD: Loaded 3828 primary data records. [2025-10-17T22:34:43.159787] [DEBUG] [LOCAL ] AMT: Derivative data saved (1820 records). [2025-10-17T22:34:43.179022] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-17T22:34:43.219334] [INFO ] [MAIN ] Derivative Progress: 87/2083 symbols completed. AMT took 1.2s. Estimated remaining: 12m 51s. Rate: 155.4 symbols/min [2025-10-17T22:34:43.253090] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:43.462831] [DEBUG] [LOCAL ] AMWL: Loaded 9827 existing records from primary storage. [2025-10-17T22:34:43.491701] [INFO ] [MAIN ] AMWL: Loaded 9827 primary data records. [2025-10-17T22:34:43.492576] [DEBUG] [LOCAL ] AMTM: Loaded 51234 existing records from primary storage. [2025-10-17T22:34:43.492814] [INFO ] [MAIN ] AMTM: Loaded 51234 primary data records. [2025-10-17T22:34:44.167130] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:44.168137] [INFO ] [MAIN ] AMTD: Generated 1820 derivative records from 3828 primary records. [2025-10-17T22:34:44.169468] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-17T22:34:44.188103] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1820 records). [2025-10-17T22:34:44.188427] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-17T22:34:44.190791] [INFO ] [MAIN ] Derivative Progress: 88/2083 symbols completed. AMTD took 1.1s. Estimated remaining: 13m 4s. Rate: 152.8 symbols/min [2025-10-17T22:34:44.223361] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:44.223600] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:44.224994] [INFO ] [MAIN ] AMTM: Generated 1820 derivative records from 51234 primary records. [2025-10-17T22:34:44.224390] [INFO ] [MAIN ] AMWL: Generated 1820 derivative records from 9827 primary records. [2025-10-17T22:34:44.225089] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-17T22:34:44.225160] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-17T22:34:44.254859] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1820 records). [2025-10-17T22:34:44.256353] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1820 records). [2025-10-17T22:34:44.256447] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-17T22:34:44.256536] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-17T22:34:44.258688] [INFO ] [MAIN ] Derivative Progress: 89/2083 symbols completed. AMTM took 1.1s. Estimated remaining: 12m 56s. Rate: 154.2 symbols/min [2025-10-17T22:34:44.260924] [INFO ] [MAIN ] Derivative Progress: 90/2083 symbols completed. AMWL took 1.0s. Estimated remaining: 12m 47s. Rate: 155.9 symbols/min [2025-10-17T22:34:44.261273] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:44.261449] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:44.261387] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:44.319400] [DEBUG] [LOCAL ] AN: Loaded 31816 existing records from primary storage. [2025-10-17T22:34:44.319705] [INFO ] [MAIN ] AN: Loaded 31816 primary data records. [2025-10-17T22:34:44.437200] [DEBUG] [LOCAL ] AMX: Loaded 49908 existing records from primary storage. [2025-10-17T22:34:44.461304] [INFO ] [MAIN ] AMX: Loaded 49908 primary data records. [2025-10-17T22:34:44.462408] [DEBUG] [LOCAL ] ANET: Loaded 54546 existing records from primary storage. [2025-10-17T22:34:44.523266] [INFO ] [MAIN ] ANET: Loaded 54546 primary data records. [2025-10-17T22:34:45.304776] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:45.307639] [INFO ] [MAIN ] AN: Generated 1820 derivative records from 31816 primary records. [2025-10-17T22:34:45.308687] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-10-17T22:34:45.335876] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:45.337409] [INFO ] [MAIN ] AMX: Generated 1820 derivative records from 49908 primary records. [2025-10-17T22:34:45.338667] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-17T22:34:45.343821] [DEBUG] [LOCAL ] AN: Derivative data saved (1820 records). [2025-10-17T22:34:45.344106] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-10-17T22:34:45.361633] [DEBUG] [LOCAL ] AMX: Derivative data saved (1820 records). [2025-10-17T22:34:45.361876] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-10-17T22:34:45.361530] [INFO ] [MAIN ] Derivative Progress: 91/2083 symbols completed. AN took 1.1s. Estimated remaining: 13m 2s. Rate: 152.8 symbols/min [2025-10-17T22:34:45.377977] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:45.378328] [INFO ] [MAIN ] Derivative Progress: 92/2083 symbols completed. AMX took 1.1s. Estimated remaining: 12m 54s. Rate: 154.4 symbols/min [2025-10-17T22:34:45.379347] [INFO ] [MAIN ] ANET: Generated 1820 derivative records from 54546 primary records. [2025-10-17T22:34:45.379503] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-17T22:34:45.379632] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:45.378261] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:45.405318] [DEBUG] [LOCAL ] ANET: Derivative data saved (1820 records). [2025-10-17T22:34:45.412144] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-17T22:34:45.414552] [INFO ] [MAIN ] Derivative Progress: 93/2083 symbols completed. ANET took 1.2s. Estimated remaining: 12m 46s. Rate: 155.9 symbols/min [2025-10-17T22:34:45.415417] [DEBUG] [LOCAL ] ANRO: Loaded 19753 existing records from primary storage. [2025-10-17T22:34:45.415584] [INFO ] [MAIN ] ANRO: Loaded 19753 primary data records. [2025-10-17T22:34:45.427316] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:45.609323] [DEBUG] [LOCAL ] ANVS: Loaded 24303 existing records from primary storage. [2025-10-17T22:34:45.750236] [INFO ] [MAIN ] ANVS: Loaded 24303 primary data records. [2025-10-17T22:34:45.812026] [DEBUG] [LOCAL ] ANF: Loaded 52835 existing records from primary storage. [2025-10-17T22:34:45.849586] [INFO ] [MAIN ] ANF: Loaded 52835 primary data records. [2025-10-17T22:34:46.465133] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:46.466515] [INFO ] [MAIN ] ANRO: Generated 1820 derivative records from 19753 primary records. [2025-10-17T22:34:46.466745] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-10-17T22:34:46.483665] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1820 records). [2025-10-17T22:34:46.484261] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-10-17T22:34:46.487024] [INFO ] [MAIN ] Derivative Progress: 94/2083 symbols completed. ANRO took 1.1s. Estimated remaining: 12m 60s. Rate: 153.0 symbols/min [2025-10-17T22:34:46.487266] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:46.504130] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:46.504964] [INFO ] [MAIN ] ANVS: Generated 1820 derivative records from 24303 primary records. [2025-10-17T22:34:46.505204] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-17T22:34:46.547766] [DEBUG] [LOCAL ] AOMR: Loaded 16681 existing records from primary storage. [2025-10-17T22:34:46.549963] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:46.550068] [INFO ] [MAIN ] AOMR: Loaded 16681 primary data records. [2025-10-17T22:34:46.549355] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1820 records). [2025-10-17T22:34:46.551012] [INFO ] [MAIN ] ANF: Generated 1820 derivative records from 52835 primary records. [2025-10-17T22:34:46.571441] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-17T22:34:46.575088] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-17T22:34:46.603628] [INFO ] [MAIN ] Derivative Progress: 95/2083 symbols completed. ANVS took 1.2s. Estimated remaining: 12m 54s. Rate: 154.2 symbols/min [2025-10-17T22:34:46.629629] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:46.655063] [DEBUG] [LOCAL ] ANF: Derivative data saved (1820 records). [2025-10-17T22:34:46.661355] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-17T22:34:46.671737] [INFO ] [MAIN ] Derivative Progress: 96/2083 symbols completed. ANF took 1.3s. Estimated remaining: 12m 47s. Rate: 155.5 symbols/min [2025-10-17T22:34:46.675600] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:46.907772] [DEBUG] [LOCAL ] AORT: Loaded 29531 existing records from primary storage. [2025-10-17T22:34:46.908863] [INFO ] [MAIN ] AORT: Loaded 29531 primary data records. [2025-10-17T22:34:46.977422] [DEBUG] [LOCAL ] AON: Loaded 45813 existing records from primary storage. [2025-10-17T22:34:46.999753] [INFO ] [MAIN ] AON: Loaded 45813 primary data records. [2025-10-17T22:34:47.126190] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:47.148408] [INFO ] [MAIN ] AOMR: Generated 1820 derivative records from 16681 primary records. [2025-10-17T22:34:47.166339] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-17T22:34:47.450309] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1820 records). [2025-10-17T22:34:47.450707] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-10-17T22:34:47.452945] [INFO ] [MAIN ] Derivative Progress: 97/2083 symbols completed. AOMR took 1.0s. Estimated remaining: 12m 54s. Rate: 153.9 symbols/min [2025-10-17T22:34:47.564799] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:47.615717] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:47.616818] [INFO ] [MAIN ] AORT: Generated 1820 derivative records from 29531 primary records. [2025-10-17T22:34:47.616994] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-10-17T22:34:47.635565] [DEBUG] [LOCAL ] AORT: Derivative data saved (1820 records). [2025-10-17T22:34:47.650833] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-10-17T22:34:47.653165] [INFO ] [MAIN ] Derivative Progress: 98/2083 symbols completed. AORT took 1.0s. Estimated remaining: 12m 50s. Rate: 154.6 symbols/min [2025-10-17T22:34:47.653402] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:47.654324] [DEBUG] [LOCAL ] AOS: Loaded 49475 existing records from primary storage. [2025-10-17T22:34:47.668002] [INFO ] [MAIN ] AOS: Loaded 49475 primary data records. [2025-10-17T22:34:47.689329] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:47.700206] [INFO ] [MAIN ] AON: Generated 1820 derivative records from 45813 primary records. [2025-10-17T22:34:47.705490] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-17T22:34:47.822398] [DEBUG] [LOCAL ] AON: Derivative data saved (1820 records). [2025-10-17T22:34:47.840053] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-17T22:34:47.843513] [INFO ] [MAIN ] Derivative Progress: 99/2083 symbols completed. AON took 1.2s. Estimated remaining: 12m 46s. Rate: 155.4 symbols/min [2025-10-17T22:34:47.860851] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:48.015169] [DEBUG] [LOCAL ] APAM: Loaded 36578 existing records from primary storage. [2025-10-17T22:34:48.016168] [INFO ] [MAIN ] APAM: Loaded 36578 primary data records. [2025-10-17T22:34:48.406797] [DEBUG] [LOCAL ] APD: Loaded 46187 existing records from primary storage. [2025-10-17T22:34:48.408173] [INFO ] [MAIN ] APD: Loaded 46187 primary data records. [2025-10-17T22:34:48.574074] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:48.617549] [INFO ] [MAIN ] AOS: Generated 1820 derivative records from 49475 primary records. [2025-10-17T22:34:48.742899] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-10-17T22:34:48.763828] [DEBUG] [LOCAL ] AOS: Derivative data saved (1820 records). [2025-10-17T22:34:48.764005] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-10-17T22:34:48.766449] [INFO ] [MAIN ] Derivative Progress: 100/2083 symbols completed. AOS took 1.2s. Estimated remaining: 12m 56s. Rate: 153.3 symbols/min [2025-10-17T22:34:48.767737] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:48.788770] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:48.789798] [INFO ] [MAIN ] APAM: Generated 1820 derivative records from 36578 primary records. [2025-10-17T22:34:48.790439] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-10-17T22:34:48.810402] [DEBUG] [LOCAL ] APAM: Derivative data saved (1820 records). [2025-10-17T22:34:48.810923] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-10-17T22:34:48.813938] [INFO ] [MAIN ] Derivative Progress: 101/2083 symbols completed. APAM took 1.2s. Estimated remaining: 12m 49s. Rate: 154.6 symbols/min [2025-10-17T22:34:48.814498] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:48.847486] [DEBUG] [MAIN ] APD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:48.848351] [INFO ] [MAIN ] APD: Generated 1820 derivative records from 46187 primary records. [2025-10-17T22:34:48.848710] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-17T22:34:48.865364] [DEBUG] [LOCAL ] APD: Derivative data saved (1820 records). [2025-10-17T22:34:48.865770] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-17T22:34:48.867957] [INFO ] [MAIN ] Derivative Progress: 102/2083 symbols completed. APD took 1.0s. Estimated remaining: 12m 42s. Rate: 156.0 symbols/min [2025-10-17T22:34:48.868147] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:48.884838] [DEBUG] [LOCAL ] APG: Loaded 51343 existing records from primary storage. [2025-10-17T22:34:48.885123] [INFO ] [MAIN ] APG: Loaded 51343 primary data records. [2025-10-17T22:34:49.250346] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-10-17T22:34:49.250709] [INFO ] [MAIN ] APH: Loaded 54471 primary data records. [2025-10-17T22:34:49.377912] [DEBUG] [LOCAL ] APLE: Loaded 52733 existing records from primary storage. [2025-10-17T22:34:49.378317] [INFO ] [MAIN ] APLE: Loaded 52733 primary data records. [2025-10-17T22:34:49.910046] [DEBUG] [MAIN ] APG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:49.910989] [INFO ] [MAIN ] APG: Generated 1820 derivative records from 51343 primary records. [2025-10-17T22:34:49.912310] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-17T22:34:49.931019] [DEBUG] [LOCAL ] APG: Derivative data saved (1820 records). [2025-10-17T22:34:49.931430] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-10-17T22:34:49.933976] [INFO ] [MAIN ] Derivative Progress: 103/2083 symbols completed. APG took 1.2s. Estimated remaining: 12m 55s. Rate: 153.3 symbols/min [2025-10-17T22:34:49.952079] [DEBUG] [MAIN ] APH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:49.952945] [INFO ] [MAIN ] APH: Generated 1820 derivative records from 54471 primary records. [2025-10-17T22:34:49.953087] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-10-17T22:34:49.986314] [DEBUG] [LOCAL ] APH: Derivative data saved (1820 records). [2025-10-17T22:34:49.985850] [DEBUG] [MAIN ] APLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:49.987228] [INFO ] [MAIN ] APLE: Generated 1820 derivative records from 52733 primary records. [2025-10-17T22:34:49.987326] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-10-17T22:34:49.987432] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-10-17T22:34:49.989311] [INFO ] [MAIN ] Derivative Progress: 104/2083 symbols completed. APH took 1.2s. Estimated remaining: 12m 48s. Rate: 154.6 symbols/min [2025-10-17T22:34:50.004803] [DEBUG] [LOCAL ] APLE: Derivative data saved (1820 records). [2025-10-17T22:34:50.004888] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-10-17T22:34:50.007052] [INFO ] [MAIN ] Derivative Progress: 105/2083 symbols completed. APLE took 1.1s. Estimated remaining: 12m 41s. Rate: 156.0 symbols/min [2025-10-17T22:34:50.007449] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:50.007562] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:50.007705] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:50.015449] [DEBUG] [LOCAL ] AQNB: Loaded 4088 existing records from primary storage. [2025-10-17T22:34:50.015672] [INFO ] [MAIN ] AQNB: Loaded 4088 primary data records. [2025-10-17T22:34:50.396685] [DEBUG] [LOCAL ] AR: Loaded 54366 existing records from primary storage. [2025-10-17T22:34:50.411112] [INFO ] [MAIN ] AR: Loaded 54366 primary data records. [2025-10-17T22:34:50.424313] [DEBUG] [LOCAL ] APTV: Loaded 52719 existing records from primary storage. [2025-10-17T22:34:50.433753] [INFO ] [MAIN ] APTV: Loaded 52719 primary data records. [2025-10-17T22:34:51.042745] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:51.044362] [INFO ] [MAIN ] AQNB: Generated 1820 derivative records from 4088 primary records. [2025-10-17T22:34:51.044480] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-17T22:34:51.064639] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1820 records). [2025-10-17T22:34:51.064787] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-17T22:34:51.066959] [INFO ] [MAIN ] Derivative Progress: 106/2083 symbols completed. AQNB took 1.1s. Estimated remaining: 12m 53s. Rate: 153.5 symbols/min [2025-10-17T22:34:51.067074] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:51.106395] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:51.106763] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:51.107749] [INFO ] [MAIN ] AR: Generated 1820 derivative records from 54366 primary records. [2025-10-17T22:34:51.108513] [INFO ] [MAIN ] APTV: Generated 1820 derivative records from 52719 primary records. [2025-10-17T22:34:51.108678] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-10-17T22:34:51.109108] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-10-17T22:34:51.140473] [DEBUG] [LOCAL ] AR: Derivative data saved (1820 records). [2025-10-17T22:34:51.140999] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-10-17T22:34:51.152451] [INFO ] [MAIN ] Derivative Progress: 107/2083 symbols completed. AR took 1.1s. Estimated remaining: 12m 47s. Rate: 154.6 symbols/min [2025-10-17T22:34:51.154028] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:51.158030] [DEBUG] [LOCAL ] APTV: Derivative data saved (1820 records). [2025-10-17T22:34:51.158144] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-10-17T22:34:51.160150] [INFO ] [MAIN ] Derivative Progress: 108/2083 symbols completed. APTV took 1.2s. Estimated remaining: 12m 40s. Rate: 156.0 symbols/min [2025-10-17T22:34:51.160293] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:51.174865] [DEBUG] [LOCAL ] ARCO: Loaded 45143 existing records from primary storage. [2025-10-17T22:34:51.175192] [INFO ] [MAIN ] ARCO: Loaded 45143 primary data records. [2025-10-17T22:34:51.399979] [DEBUG] [LOCAL ] ARDT: Loaded 28112 existing records from primary storage. [2025-10-17T22:34:51.517402] [INFO ] [MAIN ] ARDT: Loaded 28112 primary data records. [2025-10-17T22:34:51.638491] [DEBUG] [LOCAL ] ARES: Loaded 50486 existing records from primary storage. [2025-10-17T22:34:51.649410] [INFO ] [MAIN ] ARES: Loaded 50486 primary data records. [2025-10-17T22:34:52.209702] [DEBUG] [MAIN ] ARCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:52.211271] [INFO ] [MAIN ] ARCO: Generated 1820 derivative records from 45143 primary records. [2025-10-17T22:34:52.211943] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-10-17T22:34:52.230860] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1820 records). [2025-10-17T22:34:52.232252] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-10-17T22:34:52.235139] [INFO ] [MAIN ] Derivative Progress: 109/2083 symbols completed. ARCO took 1.2s. Estimated remaining: 12m 52s. Rate: 153.5 symbols/min [2025-10-17T22:34:52.235305] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:52.251507] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:52.252397] [INFO ] [MAIN ] ARDT: Generated 1820 derivative records from 28112 primary records. [2025-10-17T22:34:52.252572] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-17T22:34:52.273969] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1820 records). [2025-10-17T22:34:52.274298] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-17T22:34:52.284124] [INFO ] [MAIN ] Derivative Progress: 110/2083 symbols completed. ARDT took 1.1s. Estimated remaining: 12m 45s. Rate: 154.7 symbols/min [2025-10-17T22:34:52.289306] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:52.290070] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:52.290925] [INFO ] [MAIN ] ARES: Generated 1820 derivative records from 50486 primary records. [2025-10-17T22:34:52.291027] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-10-17T22:34:52.317300] [DEBUG] [LOCAL ] ARES: Derivative data saved (1820 records). [2025-10-17T22:34:52.317463] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-10-17T22:34:52.319887] [INFO ] [MAIN ] Derivative Progress: 111/2083 symbols completed. ARES took 1.2s. Estimated remaining: 12m 38s. Rate: 156.0 symbols/min [2025-10-17T22:34:52.320083] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:52.337076] [DEBUG] [LOCAL ] ARI: Loaded 44332 existing records from primary storage. [2025-10-17T22:34:52.337533] [INFO ] [MAIN ] ARI: Loaded 44332 primary data records. [2025-10-17T22:34:52.468908] [DEBUG] [LOCAL ] ARLO: Loaded 44394 existing records from primary storage. [2025-10-17T22:34:52.484923] [INFO ] [MAIN ] ARLO: Loaded 44394 primary data records. [2025-10-17T22:34:52.866845] [DEBUG] [LOCAL ] ARMK: Loaded 51136 existing records from primary storage. [2025-10-17T22:34:53.003071] [INFO ] [MAIN ] ARMK: Loaded 51136 primary data records. [2025-10-17T22:34:53.339571] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:53.341149] [INFO ] [MAIN ] ARI: Generated 1820 derivative records from 44332 primary records. [2025-10-17T22:34:53.342041] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-10-17T22:34:53.378566] [DEBUG] [LOCAL ] ARI: Derivative data saved (1820 records). [2025-10-17T22:34:53.378442] [DEBUG] [MAIN ] ARLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:53.378969] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-10-17T22:34:53.379787] [INFO ] [MAIN ] ARLO: Generated 1820 derivative records from 44394 primary records. [2025-10-17T22:34:53.381827] [INFO ] [MAIN ] Derivative Progress: 112/2083 symbols completed. ARI took 1.1s. Estimated remaining: 12m 50s. Rate: 153.6 symbols/min [2025-10-17T22:34:53.382589] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:53.383947] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-10-17T22:34:53.401305] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1820 records). [2025-10-17T22:34:53.401630] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-10-17T22:34:53.403681] [INFO ] [MAIN ] Derivative Progress: 113/2083 symbols completed. ARLO took 1.1s. Estimated remaining: 12m 43s. Rate: 154.9 symbols/min [2025-10-17T22:34:53.404309] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:53.422144] [DEBUG] [MAIN ] ARMK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:53.422940] [INFO ] [MAIN ] ARMK: Generated 1820 derivative records from 51136 primary records. [2025-10-17T22:34:53.423109] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-17T22:34:53.450760] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1820 records). [2025-10-17T22:34:53.450946] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-17T22:34:53.453276] [INFO ] [MAIN ] Derivative Progress: 114/2083 symbols completed. ARMK took 1.1s. Estimated remaining: 12m 37s. Rate: 156.1 symbols/min [2025-10-17T22:34:53.453618] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:53.469825] [DEBUG] [LOCAL ] AROC: Loaded 49789 existing records from primary storage. [2025-10-17T22:34:53.470091] [INFO ] [MAIN ] AROC: Loaded 49789 primary data records. [2025-10-17T22:34:53.689477] [DEBUG] [LOCAL ] ARR: Loaded 52880 existing records from primary storage. [2025-10-17T22:34:53.819546] [INFO ] [MAIN ] ARR: Loaded 52880 primary data records. [2025-10-17T22:34:53.820427] [DEBUG] [LOCAL ] ARW: Loaded 33602 existing records from primary storage. [2025-10-17T22:34:53.820696] [INFO ] [MAIN ] ARW: Loaded 33602 primary data records. [2025-10-17T22:34:54.503689] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:54.504732] [INFO ] [MAIN ] AROC: Generated 1820 derivative records from 49789 primary records. [2025-10-17T22:34:54.505041] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-10-17T22:34:54.526572] [DEBUG] [LOCAL ] AROC: Derivative data saved (1820 records). [2025-10-17T22:34:54.527114] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-10-17T22:34:54.529534] [INFO ] [MAIN ] Derivative Progress: 115/2083 symbols completed. AROC took 1.1s. Estimated remaining: 12m 48s. Rate: 153.7 symbols/min [2025-10-17T22:34:54.537941] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:54.543800] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:54.544456] [INFO ] [MAIN ] ARR: Generated 1820 derivative records from 52880 primary records. [2025-10-17T22:34:54.544673] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-10-17T22:34:54.562143] [DEBUG] [LOCAL ] ARR: Derivative data saved (1820 records). [2025-10-17T22:34:54.562463] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-10-17T22:34:54.564512] [INFO ] [MAIN ] Derivative Progress: 116/2083 symbols completed. ARR took 1.2s. Estimated remaining: 12m 42s. Rate: 154.9 symbols/min [2025-10-17T22:34:54.565795] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:54.582280] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:54.583105] [INFO ] [MAIN ] ARW: Generated 1820 derivative records from 33602 primary records. [2025-10-17T22:34:54.583205] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-17T22:34:54.599236] [DEBUG] [LOCAL ] ARW: Derivative data saved (1820 records). [2025-10-17T22:34:54.599530] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-17T22:34:54.601694] [INFO ] [MAIN ] Derivative Progress: 117/2083 symbols completed. ARW took 1.1s. Estimated remaining: 12m 36s. Rate: 156.1 symbols/min [2025-10-17T22:34:54.619833] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:54.628682] [DEBUG] [LOCAL ] ASA: Loaded 15654 existing records from primary storage. [2025-10-17T22:34:54.628909] [INFO ] [MAIN ] ASA: Loaded 15654 primary data records. [2025-10-17T22:34:54.762323] [DEBUG] [LOCAL ] AS: Loaded 53954 existing records from primary storage. [2025-10-17T22:34:54.796081] [INFO ] [MAIN ] AS: Loaded 53954 primary data records. [2025-10-17T22:34:55.097212] [DEBUG] [LOCAL ] ASAN: Loaded 53507 existing records from primary storage. [2025-10-17T22:34:55.124584] [INFO ] [MAIN ] ASAN: Loaded 53507 primary data records. [2025-10-17T22:34:55.634606] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:55.635717] [INFO ] [MAIN ] ASA: Generated 1820 derivative records from 15654 primary records. [2025-10-17T22:34:55.636235] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-17T22:34:55.655924] [DEBUG] [LOCAL ] ASA: Derivative data saved (1820 records). [2025-10-17T22:34:55.656326] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-17T22:34:55.658558] [INFO ] [MAIN ] Derivative Progress: 118/2083 symbols completed. ASA took 1.1s. Estimated remaining: 12m 47s. Rate: 153.8 symbols/min [2025-10-17T22:34:55.672041] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:55.672723] [INFO ] [MAIN ] AS: Generated 1820 derivative records from 53954 primary records. [2025-10-17T22:34:55.672872] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-17T22:34:55.691385] [DEBUG] [LOCAL ] AS: Derivative data saved (1820 records). [2025-10-17T22:34:55.691567] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-17T22:34:55.693782] [INFO ] [MAIN ] Derivative Progress: 119/2083 symbols completed. AS took 1.2s. Estimated remaining: 12m 40s. Rate: 155.0 symbols/min [2025-10-17T22:34:55.706197] [DEBUG] [MAIN ] ASAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:55.706766] [INFO ] [MAIN ] ASAN: Generated 1820 derivative records from 53507 primary records. [2025-10-17T22:34:55.706824] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-17T22:34:55.726575] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1820 records). [2025-10-17T22:34:55.726922] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-17T22:34:55.729581] [INFO ] [MAIN ] Derivative Progress: 120/2083 symbols completed. ASAN took 1.1s. Estimated remaining: 12m 34s. Rate: 156.2 symbols/min [2025-10-17T22:34:55.730071] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:55.730565] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:55.730175] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:55.737574] [DEBUG] [LOCAL ] ASBA: Loaded 3617 existing records from primary storage. [2025-10-17T22:34:55.737904] [INFO ] [MAIN ] ASBA: Loaded 3617 primary data records. [2025-10-17T22:34:55.847766] [DEBUG] [LOCAL ] ASG: Loaded 19812 existing records from primary storage. [2025-10-17T22:34:55.848122] [INFO ] [MAIN ] ASG: Loaded 19812 primary data records. [2025-10-17T22:34:56.165573] [DEBUG] [LOCAL ] ASC: Loaded 37898 existing records from primary storage. [2025-10-17T22:34:56.182732] [INFO ] [MAIN ] ASC: Loaded 37898 primary data records. [2025-10-17T22:34:56.722834] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:56.724109] [INFO ] [MAIN ] ASBA: Generated 1820 derivative records from 3617 primary records. [2025-10-17T22:34:56.724329] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-17T22:34:56.741982] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1820 records). [2025-10-17T22:34:56.742262] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-17T22:34:56.744586] [INFO ] [MAIN ] Derivative Progress: 121/2083 symbols completed. ASBA took 1.0s. Estimated remaining: 12m 44s. Rate: 154.1 symbols/min [2025-10-17T22:34:56.744858] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:56.758335] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:56.759010] [INFO ] [MAIN ] ASG: Generated 1820 derivative records from 19812 primary records. [2025-10-17T22:34:56.759159] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-17T22:34:56.775192] [DEBUG] [LOCAL ] ASG: Derivative data saved (1820 records). [2025-10-17T22:34:56.775480] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-10-17T22:34:56.777576] [INFO ] [MAIN ] Derivative Progress: 122/2083 symbols completed. ASG took 1.0s. Estimated remaining: 12m 38s. Rate: 155.2 symbols/min [2025-10-17T22:34:56.777766] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:56.793801] [DEBUG] [MAIN ] ASC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:56.800017] [INFO ] [MAIN ] ASC: Generated 1820 derivative records from 37898 primary records. [2025-10-17T22:34:56.800218] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-17T22:34:56.821342] [DEBUG] [LOCAL ] ASGI: Loaded 23311 existing records from primary storage. [2025-10-17T22:34:56.822679] [INFO ] [MAIN ] ASGI: Loaded 23311 primary data records. [2025-10-17T22:34:56.835944] [DEBUG] [LOCAL ] ASC: Derivative data saved (1820 records). [2025-10-17T22:34:56.860267] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-17T22:34:56.862378] [INFO ] [MAIN ] Derivative Progress: 123/2083 symbols completed. ASC took 1.1s. Estimated remaining: 12m 33s. Rate: 156.2 symbols/min [2025-10-17T22:34:56.877421] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:57.018998] [DEBUG] [LOCAL ] ASGN: Loaded 37201 existing records from primary storage. [2025-10-17T22:34:57.124471] [INFO ] [MAIN ] ASGN: Loaded 37201 primary data records. [2025-10-17T22:34:57.290206] [DEBUG] [LOCAL ] ASH: Loaded 38148 existing records from primary storage. [2025-10-17T22:34:57.308948] [INFO ] [MAIN ] ASH: Loaded 38148 primary data records. [2025-10-17T22:34:57.692969] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:57.816731] [INFO ] [MAIN ] ASGI: Generated 1820 derivative records from 23311 primary records. [2025-10-17T22:34:57.817554] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-10-17T22:34:57.836574] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1820 records). [2025-10-17T22:34:57.836778] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-10-17T22:34:57.839789] [INFO ] [MAIN ] Derivative Progress: 124/2083 symbols completed. ASGI took 1.1s. Estimated remaining: 12m 42s. Rate: 154.3 symbols/min [2025-10-17T22:34:57.840751] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:57.862176] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:57.862955] [INFO ] [MAIN ] ASGN: Generated 1820 derivative records from 37201 primary records. [2025-10-17T22:34:57.863293] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-17T22:34:57.885407] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1820 records). [2025-10-17T22:34:57.885729] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-17T22:34:57.887957] [INFO ] [MAIN ] Derivative Progress: 125/2083 symbols completed. ASGN took 1.1s. Estimated remaining: 12m 36s. Rate: 155.4 symbols/min [2025-10-17T22:34:57.890250] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:57.899587] [DEBUG] [LOCAL ] ASIX: Loaded 23435 existing records from primary storage. [2025-10-17T22:34:57.899980] [INFO ] [MAIN ] ASIX: Loaded 23435 primary data records. [2025-10-17T22:34:57.925255] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:57.945502] [INFO ] [MAIN ] ASH: Generated 1820 derivative records from 38148 primary records. [2025-10-17T22:34:57.950845] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-17T22:34:58.114680] [DEBUG] [LOCAL ] ASH: Derivative data saved (1820 records). [2025-10-17T22:34:58.254704] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-17T22:34:58.271159] [INFO ] [MAIN ] Derivative Progress: 126/2083 symbols completed. ASH took 1.4s. Estimated remaining: 12m 36s. Rate: 155.4 symbols/min [2025-10-17T22:34:58.271431] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:58.300041] [DEBUG] [LOCAL ] ASR: Loaded 9527 existing records from primary storage. [2025-10-17T22:34:58.314712] [INFO ] [MAIN ] ASR: Loaded 9527 primary data records. [2025-10-17T22:34:58.337214] [DEBUG] [LOCAL ] ASPN: Loaded 50648 existing records from primary storage. [2025-10-17T22:34:58.337458] [INFO ] [MAIN ] ASPN: Loaded 50648 primary data records. [2025-10-17T22:34:58.925611] [DEBUG] [MAIN ] ASIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:58.926502] [INFO ] [MAIN ] ASIX: Generated 1820 derivative records from 23435 primary records. [2025-10-17T22:34:58.926728] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-17T22:34:58.947571] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1820 records). [2025-10-17T22:34:58.948718] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-17T22:34:58.951507] [INFO ] [MAIN ] Derivative Progress: 127/2083 symbols completed. ASIX took 1.1s. Estimated remaining: 12m 40s. Rate: 154.5 symbols/min [2025-10-17T22:34:58.951725] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:58.986438] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:58.993006] [INFO ] [MAIN ] ASR: Generated 1820 derivative records from 9527 primary records. [2025-10-17T22:34:58.993171] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-10-17T22:34:58.992850] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:34:58.994710] [INFO ] [MAIN ] ASPN: Generated 1820 derivative records from 50648 primary records. [2025-10-17T22:34:59.001997] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-17T22:34:59.024024] [DEBUG] [LOCAL ] ASR: Derivative data saved (1820 records). [2025-10-17T22:34:59.031307] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-10-17T22:34:59.033423] [INFO ] [MAIN ] Derivative Progress: 128/2083 symbols completed. ASR took 0.8s. Estimated remaining: 12m 35s. Rate: 155.4 symbols/min [2025-10-17T22:34:59.037943] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:59.043465] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1820 records). [2025-10-17T22:34:59.044260] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-17T22:34:59.046764] [INFO ] [MAIN ] Derivative Progress: 129/2083 symbols completed. ASPN took 1.2s. Estimated remaining: 12m 29s. Rate: 156.6 symbols/min [2025-10-17T22:34:59.046923] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:34:59.064128] [DEBUG] [LOCAL ] ASX: Loaded 53653 existing records from primary storage. [2025-10-17T22:34:59.064755] [INFO ] [MAIN ] ASX: Loaded 53653 primary data records. [2025-10-17T22:34:59.203976] [DEBUG] [LOCAL ] ATEN: Loaded 38815 existing records from primary storage. [2025-10-17T22:34:59.210062] [INFO ] [MAIN ] ATEN: Loaded 38815 primary data records. [2025-10-17T22:34:59.353290] [DEBUG] [LOCAL ] ATGE: Loaded 31377 existing records from primary storage. [2025-10-17T22:34:59.362317] [INFO ] [MAIN ] ATGE: Loaded 31377 primary data records. [2025-10-17T22:35:00.108234] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:00.109423] [INFO ] [MAIN ] ASX: Generated 1820 derivative records from 53653 primary records. [2025-10-17T22:35:00.110412] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-17T22:35:00.140163] [DEBUG] [LOCAL ] ASX: Derivative data saved (1820 records). [2025-10-17T22:35:00.146264] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-17T22:35:00.146730] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:00.150033] [INFO ] [MAIN ] ATEN: Generated 1820 derivative records from 38815 primary records. [2025-10-17T22:35:00.148831] [INFO ] [MAIN ] Derivative Progress: 130/2083 symbols completed. ASX took 1.2s. Estimated remaining: 12m 39s. Rate: 154.4 symbols/min [2025-10-17T22:35:00.150227] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-17T22:35:00.151619] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:00.171419] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1820 records). [2025-10-17T22:35:00.171617] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-17T22:35:00.173943] [INFO ] [MAIN ] Derivative Progress: 131/2083 symbols completed. ATEN took 1.1s. Estimated remaining: 12m 33s. Rate: 155.5 symbols/min [2025-10-17T22:35:00.174130] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:00.181241] [DEBUG] [LOCAL ] ATHS: Loaded 6713 existing records from primary storage. [2025-10-17T22:35:00.181435] [INFO ] [MAIN ] ATHS: Loaded 6713 primary data records. [2025-10-17T22:35:00.261094] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:00.262003] [INFO ] [MAIN ] ATGE: Generated 1820 derivative records from 31377 primary records. [2025-10-17T22:35:00.262085] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-17T22:35:00.322405] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1820 records). [2025-10-17T22:35:00.322534] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-17T22:35:00.325718] [INFO ] [MAIN ] Derivative Progress: 132/2083 symbols completed. ATGE took 1.3s. Estimated remaining: 12m 29s. Rate: 156.2 symbols/min [2025-10-17T22:35:00.326579] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:00.587999] [DEBUG] [LOCAL ] ATI: Loaded 52088 existing records from primary storage. [2025-10-17T22:35:00.588297] [INFO ] [MAIN ] ATI: Loaded 52088 primary data records. [2025-10-17T22:35:00.588920] [DEBUG] [LOCAL ] ATKR: Loaded 35684 existing records from primary storage. [2025-10-17T22:35:00.622751] [INFO ] [MAIN ] ATKR: Loaded 35684 primary data records. [2025-10-17T22:35:01.238860] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:01.241214] [INFO ] [MAIN ] ATHS: Generated 1820 derivative records from 6713 primary records. [2025-10-17T22:35:01.241419] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-17T22:35:01.264172] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1820 records). [2025-10-17T22:35:01.264818] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-17T22:35:01.267045] [INFO ] [MAIN ] Derivative Progress: 133/2083 symbols completed. ATHS took 1.1s. Estimated remaining: 12m 37s. Rate: 154.5 symbols/min [2025-10-17T22:35:01.289230] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:01.291510] [INFO ] [MAIN ] ATI: Generated 1820 derivative records from 52088 primary records. [2025-10-17T22:35:01.292902] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-17T22:35:01.327505] [DEBUG] [LOCAL ] ATI: Derivative data saved (1820 records). [2025-10-17T22:35:01.322961] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:01.327945] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-10-17T22:35:01.328933] [INFO ] [MAIN ] ATKR: Generated 1820 derivative records from 35684 primary records. [2025-10-17T22:35:01.331488] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-17T22:35:01.331361] [INFO ] [MAIN ] Derivative Progress: 134/2083 symbols completed. ATI took 1.2s. Estimated remaining: 12m 32s. Rate: 155.5 symbols/min [2025-10-17T22:35:01.348961] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1820 records). [2025-10-17T22:35:01.349149] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-17T22:35:01.351570] [INFO ] [MAIN ] Derivative Progress: 135/2083 symbols completed. ATKR took 1.0s. Estimated remaining: 12m 26s. Rate: 156.6 symbols/min [2025-10-17T22:35:01.352384] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:01.352328] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:01.352213] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:01.451104] [DEBUG] [LOCAL ] ATR: Loaded 30974 existing records from primary storage. [2025-10-17T22:35:01.451541] [INFO ] [MAIN ] ATR: Loaded 30974 primary data records. [2025-10-17T22:35:01.604938] [DEBUG] [LOCAL ] ATMU: Loaded 39475 existing records from primary storage. [2025-10-17T22:35:01.606392] [INFO ] [MAIN ] ATMU: Loaded 39475 primary data records. [2025-10-17T22:35:01.618536] [DEBUG] [LOCAL ] ATO: Loaded 42359 existing records from primary storage. [2025-10-17T22:35:01.682036] [INFO ] [MAIN ] ATO: Loaded 42359 primary data records. [2025-10-17T22:35:02.574543] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:02.575693] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:02.576528] [INFO ] [MAIN ] ATMU: Generated 1820 derivative records from 39475 primary records. [2025-10-17T22:35:02.576773] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-17T22:35:02.577521] [INFO ] [MAIN ] ATR: Generated 1820 derivative records from 30974 primary records. [2025-10-17T22:35:02.578598] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-17T22:35:02.613969] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:02.616677] [INFO ] [MAIN ] ATO: Generated 1820 derivative records from 42359 primary records. [2025-10-17T22:35:02.625538] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1820 records). [2025-10-17T22:35:02.624418] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-17T22:35:02.626916] [DEBUG] [LOCAL ] ATR: Derivative data saved (1820 records). [2025-10-17T22:35:02.625665] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-10-17T22:35:02.629424] [INFO ] [MAIN ] Derivative Progress: 136/2083 symbols completed. ATMU took 1.3s. Estimated remaining: 12m 39s. Rate: 154.0 symbols/min [2025-10-17T22:35:02.627092] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-10-17T22:35:02.632703] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:02.633135] [INFO ] [MAIN ] Derivative Progress: 137/2083 symbols completed. ATR took 1.3s. Estimated remaining: 12m 33s. Rate: 155.1 symbols/min [2025-10-17T22:35:02.641104] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:02.656779] [DEBUG] [LOCAL ] AUNA: Loaded 5186 existing records from primary storage. [2025-10-17T22:35:02.653427] [DEBUG] [LOCAL ] ATO: Derivative data saved (1820 records). [2025-10-17T22:35:02.657072] [INFO ] [MAIN ] AUNA: Loaded 5186 primary data records. [2025-10-17T22:35:02.656986] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-10-17T22:35:02.660027] [INFO ] [MAIN ] Derivative Progress: 138/2083 symbols completed. ATO took 1.3s. Estimated remaining: 12m 27s. Rate: 156.1 symbols/min [2025-10-17T22:35:02.660454] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:03.004806] [DEBUG] [LOCAL ] AU: Loaded 53857 existing records from primary storage. [2025-10-17T22:35:03.015804] [INFO ] [MAIN ] AU: Loaded 53857 primary data records. [2025-10-17T22:35:03.038491] [DEBUG] [LOCAL ] AVA: Loaded 39279 existing records from primary storage. [2025-10-17T22:35:03.054188] [INFO ] [MAIN ] AVA: Loaded 39279 primary data records. [2025-10-17T22:35:03.661973] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:35:03.663904] [INFO ] [MAIN ] AUNA: Generated 1819 derivative records from 5186 primary records. [2025-10-17T22:35:03.664843] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-17T22:35:03.683001] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1819 records). [2025-10-17T22:35:03.683327] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-17T22:35:03.685746] [INFO ] [MAIN ] Derivative Progress: 139/2083 symbols completed. AUNA took 1.0s. Estimated remaining: 12m 36s. Rate: 154.3 symbols/min [2025-10-17T22:35:03.686149] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:03.717958] [DEBUG] [LOCAL ] AVAL: Loaded 8705 existing records from primary storage. [2025-10-17T22:35:03.718791] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:03.718208] [INFO ] [MAIN ] AVAL: Loaded 8705 primary data records. [2025-10-17T22:35:03.749966] [INFO ] [MAIN ] AU: Generated 1820 derivative records from 53857 primary records. [2025-10-17T22:35:03.770164] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-17T22:35:03.801539] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:03.820380] [INFO ] [MAIN ] AVA: Generated 1820 derivative records from 39279 primary records. [2025-10-17T22:35:03.849969] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-17T22:35:03.886265] [DEBUG] [LOCAL ] AU: Derivative data saved (1820 records). [2025-10-17T22:35:03.891498] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-10-17T22:35:03.924214] [INFO ] [MAIN ] Derivative Progress: 140/2083 symbols completed. AU took 1.3s. Estimated remaining: 12m 34s. Rate: 154.7 symbols/min [2025-10-17T22:35:03.924046] [DEBUG] [LOCAL ] AVA: Derivative data saved (1820 records). [2025-10-17T22:35:03.935633] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-17T22:35:03.952107] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:03.952695] [INFO ] [MAIN ] Derivative Progress: 141/2083 symbols completed. AVA took 1.3s. Estimated remaining: 12m 28s. Rate: 155.7 symbols/min [2025-10-17T22:35:03.971189] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:04.113441] [DEBUG] [LOCAL ] AVD: Loaded 22021 existing records from primary storage. [2025-10-17T22:35:04.113691] [INFO ] [MAIN ] AVD: Loaded 22021 primary data records. [2025-10-17T22:35:04.266237] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:04.293799] [INFO ] [MAIN ] AVAL: Generated 1820 derivative records from 8705 primary records. [2025-10-17T22:35:04.332047] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-10-17T22:35:04.491533] [DEBUG] [LOCAL ] AVB: Loaded 42866 existing records from primary storage. [2025-10-17T22:35:04.492240] [INFO ] [MAIN ] AVB: Loaded 42866 primary data records. [2025-10-17T22:35:04.544396] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1820 records). [2025-10-17T22:35:04.551198] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-10-17T22:35:04.575056] [INFO ] [MAIN ] Derivative Progress: 142/2083 symbols completed. AVAL took 0.9s. Estimated remaining: 12m 31s. Rate: 155.1 symbols/min [2025-10-17T22:35:04.609776] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:04.822991] [DEBUG] [LOCAL ] AVK: Loaded 18858 existing records from primary storage. [2025-10-17T22:35:04.823549] [INFO ] [MAIN ] AVK: Loaded 18858 primary data records. [2025-10-17T22:35:04.965769] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:04.987972] [INFO ] [MAIN ] AVD: Generated 1820 derivative records from 22021 primary records. [2025-10-17T22:35:04.998551] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-17T22:35:05.205686] [DEBUG] [LOCAL ] AVD: Derivative data saved (1820 records). [2025-10-17T22:35:05.206625] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-17T22:35:05.209256] [INFO ] [MAIN ] Derivative Progress: 143/2083 symbols completed. AVD took 1.2s. Estimated remaining: 12m 34s. Rate: 154.4 symbols/min [2025-10-17T22:35:05.217360] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:05.223415] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:05.224197] [INFO ] [MAIN ] AVB: Generated 1820 derivative records from 42866 primary records. [2025-10-17T22:35:05.225679] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-17T22:35:05.243545] [DEBUG] [LOCAL ] AVB: Derivative data saved (1820 records). [2025-10-17T22:35:05.243827] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-17T22:35:05.246180] [INFO ] [MAIN ] Derivative Progress: 144/2083 symbols completed. AVB took 1.3s. Estimated remaining: 12m 29s. Rate: 155.3 symbols/min [2025-10-17T22:35:05.246541] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:05.274279] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:05.275129] [INFO ] [MAIN ] AVK: Generated 1820 derivative records from 18858 primary records. [2025-10-17T22:35:05.275328] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-17T22:35:05.292168] [DEBUG] [LOCAL ] AVK: Derivative data saved (1820 records). [2025-10-17T22:35:05.292295] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-17T22:35:05.294679] [INFO ] [MAIN ] Derivative Progress: 145/2083 symbols completed. AVK took 0.7s. Estimated remaining: 12m 24s. Rate: 156.3 symbols/min [2025-10-17T22:35:05.305199] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:05.308078] [DEBUG] [LOCAL ] AVNS: Loaded 34111 existing records from primary storage. [2025-10-17T22:35:05.308233] [INFO ] [MAIN ] AVNS: Loaded 34111 primary data records. [2025-10-17T22:35:05.515996] [DEBUG] [LOCAL ] AVNT: Loaded 39562 existing records from primary storage. [2025-10-17T22:35:05.633715] [INFO ] [MAIN ] AVNT: Loaded 39562 primary data records. [2025-10-17T22:35:05.778779] [DEBUG] [LOCAL ] AVTR: Loaded 54352 existing records from primary storage. [2025-10-17T22:35:05.805438] [INFO ] [MAIN ] AVTR: Loaded 54352 primary data records. [2025-10-17T22:35:06.357915] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:06.360087] [INFO ] [MAIN ] AVNS: Generated 1820 derivative records from 34111 primary records. [2025-10-17T22:35:06.360158] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-17T22:35:06.379627] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1820 records). [2025-10-17T22:35:06.380160] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-17T22:35:06.382725] [INFO ] [MAIN ] Derivative Progress: 146/2083 symbols completed. AVNS took 1.2s. Estimated remaining: 12m 33s. Rate: 154.3 symbols/min [2025-10-17T22:35:06.383935] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:06.401819] [DEBUG] [MAIN ] AVNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:06.402553] [INFO ] [MAIN ] AVNT: Generated 1820 derivative records from 39562 primary records. [2025-10-17T22:35:06.402896] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-17T22:35:06.419095] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1820 records). [2025-10-17T22:35:06.419449] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-10-17T22:35:06.421509] [INFO ] [MAIN ] Derivative Progress: 147/2083 symbols completed. AVNT took 1.2s. Estimated remaining: 12m 28s. Rate: 155.3 symbols/min [2025-10-17T22:35:06.421773] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:06.444274] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:06.445050] [INFO ] [MAIN ] AVTR: Generated 1820 derivative records from 54352 primary records. [2025-10-17T22:35:06.445178] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-17T22:35:06.470293] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1820 records). [2025-10-17T22:35:06.470524] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-10-17T22:35:06.472813] [INFO ] [MAIN ] Derivative Progress: 148/2083 symbols completed. AVTR took 1.2s. Estimated remaining: 12m 23s. Rate: 156.2 symbols/min [2025-10-17T22:35:06.490796] [DEBUG] [LOCAL ] AVY: Loaded 38653 existing records from primary storage. [2025-10-17T22:35:06.498316] [INFO ] [MAIN ] AVY: Loaded 38653 primary data records. [2025-10-17T22:35:06.498853] [DEBUG] [LOCAL ] AWF: Loaded 24387 existing records from primary storage. [2025-10-17T22:35:06.540703] [INFO ] [MAIN ] AWF: Loaded 24387 primary data records. [2025-10-17T22:35:07.125942] [DEBUG] [MAIN ] AVY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:07.127003] [INFO ] [MAIN ] AVY: Generated 1820 derivative records from 38653 primary records. [2025-10-17T22:35:07.127304] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-10-17T22:35:07.148104] [DEBUG] [LOCAL ] AVY: Derivative data saved (1820 records). [2025-10-17T22:35:07.148409] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-10-17T22:35:07.151469] [INFO ] [MAIN ] Derivative Progress: 149/2083 symbols completed. AVY took 0.8s. Estimated remaining: 12m 27s. Rate: 155.4 symbols/min [2025-10-17T22:35:07.164014] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:07.164622] [INFO ] [MAIN ] AWF: Generated 1820 derivative records from 24387 primary records. [2025-10-17T22:35:07.164706] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-17T22:35:07.180420] [DEBUG] [LOCAL ] AWF: Derivative data saved (1820 records). [2025-10-17T22:35:07.180517] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-17T22:35:07.182502] [INFO ] [MAIN ] Derivative Progress: 150/2083 symbols completed. AWF took 0.8s. Estimated remaining: 12m 22s. Rate: 156.4 symbols/min [2025-10-17T22:35:07.183026] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:07.183197] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:07.183125] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:07.213834] [DEBUG] [LOCAL ] AWP: Loaded 21887 existing records from primary storage. [2025-10-17T22:35:07.213974] [INFO ] [MAIN ] AWP: Loaded 21887 primary data records. [2025-10-17T22:35:07.332782] [DEBUG] [LOCAL ] AWI: Loaded 25722 existing records from primary storage. [2025-10-17T22:35:07.337157] [INFO ] [MAIN ] AWI: Loaded 25722 primary data records. [2025-10-17T22:35:07.525346] [DEBUG] [LOCAL ] AWK: Loaded 49233 existing records from primary storage. [2025-10-17T22:35:07.542342] [INFO ] [MAIN ] AWK: Loaded 49233 primary data records. [2025-10-17T22:35:08.290975] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:08.290795] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:08.292014] [INFO ] [MAIN ] AWI: Generated 1820 derivative records from 25722 primary records. [2025-10-17T22:35:08.292238] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-17T22:35:08.293292] [INFO ] [MAIN ] AWP: Generated 1820 derivative records from 21887 primary records. [2025-10-17T22:35:08.293551] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-17T22:35:08.325436] [DEBUG] [LOCAL ] AWI: Derivative data saved (1820 records). [2025-10-17T22:35:08.327051] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-17T22:35:08.328055] [DEBUG] [LOCAL ] AWP: Derivative data saved (1820 records). [2025-10-17T22:35:08.330227] [INFO ] [MAIN ] Derivative Progress: 151/2083 symbols completed. AWI took 1.1s. Estimated remaining: 12m 31s. Rate: 154.3 symbols/min [2025-10-17T22:35:08.330372] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-17T22:35:08.332027] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:08.334896] [INFO ] [MAIN ] Derivative Progress: 152/2083 symbols completed. AWP took 1.2s. Estimated remaining: 12m 26s. Rate: 155.3 symbols/min [2025-10-17T22:35:08.335372] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:08.348639] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:08.349429] [INFO ] [MAIN ] AWK: Generated 1820 derivative records from 49233 primary records. [2025-10-17T22:35:08.349613] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-17T22:35:08.371724] [DEBUG] [LOCAL ] AWK: Derivative data saved (1820 records). [2025-10-17T22:35:08.371942] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-17T22:35:08.374820] [INFO ] [MAIN ] Derivative Progress: 153/2083 symbols completed. AWK took 1.2s. Estimated remaining: 12m 21s. Rate: 156.3 symbols/min [2025-10-17T22:35:08.375071] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:08.384840] [DEBUG] [LOCAL ] AWR: Loaded 23114 existing records from primary storage. [2025-10-17T22:35:08.385001] [INFO ] [MAIN ] AWR: Loaded 23114 primary data records. [2025-10-17T22:35:08.729331] [DEBUG] [LOCAL ] AXL: Loaded 51268 existing records from primary storage. [2025-10-17T22:35:08.744457] [INFO ] [MAIN ] AXL: Loaded 51268 primary data records. [2025-10-17T22:35:08.871838] [DEBUG] [LOCAL ] AXP: Loaded 53945 existing records from primary storage. [2025-10-17T22:35:08.908842] [INFO ] [MAIN ] AXP: Loaded 53945 primary data records. [2025-10-17T22:35:09.395512] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:09.397492] [INFO ] [MAIN ] AWR: Generated 1820 derivative records from 23114 primary records. [2025-10-17T22:35:09.397564] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-17T22:35:09.418536] [DEBUG] [LOCAL ] AWR: Derivative data saved (1820 records). [2025-10-17T22:35:09.419820] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-17T22:35:09.422184] [INFO ] [MAIN ] Derivative Progress: 154/2083 symbols completed. AWR took 1.1s. Estimated remaining: 12m 29s. Rate: 154.5 symbols/min [2025-10-17T22:35:09.422790] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:09.441271] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:09.442170] [INFO ] [MAIN ] AXL: Generated 1820 derivative records from 51268 primary records. [2025-10-17T22:35:09.445331] [DEBUG] [LOCAL ] AXR: Loaded 2975 existing records from primary storage. [2025-10-17T22:35:09.442493] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-17T22:35:09.445894] [INFO ] [MAIN ] AXR: Loaded 2975 primary data records. [2025-10-17T22:35:09.540705] [DEBUG] [LOCAL ] AXL: Derivative data saved (1820 records). [2025-10-17T22:35:09.551444] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-17T22:35:09.585476] [INFO ] [MAIN ] Derivative Progress: 155/2083 symbols completed. AXL took 1.3s. Estimated remaining: 12m 26s. Rate: 155.1 symbols/min [2025-10-17T22:35:09.592473] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:09.604465] [INFO ] [MAIN ] AXP: Generated 1820 derivative records from 53945 primary records. [2025-10-17T22:35:09.592697] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:09.614979] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-17T22:35:09.839505] [DEBUG] [LOCAL ] AXP: Derivative data saved (1820 records). [2025-10-17T22:35:09.839694] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-17T22:35:09.841933] [INFO ] [MAIN ] Derivative Progress: 156/2083 symbols completed. AXP took 1.5s. Estimated remaining: 12m 24s. Rate: 155.4 symbols/min [2025-10-17T22:35:09.842673] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:09.876512] [DEBUG] [LOCAL ] AXS: Loaded 39196 existing records from primary storage. [2025-10-17T22:35:09.877514] [INFO ] [MAIN ] AXS: Loaded 39196 primary data records. [2025-10-17T22:35:09.946863] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:09.987996] [INFO ] [MAIN ] AXR: Generated 1820 derivative records from 2975 primary records. [2025-10-17T22:35:10.010691] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-10-17T22:35:10.233760] [DEBUG] [LOCAL ] AXR: Derivative data saved (1820 records). [2025-10-17T22:35:10.239106] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-10-17T22:35:10.249238] [INFO ] [MAIN ] Derivative Progress: 157/2083 symbols completed. AXR took 0.8s. Estimated remaining: 12m 24s. Rate: 155.4 symbols/min [2025-10-17T22:35:10.252313] [DEBUG] [LOCAL ] AXTA: Loaded 53031 existing records from primary storage. [2025-10-17T22:35:10.252942] [INFO ] [MAIN ] AXTA: Loaded 53031 primary data records. [2025-10-17T22:35:10.252583] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:10.660236] [DEBUG] [LOCAL ] AYI: Loaded 25175 existing records from primary storage. [2025-10-17T22:35:10.662246] [INFO ] [MAIN ] AYI: Loaded 25175 primary data records. [2025-10-17T22:35:10.795167] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:10.840140] [INFO ] [MAIN ] AXS: Generated 1820 derivative records from 39196 primary records. [2025-10-17T22:35:10.963427] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-17T22:35:10.996808] [DEBUG] [LOCAL ] AXS: Derivative data saved (1820 records). [2025-10-17T22:35:10.997179] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-10-17T22:35:10.999613] [INFO ] [MAIN ] Derivative Progress: 158/2083 symbols completed. AXS took 1.4s. Estimated remaining: 12m 28s. Rate: 154.5 symbols/min [2025-10-17T22:35:11.000512] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:11.019009] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:11.020101] [INFO ] [MAIN ] AXTA: Generated 1820 derivative records from 53031 primary records. [2025-10-17T22:35:11.022950] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-17T22:35:11.047573] [DEBUG] [LOCAL ] AZO: Loaded 11148 existing records from primary storage. [2025-10-17T22:35:11.051172] [INFO ] [MAIN ] AZO: Loaded 11148 primary data records. [2025-10-17T22:35:11.089165] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1820 records). [2025-10-17T22:35:11.113686] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-17T22:35:11.123494] [INFO ] [MAIN ] Derivative Progress: 159/2083 symbols completed. AXTA took 1.3s. Estimated remaining: 12m 24s. Rate: 155.1 symbols/min [2025-10-17T22:35:11.137847] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:11.151330] [INFO ] [MAIN ] AYI: Generated 1820 derivative records from 25175 primary records. [2025-10-17T22:35:11.162777] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:11.174090] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-10-17T22:35:11.396738] [DEBUG] [LOCAL ] AYI: Derivative data saved (1820 records). [2025-10-17T22:35:11.396904] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-10-17T22:35:11.399745] [INFO ] [MAIN ] Derivative Progress: 160/2083 symbols completed. AYI took 1.1s. Estimated remaining: 12m 22s. Rate: 155.4 symbols/min [2025-10-17T22:35:11.400759] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:11.412023] [DEBUG] [LOCAL ] AZZ: Loaded 23075 existing records from primary storage. [2025-10-17T22:35:11.412286] [INFO ] [MAIN ] AZZ: Loaded 23075 primary data records. [2025-10-17T22:35:11.752461] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:11.753237] [INFO ] [MAIN ] AZO: Generated 1820 derivative records from 11148 primary records. [2025-10-17T22:35:11.753866] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-17T22:35:11.772636] [DEBUG] [LOCAL ] AZO: Derivative data saved (1820 records). [2025-10-17T22:35:11.773067] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-17T22:35:11.789797] [INFO ] [MAIN ] Derivative Progress: 161/2083 symbols completed. AZO took 0.8s. Estimated remaining: 12m 22s. Rate: 155.4 symbols/min [2025-10-17T22:35:11.790107] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:11.792199] [DEBUG] [LOCAL ] BA: Loaded 54570 existing records from primary storage. [2025-10-17T22:35:11.792321] [INFO ] [MAIN ] BA: Loaded 54570 primary data records. [2025-10-17T22:35:12.128305] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:12.129528] [INFO ] [MAIN ] AZZ: Generated 1820 derivative records from 23075 primary records. [2025-10-17T22:35:12.129708] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-17T22:35:12.162517] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-10-17T22:35:12.164397] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1820 records). [2025-10-17T22:35:12.164677] [INFO ] [MAIN ] BABA: Loaded 54600 primary data records. [2025-10-17T22:35:12.164618] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-17T22:35:12.167230] [INFO ] [MAIN ] Derivative Progress: 162/2083 symbols completed. AZZ took 1.0s. Estimated remaining: 12m 22s. Rate: 155.4 symbols/min [2025-10-17T22:35:12.167392] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:12.551520] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:12.552298] [INFO ] [MAIN ] BA: Generated 1820 derivative records from 54570 primary records. [2025-10-17T22:35:12.552461] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-17T22:35:12.570718] [DEBUG] [LOCAL ] BA: Derivative data saved (1820 records). [2025-10-17T22:35:12.585634] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-17T22:35:12.588169] [INFO ] [MAIN ] Derivative Progress: 163/2083 symbols completed. BA took 1.2s. Estimated remaining: 12m 22s. Rate: 155.3 symbols/min [2025-10-17T22:35:12.590314] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-10-17T22:35:12.590423] [INFO ] [MAIN ] BAC: Loaded 54588 primary data records. [2025-10-17T22:35:12.900510] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:12.901218] [INFO ] [MAIN ] BABA: Generated 1820 derivative records from 54600 primary records. [2025-10-17T22:35:12.901441] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-17T22:35:12.920388] [DEBUG] [LOCAL ] BABA: Derivative data saved (1820 records). [2025-10-17T22:35:12.920492] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-17T22:35:12.923313] [INFO ] [MAIN ] Derivative Progress: 164/2083 symbols completed. BABA took 1.1s. Estimated remaining: 12m 21s. Rate: 155.5 symbols/min [2025-10-17T22:35:12.943336] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:12.944065] [INFO ] [MAIN ] BAC: Generated 1820 derivative records from 54588 primary records. [2025-10-17T22:35:12.944129] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-17T22:35:12.960950] [DEBUG] [LOCAL ] BAC: Derivative data saved (1820 records). [2025-10-17T22:35:12.961036] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-10-17T22:35:12.963622] [INFO ] [MAIN ] Derivative Progress: 165/2083 symbols completed. BAC took 0.8s. Estimated remaining: 12m 16s. Rate: 156.3 symbols/min [2025-10-17T22:35:12.964240] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:12.964365] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:12.964870] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:13.040279] [DEBUG] [LOCAL ] BAK: Loaded 39871 existing records from primary storage. [2025-10-17T22:35:13.041164] [INFO ] [MAIN ] BAK: Loaded 39871 primary data records. [2025-10-17T22:35:13.129494] [DEBUG] [LOCAL ] BALL: Loaded 52656 existing records from primary storage. [2025-10-17T22:35:13.139971] [INFO ] [MAIN ] BALL: Loaded 52656 primary data records. [2025-10-17T22:35:13.249891] [DEBUG] [LOCAL ] BAH: Loaded 52467 existing records from primary storage. [2025-10-17T22:35:13.275383] [INFO ] [MAIN ] BAH: Loaded 52467 primary data records. [2025-10-17T22:35:14.045965] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:14.046720] [INFO ] [MAIN ] BAK: Generated 1820 derivative records from 39871 primary records. [2025-10-17T22:35:14.046883] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-17T22:35:14.063997] [DEBUG] [LOCAL ] BAK: Derivative data saved (1820 records). [2025-10-17T22:35:14.067815] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-17T22:35:14.082318] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:14.081900] [INFO ] [MAIN ] Derivative Progress: 166/2083 symbols completed. BAK took 1.1s. Estimated remaining: 12m 24s. Rate: 154.5 symbols/min [2025-10-17T22:35:14.095104] [INFO ] [MAIN ] BAH: Generated 1820 derivative records from 52467 primary records. [2025-10-17T22:35:14.095381] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:14.095974] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:14.096940] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-10-17T22:35:14.096897] [INFO ] [MAIN ] BALL: Generated 1820 derivative records from 52656 primary records. [2025-10-17T22:35:14.097585] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-17T22:35:14.128278] [DEBUG] [LOCAL ] BAH: Derivative data saved (1820 records). [2025-10-17T22:35:14.129547] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-10-17T22:35:14.129439] [DEBUG] [LOCAL ] BALL: Derivative data saved (1820 records). [2025-10-17T22:35:14.133386] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-17T22:35:14.133223] [INFO ] [MAIN ] Derivative Progress: 167/2083 symbols completed. BAH took 1.2s. Estimated remaining: 12m 20s. Rate: 155.3 symbols/min [2025-10-17T22:35:14.136040] [INFO ] [MAIN ] Derivative Progress: 168/2083 symbols completed. BALL took 1.2s. Estimated remaining: 12m 15s. Rate: 156.3 symbols/min [2025-10-17T22:35:14.135846] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:14.136587] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:14.189885] [DEBUG] [LOCAL ] BAM: Loaded 52877 existing records from primary storage. [2025-10-17T22:35:14.190126] [INFO ] [MAIN ] BAM: Loaded 52877 primary data records. [2025-10-17T22:35:14.190615] [DEBUG] [LOCAL ] BAP: Loaded 26192 existing records from primary storage. [2025-10-17T22:35:14.242346] [INFO ] [MAIN ] BAP: Loaded 26192 primary data records. [2025-10-17T22:35:14.406718] [DEBUG] [LOCAL ] BARK: Loaded 38766 existing records from primary storage. [2025-10-17T22:35:14.468499] [INFO ] [MAIN ] BARK: Loaded 38766 primary data records. [2025-10-17T22:35:15.162668] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:15.165442] [INFO ] [MAIN ] BAM: Generated 1820 derivative records from 52877 primary records. [2025-10-17T22:35:15.165683] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-17T22:35:15.180210] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:15.193886] [INFO ] [MAIN ] BAP: Generated 1820 derivative records from 26192 primary records. [2025-10-17T22:35:15.194169] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-17T22:35:15.213168] [DEBUG] [LOCAL ] BAP: Derivative data saved (1820 records). [2025-10-17T22:35:15.216102] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-17T22:35:15.216004] [DEBUG] [LOCAL ] BAM: Derivative data saved (1820 records). [2025-10-17T22:35:15.218885] [INFO ] [MAIN ] Derivative Progress: 169/2083 symbols completed. BAP took 1.1s. Estimated remaining: 12m 23s. Rate: 154.6 symbols/min [2025-10-17T22:35:15.219967] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-17T22:35:15.220135] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:15.222263] [INFO ] [MAIN ] Derivative Progress: 170/2083 symbols completed. BAM took 1.1s. Estimated remaining: 12m 18s. Rate: 155.5 symbols/min [2025-10-17T22:35:15.235348] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:15.236197] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:15.237030] [INFO ] [MAIN ] BARK: Generated 1820 derivative records from 38766 primary records. [2025-10-17T22:35:15.237173] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-17T22:35:15.254408] [DEBUG] [LOCAL ] BARK: Derivative data saved (1820 records). [2025-10-17T22:35:15.254603] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-17T22:35:15.256769] [INFO ] [MAIN ] Derivative Progress: 171/2083 symbols completed. BARK took 1.1s. Estimated remaining: 12m 14s. Rate: 156.3 symbols/min [2025-10-17T22:35:15.257126] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:15.314941] [DEBUG] [LOCAL ] BAX: Loaded 54309 existing records from primary storage. [2025-10-17T22:35:15.315186] [INFO ] [MAIN ] BAX: Loaded 54309 primary data records. [2025-10-17T22:35:15.447906] [DEBUG] [LOCAL ] BB: Loaded 53673 existing records from primary storage. [2025-10-17T22:35:15.451261] [INFO ] [MAIN ] BB: Loaded 53673 primary data records. [2025-10-17T22:35:15.759612] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-10-17T22:35:15.772936] [INFO ] [MAIN ] BBAI: Loaded 54600 primary data records. [2025-10-17T22:35:16.316909] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:16.318604] [INFO ] [MAIN ] BAX: Generated 1820 derivative records from 54309 primary records. [2025-10-17T22:35:16.318937] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-17T22:35:16.338473] [DEBUG] [LOCAL ] BAX: Derivative data saved (1820 records). [2025-10-17T22:35:16.338943] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-17T22:35:16.352822] [INFO ] [MAIN ] Derivative Progress: 172/2083 symbols completed. BAX took 1.1s. Estimated remaining: 12m 21s. Rate: 154.7 symbols/min [2025-10-17T22:35:16.353109] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:16.354484] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:16.355541] [INFO ] [MAIN ] BB: Generated 1820 derivative records from 53673 primary records. [2025-10-17T22:35:16.355744] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-17T22:35:16.374198] [DEBUG] [LOCAL ] BB: Derivative data saved (1820 records). [2025-10-17T22:35:16.375274] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-17T22:35:16.377448] [INFO ] [MAIN ] Derivative Progress: 173/2083 symbols completed. BB took 1.1s. Estimated remaining: 12m 17s. Rate: 155.5 symbols/min [2025-10-17T22:35:16.379281] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:16.393077] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:16.393769] [INFO ] [MAIN ] BBAI: Generated 1820 derivative records from 54600 primary records. [2025-10-17T22:35:16.393847] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-17T22:35:16.409812] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1820 records). [2025-10-17T22:35:16.419689] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-17T22:35:16.422744] [INFO ] [MAIN ] Derivative Progress: 174/2083 symbols completed. BBAI took 1.2s. Estimated remaining: 12m 13s. Rate: 156.3 symbols/min [2025-10-17T22:35:16.423038] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:16.441141] [DEBUG] [LOCAL ] BBAR: Loaded 42985 existing records from primary storage. [2025-10-17T22:35:16.441452] [INFO ] [MAIN ] BBAR: Loaded 42985 primary data records. [2025-10-17T22:35:16.636985] [DEBUG] [LOCAL ] BBDC: Loaded 33616 existing records from primary storage. [2025-10-17T22:35:16.672184] [INFO ] [MAIN ] BBDC: Loaded 33616 primary data records. [2025-10-17T22:35:16.741857] [DEBUG] [LOCAL ] BBD: Loaded 54039 existing records from primary storage. [2025-10-17T22:35:16.822586] [INFO ] [MAIN ] BBD: Loaded 54039 primary data records. [2025-10-17T22:35:17.439972] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:17.441373] [INFO ] [MAIN ] BBAR: Generated 1820 derivative records from 42985 primary records. [2025-10-17T22:35:17.441627] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-17T22:35:17.460044] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1820 records). [2025-10-17T22:35:17.460432] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-17T22:35:17.462348] [INFO ] [MAIN ] Derivative Progress: 175/2083 symbols completed. BBAR took 1.1s. Estimated remaining: 12m 20s. Rate: 154.8 symbols/min [2025-10-17T22:35:17.462907] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:17.486016] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:17.486269] [DEBUG] [LOCAL ] BBDO: Loaded 5104 existing records from primary storage. [2025-10-17T22:35:17.487978] [INFO ] [MAIN ] BBDC: Generated 1820 derivative records from 33616 primary records. [2025-10-17T22:35:17.488177] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-17T22:35:17.488262] [INFO ] [MAIN ] BBDO: Loaded 5104 primary data records. [2025-10-17T22:35:17.588778] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:17.583011] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1820 records). [2025-10-17T22:35:17.600445] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-17T22:35:17.607798] [INFO ] [MAIN ] Derivative Progress: 176/2083 symbols completed. BBDC took 1.2s. Estimated remaining: 12m 17s. Rate: 155.3 symbols/min [2025-10-17T22:35:17.608835] [INFO ] [MAIN ] BBD: Generated 1820 derivative records from 54039 primary records. [2025-10-17T22:35:17.614792] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:17.622503] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-17T22:35:17.723533] [DEBUG] [LOCAL ] BBD: Derivative data saved (1820 records). [2025-10-17T22:35:17.825334] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-10-17T22:35:17.841002] [INFO ] [MAIN ] Derivative Progress: 177/2083 symbols completed. BBD took 1.5s. Estimated remaining: 12m 15s. Rate: 155.7 symbols/min [2025-10-17T22:35:17.841542] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:17.858500] [DEBUG] [LOCAL ] BBN: Loaded 18233 existing records from primary storage. [2025-10-17T22:35:17.859087] [INFO ] [MAIN ] BBN: Loaded 18233 primary data records. [2025-10-17T22:35:17.874534] [DEBUG] [LOCAL ] BBU: Loaded 5708 existing records from primary storage. [2025-10-17T22:35:17.912808] [INFO ] [MAIN ] BBU: Loaded 5708 primary data records. [2025-10-17T22:35:18.552980] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:18.555898] [INFO ] [MAIN ] BBDO: Generated 1820 derivative records from 5104 primary records. [2025-10-17T22:35:18.556343] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-10-17T22:35:18.573884] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1820 records). [2025-10-17T22:35:18.573997] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-10-17T22:35:18.576058] [INFO ] [MAIN ] Derivative Progress: 178/2083 symbols completed. BBDO took 1.1s. Estimated remaining: 12m 18s. Rate: 154.9 symbols/min [2025-10-17T22:35:18.604527] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:18.605484] [INFO ] [MAIN ] BBU: Generated 1820 derivative records from 5708 primary records. [2025-10-17T22:35:18.605669] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-10-17T22:35:18.627051] [DEBUG] [MAIN ] BBN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:18.636337] [DEBUG] [LOCAL ] BBU: Derivative data saved (1820 records). [2025-10-17T22:35:18.635578] [INFO ] [MAIN ] BBN: Generated 1820 derivative records from 18233 primary records. [2025-10-17T22:35:18.636552] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-10-17T22:35:18.636675] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-10-17T22:35:18.639346] [INFO ] [MAIN ] Derivative Progress: 179/2083 symbols completed. BBU took 0.8s. Estimated remaining: 12m 14s. Rate: 155.6 symbols/min [2025-10-17T22:35:18.655340] [DEBUG] [LOCAL ] BBN: Derivative data saved (1820 records). [2025-10-17T22:35:18.655431] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-10-17T22:35:18.657619] [INFO ] [MAIN ] Derivative Progress: 180/2083 symbols completed. BBN took 1.0s. Estimated remaining: 12m 10s. Rate: 156.5 symbols/min [2025-10-17T22:35:18.658122] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:18.658189] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:18.658375] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:18.681943] [DEBUG] [LOCAL ] BBUC: Loaded 14077 existing records from primary storage. [2025-10-17T22:35:18.682492] [INFO ] [MAIN ] BBUC: Loaded 14077 primary data records. [2025-10-17T22:35:18.814291] [DEBUG] [LOCAL ] BBW: Loaded 27830 existing records from primary storage. [2025-10-17T22:35:18.814882] [INFO ] [MAIN ] BBW: Loaded 27830 primary data records. [2025-10-17T22:35:18.967967] [DEBUG] [LOCAL ] BBVA: Loaded 49862 existing records from primary storage. [2025-10-17T22:35:19.108242] [INFO ] [MAIN ] BBVA: Loaded 49862 primary data records. [2025-10-17T22:35:19.676276] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:19.677303] [INFO ] [MAIN ] BBUC: Generated 1820 derivative records from 14077 primary records. [2025-10-17T22:35:19.677612] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-10-17T22:35:19.698613] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1820 records). [2025-10-17T22:35:19.699858] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-10-17T22:35:19.702758] [INFO ] [MAIN ] Derivative Progress: 181/2083 symbols completed. BBUC took 1.0s. Estimated remaining: 12m 16s. Rate: 155.0 symbols/min [2025-10-17T22:35:19.703577] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:19.732967] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:19.734584] [INFO ] [MAIN ] BBW: Generated 1820 derivative records from 27830 primary records. [2025-10-17T22:35:19.733569] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:19.734701] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-17T22:35:19.736696] [INFO ] [MAIN ] BBVA: Generated 1820 derivative records from 49862 primary records. [2025-10-17T22:35:19.745725] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-17T22:35:19.754608] [DEBUG] [LOCAL ] BBW: Derivative data saved (1820 records). [2025-10-17T22:35:19.755063] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-17T22:35:19.757382] [INFO ] [MAIN ] Derivative Progress: 182/2083 symbols completed. BBW took 1.1s. Estimated remaining: 12m 13s. Rate: 155.7 symbols/min [2025-10-17T22:35:19.764924] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:19.774007] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1820 records). [2025-10-17T22:35:19.774276] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-17T22:35:19.776410] [INFO ] [MAIN ] Derivative Progress: 183/2083 symbols completed. BBVA took 1.1s. Estimated remaining: 12m 8s. Rate: 156.5 symbols/min [2025-10-17T22:35:19.776790] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:19.823501] [DEBUG] [LOCAL ] BBY: Loaded 54218 existing records from primary storage. [2025-10-17T22:35:19.823754] [INFO ] [MAIN ] BBY: Loaded 54218 primary data records. [2025-10-17T22:35:19.956511] [DEBUG] [LOCAL ] BCAT: Loaded 34802 existing records from primary storage. [2025-10-17T22:35:19.962384] [INFO ] [MAIN ] BCAT: Loaded 34802 primary data records. [2025-10-17T22:35:19.973241] [DEBUG] [LOCAL ] BC: Loaded 44654 existing records from primary storage. [2025-10-17T22:35:20.049522] [INFO ] [MAIN ] BC: Loaded 44654 primary data records. [2025-10-17T22:35:20.846193] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:20.847712] [INFO ] [MAIN ] BBY: Generated 1820 derivative records from 54218 primary records. [2025-10-17T22:35:20.847814] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-17T22:35:20.868063] [DEBUG] [LOCAL ] BBY: Derivative data saved (1820 records). [2025-10-17T22:35:20.869164] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-17T22:35:20.872093] [INFO ] [MAIN ] Derivative Progress: 184/2083 symbols completed. BBY took 1.2s. Estimated remaining: 12m 15s. Rate: 155.0 symbols/min [2025-10-17T22:35:20.873405] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:20.889150] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:20.898010] [INFO ] [MAIN ] BCAT: Generated 1820 derivative records from 34802 primary records. [2025-10-17T22:35:20.903320] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-17T22:35:20.903774] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:20.905668] [INFO ] [MAIN ] BC: Generated 1820 derivative records from 44654 primary records. [2025-10-17T22:35:20.914039] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-17T22:35:20.921801] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1820 records). [2025-10-17T22:35:20.929270] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-17T22:35:20.932107] [INFO ] [MAIN ] Derivative Progress: 185/2083 symbols completed. BCAT took 1.2s. Estimated remaining: 12m 12s. Rate: 155.7 symbols/min [2025-10-17T22:35:20.936521] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:20.941582] [DEBUG] [LOCAL ] BC: Derivative data saved (1820 records). [2025-10-17T22:35:20.941814] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-17T22:35:20.943911] [INFO ] [MAIN ] Derivative Progress: 186/2083 symbols completed. BC took 1.2s. Estimated remaining: 12m 7s. Rate: 156.5 symbols/min [2025-10-17T22:35:20.944302] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:20.985068] [DEBUG] [LOCAL ] BCE: Loaded 53022 existing records from primary storage. [2025-10-17T22:35:20.985266] [INFO ] [MAIN ] BCE: Loaded 53022 primary data records. [2025-10-17T22:35:21.035595] [DEBUG] [LOCAL ] BCH: Loaded 30818 existing records from primary storage. [2025-10-17T22:35:21.069699] [INFO ] [MAIN ] BCH: Loaded 30818 primary data records. [2025-10-17T22:35:21.488783] [DEBUG] [LOCAL ] BCS: Loaded 54222 existing records from primary storage. [2025-10-17T22:35:21.519415] [INFO ] [MAIN ] BCS: Loaded 54222 primary data records. [2025-10-17T22:35:22.005923] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:22.008576] [INFO ] [MAIN ] BCE: Generated 1820 derivative records from 53022 primary records. [2025-10-17T22:35:22.008709] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-17T22:35:22.035992] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:22.040724] [INFO ] [MAIN ] BCH: Generated 1820 derivative records from 30818 primary records. [2025-10-17T22:35:22.040981] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-17T22:35:22.039880] [DEBUG] [LOCAL ] BCE: Derivative data saved (1820 records). [2025-10-17T22:35:22.042388] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-17T22:35:22.052064] [INFO ] [MAIN ] Derivative Progress: 187/2083 symbols completed. BCE took 1.2s. Estimated remaining: 12m 14s. Rate: 154.9 symbols/min [2025-10-17T22:35:22.058093] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:22.076328] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:22.078005] [INFO ] [MAIN ] BCS: Generated 1820 derivative records from 54222 primary records. [2025-10-17T22:35:22.078568] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-17T22:35:22.079581] [DEBUG] [LOCAL ] BCH: Derivative data saved (1820 records). [2025-10-17T22:35:22.080088] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-10-17T22:35:22.082470] [INFO ] [MAIN ] Derivative Progress: 188/2083 symbols completed. BCH took 1.1s. Estimated remaining: 12m 10s. Rate: 155.7 symbols/min [2025-10-17T22:35:22.083279] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:22.108007] [DEBUG] [LOCAL ] BCS: Derivative data saved (1820 records). [2025-10-17T22:35:22.108241] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-10-17T22:35:22.110551] [INFO ] [MAIN ] Derivative Progress: 189/2083 symbols completed. BCS took 1.2s. Estimated remaining: 12m 6s. Rate: 156.5 symbols/min [2025-10-17T22:35:22.110889] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:22.121602] [DEBUG] [LOCAL ] BCSF: Loaded 28764 existing records from primary storage. [2025-10-17T22:35:22.121786] [INFO ] [MAIN ] BCSF: Loaded 28764 primary data records. [2025-10-17T22:35:22.239862] [DEBUG] [LOCAL ] BCX: Loaded 22404 existing records from primary storage. [2025-10-17T22:35:22.257973] [INFO ] [MAIN ] BCX: Loaded 22404 primary data records. [2025-10-17T22:35:22.411955] [DEBUG] [LOCAL ] BDC: Loaded 24777 existing records from primary storage. [2025-10-17T22:35:22.516220] [INFO ] [MAIN ] BDC: Loaded 24777 primary data records. [2025-10-17T22:35:23.130885] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:23.132598] [INFO ] [MAIN ] BCSF: Generated 1820 derivative records from 28764 primary records. [2025-10-17T22:35:23.133786] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-17T22:35:23.155268] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:23.161469] [INFO ] [MAIN ] BCX: Generated 1820 derivative records from 22404 primary records. [2025-10-17T22:35:23.162396] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-17T22:35:23.166046] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1820 records). [2025-10-17T22:35:23.166284] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-17T22:35:23.179327] [INFO ] [MAIN ] Derivative Progress: 190/2083 symbols completed. BCSF took 1.1s. Estimated remaining: 12m 13s. Rate: 155.0 symbols/min [2025-10-17T22:35:23.179710] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:23.184879] [DEBUG] [LOCAL ] BCX: Derivative data saved (1820 records). [2025-10-17T22:35:23.184974] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-10-17T22:35:23.187246] [INFO ] [MAIN ] Derivative Progress: 191/2083 symbols completed. BCX took 1.1s. Estimated remaining: 12m 9s. Rate: 155.8 symbols/min [2025-10-17T22:35:23.187471] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:23.204512] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:23.205444] [INFO ] [MAIN ] BDC: Generated 1820 derivative records from 24777 primary records. [2025-10-17T22:35:23.205554] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-17T22:35:23.245133] [DEBUG] [LOCAL ] BDC: Derivative data saved (1820 records). [2025-10-17T22:35:23.245293] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-17T22:35:23.247412] [INFO ] [MAIN ] Derivative Progress: 192/2083 symbols completed. BDC took 1.1s. Estimated remaining: 12m 5s. Rate: 156.5 symbols/min [2025-10-17T22:35:23.247711] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:23.259875] [DEBUG] [LOCAL ] BDJ: Loaded 29832 existing records from primary storage. [2025-10-17T22:35:23.260096] [INFO ] [MAIN ] BDJ: Loaded 29832 primary data records. [2025-10-17T22:35:23.401086] [DEBUG] [LOCAL ] BDX: Loaded 52951 existing records from primary storage. [2025-10-17T22:35:23.411567] [INFO ] [MAIN ] BDX: Loaded 52951 primary data records. [2025-10-17T22:35:23.781895] [DEBUG] [LOCAL ] BE: Loaded 54441 existing records from primary storage. [2025-10-17T22:35:23.814459] [INFO ] [MAIN ] BE: Loaded 54441 primary data records. [2025-10-17T22:35:24.310270] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:24.311685] [INFO ] [MAIN ] BDJ: Generated 1820 derivative records from 29832 primary records. [2025-10-17T22:35:24.311971] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-17T22:35:24.332018] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1820 records). [2025-10-17T22:35:24.332429] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-17T22:35:24.334682] [INFO ] [MAIN ] Derivative Progress: 193/2083 symbols completed. BDJ took 1.2s. Estimated remaining: 12m 12s. Rate: 155.0 symbols/min [2025-10-17T22:35:24.349320] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:24.350190] [INFO ] [MAIN ] BDX: Generated 1820 derivative records from 52951 primary records. [2025-10-17T22:35:24.350304] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-17T22:35:24.368226] [DEBUG] [LOCAL ] BDX: Derivative data saved (1820 records). [2025-10-17T22:35:24.368337] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-17T22:35:24.370381] [INFO ] [MAIN ] Derivative Progress: 194/2083 symbols completed. BDX took 1.2s. Estimated remaining: 12m 8s. Rate: 155.7 symbols/min [2025-10-17T22:35:24.387095] [DEBUG] [MAIN ] BE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:24.387781] [INFO ] [MAIN ] BE: Generated 1820 derivative records from 54441 primary records. [2025-10-17T22:35:24.387843] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-17T22:35:24.403168] [DEBUG] [LOCAL ] BE: Derivative data saved (1820 records). [2025-10-17T22:35:24.403231] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-10-17T22:35:24.405443] [INFO ] [MAIN ] Derivative Progress: 195/2083 symbols completed. BE took 1.2s. Estimated remaining: 12m 4s. Rate: 156.5 symbols/min [2025-10-17T22:35:24.406235] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:24.406391] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:24.406551] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:24.476886] [DEBUG] [LOCAL ] BEP: Loaded 39645 existing records from primary storage. [2025-10-17T22:35:24.508808] [DEBUG] [LOCAL ] BEKE: Loaded 53980 existing records from primary storage. [2025-10-17T22:35:24.510512] [INFO ] [MAIN ] BEP: Loaded 39645 primary data records. [2025-10-17T22:35:24.510600] [INFO ] [MAIN ] BEKE: Loaded 53980 primary data records. [2025-10-17T22:35:24.533636] [DEBUG] [LOCAL ] BEN: Loaded 53896 existing records from primary storage. [2025-10-17T22:35:24.563323] [INFO ] [MAIN ] BEN: Loaded 53896 primary data records. [2025-10-17T22:35:25.460056] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:25.461173] [INFO ] [MAIN ] BEP: Generated 1820 derivative records from 39645 primary records. [2025-10-17T22:35:25.461626] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-17T22:35:25.479455] [DEBUG] [LOCAL ] BEP: Derivative data saved (1820 records). [2025-10-17T22:35:25.480667] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-17T22:35:25.483271] [INFO ] [MAIN ] Derivative Progress: 196/2083 symbols completed. BEP took 1.1s. Estimated remaining: 12m 10s. Rate: 155.0 symbols/min [2025-10-17T22:35:25.484595] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:25.500827] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:25.514387] [INFO ] [MAIN ] BEN: Generated 1820 derivative records from 53896 primary records. [2025-10-17T22:35:25.514950] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-17T22:35:25.515277] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:25.524524] [INFO ] [MAIN ] BEKE: Generated 1820 derivative records from 53980 primary records. [2025-10-17T22:35:25.528691] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-17T22:35:25.542166] [DEBUG] [LOCAL ] BEN: Derivative data saved (1820 records). [2025-10-17T22:35:25.543677] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-17T22:35:25.548739] [INFO ] [MAIN ] Derivative Progress: 197/2083 symbols completed. BEN took 1.1s. Estimated remaining: 12m 7s. Rate: 155.7 symbols/min [2025-10-17T22:35:25.550117] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:25.557336] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1820 records). [2025-10-17T22:35:25.557547] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-17T22:35:25.559793] [INFO ] [MAIN ] Derivative Progress: 198/2083 symbols completed. BEKE took 1.2s. Estimated remaining: 12m 3s. Rate: 156.5 symbols/min [2025-10-17T22:35:25.559970] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:25.573591] [DEBUG] [LOCAL ] BEPH: Loaded 5233 existing records from primary storage. [2025-10-17T22:35:25.574054] [INFO ] [MAIN ] BEPH: Loaded 5233 primary data records. [2025-10-17T22:35:25.682272] [DEBUG] [LOCAL ] BEPI: Loaded 3648 existing records from primary storage. [2025-10-17T22:35:25.694912] [INFO ] [MAIN ] BEPI: Loaded 3648 primary data records. [2025-10-17T22:35:25.727102] [DEBUG] [LOCAL ] BEPC: Loaded 47230 existing records from primary storage. [2025-10-17T22:35:25.765210] [INFO ] [MAIN ] BEPC: Loaded 47230 primary data records. [2025-10-17T22:35:26.586724] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:26.596884] [INFO ] [MAIN ] BEPH: Generated 1820 derivative records from 5233 primary records. [2025-10-17T22:35:26.602250] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-10-17T22:35:26.602600] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:26.629929] [DEBUG] [MAIN ] BEPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:26.630730] [INFO ] [MAIN ] BEPI: Generated 1820 derivative records from 3648 primary records. [2025-10-17T22:35:26.631498] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1820 records). [2025-10-17T22:35:26.631755] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-10-17T22:35:26.631853] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-17T22:35:26.632585] [INFO ] [MAIN ] BEPC: Generated 1820 derivative records from 47230 primary records. [2025-10-17T22:35:26.635328] [INFO ] [MAIN ] Derivative Progress: 199/2083 symbols completed. BEPH took 1.1s. Estimated remaining: 12m 9s. Rate: 155.0 symbols/min [2025-10-17T22:35:26.635700] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-10-17T22:35:26.636670] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:26.663527] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1820 records). [2025-10-17T22:35:26.667874] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1820 records). [2025-10-17T22:35:26.668180] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-10-17T22:35:26.668012] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-17T22:35:26.670221] [INFO ] [MAIN ] Derivative Progress: 200/2083 symbols completed. BEPI took 1.1s. Estimated remaining: 12m 5s. Rate: 155.8 symbols/min [2025-10-17T22:35:26.672863] [INFO ] [MAIN ] Derivative Progress: 201/2083 symbols completed. BEPC took 1.2s. Estimated remaining: 12m 1s. Rate: 156.5 symbols/min [2025-10-17T22:35:26.672745] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:26.675700] [DEBUG] [LOCAL ] BEPJ: Loaded 3122 existing records from primary storage. [2025-10-17T22:35:26.675477] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:26.676199] [INFO ] [MAIN ] BEPJ: Loaded 3122 primary data records. [2025-10-17T22:35:26.836276] [DEBUG] [LOCAL ] BFK: Loaded 13862 existing records from primary storage. [2025-10-17T22:35:26.842748] [INFO ] [MAIN ] BFK: Loaded 13862 primary data records. [2025-10-17T22:35:27.117616] [DEBUG] [LOCAL ] BFH: Loaded 42165 existing records from primary storage. [2025-10-17T22:35:27.129044] [INFO ] [MAIN ] BFH: Loaded 42165 primary data records. [2025-10-17T22:35:27.653162] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:27.654055] [INFO ] [MAIN ] BEPJ: Generated 1820 derivative records from 3122 primary records. [2025-10-17T22:35:27.654285] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-17T22:35:27.673488] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1820 records). [2025-10-17T22:35:27.673672] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-17T22:35:27.676184] [INFO ] [MAIN ] Derivative Progress: 202/2083 symbols completed. BEPJ took 1.0s. Estimated remaining: 12m 7s. Rate: 155.3 symbols/min [2025-10-17T22:35:27.676525] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:27.711158] [DEBUG] [MAIN ] BFK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:27.717725] [INFO ] [MAIN ] BFK: Generated 1820 derivative records from 13862 primary records. [2025-10-17T22:35:27.716832] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:27.718435] [INFO ] [MAIN ] BFH: Generated 1820 derivative records from 42165 primary records. [2025-10-17T22:35:27.718636] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-17T22:35:27.718712] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-10-17T22:35:27.748434] [DEBUG] [LOCAL ] BFK: Derivative data saved (1820 records). [2025-10-17T22:35:27.749409] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-10-17T22:35:27.752492] [INFO ] [MAIN ] Derivative Progress: 203/2083 symbols completed. BFK took 1.1s. Estimated remaining: 12m 4s. Rate: 155.9 symbols/min [2025-10-17T22:35:27.753247] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:27.756360] [DEBUG] [LOCAL ] BFH: Derivative data saved (1820 records). [2025-10-17T22:35:27.756450] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-10-17T22:35:27.759441] [INFO ] [MAIN ] Derivative Progress: 204/2083 symbols completed. BFH took 1.1s. Estimated remaining: 11m 60s. Rate: 156.7 symbols/min [2025-10-17T22:35:27.774382] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:27.785870] [DEBUG] [LOCAL ] BFZ: Loaded 12201 existing records from primary storage. [2025-10-17T22:35:27.786060] [INFO ] [MAIN ] BFZ: Loaded 12201 primary data records. [2025-10-17T22:35:27.904438] [DEBUG] [LOCAL ] BFLY: Loaded 52605 existing records from primary storage. [2025-10-17T22:35:27.920508] [INFO ] [MAIN ] BFLY: Loaded 52605 primary data records. [2025-10-17T22:35:28.378758] [DEBUG] [LOCAL ] BG: Loaded 51286 existing records from primary storage. [2025-10-17T22:35:28.379374] [INFO ] [MAIN ] BG: Loaded 51286 primary data records. [2025-10-17T22:35:28.879040] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:28.881341] [INFO ] [MAIN ] BFZ: Generated 1820 derivative records from 12201 primary records. [2025-10-17T22:35:28.881444] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-17T22:35:28.900275] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1820 records). [2025-10-17T22:35:28.900884] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-17T22:35:28.903124] [INFO ] [MAIN ] Derivative Progress: 205/2083 symbols completed. BFZ took 1.1s. Estimated remaining: 12m 6s. Rate: 155.2 symbols/min [2025-10-17T22:35:28.903351] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:28.918489] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:28.919826] [INFO ] [MAIN ] BFLY: Generated 1820 derivative records from 52605 primary records. [2025-10-17T22:35:28.920204] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-17T22:35:28.942614] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1820 records). [2025-10-17T22:35:28.942859] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-17T22:35:28.945313] [INFO ] [MAIN ] Derivative Progress: 206/2083 symbols completed. BFLY took 1.3s. Estimated remaining: 12m 3s. Rate: 155.8 symbols/min [2025-10-17T22:35:28.945791] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:28.956967] [DEBUG] [LOCAL ] BGB: Loaded 18257 existing records from primary storage. [2025-10-17T22:35:28.958307] [INFO ] [MAIN ] BGB: Loaded 18257 primary data records. [2025-10-17T22:35:29.058122] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:29.085509] [INFO ] [MAIN ] BG: Generated 1820 derivative records from 51286 primary records. [2025-10-17T22:35:29.086102] [DEBUG] [LOCAL ] BGR: Loaded 13773 existing records from primary storage. [2025-10-17T22:35:29.086482] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-17T22:35:29.107822] [INFO ] [MAIN ] BGR: Loaded 13773 primary data records. [2025-10-17T22:35:29.219236] [DEBUG] [LOCAL ] BG: Derivative data saved (1820 records). [2025-10-17T22:35:29.219390] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-17T22:35:29.235418] [INFO ] [MAIN ] Derivative Progress: 207/2083 symbols completed. BG took 1.5s. Estimated remaining: 12m 1s. Rate: 156.0 symbols/min [2025-10-17T22:35:29.374916] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:29.654621] [DEBUG] [LOCAL ] BGS: Loaded 51299 existing records from primary storage. [2025-10-17T22:35:29.655212] [INFO ] [MAIN ] BGS: Loaded 51299 primary data records. [2025-10-17T22:35:29.704786] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:29.712749] [INFO ] [MAIN ] BGB: Generated 1820 derivative records from 18257 primary records. [2025-10-17T22:35:29.744739] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-17T22:35:29.811626] [DEBUG] [LOCAL ] BGB: Derivative data saved (1820 records). [2025-10-17T22:35:29.811851] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-17T22:35:29.853723] [INFO ] [MAIN ] Derivative Progress: 208/2083 symbols completed. BGB took 1.0s. Estimated remaining: 12m 3s. Rate: 155.6 symbols/min [2025-10-17T22:35:29.880387] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:29.881406] [INFO ] [MAIN ] BGR: Generated 1820 derivative records from 13773 primary records. [2025-10-17T22:35:29.881494] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-17T22:35:30.012815] [DEBUG] [LOCAL ] BGR: Derivative data saved (1820 records). [2025-10-17T22:35:30.012968] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-17T22:35:30.015706] [INFO ] [MAIN ] Derivative Progress: 209/2083 symbols completed. BGR took 1.1s. Estimated remaining: 12m 1s. Rate: 156.0 symbols/min [2025-10-17T22:35:30.035927] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:30.036519] [INFO ] [MAIN ] BGS: Generated 1820 derivative records from 51299 primary records. [2025-10-17T22:35:30.036578] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-17T22:35:30.051804] [DEBUG] [LOCAL ] BGS: Derivative data saved (1820 records). [2025-10-17T22:35:30.051862] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-17T22:35:30.053788] [INFO ] [MAIN ] Derivative Progress: 210/2083 symbols completed. BGS took 0.7s. Estimated remaining: 11m 57s. Rate: 156.7 symbols/min [2025-10-17T22:35:30.054368] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:30.054532] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:30.054638] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:30.068833] [DEBUG] [LOCAL ] BGSF: Loaded 8117 existing records from primary storage. [2025-10-17T22:35:30.068990] [INFO ] [MAIN ] BGSF: Loaded 8117 primary data records. [2025-10-17T22:35:30.131578] [DEBUG] [LOCAL ] BGX: Loaded 11350 existing records from primary storage. [2025-10-17T22:35:30.162319] [DEBUG] [LOCAL ] BGT: Loaded 16635 existing records from primary storage. [2025-10-17T22:35:30.172740] [INFO ] [MAIN ] BGX: Loaded 11350 primary data records. [2025-10-17T22:35:30.180196] [INFO ] [MAIN ] BGT: Loaded 16635 primary data records. [2025-10-17T22:35:31.043833] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:31.045674] [INFO ] [MAIN ] BGSF: Generated 1820 derivative records from 8117 primary records. [2025-10-17T22:35:31.046736] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-17T22:35:31.062388] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1820 records). [2025-10-17T22:35:31.062573] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-17T22:35:31.077998] [INFO ] [MAIN ] Derivative Progress: 211/2083 symbols completed. BGSF took 1.0s. Estimated remaining: 12m 3s. Rate: 155.4 symbols/min [2025-10-17T22:35:31.079980] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:31.079202] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:31.080988] [INFO ] [MAIN ] BGX: Generated 1820 derivative records from 11350 primary records. [2025-10-17T22:35:31.081536] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-17T22:35:31.095136] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:31.108492] [INFO ] [MAIN ] BGT: Generated 1820 derivative records from 16635 primary records. [2025-10-17T22:35:31.108857] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-17T22:35:31.131781] [DEBUG] [LOCAL ] BGT: Derivative data saved (1820 records). [2025-10-17T22:35:31.132703] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-17T22:35:31.134566] [DEBUG] [LOCAL ] BGX: Derivative data saved (1820 records). [2025-10-17T22:35:31.136777] [INFO ] [MAIN ] Derivative Progress: 212/2083 symbols completed. BGT took 1.1s. Estimated remaining: 11m 59s. Rate: 156.1 symbols/min [2025-10-17T22:35:31.136859] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-17T22:35:31.142442] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:31.145177] [INFO ] [MAIN ] Derivative Progress: 213/2083 symbols completed. BGX took 1.1s. Estimated remaining: 11m 56s. Rate: 156.8 symbols/min [2025-10-17T22:35:31.145974] [DEBUG] [LOCAL ] BH: Loaded 16442 existing records from primary storage. [2025-10-17T22:35:31.145608] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:31.146495] [INFO ] [MAIN ] BH: Loaded 16442 primary data records. [2025-10-17T22:35:31.460914] [DEBUG] [LOCAL ] BHE: Loaded 24249 existing records from primary storage. [2025-10-17T22:35:31.461599] [INFO ] [MAIN ] BHE: Loaded 24249 primary data records. [2025-10-17T22:35:31.545753] [DEBUG] [LOCAL ] BHC: Loaded 47402 existing records from primary storage. [2025-10-17T22:35:31.558837] [INFO ] [MAIN ] BHC: Loaded 47402 primary data records. [2025-10-17T22:35:32.111527] [DEBUG] [MAIN ] BH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:32.112969] [INFO ] [MAIN ] BH: Generated 1820 derivative records from 16442 primary records. [2025-10-17T22:35:32.113087] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-10-17T22:35:32.132046] [DEBUG] [LOCAL ] BH: Derivative data saved (1820 records). [2025-10-17T22:35:32.132315] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-10-17T22:35:32.134663] [INFO ] [MAIN ] Derivative Progress: 214/2083 symbols completed. BH took 1.1s. Estimated remaining: 12m 1s. Rate: 155.6 symbols/min [2025-10-17T22:35:32.134940] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:32.152898] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:32.153794] [INFO ] [MAIN ] BHE: Generated 1820 derivative records from 24249 primary records. [2025-10-17T22:35:32.153985] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-17T22:35:32.185363] [DEBUG] [LOCAL ] BHE: Derivative data saved (1820 records). [2025-10-17T22:35:32.186857] [DEBUG] [LOCAL ] BHK: Loaded 23994 existing records from primary storage. [2025-10-17T22:35:32.187048] [INFO ] [MAIN ] BHK: Loaded 23994 primary data records. [2025-10-17T22:35:32.187172] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-17T22:35:32.189305] [INFO ] [MAIN ] Derivative Progress: 215/2083 symbols completed. BHE took 1.0s. Estimated remaining: 11m 57s. Rate: 156.2 symbols/min [2025-10-17T22:35:32.197171] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:32.214871] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:32.241426] [INFO ] [MAIN ] BHC: Generated 1820 derivative records from 47402 primary records. [2025-10-17T22:35:32.254901] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-17T22:35:32.580306] [DEBUG] [LOCAL ] BHC: Derivative data saved (1820 records). [2025-10-17T22:35:32.580604] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-17T22:35:32.582744] [INFO ] [MAIN ] Derivative Progress: 216/2083 symbols completed. BHC took 1.4s. Estimated remaining: 11m 57s. Rate: 156.2 symbols/min [2025-10-17T22:35:32.583014] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:32.607090] [DEBUG] [LOCAL ] BHP: Loaded 54152 existing records from primary storage. [2025-10-17T22:35:32.611855] [INFO ] [MAIN ] BHP: Loaded 54152 primary data records. [2025-10-17T22:35:32.753532] [DEBUG] [LOCAL ] BHR: Loaded 22426 existing records from primary storage. [2025-10-17T22:35:32.770487] [INFO ] [MAIN ] BHR: Loaded 22426 primary data records. [2025-10-17T22:35:33.085769] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:33.103680] [INFO ] [MAIN ] BHK: Generated 1820 derivative records from 23994 primary records. [2025-10-17T22:35:33.104051] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-17T22:35:33.316898] [DEBUG] [LOCAL ] BHK: Derivative data saved (1820 records). [2025-10-17T22:35:33.318011] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-10-17T22:35:33.321525] [INFO ] [MAIN ] Derivative Progress: 217/2083 symbols completed. BHK took 1.2s. Estimated remaining: 11m 60s. Rate: 155.6 symbols/min [2025-10-17T22:35:33.323461] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:33.346125] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:33.347276] [INFO ] [MAIN ] BHP: Generated 1820 derivative records from 54152 primary records. [2025-10-17T22:35:33.347620] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-10-17T22:35:33.381154] [DEBUG] [LOCAL ] BHP: Derivative data saved (1820 records). [2025-10-17T22:35:33.381472] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-10-17T22:35:33.383844] [INFO ] [MAIN ] Derivative Progress: 218/2083 symbols completed. BHP took 1.2s. Estimated remaining: 11m 57s. Rate: 156.2 symbols/min [2025-10-17T22:35:33.384384] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:33.384781] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:33.385622] [INFO ] [MAIN ] BHR: Generated 1820 derivative records from 22426 primary records. [2025-10-17T22:35:33.386120] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-17T22:35:33.417374] [DEBUG] [LOCAL ] BHR: Derivative data saved (1820 records). [2025-10-17T22:35:33.417496] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-17T22:35:33.421664] [INFO ] [MAIN ] Derivative Progress: 219/2083 symbols completed. BHR took 0.8s. Estimated remaining: 11m 53s. Rate: 156.8 symbols/min [2025-10-17T22:35:33.421932] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:33.444060] [DEBUG] [LOCAL ] BHVN: Loaded 51375 existing records from primary storage. [2025-10-17T22:35:33.444518] [INFO ] [MAIN ] BHVN: Loaded 51375 primary data records. [2025-10-17T22:35:33.576564] [DEBUG] [LOCAL ] BIO: Loaded 24345 existing records from primary storage. [2025-10-17T22:35:33.609357] [INFO ] [MAIN ] BIO: Loaded 24345 primary data records. [2025-10-17T22:35:33.747157] [DEBUG] [LOCAL ] BILL: Loaded 53277 existing records from primary storage. [2025-10-17T22:35:33.905278] [INFO ] [MAIN ] BILL: Loaded 53277 primary data records. [2025-10-17T22:35:34.524567] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:34.525668] [INFO ] [MAIN ] BHVN: Generated 1820 derivative records from 51375 primary records. [2025-10-17T22:35:34.525940] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-17T22:35:34.545313] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1820 records). [2025-10-17T22:35:34.546445] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-17T22:35:34.549080] [INFO ] [MAIN ] Derivative Progress: 220/2083 symbols completed. BHVN took 1.2s. Estimated remaining: 11m 59s. Rate: 155.4 symbols/min [2025-10-17T22:35:34.550672] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:34.579662] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:34.579398] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:34.581178] [INFO ] [MAIN ] BIO: Generated 1820 derivative records from 24345 primary records. [2025-10-17T22:35:34.580547] [INFO ] [MAIN ] BILL: Generated 1820 derivative records from 53277 primary records. [2025-10-17T22:35:34.581347] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-10-17T22:35:34.581292] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-17T22:35:34.610610] [DEBUG] [LOCAL ] BIO: Derivative data saved (1820 records). [2025-10-17T22:35:34.611053] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-10-17T22:35:34.613348] [INFO ] [MAIN ] Derivative Progress: 221/2083 symbols completed. BIO took 1.2s. Estimated remaining: 11m 56s. Rate: 156.0 symbols/min [2025-10-17T22:35:34.613848] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:34.617897] [DEBUG] [LOCAL ] BILL: Derivative data saved (1820 records). [2025-10-17T22:35:34.618016] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-17T22:35:34.620864] [INFO ] [MAIN ] Derivative Progress: 222/2083 symbols completed. BILL took 1.2s. Estimated remaining: 11m 52s. Rate: 156.7 symbols/min [2025-10-17T22:35:34.621221] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:34.636409] [DEBUG] [LOCAL ] BIPH: Loaded 2538 existing records from primary storage. [2025-10-17T22:35:34.636744] [INFO ] [MAIN ] BIPH: Loaded 2538 primary data records. [2025-10-17T22:35:34.774837] [DEBUG] [LOCAL ] BIP: Loaded 39830 existing records from primary storage. [2025-10-17T22:35:34.805218] [INFO ] [MAIN ] BIP: Loaded 39830 primary data records. [2025-10-17T22:35:34.887612] [DEBUG] [LOCAL ] BIPC: Loaded 41904 existing records from primary storage. [2025-10-17T22:35:35.057731] [INFO ] [MAIN ] BIPC: Loaded 41904 primary data records. [2025-10-17T22:35:35.624732] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:35.625920] [INFO ] [MAIN ] BIPH: Generated 1820 derivative records from 2538 primary records. [2025-10-17T22:35:35.626770] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-17T22:35:35.656939] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:35.660537] [INFO ] [MAIN ] BIP: Generated 1820 derivative records from 39830 primary records. [2025-10-17T22:35:35.660695] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-17T22:35:35.659765] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1820 records). [2025-10-17T22:35:35.660802] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-17T22:35:35.662838] [INFO ] [MAIN ] Derivative Progress: 223/2083 symbols completed. BIPH took 1.0s. Estimated remaining: 11m 58s. Rate: 155.5 symbols/min [2025-10-17T22:35:35.680611] [DEBUG] [LOCAL ] BIP: Derivative data saved (1820 records). [2025-10-17T22:35:35.681674] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-17T22:35:35.684631] [INFO ] [MAIN ] Derivative Progress: 224/2083 symbols completed. BIP took 1.1s. Estimated remaining: 11m 54s. Rate: 156.2 symbols/min [2025-10-17T22:35:35.698212] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:35.698819] [INFO ] [MAIN ] BIPC: Generated 1820 derivative records from 41904 primary records. [2025-10-17T22:35:35.698882] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-17T22:35:35.714331] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1820 records). [2025-10-17T22:35:35.714389] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-10-17T22:35:35.716612] [INFO ] [MAIN ] Derivative Progress: 225/2083 symbols completed. BIPC took 1.1s. Estimated remaining: 11m 51s. Rate: 156.8 symbols/min [2025-10-17T22:35:35.717141] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:35.717072] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:35.717253] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:35.727801] [DEBUG] [LOCAL ] BIPJ: Loaded 3197 existing records from primary storage. [2025-10-17T22:35:35.728051] [DEBUG] [LOCAL ] BIPI: Loaded 3038 existing records from primary storage. [2025-10-17T22:35:35.728424] [INFO ] [MAIN ] BIPI: Loaded 3038 primary data records. [2025-10-17T22:35:35.728538] [INFO ] [MAIN ] BIPJ: Loaded 3197 primary data records. [2025-10-17T22:35:36.426745] [DEBUG] [LOCAL ] BIRK: Loaded 51882 existing records from primary storage. [2025-10-17T22:35:36.428180] [INFO ] [MAIN ] BIRK: Loaded 51882 primary data records. [2025-10-17T22:35:36.769603] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:36.771006] [INFO ] [MAIN ] BIPJ: Generated 1820 derivative records from 3197 primary records. [2025-10-17T22:35:36.771421] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-17T22:35:36.799217] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:36.806686] [INFO ] [MAIN ] BIPI: Generated 1820 derivative records from 3038 primary records. [2025-10-17T22:35:36.807907] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1820 records). [2025-10-17T22:35:36.808118] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-17T22:35:36.810332] [INFO ] [MAIN ] Derivative Progress: 226/2083 symbols completed. BIPJ took 1.1s. Estimated remaining: 11m 56s. Rate: 155.5 symbols/min [2025-10-17T22:35:36.808214] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-17T22:35:36.810546] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:36.835004] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1820 records). [2025-10-17T22:35:36.835090] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-17T22:35:36.837864] [INFO ] [MAIN ] Derivative Progress: 227/2083 symbols completed. BIPI took 1.1s. Estimated remaining: 11m 53s. Rate: 156.2 symbols/min [2025-10-17T22:35:36.838246] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:36.872342] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:36.872809] [DEBUG] [LOCAL ] BIT: Loaded 24078 existing records from primary storage. [2025-10-17T22:35:36.873838] [INFO ] [MAIN ] BIT: Loaded 24078 primary data records. [2025-10-17T22:35:36.873742] [INFO ] [MAIN ] BIRK: Generated 1820 derivative records from 51882 primary records. [2025-10-17T22:35:36.897922] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-17T22:35:37.021631] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1820 records). [2025-10-17T22:35:37.021872] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-17T22:35:37.024632] [INFO ] [MAIN ] Derivative Progress: 228/2083 symbols completed. BIRK took 1.3s. Estimated remaining: 11m 51s. Rate: 156.5 symbols/min [2025-10-17T22:35:37.057220] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:37.252067] [DEBUG] [LOCAL ] BJ: Loaded 52353 existing records from primary storage. [2025-10-17T22:35:37.252530] [INFO ] [MAIN ] BJ: Loaded 52353 primary data records. [2025-10-17T22:35:37.646047] [DEBUG] [LOCAL ] BK: Loaded 54323 existing records from primary storage. [2025-10-17T22:35:37.646717] [INFO ] [MAIN ] BK: Loaded 54323 primary data records. [2025-10-17T22:35:37.708827] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:37.736792] [INFO ] [MAIN ] BIT: Generated 1820 derivative records from 24078 primary records. [2025-10-17T22:35:37.749735] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-17T22:35:37.972700] [DEBUG] [LOCAL ] BIT: Derivative data saved (1820 records). [2025-10-17T22:35:37.979229] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-17T22:35:38.133404] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:38.147383] [INFO ] [MAIN ] Derivative Progress: 229/2083 symbols completed. BIT took 1.3s. Estimated remaining: 11m 57s. Rate: 155.2 symbols/min [2025-10-17T22:35:38.159026] [INFO ] [MAIN ] BJ: Generated 1820 derivative records from 52353 primary records. [2025-10-17T22:35:38.160749] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-17T22:35:38.160410] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:38.180963] [DEBUG] [LOCAL ] BJ: Derivative data saved (1820 records). [2025-10-17T22:35:38.181886] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-17T22:35:38.184412] [INFO ] [MAIN ] Derivative Progress: 230/2083 symbols completed. BJ took 1.3s. Estimated remaining: 11m 53s. Rate: 155.8 symbols/min [2025-10-17T22:35:38.185259] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:38.240816] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:38.241856] [INFO ] [MAIN ] BK: Generated 1820 derivative records from 54323 primary records. [2025-10-17T22:35:38.242046] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-17T22:35:38.279123] [DEBUG] [LOCAL ] BKH: Loaded 37744 existing records from primary storage. [2025-10-17T22:35:38.293239] [DEBUG] [LOCAL ] BK: Derivative data saved (1820 records). [2025-10-17T22:35:38.292107] [INFO ] [MAIN ] BKH: Loaded 37744 primary data records. [2025-10-17T22:35:38.293552] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-17T22:35:38.316492] [INFO ] [MAIN ] Derivative Progress: 231/2083 symbols completed. BK took 1.3s. Estimated remaining: 11m 51s. Rate: 156.3 symbols/min [2025-10-17T22:35:38.327911] [DEBUG] [LOCAL ] BKD: Loaded 51205 existing records from primary storage. [2025-10-17T22:35:38.328055] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:38.354271] [INFO ] [MAIN ] BKD: Loaded 51205 primary data records. [2025-10-17T22:35:38.987170] [DEBUG] [LOCAL ] BKKT: Loaded 37334 existing records from primary storage. [2025-10-17T22:35:38.987965] [INFO ] [MAIN ] BKKT: Loaded 37334 primary data records. [2025-10-17T22:35:39.312824] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:39.313958] [INFO ] [MAIN ] BKH: Generated 1820 derivative records from 37744 primary records. [2025-10-17T22:35:39.314918] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-10-17T22:35:39.334558] [DEBUG] [LOCAL ] BKH: Derivative data saved (1820 records). [2025-10-17T22:35:39.334857] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-10-17T22:35:39.350297] [INFO ] [MAIN ] Derivative Progress: 232/2083 symbols completed. BKH took 1.2s. Estimated remaining: 11m 56s. Rate: 155.1 symbols/min [2025-10-17T22:35:39.348272] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:39.351246] [INFO ] [MAIN ] BKD: Generated 1820 derivative records from 51205 primary records. [2025-10-17T22:35:39.351393] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-17T22:35:39.351507] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:39.374143] [DEBUG] [LOCAL ] BKN: Loaded 7394 existing records from primary storage. [2025-10-17T22:35:39.375331] [INFO ] [MAIN ] BKN: Loaded 7394 primary data records. [2025-10-17T22:35:39.397213] [DEBUG] [LOCAL ] BKD: Derivative data saved (1820 records). [2025-10-17T22:35:39.412522] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-17T22:35:39.421511] [INFO ] [MAIN ] Derivative Progress: 233/2083 symbols completed. BKD took 1.3s. Estimated remaining: 11m 53s. Rate: 155.7 symbols/min [2025-10-17T22:35:39.449509] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:39.533778] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:39.568252] [INFO ] [MAIN ] BKKT: Generated 1820 derivative records from 37334 primary records. [2025-10-17T22:35:39.574761] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-17T22:35:39.703417] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1820 records). [2025-10-17T22:35:39.703823] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-17T22:35:39.716523] [INFO ] [MAIN ] Derivative Progress: 234/2083 symbols completed. BKKT took 1.4s. Estimated remaining: 11m 52s. Rate: 155.8 symbols/min [2025-10-17T22:35:39.716976] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:39.740617] [DEBUG] [LOCAL ] BKSY: Loaded 49470 existing records from primary storage. [2025-10-17T22:35:39.741193] [INFO ] [MAIN ] BKSY: Loaded 49470 primary data records. [2025-10-17T22:35:39.814266] [DEBUG] [LOCAL ] BKT: Loaded 12781 existing records from primary storage. [2025-10-17T22:35:39.831484] [INFO ] [MAIN ] BKT: Loaded 12781 primary data records. [2025-10-17T22:35:39.923861] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:39.938134] [INFO ] [MAIN ] BKN: Generated 1820 derivative records from 7394 primary records. [2025-10-17T22:35:39.964818] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-17T22:35:40.365579] [DEBUG] [LOCAL ] BKN: Derivative data saved (1820 records). [2025-10-17T22:35:40.367808] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-17T22:35:40.369983] [INFO ] [MAIN ] Derivative Progress: 235/2083 symbols completed. BKN took 1.0s. Estimated remaining: 11m 54s. Rate: 155.4 symbols/min [2025-10-17T22:35:40.371225] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:40.402169] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:40.412864] [INFO ] [MAIN ] BKT: Generated 1820 derivative records from 12781 primary records. [2025-10-17T22:35:40.413013] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-17T22:35:40.426630] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:40.427562] [INFO ] [MAIN ] BKSY: Generated 1820 derivative records from 49470 primary records. [2025-10-17T22:35:40.427851] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-17T22:35:40.470548] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1820 records). [2025-10-17T22:35:40.470943] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-17T22:35:40.471295] [DEBUG] [LOCAL ] BKT: Derivative data saved (1820 records). [2025-10-17T22:35:40.473710] [INFO ] [MAIN ] Derivative Progress: 236/2083 symbols completed. BKSY took 1.0s. Estimated remaining: 11m 51s. Rate: 155.9 symbols/min [2025-10-17T22:35:40.474670] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:40.474409] [DEBUG] [LOCAL ] BKU: Loaded 42897 existing records from primary storage. [2025-10-17T22:35:40.474952] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-17T22:35:40.475286] [INFO ] [MAIN ] BKU: Loaded 42897 primary data records. [2025-10-17T22:35:40.477606] [INFO ] [MAIN ] Derivative Progress: 237/2083 symbols completed. BKT took 0.8s. Estimated remaining: 11m 48s. Rate: 156.5 symbols/min [2025-10-17T22:35:40.508042] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:40.680416] [DEBUG] [LOCAL ] BKV: Loaded 30117 existing records from primary storage. [2025-10-17T22:35:40.802586] [INFO ] [MAIN ] BKV: Loaded 30117 primary data records. [2025-10-17T22:35:40.891924] [DEBUG] [LOCAL ] BLCO: Loaded 35655 existing records from primary storage. [2025-10-17T22:35:40.921603] [INFO ] [MAIN ] BLCO: Loaded 35655 primary data records. [2025-10-17T22:35:41.473786] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:41.475094] [INFO ] [MAIN ] BKU: Generated 1820 derivative records from 42897 primary records. [2025-10-17T22:35:41.475266] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-17T22:35:41.497454] [DEBUG] [LOCAL ] BKU: Derivative data saved (1820 records). [2025-10-17T22:35:41.497698] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-17T22:35:41.499971] [INFO ] [MAIN ] Derivative Progress: 238/2083 symbols completed. BKU took 1.1s. Estimated remaining: 11m 52s. Rate: 155.4 symbols/min [2025-10-17T22:35:41.514487] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:41.515375] [INFO ] [MAIN ] BKV: Generated 1820 derivative records from 30117 primary records. [2025-10-17T22:35:41.515551] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-17T22:35:41.534118] [DEBUG] [LOCAL ] BKV: Derivative data saved (1820 records). [2025-10-17T22:35:41.534244] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-17T22:35:41.537627] [INFO ] [MAIN ] Derivative Progress: 239/2083 symbols completed. BKV took 1.1s. Estimated remaining: 11m 49s. Rate: 156.0 symbols/min [2025-10-17T22:35:41.550994] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:41.551678] [INFO ] [MAIN ] BLCO: Generated 1820 derivative records from 35655 primary records. [2025-10-17T22:35:41.551743] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-17T22:35:41.567753] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1820 records). [2025-10-17T22:35:41.567824] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-17T22:35:41.570025] [INFO ] [MAIN ] Derivative Progress: 240/2083 symbols completed. BLCO took 1.1s. Estimated remaining: 11m 46s. Rate: 156.6 symbols/min [2025-10-17T22:35:41.570506] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:41.570454] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:41.570595] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:41.586673] [DEBUG] [LOCAL ] BLE: Loaded 13930 existing records from primary storage. [2025-10-17T22:35:41.586897] [INFO ] [MAIN ] BLE: Loaded 13930 primary data records. [2025-10-17T22:35:41.704543] [DEBUG] [LOCAL ] BLD: Loaded 27717 existing records from primary storage. [2025-10-17T22:35:41.704829] [INFO ] [MAIN ] BLD: Loaded 27717 primary data records. [2025-10-17T22:35:42.063089] [DEBUG] [LOCAL ] BLDR: Loaded 52629 existing records from primary storage. [2025-10-17T22:35:42.075261] [INFO ] [MAIN ] BLDR: Loaded 52629 primary data records. [2025-10-17T22:35:42.639779] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:42.641283] [INFO ] [MAIN ] BLE: Generated 1820 derivative records from 13930 primary records. [2025-10-17T22:35:42.641841] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-17T22:35:42.658930] [DEBUG] [LOCAL ] BLE: Derivative data saved (1820 records). [2025-10-17T22:35:42.659389] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-17T22:35:42.661607] [INFO ] [MAIN ] Derivative Progress: 241/2083 symbols completed. BLE took 1.1s. Estimated remaining: 11m 51s. Rate: 155.4 symbols/min [2025-10-17T22:35:42.662483] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:42.679455] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:42.680304] [INFO ] [MAIN ] BLD: Generated 1820 derivative records from 27717 primary records. [2025-10-17T22:35:42.680527] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-17T22:35:42.702215] [DEBUG] [LOCAL ] BLD: Derivative data saved (1820 records). [2025-10-17T22:35:42.702619] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-10-17T22:35:42.705426] [INFO ] [MAIN ] Derivative Progress: 242/2083 symbols completed. BLD took 1.1s. Estimated remaining: 11m 48s. Rate: 156.0 symbols/min [2025-10-17T22:35:42.705861] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:42.733922] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:42.735082] [INFO ] [MAIN ] BLDR: Generated 1820 derivative records from 52629 primary records. [2025-10-17T22:35:42.735275] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-17T22:35:42.749496] [DEBUG] [LOCAL ] BLK: Loaded 34882 existing records from primary storage. [2025-10-17T22:35:42.758413] [INFO ] [MAIN ] BLK: Loaded 34882 primary data records. [2025-10-17T22:35:42.879819] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1820 records). [2025-10-17T22:35:42.883253] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-17T22:35:42.885538] [INFO ] [MAIN ] Derivative Progress: 243/2083 symbols completed. BLDR took 1.3s. Estimated remaining: 11m 46s. Rate: 156.3 symbols/min [2025-10-17T22:35:42.913670] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:43.094625] [DEBUG] [LOCAL ] BLND: Loaded 50014 existing records from primary storage. [2025-10-17T22:35:43.094999] [INFO ] [MAIN ] BLND: Loaded 50014 primary data records. [2025-10-17T22:35:43.193945] [DEBUG] [LOCAL ] BLW: Loaded 13364 existing records from primary storage. [2025-10-17T22:35:43.217731] [INFO ] [MAIN ] BLW: Loaded 13364 primary data records. [2025-10-17T22:35:43.753126] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:43.755373] [INFO ] [MAIN ] BLK: Generated 1820 derivative records from 34882 primary records. [2025-10-17T22:35:43.755682] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-17T22:35:43.776993] [DEBUG] [LOCAL ] BLK: Derivative data saved (1820 records). [2025-10-17T22:35:43.777195] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-17T22:35:43.779427] [INFO ] [MAIN ] Derivative Progress: 244/2083 symbols completed. BLK took 1.1s. Estimated remaining: 11m 50s. Rate: 155.5 symbols/min [2025-10-17T22:35:43.787597] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:43.793695] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:43.794334] [INFO ] [MAIN ] BLND: Generated 1820 derivative records from 50014 primary records. [2025-10-17T22:35:43.794547] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-17T22:35:43.814019] [DEBUG] [LOCAL ] BLND: Derivative data saved (1820 records). [2025-10-17T22:35:43.814391] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-17T22:35:43.816622] [INFO ] [MAIN ] Derivative Progress: 245/2083 symbols completed. BLND took 1.1s. Estimated remaining: 11m 47s. Rate: 156.1 symbols/min [2025-10-17T22:35:43.820424] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:43.834253] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:43.835003] [INFO ] [MAIN ] BLW: Generated 1820 derivative records from 13364 primary records. [2025-10-17T22:35:43.835098] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-10-17T22:35:43.859407] [DEBUG] [LOCAL ] BLW: Derivative data saved (1820 records). [2025-10-17T22:35:43.859564] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-10-17T22:35:43.862632] [INFO ] [MAIN ] Derivative Progress: 246/2083 symbols completed. BLW took 0.9s. Estimated remaining: 11m 44s. Rate: 156.6 symbols/min [2025-10-17T22:35:43.862856] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:43.860042] [DEBUG] [LOCAL ] BLX: Loaded 15775 existing records from primary storage. [2025-10-17T22:35:43.863593] [INFO ] [MAIN ] BLX: Loaded 15775 primary data records. [2025-10-17T22:35:43.995892] [DEBUG] [LOCAL ] BMA: Loaded 36733 existing records from primary storage. [2025-10-17T22:35:44.016827] [INFO ] [MAIN ] BMA: Loaded 36733 primary data records. [2025-10-17T22:35:44.219478] [DEBUG] [LOCAL ] BME: Loaded 11421 existing records from primary storage. [2025-10-17T22:35:44.231412] [INFO ] [MAIN ] BME: Loaded 11421 primary data records. [2025-10-17T22:35:44.880197] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:44.881443] [INFO ] [MAIN ] BLX: Generated 1820 derivative records from 15775 primary records. [2025-10-17T22:35:44.881972] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-17T22:35:44.899710] [DEBUG] [LOCAL ] BLX: Derivative data saved (1820 records). [2025-10-17T22:35:44.899886] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-17T22:35:44.904761] [INFO ] [MAIN ] Derivative Progress: 247/2083 symbols completed. BLX took 1.1s. Estimated remaining: 11m 48s. Rate: 155.5 symbols/min [2025-10-17T22:35:44.906162] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:44.920831] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:44.921830] [INFO ] [MAIN ] BMA: Generated 1820 derivative records from 36733 primary records. [2025-10-17T22:35:44.934080] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-17T22:35:44.934935] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:44.935877] [INFO ] [MAIN ] BME: Generated 1820 derivative records from 11421 primary records. [2025-10-17T22:35:44.935970] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-17T22:35:44.973079] [DEBUG] [LOCAL ] BME: Derivative data saved (1820 records). [2025-10-17T22:35:44.972503] [DEBUG] [LOCAL ] BMA: Derivative data saved (1820 records). [2025-10-17T22:35:44.973294] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-17T22:35:44.973220] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-17T22:35:44.975798] [INFO ] [MAIN ] Derivative Progress: 248/2083 symbols completed. BMA took 1.2s. Estimated remaining: 11m 45s. Rate: 156.1 symbols/min [2025-10-17T22:35:44.975991] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:44.978237] [INFO ] [MAIN ] Derivative Progress: 249/2083 symbols completed. BME took 1.1s. Estimated remaining: 11m 42s. Rate: 156.7 symbols/min [2025-10-17T22:35:44.978785] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:44.988187] [DEBUG] [LOCAL ] BMI: Loaded 24957 existing records from primary storage. [2025-10-17T22:35:44.988981] [INFO ] [MAIN ] BMI: Loaded 24957 primary data records. [2025-10-17T22:35:45.027439] [DEBUG] [LOCAL ] BMN: Loaded 2635 existing records from primary storage. [2025-10-17T22:35:45.055334] [INFO ] [MAIN ] BMN: Loaded 2635 primary data records. [2025-10-17T22:35:45.477236] [DEBUG] [LOCAL ] BMO: Loaded 41935 existing records from primary storage. [2025-10-17T22:35:45.483220] [INFO ] [MAIN ] BMO: Loaded 41935 primary data records. [2025-10-17T22:35:45.946747] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7798 incomplete bins [2025-10-17T22:35:45.947635] [INFO ] [MAIN ] BMN: Generated 1816 derivative records from 2635 primary records. [2025-10-17T22:35:45.947848] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-17T22:35:45.970024] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:45.976569] [DEBUG] [LOCAL ] BMN: Derivative data saved (1816 records). [2025-10-17T22:35:45.977518] [INFO ] [MAIN ] BMI: Generated 1820 derivative records from 24957 primary records. [2025-10-17T22:35:45.977829] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-17T22:35:45.979925] [INFO ] [MAIN ] Derivative Progress: 250/2083 symbols completed. BMN took 1.0s. Estimated remaining: 11m 46s. Rate: 155.7 symbols/min [2025-10-17T22:35:45.980465] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:45.980146] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-17T22:35:45.999245] [DEBUG] [LOCAL ] BMI: Derivative data saved (1820 records). [2025-10-17T22:35:45.999497] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-17T22:35:46.001764] [INFO ] [MAIN ] Derivative Progress: 251/2083 symbols completed. BMI took 1.1s. Estimated remaining: 11m 43s. Rate: 156.3 symbols/min [2025-10-17T22:35:46.003087] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:46.019720] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:46.020571] [INFO ] [MAIN ] BMO: Generated 1820 derivative records from 41935 primary records. [2025-10-17T22:35:46.020724] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-17T22:35:46.053419] [DEBUG] [LOCAL ] BMO: Derivative data saved (1820 records). [2025-10-17T22:35:46.053585] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-17T22:35:46.056819] [INFO ] [MAIN ] Derivative Progress: 252/2083 symbols completed. BMO took 1.1s. Estimated remaining: 11m 41s. Rate: 156.8 symbols/min [2025-10-17T22:35:46.057172] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:46.076530] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-10-17T22:35:46.076696] [INFO ] [MAIN ] BMY: Loaded 54537 primary data records. [2025-10-17T22:35:46.324358] [DEBUG] [LOCAL ] BN: Loaded 53768 existing records from primary storage. [2025-10-17T22:35:46.323098] [DEBUG] [LOCAL ] BNED: Loaded 28914 existing records from primary storage. [2025-10-17T22:35:46.324597] [INFO ] [MAIN ] BNED: Loaded 28914 primary data records. [2025-10-17T22:35:46.443267] [INFO ] [MAIN ] BN: Loaded 53768 primary data records. [2025-10-17T22:35:47.065722] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:47.066738] [INFO ] [MAIN ] BMY: Generated 1820 derivative records from 54537 primary records. [2025-10-17T22:35:47.067100] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-17T22:35:47.086475] [DEBUG] [LOCAL ] BMY: Derivative data saved (1820 records). [2025-10-17T22:35:47.086615] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-17T22:35:47.089050] [INFO ] [MAIN ] Derivative Progress: 253/2083 symbols completed. BMY took 1.1s. Estimated remaining: 11m 45s. Rate: 155.8 symbols/min [2025-10-17T22:35:47.107023] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:47.107812] [INFO ] [MAIN ] BNED: Generated 1820 derivative records from 28914 primary records. [2025-10-17T22:35:47.119669] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-17T22:35:47.120230] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:47.121049] [INFO ] [MAIN ] BN: Generated 1820 derivative records from 53768 primary records. [2025-10-17T22:35:47.121275] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-17T22:35:47.149755] [DEBUG] [LOCAL ] BN: Derivative data saved (1820 records). [2025-10-17T22:35:47.150224] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-17T22:35:47.152810] [INFO ] [MAIN ] Derivative Progress: 254/2083 symbols completed. BN took 1.1s. Estimated remaining: 11m 42s. Rate: 156.3 symbols/min [2025-10-17T22:35:47.153764] [DEBUG] [LOCAL ] BNED: Derivative data saved (1820 records). [2025-10-17T22:35:47.153825] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-17T22:35:47.156491] [INFO ] [MAIN ] Derivative Progress: 255/2083 symbols completed. BNED took 1.1s. Estimated remaining: 11m 39s. Rate: 156.9 symbols/min [2025-10-17T22:35:47.157084] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:47.157187] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:47.157335] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:47.166612] [DEBUG] [LOCAL ] BNJ: Loaded 2639 existing records from primary storage. [2025-10-17T22:35:47.167118] [INFO ] [MAIN ] BNJ: Loaded 2639 primary data records. [2025-10-17T22:35:47.204193] [DEBUG] [LOCAL ] BNH: Loaded 5065 existing records from primary storage. [2025-10-17T22:35:47.209679] [INFO ] [MAIN ] BNH: Loaded 5065 primary data records. [2025-10-17T22:35:47.843846] [DEBUG] [LOCAL ] BNL: Loaded 47981 existing records from primary storage. [2025-10-17T22:35:47.858547] [INFO ] [MAIN ] BNL: Loaded 47981 primary data records. [2025-10-17T22:35:48.261375] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:48.262949] [INFO ] [MAIN ] BNJ: Generated 1820 derivative records from 2639 primary records. [2025-10-17T22:35:48.277002] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-17T22:35:48.277299] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:48.279459] [INFO ] [MAIN ] BNH: Generated 1820 derivative records from 5065 primary records. [2025-10-17T22:35:48.280092] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-17T22:35:48.302792] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1820 records). [2025-10-17T22:35:48.307716] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-17T22:35:48.310391] [INFO ] [MAIN ] Derivative Progress: 256/2083 symbols completed. BNJ took 1.2s. Estimated remaining: 11m 44s. Rate: 155.7 symbols/min [2025-10-17T22:35:48.314276] [DEBUG] [LOCAL ] BNH: Derivative data saved (1820 records). [2025-10-17T22:35:48.314529] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:48.314766] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-17T22:35:48.317277] [INFO ] [MAIN ] Derivative Progress: 257/2083 symbols completed. BNH took 1.2s. Estimated remaining: 11m 41s. Rate: 156.2 symbols/min [2025-10-17T22:35:48.318782] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:48.334492] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:48.335279] [INFO ] [MAIN ] BNL: Generated 1820 derivative records from 47981 primary records. [2025-10-17T22:35:48.336446] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-17T22:35:48.351225] [DEBUG] [LOCAL ] BNT: Loaded 3594 existing records from primary storage. [2025-10-17T22:35:48.351745] [INFO ] [MAIN ] BNT: Loaded 3594 primary data records. [2025-10-17T22:35:48.454218] [DEBUG] [LOCAL ] BNL: Derivative data saved (1820 records). [2025-10-17T22:35:48.461589] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-17T22:35:48.464024] [INFO ] [MAIN ] Derivative Progress: 258/2083 symbols completed. BNL took 1.3s. Estimated remaining: 11m 39s. Rate: 156.6 symbols/min [2025-10-17T22:35:48.477456] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:48.683899] [DEBUG] [LOCAL ] BNY: Loaded 7307 existing records from primary storage. [2025-10-17T22:35:48.695019] [DEBUG] [LOCAL ] BNS: Loaded 52255 existing records from primary storage. [2025-10-17T22:35:48.695497] [INFO ] [MAIN ] BNS: Loaded 52255 primary data records. [2025-10-17T22:35:48.695393] [INFO ] [MAIN ] BNY: Loaded 7307 primary data records. [2025-10-17T22:35:49.333350] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:49.334614] [INFO ] [MAIN ] BNT: Generated 1820 derivative records from 3594 primary records. [2025-10-17T22:35:49.336303] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-17T22:35:49.354407] [DEBUG] [LOCAL ] BNT: Derivative data saved (1820 records). [2025-10-17T22:35:49.354575] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-17T22:35:49.356766] [INFO ] [MAIN ] Derivative Progress: 259/2083 symbols completed. BNT took 1.0s. Estimated remaining: 11m 42s. Rate: 155.8 symbols/min [2025-10-17T22:35:49.357063] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:49.374894] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:49.375694] [INFO ] [MAIN ] BNS: Generated 1820 derivative records from 52255 primary records. [2025-10-17T22:35:49.375917] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-17T22:35:49.399623] [DEBUG] [LOCAL ] BNS: Derivative data saved (1820 records). [2025-10-17T22:35:49.399858] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-17T22:35:49.415530] [INFO ] [MAIN ] Derivative Progress: 260/2083 symbols completed. BNS took 1.1s. Estimated remaining: 11m 40s. Rate: 156.3 symbols/min [2025-10-17T22:35:49.415911] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:49.423323] [INFO ] [MAIN ] BNY: Generated 1820 derivative records from 7307 primary records. [2025-10-17T22:35:49.423708] [DEBUG] [LOCAL ] BOC: Loaded 18798 existing records from primary storage. [2025-10-17T22:35:49.422426] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:49.423886] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-17T22:35:49.423996] [INFO ] [MAIN ] BOC: Loaded 18798 primary data records. [2025-10-17T22:35:49.460864] [DEBUG] [LOCAL ] BNY: Derivative data saved (1820 records). [2025-10-17T22:35:49.485963] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-17T22:35:49.502150] [INFO ] [MAIN ] Derivative Progress: 261/2083 symbols completed. BNY took 1.0s. Estimated remaining: 11m 37s. Rate: 156.8 symbols/min [2025-10-17T22:35:49.513503] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:49.581375] [DEBUG] [LOCAL ] BOE: Loaded 18435 existing records from primary storage. [2025-10-17T22:35:49.586734] [INFO ] [MAIN ] BOE: Loaded 18435 primary data records. [2025-10-17T22:35:49.992794] [DEBUG] [LOCAL ] BOH: Loaded 31214 existing records from primary storage. [2025-10-17T22:35:50.112318] [INFO ] [MAIN ] BOH: Loaded 31214 primary data records. [2025-10-17T22:35:50.480297] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:50.481774] [INFO ] [MAIN ] BOC: Generated 1820 derivative records from 18798 primary records. [2025-10-17T22:35:50.481950] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-17T22:35:50.502456] [DEBUG] [LOCAL ] BOC: Derivative data saved (1820 records). [2025-10-17T22:35:50.503426] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-17T22:35:50.505639] [INFO ] [MAIN ] Derivative Progress: 262/2083 symbols completed. BOC took 1.1s. Estimated remaining: 11m 41s. Rate: 155.8 symbols/min [2025-10-17T22:35:50.505985] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:50.520053] [DEBUG] [MAIN ] BOE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:50.520927] [INFO ] [MAIN ] BOE: Generated 1820 derivative records from 18435 primary records. [2025-10-17T22:35:50.521119] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-17T22:35:50.537525] [DEBUG] [LOCAL ] BOE: Derivative data saved (1820 records). [2025-10-17T22:35:50.537718] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-10-17T22:35:50.542235] [INFO ] [MAIN ] Derivative Progress: 263/2083 symbols completed. BOE took 1.1s. Estimated remaining: 11m 38s. Rate: 156.4 symbols/min [2025-10-17T22:35:50.542703] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:50.559323] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:50.568794] [INFO ] [MAIN ] BOH: Generated 1820 derivative records from 31214 primary records. [2025-10-17T22:35:50.569059] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-17T22:35:50.593856] [DEBUG] [LOCAL ] BOH: Derivative data saved (1820 records). [2025-10-17T22:35:50.595157] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-17T22:35:50.597404] [INFO ] [MAIN ] Derivative Progress: 264/2083 symbols completed. BOH took 1.1s. Estimated remaining: 11m 36s. Rate: 156.9 symbols/min [2025-10-17T22:35:50.597722] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:50.598814] [DEBUG] [LOCAL ] BOND: Loaded 32938 existing records from primary storage. [2025-10-17T22:35:50.599059] [INFO ] [MAIN ] BOND: Loaded 32938 primary data records. [2025-10-17T22:35:50.722126] [DEBUG] [LOCAL ] BOOT: Loaded 40347 existing records from primary storage. [2025-10-17T22:35:50.728124] [INFO ] [MAIN ] BOOT: Loaded 40347 primary data records. [2025-10-17T22:35:51.100879] [DEBUG] [LOCAL ] BORR: Loaded 51855 existing records from primary storage. [2025-10-17T22:35:51.134432] [INFO ] [MAIN ] BORR: Loaded 51855 primary data records. [2025-10-17T22:35:51.603774] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:51.606400] [INFO ] [MAIN ] BOND: Generated 1820 derivative records from 32938 primary records. [2025-10-17T22:35:51.606615] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-17T22:35:51.629305] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:51.633073] [INFO ] [MAIN ] BOOT: Generated 1820 derivative records from 40347 primary records. [2025-10-17T22:35:51.633696] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-17T22:35:51.638875] [DEBUG] [LOCAL ] BOND: Derivative data saved (1820 records). [2025-10-17T22:35:51.639170] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-17T22:35:51.648545] [INFO ] [MAIN ] Derivative Progress: 265/2083 symbols completed. BOND took 1.1s. Estimated remaining: 11m 40s. Rate: 155.9 symbols/min [2025-10-17T22:35:51.652946] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:51.661945] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1820 records). [2025-10-17T22:35:51.663964] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-17T22:35:51.666087] [INFO ] [MAIN ] Derivative Progress: 266/2083 symbols completed. BOOT took 1.1s. Estimated remaining: 11m 37s. Rate: 156.4 symbols/min [2025-10-17T22:35:51.666298] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:51.687302] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:51.688057] [INFO ] [MAIN ] BORR: Generated 1820 derivative records from 51855 primary records. [2025-10-17T22:35:51.688196] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-10-17T22:35:51.715949] [DEBUG] [LOCAL ] BOW: Loaded 23579 existing records from primary storage. [2025-10-17T22:35:51.715467] [DEBUG] [LOCAL ] BORR: Derivative data saved (1820 records). [2025-10-17T22:35:51.716350] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-10-17T22:35:51.716201] [INFO ] [MAIN ] BOW: Loaded 23579 primary data records. [2025-10-17T22:35:51.719095] [INFO ] [MAIN ] Derivative Progress: 267/2083 symbols completed. BORR took 1.1s. Estimated remaining: 11m 34s. Rate: 156.9 symbols/min [2025-10-17T22:35:51.724830] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:51.936156] [DEBUG] [LOCAL ] BOX: Loaded 50897 existing records from primary storage. [2025-10-17T22:35:52.053435] [INFO ] [MAIN ] BOX: Loaded 50897 primary data records. [2025-10-17T22:35:52.414566] [DEBUG] [LOCAL ] BP: Loaded 54488 existing records from primary storage. [2025-10-17T22:35:52.428754] [INFO ] [MAIN ] BP: Loaded 54488 primary data records. [2025-10-17T22:35:52.564422] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:52.613048] [INFO ] [MAIN ] BOW: Generated 1820 derivative records from 23579 primary records. [2025-10-17T22:35:52.638958] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-17T22:35:52.782673] [DEBUG] [LOCAL ] BOW: Derivative data saved (1820 records). [2025-10-17T22:35:52.783059] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-17T22:35:52.785276] [INFO ] [MAIN ] Derivative Progress: 268/2083 symbols completed. BOW took 1.1s. Estimated remaining: 11m 39s. Rate: 155.9 symbols/min [2025-10-17T22:35:52.804891] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:52.805594] [INFO ] [MAIN ] BOX: Generated 1820 derivative records from 50897 primary records. [2025-10-17T22:35:52.805789] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-17T22:35:52.821930] [DEBUG] [LOCAL ] BOX: Derivative data saved (1820 records). [2025-10-17T22:35:52.821996] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-10-17T22:35:52.824316] [INFO ] [MAIN ] Derivative Progress: 269/2083 symbols completed. BOX took 1.2s. Estimated remaining: 11m 36s. Rate: 156.4 symbols/min [2025-10-17T22:35:52.841994] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:52.842577] [INFO ] [MAIN ] BP: Generated 1820 derivative records from 54488 primary records. [2025-10-17T22:35:52.842637] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-17T22:35:52.859129] [DEBUG] [LOCAL ] BP: Derivative data saved (1820 records). [2025-10-17T22:35:52.859217] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-10-17T22:35:52.862519] [INFO ] [MAIN ] Derivative Progress: 270/2083 symbols completed. BP took 1.1s. Estimated remaining: 11m 33s. Rate: 156.9 symbols/min [2025-10-17T22:35:52.863178] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:52.863017] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:52.863128] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:52.886306] [DEBUG] [LOCAL ] BRC: Loaded 18893 existing records from primary storage. [2025-10-17T22:35:52.895260] [INFO ] [MAIN ] BRC: Loaded 18893 primary data records. [2025-10-17T22:35:53.004528] [DEBUG] [LOCAL ] BR: Loaded 35340 existing records from primary storage. [2025-10-17T22:35:53.047422] [INFO ] [MAIN ] BR: Loaded 35340 primary data records. [2025-10-17T22:35:53.080799] [DEBUG] [LOCAL ] BRCC: Loaded 40784 existing records from primary storage. [2025-10-17T22:35:53.087941] [INFO ] [MAIN ] BRCC: Loaded 40784 primary data records. [2025-10-17T22:35:53.864581] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:53.865572] [INFO ] [MAIN ] BRC: Generated 1820 derivative records from 18893 primary records. [2025-10-17T22:35:53.865836] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-17T22:35:53.883092] [DEBUG] [LOCAL ] BRC: Derivative data saved (1820 records). [2025-10-17T22:35:53.883280] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-17T22:35:53.885632] [INFO ] [MAIN ] Derivative Progress: 271/2083 symbols completed. BRC took 1.0s. Estimated remaining: 11m 37s. Rate: 156.0 symbols/min [2025-10-17T22:35:53.885814] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:53.917171] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:53.918205] [INFO ] [MAIN ] BR: Generated 1820 derivative records from 35340 primary records. [2025-10-17T22:35:53.918383] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-17T22:35:53.918557] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:53.919180] [INFO ] [MAIN ] BRCC: Generated 1820 derivative records from 40784 primary records. [2025-10-17T22:35:53.919992] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-10-17T22:35:53.950765] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1820 records). [2025-10-17T22:35:53.951959] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-10-17T22:35:53.952389] [DEBUG] [LOCAL ] BR: Derivative data saved (1820 records). [2025-10-17T22:35:53.954580] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-17T22:35:53.954512] [INFO ] [MAIN ] Derivative Progress: 272/2083 symbols completed. BRCC took 1.1s. Estimated remaining: 11m 35s. Rate: 156.4 symbols/min [2025-10-17T22:35:53.956878] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:53.957144] [INFO ] [MAIN ] Derivative Progress: 273/2083 symbols completed. BR took 1.1s. Estimated remaining: 11m 32s. Rate: 157.0 symbols/min [2025-10-17T22:35:53.957549] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:53.978357] [DEBUG] [LOCAL ] BRT: Loaded 5316 existing records from primary storage. [2025-10-17T22:35:53.978508] [INFO ] [MAIN ] BRT: Loaded 5316 primary data records. [2025-10-17T22:35:54.116162] [DEBUG] [LOCAL ] BRW: Loaded 21211 existing records from primary storage. [2025-10-17T22:35:54.132918] [DEBUG] [LOCAL ] BRO: Loaded 52839 existing records from primary storage. [2025-10-17T22:35:54.154190] [INFO ] [MAIN ] BRW: Loaded 21211 primary data records. [2025-10-17T22:35:54.179301] [INFO ] [MAIN ] BRO: Loaded 52839 primary data records. [2025-10-17T22:35:54.975199] [DEBUG] [MAIN ] BRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:54.976682] [INFO ] [MAIN ] BRT: Generated 1820 derivative records from 5316 primary records. [2025-10-17T22:35:54.977217] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-10-17T22:35:54.999072] [DEBUG] [LOCAL ] BRT: Derivative data saved (1820 records). [2025-10-17T22:35:55.008317] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-10-17T22:35:55.010972] [INFO ] [MAIN ] Derivative Progress: 274/2083 symbols completed. BRT took 1.1s. Estimated remaining: 11m 36s. Rate: 156.0 symbols/min [2025-10-17T22:35:55.016360] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:55.017577] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:55.018461] [INFO ] [MAIN ] BRW: Generated 1820 derivative records from 21211 primary records. [2025-10-17T22:35:55.018678] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-10-17T22:35:55.049572] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:55.052263] [INFO ] [MAIN ] BRO: Generated 1820 derivative records from 52839 primary records. [2025-10-17T22:35:55.053174] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-10-17T22:35:55.053058] [DEBUG] [LOCAL ] BRW: Derivative data saved (1820 records). [2025-10-17T22:35:55.054277] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-10-17T22:35:55.064229] [INFO ] [MAIN ] Derivative Progress: 275/2083 symbols completed. BRW took 1.1s. Estimated remaining: 11m 33s. Rate: 156.5 symbols/min [2025-10-17T22:35:55.064516] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:55.073584] [DEBUG] [LOCAL ] BRO: Derivative data saved (1820 records). [2025-10-17T22:35:55.073715] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-10-17T22:35:55.075844] [INFO ] [MAIN ] Derivative Progress: 276/2083 symbols completed. BRO took 1.2s. Estimated remaining: 11m 30s. Rate: 157.0 symbols/min [2025-10-17T22:35:55.076412] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:55.137824] [DEBUG] [LOCAL ] BRX: Loaded 52572 existing records from primary storage. [2025-10-17T22:35:55.148270] [INFO ] [MAIN ] BRX: Loaded 52572 primary data records. [2025-10-17T22:35:55.181864] [DEBUG] [LOCAL ] BSAC: Loaded 33351 existing records from primary storage. [2025-10-17T22:35:55.241502] [INFO ] [MAIN ] BSAC: Loaded 33351 primary data records. [2025-10-17T22:35:55.263766] [DEBUG] [LOCAL ] BSBR: Loaded 36277 existing records from primary storage. [2025-10-17T22:35:55.321435] [INFO ] [MAIN ] BSBR: Loaded 36277 primary data records. [2025-10-17T22:35:56.141189] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:56.142438] [INFO ] [MAIN ] BRX: Generated 1820 derivative records from 52572 primary records. [2025-10-17T22:35:56.142838] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-17T22:35:56.161477] [DEBUG] [LOCAL ] BRX: Derivative data saved (1820 records). [2025-10-17T22:35:56.162626] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-17T22:35:56.167214] [INFO ] [MAIN ] Derivative Progress: 277/2083 symbols completed. BRX took 1.2s. Estimated remaining: 11m 35s. Rate: 156.0 symbols/min [2025-10-17T22:35:56.167766] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:56.182497] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:56.196797] [INFO ] [MAIN ] BSAC: Generated 1820 derivative records from 33351 primary records. [2025-10-17T22:35:56.197234] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-10-17T22:35:56.197155] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:56.199033] [INFO ] [MAIN ] BSBR: Generated 1820 derivative records from 36277 primary records. [2025-10-17T22:35:56.199394] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-17T22:35:56.236984] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1820 records). [2025-10-17T22:35:56.237579] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-10-17T22:35:56.240155] [INFO ] [MAIN ] Derivative Progress: 278/2083 symbols completed. BSAC took 1.2s. Estimated remaining: 11m 32s. Rate: 156.5 symbols/min [2025-10-17T22:35:56.240903] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:56.242820] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1820 records). [2025-10-17T22:35:56.242966] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-10-17T22:35:56.245168] [INFO ] [MAIN ] Derivative Progress: 279/2083 symbols completed. BSBR took 1.2s. Estimated remaining: 11m 29s. Rate: 157.0 symbols/min [2025-10-17T22:35:56.245397] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:56.256278] [DEBUG] [LOCAL ] BSM: Loaded 32822 existing records from primary storage. [2025-10-17T22:35:56.256469] [INFO ] [MAIN ] BSM: Loaded 32822 primary data records. [2025-10-17T22:35:56.565356] [DEBUG] [LOCAL ] BSTZ: Loaded 25243 existing records from primary storage. [2025-10-17T22:35:56.566137] [INFO ] [MAIN ] BSTZ: Loaded 25243 primary data records. [2025-10-17T22:35:56.699176] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-10-17T22:35:56.710975] [INFO ] [MAIN ] BSX: Loaded 54468 primary data records. [2025-10-17T22:35:57.214778] [DEBUG] [MAIN ] BSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:57.216160] [INFO ] [MAIN ] BSM: Generated 1820 derivative records from 32822 primary records. [2025-10-17T22:35:57.216795] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-10-17T22:35:57.235901] [DEBUG] [LOCAL ] BSM: Derivative data saved (1820 records). [2025-10-17T22:35:57.239262] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-10-17T22:35:57.242113] [INFO ] [MAIN ] Derivative Progress: 280/2083 symbols completed. BSM took 1.1s. Estimated remaining: 11m 33s. Rate: 156.1 symbols/min [2025-10-17T22:35:57.242560] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:57.257161] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:57.258063] [INFO ] [MAIN ] BSTZ: Generated 1820 derivative records from 25243 primary records. [2025-10-17T22:35:57.258258] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-10-17T22:35:57.278897] [DEBUG] [LOCAL ] BTA: Loaded 5810 existing records from primary storage. [2025-10-17T22:35:57.279708] [INFO ] [MAIN ] BTA: Loaded 5810 primary data records. [2025-10-17T22:35:57.301729] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1820 records). [2025-10-17T22:35:57.311753] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-10-17T22:35:57.319263] [INFO ] [MAIN ] Derivative Progress: 281/2083 symbols completed. BSTZ took 1.1s. Estimated remaining: 11m 31s. Rate: 156.6 symbols/min [2025-10-17T22:35:57.337835] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:57.425775] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:57.478457] [INFO ] [MAIN ] BSX: Generated 1820 derivative records from 54468 primary records. [2025-10-17T22:35:57.483261] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-10-17T22:35:57.536468] [DEBUG] [LOCAL ] BTCM: Loaded 17289 existing records from primary storage. [2025-10-17T22:35:57.618256] [INFO ] [MAIN ] BTCM: Loaded 17289 primary data records. [2025-10-17T22:35:57.697346] [DEBUG] [LOCAL ] BSX: Derivative data saved (1820 records). [2025-10-17T22:35:57.704284] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-10-17T22:35:57.724210] [INFO ] [MAIN ] Derivative Progress: 282/2083 symbols completed. BSX took 1.5s. Estimated remaining: 11m 30s. Rate: 156.5 symbols/min [2025-10-17T22:35:57.733442] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:57.952717] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:57.953556] [INFO ] [MAIN ] BTA: Generated 1820 derivative records from 5810 primary records. [2025-10-17T22:35:57.953884] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-17T22:35:57.984443] [DEBUG] [LOCAL ] BTA: Derivative data saved (1820 records). [2025-10-17T22:35:57.985039] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-17T22:35:57.987043] [INFO ] [MAIN ] Derivative Progress: 283/2083 symbols completed. BTA took 0.7s. Estimated remaining: 11m 29s. Rate: 156.7 symbols/min [2025-10-17T22:35:58.019316] [DEBUG] [MAIN ] BTCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:58.020339] [DEBUG] [LOCAL ] BTI: Loaded 54375 existing records from primary storage. [2025-10-17T22:35:58.021048] [INFO ] [MAIN ] BTCM: Generated 1820 derivative records from 17289 primary records. [2025-10-17T22:35:58.021164] [INFO ] [MAIN ] BTI: Loaded 54375 primary data records. [2025-10-17T22:35:58.021235] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-10-17T22:35:58.137841] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1820 records). [2025-10-17T22:35:58.140124] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-10-17T22:35:58.142679] [INFO ] [MAIN ] Derivative Progress: 284/2083 symbols completed. BTCM took 0.8s. Estimated remaining: 11m 27s. Rate: 157.0 symbols/min [2025-10-17T22:35:58.386065] [DEBUG] [MAIN ] BTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:58.386760] [INFO ] [MAIN ] BTI: Generated 1820 derivative records from 54375 primary records. [2025-10-17T22:35:58.386824] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-17T22:35:58.402598] [DEBUG] [LOCAL ] BTI: Derivative data saved (1820 records). [2025-10-17T22:35:58.402697] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-10-17T22:35:58.404780] [INFO ] [MAIN ] Derivative Progress: 285/2083 symbols completed. BTI took 0.7s. Estimated remaining: 11m 26s. Rate: 157.2 symbols/min [2025-10-17T22:35:58.405509] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:58.405406] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:58.405636] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:58.420245] [DEBUG] [LOCAL ] BTO: Loaded 9046 existing records from primary storage. [2025-10-17T22:35:58.420465] [INFO ] [MAIN ] BTO: Loaded 9046 primary data records. [2025-10-17T22:35:58.543535] [DEBUG] [LOCAL ] BTZ: Loaded 22828 existing records from primary storage. [2025-10-17T22:35:58.594696] [INFO ] [MAIN ] BTZ: Loaded 22828 primary data records. [2025-10-17T22:35:58.951240] [DEBUG] [LOCAL ] BTU: Loaded 54104 existing records from primary storage. [2025-10-17T22:35:59.056905] [INFO ] [MAIN ] BTU: Loaded 54104 primary data records. [2025-10-17T22:35:59.392900] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:59.394379] [INFO ] [MAIN ] BTO: Generated 1820 derivative records from 9046 primary records. [2025-10-17T22:35:59.394987] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-17T22:35:59.426698] [DEBUG] [LOCAL ] BTO: Derivative data saved (1820 records). [2025-10-17T22:35:59.427211] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-17T22:35:59.429296] [INFO ] [MAIN ] Derivative Progress: 286/2083 symbols completed. BTO took 1.0s. Estimated remaining: 11m 30s. Rate: 156.3 symbols/min [2025-10-17T22:35:59.430141] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:59.429461] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:59.431071] [INFO ] [MAIN ] BTZ: Generated 1820 derivative records from 22828 primary records. [2025-10-17T22:35:59.431207] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-17T22:35:59.448183] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1820 records). [2025-10-17T22:35:59.448452] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-17T22:35:59.450360] [INFO ] [MAIN ] Derivative Progress: 287/2083 symbols completed. BTZ took 1.0s. Estimated remaining: 11m 27s. Rate: 156.8 symbols/min [2025-10-17T22:35:59.450535] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:59.468097] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:35:59.468844] [INFO ] [MAIN ] BTU: Generated 1820 derivative records from 54104 primary records. [2025-10-17T22:35:59.469096] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-10-17T22:35:59.490811] [DEBUG] [LOCAL ] BUI: Loaded 12102 existing records from primary storage. [2025-10-17T22:35:59.491508] [INFO ] [MAIN ] BUI: Loaded 12102 primary data records. [2025-10-17T22:35:59.575397] [DEBUG] [LOCAL ] BTU: Derivative data saved (1820 records). [2025-10-17T22:35:59.612618] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-10-17T22:35:59.631169] [INFO ] [MAIN ] Derivative Progress: 288/2083 symbols completed. BTU took 1.2s. Estimated remaining: 11m 26s. Rate: 157.1 symbols/min [2025-10-17T22:35:59.644676] [DEBUG] [LOCAL ] BUD: Loaded 53369 existing records from primary storage. [2025-10-17T22:35:59.655258] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:35:59.650029] [INFO ] [MAIN ] BUD: Loaded 53369 primary data records. [2025-10-17T22:36:00.191348] [DEBUG] [LOCAL ] BUR: Loaded 46071 existing records from primary storage. [2025-10-17T22:36:00.191708] [INFO ] [MAIN ] BUR: Loaded 46071 primary data records. [2025-10-17T22:36:00.519881] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:00.524679] [INFO ] [MAIN ] BUI: Generated 1820 derivative records from 12102 primary records. [2025-10-17T22:36:00.537743] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-17T22:36:00.538288] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:00.539893] [INFO ] [MAIN ] BUD: Generated 1820 derivative records from 53369 primary records. [2025-10-17T22:36:00.549315] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-17T22:36:00.574142] [DEBUG] [LOCAL ] BUD: Derivative data saved (1820 records). [2025-10-17T22:36:00.574428] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-17T22:36:00.574080] [DEBUG] [LOCAL ] BUI: Derivative data saved (1820 records). [2025-10-17T22:36:00.576776] [INFO ] [MAIN ] Derivative Progress: 289/2083 symbols completed. BUD took 1.1s. Estimated remaining: 11m 29s. Rate: 156.3 symbols/min [2025-10-17T22:36:00.574543] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-10-17T22:36:00.579163] [INFO ] [MAIN ] Derivative Progress: 290/2083 symbols completed. BUI took 1.1s. Estimated remaining: 11m 26s. Rate: 156.8 symbols/min [2025-10-17T22:36:00.577176] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:00.579854] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:00.596169] [DEBUG] [MAIN ] BUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:00.596856] [INFO ] [MAIN ] BUR: Generated 1820 derivative records from 46071 primary records. [2025-10-17T22:36:00.596973] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-17T22:36:00.630061] [DEBUG] [LOCAL ] BUXX: Loaded 15594 existing records from primary storage. [2025-10-17T22:36:00.630924] [INFO ] [MAIN ] BUXX: Loaded 15594 primary data records. [2025-10-17T22:36:00.630984] [DEBUG] [LOCAL ] BUR: Derivative data saved (1820 records). [2025-10-17T22:36:00.636409] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-17T22:36:00.669988] [INFO ] [MAIN ] Derivative Progress: 291/2083 symbols completed. BUR took 1.0s. Estimated remaining: 11m 24s. Rate: 157.2 symbols/min [2025-10-17T22:36:00.725542] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:00.822267] [DEBUG] [LOCAL ] BURL: Loaded 46304 existing records from primary storage. [2025-10-17T22:36:00.832349] [INFO ] [MAIN ] BURL: Loaded 46304 primary data records. [2025-10-17T22:36:01.313170] [DEBUG] [LOCAL ] BV: Loaded 39100 existing records from primary storage. [2025-10-17T22:36:01.314025] [INFO ] [MAIN ] BV: Loaded 39100 primary data records. [2025-10-17T22:36:01.528910] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:36:01.650267] [INFO ] [MAIN ] BUXX: Generated 1819 derivative records from 15594 primary records. [2025-10-17T22:36:01.650879] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-10-17T22:36:01.687492] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1819 records). [2025-10-17T22:36:01.688203] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-10-17T22:36:01.688017] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:01.691092] [INFO ] [MAIN ] Derivative Progress: 292/2083 symbols completed. BUXX took 1.1s. Estimated remaining: 11m 27s. Rate: 156.3 symbols/min [2025-10-17T22:36:01.689030] [INFO ] [MAIN ] BURL: Generated 1820 derivative records from 46304 primary records. [2025-10-17T22:36:01.691326] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:01.691494] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-17T22:36:01.711450] [DEBUG] [LOCAL ] BURL: Derivative data saved (1820 records). [2025-10-17T22:36:01.711800] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-17T22:36:01.714413] [INFO ] [MAIN ] Derivative Progress: 293/2083 symbols completed. BURL took 1.1s. Estimated remaining: 11m 25s. Rate: 156.8 symbols/min [2025-10-17T22:36:01.714876] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:01.740784] [DEBUG] [MAIN ] BV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:01.741743] [INFO ] [MAIN ] BV: Generated 1820 derivative records from 39100 primary records. [2025-10-17T22:36:01.742055] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-10-17T22:36:01.779147] [DEBUG] [LOCAL ] BV: Derivative data saved (1820 records). [2025-10-17T22:36:01.779956] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-10-17T22:36:01.782213] [INFO ] [MAIN ] Derivative Progress: 294/2083 symbols completed. BV took 1.1s. Estimated remaining: 11m 22s. Rate: 157.3 symbols/min [2025-10-17T22:36:01.782376] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:01.809585] [DEBUG] [LOCAL ] BVN: Loaded 45065 existing records from primary storage. [2025-10-17T22:36:01.810497] [INFO ] [MAIN ] BVN: Loaded 45065 primary data records. [2025-10-17T22:36:01.810408] [DEBUG] [LOCAL ] BW: Loaded 41213 existing records from primary storage. [2025-10-17T22:36:01.810836] [INFO ] [MAIN ] BW: Loaded 41213 primary data records. [2025-10-17T22:36:02.482624] [DEBUG] [LOCAL ] BWA: Loaded 52901 existing records from primary storage. [2025-10-17T22:36:02.483966] [INFO ] [MAIN ] BWA: Loaded 52901 primary data records. [2025-10-17T22:36:02.835853] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:02.842998] [INFO ] [MAIN ] BVN: Generated 1820 derivative records from 45065 primary records. [2025-10-17T22:36:02.843765] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-17T22:36:02.843472] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:02.845919] [INFO ] [MAIN ] BW: Generated 1820 derivative records from 41213 primary records. [2025-10-17T22:36:02.846131] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-10-17T22:36:02.878676] [DEBUG] [LOCAL ] BW: Derivative data saved (1820 records). [2025-10-17T22:36:02.880869] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-10-17T22:36:02.887010] [INFO ] [MAIN ] Derivative Progress: 295/2083 symbols completed. BW took 1.2s. Estimated remaining: 11m 26s. Rate: 156.3 symbols/min [2025-10-17T22:36:02.887893] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:02.895298] [DEBUG] [LOCAL ] BVN: Derivative data saved (1820 records). [2025-10-17T22:36:02.904817] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-10-17T22:36:02.904690] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:02.907217] [INFO ] [MAIN ] Derivative Progress: 296/2083 symbols completed. BVN took 1.2s. Estimated remaining: 11m 24s. Rate: 156.8 symbols/min [2025-10-17T22:36:02.908211] [INFO ] [MAIN ] BWA: Generated 1820 derivative records from 52901 primary records. [2025-10-17T22:36:02.908303] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-17T22:36:02.908448] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:02.933215] [DEBUG] [LOCAL ] BWA: Derivative data saved (1820 records). [2025-10-17T22:36:02.933332] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-17T22:36:02.932252] [DEBUG] [LOCAL ] BWNB: Loaded 4225 existing records from primary storage. [2025-10-17T22:36:02.935882] [INFO ] [MAIN ] Derivative Progress: 297/2083 symbols completed. BWA took 1.2s. Estimated remaining: 11m 21s. Rate: 157.3 symbols/min [2025-10-17T22:36:02.944750] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:02.945430] [INFO ] [MAIN ] BWNB: Loaded 4225 primary data records. [2025-10-17T22:36:03.052669] [DEBUG] [LOCAL ] BWSN: Loaded 5235 existing records from primary storage. [2025-10-17T22:36:03.058043] [INFO ] [MAIN ] BWSN: Loaded 5235 primary data records. [2025-10-17T22:36:03.081335] [DEBUG] [LOCAL ] BWLP: Loaded 32641 existing records from primary storage. [2025-10-17T22:36:03.134126] [INFO ] [MAIN ] BWLP: Loaded 32641 primary data records. [2025-10-17T22:36:03.982622] [DEBUG] [MAIN ] BWNB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:03.984013] [INFO ] [MAIN ] BWNB: Generated 1820 derivative records from 4225 primary records. [2025-10-17T22:36:03.984357] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-17T22:36:04.002455] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1820 records). [2025-10-17T22:36:04.002787] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-17T22:36:04.005220] [INFO ] [MAIN ] Derivative Progress: 298/2083 symbols completed. BWNB took 1.1s. Estimated remaining: 11m 25s. Rate: 156.3 symbols/min [2025-10-17T22:36:04.019197] [DEBUG] [MAIN ] BWSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:04.021218] [INFO ] [MAIN ] BWSN: Generated 1820 derivative records from 5235 primary records. [2025-10-17T22:36:04.022366] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-17T22:36:04.056399] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1820 records). [2025-10-17T22:36:04.056601] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-17T22:36:04.059169] [INFO ] [MAIN ] Derivative Progress: 299/2083 symbols completed. BWSN took 1.1s. Estimated remaining: 11m 23s. Rate: 156.8 symbols/min [2025-10-17T22:36:04.059760] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:04.060717] [INFO ] [MAIN ] BWLP: Generated 1820 derivative records from 32641 primary records. [2025-10-17T22:36:04.060802] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-17T22:36:04.083676] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1820 records). [2025-10-17T22:36:04.083796] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-17T22:36:04.086727] [INFO ] [MAIN ] Derivative Progress: 300/2083 symbols completed. BWLP took 1.2s. Estimated remaining: 11m 20s. Rate: 157.3 symbols/min [2025-10-17T22:36:04.087259] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:04.087380] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:04.087199] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:04.108273] [DEBUG] [LOCAL ] BXC: Loaded 13776 existing records from primary storage. [2025-10-17T22:36:04.108409] [INFO ] [MAIN ] BXC: Loaded 13776 primary data records. [2025-10-17T22:36:04.449593] [DEBUG] [LOCAL ] BWXT: Loaded 47875 existing records from primary storage. [2025-10-17T22:36:04.450006] [INFO ] [MAIN ] BWXT: Loaded 47875 primary data records. [2025-10-17T22:36:04.541083] [DEBUG] [LOCAL ] BX: Loaded 54263 existing records from primary storage. [2025-10-17T22:36:04.568266] [INFO ] [MAIN ] BX: Loaded 54263 primary data records. [2025-10-17T22:36:05.114803] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:05.116475] [INFO ] [MAIN ] BXC: Generated 1820 derivative records from 13776 primary records. [2025-10-17T22:36:05.116836] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-10-17T22:36:05.134262] [DEBUG] [LOCAL ] BXC: Derivative data saved (1820 records). [2025-10-17T22:36:05.135021] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-10-17T22:36:05.138075] [INFO ] [MAIN ] Derivative Progress: 301/2083 symbols completed. BXC took 1.1s. Estimated remaining: 11m 24s. Rate: 156.3 symbols/min [2025-10-17T22:36:05.139010] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:05.160398] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:05.161374] [INFO ] [MAIN ] BWXT: Generated 1820 derivative records from 47875 primary records. [2025-10-17T22:36:05.161472] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-17T22:36:05.191805] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:05.193499] [INFO ] [MAIN ] BX: Generated 1820 derivative records from 54263 primary records. [2025-10-17T22:36:05.204514] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-10-17T22:36:05.205690] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1820 records). [2025-10-17T22:36:05.206064] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-17T22:36:05.215554] [INFO ] [MAIN ] Derivative Progress: 302/2083 symbols completed. BWXT took 1.1s. Estimated remaining: 11m 22s. Rate: 156.8 symbols/min [2025-10-17T22:36:05.224224] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:05.224075] [DEBUG] [LOCAL ] BX: Derivative data saved (1820 records). [2025-10-17T22:36:05.224503] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-10-17T22:36:05.227237] [INFO ] [MAIN ] Derivative Progress: 303/2083 symbols completed. BX took 1.1s. Estimated remaining: 11m 19s. Rate: 157.3 symbols/min [2025-10-17T22:36:05.228398] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:05.243029] [DEBUG] [LOCAL ] BXMT: Loaded 48048 existing records from primary storage. [2025-10-17T22:36:05.243312] [INFO ] [MAIN ] BXMT: Loaded 48048 primary data records. [2025-10-17T22:36:05.409853] [DEBUG] [LOCAL ] BXMX: Loaded 19717 existing records from primary storage. [2025-10-17T22:36:05.433845] [INFO ] [MAIN ] BXMX: Loaded 19717 primary data records. [2025-10-17T22:36:05.803615] [DEBUG] [LOCAL ] BXP: Loaded 50594 existing records from primary storage. [2025-10-17T22:36:05.951544] [INFO ] [MAIN ] BXP: Loaded 50594 primary data records. [2025-10-17T22:36:06.139618] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:06.151432] [INFO ] [MAIN ] BXMT: Generated 1820 derivative records from 48048 primary records. [2025-10-17T22:36:06.151544] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-10-17T22:36:06.315468] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1820 records). [2025-10-17T22:36:06.315908] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-10-17T22:36:06.317976] [INFO ] [MAIN ] Derivative Progress: 304/2083 symbols completed. BXMT took 1.2s. Estimated remaining: 11m 23s. Rate: 156.3 symbols/min [2025-10-17T22:36:06.318907] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:06.339078] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:06.339873] [INFO ] [MAIN ] BXMX: Generated 1820 derivative records from 19717 primary records. [2025-10-17T22:36:06.340055] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-17T22:36:06.360345] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1820 records). [2025-10-17T22:36:06.361305] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-10-17T22:36:06.363560] [INFO ] [MAIN ] Derivative Progress: 305/2083 symbols completed. BXMX took 1.1s. Estimated remaining: 11m 21s. Rate: 156.8 symbols/min [2025-10-17T22:36:06.363800] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:06.379902] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:06.381138] [INFO ] [MAIN ] BXP: Generated 1820 derivative records from 50594 primary records. [2025-10-17T22:36:06.391920] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-17T22:36:06.430271] [DEBUG] [LOCAL ] BXP: Derivative data saved (1820 records). [2025-10-17T22:36:06.431754] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-10-17T22:36:06.431616] [DEBUG] [LOCAL ] BXSL: Loaded 48894 existing records from primary storage. [2025-10-17T22:36:06.434266] [INFO ] [MAIN ] Derivative Progress: 306/2083 symbols completed. BXP took 1.2s. Estimated remaining: 11m 18s. Rate: 157.2 symbols/min [2025-10-17T22:36:06.441717] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:06.434480] [INFO ] [MAIN ] BXSL: Loaded 48894 primary data records. [2025-10-17T22:36:06.479183] [DEBUG] [LOCAL ] BY: Loaded 22175 existing records from primary storage. [2025-10-17T22:36:06.511240] [INFO ] [MAIN ] BY: Loaded 22175 primary data records. [2025-10-17T22:36:07.067123] [DEBUG] [LOCAL ] BYD: Loaded 45593 existing records from primary storage. [2025-10-17T22:36:07.067733] [INFO ] [MAIN ] BYD: Loaded 45593 primary data records. [2025-10-17T22:36:07.385166] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:07.386554] [INFO ] [MAIN ] BXSL: Generated 1820 derivative records from 48894 primary records. [2025-10-17T22:36:07.386899] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-10-17T22:36:07.419636] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:07.421527] [INFO ] [MAIN ] BY: Generated 1820 derivative records from 22175 primary records. [2025-10-17T22:36:07.421741] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1820 records). [2025-10-17T22:36:07.421856] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-17T22:36:07.421938] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-10-17T22:36:07.423932] [INFO ] [MAIN ] Derivative Progress: 307/2083 symbols completed. BXSL took 1.1s. Estimated remaining: 11m 21s. Rate: 156.4 symbols/min [2025-10-17T22:36:07.425665] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:07.448692] [DEBUG] [LOCAL ] BY: Derivative data saved (1820 records). [2025-10-17T22:36:07.448969] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-10-17T22:36:07.451526] [INFO ] [MAIN ] Derivative Progress: 308/2083 symbols completed. BY took 1.1s. Estimated remaining: 11m 19s. Rate: 156.8 symbols/min [2025-10-17T22:36:07.451897] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:07.469603] [DEBUG] [LOCAL ] BYM: Loaded 11842 existing records from primary storage. [2025-10-17T22:36:07.470017] [INFO ] [MAIN ] BYM: Loaded 11842 primary data records. [2025-10-17T22:36:07.469945] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:07.470779] [INFO ] [MAIN ] BYD: Generated 1820 derivative records from 45593 primary records. [2025-10-17T22:36:07.491422] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-17T22:36:07.654782] [DEBUG] [LOCAL ] BYD: Derivative data saved (1820 records). [2025-10-17T22:36:07.780261] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-17T22:36:07.791533] [INFO ] [MAIN ] Derivative Progress: 309/2083 symbols completed. BYD took 1.3s. Estimated remaining: 11m 18s. Rate: 156.9 symbols/min [2025-10-17T22:36:07.802088] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:07.803078] [DEBUG] [LOCAL ] BZH: Loaded 32798 existing records from primary storage. [2025-10-17T22:36:07.803148] [INFO ] [MAIN ] BZH: Loaded 32798 primary data records. [2025-10-17T22:36:08.179746] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:08.180796] [INFO ] [MAIN ] BYM: Generated 1820 derivative records from 11842 primary records. [2025-10-17T22:36:08.181292] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-17T22:36:08.214372] [DEBUG] [LOCAL ] C: Loaded 54520 existing records from primary storage. [2025-10-17T22:36:08.215775] [INFO ] [MAIN ] C: Loaded 54520 primary data records. [2025-10-17T22:36:08.217056] [DEBUG] [LOCAL ] BYM: Derivative data saved (1820 records). [2025-10-17T22:36:08.228755] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-17T22:36:08.250943] [INFO ] [MAIN ] Derivative Progress: 310/2083 symbols completed. BYM took 0.8s. Estimated remaining: 11m 18s. Rate: 156.8 symbols/min [2025-10-17T22:36:08.275673] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:08.532780] [DEBUG] [LOCAL ] CAAP: Loaded 20139 existing records from primary storage. [2025-10-17T22:36:08.541871] [INFO ] [MAIN ] CAAP: Loaded 20139 primary data records. [2025-10-17T22:36:08.611679] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:08.626578] [INFO ] [MAIN ] BZH: Generated 1820 derivative records from 32798 primary records. [2025-10-17T22:36:08.633543] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-17T22:36:08.882764] [DEBUG] [LOCAL ] BZH: Derivative data saved (1820 records). [2025-10-17T22:36:08.882936] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-17T22:36:08.886018] [INFO ] [MAIN ] Derivative Progress: 311/2083 symbols completed. BZH took 1.4s. Estimated remaining: 11m 20s. Rate: 156.5 symbols/min [2025-10-17T22:36:08.886991] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:08.914125] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:08.914969] [INFO ] [MAIN ] C: Generated 1820 derivative records from 54520 primary records. [2025-10-17T22:36:08.915141] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-10-17T22:36:08.922438] [DEBUG] [LOCAL ] CABO: Loaded 16919 existing records from primary storage. [2025-10-17T22:36:08.922542] [INFO ] [MAIN ] CABO: Loaded 16919 primary data records. [2025-10-17T22:36:09.032033] [DEBUG] [LOCAL ] C: Derivative data saved (1820 records). [2025-10-17T22:36:09.048828] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:09.042152] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-10-17T22:36:09.059722] [INFO ] [MAIN ] Derivative Progress: 312/2083 symbols completed. C took 1.3s. Estimated remaining: 11m 18s. Rate: 156.7 symbols/min [2025-10-17T22:36:09.057347] [INFO ] [MAIN ] CAAP: Generated 1820 derivative records from 20139 primary records. [2025-10-17T22:36:09.059935] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:09.064171] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-17T22:36:09.285189] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1820 records). [2025-10-17T22:36:09.285972] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-17T22:36:09.288326] [INFO ] [MAIN ] Derivative Progress: 313/2083 symbols completed. CAAP took 1.0s. Estimated remaining: 11m 17s. Rate: 156.9 symbols/min [2025-10-17T22:36:09.299063] [DEBUG] [LOCAL ] CACI: Loaded 23405 existing records from primary storage. [2025-10-17T22:36:09.300018] [INFO ] [MAIN ] CACI: Loaded 23405 primary data records. [2025-10-17T22:36:09.615310] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:09.616511] [INFO ] [MAIN ] CABO: Generated 1820 derivative records from 16919 primary records. [2025-10-17T22:36:09.616767] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-17T22:36:09.634587] [DEBUG] [LOCAL ] CABO: Derivative data saved (1820 records). [2025-10-17T22:36:09.634929] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-17T22:36:09.637148] [INFO ] [MAIN ] Derivative Progress: 314/2083 symbols completed. CABO took 0.8s. Estimated remaining: 11m 16s. Rate: 157.0 symbols/min [2025-10-17T22:36:09.654048] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:09.654679] [INFO ] [MAIN ] CACI: Generated 1820 derivative records from 23405 primary records. [2025-10-17T22:36:09.654742] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-17T22:36:09.670389] [DEBUG] [LOCAL ] CACI: Derivative data saved (1820 records). [2025-10-17T22:36:09.670460] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-17T22:36:09.672710] [INFO ] [MAIN ] Derivative Progress: 315/2083 symbols completed. CACI took 0.6s. Estimated remaining: 11m 14s. Rate: 157.4 symbols/min [2025-10-17T22:36:09.673301] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:09.673459] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:09.673392] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:09.680251] [DEBUG] [LOCAL ] CAF: Loaded 3545 existing records from primary storage. [2025-10-17T22:36:09.680495] [INFO ] [MAIN ] CAF: Loaded 3545 primary data records. [2025-10-17T22:36:10.048004] [DEBUG] [LOCAL ] CAE: Loaded 39813 existing records from primary storage. [2025-10-17T22:36:10.049535] [INFO ] [MAIN ] CAE: Loaded 39813 primary data records. [2025-10-17T22:36:10.050406] [DEBUG] [LOCAL ] CADE: Loaded 50257 existing records from primary storage. [2025-10-17T22:36:10.061674] [INFO ] [MAIN ] CADE: Loaded 50257 primary data records. [2025-10-17T22:36:10.668576] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:10.669597] [INFO ] [MAIN ] CAF: Generated 1820 derivative records from 3545 primary records. [2025-10-17T22:36:10.670672] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-10-17T22:36:10.688449] [DEBUG] [LOCAL ] CAF: Derivative data saved (1820 records). [2025-10-17T22:36:10.688583] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-10-17T22:36:10.691299] [INFO ] [MAIN ] Derivative Progress: 316/2083 symbols completed. CAF took 1.0s. Estimated remaining: 11m 17s. Rate: 156.6 symbols/min [2025-10-17T22:36:10.692027] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:10.710034] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:10.712564] [INFO ] [MAIN ] CADE: Generated 1820 derivative records from 50257 primary records. [2025-10-17T22:36:10.712712] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-17T22:36:10.740121] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:10.742104] [INFO ] [MAIN ] CAE: Generated 1820 derivative records from 39813 primary records. [2025-10-17T22:36:10.742974] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-17T22:36:10.764909] [DEBUG] [LOCAL ] CADE: Derivative data saved (1820 records). [2025-10-17T22:36:10.764129] [DEBUG] [LOCAL ] CAE: Derivative data saved (1820 records). [2025-10-17T22:36:10.765046] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-17T22:36:10.767282] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-17T22:36:10.767196] [INFO ] [MAIN ] Derivative Progress: 317/2083 symbols completed. CADE took 1.1s. Estimated remaining: 11m 15s. Rate: 157.0 symbols/min [2025-10-17T22:36:10.769992] [INFO ] [MAIN ] Derivative Progress: 318/2083 symbols completed. CAE took 1.1s. Estimated remaining: 11m 12s. Rate: 157.5 symbols/min [2025-10-17T22:36:10.769937] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:10.770171] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:10.820466] [DEBUG] [LOCAL ] CAH: Loaded 52214 existing records from primary storage. [2025-10-17T22:36:10.828629] [INFO ] [MAIN ] CAH: Loaded 52214 primary data records. [2025-10-17T22:36:10.943161] [DEBUG] [LOCAL ] CAL: Loaded 43547 existing records from primary storage. [2025-10-17T22:36:10.946692] [INFO ] [MAIN ] CAL: Loaded 43547 primary data records. [2025-10-17T22:36:10.973825] [DEBUG] [LOCAL ] CALX: Loaded 38084 existing records from primary storage. [2025-10-17T22:36:10.979102] [INFO ] [MAIN ] CALX: Loaded 38084 primary data records. [2025-10-17T22:36:11.819255] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:11.820168] [INFO ] [MAIN ] CAH: Generated 1820 derivative records from 52214 primary records. [2025-10-17T22:36:11.820474] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-17T22:36:11.851670] [DEBUG] [LOCAL ] CAH: Derivative data saved (1820 records). [2025-10-17T22:36:11.858141] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-17T22:36:11.861059] [INFO ] [MAIN ] Derivative Progress: 319/2083 symbols completed. CAH took 1.2s. Estimated remaining: 11m 16s. Rate: 156.6 symbols/min [2025-10-17T22:36:11.861573] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:11.861396] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:11.863074] [INFO ] [MAIN ] CAL: Generated 1820 derivative records from 43547 primary records. [2025-10-17T22:36:11.863165] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-17T22:36:11.888994] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:11.890780] [INFO ] [MAIN ] CALX: Generated 1820 derivative records from 38084 primary records. [2025-10-17T22:36:11.892171] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-17T22:36:11.909803] [DEBUG] [LOCAL ] CAL: Derivative data saved (1820 records). [2025-10-17T22:36:11.918191] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-17T22:36:11.918094] [DEBUG] [LOCAL ] CALX: Derivative data saved (1820 records). [2025-10-17T22:36:11.921198] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-17T22:36:11.920577] [INFO ] [MAIN ] Derivative Progress: 320/2083 symbols completed. CAL took 1.2s. Estimated remaining: 11m 14s. Rate: 157.0 symbols/min [2025-10-17T22:36:11.931856] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:11.931970] [INFO ] [MAIN ] Derivative Progress: 321/2083 symbols completed. CALX took 1.2s. Estimated remaining: 11m 11s. Rate: 157.5 symbols/min [2025-10-17T22:36:11.933036] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:11.932574] [DEBUG] [LOCAL ] CANG: Loaded 27428 existing records from primary storage. [2025-10-17T22:36:11.933530] [INFO ] [MAIN ] CANG: Loaded 27428 primary data records. [2025-10-17T22:36:12.044339] [DEBUG] [LOCAL ] CAPL: Loaded 5696 existing records from primary storage. [2025-10-17T22:36:12.048420] [INFO ] [MAIN ] CAPL: Loaded 5696 primary data records. [2025-10-17T22:36:12.569693] [DEBUG] [LOCAL ] CARR: Loaded 54382 existing records from primary storage. [2025-10-17T22:36:12.570021] [INFO ] [MAIN ] CARR: Loaded 54382 primary data records. [2025-10-17T22:36:12.893622] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:12.895304] [INFO ] [MAIN ] CANG: Generated 1820 derivative records from 27428 primary records. [2025-10-17T22:36:12.895637] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-17T22:36:12.915841] [DEBUG] [LOCAL ] CANG: Derivative data saved (1820 records). [2025-10-17T22:36:12.916072] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-10-17T22:36:12.918259] [INFO ] [MAIN ] Derivative Progress: 322/2083 symbols completed. CANG took 1.1s. Estimated remaining: 11m 14s. Rate: 156.7 symbols/min [2025-10-17T22:36:12.919391] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:12.936102] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:12.936988] [INFO ] [MAIN ] CAPL: Generated 1820 derivative records from 5696 primary records. [2025-10-17T22:36:12.937263] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-17T22:36:12.955682] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1820 records). [2025-10-17T22:36:12.963316] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-17T22:36:12.968498] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:12.970701] [INFO ] [MAIN ] Derivative Progress: 323/2083 symbols completed. CAPL took 1.0s. Estimated remaining: 11m 12s. Rate: 157.1 symbols/min [2025-10-17T22:36:12.971869] [INFO ] [MAIN ] CARR: Generated 1820 derivative records from 54382 primary records. [2025-10-17T22:36:12.970947] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:12.972378] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-17T22:36:13.003046] [DEBUG] [LOCAL ] CARR: Derivative data saved (1820 records). [2025-10-17T22:36:13.003358] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-17T22:36:13.005681] [INFO ] [MAIN ] Derivative Progress: 324/2083 symbols completed. CARR took 1.1s. Estimated remaining: 11m 10s. Rate: 157.6 symbols/min [2025-10-17T22:36:13.006831] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:13.028529] [DEBUG] [LOCAL ] CARS: Loaded 40383 existing records from primary storage. [2025-10-17T22:36:13.029006] [INFO ] [MAIN ] CARS: Loaded 40383 primary data records. [2025-10-17T22:36:13.122605] [DEBUG] [LOCAL ] CATO: Loaded 6799 existing records from primary storage. [2025-10-17T22:36:13.133224] [INFO ] [MAIN ] CATO: Loaded 6799 primary data records. [2025-10-17T22:36:13.524927] [DEBUG] [LOCAL ] CAT: Loaded 53736 existing records from primary storage. [2025-10-17T22:36:13.553026] [INFO ] [MAIN ] CAT: Loaded 53736 primary data records. [2025-10-17T22:36:14.099006] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:14.104948] [INFO ] [MAIN ] CARS: Generated 1820 derivative records from 40383 primary records. [2025-10-17T22:36:14.105392] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:14.106503] [INFO ] [MAIN ] CATO: Generated 1820 derivative records from 6799 primary records. [2025-10-17T22:36:14.105746] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-17T22:36:14.107543] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-17T22:36:14.135516] [DEBUG] [LOCAL ] CARS: Derivative data saved (1820 records). [2025-10-17T22:36:14.136061] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-17T22:36:14.139089] [INFO ] [MAIN ] Derivative Progress: 325/2083 symbols completed. CARS took 1.2s. Estimated remaining: 11m 14s. Rate: 156.6 symbols/min [2025-10-17T22:36:14.139690] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:14.143263] [DEBUG] [LOCAL ] CATO: Derivative data saved (1820 records). [2025-10-17T22:36:14.144540] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-17T22:36:14.147338] [INFO ] [MAIN ] Derivative Progress: 326/2083 symbols completed. CATO took 1.1s. Estimated remaining: 11m 11s. Rate: 157.1 symbols/min [2025-10-17T22:36:14.147792] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:14.161792] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:14.162639] [INFO ] [MAIN ] CAT: Generated 1820 derivative records from 53736 primary records. [2025-10-17T22:36:14.162816] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-17T22:36:14.188720] [DEBUG] [LOCAL ] CAT: Derivative data saved (1820 records). [2025-10-17T22:36:14.188857] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-17T22:36:14.191689] [INFO ] [MAIN ] Derivative Progress: 327/2083 symbols completed. CAT took 1.2s. Estimated remaining: 11m 9s. Rate: 157.5 symbols/min [2025-10-17T22:36:14.192076] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:14.196746] [DEBUG] [LOCAL ] CBAN: Loaded 10619 existing records from primary storage. [2025-10-17T22:36:14.197111] [INFO ] [MAIN ] CBAN: Loaded 10619 primary data records. [2025-10-17T22:36:14.399321] [DEBUG] [LOCAL ] CBL: Loaded 16467 existing records from primary storage. [2025-10-17T22:36:14.400989] [INFO ] [MAIN ] CBL: Loaded 16467 primary data records. [2025-10-17T22:36:14.400769] [DEBUG] [LOCAL ] CB: Loaded 50716 existing records from primary storage. [2025-10-17T22:36:14.440096] [INFO ] [MAIN ] CB: Loaded 50716 primary data records. [2025-10-17T22:36:15.202481] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:15.205408] [INFO ] [MAIN ] CBAN: Generated 1820 derivative records from 10619 primary records. [2025-10-17T22:36:15.205741] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-17T22:36:15.223488] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1820 records). [2025-10-17T22:36:15.224076] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-17T22:36:15.226531] [INFO ] [MAIN ] Derivative Progress: 328/2083 symbols completed. CBAN took 1.1s. Estimated remaining: 11m 12s. Rate: 156.7 symbols/min [2025-10-17T22:36:15.244743] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:15.246341] [INFO ] [MAIN ] CBL: Generated 1820 derivative records from 16467 primary records. [2025-10-17T22:36:15.247203] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-17T22:36:15.276728] [DEBUG] [LOCAL ] CBL: Derivative data saved (1820 records). [2025-10-17T22:36:15.272696] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:15.276823] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-17T22:36:15.278995] [INFO ] [MAIN ] Derivative Progress: 329/2083 symbols completed. CBL took 1.1s. Estimated remaining: 11m 10s. Rate: 157.1 symbols/min [2025-10-17T22:36:15.279863] [INFO ] [MAIN ] CB: Generated 1820 derivative records from 50716 primary records. [2025-10-17T22:36:15.279936] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-17T22:36:15.295597] [DEBUG] [LOCAL ] CB: Derivative data saved (1820 records). [2025-10-17T22:36:15.295694] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-17T22:36:15.297832] [INFO ] [MAIN ] Derivative Progress: 330/2083 symbols completed. CB took 1.2s. Estimated remaining: 11m 8s. Rate: 157.6 symbols/min [2025-10-17T22:36:15.298224] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:15.298335] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:15.298674] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:15.306239] [DEBUG] [LOCAL ] CBNA: Loaded 2942 existing records from primary storage. [2025-10-17T22:36:15.306352] [INFO ] [MAIN ] CBNA: Loaded 2942 primary data records. [2025-10-17T22:36:15.626230] [DEBUG] [LOCAL ] CBT: Loaded 31588 existing records from primary storage. [2025-10-17T22:36:15.627048] [INFO ] [MAIN ] CBT: Loaded 31588 primary data records. [2025-10-17T22:36:15.723129] [DEBUG] [LOCAL ] CBRE: Loaded 51089 existing records from primary storage. [2025-10-17T22:36:15.745327] [INFO ] [MAIN ] CBRE: Loaded 51089 primary data records. [2025-10-17T22:36:16.340921] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:16.342123] [INFO ] [MAIN ] CBNA: Generated 1820 derivative records from 2942 primary records. [2025-10-17T22:36:16.342497] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-17T22:36:16.375702] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1820 records). [2025-10-17T22:36:16.376204] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:16.377382] [INFO ] [MAIN ] CBT: Generated 1820 derivative records from 31588 primary records. [2025-10-17T22:36:16.376682] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-17T22:36:16.380003] [INFO ] [MAIN ] Derivative Progress: 331/2083 symbols completed. CBNA took 1.1s. Estimated remaining: 11m 11s. Rate: 156.7 symbols/min [2025-10-17T22:36:16.380132] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-17T22:36:16.380262] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:16.400370] [DEBUG] [LOCAL ] CBT: Derivative data saved (1820 records). [2025-10-17T22:36:16.400686] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-17T22:36:16.402736] [INFO ] [MAIN ] Derivative Progress: 332/2083 symbols completed. CBT took 1.1s. Estimated remaining: 11m 9s. Rate: 157.1 symbols/min [2025-10-17T22:36:16.403163] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:16.417445] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:16.418285] [INFO ] [MAIN ] CBRE: Generated 1820 derivative records from 51089 primary records. [2025-10-17T22:36:16.418609] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-17T22:36:16.449038] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1820 records). [2025-10-17T22:36:16.450636] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-17T22:36:16.452765] [INFO ] [MAIN ] Derivative Progress: 333/2083 symbols completed. CBRE took 1.2s. Estimated remaining: 11m 6s. Rate: 157.5 symbols/min [2025-10-17T22:36:16.450475] [DEBUG] [LOCAL ] CBU: Loaded 23143 existing records from primary storage. [2025-10-17T22:36:16.453017] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:16.453230] [INFO ] [MAIN ] CBU: Loaded 23143 primary data records. [2025-10-17T22:36:16.576263] [DEBUG] [LOCAL ] CBZ: Loaded 34777 existing records from primary storage. [2025-10-17T22:36:16.602422] [INFO ] [MAIN ] CBZ: Loaded 34777 primary data records. [2025-10-17T22:36:16.991250] [DEBUG] [LOCAL ] CC: Loaded 53789 existing records from primary storage. [2025-10-17T22:36:16.991935] [INFO ] [MAIN ] CC: Loaded 53789 primary data records. [2025-10-17T22:36:17.443128] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:17.444972] [INFO ] [MAIN ] CBU: Generated 1820 derivative records from 23143 primary records. [2025-10-17T22:36:17.445394] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-17T22:36:17.464444] [DEBUG] [LOCAL ] CBU: Derivative data saved (1820 records). [2025-10-17T22:36:17.465360] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-17T22:36:17.467741] [INFO ] [MAIN ] Derivative Progress: 334/2083 symbols completed. CBU took 1.1s. Estimated remaining: 11m 9s. Rate: 156.8 symbols/min [2025-10-17T22:36:17.468106] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:17.490082] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:17.491174] [INFO ] [MAIN ] CBZ: Generated 1820 derivative records from 34777 primary records. [2025-10-17T22:36:17.491526] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-17T22:36:17.510130] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1820 records). [2025-10-17T22:36:17.510359] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-17T22:36:17.513309] [INFO ] [MAIN ] Derivative Progress: 335/2083 symbols completed. CBZ took 1.1s. Estimated remaining: 11m 7s. Rate: 157.2 symbols/min [2025-10-17T22:36:17.513803] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:17.531915] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:17.532717] [INFO ] [MAIN ] CC: Generated 1820 derivative records from 53789 primary records. [2025-10-17T22:36:17.532919] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-17T22:36:17.575257] [DEBUG] [LOCAL ] CCIF: Loaded 15711 existing records from primary storage. [2025-10-17T22:36:17.576438] [INFO ] [MAIN ] CCIF: Loaded 15711 primary data records. [2025-10-17T22:36:17.611345] [DEBUG] [LOCAL ] CC: Derivative data saved (1820 records). [2025-10-17T22:36:17.616868] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-17T22:36:17.639156] [INFO ] [MAIN ] Derivative Progress: 336/2083 symbols completed. CC took 1.2s. Estimated remaining: 11m 6s. Rate: 157.5 symbols/min [2025-10-17T22:36:17.654233] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:17.707419] [DEBUG] [LOCAL ] CCI: Loaded 53890 existing records from primary storage. [2025-10-17T22:36:17.712260] [INFO ] [MAIN ] CCI: Loaded 53890 primary data records. [2025-10-17T22:36:18.353836] [DEBUG] [LOCAL ] CCJ: Loaded 54468 existing records from primary storage. [2025-10-17T22:36:18.354596] [INFO ] [MAIN ] CCJ: Loaded 54468 primary data records. [2025-10-17T22:36:18.696364] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:18.697349] [INFO ] [MAIN ] CCIF: Generated 1820 derivative records from 15711 primary records. [2025-10-17T22:36:18.697469] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-17T22:36:18.718563] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1820 records). [2025-10-17T22:36:18.719097] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-17T22:36:18.721672] [INFO ] [MAIN ] Derivative Progress: 337/2083 symbols completed. CCIF took 1.2s. Estimated remaining: 11m 9s. Rate: 156.6 symbols/min [2025-10-17T22:36:18.721962] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:18.736565] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:18.737541] [INFO ] [MAIN ] CCI: Generated 1820 derivative records from 53890 primary records. [2025-10-17T22:36:18.737804] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-17T22:36:18.757840] [DEBUG] [LOCAL ] CCI: Derivative data saved (1820 records). [2025-10-17T22:36:18.758272] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-17T22:36:18.760926] [INFO ] [MAIN ] Derivative Progress: 338/2083 symbols completed. CCI took 1.3s. Estimated remaining: 11m 7s. Rate: 157.0 symbols/min [2025-10-17T22:36:18.761513] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:18.778701] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:18.779444] [INFO ] [MAIN ] CCJ: Generated 1820 derivative records from 54468 primary records. [2025-10-17T22:36:18.779602] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-17T22:36:18.807004] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1820 records). [2025-10-17T22:36:18.807158] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-17T22:36:18.809506] [INFO ] [MAIN ] Derivative Progress: 339/2083 symbols completed. CCJ took 1.2s. Estimated remaining: 11m 5s. Rate: 157.5 symbols/min [2025-10-17T22:36:18.810609] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:18.827020] [DEBUG] [LOCAL ] CCK: Loaded 47154 existing records from primary storage. [2025-10-17T22:36:18.827310] [INFO ] [MAIN ] CCK: Loaded 47154 primary data records. [2025-10-17T22:36:19.052860] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-10-17T22:36:19.058309] [INFO ] [MAIN ] CCL: Loaded 54580 primary data records. [2025-10-17T22:36:19.298840] [DEBUG] [LOCAL ] CCO: Loaded 49089 existing records from primary storage. [2025-10-17T22:36:19.335147] [INFO ] [MAIN ] CCO: Loaded 49089 primary data records. [2025-10-17T22:36:19.882247] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:19.884038] [INFO ] [MAIN ] CCK: Generated 1820 derivative records from 47154 primary records. [2025-10-17T22:36:19.884194] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-17T22:36:19.903609] [DEBUG] [LOCAL ] CCK: Derivative data saved (1820 records). [2025-10-17T22:36:19.904248] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-17T22:36:19.907097] [INFO ] [MAIN ] Derivative Progress: 340/2083 symbols completed. CCK took 1.2s. Estimated remaining: 11m 8s. Rate: 156.6 symbols/min [2025-10-17T22:36:19.908137] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:19.931042] [DEBUG] [MAIN ] CCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:19.932372] [INFO ] [MAIN ] CCL: Generated 1820 derivative records from 54580 primary records. [2025-10-17T22:36:19.936728] [DEBUG] [LOCAL ] CCRD: Loaded 9647 existing records from primary storage. [2025-10-17T22:36:19.936970] [INFO ] [MAIN ] CCRD: Loaded 9647 primary data records. [2025-10-17T22:36:19.936447] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-17T22:36:20.072715] [DEBUG] [LOCAL ] CCL: Derivative data saved (1820 records). [2025-10-17T22:36:20.078153] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-17T22:36:20.090720] [INFO ] [MAIN ] Derivative Progress: 341/2083 symbols completed. CCL took 1.3s. Estimated remaining: 11m 6s. Rate: 156.8 symbols/min [2025-10-17T22:36:20.131413] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:20.274104] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:20.275869] [INFO ] [MAIN ] CCO: Generated 1820 derivative records from 49089 primary records. [2025-10-17T22:36:20.275992] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-17T22:36:20.303676] [DEBUG] [LOCAL ] CCO: Derivative data saved (1820 records). [2025-10-17T22:36:20.304984] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-17T22:36:20.307978] [INFO ] [MAIN ] Derivative Progress: 342/2083 symbols completed. CCO took 1.5s. Estimated remaining: 11m 5s. Rate: 157.0 symbols/min [2025-10-17T22:36:20.308362] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:20.320739] [DEBUG] [LOCAL ] CCS: Loaded 30600 existing records from primary storage. [2025-10-17T22:36:20.321102] [INFO ] [MAIN ] CCS: Loaded 30600 primary data records. [2025-10-17T22:36:20.449979] [DEBUG] [LOCAL ] CCU: Loaded 22640 existing records from primary storage. [2025-10-17T22:36:20.469560] [INFO ] [MAIN ] CCU: Loaded 22640 primary data records. [2025-10-17T22:36:20.509878] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:20.564380] [INFO ] [MAIN ] CCRD: Generated 1820 derivative records from 9647 primary records. [2025-10-17T22:36:20.576756] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-17T22:36:20.778916] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1820 records). [2025-10-17T22:36:20.779086] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-17T22:36:20.781427] [INFO ] [MAIN ] Derivative Progress: 343/2083 symbols completed. CCRD took 0.9s. Estimated remaining: 11m 5s. Rate: 156.9 symbols/min [2025-10-17T22:36:21.012479] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:21.013236] [INFO ] [MAIN ] CCS: Generated 1820 derivative records from 30600 primary records. [2025-10-17T22:36:21.013396] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-17T22:36:21.030040] [DEBUG] [LOCAL ] CCS: Derivative data saved (1820 records). [2025-10-17T22:36:21.031459] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-17T22:36:21.034126] [INFO ] [MAIN ] Derivative Progress: 344/2083 symbols completed. CCS took 0.9s. Estimated remaining: 11m 4s. Rate: 157.1 symbols/min [2025-10-17T22:36:21.046773] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:21.047300] [INFO ] [MAIN ] CCU: Generated 1820 derivative records from 22640 primary records. [2025-10-17T22:36:21.047413] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-17T22:36:21.062542] [DEBUG] [LOCAL ] CCU: Derivative data saved (1820 records). [2025-10-17T22:36:21.062604] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-17T22:36:21.064635] [INFO ] [MAIN ] Derivative Progress: 345/2083 symbols completed. CCU took 0.8s. Estimated remaining: 11m 2s. Rate: 157.5 symbols/min [2025-10-17T22:36:21.065172] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:21.065341] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:21.065278] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:21.078474] [DEBUG] [LOCAL ] CDLR: Loaded 10294 existing records from primary storage. [2025-10-17T22:36:21.078778] [INFO ] [MAIN ] CDLR: Loaded 10294 primary data records. [2025-10-17T22:36:21.422552] [DEBUG] [LOCAL ] CDP: Loaded 43123 existing records from primary storage. [2025-10-17T22:36:21.421896] [DEBUG] [LOCAL ] CDE: Loaded 54423 existing records from primary storage. [2025-10-17T22:36:21.424475] [INFO ] [MAIN ] CDE: Loaded 54423 primary data records. [2025-10-17T22:36:21.423847] [INFO ] [MAIN ] CDP: Loaded 43123 primary data records. [2025-10-17T22:36:22.099546] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:22.100971] [INFO ] [MAIN ] CDLR: Generated 1820 derivative records from 10294 primary records. [2025-10-17T22:36:22.101591] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-17T22:36:22.119812] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1820 records). [2025-10-17T22:36:22.121165] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-17T22:36:22.123605] [INFO ] [MAIN ] Derivative Progress: 346/2083 symbols completed. CDLR took 1.1s. Estimated remaining: 11m 5s. Rate: 156.7 symbols/min [2025-10-17T22:36:22.124134] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:22.158379] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:22.165701] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:22.166590] [INFO ] [MAIN ] CDE: Generated 1820 derivative records from 54423 primary records. [2025-10-17T22:36:22.167410] [INFO ] [MAIN ] CDP: Generated 1820 derivative records from 43123 primary records. [2025-10-17T22:36:22.167560] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-17T22:36:22.167705] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-17T22:36:22.199673] [DEBUG] [LOCAL ] CDE: Derivative data saved (1820 records). [2025-10-17T22:36:22.199815] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-17T22:36:22.202825] [INFO ] [MAIN ] Derivative Progress: 347/2083 symbols completed. CDE took 1.1s. Estimated remaining: 11m 3s. Rate: 157.0 symbols/min [2025-10-17T22:36:22.208989] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:22.203490] [DEBUG] [LOCAL ] CDRE: Loaded 25250 existing records from primary storage. [2025-10-17T22:36:22.209870] [INFO ] [MAIN ] CDRE: Loaded 25250 primary data records. [2025-10-17T22:36:22.246528] [DEBUG] [LOCAL ] CDP: Derivative data saved (1820 records). [2025-10-17T22:36:22.252076] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-17T22:36:22.272812] [INFO ] [MAIN ] Derivative Progress: 348/2083 symbols completed. CDP took 1.2s. Estimated remaining: 11m 1s. Rate: 157.4 symbols/min [2025-10-17T22:36:22.293588] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:22.524813] [DEBUG] [LOCAL ] CEE: Loaded 5462 existing records from primary storage. [2025-10-17T22:36:22.525015] [INFO ] [MAIN ] CEE: Loaded 5462 primary data records. [2025-10-17T22:36:22.666753] [DEBUG] [LOCAL ] CE: Loaded 52065 existing records from primary storage. [2025-10-17T22:36:22.677737] [INFO ] [MAIN ] CE: Loaded 52065 primary data records. [2025-10-17T22:36:23.185428] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:23.186678] [INFO ] [MAIN ] CDRE: Generated 1820 derivative records from 25250 primary records. [2025-10-17T22:36:23.187003] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-17T22:36:23.206847] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1820 records). [2025-10-17T22:36:23.207266] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-17T22:36:23.211709] [INFO ] [MAIN ] Derivative Progress: 349/2083 symbols completed. CDRE took 1.1s. Estimated remaining: 11m 4s. Rate: 156.8 symbols/min [2025-10-17T22:36:23.213014] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:23.228800] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:23.229791] [INFO ] [MAIN ] CEE: Generated 1820 derivative records from 5462 primary records. [2025-10-17T22:36:23.229962] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-17T22:36:23.253890] [DEBUG] [LOCAL ] CEE: Derivative data saved (1820 records). [2025-10-17T22:36:23.254049] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-10-17T22:36:23.256099] [INFO ] [MAIN ] Derivative Progress: 350/2083 symbols completed. CEE took 1.0s. Estimated remaining: 11m 2s. Rate: 157.2 symbols/min [2025-10-17T22:36:23.256316] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:23.268549] [DEBUG] [LOCAL ] CEPU: Loaded 27225 existing records from primary storage. [2025-10-17T22:36:23.269186] [INFO ] [MAIN ] CEPU: Loaded 27225 primary data records. [2025-10-17T22:36:23.313508] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:23.326224] [INFO ] [MAIN ] CE: Generated 1820 derivative records from 52065 primary records. [2025-10-17T22:36:23.352977] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-17T22:36:23.618791] [DEBUG] [LOCAL ] CE: Derivative data saved (1820 records). [2025-10-17T22:36:23.619071] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-17T22:36:23.621340] [INFO ] [MAIN ] Derivative Progress: 351/2083 symbols completed. CE took 1.4s. Estimated remaining: 11m 1s. Rate: 157.2 symbols/min [2025-10-17T22:36:23.621681] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:23.643919] [DEBUG] [LOCAL ] CF: Loaded 52902 existing records from primary storage. [2025-10-17T22:36:23.644692] [INFO ] [MAIN ] CF: Loaded 52902 primary data records. [2025-10-17T22:36:23.881028] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:24.047734] [DEBUG] [LOCAL ] CFG: Loaded 54403 existing records from primary storage. [2025-10-17T22:36:24.032464] [INFO ] [MAIN ] CEPU: Generated 1820 derivative records from 27225 primary records. [2025-10-17T22:36:24.048929] [INFO ] [MAIN ] CFG: Loaded 54403 primary data records. [2025-10-17T22:36:24.049180] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-17T22:36:24.169047] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1820 records). [2025-10-17T22:36:24.180532] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-17T22:36:24.182715] [INFO ] [MAIN ] Derivative Progress: 352/2083 symbols completed. CEPU took 1.0s. Estimated remaining: 11m 2s. Rate: 157.0 symbols/min [2025-10-17T22:36:24.198283] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:24.399488] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:24.401208] [INFO ] [MAIN ] CF: Generated 1820 derivative records from 52902 primary records. [2025-10-17T22:36:24.401416] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-17T22:36:24.428410] [DEBUG] [LOCAL ] CF: Derivative data saved (1820 records). [2025-10-17T22:36:24.428697] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-10-17T22:36:24.432214] [INFO ] [MAIN ] Derivative Progress: 353/2083 symbols completed. CF took 1.2s. Estimated remaining: 11m 1s. Rate: 157.1 symbols/min [2025-10-17T22:36:24.429603] [DEBUG] [LOCAL ] CFR: Loaded 33178 existing records from primary storage. [2025-10-17T22:36:24.432727] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:24.432614] [INFO ] [MAIN ] CFR: Loaded 33178 primary data records. [2025-10-17T22:36:24.570577] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:24.577025] [INFO ] [MAIN ] CFG: Generated 1820 derivative records from 54403 primary records. [2025-10-17T22:36:24.577208] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-17T22:36:24.803848] [DEBUG] [LOCAL ] CFG: Derivative data saved (1820 records). [2025-10-17T22:36:24.804130] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-17T22:36:24.806375] [INFO ] [MAIN ] Derivative Progress: 354/2083 symbols completed. CFG took 1.2s. Estimated remaining: 11m 0s. Rate: 157.1 symbols/min [2025-10-17T22:36:24.807068] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:24.825492] [DEBUG] [LOCAL ] CGV: Loaded 1418 existing records from primary storage. [2025-10-17T22:36:24.825732] [INFO ] [MAIN ] CGV: Loaded 1418 primary data records. [2025-10-17T22:36:24.826447] [DEBUG] [LOCAL ] CGAU: Loaded 44311 existing records from primary storage. [2025-10-17T22:36:24.847060] [INFO ] [MAIN ] CGAU: Loaded 44311 primary data records. [2025-10-17T22:36:25.479360] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:25.481044] [INFO ] [MAIN ] CFR: Generated 1820 derivative records from 33178 primary records. [2025-10-17T22:36:25.482128] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-10-17T22:36:25.503533] [DEBUG] [LOCAL ] CFR: Derivative data saved (1820 records). [2025-10-17T22:36:25.504245] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-10-17T22:36:25.506631] [INFO ] [MAIN ] Derivative Progress: 355/2083 symbols completed. CFR took 1.3s. Estimated remaining: 11m 1s. Rate: 156.8 symbols/min [2025-10-17T22:36:25.507080] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:25.542250] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:25.542817] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:36:25.543726] [INFO ] [MAIN ] CGAU: Generated 1820 derivative records from 44311 primary records. [2025-10-17T22:36:25.543854] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-17T22:36:25.544682] [INFO ] [MAIN ] CGV: Generated 1819 derivative records from 1418 primary records. [2025-10-17T22:36:25.550724] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-17T22:36:25.585336] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1820 records). [2025-10-17T22:36:25.587745] [DEBUG] [LOCAL ] CHCT: Loaded 24518 existing records from primary storage. [2025-10-17T22:36:25.586556] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-17T22:36:25.590572] [INFO ] [MAIN ] Derivative Progress: 356/2083 symbols completed. CGAU took 1.2s. Estimated remaining: 10m 60s. Rate: 157.1 symbols/min [2025-10-17T22:36:25.587850] [INFO ] [MAIN ] CHCT: Loaded 24518 primary data records. [2025-10-17T22:36:25.592220] [DEBUG] [LOCAL ] CGV: Derivative data saved (1819 records). [2025-10-17T22:36:25.591082] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:25.592423] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-17T22:36:25.606192] [INFO ] [MAIN ] Derivative Progress: 357/2083 symbols completed. CGV took 0.8s. Estimated remaining: 10m 57s. Rate: 157.5 symbols/min [2025-10-17T22:36:25.631794] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:25.787441] [DEBUG] [LOCAL ] CHE: Loaded 15548 existing records from primary storage. [2025-10-17T22:36:25.856309] [INFO ] [MAIN ] CHE: Loaded 15548 primary data records. [2025-10-17T22:36:26.100625] [DEBUG] [LOCAL ] CHD: Loaded 53066 existing records from primary storage. [2025-10-17T22:36:26.131593] [INFO ] [MAIN ] CHD: Loaded 53066 primary data records. [2025-10-17T22:36:26.594810] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:26.595976] [INFO ] [MAIN ] CHCT: Generated 1820 derivative records from 24518 primary records. [2025-10-17T22:36:26.596473] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-10-17T22:36:26.617251] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1820 records). [2025-10-17T22:36:26.617883] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-10-17T22:36:26.620163] [INFO ] [MAIN ] Derivative Progress: 358/2083 symbols completed. CHCT took 1.1s. Estimated remaining: 11m 0s. Rate: 156.8 symbols/min [2025-10-17T22:36:26.636279] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:26.637227] [INFO ] [MAIN ] CHE: Generated 1820 derivative records from 15548 primary records. [2025-10-17T22:36:26.637314] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-17T22:36:26.653864] [DEBUG] [LOCAL ] CHE: Derivative data saved (1820 records). [2025-10-17T22:36:26.654023] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-17T22:36:26.656292] [INFO ] [MAIN ] Derivative Progress: 359/2083 symbols completed. CHE took 1.0s. Estimated remaining: 10m 58s. Rate: 157.2 symbols/min [2025-10-17T22:36:26.671111] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:26.671725] [INFO ] [MAIN ] CHD: Generated 1820 derivative records from 53066 primary records. [2025-10-17T22:36:26.671786] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-17T22:36:26.687477] [DEBUG] [LOCAL ] CHD: Derivative data saved (1820 records). [2025-10-17T22:36:26.687543] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-17T22:36:26.689706] [INFO ] [MAIN ] Derivative Progress: 360/2083 symbols completed. CHD took 1.1s. Estimated remaining: 10m 56s. Rate: 157.6 symbols/min [2025-10-17T22:36:26.690082] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:26.690200] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:26.690287] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:26.711039] [DEBUG] [LOCAL ] CHMI: Loaded 21855 existing records from primary storage. [2025-10-17T22:36:26.711166] [INFO ] [MAIN ] CHMI: Loaded 21855 primary data records. [2025-10-17T22:36:27.048057] [DEBUG] [LOCAL ] CHH: Loaded 32905 existing records from primary storage. [2025-10-17T22:36:27.058156] [INFO ] [MAIN ] CHH: Loaded 32905 primary data records. [2025-10-17T22:36:27.170357] [DEBUG] [LOCAL ] CHGG: Loaded 48419 existing records from primary storage. [2025-10-17T22:36:27.183633] [INFO ] [MAIN ] CHGG: Loaded 48419 primary data records. [2025-10-17T22:36:27.778045] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:27.779415] [INFO ] [MAIN ] CHMI: Generated 1820 derivative records from 21855 primary records. [2025-10-17T22:36:27.779955] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-10-17T22:36:27.796900] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1820 records). [2025-10-17T22:36:27.798358] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-10-17T22:36:27.800963] [INFO ] [MAIN ] Derivative Progress: 361/2083 symbols completed. CHMI took 1.1s. Estimated remaining: 10m 59s. Rate: 156.8 symbols/min [2025-10-17T22:36:27.801598] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:27.815456] [DEBUG] [LOCAL ] CHN: Loaded 5065 existing records from primary storage. [2025-10-17T22:36:27.828936] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:27.828631] [INFO ] [MAIN ] CHN: Loaded 5065 primary data records. [2025-10-17T22:36:27.872456] [INFO ] [MAIN ] CHH: Generated 1820 derivative records from 32905 primary records. [2025-10-17T22:36:27.877811] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-17T22:36:27.878781] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:27.930891] [INFO ] [MAIN ] CHGG: Generated 1820 derivative records from 48419 primary records. [2025-10-17T22:36:27.943521] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-17T22:36:27.964125] [DEBUG] [LOCAL ] CHH: Derivative data saved (1820 records). [2025-10-17T22:36:27.964272] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-17T22:36:27.975109] [INFO ] [MAIN ] Derivative Progress: 362/2083 symbols completed. CHH took 1.3s. Estimated remaining: 10m 58s. Rate: 157.0 symbols/min [2025-10-17T22:36:27.988514] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:28.010183] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1820 records). [2025-10-17T22:36:28.022707] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-10-17T22:36:28.024988] [INFO ] [MAIN ] Derivative Progress: 363/2083 symbols completed. CHGG took 1.3s. Estimated remaining: 10m 56s. Rate: 157.4 symbols/min [2025-10-17T22:36:28.062959] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:28.206240] [DEBUG] [LOCAL ] CHT: Loaded 19756 existing records from primary storage. [2025-10-17T22:36:28.206523] [INFO ] [MAIN ] CHT: Loaded 19756 primary data records. [2025-10-17T22:36:28.335421] [DEBUG] [LOCAL ] CHPT: Loaded 48210 existing records from primary storage. [2025-10-17T22:36:28.341224] [INFO ] [MAIN ] CHPT: Loaded 48210 primary data records. [2025-10-17T22:36:28.346769] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:28.380374] [INFO ] [MAIN ] CHN: Generated 1820 derivative records from 5065 primary records. [2025-10-17T22:36:28.398090] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-10-17T22:36:28.527361] [DEBUG] [LOCAL ] CHN: Derivative data saved (1820 records). [2025-10-17T22:36:28.534974] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-10-17T22:36:28.636317] [INFO ] [MAIN ] Derivative Progress: 364/2083 symbols completed. CHN took 0.8s. Estimated remaining: 10m 56s. Rate: 157.1 symbols/min [2025-10-17T22:36:28.642046] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:28.917217] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:28.933026] [INFO ] [MAIN ] CHT: Generated 1820 derivative records from 19756 primary records. [2025-10-17T22:36:28.933193] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-10-17T22:36:28.934095] [DEBUG] [LOCAL ] CHWY: Loaded 54435 existing records from primary storage. [2025-10-17T22:36:28.934463] [INFO ] [MAIN ] CHWY: Loaded 54435 primary data records. [2025-10-17T22:36:29.007412] [DEBUG] [LOCAL ] CHT: Derivative data saved (1820 records). [2025-10-17T22:36:29.021178] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-10-17T22:36:29.023359] [INFO ] [MAIN ] Derivative Progress: 365/2083 symbols completed. CHT took 1.0s. Estimated remaining: 10m 56s. Rate: 157.1 symbols/min [2025-10-17T22:36:29.030086] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:29.156490] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:29.164187] [INFO ] [MAIN ] CHPT: Generated 1820 derivative records from 48210 primary records. [2025-10-17T22:36:29.266812] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-10-17T22:36:29.300278] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1820 records). [2025-10-17T22:36:29.300832] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-10-17T22:36:29.303177] [INFO ] [MAIN ] Derivative Progress: 366/2083 symbols completed. CHPT took 1.3s. Estimated remaining: 10m 55s. Rate: 157.2 symbols/min [2025-10-17T22:36:29.303505] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:29.340527] [DEBUG] [LOCAL ] CI: Loaded 50399 existing records from primary storage. [2025-10-17T22:36:29.347223] [INFO ] [MAIN ] CI: Loaded 50399 primary data records. [2025-10-17T22:36:29.355189] [DEBUG] [LOCAL ] CIA: Loaded 16820 existing records from primary storage. [2025-10-17T22:36:29.394958] [INFO ] [MAIN ] CIA: Loaded 16820 primary data records. [2025-10-17T22:36:29.433121] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:29.471308] [INFO ] [MAIN ] CHWY: Generated 1820 derivative records from 54435 primary records. [2025-10-17T22:36:29.478717] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-10-17T22:36:29.618096] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1820 records). [2025-10-17T22:36:29.672720] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-10-17T22:36:29.855573] [INFO ] [MAIN ] Derivative Progress: 367/2083 symbols completed. CHWY took 1.2s. Estimated remaining: 10m 56s. Rate: 157.0 symbols/min [2025-10-17T22:36:29.881628] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:30.121628] [DEBUG] [LOCAL ] CIB: Loaded 30952 existing records from primary storage. [2025-10-17T22:36:30.140872] [INFO ] [MAIN ] CIB: Loaded 30952 primary data records. [2025-10-17T22:36:30.144070] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:30.175627] [INFO ] [MAIN ] CI: Generated 1820 derivative records from 50399 primary records. [2025-10-17T22:36:30.188552] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-10-17T22:36:30.261035] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:30.310569] [INFO ] [MAIN ] CIA: Generated 1820 derivative records from 16820 primary records. [2025-10-17T22:36:30.333014] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-17T22:36:30.338122] [DEBUG] [LOCAL ] CI: Derivative data saved (1820 records). [2025-10-17T22:36:30.344558] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-10-17T22:36:30.386762] [INFO ] [MAIN ] Derivative Progress: 368/2083 symbols completed. CI took 1.4s. Estimated remaining: 10m 56s. Rate: 156.9 symbols/min [2025-10-17T22:36:30.392823] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:30.604152] [DEBUG] [LOCAL ] CIA: Derivative data saved (1820 records). [2025-10-17T22:36:30.621450] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-17T22:36:30.624735] [INFO ] [MAIN ] Derivative Progress: 369/2083 symbols completed. CIA took 1.3s. Estimated remaining: 10m 55s. Rate: 157.0 symbols/min [2025-10-17T22:36:30.625220] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:30.654627] [DEBUG] [LOCAL ] CIF: Loaded 4087 existing records from primary storage. [2025-10-17T22:36:30.655264] [INFO ] [MAIN ] CIF: Loaded 4087 primary data records. [2025-10-17T22:36:30.829595] [DEBUG] [LOCAL ] CIEN: Loaded 52910 existing records from primary storage. [2025-10-17T22:36:30.834160] [INFO ] [MAIN ] CIEN: Loaded 52910 primary data records. [2025-10-17T22:36:31.251239] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:31.252472] [INFO ] [MAIN ] CIB: Generated 1820 derivative records from 30952 primary records. [2025-10-17T22:36:31.275026] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-10-17T22:36:31.416287] [DEBUG] [LOCAL ] CIB: Derivative data saved (1820 records). [2025-10-17T22:36:31.416758] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-10-17T22:36:31.419386] [INFO ] [MAIN ] Derivative Progress: 370/2083 symbols completed. CIB took 1.5s. Estimated remaining: 10m 56s. Rate: 156.6 symbols/min [2025-10-17T22:36:31.420188] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:31.441786] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:31.442776] [INFO ] [MAIN ] CIF: Generated 1820 derivative records from 4087 primary records. [2025-10-17T22:36:31.443625] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-17T22:36:31.474760] [DEBUG] [LOCAL ] CIF: Derivative data saved (1820 records). [2025-10-17T22:36:31.475265] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:31.476225] [INFO ] [MAIN ] CIEN: Generated 1820 derivative records from 52910 primary records. [2025-10-17T22:36:31.475361] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-17T22:36:31.485809] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-10-17T22:36:31.488235] [INFO ] [MAIN ] Derivative Progress: 371/2083 symbols completed. CIF took 0.9s. Estimated remaining: 10m 55s. Rate: 156.9 symbols/min [2025-10-17T22:36:31.489391] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:31.509865] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1820 records). [2025-10-17T22:36:31.522400] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-10-17T22:36:31.524671] [INFO ] [MAIN ] Derivative Progress: 372/2083 symbols completed. CIEN took 1.1s. Estimated remaining: 10m 53s. Rate: 157.3 symbols/min [2025-10-17T22:36:31.524980] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:31.527007] [DEBUG] [LOCAL ] CIG: Loaded 45005 existing records from primary storage. [2025-10-17T22:36:31.533419] [DEBUG] [LOCAL ] CII: Loaded 15546 existing records from primary storage. [2025-10-17T22:36:31.533628] [INFO ] [MAIN ] CII: Loaded 15546 primary data records. [2025-10-17T22:36:31.533044] [INFO ] [MAIN ] CIG: Loaded 45005 primary data records. [2025-10-17T22:36:31.925876] [DEBUG] [LOCAL ] CIM: Loaded 38246 existing records from primary storage. [2025-10-17T22:36:32.049986] [INFO ] [MAIN ] CIM: Loaded 38246 primary data records. [2025-10-17T22:36:32.536714] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:32.550909] [INFO ] [MAIN ] CIG: Generated 1820 derivative records from 45005 primary records. [2025-10-17T22:36:32.551213] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-10-17T22:36:32.552548] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:32.561955] [INFO ] [MAIN ] CII: Generated 1820 derivative records from 15546 primary records. [2025-10-17T22:36:32.562174] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-17T22:36:32.577359] [DEBUG] [LOCAL ] CIG: Derivative data saved (1820 records). [2025-10-17T22:36:32.578628] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-10-17T22:36:32.583481] [INFO ] [MAIN ] Derivative Progress: 373/2083 symbols completed. CIG took 1.2s. Estimated remaining: 10m 55s. Rate: 156.6 symbols/min [2025-10-17T22:36:32.589059] [DEBUG] [LOCAL ] CII: Derivative data saved (1820 records). [2025-10-17T22:36:32.589977] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-10-17T22:36:32.592873] [INFO ] [MAIN ] Derivative Progress: 374/2083 symbols completed. CII took 1.1s. Estimated remaining: 10m 53s. Rate: 157.0 symbols/min [2025-10-17T22:36:32.606315] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:32.606946] [INFO ] [MAIN ] CIM: Generated 1820 derivative records from 38246 primary records. [2025-10-17T22:36:32.607006] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-10-17T22:36:32.622265] [DEBUG] [LOCAL ] CIM: Derivative data saved (1820 records). [2025-10-17T22:36:32.622324] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-10-17T22:36:32.624404] [INFO ] [MAIN ] Derivative Progress: 375/2083 symbols completed. CIM took 1.1s. Estimated remaining: 10m 51s. Rate: 157.3 symbols/min [2025-10-17T22:36:32.625028] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:32.625232] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:32.625148] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:32.649199] [DEBUG] [LOCAL ] CINT: Loaded 20304 existing records from primary storage. [2025-10-17T22:36:32.649385] [INFO ] [MAIN ] CINT: Loaded 20304 primary data records. [2025-10-17T22:36:32.739629] [DEBUG] [LOCAL ] CIO: Loaded 21338 existing records from primary storage. [2025-10-17T22:36:32.763057] [INFO ] [MAIN ] CIO: Loaded 21338 primary data records. [2025-10-17T22:36:32.832557] [DEBUG] [LOCAL ] CION: Loaded 28822 existing records from primary storage. [2025-10-17T22:36:32.839485] [INFO ] [MAIN ] CION: Loaded 28822 primary data records. [2025-10-17T22:36:33.643919] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:33.644790] [INFO ] [MAIN ] CINT: Generated 1820 derivative records from 20304 primary records. [2025-10-17T22:36:33.645184] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-10-17T22:36:33.678566] [DEBUG] [LOCAL ] CINT: Derivative data saved (1820 records). [2025-10-17T22:36:33.679157] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-10-17T22:36:33.681502] [INFO ] [MAIN ] Derivative Progress: 376/2083 symbols completed. CINT took 1.1s. Estimated remaining: 10m 54s. Rate: 156.6 symbols/min [2025-10-17T22:36:33.679059] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:33.693597] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:33.695041] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:33.694605] [INFO ] [MAIN ] CIO: Generated 1820 derivative records from 21338 primary records. [2025-10-17T22:36:33.696040] [INFO ] [MAIN ] CION: Generated 1820 derivative records from 28822 primary records. [2025-10-17T22:36:33.696333] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-10-17T22:36:33.696291] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-17T22:36:33.726604] [DEBUG] [LOCAL ] CIO: Derivative data saved (1820 records). [2025-10-17T22:36:33.727574] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-17T22:36:33.729879] [INFO ] [MAIN ] Derivative Progress: 377/2083 symbols completed. CIO took 1.1s. Estimated remaining: 10m 52s. Rate: 157.0 symbols/min [2025-10-17T22:36:33.730366] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:33.732237] [DEBUG] [LOCAL ] CION: Derivative data saved (1820 records). [2025-10-17T22:36:33.732370] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-10-17T22:36:33.735087] [INFO ] [MAIN ] Derivative Progress: 378/2083 symbols completed. CION took 1.1s. Estimated remaining: 10m 50s. Rate: 157.4 symbols/min [2025-10-17T22:36:33.735625] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:33.803372] [DEBUG] [LOCAL ] CIVI: Loaded 53478 existing records from primary storage. [2025-10-17T22:36:33.817797] [INFO ] [MAIN ] CIVI: Loaded 53478 primary data records. [2025-10-17T22:36:33.818743] [DEBUG] [LOCAL ] CL: Loaded 54429 existing records from primary storage. [2025-10-17T22:36:33.849883] [INFO ] [MAIN ] CL: Loaded 54429 primary data records. [2025-10-17T22:36:34.005523] [DEBUG] [LOCAL ] CLB: Loaded 33985 existing records from primary storage. [2025-10-17T22:36:34.024993] [INFO ] [MAIN ] CLB: Loaded 33985 primary data records. [2025-10-17T22:36:34.795995] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:34.796988] [INFO ] [MAIN ] CIVI: Generated 1820 derivative records from 53478 primary records. [2025-10-17T22:36:34.797172] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-17T22:36:34.828867] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:34.832092] [INFO ] [MAIN ] CL: Generated 1820 derivative records from 54429 primary records. [2025-10-17T22:36:34.832524] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-10-17T22:36:34.835127] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1820 records). [2025-10-17T22:36:34.835580] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-17T22:36:34.837398] [INFO ] [MAIN ] Derivative Progress: 379/2083 symbols completed. CIVI took 1.1s. Estimated remaining: 10m 53s. Rate: 156.6 symbols/min [2025-10-17T22:36:34.857149] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:34.858205] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:34.858976] [INFO ] [MAIN ] CLB: Generated 1820 derivative records from 33985 primary records. [2025-10-17T22:36:34.860249] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-17T22:36:34.875204] [DEBUG] [LOCAL ] CL: Derivative data saved (1820 records). [2025-10-17T22:36:34.875311] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-10-17T22:36:34.884504] [INFO ] [MAIN ] Derivative Progress: 380/2083 symbols completed. CL took 1.2s. Estimated remaining: 10m 51s. Rate: 157.0 symbols/min [2025-10-17T22:36:34.889139] [DEBUG] [LOCAL ] CLB: Derivative data saved (1820 records). [2025-10-17T22:36:34.887916] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:34.889608] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-10-17T22:36:34.891797] [INFO ] [MAIN ] Derivative Progress: 381/2083 symbols completed. CLB took 1.2s. Estimated remaining: 10m 49s. Rate: 157.4 symbols/min [2025-10-17T22:36:34.892450] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:34.898945] [DEBUG] [LOCAL ] CLCO: Loaded 13484 existing records from primary storage. [2025-10-17T22:36:34.899164] [INFO ] [MAIN ] CLCO: Loaded 13484 primary data records. [2025-10-17T22:36:35.211121] [DEBUG] [LOCAL ] CLDT: Loaded 25824 existing records from primary storage. [2025-10-17T22:36:35.225754] [INFO ] [MAIN ] CLDT: Loaded 25824 primary data records. [2025-10-17T22:36:35.352899] [DEBUG] [LOCAL ] CLF: Loaded 54521 existing records from primary storage. [2025-10-17T22:36:35.364397] [INFO ] [MAIN ] CLF: Loaded 54521 primary data records. [2025-10-17T22:36:35.912889] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:35.916710] [INFO ] [MAIN ] CLCO: Generated 1820 derivative records from 13484 primary records. [2025-10-17T22:36:35.917797] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-10-17T22:36:35.936556] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1820 records). [2025-10-17T22:36:35.937167] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-10-17T22:36:35.939101] [INFO ] [MAIN ] Derivative Progress: 382/2083 symbols completed. CLCO took 1.1s. Estimated remaining: 10m 52s. Rate: 156.7 symbols/min [2025-10-17T22:36:35.939700] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:35.962516] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:35.963572] [INFO ] [MAIN ] CLDT: Generated 1820 derivative records from 25824 primary records. [2025-10-17T22:36:35.963888] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-17T22:36:35.990816] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1820 records). [2025-10-17T22:36:36.003238] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-17T22:36:36.003527] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:36.004268] [INFO ] [MAIN ] CLF: Generated 1820 derivative records from 54521 primary records. [2025-10-17T22:36:36.004383] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-17T22:36:36.007025] [INFO ] [MAIN ] Derivative Progress: 383/2083 symbols completed. CLDT took 1.1s. Estimated remaining: 10m 50s. Rate: 157.0 symbols/min [2025-10-17T22:36:36.007377] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:36.032239] [DEBUG] [LOCAL ] CLF: Derivative data saved (1820 records). [2025-10-17T22:36:36.032408] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-10-17T22:36:36.034627] [INFO ] [MAIN ] Derivative Progress: 384/2083 symbols completed. CLF took 1.1s. Estimated remaining: 10m 48s. Rate: 157.4 symbols/min [2025-10-17T22:36:36.035238] [DEBUG] [LOCAL ] CLH: Loaded 28288 existing records from primary storage. [2025-10-17T22:36:36.035399] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:36.035673] [INFO ] [MAIN ] CLH: Loaded 28288 primary data records. [2025-10-17T22:36:36.175734] [DEBUG] [LOCAL ] CLW: Loaded 21809 existing records from primary storage. [2025-10-17T22:36:36.182123] [INFO ] [MAIN ] CLW: Loaded 21809 primary data records. [2025-10-17T22:36:36.710701] [DEBUG] [LOCAL ] CLX: Loaded 52408 existing records from primary storage. [2025-10-17T22:36:36.711022] [INFO ] [MAIN ] CLX: Loaded 52408 primary data records. [2025-10-17T22:36:37.035608] [DEBUG] [MAIN ] CLH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:37.037401] [INFO ] [MAIN ] CLH: Generated 1820 derivative records from 28288 primary records. [2025-10-17T22:36:37.037559] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-17T22:36:37.064531] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:37.067060] [INFO ] [MAIN ] CLW: Generated 1820 derivative records from 21809 primary records. [2025-10-17T22:36:37.067449] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-17T22:36:37.070783] [DEBUG] [LOCAL ] CLH: Derivative data saved (1820 records). [2025-10-17T22:36:37.071276] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-17T22:36:37.073403] [INFO ] [MAIN ] Derivative Progress: 385/2083 symbols completed. CLH took 1.1s. Estimated remaining: 10m 50s. Rate: 156.7 symbols/min [2025-10-17T22:36:37.073807] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:37.090995] [DEBUG] [LOCAL ] CLW: Derivative data saved (1820 records). [2025-10-17T22:36:37.091381] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-17T22:36:37.093717] [INFO ] [MAIN ] Derivative Progress: 386/2083 symbols completed. CLW took 1.1s. Estimated remaining: 10m 48s. Rate: 157.1 symbols/min [2025-10-17T22:36:37.094226] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:37.122304] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:37.123755] [INFO ] [MAIN ] CLX: Generated 1820 derivative records from 52408 primary records. [2025-10-17T22:36:37.123991] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-17T22:36:37.141314] [DEBUG] [LOCAL ] CLX: Derivative data saved (1820 records). [2025-10-17T22:36:37.141481] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-17T22:36:37.156658] [INFO ] [MAIN ] Derivative Progress: 387/2083 symbols completed. CLX took 1.1s. Estimated remaining: 10m 47s. Rate: 157.4 symbols/min [2025-10-17T22:36:37.156977] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:37.209350] [DEBUG] [LOCAL ] CM: Loaded 49434 existing records from primary storage. [2025-10-17T22:36:37.210718] [INFO ] [MAIN ] CM: Loaded 49434 primary data records. [2025-10-17T22:36:37.250415] [DEBUG] [LOCAL ] CMA: Loaded 50902 existing records from primary storage. [2025-10-17T22:36:37.296986] [INFO ] [MAIN ] CMA: Loaded 50902 primary data records. [2025-10-17T22:36:37.320619] [DEBUG] [LOCAL ] CMBT: Loaded 26862 existing records from primary storage. [2025-10-17T22:36:37.362537] [INFO ] [MAIN ] CMBT: Loaded 26862 primary data records. [2025-10-17T22:36:38.199759] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:38.200766] [INFO ] [MAIN ] CM: Generated 1820 derivative records from 49434 primary records. [2025-10-17T22:36:38.201155] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-17T22:36:38.220733] [DEBUG] [LOCAL ] CM: Derivative data saved (1820 records). [2025-10-17T22:36:38.221702] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-17T22:36:38.224221] [INFO ] [MAIN ] Derivative Progress: 388/2083 symbols completed. CM took 1.2s. Estimated remaining: 10m 49s. Rate: 156.7 symbols/min [2025-10-17T22:36:38.249430] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:38.250261] [INFO ] [MAIN ] CMBT: Generated 1820 derivative records from 26862 primary records. [2025-10-17T22:36:38.250421] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:38.250536] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-17T22:36:38.251097] [INFO ] [MAIN ] CMA: Generated 1820 derivative records from 50902 primary records. [2025-10-17T22:36:38.251544] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-10-17T22:36:38.278677] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1820 records). [2025-10-17T22:36:38.279362] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-17T22:36:38.281818] [INFO ] [MAIN ] Derivative Progress: 389/2083 symbols completed. CMBT took 1.1s. Estimated remaining: 10m 47s. Rate: 157.0 symbols/min [2025-10-17T22:36:38.284390] [DEBUG] [LOCAL ] CMA: Derivative data saved (1820 records). [2025-10-17T22:36:38.284452] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-10-17T22:36:38.286520] [INFO ] [MAIN ] Derivative Progress: 390/2083 symbols completed. CMA took 1.2s. Estimated remaining: 10m 45s. Rate: 157.4 symbols/min [2025-10-17T22:36:38.287210] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:38.287362] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:38.287305] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:38.296147] [DEBUG] [LOCAL ] CMCM: Loaded 4894 existing records from primary storage. [2025-10-17T22:36:38.296430] [INFO ] [MAIN ] CMCM: Loaded 4894 primary data records. [2025-10-17T22:36:38.662348] [DEBUG] [LOCAL ] CMC: Loaded 46259 existing records from primary storage. [2025-10-17T22:36:38.662706] [INFO ] [MAIN ] CMC: Loaded 46259 primary data records. [2025-10-17T22:36:38.668756] [DEBUG] [LOCAL ] CMG: Loaded 54501 existing records from primary storage. [2025-10-17T22:36:38.680388] [INFO ] [MAIN ] CMG: Loaded 54501 primary data records. [2025-10-17T22:36:39.300422] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:39.301979] [INFO ] [MAIN ] CMCM: Generated 1820 derivative records from 4894 primary records. [2025-10-17T22:36:39.302239] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-17T22:36:39.319453] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1820 records). [2025-10-17T22:36:39.319753] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-17T22:36:39.321894] [INFO ] [MAIN ] Derivative Progress: 391/2083 symbols completed. CMCM took 1.0s. Estimated remaining: 10m 48s. Rate: 156.7 symbols/min [2025-10-17T22:36:39.322255] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:39.342820] [DEBUG] [MAIN ] CMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:39.344484] [INFO ] [MAIN ] CMG: Generated 1820 derivative records from 54501 primary records. [2025-10-17T22:36:39.344682] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-10-17T22:36:39.365732] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:39.370322] [INFO ] [MAIN ] CMC: Generated 1820 derivative records from 46259 primary records. [2025-10-17T22:36:39.371752] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-17T22:36:39.375036] [DEBUG] [LOCAL ] CMG: Derivative data saved (1820 records). [2025-10-17T22:36:39.376208] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-10-17T22:36:39.378264] [INFO ] [MAIN ] Derivative Progress: 392/2083 symbols completed. CMG took 1.1s. Estimated remaining: 10m 46s. Rate: 157.1 symbols/min [2025-10-17T22:36:39.378454] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:39.403878] [DEBUG] [LOCAL ] CMC: Derivative data saved (1820 records). [2025-10-17T22:36:39.404081] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-17T22:36:39.406258] [INFO ] [MAIN ] Derivative Progress: 393/2083 symbols completed. CMC took 1.1s. Estimated remaining: 10m 44s. Rate: 157.4 symbols/min [2025-10-17T22:36:39.406533] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:39.423415] [DEBUG] [LOCAL ] CMI: Loaded 42340 existing records from primary storage. [2025-10-17T22:36:39.423818] [INFO ] [MAIN ] CMI: Loaded 42340 primary data records. [2025-10-17T22:36:39.573505] [DEBUG] [LOCAL ] CMP: Loaded 36229 existing records from primary storage. [2025-10-17T22:36:39.629904] [INFO ] [MAIN ] CMP: Loaded 36229 primary data records. [2025-10-17T22:36:39.797589] [DEBUG] [LOCAL ] CMRE: Loaded 36418 existing records from primary storage. [2025-10-17T22:36:39.825310] [INFO ] [MAIN ] CMRE: Loaded 36418 primary data records. [2025-10-17T22:36:40.419020] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:40.419959] [INFO ] [MAIN ] CMI: Generated 1820 derivative records from 42340 primary records. [2025-10-17T22:36:40.420182] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-17T22:36:40.438658] [DEBUG] [LOCAL ] CMI: Derivative data saved (1820 records). [2025-10-17T22:36:40.441238] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-17T22:36:40.443932] [INFO ] [MAIN ] Derivative Progress: 394/2083 symbols completed. CMI took 1.1s. Estimated remaining: 10m 47s. Rate: 156.7 symbols/min [2025-10-17T22:36:40.444241] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:40.458800] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:40.460542] [INFO ] [MAIN ] CMP: Generated 1820 derivative records from 36229 primary records. [2025-10-17T22:36:40.460770] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-17T22:36:40.474074] [DEBUG] [LOCAL ] CMSA: Loaded 3570 existing records from primary storage. [2025-10-17T22:36:40.478017] [INFO ] [MAIN ] CMSA: Loaded 3570 primary data records. [2025-10-17T22:36:40.514381] [DEBUG] [LOCAL ] CMP: Derivative data saved (1820 records). [2025-10-17T22:36:40.548913] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-17T22:36:40.558579] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:40.560625] [INFO ] [MAIN ] Derivative Progress: 395/2083 symbols completed. CMP took 1.2s. Estimated remaining: 10m 45s. Rate: 157.0 symbols/min [2025-10-17T22:36:40.573593] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:40.573473] [INFO ] [MAIN ] CMRE: Generated 1820 derivative records from 36418 primary records. [2025-10-17T22:36:40.590345] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-17T22:36:40.698818] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1820 records). [2025-10-17T22:36:40.813876] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-17T22:36:40.817245] [INFO ] [MAIN ] Derivative Progress: 396/2083 symbols completed. CMRE took 1.4s. Estimated remaining: 10m 44s. Rate: 157.2 symbols/min [2025-10-17T22:36:40.668802] [DEBUG] [LOCAL ] CMSC: Loaded 4946 existing records from primary storage. [2025-10-17T22:36:40.817477] [INFO ] [MAIN ] CMSC: Loaded 4946 primary data records. [2025-10-17T22:36:40.817628] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:40.930171] [DEBUG] [LOCAL ] CMSD: Loaded 7921 existing records from primary storage. [2025-10-17T22:36:40.969263] [INFO ] [MAIN ] CMSD: Loaded 7921 primary data records. [2025-10-17T22:36:41.438995] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:36:41.440585] [INFO ] [MAIN ] CMSA: Generated 1819 derivative records from 3570 primary records. [2025-10-17T22:36:41.440824] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-10-17T22:36:41.457980] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1819 records). [2025-10-17T22:36:41.458499] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-10-17T22:36:41.460878] [INFO ] [MAIN ] Derivative Progress: 397/2083 symbols completed. CMSA took 1.0s. Estimated remaining: 10m 45s. Rate: 156.9 symbols/min [2025-10-17T22:36:41.461026] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:41.480343] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:41.481167] [INFO ] [MAIN ] CMSC: Generated 1820 derivative records from 4946 primary records. [2025-10-17T22:36:41.481435] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-17T22:36:41.498923] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1820 records). [2025-10-17T22:36:41.500684] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-17T22:36:41.502798] [INFO ] [MAIN ] Derivative Progress: 398/2083 symbols completed. CMSC took 0.9s. Estimated remaining: 10m 43s. Rate: 157.2 symbols/min [2025-10-17T22:36:41.502964] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:41.516369] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:41.525514] [INFO ] [MAIN ] CMSD: Generated 1820 derivative records from 7921 primary records. [2025-10-17T22:36:41.527116] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-17T22:36:41.546005] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1820 records). [2025-10-17T22:36:41.546379] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-17T22:36:41.546246] [DEBUG] [LOCAL ] CMU: Loaded 6381 existing records from primary storage. [2025-10-17T22:36:41.558503] [INFO ] [MAIN ] CMU: Loaded 6381 primary data records. [2025-10-17T22:36:41.548915] [INFO ] [MAIN ] Derivative Progress: 399/2083 symbols completed. CMSD took 0.7s. Estimated remaining: 10m 41s. Rate: 157.6 symbols/min [2025-10-17T22:36:41.570631] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:41.603609] [DEBUG] [LOCAL ] CMTG: Loaded 36246 existing records from primary storage. [2025-10-17T22:36:41.624340] [INFO ] [MAIN ] CMTG: Loaded 36246 primary data records. [2025-10-17T22:36:42.084540] [DEBUG] [LOCAL ] CNA: Loaded 33357 existing records from primary storage. [2025-10-17T22:36:42.111706] [INFO ] [MAIN ] CNA: Loaded 33357 primary data records. [2025-10-17T22:36:42.537413] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:42.537150] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:42.538321] [INFO ] [MAIN ] CMU: Generated 1820 derivative records from 6381 primary records. [2025-10-17T22:36:42.538936] [INFO ] [MAIN ] CMTG: Generated 1820 derivative records from 36246 primary records. [2025-10-17T22:36:42.540167] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-17T22:36:42.539484] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-10-17T22:36:42.567459] [DEBUG] [LOCAL ] CMU: Derivative data saved (1820 records). [2025-10-17T22:36:42.568979] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-10-17T22:36:42.571227] [INFO ] [MAIN ] Derivative Progress: 400/2083 symbols completed. CMU took 1.1s. Estimated remaining: 10m 44s. Rate: 156.9 symbols/min [2025-10-17T22:36:42.571441] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:42.575255] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1820 records). [2025-10-17T22:36:42.575427] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-17T22:36:42.577659] [INFO ] [MAIN ] Derivative Progress: 401/2083 symbols completed. CMTG took 1.1s. Estimated remaining: 10m 42s. Rate: 157.3 symbols/min [2025-10-17T22:36:42.577937] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:42.598357] [DEBUG] [MAIN ] CNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:42.599262] [INFO ] [MAIN ] CNA: Generated 1820 derivative records from 33357 primary records. [2025-10-17T22:36:42.599333] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-17T22:36:42.615537] [DEBUG] [LOCAL ] CNF: Loaded 10666 existing records from primary storage. [2025-10-17T22:36:42.620568] [INFO ] [MAIN ] CNF: Loaded 10666 primary data records. [2025-10-17T22:36:42.653462] [DEBUG] [LOCAL ] CNA: Derivative data saved (1820 records). [2025-10-17T22:36:42.665743] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-10-17T22:36:42.667814] [INFO ] [MAIN ] Derivative Progress: 402/2083 symbols completed. CNA took 1.1s. Estimated remaining: 10m 40s. Rate: 157.6 symbols/min [2025-10-17T22:36:42.668004] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:42.956393] [DEBUG] [LOCAL ] CNC: Loaded 54550 existing records from primary storage. [2025-10-17T22:36:42.956718] [INFO ] [MAIN ] CNC: Loaded 54550 primary data records. [2025-10-17T22:36:43.175570] [DEBUG] [LOCAL ] CNH: Loaded 54332 existing records from primary storage. [2025-10-17T22:36:43.180751] [INFO ] [MAIN ] CNH: Loaded 54332 primary data records. [2025-10-17T22:36:43.668390] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:36:43.669322] [INFO ] [MAIN ] CNF: Generated 1819 derivative records from 10666 primary records. [2025-10-17T22:36:43.669516] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-10-17T22:36:43.686921] [DEBUG] [LOCAL ] CNF: Derivative data saved (1819 records). [2025-10-17T22:36:43.687528] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-10-17T22:36:43.689774] [INFO ] [MAIN ] Derivative Progress: 403/2083 symbols completed. CNF took 1.1s. Estimated remaining: 10m 42s. Rate: 156.9 symbols/min [2025-10-17T22:36:43.708985] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:36:43.710550] [INFO ] [MAIN ] CNC: Generated 1819 derivative records from 54550 primary records. [2025-10-17T22:36:43.710665] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-17T22:36:43.727636] [DEBUG] [LOCAL ] CNC: Derivative data saved (1819 records). [2025-10-17T22:36:43.727979] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-17T22:36:43.730040] [INFO ] [MAIN ] Derivative Progress: 404/2083 symbols completed. CNC took 1.2s. Estimated remaining: 10m 40s. Rate: 157.3 symbols/min [2025-10-17T22:36:43.744789] [DEBUG] [MAIN ] CNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:43.745387] [INFO ] [MAIN ] CNH: Generated 1820 derivative records from 54332 primary records. [2025-10-17T22:36:43.745444] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-10-17T22:36:43.760764] [DEBUG] [LOCAL ] CNH: Derivative data saved (1820 records). [2025-10-17T22:36:43.760842] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-10-17T22:36:43.762892] [INFO ] [MAIN ] Derivative Progress: 405/2083 symbols completed. CNH took 1.1s. Estimated remaining: 10m 39s. Rate: 157.7 symbols/min [2025-10-17T22:36:43.763339] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:43.763456] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:43.763573] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:43.857275] [DEBUG] [LOCAL ] CNK: Loaded 53677 existing records from primary storage. [2025-10-17T22:36:43.871836] [DEBUG] [LOCAL ] CNM: Loaded 51797 existing records from primary storage. [2025-10-17T22:36:43.871182] [INFO ] [MAIN ] CNK: Loaded 53677 primary data records. [2025-10-17T22:36:43.872087] [INFO ] [MAIN ] CNM: Loaded 51797 primary data records. [2025-10-17T22:36:43.938923] [DEBUG] [LOCAL ] CNI: Loaded 52456 existing records from primary storage. [2025-10-17T22:36:43.955861] [INFO ] [MAIN ] CNI: Loaded 52456 primary data records. [2025-10-17T22:36:44.804384] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:44.805373] [INFO ] [MAIN ] CNM: Generated 1820 derivative records from 51797 primary records. [2025-10-17T22:36:44.805794] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-10-17T22:36:44.839916] [DEBUG] [LOCAL ] CNM: Derivative data saved (1820 records). [2025-10-17T22:36:44.840530] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-10-17T22:36:44.840437] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:44.844848] [INFO ] [MAIN ] CNK: Generated 1820 derivative records from 53677 primary records. [2025-10-17T22:36:44.845144] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-10-17T22:36:44.843754] [INFO ] [MAIN ] Derivative Progress: 406/2083 symbols completed. CNM took 1.1s. Estimated remaining: 10m 41s. Rate: 156.9 symbols/min [2025-10-17T22:36:44.845474] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:44.874152] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:44.876502] [INFO ] [MAIN ] CNI: Generated 1820 derivative records from 52456 primary records. [2025-10-17T22:36:44.876610] [DEBUG] [LOCAL ] CNK: Derivative data saved (1820 records). [2025-10-17T22:36:44.876823] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-10-17T22:36:44.876736] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-17T22:36:44.879197] [INFO ] [MAIN ] Derivative Progress: 407/2083 symbols completed. CNK took 1.1s. Estimated remaining: 10m 39s. Rate: 157.3 symbols/min [2025-10-17T22:36:44.879922] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:44.899374] [DEBUG] [LOCAL ] CNI: Derivative data saved (1820 records). [2025-10-17T22:36:44.899509] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-17T22:36:44.901731] [INFO ] [MAIN ] Derivative Progress: 408/2083 symbols completed. CNI took 1.1s. Estimated remaining: 10m 37s. Rate: 157.7 symbols/min [2025-10-17T22:36:44.902054] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:44.937524] [DEBUG] [LOCAL ] CNMD: Loaded 32497 existing records from primary storage. [2025-10-17T22:36:44.937922] [INFO ] [MAIN ] CNMD: Loaded 32497 primary data records. [2025-10-17T22:36:45.079985] [DEBUG] [LOCAL ] CNO: Loaded 41237 existing records from primary storage. [2025-10-17T22:36:45.111815] [INFO ] [MAIN ] CNO: Loaded 41237 primary data records. [2025-10-17T22:36:45.304178] [DEBUG] [LOCAL ] CNP: Loaded 54258 existing records from primary storage. [2025-10-17T22:36:45.340838] [INFO ] [MAIN ] CNP: Loaded 54258 primary data records. [2025-10-17T22:36:45.935846] [DEBUG] [MAIN ] CNMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:45.936837] [INFO ] [MAIN ] CNMD: Generated 1820 derivative records from 32497 primary records. [2025-10-17T22:36:45.937986] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-17T22:36:45.962782] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1820 records). [2025-10-17T22:36:45.963424] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-10-17T22:36:45.966665] [INFO ] [MAIN ] Derivative Progress: 409/2083 symbols completed. CNMD took 1.1s. Estimated remaining: 10m 40s. Rate: 157.0 symbols/min [2025-10-17T22:36:45.967254] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:45.981411] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:45.982568] [INFO ] [MAIN ] CNO: Generated 1820 derivative records from 41237 primary records. [2025-10-17T22:36:45.982809] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-17T22:36:46.013700] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:46.015136] [DEBUG] [LOCAL ] CNO: Derivative data saved (1820 records). [2025-10-17T22:36:46.015245] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-17T22:36:46.018455] [INFO ] [MAIN ] CNP: Generated 1820 derivative records from 54258 primary records. [2025-10-17T22:36:46.017526] [INFO ] [MAIN ] Derivative Progress: 410/2083 symbols completed. CNO took 1.1s. Estimated remaining: 10m 38s. Rate: 157.3 symbols/min [2025-10-17T22:36:46.018682] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:46.019105] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-17T22:36:46.057561] [DEBUG] [LOCAL ] CNP: Derivative data saved (1820 records). [2025-10-17T22:36:46.057774] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-17T22:36:46.060483] [INFO ] [MAIN ] Derivative Progress: 411/2083 symbols completed. CNP took 1.2s. Estimated remaining: 10m 36s. Rate: 157.6 symbols/min [2025-10-17T22:36:46.060797] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:46.080921] [DEBUG] [LOCAL ] CNQ: Loaded 54362 existing records from primary storage. [2025-10-17T22:36:46.081142] [INFO ] [MAIN ] CNQ: Loaded 54362 primary data records. [2025-10-17T22:36:46.251421] [DEBUG] [LOCAL ] CNX: Loaded 52093 existing records from primary storage. [2025-10-17T22:36:46.273167] [INFO ] [MAIN ] CNX: Loaded 52093 primary data records. [2025-10-17T22:36:46.326772] [DEBUG] [LOCAL ] CODI: Loaded 42174 existing records from primary storage. [2025-10-17T22:36:46.503013] [INFO ] [MAIN ] CODI: Loaded 42174 primary data records. [2025-10-17T22:36:47.050242] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:47.052268] [INFO ] [MAIN ] CNQ: Generated 1820 derivative records from 54362 primary records. [2025-10-17T22:36:47.053223] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-17T22:36:47.076840] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1820 records). [2025-10-17T22:36:47.077256] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-17T22:36:47.079104] [INFO ] [MAIN ] Derivative Progress: 412/2083 symbols completed. CNQ took 1.1s. Estimated remaining: 10m 39s. Rate: 157.0 symbols/min [2025-10-17T22:36:47.079515] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:47.101492] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:47.115028] [INFO ] [MAIN ] CNX: Generated 1820 derivative records from 52093 primary records. [2025-10-17T22:36:47.115404] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-10-17T22:36:47.115276] [DEBUG] [MAIN ] CODI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:47.116303] [INFO ] [MAIN ] CODI: Generated 1820 derivative records from 42174 primary records. [2025-10-17T22:36:47.117175] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-17T22:36:47.142003] [DEBUG] [LOCAL ] CNX: Derivative data saved (1820 records). [2025-10-17T22:36:47.144765] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-10-17T22:36:47.148207] [INFO ] [MAIN ] Derivative Progress: 413/2083 symbols completed. CNX took 1.1s. Estimated remaining: 10m 37s. Rate: 157.3 symbols/min [2025-10-17T22:36:47.151242] [DEBUG] [LOCAL ] CODI: Derivative data saved (1820 records). [2025-10-17T22:36:47.151402] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:47.152184] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-10-17T22:36:47.154356] [INFO ] [MAIN ] Derivative Progress: 414/2083 symbols completed. CODI took 1.1s. Estimated remaining: 10m 35s. Rate: 157.7 symbols/min [2025-10-17T22:36:47.154709] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:47.192143] [DEBUG] [LOCAL ] COF: Loaded 54402 existing records from primary storage. [2025-10-17T22:36:47.192287] [INFO ] [MAIN ] COF: Loaded 54402 primary data records. [2025-10-17T22:36:47.423978] [DEBUG] [LOCAL ] COMP: Loaded 54186 existing records from primary storage. [2025-10-17T22:36:47.430030] [INFO ] [MAIN ] COMP: Loaded 54186 primary data records. [2025-10-17T22:36:47.430844] [DEBUG] [LOCAL ] CON: Loaded 39523 existing records from primary storage. [2025-10-17T22:36:47.467871] [INFO ] [MAIN ] CON: Loaded 39523 primary data records. [2025-10-17T22:36:48.234134] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:48.235631] [INFO ] [MAIN ] COF: Generated 1820 derivative records from 54402 primary records. [2025-10-17T22:36:48.235918] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-17T22:36:48.255794] [DEBUG] [LOCAL ] COF: Derivative data saved (1820 records). [2025-10-17T22:36:48.257131] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-17T22:36:48.262123] [INFO ] [MAIN ] Derivative Progress: 415/2083 symbols completed. COF took 1.2s. Estimated remaining: 10m 38s. Rate: 157.0 symbols/min [2025-10-17T22:36:48.262621] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:48.277087] [DEBUG] [MAIN ] COMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:48.278447] [INFO ] [MAIN ] COMP: Generated 1820 derivative records from 54186 primary records. [2025-10-17T22:36:48.278681] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-10-17T22:36:48.318330] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:48.320888] [INFO ] [MAIN ] CON: Generated 1820 derivative records from 39523 primary records. [2025-10-17T22:36:48.321536] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-10-17T22:36:48.322539] [DEBUG] [LOCAL ] COMP: Derivative data saved (1820 records). [2025-10-17T22:36:48.323347] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-10-17T22:36:48.340869] [INFO ] [MAIN ] Derivative Progress: 416/2083 symbols completed. COMP took 1.2s. Estimated remaining: 10m 36s. Rate: 157.3 symbols/min [2025-10-17T22:36:48.348771] [DEBUG] [LOCAL ] CON: Derivative data saved (1820 records). [2025-10-17T22:36:48.349077] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-10-17T22:36:48.348977] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:48.350098] [DEBUG] [LOCAL ] COOK: Loaded 25238 existing records from primary storage. [2025-10-17T22:36:48.350195] [INFO ] [MAIN ] COOK: Loaded 25238 primary data records. [2025-10-17T22:36:48.352581] [INFO ] [MAIN ] Derivative Progress: 417/2083 symbols completed. CON took 1.2s. Estimated remaining: 10m 34s. Rate: 157.6 symbols/min [2025-10-17T22:36:48.352879] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:48.714310] [DEBUG] [LOCAL ] COR: Loaded 47244 existing records from primary storage. [2025-10-17T22:36:48.714781] [INFO ] [MAIN ] COR: Loaded 47244 primary data records. [2025-10-17T22:36:48.715390] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-10-17T22:36:48.716063] [INFO ] [MAIN ] COP: Loaded 54507 primary data records. [2025-10-17T22:36:49.334308] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:49.335074] [INFO ] [MAIN ] COOK: Generated 1820 derivative records from 25238 primary records. [2025-10-17T22:36:49.335138] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-17T22:36:49.355971] [DEBUG] [LOCAL ] COOK: Derivative data saved (1820 records). [2025-10-17T22:36:49.356222] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-17T22:36:49.358481] [INFO ] [MAIN ] Derivative Progress: 418/2083 symbols completed. COOK took 1.1s. Estimated remaining: 10m 36s. Rate: 157.0 symbols/min [2025-10-17T22:36:49.396236] [DEBUG] [MAIN ] COP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:49.396553] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:49.397405] [INFO ] [MAIN ] COP: Generated 1820 derivative records from 54507 primary records. [2025-10-17T22:36:49.397493] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-10-17T22:36:49.398287] [INFO ] [MAIN ] COR: Generated 1820 derivative records from 47244 primary records. [2025-10-17T22:36:49.398388] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-10-17T22:36:49.427265] [DEBUG] [LOCAL ] COP: Derivative data saved (1820 records). [2025-10-17T22:36:49.428682] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-10-17T22:36:49.431155] [INFO ] [MAIN ] Derivative Progress: 419/2083 symbols completed. COP took 1.1s. Estimated remaining: 10m 35s. Rate: 157.3 symbols/min [2025-10-17T22:36:49.433541] [DEBUG] [LOCAL ] COR: Derivative data saved (1820 records). [2025-10-17T22:36:49.433610] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-10-17T22:36:49.436213] [INFO ] [MAIN ] Derivative Progress: 420/2083 symbols completed. COR took 1.1s. Estimated remaining: 10m 33s. Rate: 157.7 symbols/min [2025-10-17T22:36:49.436882] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:49.437003] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:49.436818] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:49.495511] [DEBUG] [LOCAL ] CPA: Loaded 28704 existing records from primary storage. [2025-10-17T22:36:49.496413] [INFO ] [MAIN ] CPA: Loaded 28704 primary data records. [2025-10-17T22:36:49.566826] [DEBUG] [LOCAL ] CP: Loaded 54017 existing records from primary storage. [2025-10-17T22:36:49.593204] [INFO ] [MAIN ] CP: Loaded 54017 primary data records. [2025-10-17T22:36:49.737182] [DEBUG] [LOCAL ] COUR: Loaded 50057 existing records from primary storage. [2025-10-17T22:36:49.758750] [INFO ] [MAIN ] COUR: Loaded 50057 primary data records. [2025-10-17T22:36:50.511943] [DEBUG] [MAIN ] CPA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:50.512987] [INFO ] [MAIN ] CPA: Generated 1820 derivative records from 28704 primary records. [2025-10-17T22:36:50.513196] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-10-17T22:36:50.545408] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:50.546975] [INFO ] [MAIN ] CP: Generated 1820 derivative records from 54017 primary records. [2025-10-17T22:36:50.547222] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-17T22:36:50.547283] [DEBUG] [LOCAL ] CPA: Derivative data saved (1820 records). [2025-10-17T22:36:50.549234] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-10-17T22:36:50.553097] [INFO ] [MAIN ] Derivative Progress: 421/2083 symbols completed. CPA took 1.1s. Estimated remaining: 10m 35s. Rate: 157.0 symbols/min [2025-10-17T22:36:50.553247] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:50.569245] [DEBUG] [LOCAL ] CP: Derivative data saved (1820 records). [2025-10-17T22:36:50.569543] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-10-17T22:36:50.571581] [INFO ] [MAIN ] Derivative Progress: 422/2083 symbols completed. CP took 1.1s. Estimated remaining: 10m 33s. Rate: 157.3 symbols/min [2025-10-17T22:36:50.589585] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:50.591923] [DEBUG] [MAIN ] COUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:50.593411] [INFO ] [MAIN ] COUR: Generated 1820 derivative records from 50057 primary records. [2025-10-17T22:36:50.593635] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-17T22:36:50.633881] [DEBUG] [LOCAL ] CPF: Loaded 15519 existing records from primary storage. [2025-10-17T22:36:50.633992] [INFO ] [MAIN ] CPF: Loaded 15519 primary data records. [2025-10-17T22:36:50.633518] [DEBUG] [LOCAL ] COUR: Derivative data saved (1820 records). [2025-10-17T22:36:50.712099] [DEBUG] [LOCAL ] CPAY: Loaded 30966 existing records from primary storage. [2025-10-17T22:36:50.678828] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-10-17T22:36:50.723606] [INFO ] [MAIN ] CPAY: Loaded 30966 primary data records. [2025-10-17T22:36:50.763948] [INFO ] [MAIN ] Derivative Progress: 423/2083 symbols completed. COUR took 1.3s. Estimated remaining: 10m 32s. Rate: 157.5 symbols/min [2025-10-17T22:36:50.789602] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:51.125047] [DEBUG] [LOCAL ] CPK: Loaded 14207 existing records from primary storage. [2025-10-17T22:36:51.132309] [INFO ] [MAIN ] CPK: Loaded 14207 primary data records. [2025-10-17T22:36:51.660971] [DEBUG] [MAIN ] CPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:51.660559] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:51.661964] [INFO ] [MAIN ] CPF: Generated 1820 derivative records from 15519 primary records. [2025-10-17T22:36:51.662175] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-17T22:36:51.663666] [INFO ] [MAIN ] CPAY: Generated 1820 derivative records from 30966 primary records. [2025-10-17T22:36:51.663749] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-17T22:36:51.690762] [DEBUG] [LOCAL ] CPF: Derivative data saved (1820 records). [2025-10-17T22:36:51.690978] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-10-17T22:36:51.692940] [INFO ] [MAIN ] Derivative Progress: 424/2083 symbols completed. CPF took 1.1s. Estimated remaining: 10m 34s. Rate: 157.0 symbols/min [2025-10-17T22:36:51.697589] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1820 records). [2025-10-17T22:36:51.698089] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:51.697856] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-17T22:36:51.700578] [INFO ] [MAIN ] Derivative Progress: 425/2083 symbols completed. CPAY took 1.1s. Estimated remaining: 10m 32s. Rate: 157.3 symbols/min [2025-10-17T22:36:51.700832] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:51.716397] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:51.717163] [INFO ] [MAIN ] CPK: Generated 1820 derivative records from 14207 primary records. [2025-10-17T22:36:51.717265] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-17T22:36:51.735431] [DEBUG] [LOCAL ] CPK: Derivative data saved (1820 records). [2025-10-17T22:36:51.735587] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-17T22:36:51.737767] [INFO ] [MAIN ] Derivative Progress: 426/2083 symbols completed. CPK took 0.9s. Estimated remaining: 10m 31s. Rate: 157.7 symbols/min [2025-10-17T22:36:51.737999] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:51.793266] [DEBUG] [LOCAL ] CPNG: Loaded 54459 existing records from primary storage. [2025-10-17T22:36:51.802404] [INFO ] [MAIN ] CPNG: Loaded 54459 primary data records. [2025-10-17T22:36:51.803139] [DEBUG] [LOCAL ] CPS: Loaded 25505 existing records from primary storage. [2025-10-17T22:36:51.839730] [INFO ] [MAIN ] CPS: Loaded 25505 primary data records. [2025-10-17T22:36:51.995924] [DEBUG] [LOCAL ] CPRI: Loaded 53228 existing records from primary storage. [2025-10-17T22:36:52.024168] [INFO ] [MAIN ] CPRI: Loaded 53228 primary data records. [2025-10-17T22:36:52.752889] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:52.753313] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:52.753977] [INFO ] [MAIN ] CPS: Generated 1820 derivative records from 25505 primary records. [2025-10-17T22:36:52.754287] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-17T22:36:52.755013] [INFO ] [MAIN ] CPNG: Generated 1820 derivative records from 54459 primary records. [2025-10-17T22:36:52.755821] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-10-17T22:36:52.784812] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1820 records). [2025-10-17T22:36:52.784940] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-10-17T22:36:52.788263] [INFO ] [MAIN ] Derivative Progress: 427/2083 symbols completed. CPNG took 1.1s. Estimated remaining: 10m 33s. Rate: 157.0 symbols/min [2025-10-17T22:36:52.789110] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:52.792340] [DEBUG] [LOCAL ] CPS: Derivative data saved (1820 records). [2025-10-17T22:36:52.804680] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-10-17T22:36:52.807047] [INFO ] [MAIN ] Derivative Progress: 428/2083 symbols completed. CPS took 1.1s. Estimated remaining: 10m 31s. Rate: 157.4 symbols/min [2025-10-17T22:36:52.804957] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:52.808087] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:52.807909] [INFO ] [MAIN ] CPRI: Generated 1820 derivative records from 53228 primary records. [2025-10-17T22:36:52.808521] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-17T22:36:52.824865] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1820 records). [2025-10-17T22:36:52.825022] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-17T22:36:52.828748] [INFO ] [MAIN ] Derivative Progress: 429/2083 symbols completed. CPRI took 1.1s. Estimated remaining: 10m 29s. Rate: 157.7 symbols/min [2025-10-17T22:36:52.829156] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:52.852343] [DEBUG] [LOCAL ] CQP: Loaded 19156 existing records from primary storage. [2025-10-17T22:36:52.852611] [INFO ] [MAIN ] CQP: Loaded 19156 primary data records. [2025-10-17T22:36:52.977613] [DEBUG] [LOCAL ] CPT: Loaded 45243 existing records from primary storage. [2025-10-17T22:36:52.994710] [DEBUG] [LOCAL ] CR: Loaded 24488 existing records from primary storage. [2025-10-17T22:36:53.005055] [INFO ] [MAIN ] CPT: Loaded 45243 primary data records. [2025-10-17T22:36:53.005000] [INFO ] [MAIN ] CR: Loaded 24488 primary data records. [2025-10-17T22:36:53.914387] [DEBUG] [MAIN ] CQP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:53.916054] [INFO ] [MAIN ] CQP: Generated 1820 derivative records from 19156 primary records. [2025-10-17T22:36:53.919479] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-10-17T22:36:53.937670] [DEBUG] [LOCAL ] CQP: Derivative data saved (1820 records). [2025-10-17T22:36:53.938247] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-10-17T22:36:53.940259] [INFO ] [MAIN ] Derivative Progress: 430/2083 symbols completed. CQP took 1.1s. Estimated remaining: 10m 32s. Rate: 157.0 symbols/min [2025-10-17T22:36:53.940538] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:53.965108] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:53.967284] [INFO ] [MAIN ] CPT: Generated 1820 derivative records from 45243 primary records. [2025-10-17T22:36:53.967376] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-17T22:36:53.971282] [DEBUG] [LOCAL ] CRBD: Loaded 9015 existing records from primary storage. [2025-10-17T22:36:53.972459] [INFO ] [MAIN ] CRBD: Loaded 9015 primary data records. [2025-10-17T22:36:54.091581] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:54.100568] [DEBUG] [LOCAL ] CPT: Derivative data saved (1820 records). [2025-10-17T22:36:54.104403] [INFO ] [MAIN ] CR: Generated 1820 derivative records from 24488 primary records. [2025-10-17T22:36:54.104529] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-17T22:36:54.103708] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-17T22:36:54.126963] [INFO ] [MAIN ] Derivative Progress: 431/2083 symbols completed. CPT took 1.3s. Estimated remaining: 10m 31s. Rate: 157.2 symbols/min [2025-10-17T22:36:54.147404] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:54.319342] [DEBUG] [LOCAL ] CR: Derivative data saved (1820 records). [2025-10-17T22:36:54.319548] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-17T22:36:54.321754] [INFO ] [MAIN ] Derivative Progress: 432/2083 symbols completed. CR took 1.5s. Estimated remaining: 10m 29s. Rate: 157.4 symbols/min [2025-10-17T22:36:54.322596] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:54.362520] [DEBUG] [LOCAL ] CRC: Loaded 44717 existing records from primary storage. [2025-10-17T22:36:54.362926] [INFO ] [MAIN ] CRC: Loaded 44717 primary data records. [2025-10-17T22:36:54.504095] [DEBUG] [MAIN ] CRBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:54.551162] [INFO ] [MAIN ] CRBD: Generated 1820 derivative records from 9015 primary records. [2025-10-17T22:36:54.691080] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-17T22:36:54.690976] [DEBUG] [LOCAL ] CRGY: Loaded 53283 existing records from primary storage. [2025-10-17T22:36:54.705540] [INFO ] [MAIN ] CRGY: Loaded 53283 primary data records. [2025-10-17T22:36:54.799412] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1820 records). [2025-10-17T22:36:54.823619] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-17T22:36:54.829352] [INFO ] [MAIN ] Derivative Progress: 433/2083 symbols completed. CRBD took 0.9s. Estimated remaining: 10m 30s. Rate: 157.3 symbols/min [2025-10-17T22:36:55.042062] [DEBUG] [MAIN ] CRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:55.042984] [INFO ] [MAIN ] CRC: Generated 1820 derivative records from 44717 primary records. [2025-10-17T22:36:55.043290] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-17T22:36:55.061403] [DEBUG] [LOCAL ] CRC: Derivative data saved (1820 records). [2025-10-17T22:36:55.061528] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-17T22:36:55.063636] [INFO ] [MAIN ] Derivative Progress: 434/2083 symbols completed. CRC took 0.9s. Estimated remaining: 10m 29s. Rate: 157.4 symbols/min [2025-10-17T22:36:55.081117] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:55.081798] [INFO ] [MAIN ] CRGY: Generated 1820 derivative records from 53283 primary records. [2025-10-17T22:36:55.081860] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-17T22:36:55.097553] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1820 records). [2025-10-17T22:36:55.097701] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-17T22:36:55.099739] [INFO ] [MAIN ] Derivative Progress: 435/2083 symbols completed. CRGY took 0.8s. Estimated remaining: 10m 27s. Rate: 157.7 symbols/min [2025-10-17T22:36:55.100208] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:55.100539] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:55.100154] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:55.175696] [DEBUG] [LOCAL ] CRL: Loaded 43452 existing records from primary storage. [2025-10-17T22:36:55.175904] [INFO ] [MAIN ] CRL: Loaded 43452 primary data records. [2025-10-17T22:36:55.311131] [DEBUG] [LOCAL ] CRK: Loaded 53025 existing records from primary storage. [2025-10-17T22:36:55.329244] [DEBUG] [LOCAL ] CRH: Loaded 54220 existing records from primary storage. [2025-10-17T22:36:55.353715] [INFO ] [MAIN ] CRH: Loaded 54220 primary data records. [2025-10-17T22:36:55.353564] [INFO ] [MAIN ] CRK: Loaded 53025 primary data records. [2025-10-17T22:36:56.198518] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:56.199530] [INFO ] [MAIN ] CRL: Generated 1820 derivative records from 43452 primary records. [2025-10-17T22:36:56.199837] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-17T22:36:56.217668] [DEBUG] [LOCAL ] CRL: Derivative data saved (1820 records). [2025-10-17T22:36:56.217998] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-17T22:36:56.219774] [INFO ] [MAIN ] Derivative Progress: 436/2083 symbols completed. CRL took 1.1s. Estimated remaining: 10m 29s. Rate: 157.0 symbols/min [2025-10-17T22:36:56.220074] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:56.252067] [DEBUG] [MAIN ] CRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:56.258116] [INFO ] [MAIN ] CRK: Generated 1820 derivative records from 53025 primary records. [2025-10-17T22:36:56.258256] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-17T22:36:56.259269] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:56.269232] [INFO ] [MAIN ] CRH: Generated 1820 derivative records from 54220 primary records. [2025-10-17T22:36:56.272843] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-17T22:36:56.291767] [DEBUG] [LOCAL ] CRK: Derivative data saved (1820 records). [2025-10-17T22:36:56.292080] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-10-17T22:36:56.294367] [INFO ] [MAIN ] Derivative Progress: 437/2083 symbols completed. CRK took 1.2s. Estimated remaining: 10m 28s. Rate: 157.3 symbols/min [2025-10-17T22:36:56.296043] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:56.296240] [DEBUG] [LOCAL ] CRH: Derivative data saved (1820 records). [2025-10-17T22:36:56.298795] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-10-17T22:36:56.300902] [INFO ] [MAIN ] Derivative Progress: 438/2083 symbols completed. CRH took 1.2s. Estimated remaining: 10m 26s. Rate: 157.7 symbols/min [2025-10-17T22:36:56.301082] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:56.322134] [DEBUG] [LOCAL ] CRT: Loaded 4975 existing records from primary storage. [2025-10-17T22:36:56.322337] [INFO ] [MAIN ] CRT: Loaded 4975 primary data records. [2025-10-17T22:36:56.437078] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-10-17T22:36:56.458266] [INFO ] [MAIN ] CRM: Loaded 54550 primary data records. [2025-10-17T22:36:56.754318] [DEBUG] [LOCAL ] CRS: Loaded 43714 existing records from primary storage. [2025-10-17T22:36:56.757710] [INFO ] [MAIN ] CRS: Loaded 43714 primary data records. [2025-10-17T22:36:57.279691] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:57.281143] [INFO ] [MAIN ] CRT: Generated 1820 derivative records from 4975 primary records. [2025-10-17T22:36:57.281431] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-17T22:36:57.301190] [DEBUG] [LOCAL ] CRT: Derivative data saved (1820 records). [2025-10-17T22:36:57.301669] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-17T22:36:57.303689] [INFO ] [MAIN ] Derivative Progress: 439/2083 symbols completed. CRT took 1.0s. Estimated remaining: 10m 28s. Rate: 157.1 symbols/min [2025-10-17T22:36:57.304017] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:57.318984] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:57.320075] [INFO ] [MAIN ] CRM: Generated 1820 derivative records from 54550 primary records. [2025-10-17T22:36:57.320254] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-17T22:36:57.339621] [DEBUG] [LOCAL ] CRM: Derivative data saved (1820 records). [2025-10-17T22:36:57.340992] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-17T22:36:57.343914] [INFO ] [MAIN ] Derivative Progress: 440/2083 symbols completed. CRM took 1.1s. Estimated remaining: 10m 26s. Rate: 157.4 symbols/min [2025-10-17T22:36:57.344585] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:57.372469] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:57.373228] [INFO ] [MAIN ] CRS: Generated 1820 derivative records from 43714 primary records. [2025-10-17T22:36:57.373356] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-17T22:36:57.389834] [DEBUG] [LOCAL ] CRS: Derivative data saved (1820 records). [2025-10-17T22:36:57.389991] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-17T22:36:57.392134] [INFO ] [MAIN ] Derivative Progress: 441/2083 symbols completed. CRS took 1.1s. Estimated remaining: 10m 25s. Rate: 157.7 symbols/min [2025-10-17T22:36:57.392372] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:57.405920] [DEBUG] [LOCAL ] CSAN: Loaded 42773 existing records from primary storage. [2025-10-17T22:36:57.406158] [INFO ] [MAIN ] CSAN: Loaded 42773 primary data records. [2025-10-17T22:36:57.529201] [DEBUG] [LOCAL ] CSR: Loaded 13649 existing records from primary storage. [2025-10-17T22:36:57.538345] [INFO ] [MAIN ] CSR: Loaded 13649 primary data records. [2025-10-17T22:36:57.581163] [DEBUG] [LOCAL ] CSL: Loaded 31991 existing records from primary storage. [2025-10-17T22:36:57.598744] [INFO ] [MAIN ] CSL: Loaded 31991 primary data records. [2025-10-17T22:36:58.389741] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:58.390818] [INFO ] [MAIN ] CSAN: Generated 1820 derivative records from 42773 primary records. [2025-10-17T22:36:58.391171] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-17T22:36:58.425015] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1820 records). [2025-10-17T22:36:58.426923] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-17T22:36:58.426833] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:58.428917] [INFO ] [MAIN ] Derivative Progress: 442/2083 symbols completed. CSAN took 1.1s. Estimated remaining: 10m 27s. Rate: 157.1 symbols/min [2025-10-17T22:36:58.429911] [INFO ] [MAIN ] CSR: Generated 1820 derivative records from 13649 primary records. [2025-10-17T22:36:58.430142] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-17T22:36:58.430276] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:58.444794] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:58.452540] [INFO ] [MAIN ] CSL: Generated 1820 derivative records from 31991 primary records. [2025-10-17T22:36:58.460844] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-17T22:36:58.460732] [DEBUG] [LOCAL ] CSR: Derivative data saved (1820 records). [2025-10-17T22:36:58.461989] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-17T22:36:58.464027] [INFO ] [MAIN ] Derivative Progress: 443/2083 symbols completed. CSR took 1.1s. Estimated remaining: 10m 25s. Rate: 157.4 symbols/min [2025-10-17T22:36:58.471774] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:58.481318] [DEBUG] [LOCAL ] CSL: Derivative data saved (1820 records). [2025-10-17T22:36:58.481469] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-17T22:36:58.483600] [INFO ] [MAIN ] Derivative Progress: 444/2083 symbols completed. CSL took 1.1s. Estimated remaining: 10m 23s. Rate: 157.8 symbols/min [2025-10-17T22:36:58.483850] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:58.508791] [DEBUG] [LOCAL ] CSV: Loaded 12794 existing records from primary storage. [2025-10-17T22:36:58.508977] [INFO ] [MAIN ] CSV: Loaded 12794 primary data records. [2025-10-17T22:36:58.542699] [DEBUG] [LOCAL ] CTDD: Loaded 5501 existing records from primary storage. [2025-10-17T22:36:58.555235] [INFO ] [MAIN ] CTDD: Loaded 5501 primary data records. [2025-10-17T22:36:58.689849] [DEBUG] [LOCAL ] CSTM: Loaded 48273 existing records from primary storage. [2025-10-17T22:36:58.698543] [INFO ] [MAIN ] CSTM: Loaded 48273 primary data records. [2025-10-17T22:36:59.503334] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:59.504357] [INFO ] [MAIN ] CSV: Generated 1820 derivative records from 12794 primary records. [2025-10-17T22:36:59.504526] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-17T22:36:59.539748] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:36:59.539312] [DEBUG] [LOCAL ] CSV: Derivative data saved (1820 records). [2025-10-17T22:36:59.540030] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-17T22:36:59.542626] [INFO ] [MAIN ] Derivative Progress: 445/2083 symbols completed. CSV took 1.1s. Estimated remaining: 10m 25s. Rate: 157.1 symbols/min [2025-10-17T22:36:59.540769] [INFO ] [MAIN ] CTDD: Generated 1819 derivative records from 5501 primary records. [2025-10-17T22:36:59.550334] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:59.555073] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-17T22:36:59.556270] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:36:59.557173] [INFO ] [MAIN ] CSTM: Generated 1820 derivative records from 48273 primary records. [2025-10-17T22:36:59.557663] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-10-17T22:36:59.572853] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1819 records). [2025-10-17T22:36:59.581024] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-10-17T22:36:59.583076] [INFO ] [MAIN ] Derivative Progress: 446/2083 symbols completed. CTDD took 1.1s. Estimated remaining: 10m 24s. Rate: 157.5 symbols/min [2025-10-17T22:36:59.583262] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:59.600393] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1820 records). [2025-10-17T22:36:59.600536] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-10-17T22:36:59.602617] [INFO ] [MAIN ] Derivative Progress: 447/2083 symbols completed. CSTM took 1.2s. Estimated remaining: 10m 22s. Rate: 157.8 symbols/min [2025-10-17T22:36:59.602919] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:36:59.614711] [DEBUG] [LOCAL ] CTO: Loaded 28050 existing records from primary storage. [2025-10-17T22:36:59.614841] [INFO ] [MAIN ] CTO: Loaded 28050 primary data records. [2025-10-17T22:36:59.795605] [DEBUG] [LOCAL ] CTOS: Loaded 37827 existing records from primary storage. [2025-10-17T22:36:59.936611] [INFO ] [MAIN ] CTOS: Loaded 37827 primary data records. [2025-10-17T22:37:00.088235] [DEBUG] [LOCAL ] CTRA: Loaded 54427 existing records from primary storage. [2025-10-17T22:37:00.114868] [INFO ] [MAIN ] CTRA: Loaded 54427 primary data records. [2025-10-17T22:37:00.587226] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:00.588360] [INFO ] [MAIN ] CTO: Generated 1820 derivative records from 28050 primary records. [2025-10-17T22:37:00.588682] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-10-17T22:37:00.606175] [DEBUG] [LOCAL ] CTO: Derivative data saved (1820 records). [2025-10-17T22:37:00.607963] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-10-17T22:37:00.610065] [INFO ] [MAIN ] Derivative Progress: 448/2083 symbols completed. CTO took 1.1s. Estimated remaining: 10m 24s. Rate: 157.2 symbols/min [2025-10-17T22:37:00.624468] [DEBUG] [MAIN ] CTOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:00.625502] [INFO ] [MAIN ] CTOS: Generated 1820 derivative records from 37827 primary records. [2025-10-17T22:37:00.625573] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-10-17T22:37:00.643800] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1820 records). [2025-10-17T22:37:00.643926] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-10-17T22:37:00.645888] [INFO ] [MAIN ] Derivative Progress: 449/2083 symbols completed. CTOS took 1.1s. Estimated remaining: 10m 22s. Rate: 157.5 symbols/min [2025-10-17T22:37:00.660782] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:00.661315] [INFO ] [MAIN ] CTRA: Generated 1820 derivative records from 54427 primary records. [2025-10-17T22:37:00.661373] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-17T22:37:00.676888] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1820 records). [2025-10-17T22:37:00.676950] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-17T22:37:00.679551] [INFO ] [MAIN ] Derivative Progress: 450/2083 symbols completed. CTRA took 1.1s. Estimated remaining: 10m 21s. Rate: 157.8 symbols/min [2025-10-17T22:37:00.680030] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:00.679974] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:00.680146] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:00.716864] [DEBUG] [LOCAL ] CTS: Loaded 20047 existing records from primary storage. [2025-10-17T22:37:00.717095] [INFO ] [MAIN ] CTS: Loaded 20047 primary data records. [2025-10-17T22:37:00.849049] [DEBUG] [LOCAL ] CTRI: Loaded 40805 existing records from primary storage. [2025-10-17T22:37:00.865422] [INFO ] [MAIN ] CTRI: Loaded 40805 primary data records. [2025-10-17T22:37:00.997433] [DEBUG] [LOCAL ] CTVA: Loaded 54075 existing records from primary storage. [2025-10-17T22:37:01.019231] [INFO ] [MAIN ] CTVA: Loaded 54075 primary data records. [2025-10-17T22:37:01.739545] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:01.740596] [INFO ] [MAIN ] CTS: Generated 1820 derivative records from 20047 primary records. [2025-10-17T22:37:01.742126] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-17T22:37:01.763107] [DEBUG] [LOCAL ] CTS: Derivative data saved (1820 records). [2025-10-17T22:37:01.776472] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-17T22:37:01.779135] [INFO ] [MAIN ] Derivative Progress: 451/2083 symbols completed. CTS took 1.1s. Estimated remaining: 10m 23s. Rate: 157.2 symbols/min [2025-10-17T22:37:01.779617] [DEBUG] [MAIN ] CTRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:01.779975] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:01.782557] [INFO ] [MAIN ] CTRI: Generated 1820 derivative records from 40805 primary records. [2025-10-17T22:37:01.783142] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-10-17T22:37:01.812960] [DEBUG] [MAIN ] CTVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:01.815964] [INFO ] [MAIN ] CTVA: Generated 1820 derivative records from 54075 primary records. [2025-10-17T22:37:01.816101] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-10-17T22:37:01.827287] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1820 records). [2025-10-17T22:37:01.831679] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-10-17T22:37:01.834663] [INFO ] [MAIN ] Derivative Progress: 452/2083 symbols completed. CTRI took 1.2s. Estimated remaining: 10m 21s. Rate: 157.5 symbols/min [2025-10-17T22:37:01.835224] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:01.839927] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1820 records). [2025-10-17T22:37:01.840419] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-10-17T22:37:01.843523] [INFO ] [MAIN ] Derivative Progress: 453/2083 symbols completed. CTVA took 1.2s. Estimated remaining: 10m 20s. Rate: 157.8 symbols/min [2025-10-17T22:37:01.844014] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:01.863228] [DEBUG] [LOCAL ] CULP: Loaded 2947 existing records from primary storage. [2025-10-17T22:37:01.863493] [INFO ] [MAIN ] CULP: Loaded 2947 primary data records. [2025-10-17T22:37:01.994480] [DEBUG] [LOCAL ] CUBE: Loaded 51666 existing records from primary storage. [2025-10-17T22:37:01.994775] [INFO ] [MAIN ] CUBE: Loaded 51666 primary data records. [2025-10-17T22:37:02.320535] [DEBUG] [LOCAL ] CUK: Loaded 51814 existing records from primary storage. [2025-10-17T22:37:02.333431] [INFO ] [MAIN ] CUK: Loaded 51814 primary data records. [2025-10-17T22:37:02.863452] [DEBUG] [MAIN ] CULP: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:37:02.865319] [INFO ] [MAIN ] CULP: Generated 1819 derivative records from 2947 primary records. [2025-10-17T22:37:02.866500] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-10-17T22:37:02.886042] [DEBUG] [MAIN ] CUBE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:02.890865] [INFO ] [MAIN ] CUBE: Generated 1820 derivative records from 51666 primary records. [2025-10-17T22:37:02.890955] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-17T22:37:02.894935] [DEBUG] [LOCAL ] CULP: Derivative data saved (1819 records). [2025-10-17T22:37:02.895237] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-10-17T22:37:02.897324] [INFO ] [MAIN ] Derivative Progress: 454/2083 symbols completed. CULP took 1.1s. Estimated remaining: 10m 22s. Rate: 157.2 symbols/min [2025-10-17T22:37:02.898008] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:02.914611] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1820 records). [2025-10-17T22:37:02.914868] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-10-17T22:37:02.917045] [INFO ] [MAIN ] Derivative Progress: 455/2083 symbols completed. CUBE took 1.1s. Estimated remaining: 10m 20s. Rate: 157.5 symbols/min [2025-10-17T22:37:02.918427] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:02.934769] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:02.935593] [INFO ] [MAIN ] CUK: Generated 1820 derivative records from 51814 primary records. [2025-10-17T22:37:02.935834] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-17T22:37:02.970548] [DEBUG] [LOCAL ] CUK: Derivative data saved (1820 records). [2025-10-17T22:37:02.980887] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-17T22:37:02.983144] [INFO ] [MAIN ] Derivative Progress: 456/2083 symbols completed. CUK took 1.1s. Estimated remaining: 10m 19s. Rate: 157.8 symbols/min [2025-10-17T22:37:02.983432] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:02.984328] [DEBUG] [LOCAL ] CURB: Loaded 33392 existing records from primary storage. [2025-10-17T22:37:02.984817] [INFO ] [MAIN ] CURB: Loaded 33392 primary data records. [2025-10-17T22:37:03.066116] [DEBUG] [LOCAL ] CURV: Loaded 27541 existing records from primary storage. [2025-10-17T22:37:03.089307] [INFO ] [MAIN ] CURV: Loaded 27541 primary data records. [2025-10-17T22:37:03.665116] [DEBUG] [LOCAL ] CUZ: Loaded 50363 existing records from primary storage. [2025-10-17T22:37:03.665681] [INFO ] [MAIN ] CUZ: Loaded 50363 primary data records. [2025-10-17T22:37:03.994237] [DEBUG] [MAIN ] CURB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:03.995700] [INFO ] [MAIN ] CURB: Generated 1820 derivative records from 33392 primary records. [2025-10-17T22:37:03.998352] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-10-17T22:37:04.026884] [DEBUG] [LOCAL ] CURB: Derivative data saved (1820 records). [2025-10-17T22:37:04.027442] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:04.028510] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-10-17T22:37:04.028443] [INFO ] [MAIN ] CURV: Generated 1820 derivative records from 27541 primary records. [2025-10-17T22:37:04.028820] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-17T22:37:04.030787] [INFO ] [MAIN ] Derivative Progress: 457/2083 symbols completed. CURB took 1.1s. Estimated remaining: 10m 21s. Rate: 157.2 symbols/min [2025-10-17T22:37:04.031775] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:04.049197] [DEBUG] [LOCAL ] CURV: Derivative data saved (1820 records). [2025-10-17T22:37:04.049808] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-10-17T22:37:04.052081] [INFO ] [MAIN ] Derivative Progress: 458/2083 symbols completed. CURV took 1.1s. Estimated remaining: 10m 19s. Rate: 157.5 symbols/min [2025-10-17T22:37:04.052627] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:04.078820] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:04.079837] [INFO ] [MAIN ] CUZ: Generated 1820 derivative records from 50363 primary records. [2025-10-17T22:37:04.080018] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-17T22:37:04.099701] [DEBUG] [LOCAL ] CVEO: Loaded 15568 existing records from primary storage. [2025-10-17T22:37:04.107251] [INFO ] [MAIN ] CVEO: Loaded 15568 primary data records. [2025-10-17T22:37:04.198374] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1820 records). [2025-10-17T22:37:04.198498] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-17T22:37:04.201092] [INFO ] [MAIN ] Derivative Progress: 459/2083 symbols completed. CUZ took 1.2s. Estimated remaining: 10m 18s. Rate: 157.8 symbols/min [2025-10-17T22:37:04.248067] [DEBUG] [LOCAL ] CVE: Loaded 54342 existing records from primary storage. [2025-10-17T22:37:04.246712] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:04.258625] [INFO ] [MAIN ] CVE: Loaded 54342 primary data records. [2025-10-17T22:37:04.780830] [DEBUG] [LOCAL ] CVI: Loaded 47330 existing records from primary storage. [2025-10-17T22:37:04.794858] [INFO ] [MAIN ] CVI: Loaded 47330 primary data records. [2025-10-17T22:37:05.000148] [DEBUG] [MAIN ] CVEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:05.117158] [INFO ] [MAIN ] CVEO: Generated 1820 derivative records from 15568 primary records. [2025-10-17T22:37:05.118042] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-10-17T22:37:05.135210] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1820 records). [2025-10-17T22:37:05.136129] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-10-17T22:37:05.138674] [INFO ] [MAIN ] Derivative Progress: 460/2083 symbols completed. CVEO took 1.1s. Estimated remaining: 10m 19s. Rate: 157.3 symbols/min [2025-10-17T22:37:05.139048] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:05.157714] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:05.158603] [INFO ] [MAIN ] CVE: Generated 1820 derivative records from 54342 primary records. [2025-10-17T22:37:05.158844] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-10-17T22:37:05.186578] [DEBUG] [LOCAL ] CVLG: Loaded 15760 existing records from primary storage. [2025-10-17T22:37:05.186688] [INFO ] [MAIN ] CVLG: Loaded 15760 primary data records. [2025-10-17T22:37:05.186217] [DEBUG] [LOCAL ] CVE: Derivative data saved (1820 records). [2025-10-17T22:37:05.223167] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-10-17T22:37:05.251940] [INFO ] [MAIN ] Derivative Progress: 461/2083 symbols completed. CVE took 1.2s. Estimated remaining: 10m 18s. Rate: 157.5 symbols/min [2025-10-17T22:37:05.263691] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:05.363995] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:05.384251] [INFO ] [MAIN ] CVI: Generated 1820 derivative records from 47330 primary records. [2025-10-17T22:37:05.522565] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-10-17T22:37:05.558815] [DEBUG] [LOCAL ] CVI: Derivative data saved (1820 records). [2025-10-17T22:37:05.559358] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-10-17T22:37:05.561606] [INFO ] [MAIN ] Derivative Progress: 462/2083 symbols completed. CVI took 1.3s. Estimated remaining: 10m 17s. Rate: 157.6 symbols/min [2025-10-17T22:37:05.561862] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:05.598115] [DEBUG] [MAIN ] CVLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:05.598864] [INFO ] [MAIN ] CVLG: Generated 1820 derivative records from 15760 primary records. [2025-10-17T22:37:05.598928] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-10-17T22:37:05.618911] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1820 records). [2025-10-17T22:37:05.636151] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-10-17T22:37:05.638486] [INFO ] [MAIN ] Derivative Progress: 463/2083 symbols completed. CVLG took 0.5s. Estimated remaining: 10m 16s. Rate: 157.8 symbols/min [2025-10-17T22:37:05.640535] [DEBUG] [LOCAL ] CVNA: Loaded 53628 existing records from primary storage. [2025-10-17T22:37:05.640730] [INFO ] [MAIN ] CVNA: Loaded 53628 primary data records. [2025-10-17T22:37:05.844545] [DEBUG] [LOCAL ] CVS: Loaded 54474 existing records from primary storage. [2025-10-17T22:37:05.853991] [INFO ] [MAIN ] CVS: Loaded 54474 primary data records. [2025-10-17T22:37:06.319599] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:06.320348] [INFO ] [MAIN ] CVNA: Generated 1820 derivative records from 53628 primary records. [2025-10-17T22:37:06.320521] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-10-17T22:37:06.337597] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1820 records). [2025-10-17T22:37:06.338731] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-10-17T22:37:06.341563] [INFO ] [MAIN ] Derivative Progress: 464/2083 symbols completed. CVNA took 1.1s. Estimated remaining: 10m 17s. Rate: 157.5 symbols/min [2025-10-17T22:37:06.356283] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:06.356963] [INFO ] [MAIN ] CVS: Generated 1820 derivative records from 54474 primary records. [2025-10-17T22:37:06.357026] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-17T22:37:06.372628] [DEBUG] [LOCAL ] CVS: Derivative data saved (1820 records). [2025-10-17T22:37:06.372717] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-17T22:37:06.374916] [INFO ] [MAIN ] Derivative Progress: 465/2083 symbols completed. CVS took 0.8s. Estimated remaining: 10m 15s. Rate: 157.9 symbols/min [2025-10-17T22:37:06.375470] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:06.375752] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:06.375586] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:06.400324] [DEBUG] [LOCAL ] CW: Loaded 22372 existing records from primary storage. [2025-10-17T22:37:06.400470] [INFO ] [MAIN ] CW: Loaded 22372 primary data records. [2025-10-17T22:37:06.741862] [DEBUG] [LOCAL ] CWEN: Loaded 45984 existing records from primary storage. [2025-10-17T22:37:06.742562] [DEBUG] [LOCAL ] CWAN: Loaded 53387 existing records from primary storage. [2025-10-17T22:37:06.756580] [INFO ] [MAIN ] CWEN: Loaded 45984 primary data records. [2025-10-17T22:37:06.756855] [INFO ] [MAIN ] CWAN: Loaded 53387 primary data records. [2025-10-17T22:37:07.445875] [DEBUG] [MAIN ] CW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:07.447608] [INFO ] [MAIN ] CW: Generated 1820 derivative records from 22372 primary records. [2025-10-17T22:37:07.447881] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-17T22:37:07.469170] [DEBUG] [LOCAL ] CW: Derivative data saved (1820 records). [2025-10-17T22:37:07.470224] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-10-17T22:37:07.472710] [INFO ] [MAIN ] Derivative Progress: 466/2083 symbols completed. CW took 1.1s. Estimated remaining: 10m 17s. Rate: 157.2 symbols/min [2025-10-17T22:37:07.485367] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:07.487187] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:07.488038] [INFO ] [MAIN ] CWAN: Generated 1820 derivative records from 53387 primary records. [2025-10-17T22:37:07.488218] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-17T22:37:07.506282] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1820 records). [2025-10-17T22:37:07.507258] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-10-17T22:37:07.510157] [INFO ] [MAIN ] Derivative Progress: 467/2083 symbols completed. CWAN took 1.1s. Estimated remaining: 10m 16s. Rate: 157.5 symbols/min [2025-10-17T22:37:07.510492] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:07.527832] [DEBUG] [MAIN ] CWEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:07.528624] [INFO ] [MAIN ] CWEN: Generated 1820 derivative records from 45984 primary records. [2025-10-17T22:37:07.528741] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-10-17T22:37:07.549321] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1820 records). [2025-10-17T22:37:07.549596] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-10-17T22:37:07.551955] [INFO ] [MAIN ] Derivative Progress: 468/2083 symbols completed. CWEN took 1.2s. Estimated remaining: 10m 14s. Rate: 157.8 symbols/min [2025-10-17T22:37:07.552244] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:07.605426] [DEBUG] [LOCAL ] CWH: Loaded 52055 existing records from primary storage. [2025-10-17T22:37:07.605684] [INFO ] [MAIN ] CWH: Loaded 52055 primary data records. [2025-10-17T22:37:07.702962] [DEBUG] [LOCAL ] CWK: Loaded 50364 existing records from primary storage. [2025-10-17T22:37:07.718432] [INFO ] [MAIN ] CWK: Loaded 50364 primary data records. [2025-10-17T22:37:07.726569] [DEBUG] [LOCAL ] CWT: Loaded 28510 existing records from primary storage. [2025-10-17T22:37:07.730005] [INFO ] [MAIN ] CWT: Loaded 28510 primary data records. [2025-10-17T22:37:08.626484] [DEBUG] [MAIN ] CWH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:08.627563] [INFO ] [MAIN ] CWH: Generated 1820 derivative records from 52055 primary records. [2025-10-17T22:37:08.627935] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-10-17T22:37:08.665330] [DEBUG] [MAIN ] CWT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:08.664867] [DEBUG] [LOCAL ] CWH: Derivative data saved (1820 records). [2025-10-17T22:37:08.666443] [INFO ] [MAIN ] CWT: Generated 1820 derivative records from 28510 primary records. [2025-10-17T22:37:08.679412] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:08.680184] [INFO ] [MAIN ] CWK: Generated 1820 derivative records from 50364 primary records. [2025-10-17T22:37:08.679105] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-10-17T22:37:08.680331] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-17T22:37:08.678917] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-10-17T22:37:08.683607] [INFO ] [MAIN ] Derivative Progress: 469/2083 symbols completed. CWH took 1.2s. Estimated remaining: 10m 16s. Rate: 157.2 symbols/min [2025-10-17T22:37:08.691117] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:08.716013] [DEBUG] [LOCAL ] CWT: Derivative data saved (1820 records). [2025-10-17T22:37:08.717901] [DEBUG] [LOCAL ] CWK: Derivative data saved (1820 records). [2025-10-17T22:37:08.717994] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-10-17T22:37:08.718342] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-17T22:37:08.720664] [INFO ] [MAIN ] Derivative Progress: 470/2083 symbols completed. CWK took 1.2s. Estimated remaining: 10m 15s. Rate: 157.5 symbols/min [2025-10-17T22:37:08.723085] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:08.723457] [INFO ] [MAIN ] Derivative Progress: 471/2083 symbols completed. CWT took 1.2s. Estimated remaining: 10m 13s. Rate: 157.8 symbols/min [2025-10-17T22:37:08.723994] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:08.733498] [DEBUG] [LOCAL ] CXE: Loaded 6233 existing records from primary storage. [2025-10-17T22:37:08.733722] [INFO ] [MAIN ] CXE: Loaded 6233 primary data records. [2025-10-17T22:37:08.774277] [DEBUG] [LOCAL ] CXH: Loaded 4462 existing records from primary storage. [2025-10-17T22:37:08.781778] [INFO ] [MAIN ] CXH: Loaded 4462 primary data records. [2025-10-17T22:37:09.150940] [DEBUG] [LOCAL ] CX: Loaded 53605 existing records from primary storage. [2025-10-17T22:37:09.164683] [INFO ] [MAIN ] CX: Loaded 53605 primary data records. [2025-10-17T22:37:09.780074] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:09.782785] [INFO ] [MAIN ] CXE: Generated 1820 derivative records from 6233 primary records. [2025-10-17T22:37:09.783867] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-17T22:37:09.799252] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:09.816591] [DEBUG] [LOCAL ] CXE: Derivative data saved (1820 records). [2025-10-17T22:37:09.816769] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-17T22:37:09.818879] [INFO ] [MAIN ] Derivative Progress: 472/2083 symbols completed. CXE took 1.1s. Estimated remaining: 10m 15s. Rate: 157.2 symbols/min [2025-10-17T22:37:09.820137] [INFO ] [MAIN ] CXH: Generated 1820 derivative records from 4462 primary records. [2025-10-17T22:37:09.820457] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:09.821220] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-17T22:37:09.837261] [DEBUG] [LOCAL ] CXH: Derivative data saved (1820 records). [2025-10-17T22:37:09.839142] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-17T22:37:09.841530] [INFO ] [MAIN ] Derivative Progress: 473/2083 symbols completed. CXH took 1.1s. Estimated remaining: 10m 13s. Rate: 157.5 symbols/min [2025-10-17T22:37:09.841830] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:09.855677] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:09.856462] [INFO ] [MAIN ] CX: Generated 1820 derivative records from 53605 primary records. [2025-10-17T22:37:09.856578] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-17T22:37:09.873222] [DEBUG] [LOCAL ] CX: Derivative data saved (1820 records). [2025-10-17T22:37:09.873433] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-17T22:37:09.875821] [INFO ] [MAIN ] Derivative Progress: 474/2083 symbols completed. CX took 1.2s. Estimated remaining: 10m 12s. Rate: 157.8 symbols/min [2025-10-17T22:37:09.876142] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:09.909878] [DEBUG] [LOCAL ] CXT: Loaded 31488 existing records from primary storage. [2025-10-17T22:37:09.923261] [INFO ] [MAIN ] CXT: Loaded 31488 primary data records. [2025-10-17T22:37:09.935318] [DEBUG] [LOCAL ] CXM: Loaded 48245 existing records from primary storage. [2025-10-17T22:37:09.960717] [INFO ] [MAIN ] CXM: Loaded 48245 primary data records. [2025-10-17T22:37:10.152980] [DEBUG] [LOCAL ] CXW: Loaded 44487 existing records from primary storage. [2025-10-17T22:37:10.174702] [INFO ] [MAIN ] CXW: Loaded 44487 primary data records. [2025-10-17T22:37:10.867776] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:10.869521] [INFO ] [MAIN ] CXT: Generated 1820 derivative records from 31488 primary records. [2025-10-17T22:37:10.869740] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-17T22:37:10.898534] [DEBUG] [LOCAL ] CXT: Derivative data saved (1820 records). [2025-10-17T22:37:10.898770] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-17T22:37:10.900964] [INFO ] [MAIN ] Derivative Progress: 475/2083 symbols completed. CXT took 1.1s. Estimated remaining: 10m 14s. Rate: 157.2 symbols/min [2025-10-17T22:37:10.898991] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:10.901276] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:10.902621] [INFO ] [MAIN ] CXM: Generated 1820 derivative records from 48245 primary records. [2025-10-17T22:37:10.902982] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-17T22:37:10.932819] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:10.934349] [INFO ] [MAIN ] CXW: Generated 1820 derivative records from 44487 primary records. [2025-10-17T22:37:10.935207] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-17T22:37:10.936420] [DEBUG] [LOCAL ] CXM: Derivative data saved (1820 records). [2025-10-17T22:37:10.936745] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-17T22:37:10.939508] [INFO ] [MAIN ] Derivative Progress: 476/2083 symbols completed. CXM took 1.1s. Estimated remaining: 10m 12s. Rate: 157.5 symbols/min [2025-10-17T22:37:10.954692] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:10.963231] [DEBUG] [LOCAL ] CXW: Derivative data saved (1820 records). [2025-10-17T22:37:10.963383] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-17T22:37:10.965756] [INFO ] [MAIN ] Derivative Progress: 477/2083 symbols completed. CXW took 1.1s. Estimated remaining: 10m 11s. Rate: 157.8 symbols/min [2025-10-17T22:37:10.966064] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:10.975875] [DEBUG] [LOCAL ] CYD: Loaded 27356 existing records from primary storage. [2025-10-17T22:37:10.976097] [INFO ] [MAIN ] CYD: Loaded 27356 primary data records. [2025-10-17T22:37:11.078585] [DEBUG] [LOCAL ] DAC: Loaded 12751 existing records from primary storage. [2025-10-17T22:37:11.091463] [INFO ] [MAIN ] DAC: Loaded 12751 primary data records. [2025-10-17T22:37:11.237271] [DEBUG] [LOCAL ] CYH: Loaded 48440 existing records from primary storage. [2025-10-17T22:37:11.248367] [INFO ] [MAIN ] CYH: Loaded 48440 primary data records. [2025-10-17T22:37:11.966296] [DEBUG] [MAIN ] CYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:11.972194] [INFO ] [MAIN ] CYD: Generated 1820 derivative records from 27356 primary records. [2025-10-17T22:37:11.972337] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-10-17T22:37:11.973510] [DEBUG] [MAIN ] DAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:11.974570] [INFO ] [MAIN ] DAC: Generated 1820 derivative records from 12751 primary records. [2025-10-17T22:37:11.982692] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-17T22:37:12.002427] [DEBUG] [LOCAL ] CYD: Derivative data saved (1820 records). [2025-10-17T22:37:12.009301] [DEBUG] [LOCAL ] DAC: Derivative data saved (1820 records). [2025-10-17T22:37:12.009574] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-10-17T22:37:12.011700] [INFO ] [MAIN ] Derivative Progress: 478/2083 symbols completed. CYD took 1.1s. Estimated remaining: 10m 12s. Rate: 157.3 symbols/min [2025-10-17T22:37:12.009488] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-17T22:37:12.022278] [INFO ] [MAIN ] Derivative Progress: 479/2083 symbols completed. DAC took 1.0s. Estimated remaining: 10m 11s. Rate: 157.6 symbols/min [2025-10-17T22:37:12.027526] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:12.028270] [INFO ] [MAIN ] CYH: Generated 1820 derivative records from 48440 primary records. [2025-10-17T22:37:12.028331] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-17T22:37:12.043790] [DEBUG] [LOCAL ] CYH: Derivative data saved (1820 records). [2025-10-17T22:37:12.043905] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-17T22:37:12.046484] [INFO ] [MAIN ] Derivative Progress: 480/2083 symbols completed. CYH took 1.1s. Estimated remaining: 10m 9s. Rate: 157.9 symbols/min [2025-10-17T22:37:12.046915] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:12.046973] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:12.047062] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:12.072006] [DEBUG] [LOCAL ] DAO: Loaded 20206 existing records from primary storage. [2025-10-17T22:37:12.072162] [INFO ] [MAIN ] DAO: Loaded 20206 primary data records. [2025-10-17T22:37:12.268224] [DEBUG] [LOCAL ] DAN: Loaded 50069 existing records from primary storage. [2025-10-17T22:37:12.303265] [INFO ] [MAIN ] DAN: Loaded 50069 primary data records. [2025-10-17T22:37:12.417136] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-10-17T22:37:12.417398] [INFO ] [MAIN ] DAL: Loaded 54533 primary data records. [2025-10-17T22:37:13.030917] [DEBUG] [MAIN ] DAO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:13.034320] [INFO ] [MAIN ] DAO: Generated 1820 derivative records from 20206 primary records. [2025-10-17T22:37:13.034523] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-10-17T22:37:13.052890] [DEBUG] [LOCAL ] DAO: Derivative data saved (1820 records). [2025-10-17T22:37:13.053209] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-10-17T22:37:13.055930] [INFO ] [MAIN ] Derivative Progress: 481/2083 symbols completed. DAO took 1.0s. Estimated remaining: 10m 11s. Rate: 157.3 symbols/min [2025-10-17T22:37:13.057146] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:13.088929] [DEBUG] [MAIN ] DAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:13.088560] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:13.089871] [INFO ] [MAIN ] DAL: Generated 1820 derivative records from 54533 primary records. [2025-10-17T22:37:13.090013] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-17T22:37:13.091079] [INFO ] [MAIN ] DAN: Generated 1820 derivative records from 50069 primary records. [2025-10-17T22:37:13.091691] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-10-17T22:37:13.116667] [DEBUG] [LOCAL ] DAL: Derivative data saved (1820 records). [2025-10-17T22:37:13.123664] [DEBUG] [LOCAL ] DAN: Derivative data saved (1820 records). [2025-10-17T22:37:13.123932] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-17T22:37:13.126215] [INFO ] [MAIN ] Derivative Progress: 482/2083 symbols completed. DAL took 1.1s. Estimated remaining: 10m 10s. Rate: 157.6 symbols/min [2025-10-17T22:37:13.123842] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-10-17T22:37:13.128825] [INFO ] [MAIN ] Derivative Progress: 483/2083 symbols completed. DAN took 1.1s. Estimated remaining: 10m 8s. Rate: 157.9 symbols/min [2025-10-17T22:37:13.128660] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:13.129217] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:13.184692] [DEBUG] [LOCAL ] DAR: Loaded 52762 existing records from primary storage. [2025-10-17T22:37:13.185025] [INFO ] [MAIN ] DAR: Loaded 52762 primary data records. [2025-10-17T22:37:13.340968] [DEBUG] [LOCAL ] DAVA: Loaded 42431 existing records from primary storage. [2025-10-17T22:37:13.351613] [INFO ] [MAIN ] DAVA: Loaded 42431 primary data records. [2025-10-17T22:37:13.421250] [DEBUG] [LOCAL ] DB: Loaded 53281 existing records from primary storage. [2025-10-17T22:37:13.460297] [INFO ] [MAIN ] DB: Loaded 53281 primary data records. [2025-10-17T22:37:14.201519] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:14.202565] [INFO ] [MAIN ] DAR: Generated 1820 derivative records from 52762 primary records. [2025-10-17T22:37:14.202730] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-17T22:37:14.221209] [DEBUG] [LOCAL ] DAR: Derivative data saved (1820 records). [2025-10-17T22:37:14.224001] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-17T22:37:14.227323] [INFO ] [MAIN ] Derivative Progress: 484/2083 symbols completed. DAR took 1.2s. Estimated remaining: 10m 10s. Rate: 157.3 symbols/min [2025-10-17T22:37:14.228693] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:14.247968] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:14.249308] [INFO ] [MAIN ] DAVA: Generated 1820 derivative records from 42431 primary records. [2025-10-17T22:37:14.249500] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-17T22:37:14.290154] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:14.291306] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1820 records). [2025-10-17T22:37:14.291575] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-17T22:37:14.295278] [INFO ] [MAIN ] Derivative Progress: 485/2083 symbols completed. DAVA took 1.2s. Estimated remaining: 10m 8s. Rate: 157.6 symbols/min [2025-10-17T22:37:14.295574] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:14.292331] [INFO ] [MAIN ] DB: Generated 1820 derivative records from 53281 primary records. [2025-10-17T22:37:14.295807] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-17T22:37:14.324467] [DEBUG] [LOCAL ] DB: Derivative data saved (1820 records). [2025-10-17T22:37:14.324744] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-17T22:37:14.340666] [INFO ] [MAIN ] Derivative Progress: 486/2083 symbols completed. DB took 1.2s. Estimated remaining: 10m 7s. Rate: 157.9 symbols/min [2025-10-17T22:37:14.342698] [DEBUG] [LOCAL ] DBI: Loaded 44390 existing records from primary storage. [2025-10-17T22:37:14.341104] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:14.342903] [INFO ] [MAIN ] DBI: Loaded 44390 primary data records. [2025-10-17T22:37:14.680856] [DEBUG] [LOCAL ] DBRG: Loaded 50682 existing records from primary storage. [2025-10-17T22:37:14.681117] [INFO ] [MAIN ] DBRG: Loaded 50682 primary data records. [2025-10-17T22:37:14.796430] [DEBUG] [LOCAL ] DCI: Loaded 37560 existing records from primary storage. [2025-10-17T22:37:14.807917] [INFO ] [MAIN ] DCI: Loaded 37560 primary data records. [2025-10-17T22:37:15.357881] [DEBUG] [MAIN ] DBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:15.359515] [INFO ] [MAIN ] DBI: Generated 1820 derivative records from 44390 primary records. [2025-10-17T22:37:15.360169] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-17T22:37:15.378432] [DEBUG] [LOCAL ] DBI: Derivative data saved (1820 records). [2025-10-17T22:37:15.379849] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-17T22:37:15.382682] [INFO ] [MAIN ] Derivative Progress: 487/2083 symbols completed. DBI took 1.2s. Estimated remaining: 10m 9s. Rate: 157.3 symbols/min [2025-10-17T22:37:15.383012] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:15.401975] [DEBUG] [MAIN ] DBRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:15.402910] [INFO ] [MAIN ] DBRG: Generated 1820 derivative records from 50682 primary records. [2025-10-17T22:37:15.406817] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-17T22:37:15.431880] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1820 records). [2025-10-17T22:37:15.432106] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-10-17T22:37:15.431013] [DEBUG] [LOCAL ] DCO: Loaded 14832 existing records from primary storage. [2025-10-17T22:37:15.434290] [INFO ] [MAIN ] Derivative Progress: 488/2083 symbols completed. DBRG took 1.1s. Estimated remaining: 10m 7s. Rate: 157.6 symbols/min [2025-10-17T22:37:15.434575] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:15.434827] [INFO ] [MAIN ] DCO: Loaded 14832 primary data records. [2025-10-17T22:37:15.512035] [DEBUG] [MAIN ] DCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:15.540233] [INFO ] [MAIN ] DCI: Generated 1820 derivative records from 37560 primary records. [2025-10-17T22:37:15.540336] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-10-17T22:37:15.626535] [DEBUG] [LOCAL ] DCI: Derivative data saved (1820 records). [2025-10-17T22:37:15.646996] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-10-17T22:37:15.649637] [INFO ] [MAIN ] Derivative Progress: 489/2083 symbols completed. DCI took 1.3s. Estimated remaining: 10m 6s. Rate: 157.7 symbols/min [2025-10-17T22:37:15.649838] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:15.805586] [DEBUG] [LOCAL ] DD: Loaded 53704 existing records from primary storage. [2025-10-17T22:37:15.806008] [INFO ] [MAIN ] DD: Loaded 53704 primary data records. [2025-10-17T22:37:15.991368] [DEBUG] [MAIN ] DCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:16.024678] [INFO ] [MAIN ] DCO: Generated 1820 derivative records from 14832 primary records. [2025-10-17T22:37:16.024851] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-10-17T22:37:16.156823] [DEBUG] [LOCAL ] DDD: Loaded 51691 existing records from primary storage. [2025-10-17T22:37:16.157342] [INFO ] [MAIN ] DDD: Loaded 51691 primary data records. [2025-10-17T22:37:16.230848] [DEBUG] [LOCAL ] DCO: Derivative data saved (1820 records). [2025-10-17T22:37:16.239947] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-10-17T22:37:16.243247] [INFO ] [MAIN ] Derivative Progress: 490/2083 symbols completed. DCO took 0.9s. Estimated remaining: 10m 7s. Rate: 157.5 symbols/min [2025-10-17T22:37:16.255698] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:16.519779] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:37:16.520996] [INFO ] [MAIN ] DD: Generated 1819 derivative records from 53704 primary records. [2025-10-17T22:37:16.522196] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-10-17T22:37:16.538085] [DEBUG] [LOCAL ] DDL: Loaded 37618 existing records from primary storage. [2025-10-17T22:37:16.546284] [INFO ] [MAIN ] DDL: Loaded 37618 primary data records. [2025-10-17T22:37:16.586815] [DEBUG] [LOCAL ] DD: Derivative data saved (1819 records). [2025-10-17T22:37:16.610780] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-10-17T22:37:16.622881] [INFO ] [MAIN ] Derivative Progress: 491/2083 symbols completed. DD took 1.2s. Estimated remaining: 10m 6s. Rate: 157.5 symbols/min [2025-10-17T22:37:16.640086] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:16.726801] [DEBUG] [MAIN ] DDD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:16.767459] [INFO ] [MAIN ] DDD: Generated 1820 derivative records from 51691 primary records. [2025-10-17T22:37:16.767746] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-17T22:37:16.832261] [DEBUG] [LOCAL ] DDS: Loaded 12846 existing records from primary storage. [2025-10-17T22:37:16.891088] [INFO ] [MAIN ] DDS: Loaded 12846 primary data records. [2025-10-17T22:37:16.975586] [DEBUG] [LOCAL ] DDD: Derivative data saved (1820 records). [2025-10-17T22:37:16.982815] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-10-17T22:37:17.001117] [INFO ] [MAIN ] Derivative Progress: 492/2083 symbols completed. DDD took 1.4s. Estimated remaining: 10m 6s. Rate: 157.5 symbols/min [2025-10-17T22:37:17.019017] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:17.261153] [DEBUG] [LOCAL ] DDT: Loaded 2106 existing records from primary storage. [2025-10-17T22:37:17.270455] [INFO ] [MAIN ] DDT: Loaded 2106 primary data records. [2025-10-17T22:37:17.445457] [DEBUG] [MAIN ] DDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:17.449590] [INFO ] [MAIN ] DDL: Generated 1820 derivative records from 37618 primary records. [2025-10-17T22:37:17.586496] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-17T22:37:17.619897] [DEBUG] [LOCAL ] DDL: Derivative data saved (1820 records). [2025-10-17T22:37:17.623130] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-10-17T22:37:17.625693] [INFO ] [MAIN ] Derivative Progress: 493/2083 symbols completed. DDL took 1.4s. Estimated remaining: 10m 6s. Rate: 157.3 symbols/min [2025-10-17T22:37:17.639864] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:17.640675] [INFO ] [MAIN ] DDS: Generated 1820 derivative records from 12846 primary records. [2025-10-17T22:37:17.640767] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-10-17T22:37:17.657361] [DEBUG] [LOCAL ] DDS: Derivative data saved (1820 records). [2025-10-17T22:37:17.657571] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-10-17T22:37:17.660423] [INFO ] [MAIN ] Derivative Progress: 494/2083 symbols completed. DDS took 1.0s. Estimated remaining: 10m 5s. Rate: 157.6 symbols/min [2025-10-17T22:37:17.674725] [DEBUG] [MAIN ] DDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:17.675246] [INFO ] [MAIN ] DDT: Generated 1820 derivative records from 2106 primary records. [2025-10-17T22:37:17.675304] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-10-17T22:37:17.688606] [DEBUG] [LOCAL ] DDT: Derivative data saved (1820 records). [2025-10-17T22:37:17.688690] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-10-17T22:37:17.690762] [INFO ] [MAIN ] Derivative Progress: 495/2083 symbols completed. DDT took 0.7s. Estimated remaining: 10m 3s. Rate: 157.9 symbols/min [2025-10-17T22:37:17.691115] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:17.691242] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:17.691321] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:17.732103] [DEBUG] [LOCAL ] DEC: Loaded 30778 existing records from primary storage. [2025-10-17T22:37:17.732262] [INFO ] [MAIN ] DEC: Loaded 30778 primary data records. [2025-10-17T22:37:17.863438] [DEBUG] [LOCAL ] DEA: Loaded 41023 existing records from primary storage. [2025-10-17T22:37:17.888160] [INFO ] [MAIN ] DEA: Loaded 41023 primary data records. [2025-10-17T22:37:17.950924] [DEBUG] [LOCAL ] DECK: Loaded 54077 existing records from primary storage. [2025-10-17T22:37:18.086490] [INFO ] [MAIN ] DECK: Loaded 54077 primary data records. [2025-10-17T22:37:18.705361] [DEBUG] [MAIN ] DEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:18.706536] [INFO ] [MAIN ] DEC: Generated 1820 derivative records from 30778 primary records. [2025-10-17T22:37:18.707018] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-10-17T22:37:18.725979] [DEBUG] [LOCAL ] DEC: Derivative data saved (1820 records). [2025-10-17T22:37:18.726482] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-10-17T22:37:18.729701] [INFO ] [MAIN ] Derivative Progress: 496/2083 symbols completed. DEC took 1.0s. Estimated remaining: 10m 5s. Rate: 157.4 symbols/min [2025-10-17T22:37:18.730075] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:18.762572] [DEBUG] [MAIN ] DECK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:18.763433] [INFO ] [MAIN ] DECK: Generated 1820 derivative records from 54077 primary records. [2025-10-17T22:37:18.762333] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:18.763605] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-10-17T22:37:18.764273] [INFO ] [MAIN ] DEA: Generated 1820 derivative records from 41023 primary records. [2025-10-17T22:37:18.765039] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-10-17T22:37:18.781498] [DEBUG] [LOCAL ] DECK: Derivative data saved (1820 records). [2025-10-17T22:37:18.781823] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-10-17T22:37:18.791388] [INFO ] [MAIN ] Derivative Progress: 497/2083 symbols completed. DECK took 1.1s. Estimated remaining: 10m 4s. Rate: 157.6 symbols/min [2025-10-17T22:37:18.799399] [DEBUG] [LOCAL ] DEA: Derivative data saved (1820 records). [2025-10-17T22:37:18.799497] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-10-17T22:37:18.799602] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:18.802694] [INFO ] [MAIN ] Derivative Progress: 498/2083 symbols completed. DEA took 1.1s. Estimated remaining: 10m 2s. Rate: 157.9 symbols/min [2025-10-17T22:37:18.803413] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:18.855047] [DEBUG] [LOCAL ] DEI: Loaded 49027 existing records from primary storage. [2025-10-17T22:37:18.855688] [INFO ] [MAIN ] DEI: Loaded 49027 primary data records. [2025-10-17T22:37:19.101777] [DEBUG] [LOCAL ] DELL: Loaded 54516 existing records from primary storage. [2025-10-17T22:37:19.081562] [DEBUG] [LOCAL ] DEO: Loaded 49969 existing records from primary storage. [2025-10-17T22:37:19.108557] [INFO ] [MAIN ] DEO: Loaded 49969 primary data records. [2025-10-17T22:37:19.219377] [INFO ] [MAIN ] DELL: Loaded 54516 primary data records. [2025-10-17T22:37:19.943910] [DEBUG] [MAIN ] DEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:19.944854] [INFO ] [MAIN ] DEI: Generated 1820 derivative records from 49027 primary records. [2025-10-17T22:37:19.944955] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-10-17T22:37:19.965384] [DEBUG] [LOCAL ] DEI: Derivative data saved (1820 records). [2025-10-17T22:37:19.965968] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-10-17T22:37:19.967939] [INFO ] [MAIN ] Derivative Progress: 499/2083 symbols completed. DEI took 1.2s. Estimated remaining: 10m 4s. Rate: 157.3 symbols/min [2025-10-17T22:37:19.968335] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:19.999078] [DEBUG] [MAIN ] DEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:19.998753] [DEBUG] [MAIN ] DELL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:19.999856] [INFO ] [MAIN ] DELL: Generated 1820 derivative records from 54516 primary records. [2025-10-17T22:37:20.000429] [INFO ] [MAIN ] DEO: Generated 1820 derivative records from 49969 primary records. [2025-10-17T22:37:20.000719] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-10-17T22:37:20.000776] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-10-17T22:37:20.040786] [DEBUG] [LOCAL ] DELL: Derivative data saved (1820 records). [2025-10-17T22:37:20.041553] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-10-17T22:37:20.043868] [INFO ] [MAIN ] Derivative Progress: 500/2083 symbols completed. DELL took 1.2s. Estimated remaining: 10m 3s. Rate: 157.5 symbols/min [2025-10-17T22:37:20.044455] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:20.046562] [DEBUG] [LOCAL ] DEO: Derivative data saved (1820 records). [2025-10-17T22:37:20.046894] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-10-17T22:37:20.050356] [INFO ] [MAIN ] Derivative Progress: 501/2083 symbols completed. DEO took 1.2s. Estimated remaining: 10m 1s. Rate: 157.9 symbols/min [2025-10-17T22:37:20.051194] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:20.062105] [DEBUG] [LOCAL ] DFH: Loaded 32567 existing records from primary storage. [2025-10-17T22:37:20.062344] [INFO ] [MAIN ] DFH: Loaded 32567 primary data records. [2025-10-17T22:37:20.211470] [DEBUG] [LOCAL ] DFIN: Loaded 22974 existing records from primary storage. [2025-10-17T22:37:20.239868] [INFO ] [MAIN ] DFIN: Loaded 22974 primary data records. [2025-10-17T22:37:20.586271] [DEBUG] [LOCAL ] DG: Loaded 54049 existing records from primary storage. [2025-10-17T22:37:20.612090] [INFO ] [MAIN ] DG: Loaded 54049 primary data records. [2025-10-17T22:37:20.968377] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:21.038225] [INFO ] [MAIN ] DFH: Generated 1820 derivative records from 32567 primary records. [2025-10-17T22:37:21.091469] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-10-17T22:37:21.113578] [DEBUG] [LOCAL ] DFH: Derivative data saved (1820 records). [2025-10-17T22:37:21.114705] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-10-17T22:37:21.117567] [INFO ] [MAIN ] Derivative Progress: 502/2083 symbols completed. DFH took 1.1s. Estimated remaining: 10m 3s. Rate: 157.3 symbols/min [2025-10-17T22:37:21.117910] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:21.132244] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:21.133015] [INFO ] [MAIN ] DFIN: Generated 1820 derivative records from 22974 primary records. [2025-10-17T22:37:21.133239] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-10-17T22:37:21.152992] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1820 records). [2025-10-17T22:37:21.153240] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-10-17T22:37:21.156136] [INFO ] [MAIN ] Derivative Progress: 503/2083 symbols completed. DFIN took 1.1s. Estimated remaining: 10m 2s. Rate: 157.6 symbols/min [2025-10-17T22:37:21.156395] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:21.202087] [DEBUG] [MAIN ] DG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:21.203164] [INFO ] [MAIN ] DG: Generated 1820 derivative records from 54049 primary records. [2025-10-17T22:37:21.203408] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-10-17T22:37:21.221511] [DEBUG] [LOCAL ] DG: Derivative data saved (1820 records). [2025-10-17T22:37:21.229987] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-10-17T22:37:21.233125] [INFO ] [MAIN ] Derivative Progress: 504/2083 symbols completed. DG took 1.2s. Estimated remaining: 10m 0s. Rate: 157.8 symbols/min [2025-10-17T22:37:21.233340] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:21.249905] [DEBUG] [LOCAL ] DHF: Loaded 21251 existing records from primary storage. [2025-10-17T22:37:21.250731] [INFO ] [MAIN ] DHF: Loaded 21251 primary data records. [2025-10-17T22:37:21.252147] [DEBUG] [LOCAL ] DGX: Loaded 45306 existing records from primary storage. [2025-10-17T22:37:21.252490] [INFO ] [MAIN ] DGX: Loaded 45306 primary data records. [2025-10-17T22:37:21.991886] [DEBUG] [LOCAL ] DHT: Loaded 48665 existing records from primary storage. [2025-10-17T22:37:21.994144] [INFO ] [MAIN ] DHT: Loaded 48665 primary data records. [2025-10-17T22:37:22.333539] [DEBUG] [MAIN ] DGX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:22.351633] [INFO ] [MAIN ] DGX: Generated 1820 derivative records from 45306 primary records. [2025-10-17T22:37:22.353246] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-10-17T22:37:22.353052] [DEBUG] [MAIN ] DHF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:22.355810] [INFO ] [MAIN ] DHF: Generated 1820 derivative records from 21251 primary records. [2025-10-17T22:37:22.356250] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-10-17T22:37:22.385252] [DEBUG] [LOCAL ] DGX: Derivative data saved (1820 records). [2025-10-17T22:37:22.389883] [DEBUG] [LOCAL ] DHF: Derivative data saved (1820 records). [2025-10-17T22:37:22.388837] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-10-17T22:37:22.392373] [INFO ] [MAIN ] Derivative Progress: 505/2083 symbols completed. DGX took 1.3s. Estimated remaining: 10m 2s. Rate: 157.2 symbols/min [2025-10-17T22:37:22.392719] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:22.393182] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-10-17T22:37:22.395999] [INFO ] [MAIN ] Derivative Progress: 506/2083 symbols completed. DHF took 1.2s. Estimated remaining: 10m 1s. Rate: 157.5 symbols/min [2025-10-17T22:37:22.396271] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:22.419992] [DEBUG] [MAIN ] DHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:22.426146] [INFO ] [MAIN ] DHT: Generated 1820 derivative records from 48665 primary records. [2025-10-17T22:37:22.426534] [DEBUG] [LOCAL ] DIAX: Loaded 13192 existing records from primary storage. [2025-10-17T22:37:22.426622] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-10-17T22:37:22.426777] [INFO ] [MAIN ] DIAX: Loaded 13192 primary data records. [2025-10-17T22:37:22.480669] [DEBUG] [LOCAL ] DHT: Derivative data saved (1820 records). [2025-10-17T22:37:22.487667] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-10-17T22:37:22.518992] [INFO ] [MAIN ] Derivative Progress: 507/2083 symbols completed. DHT took 1.3s. Estimated remaining: 9m 60s. Rate: 157.7 symbols/min [2025-10-17T22:37:22.530911] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:22.672866] [DEBUG] [LOCAL ] DIN: Loaded 37698 existing records from primary storage. [2025-10-17T22:37:22.783545] [INFO ] [MAIN ] DIN: Loaded 37698 primary data records. [2025-10-17T22:37:23.167431] [DEBUG] [LOCAL ] DINO: Loaded 53587 existing records from primary storage. [2025-10-17T22:37:23.167813] [INFO ] [MAIN ] DINO: Loaded 53587 primary data records. [2025-10-17T22:37:23.356521] [DEBUG] [MAIN ] DIAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:23.397193] [INFO ] [MAIN ] DIAX: Generated 1820 derivative records from 13192 primary records. [2025-10-17T22:37:23.442182] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-10-17T22:37:23.703947] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1820 records). [2025-10-17T22:37:23.706215] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-10-17T22:37:23.709197] [INFO ] [MAIN ] Derivative Progress: 508/2083 symbols completed. DIAX took 1.3s. Estimated remaining: 10m 2s. Rate: 157.0 symbols/min [2025-10-17T22:37:23.730606] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:23.732666] [INFO ] [MAIN ] DIN: Generated 1820 derivative records from 37698 primary records. [2025-10-17T22:37:23.732877] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-17T22:37:23.753107] [DEBUG] [LOCAL ] DIN: Derivative data saved (1820 records). [2025-10-17T22:37:23.753361] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-10-17T22:37:23.756329] [INFO ] [MAIN ] Derivative Progress: 509/2083 symbols completed. DIN took 1.4s. Estimated remaining: 10m 0s. Rate: 157.3 symbols/min [2025-10-17T22:37:23.773798] [DEBUG] [MAIN ] DINO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:23.774518] [INFO ] [MAIN ] DINO: Generated 1820 derivative records from 53587 primary records. [2025-10-17T22:37:23.774581] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-10-17T22:37:23.791080] [DEBUG] [LOCAL ] DINO: Derivative data saved (1820 records). [2025-10-17T22:37:23.791219] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-10-17T22:37:23.793512] [INFO ] [MAIN ] Derivative Progress: 510/2083 symbols completed. DINO took 1.3s. Estimated remaining: 9m 59s. Rate: 157.6 symbols/min [2025-10-17T22:37:23.794133] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:23.794066] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:23.794244] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:23.819056] [DEBUG] [LOCAL ] DKL: Loaded 17652 existing records from primary storage. [2025-10-17T22:37:23.819209] [INFO ] [MAIN ] DKL: Loaded 17652 primary data records. [2025-10-17T22:37:24.075764] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-10-17T22:37:24.202578] [INFO ] [MAIN ] DIS: Loaded 54568 primary data records. [2025-10-17T22:37:24.246505] [DEBUG] [LOCAL ] DKS: Loaded 50372 existing records from primary storage. [2025-10-17T22:37:24.266709] [INFO ] [MAIN ] DKS: Loaded 50372 primary data records. [2025-10-17T22:37:24.854621] [DEBUG] [MAIN ] DKL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:24.856055] [INFO ] [MAIN ] DKL: Generated 1820 derivative records from 17652 primary records. [2025-10-17T22:37:24.856968] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-10-17T22:37:24.874607] [DEBUG] [LOCAL ] DKL: Derivative data saved (1820 records). [2025-10-17T22:37:24.875020] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-10-17T22:37:24.877457] [INFO ] [MAIN ] Derivative Progress: 511/2083 symbols completed. DKL took 1.1s. Estimated remaining: 10m 1s. Rate: 157.0 symbols/min [2025-10-17T22:37:24.878018] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:24.898928] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:24.911941] [INFO ] [MAIN ] DIS: Generated 1820 derivative records from 54568 primary records. [2025-10-17T22:37:24.912310] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:24.912955] [INFO ] [MAIN ] DKS: Generated 1820 derivative records from 50372 primary records. [2025-10-17T22:37:24.913149] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-10-17T22:37:24.913200] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-10-17T22:37:24.964768] [DEBUG] [LOCAL ] DIS: Derivative data saved (1820 records). [2025-10-17T22:37:24.974279] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-10-17T22:37:24.977464] [INFO ] [MAIN ] Derivative Progress: 512/2083 symbols completed. DIS took 1.2s. Estimated remaining: 9m 59s. Rate: 157.3 symbols/min [2025-10-17T22:37:24.977969] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:24.978666] [DEBUG] [LOCAL ] DKS: Derivative data saved (1820 records). [2025-10-17T22:37:24.978767] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-10-17T22:37:24.982281] [INFO ] [MAIN ] Derivative Progress: 513/2083 symbols completed. DKS took 1.2s. Estimated remaining: 9m 58s. Rate: 157.6 symbols/min [2025-10-17T22:37:24.982638] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:24.983605] [DEBUG] [LOCAL ] DLB: Loaded 32746 existing records from primary storage. [2025-10-17T22:37:24.983899] [INFO ] [MAIN ] DLB: Loaded 32746 primary data records. [2025-10-17T22:37:25.082429] [DEBUG] [LOCAL ] DLNG: Loaded 6256 existing records from primary storage. [2025-10-17T22:37:25.091009] [INFO ] [MAIN ] DLNG: Loaded 6256 primary data records. [2025-10-17T22:37:25.674140] [DEBUG] [LOCAL ] DLR: Loaded 51423 existing records from primary storage. [2025-10-17T22:37:25.674902] [INFO ] [MAIN ] DLR: Loaded 51423 primary data records. [2025-10-17T22:37:25.986396] [DEBUG] [MAIN ] DLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:25.987169] [INFO ] [MAIN ] DLB: Generated 1820 derivative records from 32746 primary records. [2025-10-17T22:37:25.987368] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-10-17T22:37:26.004742] [DEBUG] [LOCAL ] DLB: Derivative data saved (1820 records). [2025-10-17T22:37:26.005287] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-10-17T22:37:26.007418] [INFO ] [MAIN ] Derivative Progress: 514/2083 symbols completed. DLB took 1.1s. Estimated remaining: 9m 59s. Rate: 157.0 symbols/min [2025-10-17T22:37:26.007871] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:26.025079] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:26.026583] [INFO ] [MAIN ] DLNG: Generated 1820 derivative records from 6256 primary records. [2025-10-17T22:37:26.026806] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-10-17T22:37:26.042196] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1820 records). [2025-10-17T22:37:26.042331] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-10-17T22:37:26.045284] [INFO ] [MAIN ] Derivative Progress: 515/2083 symbols completed. DLNG took 1.1s. Estimated remaining: 9m 58s. Rate: 157.3 symbols/min [2025-10-17T22:37:26.046151] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:26.070541] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:26.080801] [INFO ] [MAIN ] DLR: Generated 1820 derivative records from 51423 primary records. [2025-10-17T22:37:26.081065] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-17T22:37:26.082212] [DEBUG] [LOCAL ] DLX: Loaded 28685 existing records from primary storage. [2025-10-17T22:37:26.082406] [INFO ] [MAIN ] DLX: Loaded 28685 primary data records. [2025-10-17T22:37:26.157066] [DEBUG] [LOCAL ] DLR: Derivative data saved (1820 records). [2025-10-17T22:37:26.172700] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-17T22:37:26.192214] [INFO ] [MAIN ] Derivative Progress: 516/2083 symbols completed. DLR took 1.2s. Estimated remaining: 9m 57s. Rate: 157.5 symbols/min [2025-10-17T22:37:26.215254] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:26.215022] [DEBUG] [LOCAL ] DLY: Loaded 20947 existing records from primary storage. [2025-10-17T22:37:26.221342] [INFO ] [MAIN ] DLY: Loaded 20947 primary data records. [2025-10-17T22:37:26.769403] [DEBUG] [LOCAL ] DNA: Loaded 49343 existing records from primary storage. [2025-10-17T22:37:26.770301] [INFO ] [MAIN ] DNA: Loaded 49343 primary data records. [2025-10-17T22:37:26.947059] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:27.088007] [INFO ] [MAIN ] DLX: Generated 1820 derivative records from 28685 primary records. [2025-10-17T22:37:27.088787] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-17T22:37:27.120105] [DEBUG] [LOCAL ] DLX: Derivative data saved (1820 records). [2025-10-17T22:37:27.121030] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:27.121971] [INFO ] [MAIN ] DLY: Generated 1820 derivative records from 20947 primary records. [2025-10-17T22:37:27.122546] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-10-17T22:37:27.122240] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-10-17T22:37:27.125840] [INFO ] [MAIN ] Derivative Progress: 517/2083 symbols completed. DLX took 1.1s. Estimated remaining: 9m 58s. Rate: 157.1 symbols/min [2025-10-17T22:37:27.125992] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:27.144930] [DEBUG] [LOCAL ] DLY: Derivative data saved (1820 records). [2025-10-17T22:37:27.145315] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-10-17T22:37:27.148057] [INFO ] [MAIN ] Derivative Progress: 518/2083 symbols completed. DLY took 1.1s. Estimated remaining: 9m 57s. Rate: 157.4 symbols/min [2025-10-17T22:37:27.148773] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:27.182508] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:27.183303] [INFO ] [MAIN ] DNA: Generated 1820 derivative records from 49343 primary records. [2025-10-17T22:37:27.183425] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-10-17T22:37:27.212866] [DEBUG] [LOCAL ] DNA: Derivative data saved (1820 records). [2025-10-17T22:37:27.213004] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-10-17T22:37:27.214900] [INFO ] [MAIN ] Derivative Progress: 519/2083 symbols completed. DNA took 1.0s. Estimated remaining: 9m 55s. Rate: 157.6 symbols/min [2025-10-17T22:37:27.215964] [DEBUG] [LOCAL ] DNOW: Loaded 44485 existing records from primary storage. [2025-10-17T22:37:27.216173] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:27.216072] [INFO ] [MAIN ] DNOW: Loaded 44485 primary data records. [2025-10-17T22:37:27.411707] [DEBUG] [LOCAL ] DOC: Loaded 54334 existing records from primary storage. [2025-10-17T22:37:27.535213] [INFO ] [MAIN ] DOC: Loaded 54334 primary data records. [2025-10-17T22:37:27.732103] [DEBUG] [LOCAL ] DOCN: Loaded 51798 existing records from primary storage. [2025-10-17T22:37:27.747722] [INFO ] [MAIN ] DOCN: Loaded 51798 primary data records. [2025-10-17T22:37:28.229002] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:28.229836] [INFO ] [MAIN ] DNOW: Generated 1820 derivative records from 44485 primary records. [2025-10-17T22:37:28.230573] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-17T22:37:28.248469] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1820 records). [2025-10-17T22:37:28.249139] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-10-17T22:37:28.252434] [INFO ] [MAIN ] Derivative Progress: 520/2083 symbols completed. DNOW took 1.1s. Estimated remaining: 9m 57s. Rate: 157.1 symbols/min [2025-10-17T22:37:28.252749] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:28.268762] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:28.270277] [INFO ] [MAIN ] DOC: Generated 1820 derivative records from 54334 primary records. [2025-10-17T22:37:28.270515] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-17T22:37:28.288388] [DEBUG] [LOCAL ] DOC: Derivative data saved (1820 records). [2025-10-17T22:37:28.288594] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-17T22:37:28.290692] [INFO ] [MAIN ] Derivative Progress: 521/2083 symbols completed. DOC took 1.1s. Estimated remaining: 9m 56s. Rate: 157.4 symbols/min [2025-10-17T22:37:28.291968] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:28.309263] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:28.310219] [INFO ] [MAIN ] DOCN: Generated 1820 derivative records from 51798 primary records. [2025-10-17T22:37:28.310315] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-17T22:37:28.328341] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1820 records). [2025-10-17T22:37:28.337164] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-17T22:37:28.340353] [INFO ] [MAIN ] Derivative Progress: 522/2083 symbols completed. DOCN took 1.1s. Estimated remaining: 9m 54s. Rate: 157.6 symbols/min [2025-10-17T22:37:28.340781] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:28.381696] [DEBUG] [LOCAL ] DOUG: Loaded 34582 existing records from primary storage. [2025-10-17T22:37:28.383028] [INFO ] [MAIN ] DOUG: Loaded 34582 primary data records. [2025-10-17T22:37:28.382897] [DEBUG] [LOCAL ] DOLE: Loaded 39732 existing records from primary storage. [2025-10-17T22:37:28.383261] [INFO ] [MAIN ] DOLE: Loaded 39732 primary data records. [2025-10-17T22:37:28.697159] [DEBUG] [LOCAL ] DOV: Loaded 46315 existing records from primary storage. [2025-10-17T22:37:28.735432] [INFO ] [MAIN ] DOV: Loaded 46315 primary data records. [2025-10-17T22:37:29.413740] [DEBUG] [MAIN ] DOLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:29.419968] [INFO ] [MAIN ] DOLE: Generated 1820 derivative records from 39732 primary records. [2025-10-17T22:37:29.420192] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-10-17T22:37:29.420876] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:29.430355] [INFO ] [MAIN ] DOUG: Generated 1820 derivative records from 34582 primary records. [2025-10-17T22:37:29.430490] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-17T22:37:29.471074] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1820 records). [2025-10-17T22:37:29.472103] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-17T22:37:29.474529] [INFO ] [MAIN ] Derivative Progress: 523/2083 symbols completed. DOUG took 1.2s. Estimated remaining: 9m 56s. Rate: 157.0 symbols/min [2025-10-17T22:37:29.471750] [DEBUG] [MAIN ] DOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:29.477208] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1820 records). [2025-10-17T22:37:29.478193] [INFO ] [MAIN ] DOV: Generated 1820 derivative records from 46315 primary records. [2025-10-17T22:37:29.478415] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-10-17T22:37:29.480661] [INFO ] [MAIN ] Derivative Progress: 524/2083 symbols completed. DOLE took 1.2s. Estimated remaining: 9m 55s. Rate: 157.3 symbols/min [2025-10-17T22:37:29.478531] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-17T22:37:29.498159] [DEBUG] [LOCAL ] DOV: Derivative data saved (1820 records). [2025-10-17T22:37:29.498324] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-10-17T22:37:29.502518] [INFO ] [MAIN ] Derivative Progress: 525/2083 symbols completed. DOV took 1.2s. Estimated remaining: 9m 53s. Rate: 157.6 symbols/min [2025-10-17T22:37:29.503144] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:29.503376] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:29.503244] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:29.587150] [DEBUG] [LOCAL ] DQ: Loaded 44434 existing records from primary storage. [2025-10-17T22:37:29.598842] [INFO ] [MAIN ] DQ: Loaded 44434 primary data records. [2025-10-17T22:37:29.598698] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-10-17T22:37:29.622213] [INFO ] [MAIN ] DOW: Loaded 54513 primary data records. [2025-10-17T22:37:29.638615] [DEBUG] [LOCAL ] DRD: Loaded 38427 existing records from primary storage. [2025-10-17T22:37:29.662371] [INFO ] [MAIN ] DRD: Loaded 38427 primary data records. [2025-10-17T22:37:30.547697] [DEBUG] [MAIN ] DOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:30.550188] [INFO ] [MAIN ] DOW: Generated 1820 derivative records from 54513 primary records. [2025-10-17T22:37:30.550998] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-10-17T22:37:30.578586] [DEBUG] [MAIN ] DQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:30.579981] [INFO ] [MAIN ] DQ: Generated 1820 derivative records from 44434 primary records. [2025-10-17T22:37:30.580669] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-10-17T22:37:30.596823] [DEBUG] [LOCAL ] DOW: Derivative data saved (1820 records). [2025-10-17T22:37:30.597440] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-10-17T22:37:30.597113] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:30.599258] [INFO ] [MAIN ] Derivative Progress: 526/2083 symbols completed. DOW took 1.1s. Estimated remaining: 9m 55s. Rate: 157.0 symbols/min [2025-10-17T22:37:30.600099] [INFO ] [MAIN ] DRD: Generated 1820 derivative records from 38427 primary records. [2025-10-17T22:37:30.600431] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-17T22:37:30.607847] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:30.617021] [DEBUG] [LOCAL ] DQ: Derivative data saved (1820 records). [2025-10-17T22:37:30.624258] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-10-17T22:37:30.634122] [DEBUG] [LOCAL ] DRD: Derivative data saved (1820 records). [2025-10-17T22:37:30.634230] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-10-17T22:37:30.632521] [INFO ] [MAIN ] Derivative Progress: 527/2083 symbols completed. DQ took 1.1s. Estimated remaining: 9m 53s. Rate: 157.3 symbols/min [2025-10-17T22:37:30.636546] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:30.636623] [INFO ] [MAIN ] Derivative Progress: 528/2083 symbols completed. DRD took 1.1s. Estimated remaining: 9m 52s. Rate: 157.6 symbols/min [2025-10-17T22:37:30.637285] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:30.649323] [DEBUG] [LOCAL ] DRLL: Loaded 9219 existing records from primary storage. [2025-10-17T22:37:30.649677] [INFO ] [MAIN ] DRLL: Loaded 9219 primary data records. [2025-10-17T22:37:30.984082] [DEBUG] [LOCAL ] DRH: Loaded 51122 existing records from primary storage. [2025-10-17T22:37:30.985371] [INFO ] [MAIN ] DRH: Loaded 51122 primary data records. [2025-10-17T22:37:31.074588] [DEBUG] [LOCAL ] DRI: Loaded 48386 existing records from primary storage. [2025-10-17T22:37:31.099227] [INFO ] [MAIN ] DRI: Loaded 48386 primary data records. [2025-10-17T22:37:31.500481] [DEBUG] [MAIN ] DRLL: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:37:31.666327] [INFO ] [MAIN ] DRLL: Generated 1819 derivative records from 9219 primary records. [2025-10-17T22:37:31.667273] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-10-17T22:37:31.688271] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1819 records). [2025-10-17T22:37:31.688974] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-10-17T22:37:31.691190] [INFO ] [MAIN ] Derivative Progress: 529/2083 symbols completed. DRLL took 1.1s. Estimated remaining: 9m 54s. Rate: 157.1 symbols/min [2025-10-17T22:37:31.692467] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:31.713570] [DEBUG] [MAIN ] DRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:31.714306] [INFO ] [MAIN ] DRH: Generated 1820 derivative records from 51122 primary records. [2025-10-17T22:37:31.714688] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-10-17T22:37:31.742029] [DEBUG] [LOCAL ] DRH: Derivative data saved (1820 records). [2025-10-17T22:37:31.742863] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-10-17T22:37:31.764988] [INFO ] [MAIN ] Derivative Progress: 530/2083 symbols completed. DRH took 1.2s. Estimated remaining: 9m 52s. Rate: 157.3 symbols/min [2025-10-17T22:37:31.767859] [DEBUG] [LOCAL ] DSL: Loaded 29410 existing records from primary storage. [2025-10-17T22:37:31.767079] [DEBUG] [MAIN ] DRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:31.768085] [INFO ] [MAIN ] DSL: Loaded 29410 primary data records. [2025-10-17T22:37:31.767195] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:31.769002] [INFO ] [MAIN ] DRI: Generated 1820 derivative records from 48386 primary records. [2025-10-17T22:37:31.817145] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-10-17T22:37:31.849505] [DEBUG] [LOCAL ] DSMC: Loaded 1866 existing records from primary storage. [2025-10-17T22:37:31.869881] [INFO ] [MAIN ] DSMC: Loaded 1866 primary data records. [2025-10-17T22:37:31.916004] [DEBUG] [LOCAL ] DRI: Derivative data saved (1820 records). [2025-10-17T22:37:31.926354] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-10-17T22:37:31.933798] [INFO ] [MAIN ] Derivative Progress: 531/2083 symbols completed. DRI took 1.3s. Estimated remaining: 9m 51s. Rate: 157.5 symbols/min [2025-10-17T22:37:31.940781] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:32.416974] [DEBUG] [LOCAL ] DSU: Loaded 23392 existing records from primary storage. [2025-10-17T22:37:32.418335] [INFO ] [MAIN ] DSU: Loaded 23392 primary data records. [2025-10-17T22:37:32.742292] [DEBUG] [MAIN ] DSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:32.744069] [INFO ] [MAIN ] DSL: Generated 1820 derivative records from 29410 primary records. [2025-10-17T22:37:32.744420] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-10-17T22:37:32.769036] [DEBUG] [MAIN ] DSMC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:37:32.776785] [INFO ] [MAIN ] DSMC: Generated 1819 derivative records from 1866 primary records. [2025-10-17T22:37:32.777003] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-10-17T22:37:32.776035] [DEBUG] [LOCAL ] DSL: Derivative data saved (1820 records). [2025-10-17T22:37:32.777737] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-10-17T22:37:32.779967] [INFO ] [MAIN ] Derivative Progress: 532/2083 symbols completed. DSL took 1.1s. Estimated remaining: 9m 52s. Rate: 157.1 symbols/min [2025-10-17T22:37:32.780253] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:32.794257] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1819 records). [2025-10-17T22:37:32.794466] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-10-17T22:37:32.796549] [INFO ] [MAIN ] Derivative Progress: 533/2083 symbols completed. DSMC took 1.0s. Estimated remaining: 9m 51s. Rate: 157.4 symbols/min [2025-10-17T22:37:32.796812] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:32.824020] [DEBUG] [LOCAL ] DTB: Loaded 5028 existing records from primary storage. [2025-10-17T22:37:32.823816] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:32.824924] [INFO ] [MAIN ] DSU: Generated 1820 derivative records from 23392 primary records. [2025-10-17T22:37:32.824241] [INFO ] [MAIN ] DTB: Loaded 5028 primary data records. [2025-10-17T22:37:32.825023] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-17T22:37:32.922324] [DEBUG] [LOCAL ] DSX: Loaded 24294 existing records from primary storage. [2025-10-17T22:37:32.954897] [DEBUG] [LOCAL ] DSU: Derivative data saved (1820 records). [2025-10-17T22:37:32.955078] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-10-17T22:37:32.947017] [INFO ] [MAIN ] DSX: Loaded 24294 primary data records. [2025-10-17T22:37:32.961113] [INFO ] [MAIN ] Derivative Progress: 534/2083 symbols completed. DSU took 1.0s. Estimated remaining: 9m 50s. Rate: 157.6 symbols/min [2025-10-17T22:37:32.961357] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:33.546690] [DEBUG] [LOCAL ] DTE: Loaded 48020 existing records from primary storage. [2025-10-17T22:37:33.548159] [INFO ] [MAIN ] DTE: Loaded 48020 primary data records. [2025-10-17T22:37:33.865556] [DEBUG] [MAIN ] DTB: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:37:33.866556] [INFO ] [MAIN ] DTB: Generated 1819 derivative records from 5028 primary records. [2025-10-17T22:37:33.866732] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-10-17T22:37:33.884520] [DEBUG] [LOCAL ] DTB: Derivative data saved (1819 records). [2025-10-17T22:37:33.884960] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-10-17T22:37:33.890087] [INFO ] [MAIN ] Derivative Progress: 535/2083 symbols completed. DTB took 1.1s. Estimated remaining: 9m 51s. Rate: 157.2 symbols/min [2025-10-17T22:37:33.890935] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:33.907091] [DEBUG] [MAIN ] DSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:33.908182] [INFO ] [MAIN ] DSX: Generated 1820 derivative records from 24294 primary records. [2025-10-17T22:37:33.909966] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-10-17T22:37:33.926973] [DEBUG] [LOCAL ] DTG: Loaded 5859 existing records from primary storage. [2025-10-17T22:37:33.930631] [INFO ] [MAIN ] DTG: Loaded 5859 primary data records. [2025-10-17T22:37:33.931371] [DEBUG] [LOCAL ] DSX: Derivative data saved (1820 records). [2025-10-17T22:37:33.952278] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-10-17T22:37:34.002696] [INFO ] [MAIN ] Derivative Progress: 536/2083 symbols completed. DSX took 1.2s. Estimated remaining: 9m 50s. Rate: 157.4 symbols/min [2025-10-17T22:37:34.038166] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:34.125062] [DEBUG] [MAIN ] DTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:34.242680] [INFO ] [MAIN ] DTE: Generated 1820 derivative records from 48020 primary records. [2025-10-17T22:37:34.252197] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-10-17T22:37:34.270841] [DEBUG] [LOCAL ] DTE: Derivative data saved (1820 records). [2025-10-17T22:37:34.271418] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-10-17T22:37:34.274129] [INFO ] [MAIN ] Derivative Progress: 537/2083 symbols completed. DTE took 1.3s. Estimated remaining: 9m 49s. Rate: 157.4 symbols/min [2025-10-17T22:37:34.274932] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:34.296881] [DEBUG] [LOCAL ] DTW: Loaded 4872 existing records from primary storage. [2025-10-17T22:37:34.297416] [INFO ] [MAIN ] DTW: Loaded 4872 primary data records. [2025-10-17T22:37:34.430107] [DEBUG] [MAIN ] DTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:34.443473] [INFO ] [MAIN ] DTG: Generated 1820 derivative records from 5859 primary records. [2025-10-17T22:37:34.443670] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-10-17T22:37:34.445594] [DEBUG] [LOCAL ] DTM: Loaded 44538 existing records from primary storage. [2025-10-17T22:37:34.461868] [INFO ] [MAIN ] DTM: Loaded 44538 primary data records. [2025-10-17T22:37:34.756398] [DEBUG] [LOCAL ] DTG: Derivative data saved (1820 records). [2025-10-17T22:37:34.768566] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-10-17T22:37:34.776607] [INFO ] [MAIN ] Derivative Progress: 538/2083 symbols completed. DTG took 0.9s. Estimated remaining: 9m 49s. Rate: 157.3 symbols/min [2025-10-17T22:37:34.992053] [DEBUG] [MAIN ] DTW: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:37:34.993125] [INFO ] [MAIN ] DTW: Generated 1819 derivative records from 4872 primary records. [2025-10-17T22:37:34.993379] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-10-17T22:37:35.009826] [DEBUG] [LOCAL ] DTW: Derivative data saved (1819 records). [2025-10-17T22:37:35.009947] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-10-17T22:37:35.012035] [INFO ] [MAIN ] Derivative Progress: 539/2083 symbols completed. DTW took 0.7s. Estimated remaining: 9m 48s. Rate: 157.5 symbols/min [2025-10-17T22:37:35.028231] [DEBUG] [MAIN ] DTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:35.028942] [INFO ] [MAIN ] DTM: Generated 1820 derivative records from 44538 primary records. [2025-10-17T22:37:35.029002] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-10-17T22:37:35.044764] [DEBUG] [LOCAL ] DTM: Derivative data saved (1820 records). [2025-10-17T22:37:35.044875] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-10-17T22:37:35.047165] [INFO ] [MAIN ] Derivative Progress: 540/2083 symbols completed. DTM took 1.0s. Estimated remaining: 9m 47s. Rate: 157.7 symbols/min [2025-10-17T22:37:35.047878] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:35.048278] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:35.048390] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:35.058780] [DEBUG] [LOCAL ] DUKB: Loaded 6333 existing records from primary storage. [2025-10-17T22:37:35.059016] [INFO ] [MAIN ] DUKB: Loaded 6333 primary data records. [2025-10-17T22:37:35.405330] [DEBUG] [LOCAL ] DV: Loaded 52038 existing records from primary storage. [2025-10-17T22:37:35.405623] [INFO ] [MAIN ] DV: Loaded 52038 primary data records. [2025-10-17T22:37:35.502063] [DEBUG] [LOCAL ] DUK: Loaded 54217 existing records from primary storage. [2025-10-17T22:37:35.518953] [INFO ] [MAIN ] DUK: Loaded 54217 primary data records. [2025-10-17T22:37:36.096162] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:36.098180] [INFO ] [MAIN ] DUKB: Generated 1820 derivative records from 6333 primary records. [2025-10-17T22:37:36.098600] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-10-17T22:37:36.117962] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1820 records). [2025-10-17T22:37:36.118888] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-10-17T22:37:36.121821] [INFO ] [MAIN ] Derivative Progress: 541/2083 symbols completed. DUKB took 1.1s. Estimated remaining: 9m 49s. Rate: 157.2 symbols/min [2025-10-17T22:37:36.122436] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:36.159731] [DEBUG] [MAIN ] DUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:36.160346] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:36.161252] [INFO ] [MAIN ] DUK: Generated 1820 derivative records from 54217 primary records. [2025-10-17T22:37:36.162109] [INFO ] [MAIN ] DV: Generated 1820 derivative records from 52038 primary records. [2025-10-17T22:37:36.162228] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-10-17T22:37:36.162321] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-17T22:37:36.204998] [DEBUG] [LOCAL ] DUK: Derivative data saved (1820 records). [2025-10-17T22:37:36.202149] [DEBUG] [LOCAL ] DV: Derivative data saved (1820 records). [2025-10-17T22:37:36.205152] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-10-17T22:37:36.205352] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-17T22:37:36.207510] [INFO ] [MAIN ] Derivative Progress: 542/2083 symbols completed. DUK took 1.2s. Estimated remaining: 9m 47s. Rate: 157.4 symbols/min [2025-10-17T22:37:36.210568] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:36.224057] [INFO ] [MAIN ] Derivative Progress: 543/2083 symbols completed. DV took 1.2s. Estimated remaining: 9m 46s. Rate: 157.7 symbols/min [2025-10-17T22:37:36.224345] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:36.225838] [DEBUG] [LOCAL ] DVA: Loaded 41554 existing records from primary storage. [2025-10-17T22:37:36.226458] [INFO ] [MAIN ] DVA: Loaded 41554 primary data records. [2025-10-17T22:37:36.585899] [DEBUG] [LOCAL ] DXC: Loaded 50621 existing records from primary storage. [2025-10-17T22:37:36.586934] [INFO ] [MAIN ] DXC: Loaded 50621 primary data records. [2025-10-17T22:37:36.709759] [DEBUG] [LOCAL ] DX: Loaded 53271 existing records from primary storage. [2025-10-17T22:37:36.727145] [INFO ] [MAIN ] DX: Loaded 53271 primary data records. [2025-10-17T22:37:37.219759] [DEBUG] [MAIN ] DVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:37.221476] [INFO ] [MAIN ] DVA: Generated 1820 derivative records from 41554 primary records. [2025-10-17T22:37:37.221980] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-17T22:37:37.242451] [DEBUG] [LOCAL ] DVA: Derivative data saved (1820 records). [2025-10-17T22:37:37.243022] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-10-17T22:37:37.245262] [INFO ] [MAIN ] Derivative Progress: 544/2083 symbols completed. DVA took 1.1s. Estimated remaining: 9m 47s. Rate: 157.2 symbols/min [2025-10-17T22:37:37.245461] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:37.266520] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:37.267437] [INFO ] [MAIN ] DXC: Generated 1820 derivative records from 50621 primary records. [2025-10-17T22:37:37.267625] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-10-17T22:37:37.285270] [DEBUG] [LOCAL ] DXC: Derivative data saved (1820 records). [2025-10-17T22:37:37.285481] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-10-17T22:37:37.288316] [INFO ] [MAIN ] Derivative Progress: 545/2083 symbols completed. DXC took 1.1s. Estimated remaining: 9m 46s. Rate: 157.5 symbols/min [2025-10-17T22:37:37.288538] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:37.304325] [DEBUG] [MAIN ] DX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:37.313969] [INFO ] [MAIN ] DX: Generated 1820 derivative records from 53271 primary records. [2025-10-17T22:37:37.314149] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-10-17T22:37:37.330468] [DEBUG] [LOCAL ] DX: Derivative data saved (1820 records). [2025-10-17T22:37:37.331343] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-10-17T22:37:37.342836] [INFO ] [MAIN ] Derivative Progress: 546/2083 symbols completed. DX took 1.1s. Estimated remaining: 9m 45s. Rate: 157.7 symbols/min [2025-10-17T22:37:37.344202] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:37.351533] [DEBUG] [LOCAL ] DXYZ: Loaded 37760 existing records from primary storage. [2025-10-17T22:37:37.351722] [INFO ] [MAIN ] DXYZ: Loaded 37760 primary data records. [2025-10-17T22:37:37.466230] [DEBUG] [LOCAL ] DY: Loaded 28800 existing records from primary storage. [2025-10-17T22:37:37.487509] [INFO ] [MAIN ] DY: Loaded 28800 primary data records. [2025-10-17T22:37:37.837736] [DEBUG] [LOCAL ] E: Loaded 33728 existing records from primary storage. [2025-10-17T22:37:37.859891] [INFO ] [MAIN ] E: Loaded 33728 primary data records. [2025-10-17T22:37:38.356446] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:37:38.357615] [INFO ] [MAIN ] DXYZ: Generated 1819 derivative records from 37760 primary records. [2025-10-17T22:37:38.358164] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-17T22:37:38.392758] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1819 records). [2025-10-17T22:37:38.393002] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-17T22:37:38.395243] [INFO ] [MAIN ] Derivative Progress: 547/2083 symbols completed. DXYZ took 1.1s. Estimated remaining: 9m 46s. Rate: 157.2 symbols/min [2025-10-17T22:37:38.395856] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:38.395746] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:38.396892] [INFO ] [MAIN ] DY: Generated 1820 derivative records from 28800 primary records. [2025-10-17T22:37:38.397377] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-17T22:37:38.415920] [DEBUG] [LOCAL ] EAI: Loaded 4014 existing records from primary storage. [2025-10-17T22:37:38.416079] [INFO ] [MAIN ] EAI: Loaded 4014 primary data records. [2025-10-17T22:37:38.448152] [DEBUG] [LOCAL ] DY: Derivative data saved (1820 records). [2025-10-17T22:37:38.455694] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-10-17T22:37:38.468469] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:38.471282] [INFO ] [MAIN ] Derivative Progress: 548/2083 symbols completed. DY took 1.2s. Estimated remaining: 9m 45s. Rate: 157.4 symbols/min [2025-10-17T22:37:38.469169] [INFO ] [MAIN ] E: Generated 1820 derivative records from 33728 primary records. [2025-10-17T22:37:38.490153] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:38.499426] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-10-17T22:37:38.769462] [DEBUG] [LOCAL ] EARN: Loaded 28956 existing records from primary storage. [2025-10-17T22:37:38.769606] [DEBUG] [LOCAL ] E: Derivative data saved (1820 records). [2025-10-17T22:37:38.769961] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-10-17T22:37:38.770077] [INFO ] [MAIN ] EARN: Loaded 28956 primary data records. [2025-10-17T22:37:38.773111] [INFO ] [MAIN ] Derivative Progress: 549/2083 symbols completed. E took 1.4s. Estimated remaining: 9m 44s. Rate: 157.5 symbols/min [2025-10-17T22:37:38.787928] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:39.120800] [DEBUG] [MAIN ] EAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:39.121630] [INFO ] [MAIN ] EAI: Generated 1820 derivative records from 4014 primary records. [2025-10-17T22:37:39.121774] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-10-17T22:37:39.152770] [DEBUG] [LOCAL ] EAT: Loaded 50582 existing records from primary storage. [2025-10-17T22:37:39.154317] [INFO ] [MAIN ] EAT: Loaded 50582 primary data records. [2025-10-17T22:37:39.155620] [DEBUG] [LOCAL ] EAI: Derivative data saved (1820 records). [2025-10-17T22:37:39.167299] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-10-17T22:37:39.188764] [INFO ] [MAIN ] Derivative Progress: 550/2083 symbols completed. EAI took 0.8s. Estimated remaining: 9m 44s. Rate: 157.5 symbols/min [2025-10-17T22:37:39.194553] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:39.552361] [DEBUG] [LOCAL ] EB: Loaded 36946 existing records from primary storage. [2025-10-17T22:37:39.557505] [INFO ] [MAIN ] EB: Loaded 36946 primary data records. [2025-10-17T22:37:39.558798] [DEBUG] [MAIN ] EARN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:39.566609] [INFO ] [MAIN ] EARN: Generated 1820 derivative records from 28956 primary records. [2025-10-17T22:37:39.582778] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-10-17T22:37:39.697792] [DEBUG] [LOCAL ] EARN: Derivative data saved (1820 records). [2025-10-17T22:37:39.708410] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-10-17T22:37:39.710872] [INFO ] [MAIN ] Derivative Progress: 551/2083 symbols completed. EARN took 1.2s. Estimated remaining: 9m 44s. Rate: 157.4 symbols/min [2025-10-17T22:37:39.763919] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:39.908152] [DEBUG] [MAIN ] EAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:39.909274] [INFO ] [MAIN ] EAT: Generated 1820 derivative records from 50582 primary records. [2025-10-17T22:37:39.910366] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-10-17T22:37:39.935520] [DEBUG] [LOCAL ] EBF: Loaded 19324 existing records from primary storage. [2025-10-17T22:37:39.935056] [DEBUG] [LOCAL ] EAT: Derivative data saved (1820 records). [2025-10-17T22:37:39.935986] [INFO ] [MAIN ] EBF: Loaded 19324 primary data records. [2025-10-17T22:37:39.935800] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-10-17T22:37:39.974891] [INFO ] [MAIN ] Derivative Progress: 552/2083 symbols completed. EAT took 1.2s. Estimated remaining: 9m 43s. Rate: 157.5 symbols/min [2025-10-17T22:37:40.002912] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:40.134114] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:40.191377] [INFO ] [MAIN ] EB: Generated 1820 derivative records from 36946 primary records. [2025-10-17T22:37:40.248788] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-10-17T22:37:40.291026] [DEBUG] [LOCAL ] EB: Derivative data saved (1820 records). [2025-10-17T22:37:40.292450] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-10-17T22:37:40.294838] [INFO ] [MAIN ] Derivative Progress: 553/2083 symbols completed. EB took 1.1s. Estimated remaining: 9m 43s. Rate: 157.5 symbols/min [2025-10-17T22:37:40.296221] [DEBUG] [LOCAL ] EBR: Loaded 43964 existing records from primary storage. [2025-10-17T22:37:40.297230] [INFO ] [MAIN ] EBR: Loaded 43964 primary data records. [2025-10-17T22:37:40.495415] [DEBUG] [MAIN ] EBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:40.607708] [INFO ] [MAIN ] EBF: Generated 1820 derivative records from 19324 primary records. [2025-10-17T22:37:40.617456] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-10-17T22:37:40.638633] [DEBUG] [LOCAL ] EBF: Derivative data saved (1820 records). [2025-10-17T22:37:40.639672] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-10-17T22:37:40.641943] [INFO ] [MAIN ] Derivative Progress: 554/2083 symbols completed. EBF took 0.9s. Estimated remaining: 9m 42s. Rate: 157.5 symbols/min [2025-10-17T22:37:40.659421] [DEBUG] [MAIN ] EBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:40.660077] [INFO ] [MAIN ] EBR: Generated 1820 derivative records from 43964 primary records. [2025-10-17T22:37:40.660179] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-17T22:37:40.675312] [DEBUG] [LOCAL ] EBR: Derivative data saved (1820 records). [2025-10-17T22:37:40.675370] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-17T22:37:40.677498] [INFO ] [MAIN ] Derivative Progress: 555/2083 symbols completed. EBR took 0.7s. Estimated remaining: 9m 41s. Rate: 157.8 symbols/min [2025-10-17T22:37:40.678166] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:40.678249] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:40.678434] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:40.736156] [DEBUG] [LOCAL ] ECAT: Loaded 29841 existing records from primary storage. [2025-10-17T22:37:40.747014] [INFO ] [MAIN ] ECAT: Loaded 29841 primary data records. [2025-10-17T22:37:40.829305] [DEBUG] [LOCAL ] EC: Loaded 49674 existing records from primary storage. [2025-10-17T22:37:40.850679] [INFO ] [MAIN ] EC: Loaded 49674 primary data records. [2025-10-17T22:37:40.929160] [DEBUG] [LOCAL ] EBS: Loaded 47428 existing records from primary storage. [2025-10-17T22:37:40.962190] [INFO ] [MAIN ] EBS: Loaded 47428 primary data records. [2025-10-17T22:37:41.846704] [DEBUG] [MAIN ] ECAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:41.848417] [INFO ] [MAIN ] ECAT: Generated 1820 derivative records from 29841 primary records. [2025-10-17T22:37:41.848901] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-10-17T22:37:41.847361] [DEBUG] [MAIN ] EC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:41.850477] [INFO ] [MAIN ] EC: Generated 1820 derivative records from 49674 primary records. [2025-10-17T22:37:41.851016] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-10-17T22:37:41.896510] [DEBUG] [MAIN ] EBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:41.898515] [INFO ] [MAIN ] EBS: Generated 1820 derivative records from 47428 primary records. [2025-10-17T22:37:41.899345] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-10-17T22:37:41.900988] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1820 records). [2025-10-17T22:37:41.901592] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-10-17T22:37:41.903865] [INFO ] [MAIN ] Derivative Progress: 556/2083 symbols completed. ECAT took 1.2s. Estimated remaining: 9m 43s. Rate: 157.2 symbols/min [2025-10-17T22:37:41.904011] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:41.904904] [DEBUG] [LOCAL ] EC: Derivative data saved (1820 records). [2025-10-17T22:37:41.920860] [DEBUG] [LOCAL ] EBS: Derivative data saved (1820 records). [2025-10-17T22:37:41.921066] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-10-17T22:37:41.923314] [INFO ] [MAIN ] Derivative Progress: 557/2083 symbols completed. EBS took 1.2s. Estimated remaining: 9m 42s. Rate: 157.4 symbols/min [2025-10-17T22:37:41.916858] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-10-17T22:37:41.926469] [INFO ] [MAIN ] Derivative Progress: 558/2083 symbols completed. EC took 1.2s. Estimated remaining: 9m 40s. Rate: 157.7 symbols/min [2025-10-17T22:37:41.926317] [INFO ] [MAIN ] ECCU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:41.926869] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:41.932576] [DEBUG] [LOCAL ] ECCU: Loaded 2234 existing records from primary storage. [2025-10-17T22:37:41.932808] [INFO ] [MAIN ] ECCU: Loaded 2234 primary data records. [2025-10-17T22:37:42.265161] [DEBUG] [LOCAL ] ECC: Loaded 43973 existing records from primary storage. [2025-10-17T22:37:42.278299] [INFO ] [MAIN ] ECC: Loaded 43973 primary data records. [2025-10-17T22:37:42.291349] [DEBUG] [LOCAL ] ECG: Loaded 33657 existing records from primary storage. [2025-10-17T22:37:42.317737] [INFO ] [MAIN ] ECG: Loaded 33657 primary data records. [2025-10-17T22:37:42.959790] [DEBUG] [MAIN ] ECCU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:42.962097] [INFO ] [MAIN ] ECCU: Generated 1820 derivative records from 2234 primary records. [2025-10-17T22:37:42.962942] [DEBUG] [LOCAL ] ECCU: Saving derivative data. [2025-10-17T22:37:42.978355] [DEBUG] [LOCAL ] ECCU: Derivative data saved (1820 records). [2025-10-17T22:37:42.978579] [INFO ] [MAIN ] ECCU: Successfully saved derivative data. [2025-10-17T22:37:42.980846] [INFO ] [MAIN ] Derivative Progress: 559/2083 symbols completed. ECCU took 1.1s. Estimated remaining: 9m 42s. Rate: 157.2 symbols/min [2025-10-17T22:37:42.981484] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:43.002257] [DEBUG] [MAIN ] ECC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:43.016914] [INFO ] [MAIN ] ECC: Generated 1820 derivative records from 43973 primary records. [2025-10-17T22:37:43.017156] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-17T22:37:43.018174] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:43.026823] [INFO ] [MAIN ] ECG: Generated 1820 derivative records from 33657 primary records. [2025-10-17T22:37:43.050468] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-17T22:37:43.055927] [DEBUG] [LOCAL ] ECC: Derivative data saved (1820 records). [2025-10-17T22:37:43.056852] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-10-17T22:37:43.058853] [INFO ] [MAIN ] Derivative Progress: 560/2083 symbols completed. ECC took 1.2s. Estimated remaining: 9m 40s. Rate: 157.4 symbols/min [2025-10-17T22:37:43.066320] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:43.088175] [DEBUG] [LOCAL ] ECG: Derivative data saved (1820 records). [2025-10-17T22:37:43.088442] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-10-17T22:37:43.090689] [INFO ] [MAIN ] Derivative Progress: 561/2083 symbols completed. ECG took 1.2s. Estimated remaining: 9m 39s. Rate: 157.7 symbols/min [2025-10-17T22:37:43.096102] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:43.112151] [DEBUG] [LOCAL ] ECL: Loaded 47419 existing records from primary storage. [2025-10-17T22:37:43.112727] [INFO ] [MAIN ] ECL: Loaded 47419 primary data records. [2025-10-17T22:37:43.176343] [DEBUG] [LOCAL ] ECO: Loaded 18402 existing records from primary storage. [2025-10-17T22:37:43.202205] [INFO ] [MAIN ] ECO: Loaded 18402 primary data records. [2025-10-17T22:37:43.575219] [DEBUG] [LOCAL ] ECVT: Loaded 43948 existing records from primary storage. [2025-10-17T22:37:43.581039] [INFO ] [MAIN ] ECVT: Loaded 43948 primary data records. [2025-10-17T22:37:44.147208] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:44.148755] [INFO ] [MAIN ] ECL: Generated 1820 derivative records from 47419 primary records. [2025-10-17T22:37:44.149225] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-17T22:37:44.171900] [DEBUG] [LOCAL ] ECL: Derivative data saved (1820 records). [2025-10-17T22:37:44.173325] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-17T22:37:44.176167] [INFO ] [MAIN ] Derivative Progress: 562/2083 symbols completed. ECL took 1.2s. Estimated remaining: 9m 41s. Rate: 157.2 symbols/min [2025-10-17T22:37:44.176582] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:44.191000] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:44.191871] [INFO ] [MAIN ] ECO: Generated 1820 derivative records from 18402 primary records. [2025-10-17T22:37:44.192174] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-17T22:37:44.224240] [DEBUG] [MAIN ] ECVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:44.225345] [INFO ] [MAIN ] ECVT: Generated 1820 derivative records from 43948 primary records. [2025-10-17T22:37:44.226889] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-10-17T22:37:44.226834] [DEBUG] [LOCAL ] ECO: Derivative data saved (1820 records). [2025-10-17T22:37:44.227777] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-17T22:37:44.229975] [INFO ] [MAIN ] Derivative Progress: 563/2083 symbols completed. ECO took 1.2s. Estimated remaining: 9m 39s. Rate: 157.4 symbols/min [2025-10-17T22:37:44.230520] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:44.246892] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1820 records). [2025-10-17T22:37:44.247249] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-10-17T22:37:44.249491] [INFO ] [MAIN ] Derivative Progress: 564/2083 symbols completed. ECVT took 1.2s. Estimated remaining: 9m 38s. Rate: 157.7 symbols/min [2025-10-17T22:37:44.250037] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:44.277372] [DEBUG] [LOCAL ] EDF: Loaded 13279 existing records from primary storage. [2025-10-17T22:37:44.277600] [INFO ] [MAIN ] EDF: Loaded 13279 primary data records. [2025-10-17T22:37:44.406136] [DEBUG] [LOCAL ] ED: Loaded 53411 existing records from primary storage. [2025-10-17T22:37:44.410523] [INFO ] [MAIN ] ED: Loaded 53411 primary data records. [2025-10-17T22:37:44.437924] [DEBUG] [LOCAL ] EDN: Loaded 19338 existing records from primary storage. [2025-10-17T22:37:44.500190] [INFO ] [MAIN ] EDN: Loaded 19338 primary data records. [2025-10-17T22:37:45.255210] [DEBUG] [MAIN ] EDF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:45.256584] [INFO ] [MAIN ] EDF: Generated 1820 derivative records from 13279 primary records. [2025-10-17T22:37:45.256783] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-10-17T22:37:45.275004] [DEBUG] [LOCAL ] EDF: Derivative data saved (1820 records). [2025-10-17T22:37:45.276689] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-10-17T22:37:45.279383] [INFO ] [MAIN ] Derivative Progress: 565/2083 symbols completed. EDF took 1.0s. Estimated remaining: 9m 39s. Rate: 157.2 symbols/min [2025-10-17T22:37:45.279708] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:45.294614] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:45.295716] [INFO ] [MAIN ] ED: Generated 1820 derivative records from 53411 primary records. [2025-10-17T22:37:45.296037] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-17T22:37:45.323894] [DEBUG] [LOCAL ] ED: Derivative data saved (1820 records). [2025-10-17T22:37:45.329130] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:45.329301] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-17T22:37:45.331481] [INFO ] [MAIN ] Derivative Progress: 566/2083 symbols completed. ED took 1.2s. Estimated remaining: 9m 38s. Rate: 157.4 symbols/min [2025-10-17T22:37:45.332571] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:45.332362] [INFO ] [MAIN ] EDN: Generated 1820 derivative records from 19338 primary records. [2025-10-17T22:37:45.332776] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-17T22:37:45.360669] [DEBUG] [LOCAL ] EDN: Derivative data saved (1820 records). [2025-10-17T22:37:45.360742] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-17T22:37:45.363716] [INFO ] [MAIN ] Derivative Progress: 567/2083 symbols completed. EDN took 1.1s. Estimated remaining: 9m 37s. Rate: 157.7 symbols/min [2025-10-17T22:37:45.364055] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:45.379481] [DEBUG] [LOCAL ] EDU: Loaded 45507 existing records from primary storage. [2025-10-17T22:37:45.379719] [INFO ] [MAIN ] EDU: Loaded 45507 primary data records. [2025-10-17T22:37:45.515946] [DEBUG] [LOCAL ] EEX: Loaded 10348 existing records from primary storage. [2025-10-17T22:37:45.530826] [INFO ] [MAIN ] EEX: Loaded 10348 primary data records. [2025-10-17T22:37:45.573028] [DEBUG] [LOCAL ] EE: Loaded 33450 existing records from primary storage. [2025-10-17T22:37:45.578304] [INFO ] [MAIN ] EE: Loaded 33450 primary data records. [2025-10-17T22:37:46.404876] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:46.406092] [INFO ] [MAIN ] EDU: Generated 1820 derivative records from 45507 primary records. [2025-10-17T22:37:46.406565] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-17T22:37:46.449368] [DEBUG] [LOCAL ] EDU: Derivative data saved (1820 records). [2025-10-17T22:37:46.454630] [DEBUG] [MAIN ] EE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:46.454757] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-17T22:37:46.449609] [DEBUG] [MAIN ] EEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:46.455669] [INFO ] [MAIN ] EE: Generated 1820 derivative records from 33450 primary records. [2025-10-17T22:37:46.457945] [INFO ] [MAIN ] Derivative Progress: 568/2083 symbols completed. EDU took 1.2s. Estimated remaining: 9m 38s. Rate: 157.2 symbols/min [2025-10-17T22:37:46.455780] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-10-17T22:37:46.459468] [INFO ] [MAIN ] EEX: Generated 1820 derivative records from 10348 primary records. [2025-10-17T22:37:46.460041] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-10-17T22:37:46.484159] [DEBUG] [LOCAL ] EE: Derivative data saved (1820 records). [2025-10-17T22:37:46.484280] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-10-17T22:37:46.486333] [INFO ] [MAIN ] Derivative Progress: 569/2083 symbols completed. EE took 1.2s. Estimated remaining: 9m 37s. Rate: 157.4 symbols/min [2025-10-17T22:37:46.494166] [DEBUG] [LOCAL ] EEX: Derivative data saved (1820 records). [2025-10-17T22:37:46.494275] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-10-17T22:37:46.496854] [INFO ] [MAIN ] Derivative Progress: 570/2083 symbols completed. EEX took 1.1s. Estimated remaining: 9m 36s. Rate: 157.7 symbols/min [2025-10-17T22:37:46.497278] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:46.498321] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:46.498810] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:46.518851] [DEBUG] [LOCAL ] EFT: Loaded 13215 existing records from primary storage. [2025-10-17T22:37:46.519073] [INFO ] [MAIN ] EFT: Loaded 13215 primary data records. [2025-10-17T22:37:46.593984] [DEBUG] [LOCAL ] EFR: Loaded 15309 existing records from primary storage. [2025-10-17T22:37:46.600410] [INFO ] [MAIN ] EFR: Loaded 15309 primary data records. [2025-10-17T22:37:47.107825] [DEBUG] [LOCAL ] EFC: Loaded 47042 existing records from primary storage. [2025-10-17T22:37:47.144780] [INFO ] [MAIN ] EFC: Loaded 47042 primary data records. [2025-10-17T22:37:47.521835] [DEBUG] [MAIN ] EFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:47.523014] [INFO ] [MAIN ] EFT: Generated 1820 derivative records from 13215 primary records. [2025-10-17T22:37:47.523200] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-10-17T22:37:47.539707] [DEBUG] [MAIN ] EFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:47.540487] [INFO ] [MAIN ] EFR: Generated 1820 derivative records from 15309 primary records. [2025-10-17T22:37:47.547793] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-17T22:37:47.572584] [DEBUG] [LOCAL ] EFT: Derivative data saved (1820 records). [2025-10-17T22:37:47.576913] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-10-17T22:37:47.579408] [INFO ] [MAIN ] Derivative Progress: 571/2083 symbols completed. EFT took 1.1s. Estimated remaining: 9m 37s. Rate: 157.2 symbols/min [2025-10-17T22:37:47.580041] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:47.585427] [DEBUG] [LOCAL ] EFR: Derivative data saved (1820 records). [2025-10-17T22:37:47.585851] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-17T22:37:47.588255] [INFO ] [MAIN ] Derivative Progress: 572/2083 symbols completed. EFR took 1.1s. Estimated remaining: 9m 36s. Rate: 157.5 symbols/min [2025-10-17T22:37:47.588583] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:47.606898] [DEBUG] [MAIN ] EFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:47.607730] [INFO ] [MAIN ] EFC: Generated 1820 derivative records from 47042 primary records. [2025-10-17T22:37:47.607862] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-10-17T22:37:47.645111] [DEBUG] [LOCAL ] EFC: Derivative data saved (1820 records). [2025-10-17T22:37:47.645337] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-10-17T22:37:47.647704] [INFO ] [MAIN ] Derivative Progress: 573/2083 symbols completed. EFC took 1.1s. Estimated remaining: 9m 35s. Rate: 157.7 symbols/min [2025-10-17T22:37:47.647999] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:47.660156] [DEBUG] [LOCAL ] EFXT: Loaded 30200 existing records from primary storage. [2025-10-17T22:37:47.660398] [INFO ] [MAIN ] EFXT: Loaded 30200 primary data records. [2025-10-17T22:37:47.791288] [DEBUG] [LOCAL ] EFX: Loaded 45309 existing records from primary storage. [2025-10-17T22:37:47.795228] [INFO ] [MAIN ] EFX: Loaded 45309 primary data records. [2025-10-17T22:37:47.912704] [DEBUG] [LOCAL ] EG: Loaded 28182 existing records from primary storage. [2025-10-17T22:37:48.083115] [INFO ] [MAIN ] EG: Loaded 28182 primary data records. [2025-10-17T22:37:48.648342] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:48.649208] [INFO ] [MAIN ] EFXT: Generated 1820 derivative records from 30200 primary records. [2025-10-17T22:37:48.649558] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-17T22:37:48.668921] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1820 records). [2025-10-17T22:37:48.669592] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-10-17T22:37:48.671807] [INFO ] [MAIN ] Derivative Progress: 574/2083 symbols completed. EFXT took 1.1s. Estimated remaining: 9m 36s. Rate: 157.2 symbols/min [2025-10-17T22:37:48.680139] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:48.686182] [DEBUG] [MAIN ] EFX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:48.686987] [INFO ] [MAIN ] EFX: Generated 1820 derivative records from 45309 primary records. [2025-10-17T22:37:48.687133] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-10-17T22:37:48.707277] [DEBUG] [LOCAL ] EFX: Derivative data saved (1820 records). [2025-10-17T22:37:48.708317] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-10-17T22:37:48.710828] [INFO ] [MAIN ] Derivative Progress: 575/2083 symbols completed. EFX took 1.1s. Estimated remaining: 9m 35s. Rate: 157.5 symbols/min [2025-10-17T22:37:48.711056] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:48.724638] [DEBUG] [MAIN ] EG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:48.725280] [INFO ] [MAIN ] EG: Generated 1820 derivative records from 28182 primary records. [2025-10-17T22:37:48.725431] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-17T22:37:48.743827] [DEBUG] [LOCAL ] EG: Derivative data saved (1820 records). [2025-10-17T22:37:48.757406] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-10-17T22:37:48.762174] [INFO ] [MAIN ] Derivative Progress: 576/2083 symbols completed. EG took 1.1s. Estimated remaining: 9m 33s. Rate: 157.7 symbols/min [2025-10-17T22:37:48.762483] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:48.791611] [DEBUG] [LOCAL ] EGO: Loaded 52505 existing records from primary storage. [2025-10-17T22:37:48.791856] [INFO ] [MAIN ] EGO: Loaded 52505 primary data records. [2025-10-17T22:37:48.914201] [DEBUG] [LOCAL ] EGP: Loaded 30899 existing records from primary storage. [2025-10-17T22:37:48.920023] [INFO ] [MAIN ] EGP: Loaded 30899 primary data records. [2025-10-17T22:37:49.081120] [DEBUG] [LOCAL ] EGY: Loaded 42160 existing records from primary storage. [2025-10-17T22:37:49.234972] [INFO ] [MAIN ] EGY: Loaded 42160 primary data records. [2025-10-17T22:37:49.822688] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:49.824124] [INFO ] [MAIN ] EGO: Generated 1820 derivative records from 52505 primary records. [2025-10-17T22:37:49.826738] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-17T22:37:49.841373] [DEBUG] [MAIN ] EGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:49.842398] [INFO ] [MAIN ] EGP: Generated 1820 derivative records from 30899 primary records. [2025-10-17T22:37:49.842691] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-17T22:37:49.858316] [DEBUG] [LOCAL ] EGO: Derivative data saved (1820 records). [2025-10-17T22:37:49.858560] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-10-17T22:37:49.860816] [INFO ] [MAIN ] Derivative Progress: 577/2083 symbols completed. EGO took 1.2s. Estimated remaining: 9m 35s. Rate: 157.2 symbols/min [2025-10-17T22:37:49.861003] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:49.888406] [DEBUG] [LOCAL ] EGP: Derivative data saved (1820 records). [2025-10-17T22:37:49.893797] [DEBUG] [MAIN ] EGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:49.893861] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-10-17T22:37:49.894565] [INFO ] [MAIN ] EGY: Generated 1820 derivative records from 42160 primary records. [2025-10-17T22:37:49.896631] [INFO ] [MAIN ] Derivative Progress: 578/2083 symbols completed. EGP took 1.2s. Estimated remaining: 9m 34s. Rate: 157.4 symbols/min [2025-10-17T22:37:49.897018] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-10-17T22:37:49.896892] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:49.931205] [DEBUG] [LOCAL ] EGY: Derivative data saved (1820 records). [2025-10-17T22:37:49.932376] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-10-17T22:37:49.932855] [DEBUG] [LOCAL ] EHAB: Loaded 29656 existing records from primary storage. [2025-10-17T22:37:49.932942] [INFO ] [MAIN ] EHAB: Loaded 29656 primary data records. [2025-10-17T22:37:49.935163] [INFO ] [MAIN ] Derivative Progress: 579/2083 symbols completed. EGY took 1.2s. Estimated remaining: 9m 32s. Rate: 157.7 symbols/min [2025-10-17T22:37:49.935354] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:50.093077] [DEBUG] [LOCAL ] EHI: Loaded 10782 existing records from primary storage. [2025-10-17T22:37:50.101753] [INFO ] [MAIN ] EHI: Loaded 10782 primary data records. [2025-10-17T22:37:50.181585] [DEBUG] [LOCAL ] EHC: Loaded 41587 existing records from primary storage. [2025-10-17T22:37:50.321613] [INFO ] [MAIN ] EHC: Loaded 41587 primary data records. [2025-10-17T22:37:50.877791] [DEBUG] [MAIN ] EHAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:50.879198] [INFO ] [MAIN ] EHAB: Generated 1820 derivative records from 29656 primary records. [2025-10-17T22:37:50.879573] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-10-17T22:37:50.897630] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1820 records). [2025-10-17T22:37:50.898241] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-10-17T22:37:50.902423] [INFO ] [MAIN ] Derivative Progress: 580/2083 symbols completed. EHAB took 1.0s. Estimated remaining: 9m 33s. Rate: 157.3 symbols/min [2025-10-17T22:37:50.903913] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:50.919201] [DEBUG] [MAIN ] EHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:50.920241] [INFO ] [MAIN ] EHI: Generated 1820 derivative records from 10782 primary records. [2025-10-17T22:37:50.920692] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-17T22:37:50.963006] [DEBUG] [LOCAL ] EHI: Derivative data saved (1820 records). [2025-10-17T22:37:50.962218] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:50.963844] [INFO ] [MAIN ] EHC: Generated 1820 derivative records from 41587 primary records. [2025-10-17T22:37:50.964078] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-17T22:37:50.964016] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-10-17T22:37:50.966746] [INFO ] [MAIN ] Derivative Progress: 581/2083 symbols completed. EHI took 1.0s. Estimated remaining: 9m 32s. Rate: 157.5 symbols/min [2025-10-17T22:37:50.967701] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:50.987822] [DEBUG] [LOCAL ] EIC: Loaded 23126 existing records from primary storage. [2025-10-17T22:37:50.988293] [INFO ] [MAIN ] EIC: Loaded 23126 primary data records. [2025-10-17T22:37:51.100519] [DEBUG] [LOCAL ] EHC: Derivative data saved (1820 records). [2025-10-17T22:37:51.117277] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-10-17T22:37:51.126204] [DEBUG] [LOCAL ] EIG: Loaded 20485 existing records from primary storage. [2025-10-17T22:37:51.125700] [INFO ] [MAIN ] Derivative Progress: 582/2083 symbols completed. EHC took 1.2s. Estimated remaining: 9m 31s. Rate: 157.7 symbols/min [2025-10-17T22:37:51.126461] [INFO ] [MAIN ] EIG: Loaded 20485 primary data records. [2025-10-17T22:37:51.126390] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:51.696789] [DEBUG] [LOCAL ] EL: Loaded 54155 existing records from primary storage. [2025-10-17T22:37:51.697256] [INFO ] [MAIN ] EL: Loaded 54155 primary data records. [2025-10-17T22:37:51.697185] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:51.698161] [INFO ] [MAIN ] EIC: Generated 1820 derivative records from 23126 primary records. [2025-10-17T22:37:51.698258] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-10-17T22:37:51.834506] [DEBUG] [LOCAL ] EIC: Derivative data saved (1820 records). [2025-10-17T22:37:51.835262] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-10-17T22:37:51.842611] [INFO ] [MAIN ] Derivative Progress: 583/2083 symbols completed. EIC took 0.9s. Estimated remaining: 9m 32s. Rate: 157.4 symbols/min [2025-10-17T22:37:51.881331] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:51.912209] [INFO ] [MAIN ] EIG: Generated 1820 derivative records from 20485 primary records. [2025-10-17T22:37:51.930274] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-17T22:37:52.075181] [DEBUG] [LOCAL ] EIG: Derivative data saved (1820 records). [2025-10-17T22:37:52.075560] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-17T22:37:52.078165] [INFO ] [MAIN ] Derivative Progress: 584/2083 symbols completed. EIG took 1.1s. Estimated remaining: 9m 31s. Rate: 157.5 symbols/min [2025-10-17T22:37:52.099259] [DEBUG] [MAIN ] EL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:52.099948] [INFO ] [MAIN ] EL: Generated 1820 derivative records from 54155 primary records. [2025-10-17T22:37:52.100011] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-17T22:37:52.117310] [DEBUG] [LOCAL ] EL: Derivative data saved (1820 records). [2025-10-17T22:37:52.117380] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-10-17T22:37:52.119545] [INFO ] [MAIN ] Derivative Progress: 585/2083 symbols completed. EL took 1.0s. Estimated remaining: 9m 30s. Rate: 157.8 symbols/min [2025-10-17T22:37:52.120124] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:52.120573] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:52.120045] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:52.127144] [DEBUG] [LOCAL ] ELC: Loaded 3542 existing records from primary storage. [2025-10-17T22:37:52.127467] [INFO ] [MAIN ] ELC: Loaded 3542 primary data records. [2025-10-17T22:37:52.473105] [DEBUG] [LOCAL ] ELAN: Loaded 54080 existing records from primary storage. [2025-10-17T22:37:52.490080] [DEBUG] [LOCAL ] ELF: Loaded 52711 existing records from primary storage. [2025-10-17T22:37:52.488890] [INFO ] [MAIN ] ELAN: Loaded 54080 primary data records. [2025-10-17T22:37:52.490770] [INFO ] [MAIN ] ELF: Loaded 52711 primary data records. [2025-10-17T22:37:52.718945] [DEBUG] [MAIN ] ELC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:52.743039] [INFO ] [MAIN ] ELC: Generated 1820 derivative records from 3542 primary records. [2025-10-17T22:37:52.748265] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-10-17T22:37:53.148532] [DEBUG] [LOCAL ] ELC: Derivative data saved (1820 records). [2025-10-17T22:37:53.148946] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-10-17T22:37:53.151196] [INFO ] [MAIN ] Derivative Progress: 586/2083 symbols completed. ELC took 1.0s. Estimated remaining: 9m 31s. Rate: 157.3 symbols/min [2025-10-17T22:37:53.151454] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:53.194537] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:53.195567] [INFO ] [MAIN ] ELF: Generated 1820 derivative records from 52711 primary records. [2025-10-17T22:37:53.195796] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-10-17T22:37:53.224575] [DEBUG] [LOCAL ] ELF: Derivative data saved (1820 records). [2025-10-17T22:37:53.225584] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-10-17T22:37:53.227531] [INFO ] [MAIN ] Derivative Progress: 587/2083 symbols completed. ELF took 1.1s. Estimated remaining: 9m 30s. Rate: 157.5 symbols/min [2025-10-17T22:37:53.228081] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:53.241862] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:53.253732] [INFO ] [MAIN ] ELAN: Generated 1820 derivative records from 54080 primary records. [2025-10-17T22:37:53.253985] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-17T22:37:53.255534] [DEBUG] [LOCAL ] ELME: Loaded 39953 existing records from primary storage. [2025-10-17T22:37:53.255859] [INFO ] [MAIN ] ELME: Loaded 39953 primary data records. [2025-10-17T22:37:53.293083] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1820 records). [2025-10-17T22:37:53.338384] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-17T22:37:53.376119] [INFO ] [MAIN ] Derivative Progress: 588/2083 symbols completed. ELAN took 1.3s. Estimated remaining: 9m 29s. Rate: 157.7 symbols/min [2025-10-17T22:37:53.387389] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:53.471145] [DEBUG] [LOCAL ] ELP: Loaded 26040 existing records from primary storage. [2025-10-17T22:37:53.477022] [INFO ] [MAIN ] ELP: Loaded 26040 primary data records. [2025-10-17T22:37:53.998347] [DEBUG] [LOCAL ] ELS: Loaded 50599 existing records from primary storage. [2025-10-17T22:37:53.998871] [INFO ] [MAIN ] ELS: Loaded 50599 primary data records. [2025-10-17T22:37:54.202843] [DEBUG] [MAIN ] ELME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:54.308684] [INFO ] [MAIN ] ELME: Generated 1820 derivative records from 39953 primary records. [2025-10-17T22:37:54.317667] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-10-17T22:37:54.336232] [DEBUG] [LOCAL ] ELME: Derivative data saved (1820 records). [2025-10-17T22:37:54.337913] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-10-17T22:37:54.342544] [INFO ] [MAIN ] Derivative Progress: 589/2083 symbols completed. ELME took 1.2s. Estimated remaining: 9m 30s. Rate: 157.3 symbols/min [2025-10-17T22:37:54.342859] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:54.356864] [DEBUG] [MAIN ] ELP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:54.357797] [INFO ] [MAIN ] ELP: Generated 1820 derivative records from 26040 primary records. [2025-10-17T22:37:54.357882] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-10-17T22:37:54.375546] [DEBUG] [LOCAL ] ELP: Derivative data saved (1820 records). [2025-10-17T22:37:54.375777] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-10-17T22:37:54.377883] [INFO ] [MAIN ] Derivative Progress: 590/2083 symbols completed. ELP took 1.1s. Estimated remaining: 9m 29s. Rate: 157.5 symbols/min [2025-10-17T22:37:54.378161] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:54.397292] [DEBUG] [MAIN ] ELS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:54.398043] [INFO ] [MAIN ] ELS: Generated 1820 derivative records from 50599 primary records. [2025-10-17T22:37:54.398214] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-10-17T22:37:54.437089] [DEBUG] [LOCAL ] ELS: Derivative data saved (1820 records). [2025-10-17T22:37:54.438397] [DEBUG] [LOCAL ] EMD: Loaded 21209 existing records from primary storage. [2025-10-17T22:37:54.438069] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-10-17T22:37:54.440531] [INFO ] [MAIN ] Derivative Progress: 591/2083 symbols completed. ELS took 1.1s. Estimated remaining: 9m 28s. Rate: 157.7 symbols/min [2025-10-17T22:37:54.438501] [INFO ] [MAIN ] EMD: Loaded 21209 primary data records. [2025-10-17T22:37:54.441507] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:54.537624] [DEBUG] [LOCAL ] ELV: Loaded 51393 existing records from primary storage. [2025-10-17T22:37:54.550451] [INFO ] [MAIN ] ELV: Loaded 51393 primary data records. [2025-10-17T22:37:54.540107] [DEBUG] [LOCAL ] EMF: Loaded 3246 existing records from primary storage. [2025-10-17T22:37:54.557992] [INFO ] [MAIN ] EMF: Loaded 3246 primary data records. [2025-10-17T22:37:55.427550] [DEBUG] [MAIN ] EMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:55.428419] [INFO ] [MAIN ] EMD: Generated 1820 derivative records from 21209 primary records. [2025-10-17T22:37:55.428600] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-10-17T22:37:55.449905] [DEBUG] [LOCAL ] EMD: Derivative data saved (1820 records). [2025-10-17T22:37:55.451974] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-10-17T22:37:55.464695] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:55.466812] [INFO ] [MAIN ] Derivative Progress: 592/2083 symbols completed. EMD took 1.1s. Estimated remaining: 9m 29s. Rate: 157.3 symbols/min [2025-10-17T22:37:55.473167] [INFO ] [MAIN ] EMF: Generated 1820 derivative records from 3246 primary records. [2025-10-17T22:37:55.481693] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-17T22:37:55.467045] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:55.483811] [DEBUG] [MAIN ] ELV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:55.498412] [INFO ] [MAIN ] ELV: Generated 1820 derivative records from 51393 primary records. [2025-10-17T22:37:55.497539] [DEBUG] [LOCAL ] EMF: Derivative data saved (1820 records). [2025-10-17T22:37:55.498639] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-10-17T22:37:55.498783] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-17T22:37:55.501871] [INFO ] [MAIN ] Derivative Progress: 593/2083 symbols completed. EMF took 1.1s. Estimated remaining: 9m 28s. Rate: 157.5 symbols/min [2025-10-17T22:37:55.502744] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:55.519475] [DEBUG] [LOCAL ] ELV: Derivative data saved (1820 records). [2025-10-17T22:37:55.519788] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-10-17T22:37:55.521880] [INFO ] [MAIN ] Derivative Progress: 594/2083 symbols completed. ELV took 1.2s. Estimated remaining: 9m 26s. Rate: 157.8 symbols/min [2025-10-17T22:37:55.525967] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:55.533374] [DEBUG] [LOCAL ] EMO: Loaded 13445 existing records from primary storage. [2025-10-17T22:37:55.534363] [INFO ] [MAIN ] EMO: Loaded 13445 primary data records. [2025-10-17T22:37:55.594140] [DEBUG] [LOCAL ] EMP: Loaded 3057 existing records from primary storage. [2025-10-17T22:37:55.612264] [INFO ] [MAIN ] EMP: Loaded 3057 primary data records. [2025-10-17T22:37:55.790565] [DEBUG] [LOCAL ] EMN: Loaded 51488 existing records from primary storage. [2025-10-17T22:37:55.804329] [INFO ] [MAIN ] EMN: Loaded 51488 primary data records. [2025-10-17T22:37:56.535264] [DEBUG] [MAIN ] EMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:56.548760] [INFO ] [MAIN ] EMO: Generated 1820 derivative records from 13445 primary records. [2025-10-17T22:37:56.549684] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-10-17T22:37:56.551264] [DEBUG] [MAIN ] EMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:56.554874] [INFO ] [MAIN ] EMP: Generated 1820 derivative records from 3057 primary records. [2025-10-17T22:37:56.562247] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-10-17T22:37:56.585086] [DEBUG] [LOCAL ] EMO: Derivative data saved (1820 records). [2025-10-17T22:37:56.593801] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-10-17T22:37:56.596092] [INFO ] [MAIN ] Derivative Progress: 595/2083 symbols completed. EMO took 1.1s. Estimated remaining: 9m 28s. Rate: 157.3 symbols/min [2025-10-17T22:37:56.596636] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:56.596782] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:56.598300] [INFO ] [MAIN ] EMN: Generated 1820 derivative records from 51488 primary records. [2025-10-17T22:37:56.599181] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-17T22:37:56.611429] [DEBUG] [LOCAL ] EMP: Derivative data saved (1820 records). [2025-10-17T22:37:56.614732] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-10-17T22:37:56.620881] [INFO ] [MAIN ] Derivative Progress: 596/2083 symbols completed. EMP took 1.1s. Estimated remaining: 9m 26s. Rate: 157.5 symbols/min [2025-10-17T22:37:56.621041] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:56.618601] [DEBUG] [LOCAL ] EMN: Derivative data saved (1820 records). [2025-10-17T22:37:56.621255] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-10-17T22:37:56.623585] [INFO ] [MAIN ] Derivative Progress: 597/2083 symbols completed. EMN took 1.2s. Estimated remaining: 9m 25s. Rate: 157.8 symbols/min [2025-10-17T22:37:56.623976] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:56.687265] [DEBUG] [LOCAL ] ENIC: Loaded 37209 existing records from primary storage. [2025-10-17T22:37:56.688313] [INFO ] [MAIN ] ENIC: Loaded 37209 primary data records. [2025-10-17T22:37:56.784590] [DEBUG] [LOCAL ] EMR: Loaded 53972 existing records from primary storage. [2025-10-17T22:37:56.797623] [INFO ] [MAIN ] EMR: Loaded 53972 primary data records. [2025-10-17T22:37:56.852639] [DEBUG] [LOCAL ] ENB: Loaded 54292 existing records from primary storage. [2025-10-17T22:37:56.879743] [INFO ] [MAIN ] ENB: Loaded 54292 primary data records. [2025-10-17T22:37:57.683475] [DEBUG] [MAIN ] ENIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:57.685105] [INFO ] [MAIN ] ENIC: Generated 1820 derivative records from 37209 primary records. [2025-10-17T22:37:57.685805] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-10-17T22:37:57.712897] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:57.716484] [INFO ] [MAIN ] ENB: Generated 1820 derivative records from 54292 primary records. [2025-10-17T22:37:57.716598] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-17T22:37:57.738464] [DEBUG] [MAIN ] EMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:57.746016] [INFO ] [MAIN ] EMR: Generated 1820 derivative records from 53972 primary records. [2025-10-17T22:37:57.748365] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1820 records). [2025-10-17T22:37:57.748639] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-10-17T22:37:57.750101] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-10-17T22:37:57.753331] [INFO ] [MAIN ] Derivative Progress: 598/2083 symbols completed. ENIC took 1.1s. Estimated remaining: 9m 26s. Rate: 157.3 symbols/min [2025-10-17T22:37:57.770780] [DEBUG] [LOCAL ] ENB: Derivative data saved (1820 records). [2025-10-17T22:37:57.771791] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-10-17T22:37:57.774768] [INFO ] [MAIN ] Derivative Progress: 599/2083 symbols completed. ENB took 1.2s. Estimated remaining: 9m 25s. Rate: 157.5 symbols/min [2025-10-17T22:37:57.774867] [DEBUG] [LOCAL ] EMR: Derivative data saved (1820 records). [2025-10-17T22:37:57.775266] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-10-17T22:37:57.777500] [INFO ] [MAIN ] Derivative Progress: 600/2083 symbols completed. EMR took 1.2s. Estimated remaining: 9m 24s. Rate: 157.8 symbols/min [2025-10-17T22:37:57.777984] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:57.778429] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:57.778106] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:57.784847] [DEBUG] [LOCAL ] ENO: Loaded 1872 existing records from primary storage. [2025-10-17T22:37:57.784988] [INFO ] [MAIN ] ENO: Loaded 1872 primary data records. [2025-10-17T22:37:58.128876] [DEBUG] [LOCAL ] ENR: Loaded 44323 existing records from primary storage. [2025-10-17T22:37:58.129635] [INFO ] [MAIN ] ENR: Loaded 44323 primary data records. [2025-10-17T22:37:58.130472] [DEBUG] [LOCAL ] ENOV: Loaded 45385 existing records from primary storage. [2025-10-17T22:37:58.151240] [INFO ] [MAIN ] ENOV: Loaded 45385 primary data records. [2025-10-17T22:37:58.780963] [DEBUG] [MAIN ] ENO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:58.782239] [INFO ] [MAIN ] ENO: Generated 1820 derivative records from 1872 primary records. [2025-10-17T22:37:58.782542] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-10-17T22:37:58.802100] [DEBUG] [LOCAL ] ENO: Derivative data saved (1820 records). [2025-10-17T22:37:58.802503] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-10-17T22:37:58.804628] [INFO ] [MAIN ] Derivative Progress: 601/2083 symbols completed. ENO took 1.0s. Estimated remaining: 9m 25s. Rate: 157.3 symbols/min [2025-10-17T22:37:58.805158] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:58.834598] [DEBUG] [MAIN ] ENOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:58.845592] [INFO ] [MAIN ] ENOV: Generated 1820 derivative records from 45385 primary records. [2025-10-17T22:37:58.852718] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-10-17T22:37:58.854250] [DEBUG] [MAIN ] ENR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:58.855383] [INFO ] [MAIN ] ENR: Generated 1820 derivative records from 44323 primary records. [2025-10-17T22:37:58.855539] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-17T22:37:58.892323] [DEBUG] [LOCAL ] ENVA: Loaded 25790 existing records from primary storage. [2025-10-17T22:37:58.893161] [INFO ] [MAIN ] ENVA: Loaded 25790 primary data records. [2025-10-17T22:37:58.917412] [DEBUG] [LOCAL ] ENR: Derivative data saved (1820 records). [2025-10-17T22:37:58.928408] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-17T22:37:58.956032] [INFO ] [MAIN ] Derivative Progress: 602/2083 symbols completed. ENR took 1.2s. Estimated remaining: 9m 24s. Rate: 157.5 symbols/min [2025-10-17T22:37:58.970904] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:58.970987] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1820 records). [2025-10-17T22:37:58.993368] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-10-17T22:37:59.006460] [INFO ] [MAIN ] Derivative Progress: 603/2083 symbols completed. ENOV took 1.2s. Estimated remaining: 9m 23s. Rate: 157.7 symbols/min [2025-10-17T22:37:59.012213] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:59.207187] [DEBUG] [LOCAL ] EOD: Loaded 15256 existing records from primary storage. [2025-10-17T22:37:59.207414] [INFO ] [MAIN ] EOD: Loaded 15256 primary data records. [2025-10-17T22:37:59.569608] [DEBUG] [LOCAL ] EOG: Loaded 54152 existing records from primary storage. [2025-10-17T22:37:59.570129] [INFO ] [MAIN ] EOG: Loaded 54152 primary data records. [2025-10-17T22:37:59.646280] [DEBUG] [MAIN ] ENVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:59.653278] [INFO ] [MAIN ] ENVA: Generated 1820 derivative records from 25790 primary records. [2025-10-17T22:37:59.664490] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-17T22:37:59.740438] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1820 records). [2025-10-17T22:37:59.749060] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-17T22:37:59.757500] [INFO ] [MAIN ] Derivative Progress: 604/2083 symbols completed. ENVA took 1.0s. Estimated remaining: 9m 24s. Rate: 157.5 symbols/min [2025-10-17T22:37:59.778727] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:37:59.914433] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:37:59.915219] [INFO ] [MAIN ] EOD: Generated 1820 derivative records from 15256 primary records. [2025-10-17T22:37:59.915423] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-10-17T22:37:59.929173] [DEBUG] [LOCAL ] EOI: Loaded 10809 existing records from primary storage. [2025-10-17T22:37:59.933385] [INFO ] [MAIN ] EOI: Loaded 10809 primary data records. [2025-10-17T22:38:00.024414] [DEBUG] [LOCAL ] EOD: Derivative data saved (1820 records). [2025-10-17T22:38:00.040396] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-10-17T22:38:00.053733] [INFO ] [MAIN ] Derivative Progress: 605/2083 symbols completed. EOD took 1.1s. Estimated remaining: 9m 23s. Rate: 157.5 symbols/min [2025-10-17T22:38:00.054503] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:00.249698] [DEBUG] [LOCAL ] EOS: Loaded 15294 existing records from primary storage. [2025-10-17T22:38:00.250789] [INFO ] [MAIN ] EOS: Loaded 15294 primary data records. [2025-10-17T22:38:00.263793] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:00.275537] [INFO ] [MAIN ] EOG: Generated 1820 derivative records from 54152 primary records. [2025-10-17T22:38:00.284988] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-17T22:38:00.573456] [DEBUG] [LOCAL ] EOG: Derivative data saved (1820 records). [2025-10-17T22:38:00.573909] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-17T22:38:00.576247] [INFO ] [MAIN ] Derivative Progress: 606/2083 symbols completed. EOG took 1.6s. Estimated remaining: 9m 23s. Rate: 157.4 symbols/min [2025-10-17T22:38:00.576520] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:00.600546] [DEBUG] [LOCAL ] EOT: Loaded 7100 existing records from primary storage. [2025-10-17T22:38:00.601056] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:00.602583] [INFO ] [MAIN ] EOI: Generated 1820 derivative records from 10809 primary records. [2025-10-17T22:38:00.602922] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-17T22:38:00.601127] [INFO ] [MAIN ] EOT: Loaded 7100 primary data records. [2025-10-17T22:38:00.718713] [DEBUG] [LOCAL ] EOI: Derivative data saved (1820 records). [2025-10-17T22:38:00.724136] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-17T22:38:00.726264] [INFO ] [MAIN ] Derivative Progress: 607/2083 symbols completed. EOI took 0.9s. Estimated remaining: 9m 22s. Rate: 157.6 symbols/min [2025-10-17T22:38:00.726413] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:00.937265] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:00.939119] [INFO ] [MAIN ] EOS: Generated 1820 derivative records from 15294 primary records. [2025-10-17T22:38:00.939418] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-17T22:38:00.964278] [DEBUG] [LOCAL ] EOS: Derivative data saved (1820 records). [2025-10-17T22:38:00.964800] [DEBUG] [LOCAL ] EPAC: Loaded 27001 existing records from primary storage. [2025-10-17T22:38:00.965075] [INFO ] [MAIN ] EPAC: Loaded 27001 primary data records. [2025-10-17T22:38:00.965232] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-10-17T22:38:00.990069] [INFO ] [MAIN ] Derivative Progress: 608/2083 symbols completed. EOS took 0.9s. Estimated remaining: 9m 21s. Rate: 157.7 symbols/min [2025-10-17T22:38:01.015044] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:01.347516] [DEBUG] [MAIN ] EOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:01.349969] [INFO ] [MAIN ] EOT: Generated 1820 derivative records from 7100 primary records. [2025-10-17T22:38:01.350097] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-10-17T22:38:01.377799] [DEBUG] [LOCAL ] EOT: Derivative data saved (1820 records). [2025-10-17T22:38:01.377971] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-10-17T22:38:01.380570] [INFO ] [MAIN ] Derivative Progress: 609/2083 symbols completed. EOT took 0.8s. Estimated remaining: 9m 21s. Rate: 157.7 symbols/min [2025-10-17T22:38:01.381120] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:01.394997] [DEBUG] [LOCAL ] EPAM: Loaded 39978 existing records from primary storage. [2025-10-17T22:38:01.395292] [INFO ] [MAIN ] EPAM: Loaded 39978 primary data records. [2025-10-17T22:38:01.549271] [DEBUG] [MAIN ] EPAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:01.607970] [INFO ] [MAIN ] EPAC: Generated 1820 derivative records from 27001 primary records. [2025-10-17T22:38:01.608181] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-10-17T22:38:01.742470] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1820 records). [2025-10-17T22:38:01.754301] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-10-17T22:38:01.758151] [INFO ] [MAIN ] Derivative Progress: 610/2083 symbols completed. EPAC took 1.0s. Estimated remaining: 9m 21s. Rate: 157.7 symbols/min [2025-10-17T22:38:01.758481] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:01.760504] [DEBUG] [LOCAL ] EPC: Loaded 40316 existing records from primary storage. [2025-10-17T22:38:01.761590] [INFO ] [MAIN ] EPC: Loaded 40316 primary data records. [2025-10-17T22:38:02.108478] [DEBUG] [MAIN ] EPAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:02.110362] [INFO ] [MAIN ] EPAM: Generated 1820 derivative records from 39978 primary records. [2025-10-17T22:38:02.110803] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-10-17T22:38:02.143669] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1820 records). [2025-10-17T22:38:02.143870] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-10-17T22:38:02.145316] [DEBUG] [LOCAL ] EPD: Loaded 54391 existing records from primary storage. [2025-10-17T22:38:02.148398] [INFO ] [MAIN ] Derivative Progress: 611/2083 symbols completed. EPAM took 1.1s. Estimated remaining: 9m 20s. Rate: 157.7 symbols/min [2025-10-17T22:38:02.148848] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:02.146237] [INFO ] [MAIN ] EPD: Loaded 54391 primary data records. [2025-10-17T22:38:02.481145] [DEBUG] [MAIN ] EPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:02.482611] [INFO ] [MAIN ] EPC: Generated 1820 derivative records from 40316 primary records. [2025-10-17T22:38:02.496428] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-10-17T22:38:02.499568] [DEBUG] [LOCAL ] EPR: Loaded 44473 existing records from primary storage. [2025-10-17T22:38:02.500199] [INFO ] [MAIN ] EPR: Loaded 44473 primary data records. [2025-10-17T22:38:02.528485] [DEBUG] [LOCAL ] EPC: Derivative data saved (1820 records). [2025-10-17T22:38:02.549194] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-10-17T22:38:02.568843] [INFO ] [MAIN ] Derivative Progress: 612/2083 symbols completed. EPC took 1.2s. Estimated remaining: 9m 20s. Rate: 157.6 symbols/min [2025-10-17T22:38:02.569164] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:02.853894] [DEBUG] [MAIN ] EPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:02.855372] [INFO ] [MAIN ] EPD: Generated 1820 derivative records from 54391 primary records. [2025-10-17T22:38:02.855527] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-17T22:38:02.873093] [DEBUG] [LOCAL ] EPD: Derivative data saved (1820 records). [2025-10-17T22:38:02.887339] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-10-17T22:38:02.888114] [DEBUG] [LOCAL ] EPRT: Loaded 49233 existing records from primary storage. [2025-10-17T22:38:02.888334] [INFO ] [MAIN ] EPRT: Loaded 49233 primary data records. [2025-10-17T22:38:02.911235] [INFO ] [MAIN ] Derivative Progress: 613/2083 symbols completed. EPD took 1.2s. Estimated remaining: 9m 19s. Rate: 157.7 symbols/min [2025-10-17T22:38:03.236866] [DEBUG] [MAIN ] EPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:03.237535] [INFO ] [MAIN ] EPR: Generated 1820 derivative records from 44473 primary records. [2025-10-17T22:38:03.237595] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-10-17T22:38:03.256764] [DEBUG] [LOCAL ] EPR: Derivative data saved (1820 records). [2025-10-17T22:38:03.257071] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-10-17T22:38:03.259396] [INFO ] [MAIN ] Derivative Progress: 614/2083 symbols completed. EPR took 1.1s. Estimated remaining: 9m 19s. Rate: 157.7 symbols/min [2025-10-17T22:38:03.279062] [DEBUG] [MAIN ] EPRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:03.279691] [INFO ] [MAIN ] EPRT: Generated 1820 derivative records from 49233 primary records. [2025-10-17T22:38:03.279754] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-10-17T22:38:03.295191] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1820 records). [2025-10-17T22:38:03.295251] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-10-17T22:38:03.298561] [INFO ] [MAIN ] Derivative Progress: 615/2083 symbols completed. EPRT took 0.7s. Estimated remaining: 9m 18s. Rate: 157.9 symbols/min [2025-10-17T22:38:03.299151] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:03.299254] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:03.299050] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:03.313907] [DEBUG] [LOCAL ] EQBK: Loaded 11534 existing records from primary storage. [2025-10-17T22:38:03.314053] [INFO ] [MAIN ] EQBK: Loaded 11534 primary data records. [2025-10-17T22:38:03.652765] [DEBUG] [LOCAL ] EQNR: Loaded 53821 existing records from primary storage. [2025-10-17T22:38:03.653584] [INFO ] [MAIN ] EQNR: Loaded 53821 primary data records. [2025-10-17T22:38:03.762988] [DEBUG] [LOCAL ] EQH: Loaded 53475 existing records from primary storage. [2025-10-17T22:38:03.775594] [INFO ] [MAIN ] EQH: Loaded 53475 primary data records. [2025-10-17T22:38:04.318694] [DEBUG] [MAIN ] EQBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:04.320692] [INFO ] [MAIN ] EQBK: Generated 1820 derivative records from 11534 primary records. [2025-10-17T22:38:04.320933] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-10-17T22:38:04.339599] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1820 records). [2025-10-17T22:38:04.340384] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-10-17T22:38:04.342828] [INFO ] [MAIN ] Derivative Progress: 616/2083 symbols completed. EQBK took 1.0s. Estimated remaining: 9m 19s. Rate: 157.5 symbols/min [2025-10-17T22:38:04.342995] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:04.361148] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:04.362229] [INFO ] [MAIN ] EQNR: Generated 1820 derivative records from 53821 primary records. [2025-10-17T22:38:04.362306] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-17T22:38:04.380426] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1820 records). [2025-10-17T22:38:04.381289] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-10-17T22:38:04.383342] [INFO ] [MAIN ] Derivative Progress: 617/2083 symbols completed. EQNR took 1.1s. Estimated remaining: 9m 18s. Rate: 157.7 symbols/min [2025-10-17T22:38:04.383789] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:04.397206] [DEBUG] [MAIN ] EQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:04.397878] [INFO ] [MAIN ] EQH: Generated 1820 derivative records from 53475 primary records. [2025-10-17T22:38:04.398060] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-17T22:38:04.435312] [DEBUG] [LOCAL ] EQH: Derivative data saved (1820 records). [2025-10-17T22:38:04.435542] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-10-17T22:38:04.437705] [INFO ] [MAIN ] Derivative Progress: 618/2083 symbols completed. EQH took 1.1s. Estimated remaining: 9m 17s. Rate: 157.9 symbols/min [2025-10-17T22:38:04.453271] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:04.471170] [DEBUG] [LOCAL ] EQR: Loaded 52498 existing records from primary storage. [2025-10-17T22:38:04.471493] [INFO ] [MAIN ] EQR: Loaded 52498 primary data records. [2025-10-17T22:38:04.813474] [DEBUG] [LOCAL ] EQT: Loaded 54465 existing records from primary storage. [2025-10-17T22:38:04.826940] [INFO ] [MAIN ] EQT: Loaded 54465 primary data records. [2025-10-17T22:38:04.839001] [DEBUG] [LOCAL ] ERJ: Loaded 51052 existing records from primary storage. [2025-10-17T22:38:04.864322] [INFO ] [MAIN ] ERJ: Loaded 51052 primary data records. [2025-10-17T22:38:05.483996] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:05.485374] [INFO ] [MAIN ] EQR: Generated 1820 derivative records from 52498 primary records. [2025-10-17T22:38:05.485609] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-17T22:38:05.503425] [DEBUG] [LOCAL ] EQR: Derivative data saved (1820 records). [2025-10-17T22:38:05.503579] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-17T22:38:05.507036] [INFO ] [MAIN ] Derivative Progress: 619/2083 symbols completed. EQR took 1.2s. Estimated remaining: 9m 18s. Rate: 157.5 symbols/min [2025-10-17T22:38:05.507581] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:05.528035] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:05.529911] [INFO ] [MAIN ] EQT: Generated 1820 derivative records from 54465 primary records. [2025-10-17T22:38:05.530244] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-17T22:38:05.551506] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:05.562773] [DEBUG] [LOCAL ] EQT: Derivative data saved (1820 records). [2025-10-17T22:38:05.560769] [INFO ] [MAIN ] ERJ: Generated 1820 derivative records from 51052 primary records. [2025-10-17T22:38:05.562910] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-17T22:38:05.563882] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-17T22:38:05.565958] [INFO ] [MAIN ] Derivative Progress: 620/2083 symbols completed. EQT took 1.2s. Estimated remaining: 9m 17s. Rate: 157.7 symbols/min [2025-10-17T22:38:05.573582] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:05.591191] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1820 records). [2025-10-17T22:38:05.591463] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-17T22:38:05.593529] [INFO ] [MAIN ] Derivative Progress: 621/2083 symbols completed. ERJ took 1.1s. Estimated remaining: 9m 16s. Rate: 157.9 symbols/min [2025-10-17T22:38:05.593831] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:05.611455] [DEBUG] [LOCAL ] ERO: Loaded 42618 existing records from primary storage. [2025-10-17T22:38:05.611838] [INFO ] [MAIN ] ERO: Loaded 42618 primary data records. [2025-10-17T22:38:05.806672] [DEBUG] [LOCAL ] ESAB: Loaded 26444 existing records from primary storage. [2025-10-17T22:38:05.827313] [INFO ] [MAIN ] ESAB: Loaded 26444 primary data records. [2025-10-17T22:38:06.058223] [DEBUG] [LOCAL ] ES: Loaded 53462 existing records from primary storage. [2025-10-17T22:38:06.078480] [INFO ] [MAIN ] ES: Loaded 53462 primary data records. [2025-10-17T22:38:06.642474] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:06.643881] [INFO ] [MAIN ] ERO: Generated 1820 derivative records from 42618 primary records. [2025-10-17T22:38:06.644088] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-17T22:38:06.663767] [DEBUG] [LOCAL ] ERO: Derivative data saved (1820 records). [2025-10-17T22:38:06.664111] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-17T22:38:06.667182] [INFO ] [MAIN ] Derivative Progress: 622/2083 symbols completed. ERO took 1.2s. Estimated remaining: 9m 17s. Rate: 157.4 symbols/min [2025-10-17T22:38:06.669319] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:06.683522] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:06.684279] [INFO ] [MAIN ] ESAB: Generated 1820 derivative records from 26444 primary records. [2025-10-17T22:38:06.684453] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-17T22:38:06.701599] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1820 records). [2025-10-17T22:38:06.706752] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-17T22:38:06.708865] [INFO ] [MAIN ] Derivative Progress: 623/2083 symbols completed. ESAB took 1.1s. Estimated remaining: 9m 16s. Rate: 157.7 symbols/min [2025-10-17T22:38:06.709705] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:06.731133] [DEBUG] [LOCAL ] ESE: Loaded 16777 existing records from primary storage. [2025-10-17T22:38:06.730157] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:06.731944] [INFO ] [MAIN ] ES: Generated 1820 derivative records from 53462 primary records. [2025-10-17T22:38:06.732137] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-17T22:38:06.732583] [INFO ] [MAIN ] ESE: Loaded 16777 primary data records. [2025-10-17T22:38:06.842878] [DEBUG] [LOCAL ] ES: Derivative data saved (1820 records). [2025-10-17T22:38:06.843105] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-17T22:38:06.847985] [INFO ] [MAIN ] Derivative Progress: 624/2083 symbols completed. ES took 1.3s. Estimated remaining: 9m 15s. Rate: 157.8 symbols/min [2025-10-17T22:38:06.848150] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:07.084945] [DEBUG] [LOCAL ] ESI: Loaded 51407 existing records from primary storage. [2025-10-17T22:38:07.085501] [INFO ] [MAIN ] ESI: Loaded 51407 primary data records. [2025-10-17T22:38:07.206433] [DEBUG] [LOCAL ] ESNT: Loaded 38819 existing records from primary storage. [2025-10-17T22:38:07.229156] [INFO ] [MAIN ] ESNT: Loaded 38819 primary data records. [2025-10-17T22:38:07.598949] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:07.623763] [INFO ] [MAIN ] ESE: Generated 1820 derivative records from 16777 primary records. [2025-10-17T22:38:07.641529] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-17T22:38:07.805805] [DEBUG] [LOCAL ] ESE: Derivative data saved (1820 records). [2025-10-17T22:38:07.806701] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-17T22:38:07.808889] [INFO ] [MAIN ] Derivative Progress: 625/2083 symbols completed. ESE took 1.1s. Estimated remaining: 9m 16s. Rate: 157.4 symbols/min [2025-10-17T22:38:07.809430] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:07.832702] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:07.833419] [INFO ] [MAIN ] ESI: Generated 1820 derivative records from 51407 primary records. [2025-10-17T22:38:07.833589] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-17T22:38:07.851324] [DEBUG] [LOCAL ] ESI: Derivative data saved (1820 records). [2025-10-17T22:38:07.851465] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-17T22:38:07.864784] [INFO ] [MAIN ] Derivative Progress: 626/2083 symbols completed. ESI took 1.2s. Estimated remaining: 9m 14s. Rate: 157.7 symbols/min [2025-10-17T22:38:07.865821] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:07.880625] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:07.894101] [INFO ] [MAIN ] ESNT: Generated 1820 derivative records from 38819 primary records. [2025-10-17T22:38:07.894200] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-17T22:38:07.895452] [DEBUG] [LOCAL ] ESRT: Loaded 47197 existing records from primary storage. [2025-10-17T22:38:07.895958] [INFO ] [MAIN ] ESRT: Loaded 47197 primary data records. [2025-10-17T22:38:07.948768] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1820 records). [2025-10-17T22:38:07.966673] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-17T22:38:07.983522] [INFO ] [MAIN ] Derivative Progress: 627/2083 symbols completed. ESNT took 1.1s. Estimated remaining: 9m 14s. Rate: 157.8 symbols/min [2025-10-17T22:38:08.013539] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:08.223169] [DEBUG] [LOCAL ] ESS: Loaded 30619 existing records from primary storage. [2025-10-17T22:38:08.224232] [INFO ] [MAIN ] ESS: Loaded 30619 primary data records. [2025-10-17T22:38:08.568808] [DEBUG] [LOCAL ] ESTC: Loaded 51091 existing records from primary storage. [2025-10-17T22:38:08.569338] [INFO ] [MAIN ] ESTC: Loaded 51091 primary data records. [2025-10-17T22:38:08.872081] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:08.886875] [INFO ] [MAIN ] ESRT: Generated 1820 derivative records from 47197 primary records. [2025-10-17T22:38:08.887077] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-17T22:38:08.905597] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1820 records). [2025-10-17T22:38:08.905950] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-17T22:38:08.908070] [INFO ] [MAIN ] Derivative Progress: 628/2083 symbols completed. ESRT took 1.1s. Estimated remaining: 9m 14s. Rate: 157.5 symbols/min [2025-10-17T22:38:08.926172] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:08.926973] [INFO ] [MAIN ] ESS: Generated 1820 derivative records from 30619 primary records. [2025-10-17T22:38:08.927115] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-17T22:38:08.943973] [DEBUG] [LOCAL ] ESS: Derivative data saved (1820 records). [2025-10-17T22:38:08.944082] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-17T22:38:08.946082] [INFO ] [MAIN ] Derivative Progress: 629/2083 symbols completed. ESS took 1.1s. Estimated remaining: 9m 13s. Rate: 157.7 symbols/min [2025-10-17T22:38:08.961124] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:08.961638] [INFO ] [MAIN ] ESTC: Generated 1820 derivative records from 51091 primary records. [2025-10-17T22:38:08.961721] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-17T22:38:08.976788] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1820 records). [2025-10-17T22:38:08.976848] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-17T22:38:08.978980] [INFO ] [MAIN ] Derivative Progress: 630/2083 symbols completed. ESTC took 1.0s. Estimated remaining: 9m 12s. Rate: 157.9 symbols/min [2025-10-17T22:38:08.979517] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:08.979605] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:08.979460] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:08.995755] [DEBUG] [LOCAL ] ETB: Loaded 12085 existing records from primary storage. [2025-10-17T22:38:08.995884] [INFO ] [MAIN ] ETB: Loaded 12085 primary data records. [2025-10-17T22:38:09.184539] [DEBUG] [LOCAL ] ETD: Loaded 27663 existing records from primary storage. [2025-10-17T22:38:09.204250] [INFO ] [MAIN ] ETD: Loaded 27663 primary data records. [2025-10-17T22:38:09.408511] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-10-17T22:38:09.428401] [INFO ] [MAIN ] ET: Loaded 54569 primary data records. [2025-10-17T22:38:10.000028] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:10.001416] [INFO ] [MAIN ] ETB: Generated 1820 derivative records from 12085 primary records. [2025-10-17T22:38:10.002089] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-17T22:38:10.040384] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:10.049540] [DEBUG] [LOCAL ] ETB: Derivative data saved (1820 records). [2025-10-17T22:38:10.054420] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-17T22:38:10.055749] [INFO ] [MAIN ] ETD: Generated 1820 derivative records from 27663 primary records. [2025-10-17T22:38:10.058408] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-17T22:38:10.058905] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:10.058283] [INFO ] [MAIN ] Derivative Progress: 631/2083 symbols completed. ETB took 1.1s. Estimated remaining: 9m 13s. Rate: 157.5 symbols/min [2025-10-17T22:38:10.060391] [INFO ] [MAIN ] ET: Generated 1820 derivative records from 54569 primary records. [2025-10-17T22:38:10.061561] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-17T22:38:10.061173] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:10.087504] [DEBUG] [LOCAL ] ETD: Derivative data saved (1820 records). [2025-10-17T22:38:10.092183] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-17T22:38:10.095156] [INFO ] [MAIN ] Derivative Progress: 632/2083 symbols completed. ETD took 1.1s. Estimated remaining: 9m 12s. Rate: 157.7 symbols/min [2025-10-17T22:38:10.100008] [DEBUG] [LOCAL ] ET: Derivative data saved (1820 records). [2025-10-17T22:38:10.100358] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:10.100582] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-17T22:38:10.103219] [INFO ] [MAIN ] Derivative Progress: 633/2083 symbols completed. ET took 1.1s. Estimated remaining: 9m 11s. Rate: 157.9 symbols/min [2025-10-17T22:38:10.103534] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:10.117122] [DEBUG] [LOCAL ] ETG: Loaded 16892 existing records from primary storage. [2025-10-17T22:38:10.117244] [INFO ] [MAIN ] ETG: Loaded 16892 primary data records. [2025-10-17T22:38:10.290748] [DEBUG] [LOCAL ] ETJ: Loaded 17031 existing records from primary storage. [2025-10-17T22:38:10.314049] [INFO ] [MAIN ] ETJ: Loaded 17031 primary data records. [2025-10-17T22:38:10.598028] [DEBUG] [LOCAL ] ETN: Loaded 53392 existing records from primary storage. [2025-10-17T22:38:10.622907] [INFO ] [MAIN ] ETN: Loaded 53392 primary data records. [2025-10-17T22:38:11.159067] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:11.161803] [INFO ] [MAIN ] ETG: Generated 1820 derivative records from 16892 primary records. [2025-10-17T22:38:11.162369] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-10-17T22:38:11.184992] [DEBUG] [LOCAL ] ETG: Derivative data saved (1820 records). [2025-10-17T22:38:11.198759] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-10-17T22:38:11.199526] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:11.202573] [INFO ] [MAIN ] Derivative Progress: 634/2083 symbols completed. ETG took 1.1s. Estimated remaining: 9m 12s. Rate: 157.5 symbols/min [2025-10-17T22:38:11.204219] [INFO ] [MAIN ] ETJ: Generated 1820 derivative records from 17031 primary records. [2025-10-17T22:38:11.204502] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-17T22:38:11.203197] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:11.233515] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1820 records). [2025-10-17T22:38:11.234549] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-17T22:38:11.234236] [DEBUG] [LOCAL ] ETO: Loaded 7052 existing records from primary storage. [2025-10-17T22:38:11.250194] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:11.249802] [INFO ] [MAIN ] Derivative Progress: 635/2083 symbols completed. ETJ took 1.1s. Estimated remaining: 9m 11s. Rate: 157.7 symbols/min [2025-10-17T22:38:11.247566] [INFO ] [MAIN ] ETO: Loaded 7052 primary data records. [2025-10-17T22:38:11.256684] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:11.256521] [INFO ] [MAIN ] ETN: Generated 1820 derivative records from 53392 primary records. [2025-10-17T22:38:11.274379] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-17T22:38:11.546856] [DEBUG] [LOCAL ] ETN: Derivative data saved (1820 records). [2025-10-17T22:38:11.587144] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-17T22:38:11.594679] [INFO ] [MAIN ] Derivative Progress: 636/2083 symbols completed. ETN took 1.5s. Estimated remaining: 9m 11s. Rate: 157.7 symbols/min [2025-10-17T22:38:11.605466] [INFO ] [MAIN ] ETSY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:11.627928] [DEBUG] [LOCAL ] ETR: Loaded 53984 existing records from primary storage. [2025-10-17T22:38:11.628908] [INFO ] [MAIN ] ETR: Loaded 53984 primary data records. [2025-10-17T22:38:11.983523] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:11.985362] [INFO ] [MAIN ] ETO: Generated 1820 derivative records from 7052 primary records. [2025-10-17T22:38:11.986787] [DEBUG] [LOCAL ] ETSY: Loaded 54353 existing records from primary storage. [2025-10-17T22:38:11.987392] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-17T22:38:11.987542] [INFO ] [MAIN ] ETSY: Loaded 54353 primary data records. [2025-10-17T22:38:12.099830] [DEBUG] [LOCAL ] ETO: Derivative data saved (1820 records). [2025-10-17T22:38:12.111860] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-17T22:38:12.131721] [INFO ] [MAIN ] Derivative Progress: 637/2083 symbols completed. ETO took 0.9s. Estimated remaining: 9m 10s. Rate: 157.6 symbols/min [2025-10-17T22:38:12.142484] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:12.327407] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:12.328238] [INFO ] [MAIN ] ETR: Generated 1820 derivative records from 53984 primary records. [2025-10-17T22:38:12.328526] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-17T22:38:12.351774] [DEBUG] [LOCAL ] ETR: Derivative data saved (1820 records). [2025-10-17T22:38:12.352194] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-10-17T22:38:12.354902] [INFO ] [MAIN ] Derivative Progress: 638/2083 symbols completed. ETR took 1.1s. Estimated remaining: 9m 10s. Rate: 157.7 symbols/min [2025-10-17T22:38:12.362220] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:12.363081] [DEBUG] [LOCAL ] ETV: Loaded 22515 existing records from primary storage. [2025-10-17T22:38:12.363343] [INFO ] [MAIN ] ETV: Loaded 22515 primary data records. [2025-10-17T22:38:12.681677] [DEBUG] [LOCAL ] ETW: Loaded 25887 existing records from primary storage. [2025-10-17T22:38:12.681946] [INFO ] [MAIN ] ETW: Loaded 25887 primary data records. [2025-10-17T22:38:12.812194] [DEBUG] [MAIN ] ETSY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:12.874134] [INFO ] [MAIN ] ETSY: Generated 1820 derivative records from 54353 primary records. [2025-10-17T22:38:13.047076] [DEBUG] [LOCAL ] ETSY: Saving derivative data. [2025-10-17T22:38:13.071160] [DEBUG] [LOCAL ] ETSY: Derivative data saved (1820 records). [2025-10-17T22:38:13.071412] [INFO ] [MAIN ] ETSY: Successfully saved derivative data. [2025-10-17T22:38:13.073694] [INFO ] [MAIN ] Derivative Progress: 639/2083 symbols completed. ETSY took 1.5s. Estimated remaining: 9m 10s. Rate: 157.5 symbols/min [2025-10-17T22:38:13.074094] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:13.089123] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:13.090035] [INFO ] [MAIN ] ETV: Generated 1820 derivative records from 22515 primary records. [2025-10-17T22:38:13.090257] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-10-17T22:38:13.109260] [DEBUG] [LOCAL ] ETX: Loaded 5300 existing records from primary storage. [2025-10-17T22:38:13.109441] [INFO ] [MAIN ] ETX: Loaded 5300 primary data records. [2025-10-17T22:38:13.200464] [DEBUG] [LOCAL ] ETV: Derivative data saved (1820 records). [2025-10-17T22:38:13.216500] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-10-17T22:38:13.218783] [INFO ] [MAIN ] Derivative Progress: 640/2083 symbols completed. ETV took 1.1s. Estimated remaining: 9m 9s. Rate: 157.6 symbols/min [2025-10-17T22:38:13.231247] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:13.232855] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:13.244813] [INFO ] [MAIN ] ETW: Generated 1820 derivative records from 25887 primary records. [2025-10-17T22:38:13.255370] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-17T22:38:13.451895] [DEBUG] [LOCAL ] ETW: Derivative data saved (1820 records). [2025-10-17T22:38:13.452424] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-17T22:38:13.454858] [INFO ] [MAIN ] Derivative Progress: 641/2083 symbols completed. ETW took 1.1s. Estimated remaining: 9m 9s. Rate: 157.7 symbols/min [2025-10-17T22:38:13.455399] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:13.464031] [DEBUG] [LOCAL ] ETY: Loaded 23210 existing records from primary storage. [2025-10-17T22:38:13.465280] [INFO ] [MAIN ] ETY: Loaded 23210 primary data records. [2025-10-17T22:38:13.583609] [DEBUG] [LOCAL ] EVC: Loaded 18307 existing records from primary storage. [2025-10-17T22:38:13.589499] [INFO ] [MAIN ] EVC: Loaded 18307 primary data records. [2025-10-17T22:38:13.906674] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:13.908426] [INFO ] [MAIN ] ETX: Generated 1820 derivative records from 5300 primary records. [2025-10-17T22:38:13.914101] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-17T22:38:14.007571] [DEBUG] [LOCAL ] ETX: Derivative data saved (1820 records). [2025-10-17T22:38:14.106896] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-10-17T22:38:14.129836] [INFO ] [MAIN ] Derivative Progress: 642/2083 symbols completed. ETX took 1.1s. Estimated remaining: 9m 9s. Rate: 157.5 symbols/min [2025-10-17T22:38:14.130357] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:14.154909] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:14.156017] [INFO ] [MAIN ] ETY: Generated 1820 derivative records from 23210 primary records. [2025-10-17T22:38:14.156292] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-10-17T22:38:14.192463] [DEBUG] [LOCAL ] EVEX: Loaded 33091 existing records from primary storage. [2025-10-17T22:38:14.192016] [DEBUG] [LOCAL ] ETY: Derivative data saved (1820 records). [2025-10-17T22:38:14.192638] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-10-17T22:38:14.195736] [INFO ] [MAIN ] Derivative Progress: 643/2083 symbols completed. ETY took 1.0s. Estimated remaining: 9m 8s. Rate: 157.7 symbols/min [2025-10-17T22:38:14.196001] [INFO ] [MAIN ] EVEX: Loaded 33091 primary data records. [2025-10-17T22:38:14.319037] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:14.336856] [INFO ] [MAIN ] EVC: Generated 1820 derivative records from 18307 primary records. [2025-10-17T22:38:14.360489] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-17T22:38:14.536249] [DEBUG] [LOCAL ] EVC: Derivative data saved (1820 records). [2025-10-17T22:38:14.536399] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-17T22:38:14.538442] [INFO ] [MAIN ] Derivative Progress: 644/2083 symbols completed. EVC took 1.1s. Estimated remaining: 9m 7s. Rate: 157.8 symbols/min [2025-10-17T22:38:14.561105] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:14.561746] [INFO ] [MAIN ] EVEX: Generated 1820 derivative records from 33091 primary records. [2025-10-17T22:38:14.561809] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-17T22:38:14.577109] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1820 records). [2025-10-17T22:38:14.577171] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-17T22:38:14.579431] [INFO ] [MAIN ] Derivative Progress: 645/2083 symbols completed. EVEX took 0.4s. Estimated remaining: 9m 6s. Rate: 158.0 symbols/min [2025-10-17T22:38:14.580238] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:14.580669] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:14.580163] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:14.592221] [DEBUG] [LOCAL ] EVG: Loaded 6021 existing records from primary storage. [2025-10-17T22:38:14.592408] [INFO ] [MAIN ] EVG: Loaded 6021 primary data records. [2025-10-17T22:38:14.633928] [DEBUG] [LOCAL ] EVF: Loaded 9913 existing records from primary storage. [2025-10-17T22:38:14.652793] [INFO ] [MAIN ] EVF: Loaded 9913 primary data records. [2025-10-17T22:38:14.983196] [DEBUG] [LOCAL ] EVH: Loaded 50335 existing records from primary storage. [2025-10-17T22:38:15.247236] [INFO ] [MAIN ] EVH: Loaded 50335 primary data records. [2025-10-17T22:38:15.615828] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:15.617694] [INFO ] [MAIN ] EVF: Generated 1820 derivative records from 9913 primary records. [2025-10-17T22:38:15.618380] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-17T22:38:15.650381] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:15.651819] [INFO ] [MAIN ] EVG: Generated 1820 derivative records from 6021 primary records. [2025-10-17T22:38:15.652338] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-17T22:38:15.659354] [DEBUG] [LOCAL ] EVF: Derivative data saved (1820 records). [2025-10-17T22:38:15.659512] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-17T22:38:15.662910] [INFO ] [MAIN ] Derivative Progress: 646/2083 symbols completed. EVF took 1.1s. Estimated remaining: 9m 7s. Rate: 157.5 symbols/min [2025-10-17T22:38:15.672948] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:15.686634] [DEBUG] [LOCAL ] EVG: Derivative data saved (1820 records). [2025-10-17T22:38:15.687153] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-17T22:38:15.689919] [INFO ] [MAIN ] Derivative Progress: 647/2083 symbols completed. EVG took 1.1s. Estimated remaining: 9m 6s. Rate: 157.8 symbols/min [2025-10-17T22:38:15.690397] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:15.724887] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:15.726251] [INFO ] [MAIN ] EVH: Generated 1820 derivative records from 50335 primary records. [2025-10-17T22:38:15.726783] [DEBUG] [LOCAL ] EVN: Loaded 10887 existing records from primary storage. [2025-10-17T22:38:15.727089] [INFO ] [MAIN ] EVN: Loaded 10887 primary data records. [2025-10-17T22:38:15.726874] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-17T22:38:15.936213] [DEBUG] [LOCAL ] EVH: Derivative data saved (1820 records). [2025-10-17T22:38:15.938029] [DEBUG] [LOCAL ] EVR: Loaded 34821 existing records from primary storage. [2025-10-17T22:38:15.939418] [INFO ] [MAIN ] EVR: Loaded 34821 primary data records. [2025-10-17T22:38:15.938539] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-17T22:38:15.981499] [INFO ] [MAIN ] Derivative Progress: 648/2083 symbols completed. EVH took 1.4s. Estimated remaining: 9m 6s. Rate: 157.8 symbols/min [2025-10-17T22:38:16.034551] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:16.385007] [DEBUG] [LOCAL ] EVT: Loaded 17008 existing records from primary storage. [2025-10-17T22:38:16.417974] [INFO ] [MAIN ] EVT: Loaded 17008 primary data records. [2025-10-17T22:38:16.932621] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:16.934241] [INFO ] [MAIN ] EVN: Generated 1820 derivative records from 10887 primary records. [2025-10-17T22:38:16.934357] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-17T22:38:16.968061] [DEBUG] [LOCAL ] EVN: Derivative data saved (1820 records). [2025-10-17T22:38:16.968888] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:16.969715] [INFO ] [MAIN ] EVR: Generated 1820 derivative records from 34821 primary records. [2025-10-17T22:38:16.968514] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-17T22:38:16.972223] [INFO ] [MAIN ] Derivative Progress: 649/2083 symbols completed. EVN took 1.3s. Estimated remaining: 9m 7s. Rate: 157.4 symbols/min [2025-10-17T22:38:16.970002] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-17T22:38:16.973511] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:16.990982] [DEBUG] [LOCAL ] EVR: Derivative data saved (1820 records). [2025-10-17T22:38:16.991416] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-17T22:38:16.996047] [INFO ] [MAIN ] Derivative Progress: 650/2083 symbols completed. EVR took 1.3s. Estimated remaining: 9m 5s. Rate: 157.7 symbols/min [2025-10-17T22:38:16.996514] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:17.009866] [DEBUG] [MAIN ] EVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:17.010547] [INFO ] [MAIN ] EVT: Generated 1820 derivative records from 17008 primary records. [2025-10-17T22:38:17.010859] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-17T22:38:17.033801] [DEBUG] [LOCAL ] EVT: Derivative data saved (1820 records). [2025-10-17T22:38:17.033921] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-17T22:38:17.036001] [INFO ] [MAIN ] Derivative Progress: 651/2083 symbols completed. EVT took 1.0s. Estimated remaining: 9m 4s. Rate: 157.9 symbols/min [2025-10-17T22:38:17.043991] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:17.045623] [DEBUG] [LOCAL ] EVTC: Loaded 27241 existing records from primary storage. [2025-10-17T22:38:17.046045] [INFO ] [MAIN ] EVTC: Loaded 27241 primary data records. [2025-10-17T22:38:17.400535] [DEBUG] [LOCAL ] EVTL: Loaded 41058 existing records from primary storage. [2025-10-17T22:38:17.400727] [INFO ] [MAIN ] EVTL: Loaded 41058 primary data records. [2025-10-17T22:38:17.481295] [DEBUG] [LOCAL ] EVTR: Loaded 25284 existing records from primary storage. [2025-10-17T22:38:17.493199] [INFO ] [MAIN ] EVTR: Loaded 25284 primary data records. [2025-10-17T22:38:18.060839] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:18.062464] [INFO ] [MAIN ] EVTC: Generated 1820 derivative records from 27241 primary records. [2025-10-17T22:38:18.062826] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-17T22:38:18.081014] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1820 records). [2025-10-17T22:38:18.081358] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-17T22:38:18.083801] [INFO ] [MAIN ] Derivative Progress: 652/2083 symbols completed. EVTC took 1.1s. Estimated remaining: 9m 5s. Rate: 157.5 symbols/min [2025-10-17T22:38:18.084227] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:18.102172] [DEBUG] [MAIN ] EVTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:18.102954] [INFO ] [MAIN ] EVTL: Generated 1820 derivative records from 41058 primary records. [2025-10-17T22:38:18.103122] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-17T22:38:18.121438] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1820 records). [2025-10-17T22:38:18.121711] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-17T22:38:18.123790] [INFO ] [MAIN ] Derivative Progress: 653/2083 symbols completed. EVTL took 1.1s. Estimated remaining: 9m 4s. Rate: 157.7 symbols/min [2025-10-17T22:38:18.124061] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:18.138966] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:18.139709] [INFO ] [MAIN ] EVTR: Generated 1820 derivative records from 25284 primary records. [2025-10-17T22:38:18.139774] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-17T22:38:18.157210] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1820 records). [2025-10-17T22:38:18.157630] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-17T22:38:18.159764] [INFO ] [MAIN ] Derivative Progress: 654/2083 symbols completed. EVTR took 1.1s. Estimated remaining: 9m 3s. Rate: 157.9 symbols/min [2025-10-17T22:38:18.160000] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:18.195308] [DEBUG] [LOCAL ] EXG: Loaded 34518 existing records from primary storage. [2025-10-17T22:38:18.195446] [INFO ] [MAIN ] EXG: Loaded 34518 primary data records. [2025-10-17T22:38:18.311318] [DEBUG] [LOCAL ] EW: Loaded 54179 existing records from primary storage. [2025-10-17T22:38:18.311556] [INFO ] [MAIN ] EW: Loaded 54179 primary data records. [2025-10-17T22:38:18.696675] [DEBUG] [LOCAL ] EXK: Loaded 53951 existing records from primary storage. [2025-10-17T22:38:18.707931] [INFO ] [MAIN ] EXK: Loaded 53951 primary data records. [2025-10-17T22:38:19.224437] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:19.226014] [INFO ] [MAIN ] EXG: Generated 1820 derivative records from 34518 primary records. [2025-10-17T22:38:19.226134] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-17T22:38:19.244367] [DEBUG] [LOCAL ] EXG: Derivative data saved (1820 records). [2025-10-17T22:38:19.244791] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-17T22:38:19.248065] [INFO ] [MAIN ] Derivative Progress: 655/2083 symbols completed. EXG took 1.1s. Estimated remaining: 9m 4s. Rate: 157.4 symbols/min [2025-10-17T22:38:19.261203] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:19.261080] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:19.262002] [INFO ] [MAIN ] EW: Generated 1820 derivative records from 54179 primary records. [2025-10-17T22:38:19.262075] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-17T22:38:19.280248] [DEBUG] [LOCAL ] EW: Derivative data saved (1820 records). [2025-10-17T22:38:19.280362] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-17T22:38:19.282502] [INFO ] [MAIN ] Derivative Progress: 656/2083 symbols completed. EW took 1.2s. Estimated remaining: 9m 3s. Rate: 157.7 symbols/min [2025-10-17T22:38:19.282824] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:19.314037] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:19.314821] [INFO ] [MAIN ] EXK: Generated 1820 derivative records from 53951 primary records. [2025-10-17T22:38:19.314952] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-17T22:38:19.340978] [DEBUG] [LOCAL ] EXK: Derivative data saved (1820 records). [2025-10-17T22:38:19.341709] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-17T22:38:19.341483] [DEBUG] [LOCAL ] EXP: Loaded 29985 existing records from primary storage. [2025-10-17T22:38:19.344822] [INFO ] [MAIN ] Derivative Progress: 657/2083 symbols completed. EXK took 1.2s. Estimated remaining: 9m 2s. Rate: 157.9 symbols/min [2025-10-17T22:38:19.345242] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:19.345129] [INFO ] [MAIN ] EXP: Loaded 29985 primary data records. [2025-10-17T22:38:19.671044] [DEBUG] [LOCAL ] EXPD: Loaded 48595 existing records from primary storage. [2025-10-17T22:38:19.671399] [INFO ] [MAIN ] EXPD: Loaded 48595 primary data records. [2025-10-17T22:38:19.844892] [DEBUG] [LOCAL ] EXR: Loaded 46249 existing records from primary storage. [2025-10-17T22:38:19.845154] [INFO ] [MAIN ] EXR: Loaded 46249 primary data records. [2025-10-17T22:38:20.358740] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:20.360672] [INFO ] [MAIN ] EXP: Generated 1820 derivative records from 29985 primary records. [2025-10-17T22:38:20.360954] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-17T22:38:20.381090] [DEBUG] [LOCAL ] EXP: Derivative data saved (1820 records). [2025-10-17T22:38:20.381612] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-17T22:38:20.385026] [INFO ] [MAIN ] Derivative Progress: 658/2083 symbols completed. EXP took 1.1s. Estimated remaining: 9m 3s. Rate: 157.4 symbols/min [2025-10-17T22:38:20.398249] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:20.399137] [INFO ] [MAIN ] EXPD: Generated 1820 derivative records from 48595 primary records. [2025-10-17T22:38:20.399279] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-17T22:38:20.415798] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1820 records). [2025-10-17T22:38:20.417948] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-17T22:38:20.420208] [INFO ] [MAIN ] Derivative Progress: 659/2083 symbols completed. EXPD took 1.1s. Estimated remaining: 9m 2s. Rate: 157.7 symbols/min [2025-10-17T22:38:20.433395] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:20.433988] [INFO ] [MAIN ] EXR: Generated 1820 derivative records from 46249 primary records. [2025-10-17T22:38:20.434047] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-17T22:38:20.449446] [DEBUG] [LOCAL ] EXR: Derivative data saved (1820 records). [2025-10-17T22:38:20.449510] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-17T22:38:20.452085] [INFO ] [MAIN ] Derivative Progress: 660/2083 symbols completed. EXR took 1.1s. Estimated remaining: 9m 1s. Rate: 157.9 symbols/min [2025-10-17T22:38:20.452755] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:20.452683] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:20.452926] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:20.528488] [DEBUG] [LOCAL ] FBIN: Loaded 51068 existing records from primary storage. [2025-10-17T22:38:20.528855] [INFO ] [MAIN ] FBIN: Loaded 51068 primary data records. [2025-10-17T22:38:20.655916] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-10-17T22:38:20.659951] [DEBUG] [LOCAL ] FAF: Loaded 42095 existing records from primary storage. [2025-10-17T22:38:20.660178] [INFO ] [MAIN ] F: Loaded 54600 primary data records. [2025-10-17T22:38:20.660276] [INFO ] [MAIN ] FAF: Loaded 42095 primary data records. [2025-10-17T22:38:21.522711] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:21.524499] [INFO ] [MAIN ] FBIN: Generated 1820 derivative records from 51068 primary records. [2025-10-17T22:38:21.524599] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-17T22:38:21.541574] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1820 records). [2025-10-17T22:38:21.541773] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-10-17T22:38:21.544400] [INFO ] [MAIN ] Derivative Progress: 661/2083 symbols completed. FBIN took 1.1s. Estimated remaining: 9m 2s. Rate: 157.4 symbols/min [2025-10-17T22:38:21.544756] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:21.562274] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:21.563902] [INFO ] [MAIN ] F: Generated 1820 derivative records from 54600 primary records. [2025-10-17T22:38:21.564102] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-17T22:38:21.601544] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:21.601285] [DEBUG] [LOCAL ] F: Derivative data saved (1820 records). [2025-10-17T22:38:21.601730] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-17T22:38:21.603793] [INFO ] [MAIN ] Derivative Progress: 662/2083 symbols completed. F took 1.2s. Estimated remaining: 9m 1s. Rate: 157.6 symbols/min [2025-10-17T22:38:21.604831] [INFO ] [MAIN ] FAF: Generated 1820 derivative records from 42095 primary records. [2025-10-17T22:38:21.603957] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:21.605083] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-17T22:38:21.628820] [DEBUG] [LOCAL ] FBK: Loaded 27962 existing records from primary storage. [2025-10-17T22:38:21.629503] [INFO ] [MAIN ] FBK: Loaded 27962 primary data records. [2025-10-17T22:38:21.642107] [DEBUG] [LOCAL ] FAF: Derivative data saved (1820 records). [2025-10-17T22:38:21.673363] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-17T22:38:21.707970] [INFO ] [MAIN ] Derivative Progress: 663/2083 symbols completed. FAF took 1.3s. Estimated remaining: 8m 60s. Rate: 157.8 symbols/min [2025-10-17T22:38:21.724292] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:21.963005] [DEBUG] [LOCAL ] FBP: Loaded 46466 existing records from primary storage. [2025-10-17T22:38:21.963303] [INFO ] [MAIN ] FBP: Loaded 46466 primary data records. [2025-10-17T22:38:22.119740] [DEBUG] [LOCAL ] FBRT: Loaded 35936 existing records from primary storage. [2025-10-17T22:38:22.141456] [INFO ] [MAIN ] FBRT: Loaded 35936 primary data records. [2025-10-17T22:38:22.620553] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:22.622480] [INFO ] [MAIN ] FBK: Generated 1820 derivative records from 27962 primary records. [2025-10-17T22:38:22.622766] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-17T22:38:22.644640] [DEBUG] [LOCAL ] FBK: Derivative data saved (1820 records). [2025-10-17T22:38:22.646408] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-17T22:38:22.648780] [INFO ] [MAIN ] Derivative Progress: 664/2083 symbols completed. FBK took 1.1s. Estimated remaining: 9m 1s. Rate: 157.5 symbols/min [2025-10-17T22:38:22.649478] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:22.664223] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:22.665228] [INFO ] [MAIN ] FBP: Generated 1820 derivative records from 46466 primary records. [2025-10-17T22:38:22.665441] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-17T22:38:22.683936] [DEBUG] [LOCAL ] FBP: Derivative data saved (1820 records). [2025-10-17T22:38:22.687849] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-17T22:38:22.691360] [INFO ] [MAIN ] Derivative Progress: 665/2083 symbols completed. FBP took 1.1s. Estimated remaining: 8m 60s. Rate: 157.7 symbols/min [2025-10-17T22:38:22.691849] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:22.706076] [DEBUG] [MAIN ] FBRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:22.706827] [INFO ] [MAIN ] FBRT: Generated 1820 derivative records from 35936 primary records. [2025-10-17T22:38:22.712208] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-17T22:38:22.713326] [DEBUG] [LOCAL ] FC: Loaded 15052 existing records from primary storage. [2025-10-17T22:38:22.713433] [INFO ] [MAIN ] FC: Loaded 15052 primary data records. [2025-10-17T22:38:22.775969] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1820 records). [2025-10-17T22:38:22.782696] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-10-17T22:38:22.785776] [INFO ] [MAIN ] Derivative Progress: 666/2083 symbols completed. FBRT took 1.1s. Estimated remaining: 8m 59s. Rate: 157.8 symbols/min [2025-10-17T22:38:22.801130] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:23.095841] [DEBUG] [LOCAL ] FCF: Loaded 39969 existing records from primary storage. [2025-10-17T22:38:23.096053] [INFO ] [MAIN ] FCF: Loaded 39969 primary data records. [2025-10-17T22:38:23.096428] [DEBUG] [LOCAL ] FCN: Loaded 26402 existing records from primary storage. [2025-10-17T22:38:23.101826] [INFO ] [MAIN ] FCN: Loaded 26402 primary data records. [2025-10-17T22:38:23.760924] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:23.763363] [INFO ] [MAIN ] FC: Generated 1820 derivative records from 15052 primary records. [2025-10-17T22:38:23.763597] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-17T22:38:23.784200] [DEBUG] [LOCAL ] FC: Derivative data saved (1820 records). [2025-10-17T22:38:23.786401] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-10-17T22:38:23.789299] [INFO ] [MAIN ] Derivative Progress: 667/2083 symbols completed. FC took 1.1s. Estimated remaining: 8m 60s. Rate: 157.5 symbols/min [2025-10-17T22:38:23.789699] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:23.805594] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:23.806696] [INFO ] [MAIN ] FCN: Generated 1820 derivative records from 26402 primary records. [2025-10-17T22:38:23.806978] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-17T22:38:23.828439] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:23.833544] [INFO ] [MAIN ] FCF: Generated 1820 derivative records from 39969 primary records. [2025-10-17T22:38:23.836052] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-10-17T22:38:23.853103] [DEBUG] [LOCAL ] FCN: Derivative data saved (1820 records). [2025-10-17T22:38:23.855003] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-17T22:38:23.857477] [INFO ] [MAIN ] Derivative Progress: 668/2083 symbols completed. FCN took 1.1s. Estimated remaining: 8m 59s. Rate: 157.7 symbols/min [2025-10-17T22:38:23.858171] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:23.860521] [DEBUG] [LOCAL ] FCF: Derivative data saved (1820 records). [2025-10-17T22:38:23.860600] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-10-17T22:38:23.863558] [INFO ] [MAIN ] Derivative Progress: 669/2083 symbols completed. FCF took 1.2s. Estimated remaining: 8m 57s. Rate: 157.9 symbols/min [2025-10-17T22:38:23.864014] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:23.886822] [DEBUG] [LOCAL ] FCT: Loaded 14906 existing records from primary storage. [2025-10-17T22:38:23.886958] [INFO ] [MAIN ] FCT: Loaded 14906 primary data records. [2025-10-17T22:38:23.989406] [DEBUG] [LOCAL ] FCPT: Loaded 37885 existing records from primary storage. [2025-10-17T22:38:24.007484] [INFO ] [MAIN ] FCPT: Loaded 37885 primary data records. [2025-10-17T22:38:24.395442] [DEBUG] [LOCAL ] FCX: Loaded 54481 existing records from primary storage. [2025-10-17T22:38:24.422360] [INFO ] [MAIN ] FCX: Loaded 54481 primary data records. [2025-10-17T22:38:24.926474] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:24.927809] [INFO ] [MAIN ] FCT: Generated 1820 derivative records from 14906 primary records. [2025-10-17T22:38:24.927920] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-17T22:38:24.946561] [DEBUG] [LOCAL ] FCT: Derivative data saved (1820 records). [2025-10-17T22:38:24.946787] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-17T22:38:24.949661] [INFO ] [MAIN ] Derivative Progress: 670/2083 symbols completed. FCT took 1.1s. Estimated remaining: 8m 58s. Rate: 157.4 symbols/min [2025-10-17T22:38:24.950769] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:24.965617] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:24.966465] [INFO ] [MAIN ] FCPT: Generated 1820 derivative records from 37885 primary records. [2025-10-17T22:38:24.966683] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-17T22:38:24.987227] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1820 records). [2025-10-17T22:38:24.987491] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-17T22:38:24.989713] [INFO ] [MAIN ] Derivative Progress: 671/2083 symbols completed. FCPT took 1.2s. Estimated remaining: 8m 57s. Rate: 157.7 symbols/min [2025-10-17T22:38:24.990334] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:25.016696] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:25.017771] [INFO ] [MAIN ] FCX: Generated 1820 derivative records from 54481 primary records. [2025-10-17T22:38:25.017986] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-17T22:38:25.046339] [DEBUG] [LOCAL ] FCX: Derivative data saved (1820 records). [2025-10-17T22:38:25.046475] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-17T22:38:25.048561] [INFO ] [MAIN ] Derivative Progress: 672/2083 symbols completed. FCX took 1.2s. Estimated remaining: 8m 56s. Rate: 157.9 symbols/min [2025-10-17T22:38:25.049599] [DEBUG] [LOCAL ] FDP: Loaded 30199 existing records from primary storage. [2025-10-17T22:38:25.055965] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:25.056066] [INFO ] [MAIN ] FDP: Loaded 30199 primary data records. [2025-10-17T22:38:25.177263] [DEBUG] [LOCAL ] FDS: Loaded 28183 existing records from primary storage. [2025-10-17T22:38:25.183498] [INFO ] [MAIN ] FDS: Loaded 28183 primary data records. [2025-10-17T22:38:25.730338] [DEBUG] [LOCAL ] FDX: Loaded 52099 existing records from primary storage. [2025-10-17T22:38:25.731678] [INFO ] [MAIN ] FDX: Loaded 52099 primary data records. [2025-10-17T22:38:26.071941] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:26.073458] [INFO ] [MAIN ] FDP: Generated 1820 derivative records from 30199 primary records. [2025-10-17T22:38:26.073565] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-17T22:38:26.094231] [DEBUG] [LOCAL ] FDP: Derivative data saved (1820 records). [2025-10-17T22:38:26.094487] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-17T22:38:26.108057] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:26.111380] [INFO ] [MAIN ] FDS: Generated 1820 derivative records from 28183 primary records. [2025-10-17T22:38:26.111488] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-17T22:38:26.110585] [INFO ] [MAIN ] Derivative Progress: 673/2083 symbols completed. FDP took 1.2s. Estimated remaining: 8m 57s. Rate: 157.4 symbols/min [2025-10-17T22:38:26.129899] [DEBUG] [LOCAL ] FDS: Derivative data saved (1820 records). [2025-10-17T22:38:26.130134] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-17T22:38:26.132431] [INFO ] [MAIN ] Derivative Progress: 674/2083 symbols completed. FDS took 1.1s. Estimated remaining: 8m 56s. Rate: 157.7 symbols/min [2025-10-17T22:38:26.150011] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:26.150635] [INFO ] [MAIN ] FDX: Generated 1820 derivative records from 52099 primary records. [2025-10-17T22:38:26.150741] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-17T22:38:26.166224] [DEBUG] [LOCAL ] FDX: Derivative data saved (1820 records). [2025-10-17T22:38:26.166281] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-17T22:38:26.168241] [INFO ] [MAIN ] Derivative Progress: 675/2083 symbols completed. FDX took 1.1s. Estimated remaining: 8m 55s. Rate: 157.9 symbols/min [2025-10-17T22:38:26.169128] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:26.168900] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:26.169030] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:26.188315] [DEBUG] [LOCAL ] FET: Loaded 13043 existing records from primary storage. [2025-10-17T22:38:26.188597] [INFO ] [MAIN ] FET: Loaded 13043 primary data records. [2025-10-17T22:38:26.567631] [DEBUG] [LOCAL ] FE: Loaded 54212 existing records from primary storage. [2025-10-17T22:38:26.566782] [DEBUG] [LOCAL ] FERG: Loaded 49492 existing records from primary storage. [2025-10-17T22:38:26.567982] [INFO ] [MAIN ] FE: Loaded 54212 primary data records. [2025-10-17T22:38:26.568045] [INFO ] [MAIN ] FERG: Loaded 49492 primary data records. [2025-10-17T22:38:27.260050] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:27.261239] [INFO ] [MAIN ] FET: Generated 1820 derivative records from 13043 primary records. [2025-10-17T22:38:27.261788] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-17T22:38:27.278763] [DEBUG] [LOCAL ] FET: Derivative data saved (1820 records). [2025-10-17T22:38:27.279112] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-17T22:38:27.281500] [INFO ] [MAIN ] Derivative Progress: 676/2083 symbols completed. FET took 1.1s. Estimated remaining: 8m 56s. Rate: 157.4 symbols/min [2025-10-17T22:38:27.282898] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:27.300851] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:27.302754] [INFO ] [MAIN ] FE: Generated 1820 derivative records from 54212 primary records. [2025-10-17T22:38:27.303089] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-17T22:38:27.316999] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:27.325572] [INFO ] [MAIN ] FERG: Generated 1820 derivative records from 49492 primary records. [2025-10-17T22:38:27.326705] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-17T22:38:27.351276] [DEBUG] [LOCAL ] FE: Derivative data saved (1820 records). [2025-10-17T22:38:27.356447] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-17T22:38:27.358616] [INFO ] [MAIN ] Derivative Progress: 677/2083 symbols completed. FE took 1.2s. Estimated remaining: 8m 55s. Rate: 157.6 symbols/min [2025-10-17T22:38:27.359829] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:27.364145] [DEBUG] [LOCAL ] FERG: Derivative data saved (1820 records). [2025-10-17T22:38:27.372224] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-17T22:38:27.375737] [DEBUG] [LOCAL ] FF: Loaded 24686 existing records from primary storage. [2025-10-17T22:38:27.375882] [INFO ] [MAIN ] FF: Loaded 24686 primary data records. [2025-10-17T22:38:27.374906] [INFO ] [MAIN ] Derivative Progress: 678/2083 symbols completed. FERG took 1.2s. Estimated remaining: 8m 54s. Rate: 157.8 symbols/min [2025-10-17T22:38:27.377203] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:27.445419] [DEBUG] [LOCAL ] FFA: Loaded 5984 existing records from primary storage. [2025-10-17T22:38:27.471432] [INFO ] [MAIN ] FFA: Loaded 5984 primary data records. [2025-10-17T22:38:27.532458] [DEBUG] [LOCAL ] FFC: Loaded 16896 existing records from primary storage. [2025-10-17T22:38:27.599414] [INFO ] [MAIN ] FFC: Loaded 16896 primary data records. [2025-10-17T22:38:28.359735] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:28.362178] [INFO ] [MAIN ] FF: Generated 1820 derivative records from 24686 primary records. [2025-10-17T22:38:28.370294] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-17T22:38:28.390529] [DEBUG] [MAIN ] FFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:28.391541] [INFO ] [MAIN ] FFA: Generated 1820 derivative records from 5984 primary records. [2025-10-17T22:38:28.395218] [DEBUG] [LOCAL ] FF: Derivative data saved (1820 records). [2025-10-17T22:38:28.395799] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-17T22:38:28.393843] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-17T22:38:28.399375] [INFO ] [MAIN ] Derivative Progress: 679/2083 symbols completed. FF took 1.1s. Estimated remaining: 8m 55s. Rate: 157.4 symbols/min [2025-10-17T22:38:28.399908] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:28.417723] [DEBUG] [LOCAL ] FFA: Derivative data saved (1820 records). [2025-10-17T22:38:28.418057] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-17T22:38:28.420380] [INFO ] [MAIN ] Derivative Progress: 680/2083 symbols completed. FFA took 1.1s. Estimated remaining: 8m 54s. Rate: 157.7 symbols/min [2025-10-17T22:38:28.420719] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:28.439429] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:28.449138] [INFO ] [MAIN ] FFC: Generated 1820 derivative records from 16896 primary records. [2025-10-17T22:38:28.449251] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-17T22:38:28.480982] [DEBUG] [LOCAL ] FFC: Derivative data saved (1820 records). [2025-10-17T22:38:28.481174] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-17T22:38:28.483516] [INFO ] [MAIN ] Derivative Progress: 681/2083 symbols completed. FFC took 1.1s. Estimated remaining: 8m 53s. Rate: 157.8 symbols/min [2025-10-17T22:38:28.484212] [DEBUG] [LOCAL ] FFWM: Loaded 36515 existing records from primary storage. [2025-10-17T22:38:28.484666] [INFO ] [MAIN ] FFWM: Loaded 36515 primary data records. [2025-10-17T22:38:28.484437] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:28.524046] [DEBUG] [LOCAL ] FG: Loaded 22484 existing records from primary storage. [2025-10-17T22:38:28.548113] [INFO ] [MAIN ] FG: Loaded 22484 primary data records. [2025-10-17T22:38:28.593686] [DEBUG] [LOCAL ] FGN: Loaded 3750 existing records from primary storage. [2025-10-17T22:38:28.642621] [INFO ] [MAIN ] FGN: Loaded 3750 primary data records. [2025-10-17T22:38:29.491239] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:29.492342] [INFO ] [MAIN ] FFWM: Generated 1820 derivative records from 36515 primary records. [2025-10-17T22:38:29.492454] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-17T22:38:29.511379] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1820 records). [2025-10-17T22:38:29.512485] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-17T22:38:29.514704] [INFO ] [MAIN ] Derivative Progress: 682/2083 symbols completed. FFWM took 1.1s. Estimated remaining: 8m 54s. Rate: 157.5 symbols/min [2025-10-17T22:38:29.514888] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:29.529555] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:29.537912] [INFO ] [MAIN ] FG: Generated 1820 derivative records from 22484 primary records. [2025-10-17T22:38:29.542595] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-17T22:38:29.543274] [DEBUG] [MAIN ] FGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:29.544245] [INFO ] [MAIN ] FGN: Generated 1820 derivative records from 3750 primary records. [2025-10-17T22:38:29.544395] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-17T22:38:29.571391] [DEBUG] [LOCAL ] FG: Derivative data saved (1820 records). [2025-10-17T22:38:29.574250] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-17T22:38:29.580712] [INFO ] [MAIN ] Derivative Progress: 683/2083 symbols completed. FG took 1.2s. Estimated remaining: 8m 53s. Rate: 157.6 symbols/min [2025-10-17T22:38:29.577913] [DEBUG] [LOCAL ] FGN: Derivative data saved (1820 records). [2025-10-17T22:38:29.580883] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:29.581121] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-10-17T22:38:29.583804] [INFO ] [MAIN ] Derivative Progress: 684/2083 symbols completed. FGN took 1.1s. Estimated remaining: 8m 52s. Rate: 157.9 symbols/min [2025-10-17T22:38:29.584231] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:29.615482] [DEBUG] [LOCAL ] FHI: Loaded 40432 existing records from primary storage. [2025-10-17T22:38:29.615778] [INFO ] [MAIN ] FHI: Loaded 40432 primary data records. [2025-10-17T22:38:29.970813] [DEBUG] [LOCAL ] FHN: Loaded 54172 existing records from primary storage. [2025-10-17T22:38:29.971499] [INFO ] [MAIN ] FHN: Loaded 54172 primary data records. [2025-10-17T22:38:29.972965] [DEBUG] [LOCAL ] FI: Loaded 54357 existing records from primary storage. [2025-10-17T22:38:29.985363] [INFO ] [MAIN ] FI: Loaded 54357 primary data records. [2025-10-17T22:38:30.609194] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:30.610191] [INFO ] [MAIN ] FHI: Generated 1820 derivative records from 40432 primary records. [2025-10-17T22:38:30.610437] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-17T22:38:30.629796] [DEBUG] [LOCAL ] FHI: Derivative data saved (1820 records). [2025-10-17T22:38:30.629922] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-17T22:38:30.632591] [INFO ] [MAIN ] Derivative Progress: 685/2083 symbols completed. FHI took 1.1s. Estimated remaining: 8m 53s. Rate: 157.5 symbols/min [2025-10-17T22:38:30.633175] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:30.660112] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:30.673392] [INFO ] [MAIN ] FI: Generated 1820 derivative records from 54357 primary records. [2025-10-17T22:38:30.673555] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-17T22:38:30.674616] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:30.682605] [INFO ] [MAIN ] FHN: Generated 1820 derivative records from 54172 primary records. [2025-10-17T22:38:30.686322] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-17T22:38:30.695679] [DEBUG] [LOCAL ] FICO: Loaded 22042 existing records from primary storage. [2025-10-17T22:38:30.696332] [INFO ] [MAIN ] FICO: Loaded 22042 primary data records. [2025-10-17T22:38:30.777043] [DEBUG] [LOCAL ] FI: Derivative data saved (1820 records). [2025-10-17T22:38:30.777383] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-17T22:38:30.783813] [DEBUG] [LOCAL ] FHN: Derivative data saved (1820 records). [2025-10-17T22:38:30.793767] [INFO ] [MAIN ] Derivative Progress: 686/2083 symbols completed. FI took 1.2s. Estimated remaining: 8m 52s. Rate: 157.6 symbols/min [2025-10-17T22:38:30.798992] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-17T22:38:30.820745] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:30.823453] [INFO ] [MAIN ] Derivative Progress: 687/2083 symbols completed. FHN took 1.2s. Estimated remaining: 8m 51s. Rate: 157.8 symbols/min [2025-10-17T22:38:30.824089] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:31.073057] [DEBUG] [LOCAL ] FIGS: Loaded 49320 existing records from primary storage. [2025-10-17T22:38:31.074270] [INFO ] [MAIN ] FIGS: Loaded 49320 primary data records. [2025-10-17T22:38:31.086377] [DEBUG] [LOCAL ] FIHL: Loaded 39982 existing records from primary storage. [2025-10-17T22:38:31.086604] [INFO ] [MAIN ] FIHL: Loaded 39982 primary data records. [2025-10-17T22:38:31.372359] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:38:31.418062] [INFO ] [MAIN ] FICO: Generated 1819 derivative records from 22042 primary records. [2025-10-17T22:38:31.541117] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-17T22:38:31.803010] [DEBUG] [LOCAL ] FICO: Derivative data saved (1819 records). [2025-10-17T22:38:31.803161] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-17T22:38:31.807603] [INFO ] [MAIN ] Derivative Progress: 688/2083 symbols completed. FICO took 1.2s. Estimated remaining: 8m 52s. Rate: 157.4 symbols/min [2025-10-17T22:38:31.829745] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:31.843240] [INFO ] [MAIN ] FIGS: Generated 1820 derivative records from 49320 primary records. [2025-10-17T22:38:31.843333] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-17T22:38:31.842298] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:31.843940] [INFO ] [MAIN ] FIHL: Generated 1820 derivative records from 39982 primary records. [2025-10-17T22:38:31.844714] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-17T22:38:31.878393] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1820 records). [2025-10-17T22:38:31.879814] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1820 records). [2025-10-17T22:38:31.879951] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-17T22:38:31.880413] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-17T22:38:31.883080] [INFO ] [MAIN ] Derivative Progress: 689/2083 symbols completed. FIHL took 1.1s. Estimated remaining: 8m 51s. Rate: 157.6 symbols/min [2025-10-17T22:38:31.888417] [INFO ] [MAIN ] Derivative Progress: 690/2083 symbols completed. FIGS took 1.1s. Estimated remaining: 8m 49s. Rate: 157.9 symbols/min [2025-10-17T22:38:31.889296] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:31.889204] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:31.889504] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:31.904592] [DEBUG] [LOCAL ] FINS: Loaded 8404 existing records from primary storage. [2025-10-17T22:38:31.904932] [INFO ] [MAIN ] FINS: Loaded 8404 primary data records. [2025-10-17T22:38:32.257014] [DEBUG] [LOCAL ] FINV: Loaded 45943 existing records from primary storage. [2025-10-17T22:38:32.257345] [INFO ] [MAIN ] FINV: Loaded 45943 primary data records. [2025-10-17T22:38:32.269944] [DEBUG] [LOCAL ] FIS: Loaded 54114 existing records from primary storage. [2025-10-17T22:38:32.289808] [INFO ] [MAIN ] FIS: Loaded 54114 primary data records. [2025-10-17T22:38:32.894301] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:32.896547] [INFO ] [MAIN ] FINS: Generated 1820 derivative records from 8404 primary records. [2025-10-17T22:38:32.897290] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-17T22:38:32.917342] [DEBUG] [LOCAL ] FINS: Derivative data saved (1820 records). [2025-10-17T22:38:32.917567] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-17T22:38:32.920208] [INFO ] [MAIN ] Derivative Progress: 691/2083 symbols completed. FINS took 1.0s. Estimated remaining: 8m 50s. Rate: 157.5 symbols/min [2025-10-17T22:38:32.920570] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:32.939123] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:32.939918] [INFO ] [MAIN ] FINV: Generated 1820 derivative records from 45943 primary records. [2025-10-17T22:38:32.940056] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-17T22:38:32.958993] [DEBUG] [LOCAL ] FINV: Derivative data saved (1820 records). [2025-10-17T22:38:32.959187] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-17T22:38:32.981050] [INFO ] [MAIN ] Derivative Progress: 692/2083 symbols completed. FINV took 1.1s. Estimated remaining: 8m 49s. Rate: 157.7 symbols/min [2025-10-17T22:38:32.981403] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:32.982128] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:32.982782] [INFO ] [MAIN ] FIS: Generated 1820 derivative records from 54114 primary records. [2025-10-17T22:38:32.982905] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-17T22:38:33.009437] [DEBUG] [LOCAL ] FIS: Derivative data saved (1820 records). [2025-10-17T22:38:33.013120] [DEBUG] [LOCAL ] FLC: Loaded 5454 existing records from primary storage. [2025-10-17T22:38:33.012875] [DEBUG] [LOCAL ] FIX: Loaded 29256 existing records from primary storage. [2025-10-17T22:38:33.013181] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-17T22:38:33.013410] [INFO ] [MAIN ] FLC: Loaded 5454 primary data records. [2025-10-17T22:38:33.015550] [INFO ] [MAIN ] Derivative Progress: 693/2083 symbols completed. FIS took 1.1s. Estimated remaining: 8m 48s. Rate: 157.9 symbols/min [2025-10-17T22:38:33.015623] [INFO ] [MAIN ] FIX: Loaded 29256 primary data records. [2025-10-17T22:38:33.015852] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:33.689845] [DEBUG] [LOCAL ] FLG: Loaded 54107 existing records from primary storage. [2025-10-17T22:38:33.690579] [INFO ] [MAIN ] FLG: Loaded 54107 primary data records. [2025-10-17T22:38:34.012139] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:34.025573] [INFO ] [MAIN ] FLC: Generated 1820 derivative records from 5454 primary records. [2025-10-17T22:38:34.025975] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:34.026811] [INFO ] [MAIN ] FIX: Generated 1820 derivative records from 29256 primary records. [2025-10-17T22:38:34.026932] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-17T22:38:34.026119] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-17T22:38:34.056087] [DEBUG] [LOCAL ] FIX: Derivative data saved (1820 records). [2025-10-17T22:38:34.056337] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-17T22:38:34.058678] [INFO ] [MAIN ] Derivative Progress: 694/2083 symbols completed. FIX took 1.1s. Estimated remaining: 8m 49s. Rate: 157.5 symbols/min [2025-10-17T22:38:34.059616] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:34.064186] [DEBUG] [LOCAL ] FLC: Derivative data saved (1820 records). [2025-10-17T22:38:34.064390] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-17T22:38:34.066842] [INFO ] [MAIN ] Derivative Progress: 695/2083 symbols completed. FLC took 1.1s. Estimated remaining: 8m 48s. Rate: 157.7 symbols/min [2025-10-17T22:38:34.067263] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:34.085334] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:34.086075] [INFO ] [MAIN ] FLG: Generated 1820 derivative records from 54107 primary records. [2025-10-17T22:38:34.086138] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-17T22:38:34.111154] [DEBUG] [LOCAL ] FLG: Derivative data saved (1820 records). [2025-10-17T22:38:34.111330] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-17T22:38:34.113701] [INFO ] [MAIN ] Derivative Progress: 696/2083 symbols completed. FLG took 1.1s. Estimated remaining: 8m 47s. Rate: 157.9 symbols/min [2025-10-17T22:38:34.113984] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:34.129870] [DEBUG] [LOCAL ] FLNG: Loaded 34189 existing records from primary storage. [2025-10-17T22:38:34.130051] [INFO ] [MAIN ] FLNG: Loaded 34189 primary data records. [2025-10-17T22:38:34.497438] [DEBUG] [LOCAL ] FLO: Loaded 52831 existing records from primary storage. [2025-10-17T22:38:34.498912] [INFO ] [MAIN ] FLO: Loaded 52831 primary data records. [2025-10-17T22:38:34.498487] [DEBUG] [LOCAL ] FLR: Loaded 54019 existing records from primary storage. [2025-10-17T22:38:34.499172] [INFO ] [MAIN ] FLR: Loaded 54019 primary data records. [2025-10-17T22:38:35.192686] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:35.195185] [INFO ] [MAIN ] FLNG: Generated 1820 derivative records from 34189 primary records. [2025-10-17T22:38:35.195707] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-17T22:38:35.213929] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1820 records). [2025-10-17T22:38:35.214316] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-17T22:38:35.216787] [INFO ] [MAIN ] Derivative Progress: 697/2083 symbols completed. FLNG took 1.2s. Estimated remaining: 8m 48s. Rate: 157.5 symbols/min [2025-10-17T22:38:35.217168] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:35.236485] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:35.245003] [INFO ] [MAIN ] FLO: Generated 1820 derivative records from 52831 primary records. [2025-10-17T22:38:35.249779] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-17T22:38:35.250888] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:35.251918] [INFO ] [MAIN ] FLR: Generated 1820 derivative records from 54019 primary records. [2025-10-17T22:38:35.265854] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-17T22:38:35.277609] [DEBUG] [LOCAL ] FLO: Derivative data saved (1820 records). [2025-10-17T22:38:35.293983] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-17T22:38:35.296784] [INFO ] [MAIN ] Derivative Progress: 698/2083 symbols completed. FLO took 1.2s. Estimated remaining: 8m 47s. Rate: 157.6 symbols/min [2025-10-17T22:38:35.297834] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:35.300526] [DEBUG] [LOCAL ] FLR: Derivative data saved (1820 records). [2025-10-17T22:38:35.300793] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-17T22:38:35.304030] [INFO ] [MAIN ] Derivative Progress: 699/2083 symbols completed. FLR took 1.2s. Estimated remaining: 8m 46s. Rate: 157.9 symbols/min [2025-10-17T22:38:35.304326] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:35.322422] [DEBUG] [LOCAL ] FLS: Loaded 51134 existing records from primary storage. [2025-10-17T22:38:35.322754] [INFO ] [MAIN ] FLS: Loaded 51134 primary data records. [2025-10-17T22:38:35.513298] [DEBUG] [LOCAL ] FLXR: Loaded 21398 existing records from primary storage. [2025-10-17T22:38:35.652017] [INFO ] [MAIN ] FLXR: Loaded 21398 primary data records. [2025-10-17T22:38:35.775111] [DEBUG] [LOCAL ] FLUT: Loaded 51478 existing records from primary storage. [2025-10-17T22:38:35.813974] [INFO ] [MAIN ] FLUT: Loaded 51478 primary data records. [2025-10-17T22:38:36.286171] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:36.287305] [INFO ] [MAIN ] FLS: Generated 1820 derivative records from 51134 primary records. [2025-10-17T22:38:36.287533] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-17T22:38:36.305856] [DEBUG] [LOCAL ] FLS: Derivative data saved (1820 records). [2025-10-17T22:38:36.306182] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-17T22:38:36.308201] [INFO ] [MAIN ] Derivative Progress: 700/2083 symbols completed. FLS took 1.1s. Estimated remaining: 8m 47s. Rate: 157.5 symbols/min [2025-10-17T22:38:36.308494] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:36.325415] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:36.326228] [INFO ] [MAIN ] FLXR: Generated 1820 derivative records from 21398 primary records. [2025-10-17T22:38:36.326482] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-17T22:38:36.358869] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:36.358561] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1820 records). [2025-10-17T22:38:36.359603] [INFO ] [MAIN ] FLUT: Generated 1820 derivative records from 51478 primary records. [2025-10-17T22:38:36.359760] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-17T22:38:36.359905] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-17T22:38:36.362493] [INFO ] [MAIN ] Derivative Progress: 701/2083 symbols completed. FLXR took 1.1s. Estimated remaining: 8m 46s. Rate: 157.7 symbols/min [2025-10-17T22:38:36.362696] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:36.395087] [DEBUG] [LOCAL ] FMN: Loaded 5571 existing records from primary storage. [2025-10-17T22:38:36.397106] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1820 records). [2025-10-17T22:38:36.397319] [INFO ] [MAIN ] FMN: Loaded 5571 primary data records. [2025-10-17T22:38:36.397210] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-17T22:38:36.420205] [INFO ] [MAIN ] Derivative Progress: 702/2083 symbols completed. FLUT took 1.1s. Estimated remaining: 8m 45s. Rate: 157.9 symbols/min [2025-10-17T22:38:36.431218] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:36.509778] [DEBUG] [LOCAL ] FMC: Loaded 52624 existing records from primary storage. [2025-10-17T22:38:36.527242] [INFO ] [MAIN ] FMC: Loaded 52624 primary data records. [2025-10-17T22:38:36.932048] [DEBUG] [LOCAL ] FMS: Loaded 30733 existing records from primary storage. [2025-10-17T22:38:36.962582] [INFO ] [MAIN ] FMS: Loaded 30733 primary data records. [2025-10-17T22:38:37.464314] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:37.466559] [INFO ] [MAIN ] FMN: Generated 1820 derivative records from 5571 primary records. [2025-10-17T22:38:37.466716] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-17T22:38:37.492878] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:37.494432] [INFO ] [MAIN ] FMC: Generated 1820 derivative records from 52624 primary records. [2025-10-17T22:38:37.495747] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-17T22:38:37.505499] [DEBUG] [LOCAL ] FMN: Derivative data saved (1820 records). [2025-10-17T22:38:37.506590] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-17T22:38:37.508598] [INFO ] [MAIN ] Derivative Progress: 703/2083 symbols completed. FMN took 1.1s. Estimated remaining: 8m 46s. Rate: 157.5 symbols/min [2025-10-17T22:38:37.516266] [DEBUG] [LOCAL ] FMC: Derivative data saved (1820 records). [2025-10-17T22:38:37.516406] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-17T22:38:37.519454] [INFO ] [MAIN ] Derivative Progress: 704/2083 symbols completed. FMC took 1.2s. Estimated remaining: 8m 45s. Rate: 157.7 symbols/min [2025-10-17T22:38:37.533960] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:37.534570] [INFO ] [MAIN ] FMS: Generated 1820 derivative records from 30733 primary records. [2025-10-17T22:38:37.534666] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-17T22:38:37.550889] [DEBUG] [LOCAL ] FMS: Derivative data saved (1820 records). [2025-10-17T22:38:37.550982] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-17T22:38:37.553044] [INFO ] [MAIN ] Derivative Progress: 705/2083 symbols completed. FMS took 1.1s. Estimated remaining: 8m 44s. Rate: 157.9 symbols/min [2025-10-17T22:38:37.553502] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:37.553892] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:37.553604] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:37.559784] [DEBUG] [LOCAL ] FMY: Loaded 1397 existing records from primary storage. [2025-10-17T22:38:37.560046] [INFO ] [MAIN ] FMY: Loaded 1397 primary data records. [2025-10-17T22:38:37.919806] [DEBUG] [LOCAL ] FMX: Loaded 41172 existing records from primary storage. [2025-10-17T22:38:37.918045] [DEBUG] [LOCAL ] FN: Loaded 38299 existing records from primary storage. [2025-10-17T22:38:37.920255] [INFO ] [MAIN ] FMX: Loaded 41172 primary data records. [2025-10-17T22:38:37.920210] [INFO ] [MAIN ] FN: Loaded 38299 primary data records. [2025-10-17T22:38:38.588857] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:38.590832] [INFO ] [MAIN ] FMY: Generated 1820 derivative records from 1397 primary records. [2025-10-17T22:38:38.591217] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-17T22:38:38.607747] [DEBUG] [LOCAL ] FMY: Derivative data saved (1820 records). [2025-10-17T22:38:38.608363] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-17T22:38:38.610992] [INFO ] [MAIN ] Derivative Progress: 706/2083 symbols completed. FMY took 1.1s. Estimated remaining: 8m 45s. Rate: 157.5 symbols/min [2025-10-17T22:38:38.611353] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:38.640227] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:38.645954] [INFO ] [MAIN ] FMX: Generated 1820 derivative records from 41172 primary records. [2025-10-17T22:38:38.645249] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:38.646109] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-17T22:38:38.646785] [INFO ] [MAIN ] FN: Generated 1820 derivative records from 38299 primary records. [2025-10-17T22:38:38.647627] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-17T22:38:38.681604] [DEBUG] [LOCAL ] FN: Derivative data saved (1820 records). [2025-10-17T22:38:38.682374] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-17T22:38:38.684542] [INFO ] [MAIN ] Derivative Progress: 707/2083 symbols completed. FN took 1.1s. Estimated remaining: 8m 44s. Rate: 157.7 symbols/min [2025-10-17T22:38:38.685530] [DEBUG] [LOCAL ] FMX: Derivative data saved (1820 records). [2025-10-17T22:38:38.684892] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:38.685915] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-17T22:38:38.687861] [INFO ] [MAIN ] Derivative Progress: 708/2083 symbols completed. FMX took 1.1s. Estimated remaining: 8m 43s. Rate: 157.9 symbols/min [2025-10-17T22:38:38.701829] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:38.728282] [DEBUG] [LOCAL ] FNB: Loaded 53376 existing records from primary storage. [2025-10-17T22:38:38.728591] [INFO ] [MAIN ] FNB: Loaded 53376 primary data records. [2025-10-17T22:38:39.116147] [DEBUG] [LOCAL ] FND: Loaded 52865 existing records from primary storage. [2025-10-17T22:38:39.116509] [INFO ] [MAIN ] FND: Loaded 52865 primary data records. [2025-10-17T22:38:39.117258] [DEBUG] [LOCAL ] FNF: Loaded 49639 existing records from primary storage. [2025-10-17T22:38:39.117465] [INFO ] [MAIN ] FNF: Loaded 49639 primary data records. [2025-10-17T22:38:39.781481] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:39.782557] [INFO ] [MAIN ] FNB: Generated 1820 derivative records from 53376 primary records. [2025-10-17T22:38:39.783110] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-17T22:38:39.805613] [DEBUG] [LOCAL ] FNB: Derivative data saved (1820 records). [2025-10-17T22:38:39.806759] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-17T22:38:39.810161] [INFO ] [MAIN ] Derivative Progress: 709/2083 symbols completed. FNB took 1.2s. Estimated remaining: 8m 44s. Rate: 157.4 symbols/min [2025-10-17T22:38:39.812002] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:39.828171] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:39.837078] [INFO ] [MAIN ] FND: Generated 1820 derivative records from 52865 primary records. [2025-10-17T22:38:39.837265] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-17T22:38:39.844110] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:39.856134] [INFO ] [MAIN ] FNF: Generated 1820 derivative records from 49639 primary records. [2025-10-17T22:38:39.857028] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-17T22:38:39.870060] [DEBUG] [LOCAL ] FND: Derivative data saved (1820 records). [2025-10-17T22:38:39.873700] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-17T22:38:39.877855] [DEBUG] [LOCAL ] FNF: Derivative data saved (1820 records). [2025-10-17T22:38:39.877984] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-17T22:38:39.880434] [INFO ] [MAIN ] Derivative Progress: 710/2083 symbols completed. FND took 1.2s. Estimated remaining: 8m 43s. Rate: 157.6 symbols/min [2025-10-17T22:38:39.882738] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:39.882988] [INFO ] [MAIN ] Derivative Progress: 711/2083 symbols completed. FNF took 1.2s. Estimated remaining: 8m 42s. Rate: 157.9 symbols/min [2025-10-17T22:38:39.883179] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:39.908525] [DEBUG] [LOCAL ] FOF: Loaded 8707 existing records from primary storage. [2025-10-17T22:38:39.908747] [INFO ] [MAIN ] FOF: Loaded 8707 primary data records. [2025-10-17T22:38:39.990532] [DEBUG] [LOCAL ] FOA: Loaded 13224 existing records from primary storage. [2025-10-17T22:38:40.007182] [INFO ] [MAIN ] FOA: Loaded 13224 primary data records. [2025-10-17T22:38:40.026207] [DEBUG] [LOCAL ] FNV: Loaded 46890 existing records from primary storage. [2025-10-17T22:38:40.066840] [INFO ] [MAIN ] FNV: Loaded 46890 primary data records. [2025-10-17T22:38:40.890136] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:40.891247] [INFO ] [MAIN ] FOF: Generated 1820 derivative records from 8707 primary records. [2025-10-17T22:38:40.891549] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-17T22:38:40.911550] [DEBUG] [LOCAL ] FOF: Derivative data saved (1820 records). [2025-10-17T22:38:40.912020] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-17T22:38:40.914386] [INFO ] [MAIN ] Derivative Progress: 712/2083 symbols completed. FOF took 1.0s. Estimated remaining: 8m 42s. Rate: 157.5 symbols/min [2025-10-17T22:38:40.914949] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:40.929919] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:40.932314] [INFO ] [MAIN ] FNV: Generated 1820 derivative records from 46890 primary records. [2025-10-17T22:38:40.932557] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-17T22:38:40.956475] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:40.968743] [DEBUG] [LOCAL ] FNV: Derivative data saved (1820 records). [2025-10-17T22:38:40.969890] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-17T22:38:40.969697] [INFO ] [MAIN ] FOA: Generated 1820 derivative records from 13224 primary records. [2025-10-17T22:38:40.972167] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-17T22:38:40.972025] [INFO ] [MAIN ] Derivative Progress: 713/2083 symbols completed. FNV took 1.2s. Estimated remaining: 8m 41s. Rate: 157.7 symbols/min [2025-10-17T22:38:40.973117] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:40.995762] [DEBUG] [LOCAL ] FOR: Loaded 20025 existing records from primary storage. [2025-10-17T22:38:40.996892] [INFO ] [MAIN ] FOR: Loaded 20025 primary data records. [2025-10-17T22:38:40.997183] [DEBUG] [LOCAL ] FOA: Derivative data saved (1820 records). [2025-10-17T22:38:41.008903] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-17T22:38:41.031953] [INFO ] [MAIN ] Derivative Progress: 714/2083 symbols completed. FOA took 1.1s. Estimated remaining: 8m 40s. Rate: 157.8 symbols/min [2025-10-17T22:38:41.043449] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:41.369956] [DEBUG] [LOCAL ] FPF: Loaded 19175 existing records from primary storage. [2025-10-17T22:38:41.370100] [INFO ] [MAIN ] FPF: Loaded 19175 primary data records. [2025-10-17T22:38:41.369619] [DEBUG] [LOCAL ] FOUR: Loaded 50475 existing records from primary storage. [2025-10-17T22:38:41.381721] [INFO ] [MAIN ] FOUR: Loaded 50475 primary data records. [2025-10-17T22:38:42.000461] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:42.002561] [INFO ] [MAIN ] FOR: Generated 1820 derivative records from 20025 primary records. [2025-10-17T22:38:42.002795] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-17T22:38:42.024920] [DEBUG] [LOCAL ] FOR: Derivative data saved (1820 records). [2025-10-17T22:38:42.025407] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-17T22:38:42.028021] [INFO ] [MAIN ] Derivative Progress: 715/2083 symbols completed. FOR took 1.1s. Estimated remaining: 8m 41s. Rate: 157.5 symbols/min [2025-10-17T22:38:42.028482] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:42.067201] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:42.067510] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:42.068752] [INFO ] [MAIN ] FOUR: Generated 1820 derivative records from 50475 primary records. [2025-10-17T22:38:42.075047] [INFO ] [MAIN ] FPF: Generated 1820 derivative records from 19175 primary records. [2025-10-17T22:38:42.075258] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-17T22:38:42.075364] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-17T22:38:42.110871] [DEBUG] [LOCAL ] FPH: Loaded 19603 existing records from primary storage. [2025-10-17T22:38:42.113676] [INFO ] [MAIN ] FPH: Loaded 19603 primary data records. [2025-10-17T22:38:42.112116] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1820 records). [2025-10-17T22:38:42.116030] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-17T22:38:42.137234] [DEBUG] [LOCAL ] FPF: Derivative data saved (1820 records). [2025-10-17T22:38:42.147387] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-17T22:38:42.161446] [INFO ] [MAIN ] Derivative Progress: 716/2083 symbols completed. FOUR took 1.2s. Estimated remaining: 8m 40s. Rate: 157.6 symbols/min [2025-10-17T22:38:42.200764] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:42.206508] [INFO ] [MAIN ] Derivative Progress: 717/2083 symbols completed. FPF took 1.1s. Estimated remaining: 8m 39s. Rate: 157.8 symbols/min [2025-10-17T22:38:42.212363] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:42.459034] [DEBUG] [LOCAL ] FPI: Loaded 31833 existing records from primary storage. [2025-10-17T22:38:42.459584] [INFO ] [MAIN ] FPI: Loaded 31833 primary data records. [2025-10-17T22:38:42.563344] [DEBUG] [LOCAL ] FR: Loaded 47301 existing records from primary storage. [2025-10-17T22:38:42.574340] [INFO ] [MAIN ] FR: Loaded 47301 primary data records. [2025-10-17T22:38:42.880037] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:42.891898] [INFO ] [MAIN ] FPH: Generated 1820 derivative records from 19603 primary records. [2025-10-17T22:38:42.897250] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-17T22:38:43.146906] [DEBUG] [LOCAL ] FPH: Derivative data saved (1820 records). [2025-10-17T22:38:43.148628] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-17T22:38:43.150973] [INFO ] [MAIN ] Derivative Progress: 718/2083 symbols completed. FPH took 1.1s. Estimated remaining: 8m 40s. Rate: 157.5 symbols/min [2025-10-17T22:38:43.171547] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:43.172370] [INFO ] [MAIN ] FPI: Generated 1820 derivative records from 31833 primary records. [2025-10-17T22:38:43.172516] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-17T22:38:43.190701] [DEBUG] [LOCAL ] FPI: Derivative data saved (1820 records). [2025-10-17T22:38:43.202787] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-17T22:38:43.205447] [INFO ] [MAIN ] Derivative Progress: 719/2083 symbols completed. FPI took 1.0s. Estimated remaining: 8m 39s. Rate: 157.7 symbols/min [2025-10-17T22:38:43.203398] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:43.206268] [INFO ] [MAIN ] FR: Generated 1820 derivative records from 47301 primary records. [2025-10-17T22:38:43.206329] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-17T22:38:43.221217] [DEBUG] [LOCAL ] FR: Derivative data saved (1820 records). [2025-10-17T22:38:43.221275] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-17T22:38:43.223482] [INFO ] [MAIN ] Derivative Progress: 720/2083 symbols completed. FR took 1.0s. Estimated remaining: 8m 38s. Rate: 157.9 symbols/min [2025-10-17T22:38:43.223932] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:43.224101] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:43.224020] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:43.252048] [DEBUG] [LOCAL ] FRA: Loaded 14476 existing records from primary storage. [2025-10-17T22:38:43.251757] [DEBUG] [LOCAL ] FRGE: Loaded 16315 existing records from primary storage. [2025-10-17T22:38:43.252195] [INFO ] [MAIN ] FRA: Loaded 14476 primary data records. [2025-10-17T22:38:43.252282] [INFO ] [MAIN ] FRGE: Loaded 16315 primary data records. [2025-10-17T22:38:43.866592] [DEBUG] [LOCAL ] FRO: Loaded 52460 existing records from primary storage. [2025-10-17T22:38:43.867121] [INFO ] [MAIN ] FRO: Loaded 52460 primary data records. [2025-10-17T22:38:44.192354] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:44.194732] [INFO ] [MAIN ] FRA: Generated 1820 derivative records from 14476 primary records. [2025-10-17T22:38:44.195043] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-17T22:38:44.217025] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:44.222016] [INFO ] [MAIN ] FRGE: Generated 1820 derivative records from 16315 primary records. [2025-10-17T22:38:44.222726] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-17T22:38:44.236275] [DEBUG] [LOCAL ] FRA: Derivative data saved (1820 records). [2025-10-17T22:38:44.239017] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-17T22:38:44.241135] [INFO ] [MAIN ] Derivative Progress: 721/2083 symbols completed. FRA took 1.0s. Estimated remaining: 8m 39s. Rate: 157.5 symbols/min [2025-10-17T22:38:44.242177] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:44.249717] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1820 records). [2025-10-17T22:38:44.249878] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-17T22:38:44.252270] [INFO ] [MAIN ] Derivative Progress: 722/2083 symbols completed. FRGE took 1.0s. Estimated remaining: 8m 38s. Rate: 157.7 symbols/min [2025-10-17T22:38:44.252582] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:44.270112] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:44.270821] [INFO ] [MAIN ] FRO: Generated 1820 derivative records from 52460 primary records. [2025-10-17T22:38:44.272837] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-17T22:38:44.300048] [DEBUG] [LOCAL ] FRO: Derivative data saved (1820 records). [2025-10-17T22:38:44.307884] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-17T22:38:44.310112] [INFO ] [MAIN ] Derivative Progress: 723/2083 symbols completed. FRO took 1.1s. Estimated remaining: 8m 37s. Rate: 157.9 symbols/min [2025-10-17T22:38:44.310444] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:44.337075] [DEBUG] [LOCAL ] FRT: Loaded 42290 existing records from primary storage. [2025-10-17T22:38:44.337279] [INFO ] [MAIN ] FRT: Loaded 42290 primary data records. [2025-10-17T22:38:44.338014] [DEBUG] [LOCAL ] FSCO: Loaded 39152 existing records from primary storage. [2025-10-17T22:38:44.358507] [INFO ] [MAIN ] FSCO: Loaded 39152 primary data records. [2025-10-17T22:38:44.979896] [DEBUG] [LOCAL ] FSK: Loaded 50273 existing records from primary storage. [2025-10-17T22:38:44.980195] [INFO ] [MAIN ] FSK: Loaded 50273 primary data records. [2025-10-17T22:38:45.303972] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:45.317572] [INFO ] [MAIN ] FRT: Generated 1820 derivative records from 42290 primary records. [2025-10-17T22:38:45.317829] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-17T22:38:45.318613] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:45.319905] [INFO ] [MAIN ] FSCO: Generated 1820 derivative records from 39152 primary records. [2025-10-17T22:38:45.327404] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-17T22:38:45.346832] [DEBUG] [LOCAL ] FRT: Derivative data saved (1820 records). [2025-10-17T22:38:45.347941] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-10-17T22:38:45.350459] [INFO ] [MAIN ] Derivative Progress: 724/2083 symbols completed. FRT took 1.1s. Estimated remaining: 8m 38s. Rate: 157.5 symbols/min [2025-10-17T22:38:45.350877] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:45.354871] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1820 records). [2025-10-17T22:38:45.355054] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-17T22:38:45.357407] [INFO ] [MAIN ] Derivative Progress: 725/2083 symbols completed. FSCO took 1.1s. Estimated remaining: 8m 36s. Rate: 157.8 symbols/min [2025-10-17T22:38:45.359094] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:45.374472] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:45.375255] [INFO ] [MAIN ] FSK: Generated 1820 derivative records from 50273 primary records. [2025-10-17T22:38:45.375316] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-17T22:38:45.395685] [DEBUG] [LOCAL ] FSK: Derivative data saved (1820 records). [2025-10-17T22:38:45.395957] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-17T22:38:45.398753] [INFO ] [MAIN ] Derivative Progress: 726/2083 symbols completed. FSK took 1.1s. Estimated remaining: 8m 35s. Rate: 158.0 symbols/min [2025-10-17T22:38:45.399278] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:45.457950] [DEBUG] [LOCAL ] FSLY: Loaded 52088 existing records from primary storage. [2025-10-17T22:38:45.458187] [INFO ] [MAIN ] FSLY: Loaded 52088 primary data records. [2025-10-17T22:38:45.569182] [DEBUG] [LOCAL ] FSS: Loaded 34103 existing records from primary storage. [2025-10-17T22:38:45.586080] [INFO ] [MAIN ] FSS: Loaded 34103 primary data records. [2025-10-17T22:38:45.587080] [DEBUG] [LOCAL ] FSM: Loaded 54081 existing records from primary storage. [2025-10-17T22:38:45.587330] [INFO ] [MAIN ] FSM: Loaded 54081 primary data records. [2025-10-17T22:38:46.402669] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:46.406448] [INFO ] [MAIN ] FSLY: Generated 1820 derivative records from 52088 primary records. [2025-10-17T22:38:46.406718] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-17T22:38:46.434853] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:46.435982] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1820 records). [2025-10-17T22:38:46.437923] [INFO ] [MAIN ] FSM: Generated 1820 derivative records from 54081 primary records. [2025-10-17T22:38:46.438901] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-17T22:38:46.438834] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-17T22:38:46.441731] [INFO ] [MAIN ] Derivative Progress: 727/2083 symbols completed. FSLY took 1.1s. Estimated remaining: 8m 36s. Rate: 157.6 symbols/min [2025-10-17T22:38:46.442075] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:46.469010] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:46.473501] [DEBUG] [LOCAL ] FSM: Derivative data saved (1820 records). [2025-10-17T22:38:46.474686] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-10-17T22:38:46.474499] [INFO ] [MAIN ] FSS: Generated 1820 derivative records from 34103 primary records. [2025-10-17T22:38:46.477108] [INFO ] [MAIN ] Derivative Progress: 728/2083 symbols completed. FSM took 1.1s. Estimated remaining: 8m 35s. Rate: 157.8 symbols/min [2025-10-17T22:38:46.477373] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:46.477466] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-17T22:38:46.494737] [DEBUG] [LOCAL ] FT: Loaded 6884 existing records from primary storage. [2025-10-17T22:38:46.495321] [INFO ] [MAIN ] FT: Loaded 6884 primary data records. [2025-10-17T22:38:46.542829] [DEBUG] [LOCAL ] FSS: Derivative data saved (1820 records). [2025-10-17T22:38:46.568370] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-17T22:38:46.591580] [INFO ] [MAIN ] Derivative Progress: 729/2083 symbols completed. FSS took 1.2s. Estimated remaining: 8m 34s. Rate: 157.9 symbols/min [2025-10-17T22:38:46.602290] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:46.613084] [DEBUG] [LOCAL ] FTHY: Loaded 12522 existing records from primary storage. [2025-10-17T22:38:46.629017] [INFO ] [MAIN ] FTHY: Loaded 12522 primary data records. [2025-10-17T22:38:47.163217] [DEBUG] [LOCAL ] FTI: Loaded 54070 existing records from primary storage. [2025-10-17T22:38:47.164735] [INFO ] [MAIN ] FTI: Loaded 54070 primary data records. [2025-10-17T22:38:47.280764] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:47.292609] [INFO ] [MAIN ] FT: Generated 1820 derivative records from 6884 primary records. [2025-10-17T22:38:47.298083] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-17T22:38:47.500318] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:47.502960] [DEBUG] [LOCAL ] FT: Derivative data saved (1820 records). [2025-10-17T22:38:47.503046] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-17T22:38:47.504845] [INFO ] [MAIN ] Derivative Progress: 730/2083 symbols completed. FT took 1.1s. Estimated remaining: 8m 35s. Rate: 157.6 symbols/min [2025-10-17T22:38:47.502891] [INFO ] [MAIN ] FTHY: Generated 1820 derivative records from 12522 primary records. [2025-10-17T22:38:47.505027] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:47.506244] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-17T22:38:47.523683] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1820 records). [2025-10-17T22:38:47.523980] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-17T22:38:47.526682] [INFO ] [MAIN ] Derivative Progress: 731/2083 symbols completed. FTHY took 1.0s. Estimated remaining: 8m 34s. Rate: 157.8 symbols/min [2025-10-17T22:38:47.526969] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:47.557556] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:47.561277] [INFO ] [MAIN ] FTI: Generated 1820 derivative records from 54070 primary records. [2025-10-17T22:38:47.573539] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-17T22:38:47.574992] [DEBUG] [LOCAL ] FTK: Loaded 33277 existing records from primary storage. [2025-10-17T22:38:47.582471] [INFO ] [MAIN ] FTK: Loaded 33277 primary data records. [2025-10-17T22:38:47.654336] [DEBUG] [LOCAL ] FTI: Derivative data saved (1820 records). [2025-10-17T22:38:47.669049] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-17T22:38:47.702854] [INFO ] [MAIN ] Derivative Progress: 732/2083 symbols completed. FTI took 1.1s. Estimated remaining: 8m 33s. Rate: 157.9 symbols/min [2025-10-17T22:38:47.703582] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:47.764416] [DEBUG] [LOCAL ] FTS: Loaded 43161 existing records from primary storage. [2025-10-17T22:38:47.877812] [INFO ] [MAIN ] FTS: Loaded 43161 primary data records. [2025-10-17T22:38:48.243859] [DEBUG] [LOCAL ] FTV: Loaded 53827 existing records from primary storage. [2025-10-17T22:38:48.244694] [INFO ] [MAIN ] FTV: Loaded 53827 primary data records. [2025-10-17T22:38:48.389936] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:48.408805] [INFO ] [MAIN ] FTK: Generated 1820 derivative records from 33277 primary records. [2025-10-17T22:38:48.409094] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-17T22:38:48.580014] [DEBUG] [LOCAL ] FTK: Derivative data saved (1820 records). [2025-10-17T22:38:48.580932] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-17T22:38:48.583146] [INFO ] [MAIN ] Derivative Progress: 733/2083 symbols completed. FTK took 1.1s. Estimated remaining: 8m 34s. Rate: 157.7 symbols/min [2025-10-17T22:38:48.601911] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:48.603070] [INFO ] [MAIN ] FTS: Generated 1820 derivative records from 43161 primary records. [2025-10-17T22:38:48.603294] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-17T22:38:48.621293] [DEBUG] [LOCAL ] FTS: Derivative data saved (1820 records). [2025-10-17T22:38:48.621358] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-17T22:38:48.623619] [INFO ] [MAIN ] Derivative Progress: 734/2083 symbols completed. FTS took 1.1s. Estimated remaining: 8m 33s. Rate: 157.9 symbols/min [2025-10-17T22:38:48.639015] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:48.639612] [INFO ] [MAIN ] FTV: Generated 1820 derivative records from 53827 primary records. [2025-10-17T22:38:48.639698] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-17T22:38:48.654710] [DEBUG] [LOCAL ] FTV: Derivative data saved (1820 records). [2025-10-17T22:38:48.654771] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-17T22:38:48.657054] [INFO ] [MAIN ] Derivative Progress: 735/2083 symbols completed. FTV took 1.0s. Estimated remaining: 8m 32s. Rate: 158.0 symbols/min [2025-10-17T22:38:48.657459] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:48.657547] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:48.657696] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:48.663429] [DEBUG] [LOCAL ] FTWO: Loaded 1965 existing records from primary storage. [2025-10-17T22:38:48.663585] [INFO ] [MAIN ] FTWO: Loaded 1965 primary data records. [2025-10-17T22:38:49.010246] [DEBUG] [LOCAL ] FUL: Loaded 32752 existing records from primary storage. [2025-10-17T22:38:49.024961] [INFO ] [MAIN ] FUL: Loaded 32752 primary data records. [2025-10-17T22:38:49.047551] [DEBUG] [LOCAL ] FUBO: Loaded 54497 existing records from primary storage. [2025-10-17T22:38:49.095710] [INFO ] [MAIN ] FUBO: Loaded 54497 primary data records. [2025-10-17T22:38:49.655837] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:38:49.657153] [INFO ] [MAIN ] FTWO: Generated 1819 derivative records from 1965 primary records. [2025-10-17T22:38:49.658976] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-17T22:38:49.676926] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1819 records). [2025-10-17T22:38:49.677415] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-17T22:38:49.679742] [INFO ] [MAIN ] Derivative Progress: 736/2083 symbols completed. FTWO took 1.0s. Estimated remaining: 8m 33s. Rate: 157.7 symbols/min [2025-10-17T22:38:49.680327] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:49.698128] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:49.698942] [INFO ] [MAIN ] FUL: Generated 1820 derivative records from 32752 primary records. [2025-10-17T22:38:49.699025] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-17T22:38:49.718964] [DEBUG] [LOCAL ] FUL: Derivative data saved (1820 records). [2025-10-17T22:38:49.719288] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-17T22:38:49.721379] [INFO ] [MAIN ] Derivative Progress: 737/2083 symbols completed. FUL took 1.1s. Estimated remaining: 8m 32s. Rate: 157.9 symbols/min [2025-10-17T22:38:49.721605] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:49.735793] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:49.736690] [INFO ] [MAIN ] FUBO: Generated 1820 derivative records from 54497 primary records. [2025-10-17T22:38:49.736913] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-17T22:38:49.767459] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1820 records). [2025-10-17T22:38:49.767788] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-17T22:38:49.769956] [INFO ] [MAIN ] Derivative Progress: 738/2083 symbols completed. FUBO took 1.1s. Estimated remaining: 8m 31s. Rate: 158.1 symbols/min [2025-10-17T22:38:49.774800] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:49.797919] [DEBUG] [LOCAL ] FVR: Loaded 21415 existing records from primary storage. [2025-10-17T22:38:49.798950] [DEBUG] [LOCAL ] FUN: Loaded 52679 existing records from primary storage. [2025-10-17T22:38:49.799091] [INFO ] [MAIN ] FUN: Loaded 52679 primary data records. [2025-10-17T22:38:49.798077] [INFO ] [MAIN ] FVR: Loaded 21415 primary data records. [2025-10-17T22:38:50.172706] [DEBUG] [LOCAL ] FVRR: Loaded 41187 existing records from primary storage. [2025-10-17T22:38:50.291349] [INFO ] [MAIN ] FVRR: Loaded 41187 primary data records. [2025-10-17T22:38:50.792232] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:50.804841] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:50.806529] [INFO ] [MAIN ] FUN: Generated 1820 derivative records from 52679 primary records. [2025-10-17T22:38:50.805940] [INFO ] [MAIN ] FVR: Generated 1820 derivative records from 21415 primary records. [2025-10-17T22:38:50.806670] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-17T22:38:50.806900] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-17T22:38:50.835908] [DEBUG] [LOCAL ] FVR: Derivative data saved (1820 records). [2025-10-17T22:38:50.838981] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-17T22:38:50.840082] [DEBUG] [LOCAL ] FUN: Derivative data saved (1820 records). [2025-10-17T22:38:50.842148] [INFO ] [MAIN ] Derivative Progress: 739/2083 symbols completed. FVR took 1.1s. Estimated remaining: 8m 31s. Rate: 157.7 symbols/min [2025-10-17T22:38:50.842604] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:50.842318] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-17T22:38:50.844970] [INFO ] [MAIN ] Derivative Progress: 740/2083 symbols completed. FUN took 1.2s. Estimated remaining: 8m 30s. Rate: 157.9 symbols/min [2025-10-17T22:38:50.845262] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:50.848368] [DEBUG] [LOCAL ] FXED: Loaded 1259 existing records from primary storage. [2025-10-17T22:38:50.848680] [INFO ] [MAIN ] FXED: Loaded 1259 primary data records. [2025-10-17T22:38:51.164923] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:51.179763] [INFO ] [MAIN ] FVRR: Generated 1820 derivative records from 41187 primary records. [2025-10-17T22:38:51.180025] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-17T22:38:51.211571] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1820 records). [2025-10-17T22:38:51.212333] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-17T22:38:51.214787] [INFO ] [MAIN ] Derivative Progress: 741/2083 symbols completed. FVRR took 1.4s. Estimated remaining: 8m 30s. Rate: 157.9 symbols/min [2025-10-17T22:38:51.215015] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:51.215858] [DEBUG] [LOCAL ] G: Loaded 50816 existing records from primary storage. [2025-10-17T22:38:51.216514] [INFO ] [MAIN ] G: Loaded 50816 primary data records. [2025-10-17T22:38:51.539106] [DEBUG] [LOCAL ] GAB: Loaded 28162 existing records from primary storage. [2025-10-17T22:38:51.547984] [INFO ] [MAIN ] GAB: Loaded 28162 primary data records. [2025-10-17T22:38:51.554354] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:51.561039] [INFO ] [MAIN ] FXED: Generated 1820 derivative records from 1259 primary records. [2025-10-17T22:38:51.577984] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-17T22:38:51.682326] [DEBUG] [LOCAL ] FXED: Derivative data saved (1820 records). [2025-10-17T22:38:51.688886] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-17T22:38:51.691313] [INFO ] [MAIN ] Derivative Progress: 742/2083 symbols completed. FXED took 0.8s. Estimated remaining: 8m 30s. Rate: 157.8 symbols/min [2025-10-17T22:38:51.696765] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:51.755753] [DEBUG] [LOCAL ] GAM: Loaded 3971 existing records from primary storage. [2025-10-17T22:38:51.886704] [INFO ] [MAIN ] GAM: Loaded 3971 primary data records. [2025-10-17T22:38:52.075225] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:52.216770] [INFO ] [MAIN ] G: Generated 1820 derivative records from 50816 primary records. [2025-10-17T22:38:52.233694] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-17T22:38:52.255109] [DEBUG] [LOCAL ] G: Derivative data saved (1820 records). [2025-10-17T22:38:52.255617] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-17T22:38:52.257862] [INFO ] [MAIN ] Derivative Progress: 743/2083 symbols completed. G took 1.4s. Estimated remaining: 8m 30s. Rate: 157.7 symbols/min [2025-10-17T22:38:52.258184] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:52.276018] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:52.276871] [INFO ] [MAIN ] GAB: Generated 1820 derivative records from 28162 primary records. [2025-10-17T22:38:52.277066] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-17T22:38:52.294278] [DEBUG] [LOCAL ] GAB: Derivative data saved (1820 records). [2025-10-17T22:38:52.294571] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-17T22:38:52.296772] [INFO ] [MAIN ] Derivative Progress: 744/2083 symbols completed. GAB took 1.1s. Estimated remaining: 8m 29s. Rate: 157.9 symbols/min [2025-10-17T22:38:52.297124] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:52.313260] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:52.314089] [INFO ] [MAIN ] GAM: Generated 1820 derivative records from 3971 primary records. [2025-10-17T22:38:52.314261] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-17T22:38:52.333123] [DEBUG] [LOCAL ] GAM: Derivative data saved (1820 records). [2025-10-17T22:38:52.333308] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-17T22:38:52.335408] [INFO ] [MAIN ] Derivative Progress: 745/2083 symbols completed. GAM took 0.6s. Estimated remaining: 8m 28s. Rate: 158.1 symbols/min [2025-10-17T22:38:52.348670] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:52.356975] [DEBUG] [LOCAL ] GATX: Loaded 18269 existing records from primary storage. [2025-10-17T22:38:52.357280] [INFO ] [MAIN ] GATX: Loaded 18269 primary data records. [2025-10-17T22:38:52.478810] [DEBUG] [LOCAL ] GAP: Loaded 54433 existing records from primary storage. [2025-10-17T22:38:52.487377] [INFO ] [MAIN ] GAP: Loaded 54433 primary data records. [2025-10-17T22:38:52.487261] [DEBUG] [LOCAL ] GBAB: Loaded 12974 existing records from primary storage. [2025-10-17T22:38:52.514946] [INFO ] [MAIN ] GBAB: Loaded 12974 primary data records. [2025-10-17T22:38:53.342937] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:53.344177] [INFO ] [MAIN ] GATX: Generated 1820 derivative records from 18269 primary records. [2025-10-17T22:38:53.344377] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-17T22:38:53.383009] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:53.391481] [INFO ] [MAIN ] GBAB: Generated 1820 derivative records from 12974 primary records. [2025-10-17T22:38:53.391867] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:53.392524] [INFO ] [MAIN ] GAP: Generated 1820 derivative records from 54433 primary records. [2025-10-17T22:38:53.390788] [DEBUG] [LOCAL ] GATX: Derivative data saved (1820 records). [2025-10-17T22:38:53.392619] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-17T22:38:53.392695] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-17T22:38:53.393161] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-17T22:38:53.395676] [INFO ] [MAIN ] Derivative Progress: 746/2083 symbols completed. GATX took 1.1s. Estimated remaining: 8m 29s. Rate: 157.7 symbols/min [2025-10-17T22:38:53.396219] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:53.424244] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1820 records). [2025-10-17T22:38:53.424591] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-17T22:38:53.427278] [INFO ] [MAIN ] Derivative Progress: 747/2083 symbols completed. GBAB took 1.1s. Estimated remaining: 8m 28s. Rate: 157.9 symbols/min [2025-10-17T22:38:53.427926] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:53.431264] [DEBUG] [LOCAL ] GAP: Derivative data saved (1820 records). [2025-10-17T22:38:53.431342] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-17T22:38:53.433428] [INFO ] [MAIN ] Derivative Progress: 748/2083 symbols completed. GAP took 1.2s. Estimated remaining: 8m 27s. Rate: 158.1 symbols/min [2025-10-17T22:38:53.484045] [DEBUG] [LOCAL ] GBCI: Loaded 41621 existing records from primary storage. [2025-10-17T22:38:53.485209] [INFO ] [MAIN ] GBCI: Loaded 41621 primary data records. [2025-10-17T22:38:53.485777] [DEBUG] [LOCAL ] GBTG: Loaded 40850 existing records from primary storage. [2025-10-17T22:38:53.518428] [INFO ] [MAIN ] GBTG: Loaded 40850 primary data records. [2025-10-17T22:38:54.166880] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:54.168835] [INFO ] [MAIN ] GBCI: Generated 1820 derivative records from 41621 primary records. [2025-10-17T22:38:54.169767] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-17T22:38:54.199030] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1820 records). [2025-10-17T22:38:54.199523] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-17T22:38:54.201460] [INFO ] [MAIN ] Derivative Progress: 749/2083 symbols completed. GBCI took 0.8s. Estimated remaining: 8m 27s. Rate: 157.9 symbols/min [2025-10-17T22:38:54.199383] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:54.202597] [INFO ] [MAIN ] GBTG: Generated 1820 derivative records from 40850 primary records. [2025-10-17T22:38:54.202725] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-17T22:38:54.218528] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1820 records). [2025-10-17T22:38:54.218618] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-17T22:38:54.220814] [INFO ] [MAIN ] Derivative Progress: 750/2083 symbols completed. GBTG took 0.8s. Estimated remaining: 8m 26s. Rate: 158.1 symbols/min [2025-10-17T22:38:54.221310] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:54.221423] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:54.221536] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:54.277706] [DEBUG] [LOCAL ] GCO: Loaded 23845 existing records from primary storage. [2025-10-17T22:38:54.285910] [INFO ] [MAIN ] GCO: Loaded 23845 primary data records. [2025-10-17T22:38:54.308442] [DEBUG] [LOCAL ] GBX: Loaded 29290 existing records from primary storage. [2025-10-17T22:38:54.330721] [INFO ] [MAIN ] GBX: Loaded 29290 primary data records. [2025-10-17T22:38:54.429269] [DEBUG] [LOCAL ] GCI: Loaded 44504 existing records from primary storage. [2025-10-17T22:38:54.468180] [INFO ] [MAIN ] GCI: Loaded 44504 primary data records. [2025-10-17T22:38:55.269352] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:55.270582] [INFO ] [MAIN ] GCO: Generated 1820 derivative records from 23845 primary records. [2025-10-17T22:38:55.270974] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-17T22:38:55.290004] [DEBUG] [LOCAL ] GCO: Derivative data saved (1820 records). [2025-10-17T22:38:55.290880] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-10-17T22:38:55.293269] [INFO ] [MAIN ] Derivative Progress: 751/2083 symbols completed. GCO took 1.1s. Estimated remaining: 8m 27s. Rate: 157.7 symbols/min [2025-10-17T22:38:55.293552] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:55.308780] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:55.310485] [INFO ] [MAIN ] GBX: Generated 1820 derivative records from 29290 primary records. [2025-10-17T22:38:55.310611] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-17T22:38:55.323809] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:55.324543] [INFO ] [MAIN ] GCI: Generated 1820 derivative records from 44504 primary records. [2025-10-17T22:38:55.331628] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-17T22:38:55.352517] [DEBUG] [LOCAL ] GBX: Derivative data saved (1820 records). [2025-10-17T22:38:55.353590] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-17T22:38:55.360321] [DEBUG] [LOCAL ] GCI: Derivative data saved (1820 records). [2025-10-17T22:38:55.362731] [INFO ] [MAIN ] Derivative Progress: 752/2083 symbols completed. GBX took 1.1s. Estimated remaining: 8m 26s. Rate: 157.9 symbols/min [2025-10-17T22:38:55.362827] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-17T22:38:55.371214] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:55.372491] [INFO ] [MAIN ] Derivative Progress: 753/2083 symbols completed. GCI took 1.1s. Estimated remaining: 8m 25s. Rate: 158.1 symbols/min [2025-10-17T22:38:55.372875] [DEBUG] [LOCAL ] GCTS: Loaded 20642 existing records from primary storage. [2025-10-17T22:38:55.373601] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:55.373773] [INFO ] [MAIN ] GCTS: Loaded 20642 primary data records. [2025-10-17T22:38:55.482455] [DEBUG] [LOCAL ] GCV: Loaded 7903 existing records from primary storage. [2025-10-17T22:38:55.486099] [INFO ] [MAIN ] GCV: Loaded 7903 primary data records. [2025-10-17T22:38:55.895417] [DEBUG] [LOCAL ] GD: Loaded 47354 existing records from primary storage. [2025-10-17T22:38:55.896168] [INFO ] [MAIN ] GD: Loaded 47354 primary data records. [2025-10-17T22:38:56.357288] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:56.358894] [INFO ] [MAIN ] GCTS: Generated 1820 derivative records from 20642 primary records. [2025-10-17T22:38:56.359101] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-17T22:38:56.379796] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1820 records). [2025-10-17T22:38:56.380299] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-17T22:38:56.395313] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:56.396120] [INFO ] [MAIN ] GCV: Generated 1820 derivative records from 7903 primary records. [2025-10-17T22:38:56.394670] [INFO ] [MAIN ] Derivative Progress: 754/2083 symbols completed. GCTS took 1.1s. Estimated remaining: 8m 25s. Rate: 157.8 symbols/min [2025-10-17T22:38:56.396338] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:56.396477] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-17T22:38:56.412549] [DEBUG] [LOCAL ] GCV: Derivative data saved (1820 records). [2025-10-17T22:38:56.412962] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-17T22:38:56.415081] [INFO ] [MAIN ] Derivative Progress: 755/2083 symbols completed. GCV took 1.0s. Estimated remaining: 8m 24s. Rate: 158.0 symbols/min [2025-10-17T22:38:56.415472] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:56.432851] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:56.433613] [INFO ] [MAIN ] GD: Generated 1820 derivative records from 47354 primary records. [2025-10-17T22:38:56.433753] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-17T22:38:56.444057] [DEBUG] [LOCAL ] GDIV: Loaded 3630 existing records from primary storage. [2025-10-17T22:38:56.444382] [INFO ] [MAIN ] GDIV: Loaded 3630 primary data records. [2025-10-17T22:38:56.494920] [DEBUG] [LOCAL ] GD: Derivative data saved (1820 records). [2025-10-17T22:38:56.513084] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-17T22:38:56.515481] [INFO ] [MAIN ] Derivative Progress: 756/2083 symbols completed. GD took 1.1s. Estimated remaining: 8m 24s. Rate: 158.1 symbols/min [2025-10-17T22:38:56.519901] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:56.666628] [DEBUG] [LOCAL ] GDL: Loaded 2550 existing records from primary storage. [2025-10-17T22:38:56.678689] [INFO ] [MAIN ] GDL: Loaded 2550 primary data records. [2025-10-17T22:38:56.773857] [DEBUG] [LOCAL ] GDDY: Loaded 50516 existing records from primary storage. [2025-10-17T22:38:56.822527] [INFO ] [MAIN ] GDDY: Loaded 50516 primary data records. [2025-10-17T22:38:57.409900] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:38:57.411083] [INFO ] [MAIN ] GDIV: Generated 1819 derivative records from 3630 primary records. [2025-10-17T22:38:57.411260] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-17T22:38:57.427441] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1819 records). [2025-10-17T22:38:57.427805] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-17T22:38:57.429852] [INFO ] [MAIN ] Derivative Progress: 757/2083 symbols completed. GDIV took 1.0s. Estimated remaining: 8m 24s. Rate: 157.8 symbols/min [2025-10-17T22:38:57.430238] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:57.450196] [DEBUG] [MAIN ] GDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:57.463737] [INFO ] [MAIN ] GDL: Generated 1820 derivative records from 2550 primary records. [2025-10-17T22:38:57.464151] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:57.464223] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-17T22:38:57.468457] [DEBUG] [LOCAL ] GDO: Loaded 5892 existing records from primary storage. [2025-10-17T22:38:57.468767] [INFO ] [MAIN ] GDO: Loaded 5892 primary data records. [2025-10-17T22:38:57.465081] [INFO ] [MAIN ] GDDY: Generated 1820 derivative records from 50516 primary records. [2025-10-17T22:38:57.477581] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-17T22:38:57.511350] [DEBUG] [LOCAL ] GDL: Derivative data saved (1820 records). [2025-10-17T22:38:57.516585] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-17T22:38:57.546186] [INFO ] [MAIN ] Derivative Progress: 758/2083 symbols completed. GDL took 1.0s. Estimated remaining: 8m 23s. Rate: 158.0 symbols/min [2025-10-17T22:38:57.580673] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:57.611241] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1820 records). [2025-10-17T22:38:57.621712] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-17T22:38:57.649589] [INFO ] [MAIN ] Derivative Progress: 759/2083 symbols completed. GDDY took 1.3s. Estimated remaining: 8m 22s. Rate: 158.1 symbols/min [2025-10-17T22:38:57.677595] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:57.832871] [DEBUG] [LOCAL ] GDOT: Loaded 38316 existing records from primary storage. [2025-10-17T22:38:57.833269] [INFO ] [MAIN ] GDOT: Loaded 38316 primary data records. [2025-10-17T22:38:57.921758] [DEBUG] [LOCAL ] GDV: Loaded 19698 existing records from primary storage. [2025-10-17T22:38:57.939727] [INFO ] [MAIN ] GDV: Loaded 19698 primary data records. [2025-10-17T22:38:58.227563] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:58.266957] [INFO ] [MAIN ] GDO: Generated 1820 derivative records from 5892 primary records. [2025-10-17T22:38:58.267108] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-17T22:38:58.352952] [DEBUG] [LOCAL ] GDO: Derivative data saved (1820 records). [2025-10-17T22:38:58.377382] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-17T22:38:58.379931] [INFO ] [MAIN ] Derivative Progress: 760/2083 symbols completed. GDO took 0.9s. Estimated remaining: 8m 23s. Rate: 157.9 symbols/min [2025-10-17T22:38:58.392793] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:58.586198] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:58.587121] [INFO ] [MAIN ] GDOT: Generated 1820 derivative records from 38316 primary records. [2025-10-17T22:38:58.587719] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-17T22:38:58.606159] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1820 records). [2025-10-17T22:38:58.606484] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-17T22:38:58.608907] [INFO ] [MAIN ] Derivative Progress: 761/2083 symbols completed. GDOT took 1.0s. Estimated remaining: 8m 22s. Rate: 158.0 symbols/min [2025-10-17T22:38:58.609291] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:58.627207] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:58.641995] [INFO ] [MAIN ] GDV: Generated 1820 derivative records from 19698 primary records. [2025-10-17T22:38:58.642070] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-17T22:38:58.662740] [DEBUG] [LOCAL ] GDV: Derivative data saved (1820 records). [2025-10-17T22:38:58.662901] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-17T22:38:58.665269] [INFO ] [MAIN ] Derivative Progress: 762/2083 symbols completed. GDV took 1.0s. Estimated remaining: 8m 21s. Rate: 158.2 symbols/min [2025-10-17T22:38:58.666503] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:58.690939] [DEBUG] [LOCAL ] GE: Loaded 54478 existing records from primary storage. [2025-10-17T22:38:58.689742] [DEBUG] [LOCAL ] GEF: Loaded 21098 existing records from primary storage. [2025-10-17T22:38:58.691286] [INFO ] [MAIN ] GEF: Loaded 21098 primary data records. [2025-10-17T22:38:58.691399] [INFO ] [MAIN ] GE: Loaded 54478 primary data records. [2025-10-17T22:38:59.164811] [DEBUG] [LOCAL ] GEL: Loaded 32124 existing records from primary storage. [2025-10-17T22:38:59.185690] [INFO ] [MAIN ] GEL: Loaded 32124 primary data records. [2025-10-17T22:38:59.647401] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:59.648721] [INFO ] [MAIN ] GEF: Generated 1820 derivative records from 21098 primary records. [2025-10-17T22:38:59.648893] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-17T22:38:59.668870] [DEBUG] [LOCAL ] GEF: Derivative data saved (1820 records). [2025-10-17T22:38:59.669289] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-17T22:38:59.671522] [INFO ] [MAIN ] Derivative Progress: 763/2083 symbols completed. GEF took 1.1s. Estimated remaining: 8m 22s. Rate: 157.8 symbols/min [2025-10-17T22:38:59.685317] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:59.686185] [INFO ] [MAIN ] GE: Generated 1820 derivative records from 54478 primary records. [2025-10-17T22:38:59.686381] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-17T22:38:59.705966] [DEBUG] [LOCAL ] GE: Derivative data saved (1820 records). [2025-10-17T22:38:59.718378] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:38:59.718476] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-17T22:38:59.719293] [INFO ] [MAIN ] GEL: Generated 1820 derivative records from 32124 primary records. [2025-10-17T22:38:59.719385] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-17T22:38:59.722377] [INFO ] [MAIN ] Derivative Progress: 764/2083 symbols completed. GE took 1.3s. Estimated remaining: 8m 21s. Rate: 158.0 symbols/min [2025-10-17T22:38:59.738113] [DEBUG] [LOCAL ] GEL: Derivative data saved (1820 records). [2025-10-17T22:38:59.738213] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-10-17T22:38:59.740333] [INFO ] [MAIN ] Derivative Progress: 765/2083 symbols completed. GEL took 1.1s. Estimated remaining: 8m 20s. Rate: 158.2 symbols/min [2025-10-17T22:38:59.740672] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:59.740760] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:59.740873] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:38:59.792736] [DEBUG] [LOCAL ] GES: Loaded 38876 existing records from primary storage. [2025-10-17T22:38:59.792942] [INFO ] [MAIN ] GES: Loaded 38876 primary data records. [2025-10-17T22:38:59.898416] [DEBUG] [LOCAL ] GENI: Loaded 53717 existing records from primary storage. [2025-10-17T22:38:59.923214] [INFO ] [MAIN ] GENI: Loaded 53717 primary data records. [2025-10-17T22:39:00.241161] [DEBUG] [LOCAL ] GEO: Loaded 52550 existing records from primary storage. [2025-10-17T22:39:00.260063] [INFO ] [MAIN ] GEO: Loaded 52550 primary data records. [2025-10-17T22:39:00.798909] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:00.804121] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:00.804994] [INFO ] [MAIN ] GENI: Generated 1820 derivative records from 53717 primary records. [2025-10-17T22:39:00.805120] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-17T22:39:00.805714] [INFO ] [MAIN ] GES: Generated 1820 derivative records from 38876 primary records. [2025-10-17T22:39:00.805975] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-17T22:39:00.835432] [DEBUG] [LOCAL ] GES: Derivative data saved (1820 records). [2025-10-17T22:39:00.839180] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-17T22:39:00.841156] [INFO ] [MAIN ] Derivative Progress: 766/2083 symbols completed. GES took 1.1s. Estimated remaining: 8m 21s. Rate: 157.8 symbols/min [2025-10-17T22:39:00.841622] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:00.843141] [DEBUG] [LOCAL ] GENI: Derivative data saved (1820 records). [2025-10-17T22:39:00.843512] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-17T22:39:00.845889] [INFO ] [MAIN ] Derivative Progress: 767/2083 symbols completed. GENI took 1.1s. Estimated remaining: 8m 20s. Rate: 158.0 symbols/min [2025-10-17T22:39:00.858912] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:00.859876] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:00.860603] [INFO ] [MAIN ] GEO: Generated 1820 derivative records from 52550 primary records. [2025-10-17T22:39:00.860724] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-17T22:39:00.878547] [DEBUG] [LOCAL ] GEO: Derivative data saved (1820 records). [2025-10-17T22:39:00.878803] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-17T22:39:00.881965] [INFO ] [MAIN ] Derivative Progress: 768/2083 symbols completed. GEO took 1.1s. Estimated remaining: 8m 19s. Rate: 158.2 symbols/min [2025-10-17T22:39:00.882412] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:00.908335] [DEBUG] [LOCAL ] GETY: Loaded 35677 existing records from primary storage. [2025-10-17T22:39:00.908784] [INFO ] [MAIN ] GETY: Loaded 35677 primary data records. [2025-10-17T22:39:01.057558] [DEBUG] [LOCAL ] GFF: Loaded 30283 existing records from primary storage. [2025-10-17T22:39:01.116770] [INFO ] [MAIN ] GFF: Loaded 30283 primary data records. [2025-10-17T22:39:01.142492] [DEBUG] [LOCAL ] GEV: Loaded 53772 existing records from primary storage. [2025-10-17T22:39:01.148087] [INFO ] [MAIN ] GEV: Loaded 53772 primary data records. [2025-10-17T22:39:01.921960] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:01.923795] [INFO ] [MAIN ] GETY: Generated 1820 derivative records from 35677 primary records. [2025-10-17T22:39:01.924874] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-17T22:39:01.945464] [DEBUG] [LOCAL ] GETY: Derivative data saved (1820 records). [2025-10-17T22:39:01.946822] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-17T22:39:01.950714] [INFO ] [MAIN ] Derivative Progress: 769/2083 symbols completed. GETY took 1.1s. Estimated remaining: 8m 19s. Rate: 157.8 symbols/min [2025-10-17T22:39:01.954158] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:01.970091] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:01.983928] [INFO ] [MAIN ] GEV: Generated 1820 derivative records from 53772 primary records. [2025-10-17T22:39:01.984414] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-17T22:39:01.984291] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:01.985056] [INFO ] [MAIN ] GFF: Generated 1820 derivative records from 30283 primary records. [2025-10-17T22:39:01.985957] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-17T22:39:02.021681] [DEBUG] [LOCAL ] GFF: Derivative data saved (1820 records). [2025-10-17T22:39:02.024273] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-17T22:39:02.027200] [INFO ] [MAIN ] Derivative Progress: 770/2083 symbols completed. GFF took 1.1s. Estimated remaining: 8m 19s. Rate: 158.0 symbols/min [2025-10-17T22:39:02.024409] [DEBUG] [LOCAL ] GEV: Derivative data saved (1820 records). [2025-10-17T22:39:02.027562] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-17T22:39:02.030095] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:02.030191] [INFO ] [MAIN ] Derivative Progress: 771/2083 symbols completed. GEV took 1.2s. Estimated remaining: 8m 18s. Rate: 158.2 symbols/min [2025-10-17T22:39:02.031139] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:02.058605] [DEBUG] [LOCAL ] GFR: Loaded 7837 existing records from primary storage. [2025-10-17T22:39:02.058972] [INFO ] [MAIN ] GFR: Loaded 7837 primary data records. [2025-10-17T22:39:02.180737] [DEBUG] [LOCAL ] GFI: Loaded 53895 existing records from primary storage. [2025-10-17T22:39:02.181117] [INFO ] [MAIN ] GFI: Loaded 53895 primary data records. [2025-10-17T22:39:02.628905] [DEBUG] [LOCAL ] GFL: Loaded 48336 existing records from primary storage. [2025-10-17T22:39:02.744979] [INFO ] [MAIN ] GFL: Loaded 48336 primary data records. [2025-10-17T22:39:03.085428] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:03.086821] [INFO ] [MAIN ] GFR: Generated 1820 derivative records from 7837 primary records. [2025-10-17T22:39:03.087041] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-17T22:39:03.107141] [DEBUG] [LOCAL ] GFR: Derivative data saved (1820 records). [2025-10-17T22:39:03.120444] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-17T22:39:03.121338] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:03.122368] [INFO ] [MAIN ] GFI: Generated 1820 derivative records from 53895 primary records. [2025-10-17T22:39:03.122799] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-17T22:39:03.125090] [INFO ] [MAIN ] Derivative Progress: 772/2083 symbols completed. GFR took 1.1s. Estimated remaining: 8m 18s. Rate: 157.8 symbols/min [2025-10-17T22:39:03.126308] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:03.144602] [DEBUG] [LOCAL ] GFI: Derivative data saved (1820 records). [2025-10-17T22:39:03.145101] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-17T22:39:03.147499] [INFO ] [MAIN ] Derivative Progress: 773/2083 symbols completed. GFI took 1.2s. Estimated remaining: 8m 17s. Rate: 158.0 symbols/min [2025-10-17T22:39:03.148070] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:03.168989] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:03.169928] [INFO ] [MAIN ] GFL: Generated 1820 derivative records from 48336 primary records. [2025-10-17T22:39:03.170128] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-17T22:39:03.209407] [DEBUG] [LOCAL ] GFL: Derivative data saved (1820 records). [2025-10-17T22:39:03.209565] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-17T22:39:03.211679] [INFO ] [MAIN ] Derivative Progress: 774/2083 symbols completed. GFL took 1.2s. Estimated remaining: 8m 17s. Rate: 158.2 symbols/min [2025-10-17T22:39:03.212773] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:03.242746] [DEBUG] [LOCAL ] GGB: Loaded 52241 existing records from primary storage. [2025-10-17T22:39:03.245359] [DEBUG] [LOCAL ] GGZ: Loaded 2448 existing records from primary storage. [2025-10-17T22:39:03.243002] [INFO ] [MAIN ] GGB: Loaded 52241 primary data records. [2025-10-17T22:39:03.246126] [INFO ] [MAIN ] GGZ: Loaded 2448 primary data records. [2025-10-17T22:39:03.245944] [DEBUG] [LOCAL ] GGG: Loaded 41252 existing records from primary storage. [2025-10-17T22:39:03.288012] [INFO ] [MAIN ] GGG: Loaded 41252 primary data records. [2025-10-17T22:39:04.195138] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:04.195954] [INFO ] [MAIN ] GGZ: Generated 1820 derivative records from 2448 primary records. [2025-10-17T22:39:04.196246] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-17T22:39:04.226631] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:04.228829] [INFO ] [MAIN ] GGB: Generated 1820 derivative records from 52241 primary records. [2025-10-17T22:39:04.229527] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-17T22:39:04.253236] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1820 records). [2025-10-17T22:39:04.252776] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:04.256881] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-17T22:39:04.254172] [INFO ] [MAIN ] GGG: Generated 1820 derivative records from 41252 primary records. [2025-10-17T22:39:04.261567] [DEBUG] [LOCAL ] GGB: Derivative data saved (1820 records). [2025-10-17T22:39:04.261731] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-10-17T22:39:04.261845] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-17T22:39:04.264085] [INFO ] [MAIN ] Derivative Progress: 775/2083 symbols completed. GGB took 1.1s. Estimated remaining: 8m 17s. Rate: 157.8 symbols/min [2025-10-17T22:39:04.267423] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:04.268065] [INFO ] [MAIN ] Derivative Progress: 776/2083 symbols completed. GGZ took 1.1s. Estimated remaining: 8m 16s. Rate: 158.0 symbols/min [2025-10-17T22:39:04.268244] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:04.288712] [DEBUG] [LOCAL ] GGG: Derivative data saved (1820 records). [2025-10-17T22:39:04.289143] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-17T22:39:04.292050] [DEBUG] [LOCAL ] GHC: Loaded 2977 existing records from primary storage. [2025-10-17T22:39:04.294669] [INFO ] [MAIN ] GHC: Loaded 2977 primary data records. [2025-10-17T22:39:04.297428] [DEBUG] [LOCAL ] GHG: Loaded 3317 existing records from primary storage. [2025-10-17T22:39:04.294523] [INFO ] [MAIN ] Derivative Progress: 777/2083 symbols completed. GGG took 1.1s. Estimated remaining: 8m 15s. Rate: 158.2 symbols/min [2025-10-17T22:39:04.308685] [INFO ] [MAIN ] GHG: Loaded 3317 primary data records. [2025-10-17T22:39:04.318361] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:04.550711] [DEBUG] [LOCAL ] GHI: Loaded 7591 existing records from primary storage. [2025-10-17T22:39:04.582099] [INFO ] [MAIN ] GHI: Loaded 7591 primary data records. [2025-10-17T22:39:05.314922] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:05.321478] [INFO ] [MAIN ] GHG: Generated 1820 derivative records from 3317 primary records. [2025-10-17T22:39:05.321723] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-17T22:39:05.322893] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:39:05.331869] [INFO ] [MAIN ] GHC: Generated 1819 derivative records from 2977 primary records. [2025-10-17T22:39:05.339153] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-17T22:39:05.339069] [DEBUG] [LOCAL ] GHG: Derivative data saved (1820 records). [2025-10-17T22:39:05.339775] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-17T22:39:05.342519] [INFO ] [MAIN ] Derivative Progress: 778/2083 symbols completed. GHG took 1.1s. Estimated remaining: 8m 16s. Rate: 157.9 symbols/min [2025-10-17T22:39:05.369768] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:05.373413] [DEBUG] [LOCAL ] GHC: Derivative data saved (1819 records). [2025-10-17T22:39:05.374297] [INFO ] [MAIN ] GHI: Generated 1820 derivative records from 7591 primary records. [2025-10-17T22:39:05.374411] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-17T22:39:05.374484] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-17T22:39:05.376734] [INFO ] [MAIN ] Derivative Progress: 779/2083 symbols completed. GHC took 1.1s. Estimated remaining: 8m 15s. Rate: 158.0 symbols/min [2025-10-17T22:39:05.393150] [DEBUG] [LOCAL ] GHI: Derivative data saved (1820 records). [2025-10-17T22:39:05.393265] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-17T22:39:05.395493] [INFO ] [MAIN ] Derivative Progress: 780/2083 symbols completed. GHI took 1.1s. Estimated remaining: 8m 14s. Rate: 158.2 symbols/min [2025-10-17T22:39:05.396080] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:05.396329] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:05.396221] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:05.406025] [DEBUG] [LOCAL ] GHLD: Loaded 4348 existing records from primary storage. [2025-10-17T22:39:05.406138] [INFO ] [MAIN ] GHLD: Loaded 4348 primary data records. [2025-10-17T22:39:05.541071] [DEBUG] [LOCAL ] GHY: Loaded 21330 existing records from primary storage. [2025-10-17T22:39:05.532380] [DEBUG] [LOCAL ] GHM: Loaded 14580 existing records from primary storage. [2025-10-17T22:39:05.545357] [INFO ] [MAIN ] GHY: Loaded 21330 primary data records. [2025-10-17T22:39:05.545530] [INFO ] [MAIN ] GHM: Loaded 14580 primary data records. [2025-10-17T22:39:06.479876] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:06.481048] [INFO ] [MAIN ] GHLD: Generated 1820 derivative records from 4348 primary records. [2025-10-17T22:39:06.481267] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-17T22:39:06.509697] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:06.513333] [INFO ] [MAIN ] GHY: Generated 1820 derivative records from 21330 primary records. [2025-10-17T22:39:06.513502] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1820 records). [2025-10-17T22:39:06.513803] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-17T22:39:06.526619] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:06.521569] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-17T22:39:06.528983] [INFO ] [MAIN ] Derivative Progress: 781/2083 symbols completed. GHLD took 1.1s. Estimated remaining: 8m 15s. Rate: 157.8 symbols/min [2025-10-17T22:39:06.530584] [INFO ] [MAIN ] GHM: Generated 1820 derivative records from 14580 primary records. [2025-10-17T22:39:06.530761] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:06.531591] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-17T22:39:06.554987] [DEBUG] [LOCAL ] GHY: Derivative data saved (1820 records). [2025-10-17T22:39:06.559862] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-17T22:39:06.565063] [INFO ] [MAIN ] Derivative Progress: 782/2083 symbols completed. GHY took 1.2s. Estimated remaining: 8m 14s. Rate: 158.0 symbols/min [2025-10-17T22:39:06.566219] [DEBUG] [LOCAL ] GHM: Derivative data saved (1820 records). [2025-10-17T22:39:06.566594] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:06.566856] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-17T22:39:06.569560] [INFO ] [MAIN ] Derivative Progress: 783/2083 symbols completed. GHM took 1.2s. Estimated remaining: 8m 13s. Rate: 158.2 symbols/min [2025-10-17T22:39:06.569805] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:06.604505] [DEBUG] [LOCAL ] GIC: Loaded 13587 existing records from primary storage. [2025-10-17T22:39:06.605084] [INFO ] [MAIN ] GIC: Loaded 13587 primary data records. [2025-10-17T22:39:06.626693] [DEBUG] [LOCAL ] GIB: Loaded 32143 existing records from primary storage. [2025-10-17T22:39:06.642587] [INFO ] [MAIN ] GIB: Loaded 32143 primary data records. [2025-10-17T22:39:07.223570] [DEBUG] [LOCAL ] GIL: Loaded 44482 existing records from primary storage. [2025-10-17T22:39:07.223904] [INFO ] [MAIN ] GIL: Loaded 44482 primary data records. [2025-10-17T22:39:07.552826] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:07.559065] [INFO ] [MAIN ] GIC: Generated 1820 derivative records from 13587 primary records. [2025-10-17T22:39:07.558287] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:07.559633] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-17T22:39:07.560441] [INFO ] [MAIN ] GIB: Generated 1820 derivative records from 32143 primary records. [2025-10-17T22:39:07.560935] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-17T22:39:07.593545] [DEBUG] [LOCAL ] GIC: Derivative data saved (1820 records). [2025-10-17T22:39:07.594002] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-17T22:39:07.596430] [INFO ] [MAIN ] Derivative Progress: 784/2083 symbols completed. GIC took 1.0s. Estimated remaining: 8m 14s. Rate: 157.9 symbols/min [2025-10-17T22:39:07.596723] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:07.598822] [DEBUG] [LOCAL ] GIB: Derivative data saved (1820 records). [2025-10-17T22:39:07.599365] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-17T22:39:07.602976] [INFO ] [MAIN ] Derivative Progress: 785/2083 symbols completed. GIB took 1.1s. Estimated remaining: 8m 13s. Rate: 158.1 symbols/min [2025-10-17T22:39:07.604151] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:07.618637] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:07.619364] [INFO ] [MAIN ] GIL: Generated 1820 derivative records from 44482 primary records. [2025-10-17T22:39:07.619473] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-17T22:39:07.638450] [DEBUG] [LOCAL ] GIL: Derivative data saved (1820 records). [2025-10-17T22:39:07.638733] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-17T22:39:07.640976] [INFO ] [MAIN ] Derivative Progress: 786/2083 symbols completed. GIL took 1.1s. Estimated remaining: 8m 12s. Rate: 158.2 symbols/min [2025-10-17T22:39:07.641330] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:07.689406] [DEBUG] [LOCAL ] GIS: Loaded 54452 existing records from primary storage. [2025-10-17T22:39:07.698078] [INFO ] [MAIN ] GIS: Loaded 54452 primary data records. [2025-10-17T22:39:07.788045] [DEBUG] [LOCAL ] GKOS: Loaded 43111 existing records from primary storage. [2025-10-17T22:39:07.799676] [INFO ] [MAIN ] GKOS: Loaded 43111 primary data records. [2025-10-17T22:39:07.821170] [DEBUG] [LOCAL ] GL: Loaded 38100 existing records from primary storage. [2025-10-17T22:39:07.863932] [INFO ] [MAIN ] GL: Loaded 38100 primary data records. [2025-10-17T22:39:08.718743] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:08.719894] [INFO ] [MAIN ] GIS: Generated 1820 derivative records from 54452 primary records. [2025-10-17T22:39:08.721176] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-17T22:39:08.759404] [DEBUG] [LOCAL ] GIS: Derivative data saved (1820 records). [2025-10-17T22:39:08.759901] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:08.760415] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-17T22:39:08.763468] [INFO ] [MAIN ] GKOS: Generated 1820 derivative records from 43111 primary records. [2025-10-17T22:39:08.762729] [INFO ] [MAIN ] Derivative Progress: 787/2083 symbols completed. GIS took 1.2s. Estimated remaining: 8m 13s. Rate: 157.9 symbols/min [2025-10-17T22:39:08.776186] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-17T22:39:08.776412] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:08.777791] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:08.787366] [INFO ] [MAIN ] GL: Generated 1820 derivative records from 38100 primary records. [2025-10-17T22:39:08.795207] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1820 records). [2025-10-17T22:39:08.795477] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-17T22:39:08.790264] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-17T22:39:08.798320] [INFO ] [MAIN ] Derivative Progress: 788/2083 symbols completed. GKOS took 1.2s. Estimated remaining: 8m 12s. Rate: 158.0 symbols/min [2025-10-17T22:39:08.798480] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:08.814978] [DEBUG] [LOCAL ] GL: Derivative data saved (1820 records). [2025-10-17T22:39:08.817057] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-17T22:39:08.819312] [INFO ] [MAIN ] Derivative Progress: 789/2083 symbols completed. GL took 1.2s. Estimated remaining: 8m 11s. Rate: 158.2 symbols/min [2025-10-17T22:39:08.819524] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:08.824341] [DEBUG] [LOCAL ] GLP: Loaded 9431 existing records from primary storage. [2025-10-17T22:39:08.824534] [INFO ] [MAIN ] GLP: Loaded 9431 primary data records. [2025-10-17T22:39:09.054517] [DEBUG] [LOCAL ] GLOB: Loaded 48655 existing records from primary storage. [2025-10-17T22:39:09.147039] [INFO ] [MAIN ] GLOB: Loaded 48655 primary data records. [2025-10-17T22:39:09.332449] [DEBUG] [LOCAL ] GLW: Loaded 54416 existing records from primary storage. [2025-10-17T22:39:09.342497] [INFO ] [MAIN ] GLW: Loaded 54416 primary data records. [2025-10-17T22:39:09.808045] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:09.809899] [INFO ] [MAIN ] GLP: Generated 1820 derivative records from 9431 primary records. [2025-10-17T22:39:09.812220] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-17T22:39:09.843186] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:09.844802] [INFO ] [MAIN ] GLOB: Generated 1820 derivative records from 48655 primary records. [2025-10-17T22:39:09.844892] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-17T22:39:09.844937] [DEBUG] [LOCAL ] GLP: Derivative data saved (1820 records). [2025-10-17T22:39:09.845079] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-17T22:39:09.848130] [INFO ] [MAIN ] Derivative Progress: 790/2083 symbols completed. GLP took 1.0s. Estimated remaining: 8m 11s. Rate: 157.9 symbols/min [2025-10-17T22:39:09.849144] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:09.866135] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1820 records). [2025-10-17T22:39:09.866474] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-17T22:39:09.868730] [INFO ] [MAIN ] Derivative Progress: 791/2083 symbols completed. GLOB took 1.1s. Estimated remaining: 8m 10s. Rate: 158.1 symbols/min [2025-10-17T22:39:09.869052] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:09.889479] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:09.890377] [INFO ] [MAIN ] GLW: Generated 1820 derivative records from 54416 primary records. [2025-10-17T22:39:09.890566] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-17T22:39:09.921792] [DEBUG] [LOCAL ] GLW: Derivative data saved (1820 records). [2025-10-17T22:39:09.922090] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-17T22:39:09.924268] [INFO ] [MAIN ] Derivative Progress: 792/2083 symbols completed. GLW took 1.1s. Estimated remaining: 8m 9s. Rate: 158.2 symbols/min [2025-10-17T22:39:09.924727] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:09.959292] [DEBUG] [LOCAL ] GM: Loaded 54509 existing records from primary storage. [2025-10-17T22:39:09.959578] [INFO ] [MAIN ] GM: Loaded 54509 primary data records. [2025-10-17T22:39:10.085851] [DEBUG] [LOCAL ] GME: Loaded 54561 existing records from primary storage. [2025-10-17T22:39:10.100423] [INFO ] [MAIN ] GME: Loaded 54561 primary data records. [2025-10-17T22:39:10.299762] [DEBUG] [LOCAL ] GMED: Loaded 48880 existing records from primary storage. [2025-10-17T22:39:10.452141] [INFO ] [MAIN ] GMED: Loaded 48880 primary data records. [2025-10-17T22:39:10.975912] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:10.977966] [INFO ] [MAIN ] GM: Generated 1820 derivative records from 54509 primary records. [2025-10-17T22:39:10.978142] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-17T22:39:10.999726] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:11.004447] [INFO ] [MAIN ] GME: Generated 1820 derivative records from 54561 primary records. [2025-10-17T22:39:11.006911] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-17T22:39:11.010540] [DEBUG] [LOCAL ] GM: Derivative data saved (1820 records). [2025-10-17T22:39:11.010916] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-17T22:39:11.021359] [INFO ] [MAIN ] Derivative Progress: 793/2083 symbols completed. GM took 1.2s. Estimated remaining: 8m 10s. Rate: 157.9 symbols/min [2025-10-17T22:39:11.030395] [DEBUG] [LOCAL ] GME: Derivative data saved (1820 records). [2025-10-17T22:39:11.030733] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-17T22:39:11.045173] [INFO ] [MAIN ] Derivative Progress: 794/2083 symbols completed. GME took 1.2s. Estimated remaining: 8m 9s. Rate: 158.1 symbols/min [2025-10-17T22:39:11.045738] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:11.046489] [INFO ] [MAIN ] GMED: Generated 1820 derivative records from 48880 primary records. [2025-10-17T22:39:11.046554] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-17T22:39:11.062193] [DEBUG] [LOCAL ] GMED: Derivative data saved (1820 records). [2025-10-17T22:39:11.062254] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-17T22:39:11.064535] [INFO ] [MAIN ] Derivative Progress: 795/2083 symbols completed. GMED took 1.1s. Estimated remaining: 8m 8s. Rate: 158.2 symbols/min [2025-10-17T22:39:11.065057] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:11.064994] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:11.065172] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:11.093800] [DEBUG] [LOCAL ] GNE: Loaded 18212 existing records from primary storage. [2025-10-17T22:39:11.093918] [INFO ] [MAIN ] GNE: Loaded 18212 primary data records. [2025-10-17T22:39:11.261110] [DEBUG] [LOCAL ] GNK: Loaded 40529 existing records from primary storage. [2025-10-17T22:39:11.291308] [DEBUG] [LOCAL ] GMRE: Loaded 37414 existing records from primary storage. [2025-10-17T22:39:11.288984] [INFO ] [MAIN ] GNK: Loaded 40529 primary data records. [2025-10-17T22:39:11.318266] [INFO ] [MAIN ] GMRE: Loaded 37414 primary data records. [2025-10-17T22:39:12.077187] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:12.078229] [INFO ] [MAIN ] GNE: Generated 1820 derivative records from 18212 primary records. [2025-10-17T22:39:12.079550] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-17T22:39:12.097273] [DEBUG] [LOCAL ] GNE: Derivative data saved (1820 records). [2025-10-17T22:39:12.097785] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-17T22:39:12.099871] [INFO ] [MAIN ] Derivative Progress: 796/2083 symbols completed. GNE took 1.0s. Estimated remaining: 8m 9s. Rate: 157.9 symbols/min [2025-10-17T22:39:12.100025] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:12.121452] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:12.122499] [INFO ] [MAIN ] GMRE: Generated 1820 derivative records from 37414 primary records. [2025-10-17T22:39:12.122665] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-17T22:39:12.152184] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1820 records). [2025-10-17T22:39:12.152392] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-17T22:39:12.154612] [INFO ] [MAIN ] Derivative Progress: 797/2083 symbols completed. GMRE took 1.1s. Estimated remaining: 8m 8s. Rate: 158.1 symbols/min [2025-10-17T22:39:12.147937] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:12.155863] [INFO ] [MAIN ] GNK: Generated 1820 derivative records from 40529 primary records. [2025-10-17T22:39:12.155985] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-17T22:39:12.154914] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:12.174469] [DEBUG] [LOCAL ] GNK: Derivative data saved (1820 records). [2025-10-17T22:39:12.174602] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-17T22:39:12.176935] [INFO ] [MAIN ] Derivative Progress: 798/2083 symbols completed. GNK took 1.1s. Estimated remaining: 8m 7s. Rate: 158.3 symbols/min [2025-10-17T22:39:12.177168] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:12.200441] [DEBUG] [LOCAL ] GNT: Loaded 8665 existing records from primary storage. [2025-10-17T22:39:12.201336] [INFO ] [MAIN ] GNT: Loaded 8665 primary data records. [2025-10-17T22:39:12.267036] [DEBUG] [LOCAL ] GNL: Loaded 47399 existing records from primary storage. [2025-10-17T22:39:12.272529] [INFO ] [MAIN ] GNL: Loaded 47399 primary data records. [2025-10-17T22:39:12.553026] [DEBUG] [LOCAL ] GNRC: Loaded 46194 existing records from primary storage. [2025-10-17T22:39:12.720917] [INFO ] [MAIN ] GNRC: Loaded 46194 primary data records. [2025-10-17T22:39:13.206170] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:13.207051] [INFO ] [MAIN ] GNT: Generated 1820 derivative records from 8665 primary records. [2025-10-17T22:39:13.207307] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-17T22:39:13.220508] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:13.221354] [INFO ] [MAIN ] GNL: Generated 1820 derivative records from 47399 primary records. [2025-10-17T22:39:13.221582] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-17T22:39:13.250591] [DEBUG] [LOCAL ] GNT: Derivative data saved (1820 records). [2025-10-17T22:39:13.250798] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-17T22:39:13.254204] [INFO ] [MAIN ] Derivative Progress: 799/2083 symbols completed. GNT took 1.1s. Estimated remaining: 8m 8s. Rate: 157.9 symbols/min [2025-10-17T22:39:13.254697] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:13.268226] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:13.269149] [INFO ] [MAIN ] GNRC: Generated 1820 derivative records from 46194 primary records. [2025-10-17T22:39:13.269300] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-17T22:39:13.279211] [DEBUG] [LOCAL ] GNL: Derivative data saved (1820 records). [2025-10-17T22:39:13.280212] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-17T22:39:13.282352] [INFO ] [MAIN ] Derivative Progress: 800/2083 symbols completed. GNL took 1.2s. Estimated remaining: 8m 7s. Rate: 158.1 symbols/min [2025-10-17T22:39:13.285081] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:13.290660] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1820 records). [2025-10-17T22:39:13.291258] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-17T22:39:13.294014] [INFO ] [MAIN ] Derivative Progress: 801/2083 symbols completed. GNRC took 1.1s. Estimated remaining: 8m 6s. Rate: 158.3 symbols/min [2025-10-17T22:39:13.294238] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:13.348877] [DEBUG] [LOCAL ] GNW: Loaded 52153 existing records from primary storage. [2025-10-17T22:39:13.349551] [INFO ] [MAIN ] GNW: Loaded 52153 primary data records. [2025-10-17T22:39:13.404639] [DEBUG] [LOCAL ] GOLF: Loaded 31259 existing records from primary storage. [2025-10-17T22:39:13.424289] [INFO ] [MAIN ] GOLF: Loaded 31259 primary data records. [2025-10-17T22:39:13.574602] [DEBUG] [LOCAL ] GOF: Loaded 43353 existing records from primary storage. [2025-10-17T22:39:13.630825] [INFO ] [MAIN ] GOF: Loaded 43353 primary data records. [2025-10-17T22:39:14.390401] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:14.391365] [INFO ] [MAIN ] GNW: Generated 1820 derivative records from 52153 primary records. [2025-10-17T22:39:14.391819] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-17T22:39:14.421326] [DEBUG] [LOCAL ] GNW: Derivative data saved (1820 records). [2025-10-17T22:39:14.426284] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-17T22:39:14.428951] [INFO ] [MAIN ] Derivative Progress: 802/2083 symbols completed. GNW took 1.2s. Estimated remaining: 8m 7s. Rate: 157.9 symbols/min [2025-10-17T22:39:14.426760] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:14.429360] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:14.430862] [INFO ] [MAIN ] GOLF: Generated 1820 derivative records from 31259 primary records. [2025-10-17T22:39:14.431114] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-17T22:39:14.448998] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1820 records). [2025-10-17T22:39:14.449975] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-17T22:39:14.452542] [INFO ] [MAIN ] Derivative Progress: 803/2083 symbols completed. GOLF took 1.2s. Estimated remaining: 8m 6s. Rate: 158.1 symbols/min [2025-10-17T22:39:14.452816] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:14.467228] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:14.468118] [INFO ] [MAIN ] GOF: Generated 1820 derivative records from 43353 primary records. [2025-10-17T22:39:14.468344] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-17T22:39:14.485984] [DEBUG] [LOCAL ] GOF: Derivative data saved (1820 records). [2025-10-17T22:39:14.486866] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-17T22:39:14.489292] [INFO ] [MAIN ] Derivative Progress: 804/2083 symbols completed. GOF took 1.2s. Estimated remaining: 8m 5s. Rate: 158.2 symbols/min [2025-10-17T22:39:14.489513] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:14.540334] [DEBUG] [LOCAL ] GOTU: Loaded 37702 existing records from primary storage. [2025-10-17T22:39:14.542281] [INFO ] [MAIN ] GOTU: Loaded 37702 primary data records. [2025-10-17T22:39:14.542054] [DEBUG] [LOCAL ] GOOS: Loaded 45143 existing records from primary storage. [2025-10-17T22:39:14.542865] [INFO ] [MAIN ] GOOS: Loaded 45143 primary data records. [2025-10-17T22:39:14.824325] [DEBUG] [LOCAL ] GPC: Loaded 46707 existing records from primary storage. [2025-10-17T22:39:14.993687] [INFO ] [MAIN ] GPC: Loaded 46707 primary data records. [2025-10-17T22:39:15.489492] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:15.490597] [INFO ] [MAIN ] GOOS: Generated 1820 derivative records from 45143 primary records. [2025-10-17T22:39:15.491896] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-17T22:39:15.521896] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:15.523801] [INFO ] [MAIN ] GOTU: Generated 1820 derivative records from 37702 primary records. [2025-10-17T22:39:15.524011] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-17T22:39:15.526195] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1820 records). [2025-10-17T22:39:15.527274] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-17T22:39:15.529689] [INFO ] [MAIN ] Derivative Progress: 805/2083 symbols completed. GOOS took 1.1s. Estimated remaining: 8m 6s. Rate: 157.9 symbols/min [2025-10-17T22:39:15.545879] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1820 records). [2025-10-17T22:39:15.541308] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:15.546988] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-17T22:39:15.549394] [INFO ] [MAIN ] Derivative Progress: 806/2083 symbols completed. GOTU took 1.1s. Estimated remaining: 8m 5s. Rate: 158.1 symbols/min [2025-10-17T22:39:15.551209] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:15.566190] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:15.567111] [INFO ] [MAIN ] GPC: Generated 1820 derivative records from 46707 primary records. [2025-10-17T22:39:15.572448] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-17T22:39:15.583858] [DEBUG] [LOCAL ] GPJA: Loaded 4230 existing records from primary storage. [2025-10-17T22:39:15.596619] [INFO ] [MAIN ] GPJA: Loaded 4230 primary data records. [2025-10-17T22:39:15.612628] [DEBUG] [LOCAL ] GPC: Derivative data saved (1820 records). [2025-10-17T22:39:15.612005] [DEBUG] [LOCAL ] GPI: Loaded 15097 existing records from primary storage. [2025-10-17T22:39:15.612885] [INFO ] [MAIN ] GPI: Loaded 15097 primary data records. [2025-10-17T22:39:15.612818] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-10-17T22:39:15.615193] [INFO ] [MAIN ] Derivative Progress: 807/2083 symbols completed. GPC took 1.1s. Estimated remaining: 8m 4s. Rate: 158.2 symbols/min [2025-10-17T22:39:15.671914] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:16.282761] [DEBUG] [LOCAL ] GPK: Loaded 53548 existing records from primary storage. [2025-10-17T22:39:16.283015] [INFO ] [MAIN ] GPK: Loaded 53548 primary data records. [2025-10-17T22:39:16.593708] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:16.594896] [INFO ] [MAIN ] GPJA: Generated 1820 derivative records from 4230 primary records. [2025-10-17T22:39:16.596861] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-17T22:39:16.625412] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1820 records). [2025-10-17T22:39:16.625538] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-17T22:39:16.625025] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:16.626322] [INFO ] [MAIN ] GPI: Generated 1820 derivative records from 15097 primary records. [2025-10-17T22:39:16.628411] [INFO ] [MAIN ] Derivative Progress: 808/2083 symbols completed. GPJA took 1.1s. Estimated remaining: 8m 4s. Rate: 157.9 symbols/min [2025-10-17T22:39:16.628580] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-17T22:39:16.645720] [DEBUG] [LOCAL ] GPI: Derivative data saved (1820 records). [2025-10-17T22:39:16.645927] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-17T22:39:16.648143] [INFO ] [MAIN ] Derivative Progress: 809/2083 symbols completed. GPI took 1.1s. Estimated remaining: 8m 3s. Rate: 158.1 symbols/min [2025-10-17T22:39:16.665018] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:16.665547] [INFO ] [MAIN ] GPK: Generated 1820 derivative records from 53548 primary records. [2025-10-17T22:39:16.665605] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-17T22:39:16.680783] [DEBUG] [LOCAL ] GPK: Derivative data saved (1820 records). [2025-10-17T22:39:16.680843] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-17T22:39:16.683051] [INFO ] [MAIN ] Derivative Progress: 810/2083 symbols completed. GPK took 1.0s. Estimated remaining: 8m 3s. Rate: 158.3 symbols/min [2025-10-17T22:39:16.683409] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:16.683712] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:16.683533] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:16.734637] [DEBUG] [LOCAL ] GPMT: Loaded 26215 existing records from primary storage. [2025-10-17T22:39:16.734142] [DEBUG] [LOCAL ] GPOR: Loaded 23691 existing records from primary storage. [2025-10-17T22:39:16.734913] [INFO ] [MAIN ] GPMT: Loaded 26215 primary data records. [2025-10-17T22:39:16.735085] [INFO ] [MAIN ] GPOR: Loaded 23691 primary data records. [2025-10-17T22:39:16.986115] [DEBUG] [LOCAL ] GPN: Loaded 52716 existing records from primary storage. [2025-10-17T22:39:16.992939] [INFO ] [MAIN ] GPN: Loaded 52716 primary data records. [2025-10-17T22:39:17.731322] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:17.733805] [INFO ] [MAIN ] GPMT: Generated 1820 derivative records from 26215 primary records. [2025-10-17T22:39:17.734000] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-17T22:39:17.763491] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:17.766734] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1820 records). [2025-10-17T22:39:17.767708] [INFO ] [MAIN ] GPOR: Generated 1820 derivative records from 23691 primary records. [2025-10-17T22:39:17.775443] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-17T22:39:17.780363] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-17T22:39:17.780842] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:17.782933] [INFO ] [MAIN ] Derivative Progress: 811/2083 symbols completed. GPMT took 1.1s. Estimated remaining: 8m 3s. Rate: 157.9 symbols/min [2025-10-17T22:39:17.783780] [INFO ] [MAIN ] GPN: Generated 1820 derivative records from 52716 primary records. [2025-10-17T22:39:17.783955] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:17.784829] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-17T22:39:17.817100] [DEBUG] [LOCAL ] GPN: Derivative data saved (1820 records). [2025-10-17T22:39:17.820459] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-17T22:39:17.821857] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1820 records). [2025-10-17T22:39:17.824099] [INFO ] [MAIN ] Derivative Progress: 812/2083 symbols completed. GPN took 1.1s. Estimated remaining: 8m 2s. Rate: 158.1 symbols/min [2025-10-17T22:39:17.824533] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-17T22:39:17.824451] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:17.827453] [INFO ] [MAIN ] Derivative Progress: 813/2083 symbols completed. GPOR took 1.1s. Estimated remaining: 8m 1s. Rate: 158.3 symbols/min [2025-10-17T22:39:17.827745] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:17.856231] [DEBUG] [LOCAL ] GRC: Loaded 9440 existing records from primary storage. [2025-10-17T22:39:17.856355] [INFO ] [MAIN ] GRC: Loaded 9440 primary data records. [2025-10-17T22:39:17.997528] [DEBUG] [LOCAL ] GRBK: Loaded 27388 existing records from primary storage. [2025-10-17T22:39:17.997069] [DEBUG] [LOCAL ] GPRK: Loaded 40348 existing records from primary storage. [2025-10-17T22:39:17.997792] [INFO ] [MAIN ] GPRK: Loaded 40348 primary data records. [2025-10-17T22:39:17.997989] [INFO ] [MAIN ] GRBK: Loaded 27388 primary data records. [2025-10-17T22:39:18.872795] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:18.873891] [INFO ] [MAIN ] GRC: Generated 1820 derivative records from 9440 primary records. [2025-10-17T22:39:18.874165] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-17T22:39:18.893967] [DEBUG] [LOCAL ] GRC: Derivative data saved (1820 records). [2025-10-17T22:39:18.894359] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-17T22:39:18.896531] [INFO ] [MAIN ] Derivative Progress: 814/2083 symbols completed. GRC took 1.1s. Estimated remaining: 8m 2s. Rate: 157.9 symbols/min [2025-10-17T22:39:18.896711] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:18.913503] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:18.914360] [INFO ] [MAIN ] GPRK: Generated 1820 derivative records from 40348 primary records. [2025-10-17T22:39:18.914519] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-17T22:39:18.928012] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:18.935542] [INFO ] [MAIN ] GRBK: Generated 1820 derivative records from 27388 primary records. [2025-10-17T22:39:18.935755] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-17T22:39:18.950106] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1820 records). [2025-10-17T22:39:18.950252] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-17T22:39:18.952552] [INFO ] [MAIN ] Derivative Progress: 815/2083 symbols completed. GPRK took 1.2s. Estimated remaining: 8m 1s. Rate: 158.1 symbols/min [2025-10-17T22:39:18.961207] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:18.968473] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1820 records). [2025-10-17T22:39:18.975069] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-17T22:39:18.978764] [INFO ] [MAIN ] Derivative Progress: 816/2083 symbols completed. GRBK took 1.2s. Estimated remaining: 8m 0s. Rate: 158.3 symbols/min [2025-10-17T22:39:18.979031] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:18.979911] [DEBUG] [LOCAL ] GRDN: Loaded 21216 existing records from primary storage. [2025-10-17T22:39:18.980145] [INFO ] [MAIN ] GRDN: Loaded 21216 primary data records. [2025-10-17T22:39:19.340859] [DEBUG] [LOCAL ] GRMN: Loaded 40933 existing records from primary storage. [2025-10-17T22:39:19.343024] [INFO ] [MAIN ] GRMN: Loaded 40933 primary data records. [2025-10-17T22:39:19.342717] [DEBUG] [LOCAL ] GRND: Loaded 50893 existing records from primary storage. [2025-10-17T22:39:19.343492] [INFO ] [MAIN ] GRND: Loaded 50893 primary data records. [2025-10-17T22:39:19.979351] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:19.980687] [INFO ] [MAIN ] GRDN: Generated 1820 derivative records from 21216 primary records. [2025-10-17T22:39:19.981150] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-17T22:39:20.001161] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1820 records). [2025-10-17T22:39:20.001996] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-17T22:39:20.004946] [INFO ] [MAIN ] Derivative Progress: 817/2083 symbols completed. GRDN took 1.1s. Estimated remaining: 8m 1s. Rate: 157.9 symbols/min [2025-10-17T22:39:20.005443] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:20.055108] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:20.055461] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:20.065132] [INFO ] [MAIN ] GRMN: Generated 1820 derivative records from 40933 primary records. [2025-10-17T22:39:20.066218] [INFO ] [MAIN ] GRND: Generated 1820 derivative records from 50893 primary records. [2025-10-17T22:39:20.066472] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-17T22:39:20.066595] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-17T22:39:20.095032] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1820 records). [2025-10-17T22:39:20.109206] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-17T22:39:20.099601] [DEBUG] [LOCAL ] GRND: Derivative data saved (1820 records). [2025-10-17T22:39:20.113895] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-17T22:39:20.113753] [INFO ] [MAIN ] Derivative Progress: 818/2083 symbols completed. GRMN took 1.2s. Estimated remaining: 8m 0s. Rate: 158.1 symbols/min [2025-10-17T22:39:20.117837] [DEBUG] [LOCAL ] GRNT: Loaded 34443 existing records from primary storage. [2025-10-17T22:39:20.116527] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:20.116690] [INFO ] [MAIN ] Derivative Progress: 819/2083 symbols completed. GRND took 1.1s. Estimated remaining: 7m 59s. Rate: 158.3 symbols/min [2025-10-17T22:39:20.118542] [INFO ] [MAIN ] GRNT: Loaded 34443 primary data records. [2025-10-17T22:39:20.118722] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:20.246172] [DEBUG] [LOCAL ] GROV: Loaded 8805 existing records from primary storage. [2025-10-17T22:39:20.238297] [DEBUG] [LOCAL ] GRX: Loaded 4862 existing records from primary storage. [2025-10-17T22:39:20.249537] [INFO ] [MAIN ] GRX: Loaded 4862 primary data records. [2025-10-17T22:39:20.255286] [INFO ] [MAIN ] GROV: Loaded 8805 primary data records. [2025-10-17T22:39:21.152029] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:21.154148] [INFO ] [MAIN ] GRNT: Generated 1820 derivative records from 34443 primary records. [2025-10-17T22:39:21.154334] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-17T22:39:21.174408] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:21.175484] [INFO ] [MAIN ] GRX: Generated 1820 derivative records from 4862 primary records. [2025-10-17T22:39:21.176991] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-17T22:39:21.184460] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1820 records). [2025-10-17T22:39:21.190740] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-17T22:39:21.193007] [INFO ] [MAIN ] Derivative Progress: 820/2083 symbols completed. GRNT took 1.2s. Estimated remaining: 7m 60s. Rate: 157.9 symbols/min [2025-10-17T22:39:21.193455] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:21.202667] [DEBUG] [LOCAL ] GRX: Derivative data saved (1820 records). [2025-10-17T22:39:21.204057] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-17T22:39:21.206528] [INFO ] [MAIN ] Derivative Progress: 821/2083 symbols completed. GRX took 1.1s. Estimated remaining: 7m 59s. Rate: 158.1 symbols/min [2025-10-17T22:39:21.208702] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:21.222811] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:21.224478] [INFO ] [MAIN ] GROV: Generated 1820 derivative records from 8805 primary records. [2025-10-17T22:39:21.224596] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-17T22:39:21.240864] [DEBUG] [LOCAL ] GROV: Derivative data saved (1820 records). [2025-10-17T22:39:21.241135] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-17T22:39:21.244132] [INFO ] [MAIN ] Derivative Progress: 822/2083 symbols completed. GROV took 1.1s. Estimated remaining: 7m 58s. Rate: 158.3 symbols/min [2025-10-17T22:39:21.244358] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:21.289135] [DEBUG] [LOCAL ] GSBD: Loaded 40293 existing records from primary storage. [2025-10-17T22:39:21.289493] [INFO ] [MAIN ] GSBD: Loaded 40293 primary data records. [2025-10-17T22:39:21.436073] [DEBUG] [LOCAL ] GS: Loaded 52558 existing records from primary storage. [2025-10-17T22:39:21.492209] [INFO ] [MAIN ] GS: Loaded 52558 primary data records. [2025-10-17T22:39:21.676789] [DEBUG] [LOCAL ] GSK: Loaded 54285 existing records from primary storage. [2025-10-17T22:39:21.688712] [INFO ] [MAIN ] GSK: Loaded 54285 primary data records. [2025-10-17T22:39:22.360699] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:22.361834] [INFO ] [MAIN ] GSBD: Generated 1820 derivative records from 40293 primary records. [2025-10-17T22:39:22.362387] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-17T22:39:22.383233] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1820 records). [2025-10-17T22:39:22.383511] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-17T22:39:22.386228] [INFO ] [MAIN ] Derivative Progress: 823/2083 symbols completed. GSBD took 1.2s. Estimated remaining: 7m 59s. Rate: 157.9 symbols/min [2025-10-17T22:39:22.402815] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:22.404508] [INFO ] [MAIN ] GS: Generated 1820 derivative records from 52558 primary records. [2025-10-17T22:39:22.405386] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-17T22:39:22.438862] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:22.441377] [INFO ] [MAIN ] GSK: Generated 1820 derivative records from 54285 primary records. [2025-10-17T22:39:22.442137] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-17T22:39:22.442064] [DEBUG] [LOCAL ] GS: Derivative data saved (1820 records). [2025-10-17T22:39:22.442542] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-17T22:39:22.445207] [INFO ] [MAIN ] Derivative Progress: 824/2083 symbols completed. GS took 1.3s. Estimated remaining: 7m 58s. Rate: 158.0 symbols/min [2025-10-17T22:39:22.460742] [DEBUG] [LOCAL ] GSK: Derivative data saved (1820 records). [2025-10-17T22:39:22.460815] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-17T22:39:22.463398] [INFO ] [MAIN ] Derivative Progress: 825/2083 symbols completed. GSK took 1.2s. Estimated remaining: 7m 57s. Rate: 158.2 symbols/min [2025-10-17T22:39:22.464048] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:22.464114] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:22.463954] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:22.516159] [DEBUG] [LOCAL ] GSL: Loaded 33725 existing records from primary storage. [2025-10-17T22:39:22.530018] [INFO ] [MAIN ] GSL: Loaded 33725 primary data records. [2025-10-17T22:39:22.659630] [DEBUG] [LOCAL ] GTES: Loaded 51134 existing records from primary storage. [2025-10-17T22:39:22.671000] [INFO ] [MAIN ] GTES: Loaded 51134 primary data records. [2025-10-17T22:39:22.665598] [DEBUG] [LOCAL ] GTLS: Loaded 43892 existing records from primary storage. [2025-10-17T22:39:22.671313] [INFO ] [MAIN ] GTLS: Loaded 43892 primary data records. [2025-10-17T22:39:23.495669] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:23.496959] [INFO ] [MAIN ] GSL: Generated 1820 derivative records from 33725 primary records. [2025-10-17T22:39:23.497403] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-17T22:39:23.516882] [DEBUG] [LOCAL ] GSL: Derivative data saved (1820 records). [2025-10-17T22:39:23.517191] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-17T22:39:23.520041] [INFO ] [MAIN ] Derivative Progress: 826/2083 symbols completed. GSL took 1.1s. Estimated remaining: 7m 58s. Rate: 157.9 symbols/min [2025-10-17T22:39:23.521015] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:23.550940] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:23.550767] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:23.552342] [INFO ] [MAIN ] GTES: Generated 1820 derivative records from 51134 primary records. [2025-10-17T22:39:23.551751] [INFO ] [MAIN ] GTLS: Generated 1820 derivative records from 43892 primary records. [2025-10-17T22:39:23.552507] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-17T22:39:23.553185] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-17T22:39:23.584927] [DEBUG] [LOCAL ] GTES: Derivative data saved (1820 records). [2025-10-17T22:39:23.585106] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-17T22:39:23.590616] [INFO ] [MAIN ] Derivative Progress: 827/2083 symbols completed. GTES took 1.1s. Estimated remaining: 7m 57s. Rate: 158.0 symbols/min [2025-10-17T22:39:23.592686] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:23.592556] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1820 records). [2025-10-17T22:39:23.593006] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-17T22:39:23.595791] [INFO ] [MAIN ] Derivative Progress: 828/2083 symbols completed. GTLS took 1.1s. Estimated remaining: 7m 56s. Rate: 158.2 symbols/min [2025-10-17T22:39:23.595953] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:23.653975] [DEBUG] [LOCAL ] GUG: Loaded 12286 existing records from primary storage. [2025-10-17T22:39:23.654134] [INFO ] [MAIN ] GUG: Loaded 12286 primary data records. [2025-10-17T22:39:23.708698] [DEBUG] [LOCAL ] GTY: Loaded 30765 existing records from primary storage. [2025-10-17T22:39:23.710124] [DEBUG] [LOCAL ] GTN: Loaded 45765 existing records from primary storage. [2025-10-17T22:39:23.736608] [INFO ] [MAIN ] GTY: Loaded 30765 primary data records. [2025-10-17T22:39:23.731117] [INFO ] [MAIN ] GTN: Loaded 45765 primary data records. [2025-10-17T22:39:24.922170] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:24.923141] [INFO ] [MAIN ] GUG: Generated 1820 derivative records from 12286 primary records. [2025-10-17T22:39:24.923377] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-17T22:39:24.940943] [DEBUG] [LOCAL ] GUG: Derivative data saved (1820 records). [2025-10-17T22:39:24.941314] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-17T22:39:24.943222] [INFO ] [MAIN ] Derivative Progress: 829/2083 symbols completed. GUG took 1.3s. Estimated remaining: 7m 57s. Rate: 157.7 symbols/min [2025-10-17T22:39:24.945764] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:24.961892] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:24.962920] [INFO ] [MAIN ] GTN: Generated 1820 derivative records from 45765 primary records. [2025-10-17T22:39:24.963043] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-17T22:39:24.987612] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:24.991816] [DEBUG] [LOCAL ] GTN: Derivative data saved (1820 records). [2025-10-17T22:39:24.996180] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-17T22:39:24.998536] [INFO ] [MAIN ] Derivative Progress: 830/2083 symbols completed. GTN took 1.5s. Estimated remaining: 7m 56s. Rate: 157.9 symbols/min [2025-10-17T22:39:24.998788] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:24.992559] [INFO ] [MAIN ] GTY: Generated 1820 derivative records from 30765 primary records. [2025-10-17T22:39:24.998934] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-17T22:39:25.013269] [DEBUG] [LOCAL ] GUT: Loaded 15859 existing records from primary storage. [2025-10-17T22:39:25.016902] [INFO ] [MAIN ] GUT: Loaded 15859 primary data records. [2025-10-17T22:39:25.032627] [DEBUG] [LOCAL ] GTY: Derivative data saved (1820 records). [2025-10-17T22:39:25.032756] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-17T22:39:25.054409] [INFO ] [MAIN ] Derivative Progress: 831/2083 symbols completed. GTY took 1.5s. Estimated remaining: 7m 55s. Rate: 158.1 symbols/min [2025-10-17T22:39:25.059693] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:25.319704] [DEBUG] [LOCAL ] GWH: Loaded 19414 existing records from primary storage. [2025-10-17T22:39:25.333678] [INFO ] [MAIN ] GWH: Loaded 19414 primary data records. [2025-10-17T22:39:25.376588] [DEBUG] [LOCAL ] GVA: Loaded 33145 existing records from primary storage. [2025-10-17T22:39:25.415565] [INFO ] [MAIN ] GVA: Loaded 33145 primary data records. [2025-10-17T22:39:25.972941] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:25.974748] [INFO ] [MAIN ] GUT: Generated 1820 derivative records from 15859 primary records. [2025-10-17T22:39:25.974986] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-17T22:39:26.002922] [DEBUG] [LOCAL ] GUT: Derivative data saved (1820 records). [2025-10-17T22:39:26.003915] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-17T22:39:26.006196] [INFO ] [MAIN ] Derivative Progress: 832/2083 symbols completed. GUT took 1.1s. Estimated remaining: 7m 56s. Rate: 157.8 symbols/min [2025-10-17T22:39:26.006708] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:26.020921] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:26.021682] [INFO ] [MAIN ] GWH: Generated 1820 derivative records from 19414 primary records. [2025-10-17T22:39:26.021767] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-17T22:39:26.049182] [DEBUG] [LOCAL ] GWH: Derivative data saved (1820 records). [2025-10-17T22:39:26.054663] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-17T22:39:26.054561] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:26.057058] [INFO ] [MAIN ] Derivative Progress: 833/2083 symbols completed. GWH took 1.0s. Estimated remaining: 7m 55s. Rate: 157.9 symbols/min [2025-10-17T22:39:26.057935] [INFO ] [MAIN ] GVA: Generated 1820 derivative records from 33145 primary records. [2025-10-17T22:39:26.058388] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-17T22:39:26.058132] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:26.075422] [DEBUG] [LOCAL ] GVA: Derivative data saved (1820 records). [2025-10-17T22:39:26.075528] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-17T22:39:26.077733] [INFO ] [MAIN ] Derivative Progress: 834/2083 symbols completed. GVA took 1.1s. Estimated remaining: 7m 54s. Rate: 158.1 symbols/min [2025-10-17T22:39:26.078009] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:26.113211] [DEBUG] [LOCAL ] GWW: Loaded 19822 existing records from primary storage. [2025-10-17T22:39:26.114881] [INFO ] [MAIN ] GWW: Loaded 19822 primary data records. [2025-10-17T22:39:26.136626] [DEBUG] [LOCAL ] GWRE: Loaded 40437 existing records from primary storage. [2025-10-17T22:39:26.153308] [INFO ] [MAIN ] GWRE: Loaded 40437 primary data records. [2025-10-17T22:39:26.443446] [DEBUG] [LOCAL ] GXO: Loaded 47418 existing records from primary storage. [2025-10-17T22:39:26.447710] [INFO ] [MAIN ] GXO: Loaded 47418 primary data records. [2025-10-17T22:39:27.166132] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:27.167183] [INFO ] [MAIN ] GWW: Generated 1820 derivative records from 19822 primary records. [2025-10-17T22:39:27.168785] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-17T22:39:27.189898] [DEBUG] [LOCAL ] GWW: Derivative data saved (1820 records). [2025-10-17T22:39:27.202944] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-17T22:39:27.205062] [INFO ] [MAIN ] Derivative Progress: 835/2083 symbols completed. GWW took 1.1s. Estimated remaining: 7m 55s. Rate: 157.8 symbols/min [2025-10-17T22:39:27.206016] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:27.205686] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:27.207209] [INFO ] [MAIN ] GWRE: Generated 1820 derivative records from 40437 primary records. [2025-10-17T22:39:27.207621] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-17T22:39:27.229782] [DEBUG] [LOCAL ] GYLD: Loaded 1562 existing records from primary storage. [2025-10-17T22:39:27.231846] [INFO ] [MAIN ] GYLD: Loaded 1562 primary data records. [2025-10-17T22:39:27.244503] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1820 records). [2025-10-17T22:39:27.282721] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-10-17T22:39:27.292133] [INFO ] [MAIN ] Derivative Progress: 836/2083 symbols completed. GWRE took 1.3s. Estimated remaining: 7m 54s. Rate: 157.9 symbols/min [2025-10-17T22:39:27.313109] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:27.331171] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:27.342482] [INFO ] [MAIN ] GXO: Generated 1820 derivative records from 47418 primary records. [2025-10-17T22:39:27.352980] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-17T22:39:27.560173] [DEBUG] [LOCAL ] GXO: Derivative data saved (1820 records). [2025-10-17T22:39:27.560393] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-10-17T22:39:27.562735] [INFO ] [MAIN ] Derivative Progress: 837/2083 symbols completed. GXO took 1.5s. Estimated remaining: 7m 53s. Rate: 158.0 symbols/min [2025-10-17T22:39:27.562998] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:27.606764] [DEBUG] [LOCAL ] H: Loaded 45047 existing records from primary storage. [2025-10-17T22:39:27.607148] [INFO ] [MAIN ] H: Loaded 45047 primary data records. [2025-10-17T22:39:27.620255] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:27.656842] [INFO ] [MAIN ] GYLD: Generated 1820 derivative records from 1562 primary records. [2025-10-17T22:39:27.687259] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-17T22:39:27.730428] [DEBUG] [LOCAL ] HAE: Loaded 40001 existing records from primary storage. [2025-10-17T22:39:27.734104] [INFO ] [MAIN ] HAE: Loaded 40001 primary data records. [2025-10-17T22:39:27.919510] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1820 records). [2025-10-17T22:39:27.930199] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-10-17T22:39:28.047505] [INFO ] [MAIN ] Derivative Progress: 838/2083 symbols completed. GYLD took 0.8s. Estimated remaining: 7m 53s. Rate: 157.9 symbols/min [2025-10-17T22:39:28.281012] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:28.281863] [INFO ] [MAIN ] H: Generated 1820 derivative records from 45047 primary records. [2025-10-17T22:39:28.282017] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-10-17T22:39:28.298788] [DEBUG] [LOCAL ] H: Derivative data saved (1820 records). [2025-10-17T22:39:28.298884] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-10-17T22:39:28.301840] [INFO ] [MAIN ] Derivative Progress: 839/2083 symbols completed. H took 1.0s. Estimated remaining: 7m 53s. Rate: 158.0 symbols/min [2025-10-17T22:39:28.316795] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:28.317420] [INFO ] [MAIN ] HAE: Generated 1820 derivative records from 40001 primary records. [2025-10-17T22:39:28.317479] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-10-17T22:39:28.332924] [DEBUG] [LOCAL ] HAE: Derivative data saved (1820 records). [2025-10-17T22:39:28.332983] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-10-17T22:39:28.335209] [INFO ] [MAIN ] Derivative Progress: 840/2083 symbols completed. HAE took 0.8s. Estimated remaining: 7m 52s. Rate: 158.1 symbols/min [2025-10-17T22:39:28.335747] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:28.335679] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:28.335816] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:28.401766] [DEBUG] [LOCAL ] HAFN: Loaded 43553 existing records from primary storage. [2025-10-17T22:39:28.402039] [INFO ] [MAIN ] HAFN: Loaded 43553 primary data records. [2025-10-17T22:39:28.403083] [DEBUG] [LOCAL ] HASI: Loaded 48399 existing records from primary storage. [2025-10-17T22:39:28.403226] [INFO ] [MAIN ] HASI: Loaded 48399 primary data records. [2025-10-17T22:39:28.673740] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-10-17T22:39:28.713286] [INFO ] [MAIN ] HAL: Loaded 54498 primary data records. [2025-10-17T22:39:29.421919] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:29.423836] [INFO ] [MAIN ] HASI: Generated 1820 derivative records from 48399 primary records. [2025-10-17T22:39:29.425995] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-17T22:39:29.458046] [DEBUG] [LOCAL ] HASI: Derivative data saved (1820 records). [2025-10-17T22:39:29.457140] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:29.459228] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-10-17T22:39:29.459139] [INFO ] [MAIN ] HAFN: Generated 1820 derivative records from 43553 primary records. [2025-10-17T22:39:29.459770] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-17T22:39:29.462080] [INFO ] [MAIN ] Derivative Progress: 841/2083 symbols completed. HASI took 1.1s. Estimated remaining: 7m 52s. Rate: 157.8 symbols/min [2025-10-17T22:39:29.463115] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:29.481378] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1820 records). [2025-10-17T22:39:29.482509] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-10-17T22:39:29.485582] [INFO ] [MAIN ] Derivative Progress: 842/2083 symbols completed. HAFN took 1.1s. Estimated remaining: 7m 51s. Rate: 157.9 symbols/min [2025-10-17T22:39:29.486257] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:29.499766] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:29.500581] [INFO ] [MAIN ] HAL: Generated 1820 derivative records from 54498 primary records. [2025-10-17T22:39:29.500805] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-17T22:39:29.521258] [DEBUG] [LOCAL ] HAL: Derivative data saved (1820 records). [2025-10-17T22:39:29.521459] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-10-17T22:39:29.523981] [INFO ] [MAIN ] Derivative Progress: 843/2083 symbols completed. HAL took 1.2s. Estimated remaining: 7m 51s. Rate: 158.1 symbols/min [2025-10-17T22:39:29.524222] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:29.541281] [DEBUG] [LOCAL ] HBB: Loaded 6540 existing records from primary storage. [2025-10-17T22:39:29.541686] [INFO ] [MAIN ] HBB: Loaded 6540 primary data records. [2025-10-17T22:39:29.873965] [DEBUG] [LOCAL ] HAYW: Loaded 49622 existing records from primary storage. [2025-10-17T22:39:29.874867] [INFO ] [MAIN ] HAYW: Loaded 49622 primary data records. [2025-10-17T22:39:29.993693] [DEBUG] [LOCAL ] HBI: Loaded 53738 existing records from primary storage. [2025-10-17T22:39:29.999332] [INFO ] [MAIN ] HBI: Loaded 53738 primary data records. [2025-10-17T22:39:30.350399] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:30.384207] [INFO ] [MAIN ] HBB: Generated 1820 derivative records from 6540 primary records. [2025-10-17T22:39:30.389468] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-10-17T22:39:30.567559] [DEBUG] [LOCAL ] HBB: Derivative data saved (1820 records). [2025-10-17T22:39:30.568803] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-10-17T22:39:30.570881] [INFO ] [MAIN ] Derivative Progress: 844/2083 symbols completed. HBB took 1.1s. Estimated remaining: 7m 51s. Rate: 157.8 symbols/min [2025-10-17T22:39:30.571326] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:30.592591] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:30.593407] [INFO ] [MAIN ] HAYW: Generated 1820 derivative records from 49622 primary records. [2025-10-17T22:39:30.593499] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-17T22:39:30.634485] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1820 records). [2025-10-17T22:39:30.646779] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-10-17T22:39:30.649048] [INFO ] [MAIN ] Derivative Progress: 845/2083 symbols completed. HAYW took 1.2s. Estimated remaining: 7m 50s. Rate: 157.9 symbols/min [2025-10-17T22:39:30.649495] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:30.649609] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:30.650990] [INFO ] [MAIN ] HBI: Generated 1820 derivative records from 53738 primary records. [2025-10-17T22:39:30.651060] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-17T22:39:30.680480] [DEBUG] [LOCAL ] HBI: Derivative data saved (1820 records). [2025-10-17T22:39:30.680693] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-10-17T22:39:30.683356] [INFO ] [MAIN ] Derivative Progress: 846/2083 symbols completed. HBI took 1.2s. Estimated remaining: 7m 49s. Rate: 158.1 symbols/min [2025-10-17T22:39:30.683685] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:30.706076] [DEBUG] [LOCAL ] HBM: Loaded 53738 existing records from primary storage. [2025-10-17T22:39:30.706352] [INFO ] [MAIN ] HBM: Loaded 53738 primary data records. [2025-10-17T22:39:30.934342] [DEBUG] [LOCAL ] HCC: Loaded 45791 existing records from primary storage. [2025-10-17T22:39:31.041895] [DEBUG] [LOCAL ] HCA: Loaded 47654 existing records from primary storage. [2025-10-17T22:39:31.050371] [INFO ] [MAIN ] HCC: Loaded 45791 primary data records. [2025-10-17T22:39:31.051191] [INFO ] [MAIN ] HCA: Loaded 47654 primary data records. [2025-10-17T22:39:31.697916] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:31.699235] [INFO ] [MAIN ] HBM: Generated 1820 derivative records from 53738 primary records. [2025-10-17T22:39:31.699350] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-10-17T22:39:31.719936] [DEBUG] [LOCAL ] HBM: Derivative data saved (1820 records). [2025-10-17T22:39:31.720153] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-10-17T22:39:31.723119] [INFO ] [MAIN ] Derivative Progress: 847/2083 symbols completed. HBM took 1.2s. Estimated remaining: 7m 50s. Rate: 157.8 symbols/min [2025-10-17T22:39:31.723552] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:31.758200] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:31.763222] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:31.762940] [INFO ] [MAIN ] HCA: Generated 1820 derivative records from 47654 primary records. [2025-10-17T22:39:31.763333] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-17T22:39:31.764055] [INFO ] [MAIN ] HCC: Generated 1820 derivative records from 45791 primary records. [2025-10-17T22:39:31.764856] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-17T22:39:31.799212] [DEBUG] [LOCAL ] HCI: Loaded 14354 existing records from primary storage. [2025-10-17T22:39:31.805265] [INFO ] [MAIN ] HCI: Loaded 14354 primary data records. [2025-10-17T22:39:31.805159] [DEBUG] [LOCAL ] HCA: Derivative data saved (1820 records). [2025-10-17T22:39:31.827635] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-10-17T22:39:31.858561] [DEBUG] [LOCAL ] HCC: Derivative data saved (1820 records). [2025-10-17T22:39:31.858011] [INFO ] [MAIN ] Derivative Progress: 848/2083 symbols completed. HCA took 1.2s. Estimated remaining: 7m 49s. Rate: 157.9 symbols/min [2025-10-17T22:39:31.866561] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:31.873924] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-10-17T22:39:31.890419] [INFO ] [MAIN ] Derivative Progress: 849/2083 symbols completed. HCC took 1.2s. Estimated remaining: 7m 48s. Rate: 158.1 symbols/min [2025-10-17T22:39:31.908628] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:32.200014] [DEBUG] [LOCAL ] HDB: Loaded 52710 existing records from primary storage. [2025-10-17T22:39:32.200411] [INFO ] [MAIN ] HDB: Loaded 52710 primary data records. [2025-10-17T22:39:32.201614] [DEBUG] [LOCAL ] HD: Loaded 54264 existing records from primary storage. [2025-10-17T22:39:32.206970] [INFO ] [MAIN ] HD: Loaded 54264 primary data records. [2025-10-17T22:39:32.297318] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:32.347142] [INFO ] [MAIN ] HCI: Generated 1820 derivative records from 14354 primary records. [2025-10-17T22:39:32.366209] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-17T22:39:32.560455] [DEBUG] [LOCAL ] HCI: Derivative data saved (1820 records). [2025-10-17T22:39:32.565909] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-10-17T22:39:32.573999] [INFO ] [MAIN ] Derivative Progress: 850/2083 symbols completed. HCI took 0.9s. Estimated remaining: 7m 48s. Rate: 157.9 symbols/min [2025-10-17T22:39:32.703733] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:32.926080] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:32.926807] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:32.927633] [INFO ] [MAIN ] HDB: Generated 1820 derivative records from 52710 primary records. [2025-10-17T22:39:32.927902] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-17T22:39:32.949473] [INFO ] [MAIN ] HD: Generated 1820 derivative records from 54264 primary records. [2025-10-17T22:39:32.951494] [DEBUG] [LOCAL ] HE: Loaded 49612 existing records from primary storage. [2025-10-17T22:39:32.951871] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-17T22:39:32.959074] [INFO ] [MAIN ] HE: Loaded 49612 primary data records. [2025-10-17T22:39:33.031802] [DEBUG] [LOCAL ] HD: Derivative data saved (1820 records). [2025-10-17T22:39:33.032177] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-10-17T22:39:33.049707] [INFO ] [MAIN ] Derivative Progress: 851/2083 symbols completed. HD took 1.2s. Estimated remaining: 7m 48s. Rate: 157.9 symbols/min [2025-10-17T22:39:33.050177] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:33.124385] [DEBUG] [LOCAL ] HDB: Derivative data saved (1820 records). [2025-10-17T22:39:33.124618] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-10-17T22:39:33.146235] [DEBUG] [LOCAL ] HEQ: Loaded 6898 existing records from primary storage. [2025-10-17T22:39:33.127313] [INFO ] [MAIN ] Derivative Progress: 852/2083 symbols completed. HDB took 1.2s. Estimated remaining: 7m 47s. Rate: 158.0 symbols/min [2025-10-17T22:39:33.156782] [INFO ] [MAIN ] HEQ: Loaded 6898 primary data records. [2025-10-17T22:39:33.156921] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:33.663866] [DEBUG] [LOCAL ] HESM: Loaded 49235 existing records from primary storage. [2025-10-17T22:39:33.664282] [INFO ] [MAIN ] HESM: Loaded 49235 primary data records. [2025-10-17T22:39:33.697472] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:33.733140] [INFO ] [MAIN ] HE: Generated 1820 derivative records from 49612 primary records. [2025-10-17T22:39:33.747816] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-17T22:39:33.799793] [DEBUG] [LOCAL ] HE: Derivative data saved (1820 records). [2025-10-17T22:39:33.799993] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-10-17T22:39:33.809616] [INFO ] [MAIN ] Derivative Progress: 853/2083 symbols completed. HE took 1.1s. Estimated remaining: 7m 47s. Rate: 157.9 symbols/min [2025-10-17T22:39:33.877185] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:33.894276] [INFO ] [MAIN ] HEQ: Generated 1820 derivative records from 6898 primary records. [2025-10-17T22:39:34.005728] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-17T22:39:34.034990] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1820 records). [2025-10-17T22:39:34.035827] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-10-17T22:39:34.038763] [INFO ] [MAIN ] Derivative Progress: 854/2083 symbols completed. HEQ took 1.0s. Estimated remaining: 7m 47s. Rate: 157.9 symbols/min [2025-10-17T22:39:34.059348] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:34.060107] [INFO ] [MAIN ] HESM: Generated 1820 derivative records from 49235 primary records. [2025-10-17T22:39:34.060170] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-17T22:39:34.075788] [DEBUG] [LOCAL ] HESM: Derivative data saved (1820 records). [2025-10-17T22:39:34.075848] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-10-17T22:39:34.078262] [INFO ] [MAIN ] Derivative Progress: 855/2083 symbols completed. HESM took 0.9s. Estimated remaining: 7m 46s. Rate: 158.1 symbols/min [2025-10-17T22:39:34.079162] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:34.079238] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:34.079041] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:34.096334] [DEBUG] [LOCAL ] HGLB: Loaded 9785 existing records from primary storage. [2025-10-17T22:39:34.096626] [INFO ] [MAIN ] HGLB: Loaded 9785 primary data records. [2025-10-17T22:39:34.191522] [DEBUG] [LOCAL ] HGER: Loaded 15286 existing records from primary storage. [2025-10-17T22:39:34.196939] [INFO ] [MAIN ] HGER: Loaded 15286 primary data records. [2025-10-17T22:39:34.216565] [DEBUG] [LOCAL ] HFRO: Loaded 17015 existing records from primary storage. [2025-10-17T22:39:34.281722] [INFO ] [MAIN ] HFRO: Loaded 17015 primary data records. [2025-10-17T22:39:35.110938] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:35.112004] [INFO ] [MAIN ] HGLB: Generated 1820 derivative records from 9785 primary records. [2025-10-17T22:39:35.112371] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-17T22:39:35.134929] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1820 records). [2025-10-17T22:39:35.135371] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-10-17T22:39:35.145439] [INFO ] [MAIN ] Derivative Progress: 856/2083 symbols completed. HGLB took 1.1s. Estimated remaining: 7m 47s. Rate: 157.8 symbols/min [2025-10-17T22:39:35.163261] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:35.164343] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:35.163998] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:35.165588] [INFO ] [MAIN ] HFRO: Generated 1820 derivative records from 17015 primary records. [2025-10-17T22:39:35.166568] [INFO ] [MAIN ] HGER: Generated 1820 derivative records from 15286 primary records. [2025-10-17T22:39:35.166713] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-17T22:39:35.166782] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-10-17T22:39:35.200054] [DEBUG] [LOCAL ] HGER: Derivative data saved (1820 records). [2025-10-17T22:39:35.200998] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-10-17T22:39:35.203479] [INFO ] [MAIN ] Derivative Progress: 857/2083 symbols completed. HGER took 1.1s. Estimated remaining: 7m 46s. Rate: 157.9 symbols/min [2025-10-17T22:39:35.204237] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:35.213015] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1820 records). [2025-10-17T22:39:35.214238] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-10-17T22:39:35.213991] [DEBUG] [LOCAL ] HGTY: Loaded 13543 existing records from primary storage. [2025-10-17T22:39:35.214449] [INFO ] [MAIN ] HGTY: Loaded 13543 primary data records. [2025-10-17T22:39:35.253909] [INFO ] [MAIN ] Derivative Progress: 858/2083 symbols completed. HFRO took 1.2s. Estimated remaining: 7m 45s. Rate: 158.1 symbols/min [2025-10-17T22:39:35.266232] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:35.571624] [DEBUG] [LOCAL ] HHH: Loaded 33589 existing records from primary storage. [2025-10-17T22:39:35.572963] [INFO ] [MAIN ] HHH: Loaded 33589 primary data records. [2025-10-17T22:39:35.573794] [DEBUG] [LOCAL ] HGV: Loaded 46933 existing records from primary storage. [2025-10-17T22:39:35.574593] [INFO ] [MAIN ] HGV: Loaded 46933 primary data records. [2025-10-17T22:39:36.196469] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:36.198738] [INFO ] [MAIN ] HGTY: Generated 1820 derivative records from 13543 primary records. [2025-10-17T22:39:36.199088] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-17T22:39:36.217633] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1820 records). [2025-10-17T22:39:36.218078] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-10-17T22:39:36.220355] [INFO ] [MAIN ] Derivative Progress: 859/2083 symbols completed. HGTY took 1.1s. Estimated remaining: 7m 45s. Rate: 157.8 symbols/min [2025-10-17T22:39:36.220587] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:36.242460] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:36.244105] [INFO ] [MAIN ] HGV: Generated 1820 derivative records from 46933 primary records. [2025-10-17T22:39:36.245032] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-17T22:39:36.280502] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:36.282479] [INFO ] [MAIN ] HHH: Generated 1820 derivative records from 33589 primary records. [2025-10-17T22:39:36.282873] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-17T22:39:36.285604] [DEBUG] [LOCAL ] HGV: Derivative data saved (1820 records). [2025-10-17T22:39:36.286051] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-10-17T22:39:36.288041] [INFO ] [MAIN ] Derivative Progress: 860/2083 symbols completed. HGV took 1.1s. Estimated remaining: 7m 45s. Rate: 158.0 symbols/min [2025-10-17T22:39:36.288255] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:36.314326] [DEBUG] [LOCAL ] HHH: Derivative data saved (1820 records). [2025-10-17T22:39:36.314427] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-10-17T22:39:36.316348] [INFO ] [MAIN ] Derivative Progress: 861/2083 symbols completed. HHH took 1.1s. Estimated remaining: 7m 44s. Rate: 158.1 symbols/min [2025-10-17T22:39:36.316511] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:36.317464] [DEBUG] [LOCAL ] HI: Loaded 36524 existing records from primary storage. [2025-10-17T22:39:36.318070] [INFO ] [MAIN ] HI: Loaded 36524 primary data records. [2025-10-17T22:39:36.669968] [DEBUG] [LOCAL ] HII: Loaded 34269 existing records from primary storage. [2025-10-17T22:39:36.670286] [INFO ] [MAIN ] HII: Loaded 34269 primary data records. [2025-10-17T22:39:36.787591] [DEBUG] [LOCAL ] HIG: Loaded 51943 existing records from primary storage. [2025-10-17T22:39:36.788136] [INFO ] [MAIN ] HIG: Loaded 51943 primary data records. [2025-10-17T22:39:37.294668] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:37.295818] [INFO ] [MAIN ] HI: Generated 1820 derivative records from 36524 primary records. [2025-10-17T22:39:37.296340] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-17T22:39:37.315038] [DEBUG] [LOCAL ] HI: Derivative data saved (1820 records). [2025-10-17T22:39:37.315241] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-10-17T22:39:37.318537] [INFO ] [MAIN ] Derivative Progress: 862/2083 symbols completed. HI took 1.1s. Estimated remaining: 7m 44s. Rate: 157.8 symbols/min [2025-10-17T22:39:37.319149] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:37.337295] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:37.338058] [INFO ] [MAIN ] HII: Generated 1820 derivative records from 34269 primary records. [2025-10-17T22:39:37.338327] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-17T22:39:37.370549] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:37.370197] [DEBUG] [LOCAL ] HII: Derivative data saved (1820 records). [2025-10-17T22:39:37.370708] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-10-17T22:39:37.373466] [INFO ] [MAIN ] Derivative Progress: 863/2083 symbols completed. HII took 1.1s. Estimated remaining: 7m 43s. Rate: 158.0 symbols/min [2025-10-17T22:39:37.371393] [INFO ] [MAIN ] HIG: Generated 1820 derivative records from 51943 primary records. [2025-10-17T22:39:37.373731] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-17T22:39:37.373834] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:37.403918] [DEBUG] [LOCAL ] HIG: Derivative data saved (1820 records). [2025-10-17T22:39:37.405209] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-10-17T22:39:37.407321] [INFO ] [MAIN ] Derivative Progress: 864/2083 symbols completed. HIG took 1.1s. Estimated remaining: 7m 42s. Rate: 158.2 symbols/min [2025-10-17T22:39:37.407706] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:37.430541] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-10-17T22:39:37.430811] [INFO ] [MAIN ] HIMS: Loaded 54597 primary data records. [2025-10-17T22:39:37.519945] [DEBUG] [LOCAL ] HIO: Loaded 24778 existing records from primary storage. [2025-10-17T22:39:37.537534] [INFO ] [MAIN ] HIO: Loaded 24778 primary data records. [2025-10-17T22:39:37.855468] [DEBUG] [LOCAL ] HIPO: Loaded 22131 existing records from primary storage. [2025-10-17T22:39:37.856158] [INFO ] [MAIN ] HIPO: Loaded 22131 primary data records. [2025-10-17T22:39:38.412805] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:38.413933] [INFO ] [MAIN ] HIMS: Generated 1820 derivative records from 54597 primary records. [2025-10-17T22:39:38.414665] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-17T22:39:38.434630] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1820 records). [2025-10-17T22:39:38.435015] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-10-17T22:39:38.437028] [INFO ] [MAIN ] Derivative Progress: 865/2083 symbols completed. HIMS took 1.1s. Estimated remaining: 7m 43s. Rate: 157.8 symbols/min [2025-10-17T22:39:38.437297] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:38.453791] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:38.455423] [INFO ] [MAIN ] HIO: Generated 1820 derivative records from 24778 primary records. [2025-10-17T22:39:38.456134] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-17T22:39:38.490747] [DEBUG] [LOCAL ] HIO: Derivative data saved (1820 records). [2025-10-17T22:39:38.491007] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-10-17T22:39:38.493255] [INFO ] [MAIN ] Derivative Progress: 866/2083 symbols completed. HIO took 1.1s. Estimated remaining: 7m 42s. Rate: 158.0 symbols/min [2025-10-17T22:39:38.493489] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:38.490632] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:38.494836] [INFO ] [MAIN ] HIPO: Generated 1820 derivative records from 22131 primary records. [2025-10-17T22:39:38.494913] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-17T22:39:38.513492] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1820 records). [2025-10-17T22:39:38.513838] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-10-17T22:39:38.516293] [INFO ] [MAIN ] Derivative Progress: 867/2083 symbols completed. HIPO took 1.1s. Estimated remaining: 7m 41s. Rate: 158.2 symbols/min [2025-10-17T22:39:38.516823] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:38.542693] [DEBUG] [LOCAL ] HIX: Loaded 20696 existing records from primary storage. [2025-10-17T22:39:38.542838] [INFO ] [MAIN ] HIX: Loaded 20696 primary data records. [2025-10-17T22:39:38.675327] [DEBUG] [LOCAL ] HIW: Loaded 45201 existing records from primary storage. [2025-10-17T22:39:38.674268] [DEBUG] [LOCAL ] HKD: Loaded 18952 existing records from primary storage. [2025-10-17T22:39:38.675595] [INFO ] [MAIN ] HKD: Loaded 18952 primary data records. [2025-10-17T22:39:38.676035] [INFO ] [MAIN ] HIW: Loaded 45201 primary data records. [2025-10-17T22:39:39.560891] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:39.562257] [INFO ] [MAIN ] HIX: Generated 1820 derivative records from 20696 primary records. [2025-10-17T22:39:39.562458] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-17T22:39:39.580480] [DEBUG] [LOCAL ] HIX: Derivative data saved (1820 records). [2025-10-17T22:39:39.581562] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-10-17T22:39:39.583952] [INFO ] [MAIN ] Derivative Progress: 868/2083 symbols completed. HIX took 1.1s. Estimated remaining: 7m 42s. Rate: 157.8 symbols/min [2025-10-17T22:39:39.598410] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:39.599186] [INFO ] [MAIN ] HKD: Generated 1820 derivative records from 18952 primary records. [2025-10-17T22:39:39.599395] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-17T22:39:39.633549] [DEBUG] [LOCAL ] HKD: Derivative data saved (1820 records). [2025-10-17T22:39:39.633681] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-10-17T22:39:39.635745] [INFO ] [MAIN ] Derivative Progress: 869/2083 symbols completed. HKD took 1.1s. Estimated remaining: 7m 41s. Rate: 158.0 symbols/min [2025-10-17T22:39:39.636106] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:39.637248] [INFO ] [MAIN ] HIW: Generated 1820 derivative records from 45201 primary records. [2025-10-17T22:39:39.637371] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-17T22:39:39.655274] [DEBUG] [LOCAL ] HIW: Derivative data saved (1820 records). [2025-10-17T22:39:39.655464] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-10-17T22:39:39.658119] [INFO ] [MAIN ] Derivative Progress: 870/2083 symbols completed. HIW took 1.2s. Estimated remaining: 7m 40s. Rate: 158.2 symbols/min [2025-10-17T22:39:39.658737] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:39.658673] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:39.659250] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:39.735340] [DEBUG] [LOCAL ] HLI: Loaded 31316 existing records from primary storage. [2025-10-17T22:39:39.736825] [INFO ] [MAIN ] HLI: Loaded 31316 primary data records. [2025-10-17T22:39:39.742996] [DEBUG] [LOCAL ] HLF: Loaded 49226 existing records from primary storage. [2025-10-17T22:39:39.766859] [INFO ] [MAIN ] HLF: Loaded 49226 primary data records. [2025-10-17T22:39:39.965320] [DEBUG] [LOCAL ] HL: Loaded 54455 existing records from primary storage. [2025-10-17T22:39:39.981186] [INFO ] [MAIN ] HL: Loaded 54455 primary data records. [2025-10-17T22:39:40.797530] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:40.804547] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:40.802901] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:40.804218] [INFO ] [MAIN ] HLI: Generated 1820 derivative records from 31316 primary records. [2025-10-17T22:39:40.806093] [INFO ] [MAIN ] HL: Generated 1820 derivative records from 54455 primary records. [2025-10-17T22:39:40.805421] [INFO ] [MAIN ] HLF: Generated 1820 derivative records from 49226 primary records. [2025-10-17T22:39:40.806234] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-17T22:39:40.807086] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-10-17T22:39:40.808073] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-17T22:39:40.831771] [DEBUG] [LOCAL ] HLF: Derivative data saved (1820 records). [2025-10-17T22:39:40.840809] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-10-17T22:39:40.847979] [INFO ] [MAIN ] Derivative Progress: 871/2083 symbols completed. HLF took 1.2s. Estimated remaining: 7m 41s. Rate: 157.8 symbols/min [2025-10-17T22:39:40.851307] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:40.853077] [DEBUG] [LOCAL ] HL: Derivative data saved (1820 records). [2025-10-17T22:39:40.857381] [DEBUG] [LOCAL ] HLI: Derivative data saved (1820 records). [2025-10-17T22:39:40.857593] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-10-17T22:39:40.860300] [INFO ] [MAIN ] Derivative Progress: 872/2083 symbols completed. HL took 1.2s. Estimated remaining: 7m 40s. Rate: 158.0 symbols/min [2025-10-17T22:39:40.857840] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-10-17T22:39:40.863047] [INFO ] [MAIN ] Derivative Progress: 873/2083 symbols completed. HLI took 1.2s. Estimated remaining: 7m 39s. Rate: 158.1 symbols/min [2025-10-17T22:39:40.860616] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:40.863325] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:40.898487] [DEBUG] [LOCAL ] HLIO: Loaded 28680 existing records from primary storage. [2025-10-17T22:39:40.898829] [INFO ] [MAIN ] HLIO: Loaded 28680 primary data records. [2025-10-17T22:39:41.045863] [DEBUG] [LOCAL ] HLLY: Loaded 33825 existing records from primary storage. [2025-10-17T22:39:41.111100] [INFO ] [MAIN ] HLLY: Loaded 33825 primary data records. [2025-10-17T22:39:41.115712] [DEBUG] [LOCAL ] HLN: Loaded 53902 existing records from primary storage. [2025-10-17T22:39:41.230038] [INFO ] [MAIN ] HLN: Loaded 53902 primary data records. [2025-10-17T22:39:41.882151] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:41.884632] [INFO ] [MAIN ] HLIO: Generated 1820 derivative records from 28680 primary records. [2025-10-17T22:39:41.885166] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-17T22:39:41.914779] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1820 records). [2025-10-17T22:39:41.914981] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-10-17T22:39:41.917577] [INFO ] [MAIN ] Derivative Progress: 874/2083 symbols completed. HLIO took 1.1s. Estimated remaining: 7m 40s. Rate: 157.8 symbols/min [2025-10-17T22:39:41.919018] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:41.948846] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:41.950226] [INFO ] [MAIN ] HLLY: Generated 1820 derivative records from 33825 primary records. [2025-10-17T22:39:41.950413] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-17T22:39:41.949347] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:41.951375] [INFO ] [MAIN ] HLN: Generated 1820 derivative records from 53902 primary records. [2025-10-17T22:39:41.951506] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-17T22:39:41.982267] [DEBUG] [LOCAL ] HLN: Derivative data saved (1820 records). [2025-10-17T22:39:41.982354] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-10-17T22:39:41.984614] [INFO ] [MAIN ] Derivative Progress: 875/2083 symbols completed. HLN took 1.1s. Estimated remaining: 7m 39s. Rate: 158.0 symbols/min [2025-10-17T22:39:41.986932] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:41.987081] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1820 records). [2025-10-17T22:39:41.987534] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-10-17T22:39:41.989606] [INFO ] [MAIN ] Derivative Progress: 876/2083 symbols completed. HLLY took 1.1s. Estimated remaining: 7m 38s. Rate: 158.1 symbols/min [2025-10-17T22:39:41.990359] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:42.039911] [DEBUG] [LOCAL ] HLT: Loaded 51246 existing records from primary storage. [2025-10-17T22:39:42.040210] [INFO ] [MAIN ] HLT: Loaded 51246 primary data records. [2025-10-17T22:39:42.179166] [DEBUG] [LOCAL ] HLX: Loaded 48172 existing records from primary storage. [2025-10-17T22:39:42.182602] [INFO ] [MAIN ] HLX: Loaded 48172 primary data records. [2025-10-17T22:39:42.194565] [DEBUG] [LOCAL ] HMC: Loaded 47137 existing records from primary storage. [2025-10-17T22:39:42.243309] [INFO ] [MAIN ] HMC: Loaded 47137 primary data records. [2025-10-17T22:39:43.084435] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:43.085866] [INFO ] [MAIN ] HLT: Generated 1820 derivative records from 51246 primary records. [2025-10-17T22:39:43.086105] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-17T22:39:43.126918] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:43.134232] [INFO ] [MAIN ] HLX: Generated 1820 derivative records from 48172 primary records. [2025-10-17T22:39:43.127577] [DEBUG] [LOCAL ] HLT: Derivative data saved (1820 records). [2025-10-17T22:39:43.147612] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-10-17T22:39:43.147452] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-10-17T22:39:43.151084] [INFO ] [MAIN ] Derivative Progress: 877/2083 symbols completed. HLT took 1.2s. Estimated remaining: 7m 39s. Rate: 157.8 symbols/min [2025-10-17T22:39:43.148324] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:43.152332] [INFO ] [MAIN ] HMC: Generated 1820 derivative records from 47137 primary records. [2025-10-17T22:39:43.152516] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:43.164623] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-17T22:39:43.170676] [DEBUG] [LOCAL ] HLX: Derivative data saved (1820 records). [2025-10-17T22:39:43.171177] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-10-17T22:39:43.174718] [INFO ] [MAIN ] Derivative Progress: 878/2083 symbols completed. HLX took 1.2s. Estimated remaining: 7m 38s. Rate: 157.9 symbols/min [2025-10-17T22:39:43.174917] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:43.193002] [DEBUG] [LOCAL ] HMC: Derivative data saved (1820 records). [2025-10-17T22:39:43.193218] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-10-17T22:39:43.196264] [INFO ] [MAIN ] Derivative Progress: 879/2083 symbols completed. HMC took 1.2s. Estimated remaining: 7m 37s. Rate: 158.1 symbols/min [2025-10-17T22:39:43.196426] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:43.214225] [DEBUG] [LOCAL ] HMN: Loaded 23749 existing records from primary storage. [2025-10-17T22:39:43.214381] [INFO ] [MAIN ] HMN: Loaded 23749 primary data records. [2025-10-17T22:39:43.407712] [DEBUG] [LOCAL ] HNI: Loaded 30085 existing records from primary storage. [2025-10-17T22:39:43.428817] [INFO ] [MAIN ] HNI: Loaded 30085 primary data records. [2025-10-17T22:39:43.670123] [DEBUG] [LOCAL ] HMY: Loaded 53946 existing records from primary storage. [2025-10-17T22:39:43.670838] [INFO ] [MAIN ] HMY: Loaded 53946 primary data records. [2025-10-17T22:39:44.203803] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:44.205757] [INFO ] [MAIN ] HMN: Generated 1820 derivative records from 23749 primary records. [2025-10-17T22:39:44.206548] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-17T22:39:44.226820] [DEBUG] [LOCAL ] HMN: Derivative data saved (1820 records). [2025-10-17T22:39:44.227153] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-10-17T22:39:44.229514] [INFO ] [MAIN ] Derivative Progress: 880/2083 symbols completed. HMN took 1.1s. Estimated remaining: 7m 37s. Rate: 157.8 symbols/min [2025-10-17T22:39:44.230312] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:44.249833] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:44.251387] [INFO ] [MAIN ] HNI: Generated 1820 derivative records from 30085 primary records. [2025-10-17T22:39:44.251627] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-17T22:39:44.270235] [DEBUG] [LOCAL ] HNI: Derivative data saved (1820 records). [2025-10-17T22:39:44.270339] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-10-17T22:39:44.274354] [INFO ] [MAIN ] Derivative Progress: 881/2083 symbols completed. HNI took 1.1s. Estimated remaining: 7m 37s. Rate: 158.0 symbols/min [2025-10-17T22:39:44.274599] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:44.291217] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:44.292613] [INFO ] [MAIN ] HMY: Generated 1820 derivative records from 53946 primary records. [2025-10-17T22:39:44.292851] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-17T22:39:44.325959] [DEBUG] [LOCAL ] HMY: Derivative data saved (1820 records). [2025-10-17T22:39:44.326302] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-10-17T22:39:44.329076] [INFO ] [MAIN ] Derivative Progress: 882/2083 symbols completed. HMY took 1.2s. Estimated remaining: 7m 36s. Rate: 158.1 symbols/min [2025-10-17T22:39:44.329405] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:44.350283] [DEBUG] [LOCAL ] HOG: Loaded 51493 existing records from primary storage. [2025-10-17T22:39:44.350480] [INFO ] [MAIN ] HOG: Loaded 51493 primary data records. [2025-10-17T22:39:44.494493] [DEBUG] [LOCAL ] HOMB: Loaded 44387 existing records from primary storage. [2025-10-17T22:39:44.505525] [INFO ] [MAIN ] HOMB: Loaded 44387 primary data records. [2025-10-17T22:39:44.720479] [DEBUG] [LOCAL ] HOUS: Loaded 46109 existing records from primary storage. [2025-10-17T22:39:44.726634] [INFO ] [MAIN ] HOUS: Loaded 46109 primary data records. [2025-10-17T22:39:45.442287] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:45.455447] [INFO ] [MAIN ] HOG: Generated 1820 derivative records from 51493 primary records. [2025-10-17T22:39:45.456294] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:45.455790] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-17T22:39:45.457630] [INFO ] [MAIN ] HOMB: Generated 1820 derivative records from 44387 primary records. [2025-10-17T22:39:45.457942] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-10-17T22:39:45.473939] [DEBUG] [LOCAL ] HOG: Derivative data saved (1820 records). [2025-10-17T22:39:45.474219] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-10-17T22:39:45.484439] [INFO ] [MAIN ] Derivative Progress: 883/2083 symbols completed. HOG took 1.3s. Estimated remaining: 7m 36s. Rate: 157.7 symbols/min [2025-10-17T22:39:45.493430] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1820 records). [2025-10-17T22:39:45.494125] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-10-17T22:39:45.496527] [INFO ] [MAIN ] Derivative Progress: 884/2083 symbols completed. HOMB took 1.2s. Estimated remaining: 7m 36s. Rate: 157.9 symbols/min [2025-10-17T22:39:45.509166] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:45.509833] [INFO ] [MAIN ] HOUS: Generated 1820 derivative records from 46109 primary records. [2025-10-17T22:39:45.509894] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-17T22:39:45.524810] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1820 records). [2025-10-17T22:39:45.524869] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-10-17T22:39:45.527851] [INFO ] [MAIN ] Derivative Progress: 885/2083 symbols completed. HOUS took 1.2s. Estimated remaining: 7m 35s. Rate: 158.1 symbols/min [2025-10-17T22:39:45.528488] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:45.528757] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:45.528569] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:45.546968] [DEBUG] [LOCAL ] HOV: Loaded 14171 existing records from primary storage. [2025-10-17T22:39:45.547266] [INFO ] [MAIN ] HOV: Loaded 14171 primary data records. [2025-10-17T22:39:45.911451] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-10-17T22:39:45.912555] [INFO ] [MAIN ] HPE: Loaded 54477 primary data records. [2025-10-17T22:39:45.913252] [DEBUG] [LOCAL ] HP: Loaded 52245 existing records from primary storage. [2025-10-17T22:39:45.913356] [INFO ] [MAIN ] HP: Loaded 52245 primary data records. [2025-10-17T22:39:46.575963] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:46.577439] [INFO ] [MAIN ] HOV: Generated 1820 derivative records from 14171 primary records. [2025-10-17T22:39:46.578230] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-17T22:39:46.596630] [DEBUG] [LOCAL ] HOV: Derivative data saved (1820 records). [2025-10-17T22:39:46.597278] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-10-17T22:39:46.599746] [INFO ] [MAIN ] Derivative Progress: 886/2083 symbols completed. HOV took 1.1s. Estimated remaining: 7m 35s. Rate: 157.8 symbols/min [2025-10-17T22:39:46.600355] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:46.615411] [DEBUG] [LOCAL ] HPF: Loaded 7566 existing records from primary storage. [2025-10-17T22:39:46.616347] [INFO ] [MAIN ] HPF: Loaded 7566 primary data records. [2025-10-17T22:39:46.701830] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:46.734512] [INFO ] [MAIN ] HP: Generated 1820 derivative records from 52245 primary records. [2025-10-17T22:39:46.733801] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:46.734614] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-17T22:39:46.746086] [INFO ] [MAIN ] HPE: Generated 1820 derivative records from 54477 primary records. [2025-10-17T22:39:46.769706] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-17T22:39:46.972328] [DEBUG] [LOCAL ] HPE: Derivative data saved (1820 records). [2025-10-17T22:39:46.976021] [DEBUG] [LOCAL ] HP: Derivative data saved (1820 records). [2025-10-17T22:39:46.974113] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-10-17T22:39:46.978118] [INFO ] [MAIN ] Derivative Progress: 887/2083 symbols completed. HPE took 1.4s. Estimated remaining: 7m 35s. Rate: 157.8 symbols/min [2025-10-17T22:39:46.978301] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:46.978666] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-10-17T22:39:46.981074] [INFO ] [MAIN ] Derivative Progress: 888/2083 symbols completed. HP took 1.5s. Estimated remaining: 7m 34s. Rate: 157.9 symbols/min [2025-10-17T22:39:46.982046] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:46.995771] [DEBUG] [LOCAL ] HPI: Loaded 10785 existing records from primary storage. [2025-10-17T22:39:46.995907] [INFO ] [MAIN ] HPI: Loaded 10785 primary data records. [2025-10-17T22:39:47.168203] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:47.203310] [INFO ] [MAIN ] HPF: Generated 1820 derivative records from 7566 primary records. [2025-10-17T22:39:47.313029] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-17T22:39:47.355511] [DEBUG] [LOCAL ] HPF: Derivative data saved (1820 records). [2025-10-17T22:39:47.355617] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-10-17T22:39:47.362378] [INFO ] [MAIN ] Derivative Progress: 889/2083 symbols completed. HPF took 0.8s. Estimated remaining: 7m 34s. Rate: 157.9 symbols/min [2025-10-17T22:39:47.354795] [DEBUG] [LOCAL ] HPP: Loaded 51937 existing records from primary storage. [2025-10-17T22:39:47.363699] [INFO ] [MAIN ] HPP: Loaded 51937 primary data records. [2025-10-17T22:39:47.394792] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:47.703950] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:47.705390] [INFO ] [MAIN ] HPI: Generated 1820 derivative records from 10785 primary records. [2025-10-17T22:39:47.705896] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-17T22:39:47.723121] [DEBUG] [LOCAL ] HPI: Derivative data saved (1820 records). [2025-10-17T22:39:47.738381] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-10-17T22:39:47.740888] [INFO ] [MAIN ] Derivative Progress: 890/2083 symbols completed. HPI took 0.8s. Estimated remaining: 7m 33s. Rate: 157.9 symbols/min [2025-10-17T22:39:47.741169] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:47.742148] [DEBUG] [LOCAL ] HPQ: Loaded 54449 existing records from primary storage. [2025-10-17T22:39:47.743002] [INFO ] [MAIN ] HPQ: Loaded 54449 primary data records. [2025-10-17T22:39:47.875682] [DEBUG] [LOCAL ] HPS: Loaded 10447 existing records from primary storage. [2025-10-17T22:39:47.907007] [INFO ] [MAIN ] HPS: Loaded 10447 primary data records. [2025-10-17T22:39:48.173274] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:48.188997] [INFO ] [MAIN ] HPP: Generated 1820 derivative records from 51937 primary records. [2025-10-17T22:39:48.193531] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-17T22:39:48.455799] [DEBUG] [LOCAL ] HPP: Derivative data saved (1820 records). [2025-10-17T22:39:48.455934] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-10-17T22:39:48.458455] [INFO ] [MAIN ] Derivative Progress: 891/2083 symbols completed. HPP took 1.5s. Estimated remaining: 7m 33s. Rate: 157.8 symbols/min [2025-10-17T22:39:48.459076] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:48.482561] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:48.491041] [INFO ] [MAIN ] HPQ: Generated 1820 derivative records from 54449 primary records. [2025-10-17T22:39:48.491342] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-17T22:39:48.516583] [DEBUG] [LOCAL ] HQH: Loaded 26187 existing records from primary storage. [2025-10-17T22:39:48.518042] [INFO ] [MAIN ] HQH: Loaded 26187 primary data records. [2025-10-17T22:39:48.517898] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1820 records). [2025-10-17T22:39:48.518294] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-10-17T22:39:48.564505] [INFO ] [MAIN ] Derivative Progress: 892/2083 symbols completed. HPQ took 1.2s. Estimated remaining: 7m 33s. Rate: 157.9 symbols/min [2025-10-17T22:39:48.590130] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:48.613805] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:48.633056] [INFO ] [MAIN ] HPS: Generated 1820 derivative records from 10447 primary records. [2025-10-17T22:39:48.636292] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-17T22:39:48.741096] [DEBUG] [LOCAL ] HQL: Loaded 17218 existing records from primary storage. [2025-10-17T22:39:48.845716] [DEBUG] [LOCAL ] HPS: Derivative data saved (1820 records). [2025-10-17T22:39:48.844434] [INFO ] [MAIN ] HQL: Loaded 17218 primary data records. [2025-10-17T22:39:48.850951] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-10-17T22:39:48.861630] [INFO ] [MAIN ] Derivative Progress: 893/2083 symbols completed. HPS took 1.1s. Estimated remaining: 7m 32s. Rate: 157.9 symbols/min [2025-10-17T22:39:48.867214] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:49.219550] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:49.220534] [DEBUG] [LOCAL ] HR: Loaded 52870 existing records from primary storage. [2025-10-17T22:39:49.221008] [INFO ] [MAIN ] HR: Loaded 52870 primary data records. [2025-10-17T22:39:49.222026] [INFO ] [MAIN ] HQH: Generated 1820 derivative records from 26187 primary records. [2025-10-17T22:39:49.222574] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-17T22:39:49.335457] [DEBUG] [LOCAL ] HQH: Derivative data saved (1820 records). [2025-10-17T22:39:49.346523] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-10-17T22:39:49.348917] [INFO ] [MAIN ] Derivative Progress: 894/2083 symbols completed. HQH took 0.9s. Estimated remaining: 7m 32s. Rate: 157.9 symbols/min [2025-10-17T22:39:49.372284] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:49.402471] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:49.420626] [INFO ] [MAIN ] HQL: Generated 1820 derivative records from 17218 primary records. [2025-10-17T22:39:49.437440] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-17T22:39:49.585035] [DEBUG] [LOCAL ] HQL: Derivative data saved (1820 records). [2025-10-17T22:39:49.585182] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-10-17T22:39:49.587323] [INFO ] [MAIN ] Derivative Progress: 895/2083 symbols completed. HQL took 1.0s. Estimated remaining: 7m 31s. Rate: 158.0 symbols/min [2025-10-17T22:39:49.587663] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:49.637633] [DEBUG] [LOCAL ] HRB: Loaded 49064 existing records from primary storage. [2025-10-17T22:39:49.645041] [INFO ] [MAIN ] HRB: Loaded 49064 primary data records. [2025-10-17T22:39:49.771411] [DEBUG] [LOCAL ] HRI: Loaded 32839 existing records from primary storage. [2025-10-17T22:39:49.784609] [INFO ] [MAIN ] HRI: Loaded 32839 primary data records. [2025-10-17T22:39:49.801024] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:49.843577] [INFO ] [MAIN ] HR: Generated 1820 derivative records from 52870 primary records. [2025-10-17T22:39:49.917872] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-17T22:39:50.126624] [DEBUG] [LOCAL ] HR: Derivative data saved (1820 records). [2025-10-17T22:39:50.154545] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-10-17T22:39:50.156664] [INFO ] [MAIN ] Derivative Progress: 896/2083 symbols completed. HR took 1.3s. Estimated remaining: 7m 31s. Rate: 157.9 symbols/min [2025-10-17T22:39:50.170551] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:50.337993] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:50.338850] [INFO ] [MAIN ] HRB: Generated 1820 derivative records from 49064 primary records. [2025-10-17T22:39:50.339087] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-17T22:39:50.370107] [DEBUG] [LOCAL ] HRB: Derivative data saved (1820 records). [2025-10-17T22:39:50.371005] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-10-17T22:39:50.373457] [INFO ] [MAIN ] Derivative Progress: 897/2083 symbols completed. HRB took 1.0s. Estimated remaining: 7m 31s. Rate: 157.9 symbols/min [2025-10-17T22:39:50.373683] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:50.393741] [DEBUG] [LOCAL ] HRL: Loaded 53904 existing records from primary storage. [2025-10-17T22:39:50.396224] [INFO ] [MAIN ] HRL: Loaded 53904 primary data records. [2025-10-17T22:39:50.502892] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:50.523565] [INFO ] [MAIN ] HRI: Generated 1820 derivative records from 32839 primary records. [2025-10-17T22:39:50.524050] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-17T22:39:50.626637] [DEBUG] [LOCAL ] HRTG: Loaded 34930 existing records from primary storage. [2025-10-17T22:39:50.674842] [INFO ] [MAIN ] HRTG: Loaded 34930 primary data records. [2025-10-17T22:39:50.822978] [DEBUG] [LOCAL ] HRI: Derivative data saved (1820 records). [2025-10-17T22:39:50.838507] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-10-17T22:39:50.848782] [INFO ] [MAIN ] Derivative Progress: 898/2083 symbols completed. HRI took 1.3s. Estimated remaining: 7m 30s. Rate: 157.9 symbols/min [2025-10-17T22:39:51.121850] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:51.123184] [INFO ] [MAIN ] HRL: Generated 1820 derivative records from 53904 primary records. [2025-10-17T22:39:51.123284] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-17T22:39:51.140076] [DEBUG] [LOCAL ] HRL: Derivative data saved (1820 records). [2025-10-17T22:39:51.140168] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-10-17T22:39:51.142544] [INFO ] [MAIN ] Derivative Progress: 899/2083 symbols completed. HRL took 1.0s. Estimated remaining: 7m 30s. Rate: 157.9 symbols/min [2025-10-17T22:39:51.160202] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:51.160882] [INFO ] [MAIN ] HRTG: Generated 1820 derivative records from 34930 primary records. [2025-10-17T22:39:51.160943] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-17T22:39:51.176321] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1820 records). [2025-10-17T22:39:51.176378] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-10-17T22:39:51.178672] [INFO ] [MAIN ] Derivative Progress: 900/2083 symbols completed. HRTG took 0.8s. Estimated remaining: 7m 29s. Rate: 158.1 symbols/min [2025-10-17T22:39:51.179234] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:51.179308] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:51.179559] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:51.196879] [DEBUG] [LOCAL ] HSHP: Loaded 15028 existing records from primary storage. [2025-10-17T22:39:51.197097] [INFO ] [MAIN ] HSHP: Loaded 15028 primary data records. [2025-10-17T22:39:51.551587] [DEBUG] [LOCAL ] HSY: Loaded 51192 existing records from primary storage. [2025-10-17T22:39:51.552788] [DEBUG] [LOCAL ] HSBC: Loaded 51777 existing records from primary storage. [2025-10-17T22:39:51.553166] [INFO ] [MAIN ] HSY: Loaded 51192 primary data records. [2025-10-17T22:39:51.553283] [INFO ] [MAIN ] HSBC: Loaded 51777 primary data records. [2025-10-17T22:39:52.190390] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:52.192245] [INFO ] [MAIN ] HSHP: Generated 1820 derivative records from 15028 primary records. [2025-10-17T22:39:52.192692] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-17T22:39:52.210378] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1820 records). [2025-10-17T22:39:52.210751] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-10-17T22:39:52.212949] [INFO ] [MAIN ] Derivative Progress: 901/2083 symbols completed. HSHP took 1.0s. Estimated remaining: 7m 29s. Rate: 157.8 symbols/min [2025-10-17T22:39:52.213619] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:52.233233] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:52.234137] [INFO ] [MAIN ] HSY: Generated 1820 derivative records from 51192 primary records. [2025-10-17T22:39:52.234323] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-17T22:39:52.260073] [DEBUG] [LOCAL ] HTD: Loaded 14424 existing records from primary storage. [2025-10-17T22:39:52.261630] [INFO ] [MAIN ] HTD: Loaded 14424 primary data records. [2025-10-17T22:39:52.363559] [DEBUG] [LOCAL ] HSY: Derivative data saved (1820 records). [2025-10-17T22:39:52.363723] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-10-17T22:39:52.358044] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:52.372206] [INFO ] [MAIN ] Derivative Progress: 902/2083 symbols completed. HSY took 1.2s. Estimated remaining: 7m 29s. Rate: 157.9 symbols/min [2025-10-17T22:39:52.372392] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:52.381400] [INFO ] [MAIN ] HSBC: Generated 1820 derivative records from 51777 primary records. [2025-10-17T22:39:52.385420] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-10-17T22:39:52.634478] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1820 records). [2025-10-17T22:39:52.634703] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-10-17T22:39:52.637105] [INFO ] [MAIN ] Derivative Progress: 903/2083 symbols completed. HSBC took 1.5s. Estimated remaining: 7m 28s. Rate: 158.0 symbols/min [2025-10-17T22:39:52.637305] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:52.662705] [DEBUG] [LOCAL ] HTH: Loaded 33038 existing records from primary storage. [2025-10-17T22:39:52.663158] [INFO ] [MAIN ] HTH: Loaded 33038 primary data records. [2025-10-17T22:39:53.013582] [DEBUG] [LOCAL ] HUBB: Loaded 36909 existing records from primary storage. [2025-10-17T22:39:53.013954] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:53.014184] [INFO ] [MAIN ] HUBB: Loaded 36909 primary data records. [2025-10-17T22:39:53.015120] [INFO ] [MAIN ] HTD: Generated 1820 derivative records from 14424 primary records. [2025-10-17T22:39:53.015902] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-17T22:39:53.080994] [DEBUG] [LOCAL ] HTD: Derivative data saved (1820 records). [2025-10-17T22:39:53.098062] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-10-17T22:39:53.111596] [INFO ] [MAIN ] Derivative Progress: 904/2083 symbols completed. HTD took 0.9s. Estimated remaining: 7m 28s. Rate: 157.9 symbols/min [2025-10-17T22:39:53.136914] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:53.400808] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:53.420998] [INFO ] [MAIN ] HTH: Generated 1820 derivative records from 33038 primary records. [2025-10-17T22:39:53.421603] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-10-17T22:39:53.443690] [DEBUG] [LOCAL ] HTH: Derivative data saved (1820 records). [2025-10-17T22:39:53.444744] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-10-17T22:39:53.425435] [DEBUG] [LOCAL ] HUBS: Loaded 40651 existing records from primary storage. [2025-10-17T22:39:53.447938] [INFO ] [MAIN ] HUBS: Loaded 40651 primary data records. [2025-10-17T22:39:53.447711] [INFO ] [MAIN ] Derivative Progress: 905/2083 symbols completed. HTH took 1.1s. Estimated remaining: 7m 28s. Rate: 157.9 symbols/min [2025-10-17T22:39:53.460994] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:53.468412] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:53.487035] [INFO ] [MAIN ] HUBB: Generated 1820 derivative records from 36909 primary records. [2025-10-17T22:39:53.498947] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-17T22:39:53.573605] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1820 records). [2025-10-17T22:39:53.580082] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-10-17T22:39:53.582928] [INFO ] [MAIN ] Derivative Progress: 906/2083 symbols completed. HUBB took 0.9s. Estimated remaining: 7m 27s. Rate: 158.0 symbols/min [2025-10-17T22:39:53.590075] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:53.854774] [DEBUG] [LOCAL ] HUM: Loaded 50015 existing records from primary storage. [2025-10-17T22:39:53.855039] [INFO ] [MAIN ] HUM: Loaded 50015 primary data records. [2025-10-17T22:39:54.056842] [DEBUG] [LOCAL ] HUN: Loaded 53992 existing records from primary storage. [2025-10-17T22:39:54.062951] [INFO ] [MAIN ] HUN: Loaded 53992 primary data records. [2025-10-17T22:39:54.194419] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:54.245747] [INFO ] [MAIN ] HUBS: Generated 1820 derivative records from 40651 primary records. [2025-10-17T22:39:54.289199] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-17T22:39:54.696723] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1820 records). [2025-10-17T22:39:54.697069] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-10-17T22:39:54.699226] [INFO ] [MAIN ] Derivative Progress: 907/2083 symbols completed. HUBS took 1.6s. Estimated remaining: 7m 27s. Rate: 157.7 symbols/min [2025-10-17T22:39:54.699533] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:54.733800] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:54.735767] [INFO ] [MAIN ] HUM: Generated 1820 derivative records from 50015 primary records. [2025-10-17T22:39:54.736070] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-10-17T22:39:54.762826] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:54.764244] [INFO ] [MAIN ] HUN: Generated 1820 derivative records from 53992 primary records. [2025-10-17T22:39:54.771558] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-17T22:39:54.795284] [DEBUG] [LOCAL ] HUN: Derivative data saved (1820 records). [2025-10-17T22:39:54.808558] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-10-17T22:39:54.812579] [INFO ] [MAIN ] Derivative Progress: 908/2083 symbols completed. HUN took 1.2s. Estimated remaining: 7m 27s. Rate: 157.8 symbols/min [2025-10-17T22:39:54.810185] [DEBUG] [LOCAL ] HUM: Derivative data saved (1820 records). [2025-10-17T22:39:54.812938] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-10-17T22:39:54.813134] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:54.816579] [INFO ] [MAIN ] Derivative Progress: 909/2083 symbols completed. HUM took 1.4s. Estimated remaining: 7m 26s. Rate: 158.0 symbols/min [2025-10-17T22:39:54.818471] [DEBUG] [LOCAL ] HUYA: Loaded 44415 existing records from primary storage. [2025-10-17T22:39:54.816989] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:54.819332] [INFO ] [MAIN ] HUYA: Loaded 44415 primary data records. [2025-10-17T22:39:54.934503] [DEBUG] [LOCAL ] HVT: Loaded 15340 existing records from primary storage. [2025-10-17T22:39:54.940425] [INFO ] [MAIN ] HVT: Loaded 15340 primary data records. [2025-10-17T22:39:55.436039] [DEBUG] [LOCAL ] HWM: Loaded 53536 existing records from primary storage. [2025-10-17T22:39:55.441885] [INFO ] [MAIN ] HWM: Loaded 53536 primary data records. [2025-10-17T22:39:55.769479] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:55.770847] [INFO ] [MAIN ] HUYA: Generated 1820 derivative records from 44415 primary records. [2025-10-17T22:39:55.771266] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-17T22:39:55.791081] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1820 records). [2025-10-17T22:39:55.792074] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-10-17T22:39:55.794508] [INFO ] [MAIN ] Derivative Progress: 910/2083 symbols completed. HUYA took 1.1s. Estimated remaining: 7m 26s. Rate: 157.7 symbols/min [2025-10-17T22:39:55.794793] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:55.808984] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:55.809916] [INFO ] [MAIN ] HVT: Generated 1820 derivative records from 15340 primary records. [2025-10-17T22:39:55.810126] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-17T22:39:55.828169] [DEBUG] [LOCAL ] HVT: Derivative data saved (1820 records). [2025-10-17T22:39:55.828831] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-10-17T22:39:55.831064] [INFO ] [MAIN ] Derivative Progress: 911/2083 symbols completed. HVT took 1.0s. Estimated remaining: 7m 25s. Rate: 157.9 symbols/min [2025-10-17T22:39:55.833716] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:55.862955] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:55.863811] [INFO ] [MAIN ] HWM: Generated 1820 derivative records from 53536 primary records. [2025-10-17T22:39:55.863993] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-17T22:39:55.897406] [DEBUG] [LOCAL ] HY: Loaded 10191 existing records from primary storage. [2025-10-17T22:39:55.899305] [INFO ] [MAIN ] HY: Loaded 10191 primary data records. [2025-10-17T22:39:55.920819] [DEBUG] [LOCAL ] HXL: Loaded 46542 existing records from primary storage. [2025-10-17T22:39:55.936471] [INFO ] [MAIN ] HXL: Loaded 46542 primary data records. [2025-10-17T22:39:55.931137] [DEBUG] [LOCAL ] HWM: Derivative data saved (1820 records). [2025-10-17T22:39:55.936631] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-10-17T22:39:55.945557] [INFO ] [MAIN ] Derivative Progress: 912/2083 symbols completed. HWM took 1.1s. Estimated remaining: 7m 25s. Rate: 158.0 symbols/min [2025-10-17T22:39:55.965913] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:56.169022] [DEBUG] [LOCAL ] HYI: Loaded 9962 existing records from primary storage. [2025-10-17T22:39:56.197432] [INFO ] [MAIN ] HYI: Loaded 9962 primary data records. [2025-10-17T22:39:56.880311] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:56.881452] [INFO ] [MAIN ] HXL: Generated 1820 derivative records from 46542 primary records. [2025-10-17T22:39:56.895785] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-17T22:39:56.896257] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:56.905819] [INFO ] [MAIN ] HY: Generated 1820 derivative records from 10191 primary records. [2025-10-17T22:39:56.914011] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-17T22:39:56.913913] [DEBUG] [LOCAL ] HXL: Derivative data saved (1820 records). [2025-10-17T22:39:56.916682] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-10-17T22:39:56.926577] [INFO ] [MAIN ] Derivative Progress: 913/2083 symbols completed. HXL took 1.1s. Estimated remaining: 7m 25s. Rate: 157.7 symbols/min [2025-10-17T22:39:56.934179] [DEBUG] [LOCAL ] HY: Derivative data saved (1820 records). [2025-10-17T22:39:56.934470] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-10-17T22:39:56.936472] [INFO ] [MAIN ] Derivative Progress: 914/2083 symbols completed. HY took 1.1s. Estimated remaining: 7m 24s. Rate: 157.9 symbols/min [2025-10-17T22:39:56.949102] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:56.949784] [INFO ] [MAIN ] HYI: Generated 1820 derivative records from 9962 primary records. [2025-10-17T22:39:56.949846] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-17T22:39:56.965051] [DEBUG] [LOCAL ] HYI: Derivative data saved (1820 records). [2025-10-17T22:39:56.965113] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-10-17T22:39:56.967423] [INFO ] [MAIN ] Derivative Progress: 915/2083 symbols completed. HYI took 1.0s. Estimated remaining: 7m 23s. Rate: 158.1 symbols/min [2025-10-17T22:39:56.968055] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:56.968138] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:56.968326] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:56.976477] [DEBUG] [LOCAL ] HYTR: Loaded 3189 existing records from primary storage. [2025-10-17T22:39:56.976598] [INFO ] [MAIN ] HYTR: Loaded 3189 primary data records. [2025-10-17T22:39:57.110908] [DEBUG] [LOCAL ] HZO: Loaded 29442 existing records from primary storage. [2025-10-17T22:39:57.145412] [INFO ] [MAIN ] HZO: Loaded 29442 primary data records. [2025-10-17T22:39:57.198440] [DEBUG] [LOCAL ] HYT: Loaded 34156 existing records from primary storage. [2025-10-17T22:39:57.312876] [INFO ] [MAIN ] HYT: Loaded 34156 primary data records. [2025-10-17T22:39:57.982039] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:39:57.984462] [INFO ] [MAIN ] HYTR: Generated 1819 derivative records from 3189 primary records. [2025-10-17T22:39:57.984680] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-17T22:39:58.001249] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1819 records). [2025-10-17T22:39:58.001507] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-10-17T22:39:58.003513] [INFO ] [MAIN ] Derivative Progress: 916/2083 symbols completed. HYTR took 1.0s. Estimated remaining: 7m 24s. Rate: 157.8 symbols/min [2025-10-17T22:39:58.003956] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:58.030903] [DEBUG] [LOCAL ] IAE: Loaded 6362 existing records from primary storage. [2025-10-17T22:39:58.031289] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:58.031489] [INFO ] [MAIN ] IAE: Loaded 6362 primary data records. [2025-10-17T22:39:58.032383] [INFO ] [MAIN ] HZO: Generated 1820 derivative records from 29442 primary records. [2025-10-17T22:39:58.052666] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-10-17T22:39:58.160168] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:58.172342] [INFO ] [MAIN ] HYT: Generated 1820 derivative records from 34156 primary records. [2025-10-17T22:39:58.188135] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-10-17T22:39:58.261529] [DEBUG] [LOCAL ] HYT: Derivative data saved (1820 records). [2025-10-17T22:39:58.261704] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-10-17T22:39:58.262234] [DEBUG] [LOCAL ] HZO: Derivative data saved (1820 records). [2025-10-17T22:39:58.264357] [INFO ] [MAIN ] Derivative Progress: 917/2083 symbols completed. HYT took 1.3s. Estimated remaining: 7m 23s. Rate: 157.8 symbols/min [2025-10-17T22:39:58.264479] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-10-17T22:39:58.367100] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:58.383981] [INFO ] [MAIN ] Derivative Progress: 918/2083 symbols completed. HZO took 1.4s. Estimated remaining: 7m 23s. Rate: 157.9 symbols/min [2025-10-17T22:39:58.384734] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:58.425875] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:58.426625] [INFO ] [MAIN ] IAE: Generated 1820 derivative records from 6362 primary records. [2025-10-17T22:39:58.426771] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-17T22:39:58.456600] [DEBUG] [LOCAL ] IAE: Derivative data saved (1820 records). [2025-10-17T22:39:58.468791] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-10-17T22:39:58.470801] [INFO ] [MAIN ] Derivative Progress: 919/2083 symbols completed. IAE took 0.5s. Estimated remaining: 7m 22s. Rate: 158.1 symbols/min [2025-10-17T22:39:58.470949] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:58.488235] [DEBUG] [LOCAL ] IAG: Loaded 54268 existing records from primary storage. [2025-10-17T22:39:58.488971] [INFO ] [MAIN ] IAG: Loaded 54268 primary data records. [2025-10-17T22:39:58.617378] [DEBUG] [LOCAL ] IBM: Loaded 54411 existing records from primary storage. [2025-10-17T22:39:58.623467] [INFO ] [MAIN ] IBM: Loaded 54411 primary data records. [2025-10-17T22:39:59.023064] [DEBUG] [LOCAL ] IBN: Loaded 53593 existing records from primary storage. [2025-10-17T22:39:59.042603] [INFO ] [MAIN ] IBN: Loaded 53593 primary data records. [2025-10-17T22:39:59.487778] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:59.490616] [INFO ] [MAIN ] IAG: Generated 1820 derivative records from 54268 primary records. [2025-10-17T22:39:59.491414] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-17T22:39:59.516431] [DEBUG] [LOCAL ] IAG: Derivative data saved (1820 records). [2025-10-17T22:39:59.517022] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-17T22:39:59.532866] [INFO ] [MAIN ] Derivative Progress: 920/2083 symbols completed. IAG took 1.2s. Estimated remaining: 7m 22s. Rate: 157.8 symbols/min [2025-10-17T22:39:59.530726] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:59.533273] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:59.534247] [INFO ] [MAIN ] IBM: Generated 1820 derivative records from 54411 primary records. [2025-10-17T22:39:59.535491] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-17T22:39:59.566412] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:39:59.568833] [DEBUG] [LOCAL ] IBM: Derivative data saved (1820 records). [2025-10-17T22:39:59.568988] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-17T22:39:59.567974] [INFO ] [MAIN ] IBN: Generated 1820 derivative records from 53593 primary records. [2025-10-17T22:39:59.571086] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-17T22:39:59.570911] [INFO ] [MAIN ] Derivative Progress: 921/2083 symbols completed. IBM took 1.2s. Estimated remaining: 7m 22s. Rate: 157.9 symbols/min [2025-10-17T22:39:59.571681] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:59.596198] [DEBUG] [LOCAL ] IBN: Derivative data saved (1820 records). [2025-10-17T22:39:59.596362] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-17T22:39:59.598947] [INFO ] [MAIN ] Derivative Progress: 922/2083 symbols completed. IBN took 1.1s. Estimated remaining: 7m 21s. Rate: 158.1 symbols/min [2025-10-17T22:39:59.599271] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:39:59.611458] [DEBUG] [LOCAL ] IBP: Loaded 29142 existing records from primary storage. [2025-10-17T22:39:59.611603] [INFO ] [MAIN ] IBP: Loaded 29142 primary data records. [2025-10-17T22:39:59.791795] [DEBUG] [LOCAL ] IBTA: Loaded 37129 existing records from primary storage. [2025-10-17T22:39:59.814566] [INFO ] [MAIN ] IBTA: Loaded 37129 primary data records. [2025-10-17T22:40:00.092756] [DEBUG] [LOCAL ] ICE: Loaded 53798 existing records from primary storage. [2025-10-17T22:40:00.121931] [INFO ] [MAIN ] ICE: Loaded 53798 primary data records. [2025-10-17T22:40:00.623987] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:00.625684] [INFO ] [MAIN ] IBP: Generated 1820 derivative records from 29142 primary records. [2025-10-17T22:40:00.626038] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-17T22:40:00.645665] [DEBUG] [LOCAL ] IBP: Derivative data saved (1820 records). [2025-10-17T22:40:00.645924] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-10-17T22:40:00.648064] [INFO ] [MAIN ] Derivative Progress: 923/2083 symbols completed. IBP took 1.1s. Estimated remaining: 7m 21s. Rate: 157.8 symbols/min [2025-10-17T22:40:00.648492] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:00.662103] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:00.662846] [INFO ] [MAIN ] IBTA: Generated 1820 derivative records from 37129 primary records. [2025-10-17T22:40:00.662995] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-17T22:40:00.682841] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1820 records). [2025-10-17T22:40:00.685350] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-17T22:40:00.687582] [INFO ] [MAIN ] Derivative Progress: 924/2083 symbols completed. IBTA took 1.1s. Estimated remaining: 7m 20s. Rate: 157.9 symbols/min [2025-10-17T22:40:00.687959] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:00.711049] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:00.711916] [INFO ] [MAIN ] ICE: Generated 1820 derivative records from 53798 primary records. [2025-10-17T22:40:00.712126] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-17T22:40:00.739576] [DEBUG] [LOCAL ] ICL: Loaded 39044 existing records from primary storage. [2025-10-17T22:40:00.740343] [INFO ] [MAIN ] ICL: Loaded 39044 primary data records. [2025-10-17T22:40:00.740831] [DEBUG] [LOCAL ] ICE: Derivative data saved (1820 records). [2025-10-17T22:40:00.741049] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-17T22:40:00.743335] [INFO ] [MAIN ] Derivative Progress: 925/2083 symbols completed. ICE took 1.1s. Estimated remaining: 7m 20s. Rate: 158.1 symbols/min [2025-10-17T22:40:00.763574] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:00.885995] [DEBUG] [LOCAL ] IDA: Loaded 33149 existing records from primary storage. [2025-10-17T22:40:00.940485] [DEBUG] [LOCAL ] IDE: Loaded 9258 existing records from primary storage. [2025-10-17T22:40:00.912782] [INFO ] [MAIN ] IDA: Loaded 33149 primary data records. [2025-10-17T22:40:01.045350] [INFO ] [MAIN ] IDE: Loaded 9258 primary data records. [2025-10-17T22:40:01.739116] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:01.740716] [INFO ] [MAIN ] ICL: Generated 1820 derivative records from 39044 primary records. [2025-10-17T22:40:01.741876] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-17T22:40:01.761363] [DEBUG] [LOCAL ] ICL: Derivative data saved (1820 records). [2025-10-17T22:40:01.762379] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-17T22:40:01.764680] [INFO ] [MAIN ] Derivative Progress: 926/2083 symbols completed. ICL took 1.1s. Estimated remaining: 7m 20s. Rate: 157.8 symbols/min [2025-10-17T22:40:01.765603] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:01.789236] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:01.790417] [INFO ] [MAIN ] IDA: Generated 1820 derivative records from 33149 primary records. [2025-10-17T22:40:01.804331] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-17T22:40:01.805329] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:01.827373] [INFO ] [MAIN ] IDE: Generated 1820 derivative records from 9258 primary records. [2025-10-17T22:40:01.829260] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-17T22:40:01.837536] [DEBUG] [LOCAL ] IDT: Loaded 18788 existing records from primary storage. [2025-10-17T22:40:01.840010] [INFO ] [MAIN ] IDT: Loaded 18788 primary data records. [2025-10-17T22:40:01.862518] [DEBUG] [LOCAL ] IDE: Derivative data saved (1820 records). [2025-10-17T22:40:01.869923] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-17T22:40:01.857884] [DEBUG] [LOCAL ] IDA: Derivative data saved (1820 records). [2025-10-17T22:40:01.872283] [INFO ] [MAIN ] Derivative Progress: 927/2083 symbols completed. IDE took 1.1s. Estimated remaining: 7m 19s. Rate: 157.9 symbols/min [2025-10-17T22:40:01.892536] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:01.898001] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-17T22:40:01.912971] [INFO ] [MAIN ] Derivative Progress: 928/2083 symbols completed. IDA took 1.2s. Estimated remaining: 7m 18s. Rate: 158.1 symbols/min [2025-10-17T22:40:02.201089] [DEBUG] [LOCAL ] IEX: Loaded 38977 existing records from primary storage. [2025-10-17T22:40:02.201829] [INFO ] [MAIN ] IEX: Loaded 38977 primary data records. [2025-10-17T22:40:02.607926] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:02.608716] [INFO ] [MAIN ] IDT: Generated 1820 derivative records from 18788 primary records. [2025-10-17T22:40:02.608782] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-17T22:40:02.627925] [DEBUG] [LOCAL ] IDT: Derivative data saved (1820 records). [2025-10-17T22:40:02.628467] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-17T22:40:02.630754] [INFO ] [MAIN ] Derivative Progress: 929/2083 symbols completed. IDT took 0.9s. Estimated remaining: 7m 18s. Rate: 157.9 symbols/min [2025-10-17T22:40:02.654556] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:02.655394] [INFO ] [MAIN ] IEX: Generated 1820 derivative records from 38977 primary records. [2025-10-17T22:40:02.655466] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-17T22:40:02.672908] [DEBUG] [LOCAL ] IEX: Derivative data saved (1820 records). [2025-10-17T22:40:02.673077] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-17T22:40:02.675600] [INFO ] [MAIN ] Derivative Progress: 930/2083 symbols completed. IEX took 0.8s. Estimated remaining: 7m 18s. Rate: 158.1 symbols/min [2025-10-17T22:40:02.676201] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:02.676924] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:02.676363] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:02.712247] [DEBUG] [LOCAL ] IFN: Loaded 18730 existing records from primary storage. [2025-10-17T22:40:02.712435] [INFO ] [MAIN ] IFN: Loaded 18730 primary data records. [2025-10-17T22:40:02.718184] [DEBUG] [LOCAL ] IFS: Loaded 22863 existing records from primary storage. [2025-10-17T22:40:02.743423] [INFO ] [MAIN ] IFS: Loaded 22863 primary data records. [2025-10-17T22:40:03.374077] [DEBUG] [LOCAL ] IFF: Loaded 51919 existing records from primary storage. [2025-10-17T22:40:03.375117] [INFO ] [MAIN ] IFF: Loaded 51919 primary data records. [2025-10-17T22:40:03.734616] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:03.734362] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:03.736099] [INFO ] [MAIN ] IFS: Generated 1820 derivative records from 22863 primary records. [2025-10-17T22:40:03.735490] [INFO ] [MAIN ] IFN: Generated 1820 derivative records from 18730 primary records. [2025-10-17T22:40:03.736239] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-17T22:40:03.738331] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-17T22:40:03.762435] [DEBUG] [LOCAL ] IFS: Derivative data saved (1820 records). [2025-10-17T22:40:03.766799] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-17T22:40:03.770032] [INFO ] [MAIN ] Derivative Progress: 931/2083 symbols completed. IFS took 1.1s. Estimated remaining: 7m 18s. Rate: 157.7 symbols/min [2025-10-17T22:40:03.770865] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:03.773839] [DEBUG] [LOCAL ] IFN: Derivative data saved (1820 records). [2025-10-17T22:40:03.774438] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-17T22:40:03.776600] [INFO ] [MAIN ] Derivative Progress: 932/2083 symbols completed. IFN took 1.1s. Estimated remaining: 7m 17s. Rate: 157.9 symbols/min [2025-10-17T22:40:03.777134] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:03.798194] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:03.803883] [DEBUG] [LOCAL ] IGA: Loaded 10395 existing records from primary storage. [2025-10-17T22:40:03.803571] [INFO ] [MAIN ] IFF: Generated 1820 derivative records from 51919 primary records. [2025-10-17T22:40:03.804033] [INFO ] [MAIN ] IGA: Loaded 10395 primary data records. [2025-10-17T22:40:03.804184] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-17T22:40:03.922808] [DEBUG] [LOCAL ] IGD: Loaded 19676 existing records from primary storage. [2025-10-17T22:40:03.922994] [INFO ] [MAIN ] IGD: Loaded 19676 primary data records. [2025-10-17T22:40:03.985116] [DEBUG] [LOCAL ] IFF: Derivative data saved (1820 records). [2025-10-17T22:40:04.043117] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-17T22:40:04.106140] [INFO ] [MAIN ] Derivative Progress: 933/2083 symbols completed. IFF took 1.4s. Estimated remaining: 7m 17s. Rate: 157.9 symbols/min [2025-10-17T22:40:04.252859] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:04.481829] [DEBUG] [LOCAL ] IGI: Loaded 4092 existing records from primary storage. [2025-10-17T22:40:04.482354] [INFO ] [MAIN ] IGI: Loaded 4092 primary data records. [2025-10-17T22:40:04.808518] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:04.811299] [INFO ] [MAIN ] IGA: Generated 1820 derivative records from 10395 primary records. [2025-10-17T22:40:04.813383] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-17T22:40:04.841983] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:04.844943] [INFO ] [MAIN ] IGD: Generated 1820 derivative records from 19676 primary records. [2025-10-17T22:40:04.845056] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-17T22:40:04.846882] [DEBUG] [LOCAL ] IGA: Derivative data saved (1820 records). [2025-10-17T22:40:04.847136] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-17T22:40:04.849727] [INFO ] [MAIN ] Derivative Progress: 934/2083 symbols completed. IGA took 1.1s. Estimated remaining: 7m 17s. Rate: 157.8 symbols/min [2025-10-17T22:40:04.863925] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:04.864984] [DEBUG] [LOCAL ] IGD: Derivative data saved (1820 records). [2025-10-17T22:40:04.865291] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-17T22:40:04.867829] [INFO ] [MAIN ] Derivative Progress: 935/2083 symbols completed. IGD took 1.1s. Estimated remaining: 7m 16s. Rate: 157.9 symbols/min [2025-10-17T22:40:04.868291] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:04.887222] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:04.890429] [INFO ] [MAIN ] IGI: Generated 1820 derivative records from 4092 primary records. [2025-10-17T22:40:04.890542] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-17T22:40:04.903555] [DEBUG] [LOCAL ] IHD: Loaded 7396 existing records from primary storage. [2025-10-17T22:40:04.911693] [INFO ] [MAIN ] IHD: Loaded 7396 primary data records. [2025-10-17T22:40:04.911529] [DEBUG] [LOCAL ] IGI: Derivative data saved (1820 records). [2025-10-17T22:40:04.946256] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-17T22:40:04.998273] [INFO ] [MAIN ] Derivative Progress: 936/2083 symbols completed. IGI took 0.7s. Estimated remaining: 7m 15s. Rate: 158.0 symbols/min [2025-10-17T22:40:05.050558] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:05.054176] [DEBUG] [LOCAL ] IGR: Loaded 30813 existing records from primary storage. [2025-10-17T22:40:05.054601] [INFO ] [MAIN ] IGR: Loaded 30813 primary data records. [2025-10-17T22:40:05.446568] [DEBUG] [LOCAL ] IHG: Loaded 24671 existing records from primary storage. [2025-10-17T22:40:05.568604] [INFO ] [MAIN ] IHG: Loaded 24671 primary data records. [2025-10-17T22:40:05.905715] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:05.909705] [INFO ] [MAIN ] IHD: Generated 1820 derivative records from 7396 primary records. [2025-10-17T22:40:05.910295] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-17T22:40:05.937017] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:05.939004] [DEBUG] [LOCAL ] IHD: Derivative data saved (1820 records). [2025-10-17T22:40:05.940138] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-17T22:40:05.939949] [INFO ] [MAIN ] IGR: Generated 1820 derivative records from 30813 primary records. [2025-10-17T22:40:05.940269] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-17T22:40:05.942607] [INFO ] [MAIN ] Derivative Progress: 937/2083 symbols completed. IHD took 1.1s. Estimated remaining: 7m 16s. Rate: 157.8 symbols/min [2025-10-17T22:40:05.943756] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:05.961162] [DEBUG] [LOCAL ] IGR: Derivative data saved (1820 records). [2025-10-17T22:40:05.961345] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-17T22:40:05.963672] [INFO ] [MAIN ] Derivative Progress: 938/2083 symbols completed. IGR took 1.1s. Estimated remaining: 7m 15s. Rate: 157.9 symbols/min [2025-10-17T22:40:05.964862] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:05.979274] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:05.980128] [INFO ] [MAIN ] IHG: Generated 1820 derivative records from 24671 primary records. [2025-10-17T22:40:05.980192] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-17T22:40:06.005979] [DEBUG] [LOCAL ] IHG: Derivative data saved (1820 records). [2025-10-17T22:40:06.006081] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-17T22:40:06.008385] [INFO ] [MAIN ] Derivative Progress: 939/2083 symbols completed. IHG took 1.0s. Estimated remaining: 7m 14s. Rate: 158.1 symbols/min [2025-10-17T22:40:06.008663] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:06.012882] [DEBUG] [LOCAL ] IIF: Loaded 5622 existing records from primary storage. [2025-10-17T22:40:06.013120] [INFO ] [MAIN ] IIF: Loaded 5622 primary data records. [2025-10-17T22:40:06.112439] [DEBUG] [LOCAL ] IHS: Loaded 38062 existing records from primary storage. [2025-10-17T22:40:06.134187] [INFO ] [MAIN ] IHS: Loaded 38062 primary data records. [2025-10-17T22:40:06.227250] [DEBUG] [LOCAL ] IIIN: Loaded 16427 existing records from primary storage. [2025-10-17T22:40:06.289520] [INFO ] [MAIN ] IIIN: Loaded 16427 primary data records. [2025-10-17T22:40:07.006905] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:07.008498] [INFO ] [MAIN ] IIF: Generated 1820 derivative records from 5622 primary records. [2025-10-17T22:40:07.008733] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-17T22:40:07.027102] [DEBUG] [LOCAL ] IIF: Derivative data saved (1820 records). [2025-10-17T22:40:07.027778] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-17T22:40:07.030000] [INFO ] [MAIN ] Derivative Progress: 940/2083 symbols completed. IIF took 1.1s. Estimated remaining: 7m 15s. Rate: 157.8 symbols/min [2025-10-17T22:40:07.038163] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:07.044343] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:07.045599] [INFO ] [MAIN ] IHS: Generated 1820 derivative records from 38062 primary records. [2025-10-17T22:40:07.045817] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-17T22:40:07.065241] [DEBUG] [LOCAL ] IHS: Derivative data saved (1820 records). [2025-10-17T22:40:07.065345] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-17T22:40:07.079909] [INFO ] [MAIN ] Derivative Progress: 941/2083 symbols completed. IHS took 1.1s. Estimated remaining: 7m 14s. Rate: 158.0 symbols/min [2025-10-17T22:40:07.084705] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:07.085254] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:07.086382] [INFO ] [MAIN ] IIIN: Generated 1820 derivative records from 16427 primary records. [2025-10-17T22:40:07.086514] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-17T22:40:07.102637] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1820 records). [2025-10-17T22:40:07.102849] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-17T22:40:07.110256] [INFO ] [MAIN ] Derivative Progress: 942/2083 symbols completed. IIIN took 1.1s. Estimated remaining: 7m 13s. Rate: 158.1 symbols/min [2025-10-17T22:40:07.110783] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:07.111775] [DEBUG] [LOCAL ] IIM: Loaded 15903 existing records from primary storage. [2025-10-17T22:40:07.111918] [INFO ] [MAIN ] IIM: Loaded 15903 primary data records. [2025-10-17T22:40:07.260443] [DEBUG] [LOCAL ] IIPR: Loaded 29862 existing records from primary storage. [2025-10-17T22:40:07.303867] [INFO ] [MAIN ] IIPR: Loaded 29862 primary data records. [2025-10-17T22:40:07.559796] [DEBUG] [LOCAL ] IMAX: Loaded 43881 existing records from primary storage. [2025-10-17T22:40:07.577522] [INFO ] [MAIN ] IMAX: Loaded 43881 primary data records. [2025-10-17T22:40:08.133813] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:08.135445] [INFO ] [MAIN ] IIM: Generated 1820 derivative records from 15903 primary records. [2025-10-17T22:40:08.136118] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-17T22:40:08.154787] [DEBUG] [LOCAL ] IIM: Derivative data saved (1820 records). [2025-10-17T22:40:08.156393] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-17T22:40:08.160060] [INFO ] [MAIN ] Derivative Progress: 943/2083 symbols completed. IIM took 1.1s. Estimated remaining: 7m 13s. Rate: 157.8 symbols/min [2025-10-17T22:40:08.175523] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:08.176605] [INFO ] [MAIN ] IIPR: Generated 1820 derivative records from 29862 primary records. [2025-10-17T22:40:08.176824] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-17T22:40:08.210160] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1820 records). [2025-10-17T22:40:08.210547] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-17T22:40:08.213145] [INFO ] [MAIN ] Derivative Progress: 944/2083 symbols completed. IIPR took 1.1s. Estimated remaining: 7m 13s. Rate: 158.0 symbols/min [2025-10-17T22:40:08.210788] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:08.214150] [INFO ] [MAIN ] IMAX: Generated 1820 derivative records from 43881 primary records. [2025-10-17T22:40:08.214227] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-17T22:40:08.230316] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1820 records). [2025-10-17T22:40:08.230408] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-17T22:40:08.232977] [INFO ] [MAIN ] Derivative Progress: 945/2083 symbols completed. IMAX took 1.1s. Estimated remaining: 7m 12s. Rate: 158.1 symbols/min [2025-10-17T22:40:08.233597] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:08.234093] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:08.233765] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:08.320670] [DEBUG] [LOCAL ] INFA: Loaded 49646 existing records from primary storage. [2025-10-17T22:40:08.322861] [INFO ] [MAIN ] INFA: Loaded 49646 primary data records. [2025-10-17T22:40:08.323520] [DEBUG] [LOCAL ] ING: Loaded 51494 existing records from primary storage. [2025-10-17T22:40:08.323982] [INFO ] [MAIN ] ING: Loaded 51494 primary data records. [2025-10-17T22:40:08.374566] [DEBUG] [LOCAL ] INFY: Loaded 54376 existing records from primary storage. [2025-10-17T22:40:08.449850] [INFO ] [MAIN ] INFY: Loaded 54376 primary data records. [2025-10-17T22:40:09.300849] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:09.306737] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:09.307437] [INFO ] [MAIN ] INFA: Generated 1820 derivative records from 49646 primary records. [2025-10-17T22:40:09.306373] [INFO ] [MAIN ] ING: Generated 1820 derivative records from 51494 primary records. [2025-10-17T22:40:09.307719] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-17T22:40:09.308660] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-17T22:40:09.334934] [DEBUG] [LOCAL ] INFA: Derivative data saved (1820 records). [2025-10-17T22:40:09.338766] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-17T22:40:09.340701] [INFO ] [MAIN ] Derivative Progress: 946/2083 symbols completed. INFA took 1.1s. Estimated remaining: 7m 12s. Rate: 157.8 symbols/min [2025-10-17T22:40:09.356527] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:09.358461] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:09.358036] [DEBUG] [LOCAL ] ING: Derivative data saved (1820 records). [2025-10-17T22:40:09.359403] [INFO ] [MAIN ] INFY: Generated 1820 derivative records from 54376 primary records. [2025-10-17T22:40:09.359507] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-17T22:40:09.359812] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-10-17T22:40:09.363042] [INFO ] [MAIN ] Derivative Progress: 947/2083 symbols completed. ING took 1.1s. Estimated remaining: 7m 12s. Rate: 157.9 symbols/min [2025-10-17T22:40:09.374989] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:09.380771] [DEBUG] [LOCAL ] INFY: Derivative data saved (1820 records). [2025-10-17T22:40:09.380988] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-17T22:40:09.383301] [INFO ] [MAIN ] Derivative Progress: 948/2083 symbols completed. INFY took 1.1s. Estimated remaining: 7m 11s. Rate: 158.1 symbols/min [2025-10-17T22:40:09.383533] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:09.416848] [DEBUG] [LOCAL ] INGM: Loaded 28706 existing records from primary storage. [2025-10-17T22:40:09.417004] [INFO ] [MAIN ] INGM: Loaded 28706 primary data records. [2025-10-17T22:40:09.536891] [DEBUG] [LOCAL ] INGR: Loaded 34266 existing records from primary storage. [2025-10-17T22:40:09.558083] [INFO ] [MAIN ] INGR: Loaded 34266 primary data records. [2025-10-17T22:40:09.703463] [DEBUG] [LOCAL ] INN: Loaded 42375 existing records from primary storage. [2025-10-17T22:40:09.845997] [INFO ] [MAIN ] INN: Loaded 42375 primary data records. [2025-10-17T22:40:10.409697] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:10.410857] [INFO ] [MAIN ] INGM: Generated 1820 derivative records from 28706 primary records. [2025-10-17T22:40:10.410986] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-17T22:40:10.445345] [DEBUG] [LOCAL ] INGM: Derivative data saved (1820 records). [2025-10-17T22:40:10.444951] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:10.445773] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-17T22:40:10.446702] [INFO ] [MAIN ] INGR: Generated 1820 derivative records from 34266 primary records. [2025-10-17T22:40:10.448922] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-17T22:40:10.448616] [INFO ] [MAIN ] Derivative Progress: 949/2083 symbols completed. INGM took 1.1s. Estimated remaining: 7m 11s. Rate: 157.8 symbols/min [2025-10-17T22:40:10.450151] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:10.481899] [DEBUG] [LOCAL ] INGR: Derivative data saved (1820 records). [2025-10-17T22:40:10.482530] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-17T22:40:10.484733] [INFO ] [MAIN ] Derivative Progress: 950/2083 symbols completed. INGR took 1.1s. Estimated remaining: 7m 10s. Rate: 158.0 symbols/min [2025-10-17T22:40:10.484943] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:10.485211] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:10.486408] [INFO ] [MAIN ] INN: Generated 1820 derivative records from 42375 primary records. [2025-10-17T22:40:10.486473] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-17T22:40:10.502972] [DEBUG] [LOCAL ] INN: Derivative data saved (1820 records). [2025-10-17T22:40:10.513501] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-17T22:40:10.517218] [INFO ] [MAIN ] Derivative Progress: 951/2083 symbols completed. INN took 1.1s. Estimated remaining: 7m 10s. Rate: 158.1 symbols/min [2025-10-17T22:40:10.517487] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:10.534001] [DEBUG] [LOCAL ] INSP: Loaded 38922 existing records from primary storage. [2025-10-17T22:40:10.534338] [INFO ] [MAIN ] INSP: Loaded 38922 primary data records. [2025-10-17T22:40:10.716534] [DEBUG] [LOCAL ] INSW: Loaded 40192 existing records from primary storage. [2025-10-17T22:40:10.716852] [INFO ] [MAIN ] INSW: Loaded 40192 primary data records. [2025-10-17T22:40:11.014707] [DEBUG] [LOCAL ] INVH: Loaded 53973 existing records from primary storage. [2025-10-17T22:40:11.060728] [INFO ] [MAIN ] INVH: Loaded 53973 primary data records. [2025-10-17T22:40:11.513831] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:11.517343] [INFO ] [MAIN ] INSP: Generated 1820 derivative records from 38922 primary records. [2025-10-17T22:40:11.519094] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-17T22:40:11.549926] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:11.552405] [INFO ] [MAIN ] INSW: Generated 1820 derivative records from 40192 primary records. [2025-10-17T22:40:11.552983] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-17T22:40:11.569956] [DEBUG] [LOCAL ] INSP: Derivative data saved (1820 records). [2025-10-17T22:40:11.572439] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-17T22:40:11.573306] [DEBUG] [LOCAL ] INSW: Derivative data saved (1820 records). [2025-10-17T22:40:11.573421] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-17T22:40:11.575717] [INFO ] [MAIN ] Derivative Progress: 952/2083 symbols completed. INSW took 1.1s. Estimated remaining: 7m 10s. Rate: 157.8 symbols/min [2025-10-17T22:40:11.578294] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:11.578366] [INFO ] [MAIN ] Derivative Progress: 953/2083 symbols completed. INSP took 1.1s. Estimated remaining: 7m 9s. Rate: 158.0 symbols/min [2025-10-17T22:40:11.578585] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:11.596803] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:11.597449] [INFO ] [MAIN ] INVH: Generated 1820 derivative records from 53973 primary records. [2025-10-17T22:40:11.597626] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-17T22:40:11.615059] [DEBUG] [LOCAL ] INVH: Derivative data saved (1820 records). [2025-10-17T22:40:11.615264] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-17T22:40:11.618878] [INFO ] [MAIN ] Derivative Progress: 954/2083 symbols completed. INVH took 1.1s. Estimated remaining: 7m 8s. Rate: 158.1 symbols/min [2025-10-17T22:40:11.619136] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:11.688206] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-10-17T22:40:11.689872] [INFO ] [MAIN ] IONQ: Loaded 54568 primary data records. [2025-10-17T22:40:11.702230] [DEBUG] [LOCAL ] IOT: Loaded 54260 existing records from primary storage. [2025-10-17T22:40:11.747282] [INFO ] [MAIN ] IOT: Loaded 54260 primary data records. [2025-10-17T22:40:12.111524] [DEBUG] [LOCAL ] IP: Loaded 54087 existing records from primary storage. [2025-10-17T22:40:12.125491] [INFO ] [MAIN ] IP: Loaded 54087 primary data records. [2025-10-17T22:40:12.696936] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:12.698028] [INFO ] [MAIN ] IONQ: Generated 1820 derivative records from 54568 primary records. [2025-10-17T22:40:12.698548] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-17T22:40:12.716829] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1820 records). [2025-10-17T22:40:12.717877] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-17T22:40:12.721799] [INFO ] [MAIN ] Derivative Progress: 955/2083 symbols completed. IONQ took 1.1s. Estimated remaining: 7m 9s. Rate: 157.8 symbols/min [2025-10-17T22:40:12.722783] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:12.737662] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:12.738468] [INFO ] [MAIN ] IOT: Generated 1820 derivative records from 54260 primary records. [2025-10-17T22:40:12.738592] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-17T22:40:12.757591] [DEBUG] [LOCAL ] IOT: Derivative data saved (1820 records). [2025-10-17T22:40:12.765422] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-17T22:40:12.767669] [INFO ] [MAIN ] Derivative Progress: 956/2083 symbols completed. IOT took 1.2s. Estimated remaining: 7m 8s. Rate: 158.0 symbols/min [2025-10-17T22:40:12.772542] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:12.773530] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:12.774269] [INFO ] [MAIN ] IP: Generated 1820 derivative records from 54087 primary records. [2025-10-17T22:40:12.774376] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-17T22:40:12.791935] [DEBUG] [LOCAL ] IP: Derivative data saved (1820 records). [2025-10-17T22:40:12.792086] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-17T22:40:12.794080] [INFO ] [MAIN ] Derivative Progress: 957/2083 symbols completed. IP took 1.2s. Estimated remaining: 7m 7s. Rate: 158.1 symbols/min [2025-10-17T22:40:12.794389] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:12.822721] [DEBUG] [LOCAL ] IPI: Loaded 21783 existing records from primary storage. [2025-10-17T22:40:12.827390] [INFO ] [MAIN ] IPI: Loaded 21783 primary data records. [2025-10-17T22:40:12.950074] [DEBUG] [LOCAL ] IQI: Loaded 18096 existing records from primary storage. [2025-10-17T22:40:12.939114] [DEBUG] [LOCAL ] IPG: Loaded 54111 existing records from primary storage. [2025-10-17T22:40:12.950696] [INFO ] [MAIN ] IPG: Loaded 54111 primary data records. [2025-10-17T22:40:12.950383] [INFO ] [MAIN ] IQI: Loaded 18096 primary data records. [2025-10-17T22:40:13.782388] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:13.783386] [INFO ] [MAIN ] IPI: Generated 1820 derivative records from 21783 primary records. [2025-10-17T22:40:13.783764] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-17T22:40:13.801899] [DEBUG] [LOCAL ] IPI: Derivative data saved (1820 records). [2025-10-17T22:40:13.802129] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-17T22:40:13.804398] [INFO ] [MAIN ] Derivative Progress: 958/2083 symbols completed. IPI took 1.0s. Estimated remaining: 7m 8s. Rate: 157.8 symbols/min [2025-10-17T22:40:13.822297] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:13.824886] [INFO ] [MAIN ] IPG: Generated 1820 derivative records from 54111 primary records. [2025-10-17T22:40:13.825067] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-17T22:40:13.838302] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:13.839131] [INFO ] [MAIN ] IQI: Generated 1820 derivative records from 18096 primary records. [2025-10-17T22:40:13.846483] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-17T22:40:13.870002] [DEBUG] [LOCAL ] IQI: Derivative data saved (1820 records). [2025-10-17T22:40:13.870356] [DEBUG] [LOCAL ] IPG: Derivative data saved (1820 records). [2025-10-17T22:40:13.870496] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-17T22:40:13.870555] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-17T22:40:13.872958] [INFO ] [MAIN ] Derivative Progress: 959/2083 symbols completed. IQI took 1.1s. Estimated remaining: 7m 7s. Rate: 158.0 symbols/min [2025-10-17T22:40:13.875269] [INFO ] [MAIN ] Derivative Progress: 960/2083 symbols completed. IPG took 1.2s. Estimated remaining: 7m 6s. Rate: 158.1 symbols/min [2025-10-17T22:40:13.875618] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:13.875799] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:13.875746] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:13.960030] [DEBUG] [LOCAL ] IR: Loaded 53548 existing records from primary storage. [2025-10-17T22:40:13.961140] [INFO ] [MAIN ] IR: Loaded 53548 primary data records. [2025-10-17T22:40:13.983041] [DEBUG] [LOCAL ] IRM: Loaded 49820 existing records from primary storage. [2025-10-17T22:40:13.998829] [INFO ] [MAIN ] IRM: Loaded 49820 primary data records. [2025-10-17T22:40:14.132040] [DEBUG] [LOCAL ] IQV: Loaded 50750 existing records from primary storage. [2025-10-17T22:40:14.160623] [INFO ] [MAIN ] IQV: Loaded 50750 primary data records. [2025-10-17T22:40:14.937750] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:14.939377] [INFO ] [MAIN ] IR: Generated 1820 derivative records from 53548 primary records. [2025-10-17T22:40:14.939622] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-17T22:40:14.973534] [DEBUG] [LOCAL ] IR: Derivative data saved (1820 records). [2025-10-17T22:40:14.974141] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-17T22:40:14.974464] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:14.976575] [INFO ] [MAIN ] Derivative Progress: 961/2083 symbols completed. IR took 1.1s. Estimated remaining: 7m 7s. Rate: 157.8 symbols/min [2025-10-17T22:40:14.977630] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:14.978748] [INFO ] [MAIN ] IRM: Generated 1820 derivative records from 49820 primary records. [2025-10-17T22:40:14.981518] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-17T22:40:15.006575] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:15.011863] [DEBUG] [LOCAL ] IRM: Derivative data saved (1820 records). [2025-10-17T22:40:15.012048] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-17T22:40:15.010710] [INFO ] [MAIN ] IQV: Generated 1820 derivative records from 50750 primary records. [2025-10-17T22:40:15.012181] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-17T22:40:15.015197] [INFO ] [MAIN ] Derivative Progress: 962/2083 symbols completed. IRM took 1.1s. Estimated remaining: 7m 6s. Rate: 158.0 symbols/min [2025-10-17T22:40:15.015791] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:15.039161] [DEBUG] [LOCAL ] IQV: Derivative data saved (1820 records). [2025-10-17T22:40:15.039447] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-17T22:40:15.044126] [INFO ] [MAIN ] Derivative Progress: 963/2083 symbols completed. IQV took 1.2s. Estimated remaining: 7m 5s. Rate: 158.1 symbols/min [2025-10-17T22:40:15.044389] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:15.055756] [DEBUG] [LOCAL ] IRS: Loaded 23427 existing records from primary storage. [2025-10-17T22:40:15.056128] [INFO ] [MAIN ] IRS: Loaded 23427 primary data records. [2025-10-17T22:40:15.252740] [DEBUG] [LOCAL ] ISD: Loaded 16121 existing records from primary storage. [2025-10-17T22:40:15.362378] [INFO ] [MAIN ] ISD: Loaded 16121 primary data records. [2025-10-17T22:40:15.468894] [DEBUG] [LOCAL ] IRT: Loaded 51273 existing records from primary storage. [2025-10-17T22:40:15.487603] [INFO ] [MAIN ] IRT: Loaded 51273 primary data records. [2025-10-17T22:40:16.026743] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:16.027740] [INFO ] [MAIN ] IRS: Generated 1820 derivative records from 23427 primary records. [2025-10-17T22:40:16.028335] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-17T22:40:16.049283] [DEBUG] [LOCAL ] IRS: Derivative data saved (1820 records). [2025-10-17T22:40:16.049455] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-17T22:40:16.051931] [INFO ] [MAIN ] Derivative Progress: 964/2083 symbols completed. IRS took 1.1s. Estimated remaining: 7m 5s. Rate: 157.8 symbols/min [2025-10-17T22:40:16.053572] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:16.072073] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:16.072967] [INFO ] [MAIN ] ISD: Generated 1820 derivative records from 16121 primary records. [2025-10-17T22:40:16.073251] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-17T22:40:16.102362] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:16.104297] [INFO ] [MAIN ] IRT: Generated 1820 derivative records from 51273 primary records. [2025-10-17T22:40:16.104445] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-17T22:40:16.114224] [DEBUG] [LOCAL ] ISD: Derivative data saved (1820 records). [2025-10-17T22:40:16.114486] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-17T22:40:16.117924] [INFO ] [MAIN ] Derivative Progress: 965/2083 symbols completed. ISD took 1.1s. Estimated remaining: 7m 5s. Rate: 158.0 symbols/min [2025-10-17T22:40:16.131183] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:16.135823] [DEBUG] [LOCAL ] IRT: Derivative data saved (1820 records). [2025-10-17T22:40:16.135913] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-17T22:40:16.138188] [INFO ] [MAIN ] Derivative Progress: 966/2083 symbols completed. IRT took 1.1s. Estimated remaining: 7m 4s. Rate: 158.1 symbols/min [2025-10-17T22:40:16.138473] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:16.153249] [DEBUG] [LOCAL ] IT: Loaded 42892 existing records from primary storage. [2025-10-17T22:40:16.153424] [INFO ] [MAIN ] IT: Loaded 42892 primary data records. [2025-10-17T22:40:16.277906] [DEBUG] [LOCAL ] ITGR: Loaded 31722 existing records from primary storage. [2025-10-17T22:40:16.303017] [INFO ] [MAIN ] ITGR: Loaded 31722 primary data records. [2025-10-17T22:40:16.398995] [DEBUG] [LOCAL ] ITT: Loaded 33177 existing records from primary storage. [2025-10-17T22:40:16.539403] [INFO ] [MAIN ] ITT: Loaded 33177 primary data records. [2025-10-17T22:40:17.351023] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:17.352785] [INFO ] [MAIN ] IT: Generated 1820 derivative records from 42892 primary records. [2025-10-17T22:40:17.353816] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-17T22:40:17.379891] [DEBUG] [LOCAL ] IT: Derivative data saved (1820 records). [2025-10-17T22:40:17.381289] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-17T22:40:17.385268] [INFO ] [MAIN ] Derivative Progress: 967/2083 symbols completed. IT took 1.3s. Estimated remaining: 7m 4s. Rate: 157.8 symbols/min [2025-10-17T22:40:17.385693] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:17.411551] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:17.412583] [INFO ] [MAIN ] ITGR: Generated 1820 derivative records from 31722 primary records. [2025-10-17T22:40:17.413501] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-17T22:40:17.465874] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:17.468350] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1820 records). [2025-10-17T22:40:17.468575] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-17T22:40:17.469625] [INFO ] [MAIN ] ITT: Generated 1820 derivative records from 33177 primary records. [2025-10-17T22:40:17.473016] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-17T22:40:17.472906] [INFO ] [MAIN ] Derivative Progress: 968/2083 symbols completed. ITGR took 1.3s. Estimated remaining: 7m 4s. Rate: 157.9 symbols/min [2025-10-17T22:40:17.474498] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:17.516429] [DEBUG] [LOCAL ] ITT: Derivative data saved (1820 records). [2025-10-17T22:40:17.516687] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-17T22:40:17.519697] [INFO ] [MAIN ] Derivative Progress: 969/2083 symbols completed. ITT took 1.4s. Estimated remaining: 7m 3s. Rate: 158.0 symbols/min [2025-10-17T22:40:17.520083] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:17.543687] [DEBUG] [LOCAL ] ITUB: Loaded 54103 existing records from primary storage. [2025-10-17T22:40:17.544100] [INFO ] [MAIN ] ITUB: Loaded 54103 primary data records. [2025-10-17T22:40:17.747020] [DEBUG] [LOCAL ] ITW: Loaded 46398 existing records from primary storage. [2025-10-17T22:40:17.751855] [INFO ] [MAIN ] ITW: Loaded 46398 primary data records. [2025-10-17T22:40:17.937935] [DEBUG] [LOCAL ] IVR: Loaded 48761 existing records from primary storage. [2025-10-17T22:40:17.975600] [INFO ] [MAIN ] IVR: Loaded 48761 primary data records. [2025-10-17T22:40:18.708801] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:18.713510] [INFO ] [MAIN ] ITUB: Generated 1820 derivative records from 54103 primary records. [2025-10-17T22:40:18.714248] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-17T22:40:18.743824] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:18.745489] [INFO ] [MAIN ] ITW: Generated 1820 derivative records from 46398 primary records. [2025-10-17T22:40:18.744784] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1820 records). [2025-10-17T22:40:18.745854] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-17T22:40:18.747828] [INFO ] [MAIN ] Derivative Progress: 970/2083 symbols completed. ITUB took 1.4s. Estimated remaining: 7m 4s. Rate: 157.7 symbols/min [2025-10-17T22:40:18.745590] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-17T22:40:18.748036] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:18.767785] [DEBUG] [LOCAL ] ITW: Derivative data saved (1820 records). [2025-10-17T22:40:18.775500] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-17T22:40:18.778094] [INFO ] [MAIN ] Derivative Progress: 971/2083 symbols completed. ITW took 1.3s. Estimated remaining: 7m 3s. Rate: 157.8 symbols/min [2025-10-17T22:40:18.778289] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:18.784194] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:18.784914] [INFO ] [MAIN ] IVR: Generated 1820 derivative records from 48761 primary records. [2025-10-17T22:40:18.785062] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-17T22:40:18.808849] [DEBUG] [LOCAL ] IVR: Derivative data saved (1820 records). [2025-10-17T22:40:18.809103] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-17T22:40:18.811198] [INFO ] [MAIN ] Derivative Progress: 972/2083 symbols completed. IVR took 1.3s. Estimated remaining: 7m 2s. Rate: 158.0 symbols/min [2025-10-17T22:40:18.811424] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:18.824417] [DEBUG] [LOCAL ] IVT: Loaded 31836 existing records from primary storage. [2025-10-17T22:40:18.824568] [INFO ] [MAIN ] IVT: Loaded 31836 primary data records. [2025-10-17T22:40:19.005556] [DEBUG] [LOCAL ] IX: Loaded 22572 existing records from primary storage. [2025-10-17T22:40:19.031865] [INFO ] [MAIN ] IX: Loaded 22572 primary data records. [2025-10-17T22:40:19.251376] [DEBUG] [LOCAL ] IVZ: Loaded 53895 existing records from primary storage. [2025-10-17T22:40:19.268444] [INFO ] [MAIN ] IVZ: Loaded 53895 primary data records. [2025-10-17T22:40:19.813028] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:19.814355] [INFO ] [MAIN ] IVT: Generated 1820 derivative records from 31836 primary records. [2025-10-17T22:40:19.815705] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-17T22:40:19.862716] [DEBUG] [LOCAL ] IVT: Derivative data saved (1820 records). [2025-10-17T22:40:19.863902] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:19.864202] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-17T22:40:19.867362] [INFO ] [MAIN ] Derivative Progress: 973/2083 symbols completed. IVT took 1.1s. Estimated remaining: 7m 2s. Rate: 157.7 symbols/min [2025-10-17T22:40:19.865132] [INFO ] [MAIN ] IX: Generated 1820 derivative records from 22572 primary records. [2025-10-17T22:40:19.867663] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-17T22:40:19.894698] [DEBUG] [LOCAL ] IX: Derivative data saved (1820 records). [2025-10-17T22:40:19.907208] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-17T22:40:19.907697] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:19.910306] [INFO ] [MAIN ] Derivative Progress: 974/2083 symbols completed. IX took 1.1s. Estimated remaining: 7m 2s. Rate: 157.8 symbols/min [2025-10-17T22:40:19.911177] [INFO ] [MAIN ] IVZ: Generated 1820 derivative records from 53895 primary records. [2025-10-17T22:40:19.911260] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-17T22:40:19.927469] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1820 records). [2025-10-17T22:40:19.927569] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-17T22:40:19.929795] [INFO ] [MAIN ] Derivative Progress: 975/2083 symbols completed. IVZ took 1.2s. Estimated remaining: 7m 1s. Rate: 158.0 symbols/min [2025-10-17T22:40:19.930354] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:19.930285] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:19.930187] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:19.984628] [DEBUG] [LOCAL ] JBI: Loaded 43558 existing records from primary storage. [2025-10-17T22:40:19.984889] [INFO ] [MAIN ] JBI: Loaded 43558 primary data records. [2025-10-17T22:40:20.120526] [DEBUG] [LOCAL ] J: Loaded 41066 existing records from primary storage. [2025-10-17T22:40:20.144861] [INFO ] [MAIN ] J: Loaded 41066 primary data records. [2025-10-17T22:40:20.157092] [DEBUG] [LOCAL ] JBGS: Loaded 42660 existing records from primary storage. [2025-10-17T22:40:20.193030] [INFO ] [MAIN ] JBGS: Loaded 42660 primary data records. [2025-10-17T22:40:21.095054] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:21.089112] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:21.096120] [INFO ] [MAIN ] J: Generated 1820 derivative records from 41066 primary records. [2025-10-17T22:40:21.097103] [INFO ] [MAIN ] JBI: Generated 1820 derivative records from 43558 primary records. [2025-10-17T22:40:21.097385] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-17T22:40:21.098069] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-17T22:40:21.117988] [DEBUG] [LOCAL ] JBI: Derivative data saved (1820 records). [2025-10-17T22:40:21.118294] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-17T22:40:21.127775] [INFO ] [MAIN ] Derivative Progress: 976/2083 symbols completed. JBI took 1.2s. Estimated remaining: 7m 1s. Rate: 157.6 symbols/min [2025-10-17T22:40:21.135025] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:21.137383] [DEBUG] [LOCAL ] J: Derivative data saved (1820 records). [2025-10-17T22:40:21.137719] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-17T22:40:21.140350] [INFO ] [MAIN ] Derivative Progress: 977/2083 symbols completed. J took 1.2s. Estimated remaining: 7m 1s. Rate: 157.8 symbols/min [2025-10-17T22:40:21.140680] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:21.158631] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:21.159511] [INFO ] [MAIN ] JBGS: Generated 1820 derivative records from 42660 primary records. [2025-10-17T22:40:21.159694] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-17T22:40:21.190541] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1820 records). [2025-10-17T22:40:21.190804] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-17T22:40:21.193470] [INFO ] [MAIN ] Derivative Progress: 978/2083 symbols completed. JBGS took 1.3s. Estimated remaining: 6m 60s. Rate: 157.9 symbols/min [2025-10-17T22:40:21.193707] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:21.215091] [DEBUG] [LOCAL ] JBND: Loaded 27442 existing records from primary storage. [2025-10-17T22:40:21.215229] [INFO ] [MAIN ] JBND: Loaded 27442 primary data records. [2025-10-17T22:40:21.333791] [DEBUG] [LOCAL ] JCE: Loaded 7507 existing records from primary storage. [2025-10-17T22:40:21.334013] [INFO ] [MAIN ] JCE: Loaded 7507 primary data records. [2025-10-17T22:40:21.398482] [DEBUG] [LOCAL ] JBL: Loaded 49045 existing records from primary storage. [2025-10-17T22:40:21.419625] [INFO ] [MAIN ] JBL: Loaded 49045 primary data records. [2025-10-17T22:40:22.170242] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:22.171709] [INFO ] [MAIN ] JBND: Generated 1820 derivative records from 27442 primary records. [2025-10-17T22:40:22.171992] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-17T22:40:22.191583] [DEBUG] [LOCAL ] JBND: Derivative data saved (1820 records). [2025-10-17T22:40:22.192065] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-17T22:40:22.194102] [INFO ] [MAIN ] Derivative Progress: 979/2083 symbols completed. JBND took 1.1s. Estimated remaining: 7m 0s. Rate: 157.7 symbols/min [2025-10-17T22:40:22.194499] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:22.211708] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:22.212486] [INFO ] [MAIN ] JCE: Generated 1820 derivative records from 7507 primary records. [2025-10-17T22:40:22.212741] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-17T22:40:22.228991] [DEBUG] [LOCAL ] JCE: Derivative data saved (1820 records). [2025-10-17T22:40:22.229515] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-17T22:40:22.234693] [INFO ] [MAIN ] Derivative Progress: 980/2083 symbols completed. JCE took 1.0s. Estimated remaining: 6m 59s. Rate: 157.8 symbols/min [2025-10-17T22:40:22.234847] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:22.249983] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:22.250726] [INFO ] [MAIN ] JBL: Generated 1820 derivative records from 49045 primary records. [2025-10-17T22:40:22.250835] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-17T22:40:22.267465] [DEBUG] [LOCAL ] JBL: Derivative data saved (1820 records). [2025-10-17T22:40:22.267596] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-17T22:40:22.269917] [INFO ] [MAIN ] Derivative Progress: 981/2083 symbols completed. JBL took 1.1s. Estimated remaining: 6m 59s. Rate: 158.0 symbols/min [2025-10-17T22:40:22.270060] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:22.320724] [DEBUG] [LOCAL ] JCI: Loaded 54306 existing records from primary storage. [2025-10-17T22:40:22.321009] [INFO ] [MAIN ] JCI: Loaded 54306 primary data records. [2025-10-17T22:40:22.460907] [DEBUG] [LOCAL ] JEF: Loaded 50950 existing records from primary storage. [2025-10-17T22:40:22.476667] [INFO ] [MAIN ] JEF: Loaded 50950 primary data records. [2025-10-17T22:40:22.488811] [DEBUG] [LOCAL ] JELD: Loaded 46697 existing records from primary storage. [2025-10-17T22:40:22.515622] [INFO ] [MAIN ] JELD: Loaded 46697 primary data records. [2025-10-17T22:40:23.325903] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:23.327107] [INFO ] [MAIN ] JCI: Generated 1820 derivative records from 54306 primary records. [2025-10-17T22:40:23.327848] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-17T22:40:23.346997] [DEBUG] [LOCAL ] JCI: Derivative data saved (1820 records). [2025-10-17T22:40:23.347534] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-17T22:40:23.349789] [INFO ] [MAIN ] Derivative Progress: 982/2083 symbols completed. JCI took 1.2s. Estimated remaining: 6m 59s. Rate: 157.7 symbols/min [2025-10-17T22:40:23.350334] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:23.370280] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:23.372426] [INFO ] [MAIN ] JEF: Generated 1820 derivative records from 50950 primary records. [2025-10-17T22:40:23.380358] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-17T22:40:23.387016] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:23.404471] [INFO ] [MAIN ] JELD: Generated 1820 derivative records from 46697 primary records. [2025-10-17T22:40:23.408329] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-17T22:40:23.412123] [DEBUG] [LOCAL ] JEF: Derivative data saved (1820 records). [2025-10-17T22:40:23.412321] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-17T22:40:23.414748] [INFO ] [MAIN ] Derivative Progress: 983/2083 symbols completed. JEF took 1.2s. Estimated remaining: 6m 58s. Rate: 157.8 symbols/min [2025-10-17T22:40:23.415427] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:23.438220] [DEBUG] [LOCAL ] JFR: Loaded 31519 existing records from primary storage. [2025-10-17T22:40:23.441620] [INFO ] [MAIN ] JFR: Loaded 31519 primary data records. [2025-10-17T22:40:23.441383] [DEBUG] [LOCAL ] JELD: Derivative data saved (1820 records). [2025-10-17T22:40:23.441796] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-17T22:40:23.478889] [INFO ] [MAIN ] Derivative Progress: 984/2083 symbols completed. JELD took 1.2s. Estimated remaining: 6m 58s. Rate: 157.9 symbols/min [2025-10-17T22:40:23.479081] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:23.552394] [DEBUG] [LOCAL ] JGH: Loaded 12828 existing records from primary storage. [2025-10-17T22:40:23.561712] [INFO ] [MAIN ] JGH: Loaded 12828 primary data records. [2025-10-17T22:40:24.120416] [DEBUG] [LOCAL ] JHG: Loaded 48298 existing records from primary storage. [2025-10-17T22:40:24.122135] [INFO ] [MAIN ] JHG: Loaded 48298 primary data records. [2025-10-17T22:40:24.381781] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:24.500240] [INFO ] [MAIN ] JFR: Generated 1820 derivative records from 31519 primary records. [2025-10-17T22:40:24.500705] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-17T22:40:24.521138] [DEBUG] [LOCAL ] JFR: Derivative data saved (1820 records). [2025-10-17T22:40:24.521630] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-17T22:40:24.524931] [INFO ] [MAIN ] Derivative Progress: 985/2083 symbols completed. JFR took 1.2s. Estimated remaining: 6m 58s. Rate: 157.6 symbols/min [2025-10-17T22:40:24.525428] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:24.540899] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:24.541812] [INFO ] [MAIN ] JGH: Generated 1820 derivative records from 12828 primary records. [2025-10-17T22:40:24.541913] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-17T22:40:24.557553] [DEBUG] [LOCAL ] JHI: Loaded 4176 existing records from primary storage. [2025-10-17T22:40:24.560348] [INFO ] [MAIN ] JHI: Loaded 4176 primary data records. [2025-10-17T22:40:24.617407] [DEBUG] [LOCAL ] JGH: Derivative data saved (1820 records). [2025-10-17T22:40:24.631738] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-17T22:40:24.634459] [INFO ] [MAIN ] Derivative Progress: 986/2083 symbols completed. JGH took 1.2s. Estimated remaining: 6m 57s. Rate: 157.8 symbols/min [2025-10-17T22:40:24.640749] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:24.745803] [DEBUG] [LOCAL ] JHS: Loaded 2952 existing records from primary storage. [2025-10-17T22:40:24.901249] [INFO ] [MAIN ] JHS: Loaded 2952 primary data records. [2025-10-17T22:40:24.921991] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:24.940095] [INFO ] [MAIN ] JHG: Generated 1820 derivative records from 48298 primary records. [2025-10-17T22:40:24.964492] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-17T22:40:25.056741] [DEBUG] [LOCAL ] JHG: Derivative data saved (1820 records). [2025-10-17T22:40:25.056890] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-10-17T22:40:25.069297] [INFO ] [MAIN ] Derivative Progress: 987/2083 symbols completed. JHG took 1.6s. Estimated remaining: 6m 57s. Rate: 157.7 symbols/min [2025-10-17T22:40:25.129688] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:25.285505] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:25.286445] [INFO ] [MAIN ] JHI: Generated 1820 derivative records from 4176 primary records. [2025-10-17T22:40:25.286614] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-17T22:40:25.302256] [DEBUG] [LOCAL ] JHI: Derivative data saved (1820 records). [2025-10-17T22:40:25.302493] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-17T22:40:25.304698] [INFO ] [MAIN ] Derivative Progress: 988/2083 symbols completed. JHI took 0.8s. Estimated remaining: 6m 56s. Rate: 157.8 symbols/min [2025-10-17T22:40:25.336344] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:25.337044] [INFO ] [MAIN ] JHS: Generated 1820 derivative records from 2952 primary records. [2025-10-17T22:40:25.337106] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-17T22:40:25.365942] [DEBUG] [LOCAL ] JHX: Loaded 53939 existing records from primary storage. [2025-10-17T22:40:25.366862] [INFO ] [MAIN ] JHX: Loaded 53939 primary data records. [2025-10-17T22:40:25.367344] [DEBUG] [LOCAL ] JHS: Derivative data saved (1820 records). [2025-10-17T22:40:25.436544] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-17T22:40:25.444408] [INFO ] [MAIN ] Derivative Progress: 989/2083 symbols completed. JHS took 0.8s. Estimated remaining: 6m 56s. Rate: 157.9 symbols/min [2025-10-17T22:40:25.682784] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:25.683374] [INFO ] [MAIN ] JHX: Generated 1820 derivative records from 53939 primary records. [2025-10-17T22:40:25.683439] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-17T22:40:25.698551] [DEBUG] [LOCAL ] JHX: Derivative data saved (1820 records). [2025-10-17T22:40:25.698611] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-17T22:40:25.700469] [INFO ] [MAIN ] Derivative Progress: 990/2083 symbols completed. JHX took 0.6s. Estimated remaining: 6m 55s. Rate: 157.9 symbols/min [2025-10-17T22:40:25.700959] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:25.701339] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:25.701076] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:25.720029] [DEBUG] [LOCAL ] JILL: Loaded 16049 existing records from primary storage. [2025-10-17T22:40:25.720196] [INFO ] [MAIN ] JILL: Loaded 16049 primary data records. [2025-10-17T22:40:25.852916] [DEBUG] [LOCAL ] JLL: Loaded 32147 existing records from primary storage. [2025-10-17T22:40:25.869090] [INFO ] [MAIN ] JLL: Loaded 32147 primary data records. [2025-10-17T22:40:26.002340] [DEBUG] [LOCAL ] JKS: Loaded 40154 existing records from primary storage. [2025-10-17T22:40:26.133230] [INFO ] [MAIN ] JKS: Loaded 40154 primary data records. [2025-10-17T22:40:26.755067] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:26.756375] [INFO ] [MAIN ] JILL: Generated 1820 derivative records from 16049 primary records. [2025-10-17T22:40:26.756720] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-17T22:40:26.778290] [DEBUG] [LOCAL ] JILL: Derivative data saved (1820 records). [2025-10-17T22:40:26.778983] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-17T22:40:26.781240] [INFO ] [MAIN ] Derivative Progress: 991/2083 symbols completed. JILL took 1.1s. Estimated remaining: 6m 56s. Rate: 157.7 symbols/min [2025-10-17T22:40:26.781456] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:26.807620] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:26.808032] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:26.808906] [INFO ] [MAIN ] JLL: Generated 1820 derivative records from 32147 primary records. [2025-10-17T22:40:26.810142] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-17T22:40:26.811355] [INFO ] [MAIN ] JKS: Generated 1820 derivative records from 40154 primary records. [2025-10-17T22:40:26.811711] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-17T22:40:26.815129] [DEBUG] [LOCAL ] JLS: Loaded 4259 existing records from primary storage. [2025-10-17T22:40:26.830835] [INFO ] [MAIN ] JLS: Loaded 4259 primary data records. [2025-10-17T22:40:26.911322] [DEBUG] [LOCAL ] JKS: Derivative data saved (1820 records). [2025-10-17T22:40:26.913691] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-17T22:40:26.915986] [INFO ] [MAIN ] Derivative Progress: 992/2083 symbols completed. JKS took 1.2s. Estimated remaining: 6m 55s. Rate: 157.8 symbols/min [2025-10-17T22:40:26.922868] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:26.952396] [DEBUG] [LOCAL ] JLL: Derivative data saved (1820 records). [2025-10-17T22:40:26.968872] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-17T22:40:26.971404] [INFO ] [MAIN ] Derivative Progress: 993/2083 symbols completed. JLL took 1.3s. Estimated remaining: 6m 54s. Rate: 157.9 symbols/min [2025-10-17T22:40:26.994510] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:27.216332] [DEBUG] [LOCAL ] JMIA: Loaded 51831 existing records from primary storage. [2025-10-17T22:40:27.215155] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:27.216510] [INFO ] [MAIN ] JMIA: Loaded 51831 primary data records. [2025-10-17T22:40:27.217349] [INFO ] [MAIN ] JLS: Generated 1820 derivative records from 4259 primary records. [2025-10-17T22:40:27.217436] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-17T22:40:27.390074] [DEBUG] [LOCAL ] JLS: Derivative data saved (1820 records). [2025-10-17T22:40:27.409214] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-10-17T22:40:27.409569] [INFO ] [MAIN ] JNJ: Loaded 54533 primary data records. [2025-10-17T22:40:27.409344] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-17T22:40:27.442050] [INFO ] [MAIN ] Derivative Progress: 994/2083 symbols completed. JLS took 0.7s. Estimated remaining: 6m 54s. Rate: 157.9 symbols/min [2025-10-17T22:40:27.463635] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:27.899468] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:27.915789] [INFO ] [MAIN ] JMIA: Generated 1820 derivative records from 51831 primary records. [2025-10-17T22:40:27.916034] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-17T22:40:27.917916] [DEBUG] [LOCAL ] JOBY: Loaded 54588 existing records from primary storage. [2025-10-17T22:40:27.918423] [INFO ] [MAIN ] JOBY: Loaded 54588 primary data records. [2025-10-17T22:40:27.957536] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1820 records). [2025-10-17T22:40:27.957730] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-17T22:40:27.982540] [INFO ] [MAIN ] Derivative Progress: 995/2083 symbols completed. JMIA took 1.1s. Estimated remaining: 6m 54s. Rate: 157.8 symbols/min [2025-10-17T22:40:28.003815] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:28.045668] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:28.057768] [INFO ] [MAIN ] JNJ: Generated 1820 derivative records from 54533 primary records. [2025-10-17T22:40:28.063200] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-17T22:40:28.282220] [DEBUG] [LOCAL ] JOE: Loaded 24168 existing records from primary storage. [2025-10-17T22:40:28.282377] [INFO ] [MAIN ] JOE: Loaded 24168 primary data records. [2025-10-17T22:40:28.294978] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1820 records). [2025-10-17T22:40:28.295211] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-17T22:40:28.306672] [INFO ] [MAIN ] Derivative Progress: 996/2083 symbols completed. JNJ took 1.3s. Estimated remaining: 6m 53s. Rate: 157.8 symbols/min [2025-10-17T22:40:28.306831] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:28.436966] [DEBUG] [LOCAL ] JOF: Loaded 6969 existing records from primary storage. [2025-10-17T22:40:28.470216] [INFO ] [MAIN ] JOF: Loaded 6969 primary data records. [2025-10-17T22:40:28.951309] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:28.952911] [INFO ] [MAIN ] JOBY: Generated 1820 derivative records from 54588 primary records. [2025-10-17T22:40:28.953893] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-17T22:40:28.973166] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1820 records). [2025-10-17T22:40:28.973537] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-17T22:40:28.976062] [INFO ] [MAIN ] Derivative Progress: 997/2083 symbols completed. JOBY took 1.5s. Estimated remaining: 6m 53s. Rate: 157.7 symbols/min [2025-10-17T22:40:28.976230] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:28.995299] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:28.996248] [INFO ] [MAIN ] JOE: Generated 1820 derivative records from 24168 primary records. [2025-10-17T22:40:28.996379] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-17T22:40:29.014601] [DEBUG] [LOCAL ] JOE: Derivative data saved (1820 records). [2025-10-17T22:40:29.014848] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-17T22:40:29.016946] [INFO ] [MAIN ] Derivative Progress: 998/2083 symbols completed. JOE took 1.0s. Estimated remaining: 6m 52s. Rate: 157.8 symbols/min [2025-10-17T22:40:29.017193] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:29.044363] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:29.045334] [INFO ] [MAIN ] JOF: Generated 1820 derivative records from 6969 primary records. [2025-10-17T22:40:29.045488] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-17T22:40:29.071743] [DEBUG] [LOCAL ] JOF: Derivative data saved (1820 records). [2025-10-17T22:40:29.072777] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-17T22:40:29.074998] [INFO ] [MAIN ] Derivative Progress: 999/2083 symbols completed. JOF took 0.8s. Estimated remaining: 6m 52s. Rate: 158.0 symbols/min [2025-10-17T22:40:29.075173] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:29.077429] [DEBUG] [LOCAL ] JPC: Loaded 37747 existing records from primary storage. [2025-10-17T22:40:29.077601] [INFO ] [MAIN ] JPC: Loaded 37747 primary data records. [2025-10-17T22:40:29.443932] [DEBUG] [LOCAL ] JQC: Loaded 34272 existing records from primary storage. [2025-10-17T22:40:29.445348] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-10-17T22:40:29.445602] [INFO ] [MAIN ] JQC: Loaded 34272 primary data records. [2025-10-17T22:40:29.445700] [INFO ] [MAIN ] JPM: Loaded 54574 primary data records. [2025-10-17T22:40:30.079322] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:30.080602] [INFO ] [MAIN ] JPC: Generated 1820 derivative records from 37747 primary records. [2025-10-17T22:40:30.080989] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-17T22:40:30.099418] [DEBUG] [LOCAL ] JPC: Derivative data saved (1820 records). [2025-10-17T22:40:30.100583] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-17T22:40:30.103335] [INFO ] [MAIN ] Derivative Progress: 1000/2083 symbols completed. JPC took 1.1s. Estimated remaining: 6m 52s. Rate: 157.7 symbols/min [2025-10-17T22:40:30.103934] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:30.130573] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:30.131727] [INFO ] [MAIN ] JPM: Generated 1820 derivative records from 54574 primary records. [2025-10-17T22:40:30.144566] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:30.144309] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-17T22:40:30.145588] [INFO ] [MAIN ] JQC: Generated 1820 derivative records from 34272 primary records. [2025-10-17T22:40:30.146114] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-17T22:40:30.159824] [DEBUG] [LOCAL ] JRI: Loaded 15593 existing records from primary storage. [2025-10-17T22:40:30.174560] [INFO ] [MAIN ] JRI: Loaded 15593 primary data records. [2025-10-17T22:40:30.214357] [DEBUG] [LOCAL ] JPM: Derivative data saved (1820 records). [2025-10-17T22:40:30.227460] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-17T22:40:30.244701] [INFO ] [MAIN ] Derivative Progress: 1001/2083 symbols completed. JPM took 1.2s. Estimated remaining: 6m 51s. Rate: 157.8 symbols/min [2025-10-17T22:40:30.233846] [DEBUG] [LOCAL ] JQC: Derivative data saved (1820 records). [2025-10-17T22:40:30.258929] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:30.259115] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-17T22:40:30.261622] [INFO ] [MAIN ] Derivative Progress: 1002/2083 symbols completed. JQC took 1.2s. Estimated remaining: 6m 51s. Rate: 157.9 symbols/min [2025-10-17T22:40:30.284447] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:30.500201] [DEBUG] [LOCAL ] JRS: Loaded 11802 existing records from primary storage. [2025-10-17T22:40:30.500960] [INFO ] [MAIN ] JRS: Loaded 11802 primary data records. [2025-10-17T22:40:30.859544] [DEBUG] [LOCAL ] JXN: Loaded 45301 existing records from primary storage. [2025-10-17T22:40:30.860691] [INFO ] [MAIN ] JXN: Loaded 45301 primary data records. [2025-10-17T22:40:31.063250] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:31.179222] [INFO ] [MAIN ] JRI: Generated 1820 derivative records from 15593 primary records. [2025-10-17T22:40:31.179901] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-17T22:40:31.213751] [DEBUG] [LOCAL ] JRI: Derivative data saved (1820 records). [2025-10-17T22:40:31.214699] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:31.215129] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-17T22:40:31.217828] [INFO ] [MAIN ] Derivative Progress: 1003/2083 symbols completed. JRI took 1.1s. Estimated remaining: 6m 51s. Rate: 157.7 symbols/min [2025-10-17T22:40:31.218517] [INFO ] [MAIN ] JRS: Generated 1820 derivative records from 11802 primary records. [2025-10-17T22:40:31.218753] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-17T22:40:31.239262] [DEBUG] [LOCAL ] JRS: Derivative data saved (1820 records). [2025-10-17T22:40:31.239365] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-17T22:40:31.241786] [INFO ] [MAIN ] Derivative Progress: 1004/2083 symbols completed. JRS took 1.0s. Estimated remaining: 6m 50s. Rate: 157.9 symbols/min [2025-10-17T22:40:31.257333] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:31.258020] [INFO ] [MAIN ] JXN: Generated 1820 derivative records from 45301 primary records. [2025-10-17T22:40:31.258081] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-17T22:40:31.273234] [DEBUG] [LOCAL ] JXN: Derivative data saved (1820 records). [2025-10-17T22:40:31.273292] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-17T22:40:31.275558] [INFO ] [MAIN ] Derivative Progress: 1005/2083 symbols completed. JXN took 1.0s. Estimated remaining: 6m 49s. Rate: 158.0 symbols/min [2025-10-17T22:40:31.276140] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:31.276077] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:31.276008] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:31.293194] [DEBUG] [LOCAL ] KAI: Loaded 13783 existing records from primary storage. [2025-10-17T22:40:31.293329] [INFO ] [MAIN ] KAI: Loaded 13783 primary data records. [2025-10-17T22:40:31.507363] [DEBUG] [LOCAL ] KAR: Loaded 40601 existing records from primary storage. [2025-10-17T22:40:31.573774] [INFO ] [MAIN ] KAR: Loaded 40601 primary data records. [2025-10-17T22:40:31.682417] [DEBUG] [LOCAL ] K: Loaded 51154 existing records from primary storage. [2025-10-17T22:40:31.710827] [INFO ] [MAIN ] K: Loaded 51154 primary data records. [2025-10-17T22:40:32.285759] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:32.287122] [INFO ] [MAIN ] KAI: Generated 1820 derivative records from 13783 primary records. [2025-10-17T22:40:32.287627] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-17T22:40:32.306376] [DEBUG] [LOCAL ] KAI: Derivative data saved (1820 records). [2025-10-17T22:40:32.306482] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-17T22:40:32.308944] [INFO ] [MAIN ] Derivative Progress: 1006/2083 symbols completed. KAI took 1.0s. Estimated remaining: 6m 50s. Rate: 157.7 symbols/min [2025-10-17T22:40:32.309402] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:32.327058] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:32.328040] [INFO ] [MAIN ] KAR: Generated 1820 derivative records from 40601 primary records. [2025-10-17T22:40:32.329927] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-17T22:40:32.363276] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:32.366797] [INFO ] [MAIN ] K: Generated 1820 derivative records from 51154 primary records. [2025-10-17T22:40:32.366901] [DEBUG] [LOCAL ] KAR: Derivative data saved (1820 records). [2025-10-17T22:40:32.367009] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-17T22:40:32.367125] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-17T22:40:32.369985] [INFO ] [MAIN ] Derivative Progress: 1007/2083 symbols completed. KAR took 1.1s. Estimated remaining: 6m 49s. Rate: 157.9 symbols/min [2025-10-17T22:40:32.370265] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:32.390109] [DEBUG] [LOCAL ] KB: Loaded 23613 existing records from primary storage. [2025-10-17T22:40:32.393375] [INFO ] [MAIN ] KB: Loaded 23613 primary data records. [2025-10-17T22:40:32.394397] [DEBUG] [LOCAL ] K: Derivative data saved (1820 records). [2025-10-17T22:40:32.394638] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-17T22:40:32.428503] [INFO ] [MAIN ] Derivative Progress: 1008/2083 symbols completed. K took 1.2s. Estimated remaining: 6m 48s. Rate: 158.0 symbols/min [2025-10-17T22:40:32.461042] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:32.668483] [DEBUG] [LOCAL ] KBDC: Loaded 22794 existing records from primary storage. [2025-10-17T22:40:32.737208] [INFO ] [MAIN ] KBDC: Loaded 22794 primary data records. [2025-10-17T22:40:33.056591] [DEBUG] [LOCAL ] KBH: Loaded 49532 existing records from primary storage. [2025-10-17T22:40:33.065117] [INFO ] [MAIN ] KBH: Loaded 49532 primary data records. [2025-10-17T22:40:33.394624] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:33.395998] [INFO ] [MAIN ] KB: Generated 1820 derivative records from 23613 primary records. [2025-10-17T22:40:33.396278] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-17T22:40:33.414028] [DEBUG] [LOCAL ] KB: Derivative data saved (1820 records). [2025-10-17T22:40:33.414312] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-17T22:40:33.416503] [INFO ] [MAIN ] Derivative Progress: 1009/2083 symbols completed. KB took 1.1s. Estimated remaining: 6m 49s. Rate: 157.7 symbols/min [2025-10-17T22:40:33.416845] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:33.435955] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:33.436831] [INFO ] [MAIN ] KBDC: Generated 1820 derivative records from 22794 primary records. [2025-10-17T22:40:33.437279] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-17T22:40:33.455725] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1820 records). [2025-10-17T22:40:33.456123] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-17T22:40:33.458463] [INFO ] [MAIN ] Derivative Progress: 1010/2083 symbols completed. KBDC took 1.1s. Estimated remaining: 6m 48s. Rate: 157.9 symbols/min [2025-10-17T22:40:33.458802] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:33.487057] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:33.487796] [INFO ] [MAIN ] KBH: Generated 1820 derivative records from 49532 primary records. [2025-10-17T22:40:33.487952] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-17T22:40:33.504797] [DEBUG] [LOCAL ] KBH: Derivative data saved (1820 records). [2025-10-17T22:40:33.504942] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-17T22:40:33.507496] [INFO ] [MAIN ] Derivative Progress: 1011/2083 symbols completed. KBH took 1.0s. Estimated remaining: 6m 47s. Rate: 158.0 symbols/min [2025-10-17T22:40:33.519917] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:33.522326] [DEBUG] [LOCAL ] KBR: Loaded 48737 existing records from primary storage. [2025-10-17T22:40:33.522506] [INFO ] [MAIN ] KBR: Loaded 48737 primary data records. [2025-10-17T22:40:33.621139] [DEBUG] [LOCAL ] KEN: Loaded 4731 existing records from primary storage. [2025-10-17T22:40:33.657035] [INFO ] [MAIN ] KEN: Loaded 4731 primary data records. [2025-10-17T22:40:33.701058] [DEBUG] [LOCAL ] KD: Loaded 53125 existing records from primary storage. [2025-10-17T22:40:33.728867] [INFO ] [MAIN ] KD: Loaded 53125 primary data records. [2025-10-17T22:40:34.549714] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:34.552198] [INFO ] [MAIN ] KBR: Generated 1820 derivative records from 48737 primary records. [2025-10-17T22:40:34.552538] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-17T22:40:34.582763] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:34.584612] [DEBUG] [LOCAL ] KBR: Derivative data saved (1820 records). [2025-10-17T22:40:34.585581] [INFO ] [MAIN ] KEN: Generated 1820 derivative records from 4731 primary records. [2025-10-17T22:40:34.585708] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-17T22:40:34.585968] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-17T22:40:34.595933] [INFO ] [MAIN ] Derivative Progress: 1012/2083 symbols completed. KBR took 1.2s. Estimated remaining: 6m 47s. Rate: 157.7 symbols/min [2025-10-17T22:40:34.601693] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:34.602197] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:34.609433] [INFO ] [MAIN ] KD: Generated 1820 derivative records from 53125 primary records. [2025-10-17T22:40:34.613593] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-17T22:40:34.633252] [DEBUG] [LOCAL ] KD: Derivative data saved (1820 records). [2025-10-17T22:40:34.634624] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-17T22:40:34.637217] [INFO ] [MAIN ] Derivative Progress: 1013/2083 symbols completed. KD took 1.2s. Estimated remaining: 6m 47s. Rate: 157.9 symbols/min [2025-10-17T22:40:34.637803] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:34.638234] [DEBUG] [LOCAL ] KEN: Derivative data saved (1820 records). [2025-10-17T22:40:34.638519] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-17T22:40:34.640775] [INFO ] [MAIN ] Derivative Progress: 1014/2083 symbols completed. KEN took 1.1s. Estimated remaining: 6m 46s. Rate: 158.0 symbols/min [2025-10-17T22:40:34.641078] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:34.654477] [DEBUG] [LOCAL ] KF: Loaded 2385 existing records from primary storage. [2025-10-17T22:40:34.654672] [INFO ] [MAIN ] KF: Loaded 2385 primary data records. [2025-10-17T22:40:34.763264] [DEBUG] [LOCAL ] KEP: Loaded 32548 existing records from primary storage. [2025-10-17T22:40:34.776739] [INFO ] [MAIN ] KEP: Loaded 32548 primary data records. [2025-10-17T22:40:35.083698] [DEBUG] [LOCAL ] KEX: Loaded 39285 existing records from primary storage. [2025-10-17T22:40:35.094862] [INFO ] [MAIN ] KEX: Loaded 39285 primary data records. [2025-10-17T22:40:35.619439] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:35.621223] [INFO ] [MAIN ] KF: Generated 1820 derivative records from 2385 primary records. [2025-10-17T22:40:35.621545] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-17T22:40:35.640535] [DEBUG] [LOCAL ] KF: Derivative data saved (1820 records). [2025-10-17T22:40:35.641055] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-17T22:40:35.650990] [INFO ] [MAIN ] Derivative Progress: 1015/2083 symbols completed. KF took 1.0s. Estimated remaining: 6m 46s. Rate: 157.8 symbols/min [2025-10-17T22:40:35.656550] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:35.656324] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:35.657686] [INFO ] [MAIN ] KEP: Generated 1820 derivative records from 32548 primary records. [2025-10-17T22:40:35.657813] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-17T22:40:35.677945] [DEBUG] [LOCAL ] KEP: Derivative data saved (1820 records). [2025-10-17T22:40:35.678142] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-17T22:40:35.680310] [INFO ] [MAIN ] Derivative Progress: 1016/2083 symbols completed. KEP took 1.1s. Estimated remaining: 6m 45s. Rate: 157.9 symbols/min [2025-10-17T22:40:35.680446] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:35.694007] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:35.695452] [INFO ] [MAIN ] KEX: Generated 1820 derivative records from 39285 primary records. [2025-10-17T22:40:35.695532] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-17T22:40:35.725973] [DEBUG] [LOCAL ] KFRC: Loaded 20885 existing records from primary storage. [2025-10-17T22:40:35.726147] [INFO ] [MAIN ] KFRC: Loaded 20885 primary data records. [2025-10-17T22:40:35.751560] [DEBUG] [LOCAL ] KFS: Loaded 8837 existing records from primary storage. [2025-10-17T22:40:35.762085] [INFO ] [MAIN ] KFS: Loaded 8837 primary data records. [2025-10-17T22:40:35.948450] [DEBUG] [LOCAL ] KEX: Derivative data saved (1820 records). [2025-10-17T22:40:35.979821] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-17T22:40:35.991211] [INFO ] [MAIN ] Derivative Progress: 1017/2083 symbols completed. KEX took 1.4s. Estimated remaining: 6m 45s. Rate: 157.9 symbols/min [2025-10-17T22:40:36.016487] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:36.365408] [DEBUG] [LOCAL ] KFY: Loaded 30339 existing records from primary storage. [2025-10-17T22:40:36.365901] [INFO ] [MAIN ] KFY: Loaded 30339 primary data records. [2025-10-17T22:40:36.567740] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:36.601694] [INFO ] [MAIN ] KFRC: Generated 1820 derivative records from 20885 primary records. [2025-10-17T22:40:36.713672] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-17T22:40:36.757375] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1820 records). [2025-10-17T22:40:36.758666] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-17T22:40:36.756850] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:40:36.760948] [INFO ] [MAIN ] Derivative Progress: 1018/2083 symbols completed. KFRC took 1.1s. Estimated remaining: 6m 45s. Rate: 157.8 symbols/min [2025-10-17T22:40:36.763358] [INFO ] [MAIN ] KFS: Generated 1819 derivative records from 8837 primary records. [2025-10-17T22:40:36.763550] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-17T22:40:36.781533] [DEBUG] [LOCAL ] KFS: Derivative data saved (1819 records). [2025-10-17T22:40:36.781771] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-17T22:40:36.784067] [INFO ] [MAIN ] Derivative Progress: 1019/2083 symbols completed. KFS took 1.1s. Estimated remaining: 6m 44s. Rate: 157.9 symbols/min [2025-10-17T22:40:36.801661] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:36.802281] [INFO ] [MAIN ] KFY: Generated 1820 derivative records from 30339 primary records. [2025-10-17T22:40:36.802342] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-17T22:40:36.818281] [DEBUG] [LOCAL ] KFY: Derivative data saved (1820 records). [2025-10-17T22:40:36.818341] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-10-17T22:40:36.820672] [INFO ] [MAIN ] Derivative Progress: 1020/2083 symbols completed. KFY took 0.8s. Estimated remaining: 6m 44s. Rate: 158.1 symbols/min [2025-10-17T22:40:36.821252] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:36.821325] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:36.821466] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:36.906706] [DEBUG] [LOCAL ] KGC: Loaded 54480 existing records from primary storage. [2025-10-17T22:40:36.908072] [INFO ] [MAIN ] KGC: Loaded 54480 primary data records. [2025-10-17T22:40:36.908911] [DEBUG] [LOCAL ] KGS: Loaded 46744 existing records from primary storage. [2025-10-17T22:40:36.929745] [INFO ] [MAIN ] KGS: Loaded 46744 primary data records. [2025-10-17T22:40:37.115112] [DEBUG] [LOCAL ] KIM: Loaded 53783 existing records from primary storage. [2025-10-17T22:40:37.162626] [INFO ] [MAIN ] KIM: Loaded 53783 primary data records. [2025-10-17T22:40:37.862025] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:37.874917] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:37.875762] [INFO ] [MAIN ] KGC: Generated 1820 derivative records from 54480 primary records. [2025-10-17T22:40:37.875975] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-17T22:40:37.876749] [INFO ] [MAIN ] KGS: Generated 1820 derivative records from 46744 primary records. [2025-10-17T22:40:37.876854] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-17T22:40:37.907592] [DEBUG] [LOCAL ] KGC: Derivative data saved (1820 records). [2025-10-17T22:40:37.911719] [DEBUG] [LOCAL ] KGS: Derivative data saved (1820 records). [2025-10-17T22:40:37.911866] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-17T22:40:37.913700] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-17T22:40:37.913603] [INFO ] [MAIN ] Derivative Progress: 1021/2083 symbols completed. KGC took 1.1s. Estimated remaining: 6m 44s. Rate: 157.8 symbols/min [2025-10-17T22:40:37.913891] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:37.916059] [INFO ] [MAIN ] Derivative Progress: 1022/2083 symbols completed. KGS took 1.1s. Estimated remaining: 6m 43s. Rate: 157.9 symbols/min [2025-10-17T22:40:37.916261] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:37.930376] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:37.931091] [INFO ] [MAIN ] KIM: Generated 1820 derivative records from 53783 primary records. [2025-10-17T22:40:37.931301] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-17T22:40:37.947858] [DEBUG] [LOCAL ] KIM: Derivative data saved (1820 records). [2025-10-17T22:40:37.948050] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-10-17T22:40:37.951085] [INFO ] [MAIN ] Derivative Progress: 1023/2083 symbols completed. KIM took 1.1s. Estimated remaining: 6m 42s. Rate: 158.1 symbols/min [2025-10-17T22:40:37.951355] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:37.966618] [DEBUG] [LOCAL ] KKRS: Loaded 5669 existing records from primary storage. [2025-10-17T22:40:37.966849] [INFO ] [MAIN ] KKRS: Loaded 5669 primary data records. [2025-10-17T22:40:38.042186] [DEBUG] [LOCAL ] KIO: Loaded 22090 existing records from primary storage. [2025-10-17T22:40:38.064095] [INFO ] [MAIN ] KIO: Loaded 22090 primary data records. [2025-10-17T22:40:38.283087] [DEBUG] [LOCAL ] KKR: Loaded 54283 existing records from primary storage. [2025-10-17T22:40:38.448556] [INFO ] [MAIN ] KKR: Loaded 54283 primary data records. [2025-10-17T22:40:38.982434] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:38.983970] [INFO ] [MAIN ] KKRS: Generated 1820 derivative records from 5669 primary records. [2025-10-17T22:40:38.985785] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-17T22:40:39.004465] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1820 records). [2025-10-17T22:40:39.005102] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-17T22:40:39.015080] [INFO ] [MAIN ] Derivative Progress: 1024/2083 symbols completed. KKRS took 1.1s. Estimated remaining: 6m 43s. Rate: 157.8 symbols/min [2025-10-17T22:40:39.021579] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:39.021037] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:39.025004] [INFO ] [MAIN ] KIO: Generated 1820 derivative records from 22090 primary records. [2025-10-17T22:40:39.025798] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-17T22:40:39.053393] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:39.054945] [INFO ] [MAIN ] KKR: Generated 1820 derivative records from 54283 primary records. [2025-10-17T22:40:39.055835] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-17T22:40:39.079849] [DEBUG] [LOCAL ] KKR: Derivative data saved (1820 records). [2025-10-17T22:40:39.079965] [DEBUG] [LOCAL ] KIO: Derivative data saved (1820 records). [2025-10-17T22:40:39.080100] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-17T22:40:39.082548] [INFO ] [MAIN ] Derivative Progress: 1025/2083 symbols completed. KKR took 1.2s. Estimated remaining: 6m 42s. Rate: 157.9 symbols/min [2025-10-17T22:40:39.082686] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-17T22:40:39.082854] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:39.085711] [INFO ] [MAIN ] Derivative Progress: 1026/2083 symbols completed. KIO took 1.2s. Estimated remaining: 6m 41s. Rate: 158.1 symbols/min [2025-10-17T22:40:39.095863] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:39.115698] [DEBUG] [LOCAL ] KMPB: Loaded 3680 existing records from primary storage. [2025-10-17T22:40:39.116015] [INFO ] [MAIN ] KMPB: Loaded 3680 primary data records. [2025-10-17T22:40:39.137924] [DEBUG] [LOCAL ] KLC: Loaded 37016 existing records from primary storage. [2025-10-17T22:40:39.173707] [INFO ] [MAIN ] KLC: Loaded 37016 primary data records. [2025-10-17T22:40:39.748773] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-10-17T22:40:39.749580] [INFO ] [MAIN ] KMI: Loaded 54473 primary data records. [2025-10-17T22:40:40.102373] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:40.097303] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:40.104517] [INFO ] [MAIN ] KMPB: Generated 1820 derivative records from 3680 primary records. [2025-10-17T22:40:40.103483] [INFO ] [MAIN ] KLC: Generated 1820 derivative records from 37016 primary records. [2025-10-17T22:40:40.104823] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-17T22:40:40.104934] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-17T22:40:40.136083] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1820 records). [2025-10-17T22:40:40.136023] [DEBUG] [LOCAL ] KLC: Derivative data saved (1820 records). [2025-10-17T22:40:40.136228] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-17T22:40:40.138204] [INFO ] [MAIN ] Derivative Progress: 1027/2083 symbols completed. KMPB took 1.0s. Estimated remaining: 6m 42s. Rate: 157.8 symbols/min [2025-10-17T22:40:40.138567] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-17T22:40:40.138489] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:40.141101] [INFO ] [MAIN ] Derivative Progress: 1028/2083 symbols completed. KLC took 1.1s. Estimated remaining: 6m 41s. Rate: 157.9 symbols/min [2025-10-17T22:40:40.141339] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:40.160963] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:40.161802] [INFO ] [MAIN ] KMI: Generated 1820 derivative records from 54473 primary records. [2025-10-17T22:40:40.162027] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-17T22:40:40.178481] [DEBUG] [LOCAL ] KMI: Derivative data saved (1820 records). [2025-10-17T22:40:40.178753] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-17T22:40:40.180974] [INFO ] [MAIN ] Derivative Progress: 1029/2083 symbols completed. KMI took 1.1s. Estimated remaining: 6m 40s. Rate: 158.1 symbols/min [2025-10-17T22:40:40.181297] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:40.217818] [DEBUG] [LOCAL ] KMPR: Loaded 40730 existing records from primary storage. [2025-10-17T22:40:40.229732] [INFO ] [MAIN ] KMPR: Loaded 40730 primary data records. [2025-10-17T22:40:40.230353] [DEBUG] [LOCAL ] KMT: Loaded 43532 existing records from primary storage. [2025-10-17T22:40:40.235576] [INFO ] [MAIN ] KMT: Loaded 43532 primary data records. [2025-10-17T22:40:40.540015] [DEBUG] [LOCAL ] KMX: Loaded 54057 existing records from primary storage. [2025-10-17T22:40:40.740461] [INFO ] [MAIN ] KMX: Loaded 54057 primary data records. [2025-10-17T22:40:41.217108] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:41.216799] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:41.217937] [INFO ] [MAIN ] KMPR: Generated 1820 derivative records from 40730 primary records. [2025-10-17T22:40:41.218025] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-17T22:40:41.218602] [INFO ] [MAIN ] KMT: Generated 1820 derivative records from 43532 primary records. [2025-10-17T22:40:41.219346] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-17T22:40:41.251283] [DEBUG] [LOCAL ] KMT: Derivative data saved (1820 records). [2025-10-17T22:40:41.251449] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-17T22:40:41.251383] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1820 records). [2025-10-17T22:40:41.251708] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-17T22:40:41.253634] [INFO ] [MAIN ] Derivative Progress: 1030/2083 symbols completed. KMPR took 1.1s. Estimated remaining: 6m 40s. Rate: 157.8 symbols/min [2025-10-17T22:40:41.253947] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:41.256376] [INFO ] [MAIN ] Derivative Progress: 1031/2083 symbols completed. KMT took 1.1s. Estimated remaining: 6m 40s. Rate: 158.0 symbols/min [2025-10-17T22:40:41.256858] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:41.276308] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:41.277103] [INFO ] [MAIN ] KMX: Generated 1820 derivative records from 54057 primary records. [2025-10-17T22:40:41.277220] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-17T22:40:41.304168] [DEBUG] [LOCAL ] KMX: Derivative data saved (1820 records). [2025-10-17T22:40:41.311572] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-17T22:40:41.313676] [INFO ] [MAIN ] Derivative Progress: 1032/2083 symbols completed. KMX took 1.1s. Estimated remaining: 6m 39s. Rate: 158.1 symbols/min [2025-10-17T22:40:41.313954] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:41.330866] [DEBUG] [LOCAL ] KNF: Loaded 37116 existing records from primary storage. [2025-10-17T22:40:41.340910] [INFO ] [MAIN ] KNF: Loaded 37116 primary data records. [2025-10-17T22:40:41.373163] [DEBUG] [LOCAL ] KN: Loaded 39111 existing records from primary storage. [2025-10-17T22:40:41.388800] [DEBUG] [LOCAL ] KNOP: Loaded 10627 existing records from primary storage. [2025-10-17T22:40:41.388861] [INFO ] [MAIN ] KN: Loaded 39111 primary data records. [2025-10-17T22:40:41.400639] [INFO ] [MAIN ] KNOP: Loaded 10627 primary data records. [2025-10-17T22:40:42.293326] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:42.294383] [INFO ] [MAIN ] KNF: Generated 1820 derivative records from 37116 primary records. [2025-10-17T22:40:42.294569] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-17T22:40:42.313845] [DEBUG] [LOCAL ] KNF: Derivative data saved (1820 records). [2025-10-17T22:40:42.313955] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-17T22:40:42.315983] [INFO ] [MAIN ] Derivative Progress: 1033/2083 symbols completed. KNF took 1.1s. Estimated remaining: 6m 39s. Rate: 157.8 symbols/min [2025-10-17T22:40:42.330633] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:42.343431] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:42.343203] [INFO ] [MAIN ] KN: Generated 1820 derivative records from 39111 primary records. [2025-10-17T22:40:42.343532] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-17T22:40:42.344099] [INFO ] [MAIN ] KNOP: Generated 1820 derivative records from 10627 primary records. [2025-10-17T22:40:42.344760] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-17T22:40:42.372831] [DEBUG] [LOCAL ] KN: Derivative data saved (1820 records). [2025-10-17T22:40:42.373737] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-17T22:40:42.374116] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1820 records). [2025-10-17T22:40:42.376371] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-10-17T22:40:42.376311] [INFO ] [MAIN ] Derivative Progress: 1034/2083 symbols completed. KN took 1.1s. Estimated remaining: 6m 38s. Rate: 158.0 symbols/min [2025-10-17T22:40:42.378616] [INFO ] [MAIN ] Derivative Progress: 1035/2083 symbols completed. KNOP took 1.1s. Estimated remaining: 6m 38s. Rate: 158.1 symbols/min [2025-10-17T22:40:42.379169] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:42.379116] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:42.379288] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:42.399221] [DEBUG] [LOCAL ] KNSL: Loaded 18750 existing records from primary storage. [2025-10-17T22:40:42.399358] [INFO ] [MAIN ] KNSL: Loaded 18750 primary data records. [2025-10-17T22:40:42.740783] [DEBUG] [LOCAL ] KNTK: Loaded 47788 existing records from primary storage. [2025-10-17T22:40:42.741072] [INFO ] [MAIN ] KNTK: Loaded 47788 primary data records. [2025-10-17T22:40:42.741902] [DEBUG] [LOCAL ] KNX: Loaded 53395 existing records from primary storage. [2025-10-17T22:40:42.753489] [INFO ] [MAIN ] KNX: Loaded 53395 primary data records. [2025-10-17T22:40:43.381123] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:43.382391] [INFO ] [MAIN ] KNSL: Generated 1820 derivative records from 18750 primary records. [2025-10-17T22:40:43.382634] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-17T22:40:43.400663] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1820 records). [2025-10-17T22:40:43.400915] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-17T22:40:43.403413] [INFO ] [MAIN ] Derivative Progress: 1036/2083 symbols completed. KNSL took 1.0s. Estimated remaining: 6m 38s. Rate: 157.9 symbols/min [2025-10-17T22:40:43.403738] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:43.427563] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:43.428590] [INFO ] [MAIN ] KNTK: Generated 1820 derivative records from 47788 primary records. [2025-10-17T22:40:43.428877] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-17T22:40:43.451695] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:43.469233] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1820 records). [2025-10-17T22:40:43.469489] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-17T22:40:43.467997] [INFO ] [MAIN ] KNX: Generated 1820 derivative records from 53395 primary records. [2025-10-17T22:40:43.471583] [INFO ] [MAIN ] Derivative Progress: 1037/2083 symbols completed. KNTK took 1.1s. Estimated remaining: 6m 37s. Rate: 158.0 symbols/min [2025-10-17T22:40:43.471805] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-17T22:40:43.472140] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:43.489815] [DEBUG] [LOCAL ] KNX: Derivative data saved (1820 records). [2025-10-17T22:40:43.489979] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-17T22:40:43.492265] [INFO ] [MAIN ] Derivative Progress: 1038/2083 symbols completed. KNX took 1.1s. Estimated remaining: 6m 37s. Rate: 158.1 symbols/min [2025-10-17T22:40:43.503844] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:43.506146] [DEBUG] [LOCAL ] KODK: Loaded 44414 existing records from primary storage. [2025-10-17T22:40:43.506473] [INFO ] [MAIN ] KODK: Loaded 44414 primary data records. [2025-10-17T22:40:43.635367] [DEBUG] [LOCAL ] KOF: Loaded 26961 existing records from primary storage. [2025-10-17T22:40:43.641190] [INFO ] [MAIN ] KOF: Loaded 26961 primary data records. [2025-10-17T22:40:43.662370] [DEBUG] [LOCAL ] KOP: Loaded 17674 existing records from primary storage. [2025-10-17T22:40:43.737786] [INFO ] [MAIN ] KOP: Loaded 17674 primary data records. [2025-10-17T22:40:44.502060] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:44.503037] [INFO ] [MAIN ] KODK: Generated 1820 derivative records from 44414 primary records. [2025-10-17T22:40:44.503392] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-17T22:40:44.521487] [DEBUG] [LOCAL ] KODK: Derivative data saved (1820 records). [2025-10-17T22:40:44.521706] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-17T22:40:44.523934] [INFO ] [MAIN ] Derivative Progress: 1039/2083 symbols completed. KODK took 1.1s. Estimated remaining: 6m 37s. Rate: 157.9 symbols/min [2025-10-17T22:40:44.524102] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:44.532981] [DEBUG] [LOCAL ] KORE: Loaded 2191 existing records from primary storage. [2025-10-17T22:40:44.533493] [INFO ] [MAIN ] KORE: Loaded 2191 primary data records. [2025-10-17T22:40:44.579205] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:44.632413] [INFO ] [MAIN ] KOF: Generated 1820 derivative records from 26961 primary records. [2025-10-17T22:40:44.653703] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-17T22:40:44.679615] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:44.703298] [INFO ] [MAIN ] KOP: Generated 1820 derivative records from 17674 primary records. [2025-10-17T22:40:44.709028] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-17T22:40:44.891834] [DEBUG] [LOCAL ] KOF: Derivative data saved (1820 records). [2025-10-17T22:40:44.893790] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-17T22:40:44.899084] [INFO ] [MAIN ] Derivative Progress: 1040/2083 symbols completed. KOF took 1.4s. Estimated remaining: 6m 36s. Rate: 157.9 symbols/min [2025-10-17T22:40:44.899288] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:44.896848] [DEBUG] [LOCAL ] KOP: Derivative data saved (1820 records). [2025-10-17T22:40:44.899458] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-17T22:40:44.902013] [INFO ] [MAIN ] Derivative Progress: 1041/2083 symbols completed. KOP took 1.4s. Estimated remaining: 6m 36s. Rate: 158.0 symbols/min [2025-10-17T22:40:44.902214] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:44.927902] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:44.928588] [INFO ] [MAIN ] KORE: Generated 1820 derivative records from 2191 primary records. [2025-10-17T22:40:44.928754] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-17T22:40:44.955892] [DEBUG] [LOCAL ] KORE: Derivative data saved (1820 records). [2025-10-17T22:40:44.956156] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-10-17T22:40:44.958057] [INFO ] [MAIN ] Derivative Progress: 1042/2083 symbols completed. KORE took 0.4s. Estimated remaining: 6m 35s. Rate: 158.1 symbols/min [2025-10-17T22:40:44.970440] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:44.988030] [DEBUG] [LOCAL ] KOS: Loaded 53875 existing records from primary storage. [2025-10-17T22:40:44.988267] [INFO ] [MAIN ] KOS: Loaded 53875 primary data records. [2025-10-17T22:40:45.104914] [DEBUG] [LOCAL ] KR: Loaded 54460 existing records from primary storage. [2025-10-17T22:40:45.105160] [INFO ] [MAIN ] KR: Loaded 54460 primary data records. [2025-10-17T22:40:45.612793] [DEBUG] [LOCAL ] KRC: Loaded 48982 existing records from primary storage. [2025-10-17T22:40:45.614096] [INFO ] [MAIN ] KRC: Loaded 48982 primary data records. [2025-10-17T22:40:45.928014] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:45.930419] [INFO ] [MAIN ] KOS: Generated 1820 derivative records from 53875 primary records. [2025-10-17T22:40:45.930539] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-17T22:40:45.959249] [DEBUG] [LOCAL ] KOS: Derivative data saved (1820 records). [2025-10-17T22:40:45.959918] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:45.959693] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-17T22:40:45.961861] [INFO ] [MAIN ] Derivative Progress: 1043/2083 symbols completed. KOS took 1.1s. Estimated remaining: 6m 35s. Rate: 157.9 symbols/min [2025-10-17T22:40:45.963050] [INFO ] [MAIN ] KR: Generated 1820 derivative records from 54460 primary records. [2025-10-17T22:40:45.962114] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:45.963154] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-17T22:40:45.981934] [DEBUG] [LOCAL ] KR: Derivative data saved (1820 records). [2025-10-17T22:40:45.983505] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-17T22:40:45.985823] [INFO ] [MAIN ] Derivative Progress: 1044/2083 symbols completed. KR took 1.1s. Estimated remaining: 6m 34s. Rate: 158.0 symbols/min [2025-10-17T22:40:45.985974] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:46.000113] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:46.000851] [INFO ] [MAIN ] KRC: Generated 1820 derivative records from 48982 primary records. [2025-10-17T22:40:46.001111] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-17T22:40:46.026413] [DEBUG] [LOCAL ] KRC: Derivative data saved (1820 records). [2025-10-17T22:40:46.026702] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-17T22:40:46.041626] [INFO ] [MAIN ] Derivative Progress: 1045/2083 symbols completed. KRC took 1.1s. Estimated remaining: 6m 34s. Rate: 158.2 symbols/min [2025-10-17T22:40:46.042931] [DEBUG] [LOCAL ] KREF: Loaded 38479 existing records from primary storage. [2025-10-17T22:40:46.043164] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:46.043318] [INFO ] [MAIN ] KREF: Loaded 38479 primary data records. [2025-10-17T22:40:46.393173] [DEBUG] [LOCAL ] KRO: Loaded 26887 existing records from primary storage. [2025-10-17T22:40:46.394435] [DEBUG] [LOCAL ] KRG: Loaded 50023 existing records from primary storage. [2025-10-17T22:40:46.394537] [INFO ] [MAIN ] KRO: Loaded 26887 primary data records. [2025-10-17T22:40:46.394613] [INFO ] [MAIN ] KRG: Loaded 50023 primary data records. [2025-10-17T22:40:47.011370] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:47.012725] [INFO ] [MAIN ] KREF: Generated 1820 derivative records from 38479 primary records. [2025-10-17T22:40:47.013015] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-17T22:40:47.036796] [DEBUG] [LOCAL ] KREF: Derivative data saved (1820 records). [2025-10-17T22:40:47.038576] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-17T22:40:47.053715] [INFO ] [MAIN ] Derivative Progress: 1046/2083 symbols completed. KREF took 1.1s. Estimated remaining: 6m 34s. Rate: 157.9 symbols/min [2025-10-17T22:40:47.054333] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:47.054965] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:47.063961] [INFO ] [MAIN ] KRG: Generated 1820 derivative records from 50023 primary records. [2025-10-17T22:40:47.069183] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:47.069262] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-17T22:40:47.069911] [INFO ] [MAIN ] KRO: Generated 1820 derivative records from 26887 primary records. [2025-10-17T22:40:47.070797] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-17T22:40:47.100814] [DEBUG] [LOCAL ] KRG: Derivative data saved (1820 records). [2025-10-17T22:40:47.101794] [DEBUG] [LOCAL ] KRO: Derivative data saved (1820 records). [2025-10-17T22:40:47.102059] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-17T22:40:47.101924] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-17T22:40:47.104189] [INFO ] [MAIN ] Derivative Progress: 1047/2083 symbols completed. KRO took 1.1s. Estimated remaining: 6m 33s. Rate: 158.0 symbols/min [2025-10-17T22:40:47.104479] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:47.106787] [INFO ] [MAIN ] Derivative Progress: 1048/2083 symbols completed. KRG took 1.1s. Estimated remaining: 6m 33s. Rate: 158.2 symbols/min [2025-10-17T22:40:47.137348] [DEBUG] [LOCAL ] KRP: Loaded 36833 existing records from primary storage. [2025-10-17T22:40:47.137550] [INFO ] [MAIN ] KRP: Loaded 36833 primary data records. [2025-10-17T22:40:47.462232] [DEBUG] [LOCAL ] KSS: Loaded 54372 existing records from primary storage. [2025-10-17T22:40:47.462460] [INFO ] [MAIN ] KSS: Loaded 54372 primary data records. [2025-10-17T22:40:47.790409] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:47.791200] [INFO ] [MAIN ] KRP: Generated 1820 derivative records from 36833 primary records. [2025-10-17T22:40:47.791312] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-17T22:40:47.810885] [DEBUG] [LOCAL ] KRP: Derivative data saved (1820 records). [2025-10-17T22:40:47.811132] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-17T22:40:47.813626] [INFO ] [MAIN ] Derivative Progress: 1049/2083 symbols completed. KRP took 0.8s. Estimated remaining: 6m 32s. Rate: 158.1 symbols/min [2025-10-17T22:40:47.830013] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:47.830632] [INFO ] [MAIN ] KSS: Generated 1820 derivative records from 54372 primary records. [2025-10-17T22:40:47.830727] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-17T22:40:47.846042] [DEBUG] [LOCAL ] KSS: Derivative data saved (1820 records). [2025-10-17T22:40:47.846098] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-17T22:40:47.848144] [INFO ] [MAIN ] Derivative Progress: 1050/2083 symbols completed. KSS took 0.7s. Estimated remaining: 6m 32s. Rate: 158.2 symbols/min [2025-10-17T22:40:47.848509] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:47.848807] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:47.848980] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:47.861100] [DEBUG] [LOCAL ] KTF: Loaded 11900 existing records from primary storage. [2025-10-17T22:40:47.861370] [INFO ] [MAIN ] KTF: Loaded 11900 primary data records. [2025-10-17T22:40:48.218428] [DEBUG] [LOCAL ] KT: Loaded 46205 existing records from primary storage. [2025-10-17T22:40:48.219688] [DEBUG] [LOCAL ] KTB: Loaded 41064 existing records from primary storage. [2025-10-17T22:40:48.219879] [INFO ] [MAIN ] KTB: Loaded 41064 primary data records. [2025-10-17T22:40:48.220038] [INFO ] [MAIN ] KT: Loaded 46205 primary data records. [2025-10-17T22:40:48.825835] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:48.826961] [INFO ] [MAIN ] KTF: Generated 1820 derivative records from 11900 primary records. [2025-10-17T22:40:48.827184] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-17T22:40:48.846096] [DEBUG] [LOCAL ] KTF: Derivative data saved (1820 records). [2025-10-17T22:40:48.846499] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-17T22:40:48.849116] [INFO ] [MAIN ] Derivative Progress: 1051/2083 symbols completed. KTF took 1.0s. Estimated remaining: 6m 32s. Rate: 158.0 symbols/min [2025-10-17T22:40:48.849479] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:48.881033] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:48.880862] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:48.881779] [INFO ] [MAIN ] KTB: Generated 1820 derivative records from 41064 primary records. [2025-10-17T22:40:48.882503] [INFO ] [MAIN ] KT: Generated 1820 derivative records from 46205 primary records. [2025-10-17T22:40:48.882703] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-17T22:40:48.883578] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-17T22:40:48.916264] [DEBUG] [LOCAL ] KTB: Derivative data saved (1820 records). [2025-10-17T22:40:48.916118] [DEBUG] [LOCAL ] KT: Derivative data saved (1820 records). [2025-10-17T22:40:48.916504] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-17T22:40:48.916406] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-17T22:40:48.919003] [INFO ] [MAIN ] Derivative Progress: 1052/2083 symbols completed. KT took 1.1s. Estimated remaining: 6m 31s. Rate: 158.1 symbols/min [2025-10-17T22:40:48.921234] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:48.921318] [INFO ] [MAIN ] Derivative Progress: 1053/2083 symbols completed. KTB took 1.1s. Estimated remaining: 6m 31s. Rate: 158.2 symbols/min [2025-10-17T22:40:48.921414] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:48.973888] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-10-17T22:40:48.974280] [INFO ] [MAIN ] KVUE: Loaded 54447 primary data records. [2025-10-17T22:40:49.096736] [DEBUG] [LOCAL ] KW: Loaded 41091 existing records from primary storage. [2025-10-17T22:40:49.108614] [INFO ] [MAIN ] KW: Loaded 41091 primary data records. [2025-10-17T22:40:49.411853] [DEBUG] [LOCAL ] KVYO: Loaded 51549 existing records from primary storage. [2025-10-17T22:40:49.447339] [INFO ] [MAIN ] KVYO: Loaded 51549 primary data records. [2025-10-17T22:40:49.978625] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:49.979633] [INFO ] [MAIN ] KVUE: Generated 1820 derivative records from 54447 primary records. [2025-10-17T22:40:49.980267] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-17T22:40:50.013891] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:50.015615] [INFO ] [MAIN ] KW: Generated 1820 derivative records from 41091 primary records. [2025-10-17T22:40:50.016084] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-17T22:40:50.018527] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1820 records). [2025-10-17T22:40:50.019892] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-17T22:40:50.028783] [INFO ] [MAIN ] Derivative Progress: 1054/2083 symbols completed. KVUE took 1.2s. Estimated remaining: 6m 31s. Rate: 157.9 symbols/min [2025-10-17T22:40:50.028940] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:50.048590] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:40:50.050132] [INFO ] [MAIN ] KVYO: Generated 1819 derivative records from 51549 primary records. [2025-10-17T22:40:50.050739] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-17T22:40:50.064230] [DEBUG] [LOCAL ] KW: Derivative data saved (1820 records). [2025-10-17T22:40:50.072392] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1819 records). [2025-10-17T22:40:50.072565] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-17T22:40:50.072637] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-17T22:40:50.074924] [INFO ] [MAIN ] Derivative Progress: 1055/2083 symbols completed. KW took 1.2s. Estimated remaining: 6m 30s. Rate: 158.1 symbols/min [2025-10-17T22:40:50.077745] [INFO ] [MAIN ] Derivative Progress: 1056/2083 symbols completed. KVYO took 1.2s. Estimated remaining: 6m 29s. Rate: 158.2 symbols/min [2025-10-17T22:40:50.077530] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:50.077957] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:50.085390] [DEBUG] [LOCAL ] KWR: Loaded 16242 existing records from primary storage. [2025-10-17T22:40:50.085504] [INFO ] [MAIN ] KWR: Loaded 16242 primary data records. [2025-10-17T22:40:50.395411] [DEBUG] [LOCAL ] KYN: Loaded 30763 existing records from primary storage. [2025-10-17T22:40:50.409262] [INFO ] [MAIN ] KYN: Loaded 30763 primary data records. [2025-10-17T22:40:50.490526] [DEBUG] [LOCAL ] L: Loaded 41844 existing records from primary storage. [2025-10-17T22:40:50.507627] [INFO ] [MAIN ] L: Loaded 41844 primary data records. [2025-10-17T22:40:51.048627] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:51.049773] [INFO ] [MAIN ] KWR: Generated 1820 derivative records from 16242 primary records. [2025-10-17T22:40:51.050386] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-17T22:40:51.069940] [DEBUG] [LOCAL ] KWR: Derivative data saved (1820 records). [2025-10-17T22:40:51.070331] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-17T22:40:51.072481] [INFO ] [MAIN ] Derivative Progress: 1057/2083 symbols completed. KWR took 1.0s. Estimated remaining: 6m 30s. Rate: 158.0 symbols/min [2025-10-17T22:40:51.072771] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:51.105293] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:51.105621] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:51.106688] [INFO ] [MAIN ] KYN: Generated 1820 derivative records from 30763 primary records. [2025-10-17T22:40:51.107487] [INFO ] [MAIN ] L: Generated 1820 derivative records from 41844 primary records. [2025-10-17T22:40:51.107622] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-17T22:40:51.107790] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-17T22:40:51.135828] [DEBUG] [LOCAL ] KYN: Derivative data saved (1820 records). [2025-10-17T22:40:51.136506] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-17T22:40:51.138738] [INFO ] [MAIN ] Derivative Progress: 1058/2083 symbols completed. KYN took 1.1s. Estimated remaining: 6m 29s. Rate: 158.1 symbols/min [2025-10-17T22:40:51.139707] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:51.157110] [DEBUG] [LOCAL ] L: Derivative data saved (1820 records). [2025-10-17T22:40:51.157202] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-10-17T22:40:51.159352] [INFO ] [MAIN ] Derivative Progress: 1059/2083 symbols completed. L took 1.1s. Estimated remaining: 6m 28s. Rate: 158.2 symbols/min [2025-10-17T22:40:51.159554] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:51.183949] [DEBUG] [LOCAL ] LAC: Loaded 53290 existing records from primary storage. [2025-10-17T22:40:51.184196] [INFO ] [MAIN ] LAC: Loaded 53290 primary data records. [2025-10-17T22:40:51.272620] [DEBUG] [LOCAL ] LAD: Loaded 23663 existing records from primary storage. [2025-10-17T22:40:51.296437] [INFO ] [MAIN ] LAD: Loaded 23663 primary data records. [2025-10-17T22:40:51.457846] [DEBUG] [LOCAL ] LADR: Loaded 39947 existing records from primary storage. [2025-10-17T22:40:51.633206] [INFO ] [MAIN ] LADR: Loaded 39947 primary data records. [2025-10-17T22:40:52.197916] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:52.200808] [INFO ] [MAIN ] LAC: Generated 1820 derivative records from 53290 primary records. [2025-10-17T22:40:52.200950] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-17T22:40:52.221837] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:52.226448] [INFO ] [MAIN ] LAD: Generated 1820 derivative records from 23663 primary records. [2025-10-17T22:40:52.228747] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-17T22:40:52.231690] [DEBUG] [LOCAL ] LAC: Derivative data saved (1820 records). [2025-10-17T22:40:52.232039] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-17T22:40:52.241462] [INFO ] [MAIN ] Derivative Progress: 1060/2083 symbols completed. LAC took 1.2s. Estimated remaining: 6m 29s. Rate: 158.0 symbols/min [2025-10-17T22:40:52.245376] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:52.250217] [DEBUG] [LOCAL ] LAD: Derivative data saved (1820 records). [2025-10-17T22:40:52.250399] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-17T22:40:52.252861] [INFO ] [MAIN ] Derivative Progress: 1061/2083 symbols completed. LAD took 1.1s. Estimated remaining: 6m 28s. Rate: 158.1 symbols/min [2025-10-17T22:40:52.256469] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:52.272326] [DEBUG] [LOCAL ] LANV: Loaded 2807 existing records from primary storage. [2025-10-17T22:40:52.272143] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:52.273196] [INFO ] [MAIN ] LADR: Generated 1820 derivative records from 39947 primary records. [2025-10-17T22:40:52.272472] [INFO ] [MAIN ] LANV: Loaded 2807 primary data records. [2025-10-17T22:40:52.273304] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-17T22:40:52.398111] [DEBUG] [LOCAL ] LAW: Loaded 14898 existing records from primary storage. [2025-10-17T22:40:52.402351] [INFO ] [MAIN ] LAW: Loaded 14898 primary data records. [2025-10-17T22:40:52.402163] [DEBUG] [LOCAL ] LADR: Derivative data saved (1820 records). [2025-10-17T22:40:52.402481] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-17T22:40:52.404720] [INFO ] [MAIN ] Derivative Progress: 1062/2083 symbols completed. LADR took 1.2s. Estimated remaining: 6m 27s. Rate: 158.2 symbols/min [2025-10-17T22:40:52.430866] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:52.925819] [DEBUG] [LOCAL ] LAZ: Loaded 45283 existing records from primary storage. [2025-10-17T22:40:52.927075] [INFO ] [MAIN ] LAZ: Loaded 45283 primary data records. [2025-10-17T22:40:53.032479] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:53.043933] [INFO ] [MAIN ] LANV: Generated 1820 derivative records from 2807 primary records. [2025-10-17T22:40:53.044119] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-17T22:40:53.246132] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:53.253131] [INFO ] [MAIN ] LAW: Generated 1820 derivative records from 14898 primary records. [2025-10-17T22:40:53.262836] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-17T22:40:53.265001] [DEBUG] [LOCAL ] LANV: Derivative data saved (1820 records). [2025-10-17T22:40:53.266884] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-17T22:40:53.269378] [INFO ] [MAIN ] Derivative Progress: 1063/2083 symbols completed. LANV took 1.0s. Estimated remaining: 6m 27s. Rate: 158.0 symbols/min [2025-10-17T22:40:53.286117] [DEBUG] [LOCAL ] LAW: Derivative data saved (1820 records). [2025-10-17T22:40:53.286548] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-17T22:40:53.289095] [INFO ] [MAIN ] Derivative Progress: 1064/2083 symbols completed. LAW took 1.0s. Estimated remaining: 6m 27s. Rate: 158.2 symbols/min [2025-10-17T22:40:53.308803] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:53.309435] [INFO ] [MAIN ] LAZ: Generated 1820 derivative records from 45283 primary records. [2025-10-17T22:40:53.309495] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-17T22:40:53.325142] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1820 records). [2025-10-17T22:40:53.325203] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-17T22:40:53.327418] [INFO ] [MAIN ] Derivative Progress: 1065/2083 symbols completed. LAZ took 0.9s. Estimated remaining: 6m 26s. Rate: 158.3 symbols/min [2025-10-17T22:40:53.327898] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:53.328058] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:53.328193] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:53.359413] [DEBUG] [LOCAL ] LCII: Loaded 27730 existing records from primary storage. [2025-10-17T22:40:53.359540] [INFO ] [MAIN ] LCII: Loaded 27730 primary data records. [2025-10-17T22:40:53.579623] [DEBUG] [LOCAL ] LC: Loaded 48927 existing records from primary storage. [2025-10-17T22:40:53.580085] [INFO ] [MAIN ] LC: Loaded 48927 primary data records. [2025-10-17T22:40:53.722365] [DEBUG] [LOCAL ] LBRT: Loaded 53738 existing records from primary storage. [2025-10-17T22:40:53.741612] [INFO ] [MAIN ] LBRT: Loaded 53738 primary data records. [2025-10-17T22:40:54.388929] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:54.390284] [INFO ] [MAIN ] LCII: Generated 1820 derivative records from 27730 primary records. [2025-10-17T22:40:54.390943] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-17T22:40:54.413615] [DEBUG] [LOCAL ] LCII: Derivative data saved (1820 records). [2025-10-17T22:40:54.414111] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-17T22:40:54.416478] [INFO ] [MAIN ] Derivative Progress: 1066/2083 symbols completed. LCII took 1.1s. Estimated remaining: 6m 26s. Rate: 158.0 symbols/min [2025-10-17T22:40:54.416635] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:54.430958] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:54.432847] [INFO ] [MAIN ] LC: Generated 1820 derivative records from 48927 primary records. [2025-10-17T22:40:54.433144] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-17T22:40:54.451467] [DEBUG] [LOCAL ] LC: Derivative data saved (1820 records). [2025-10-17T22:40:54.451752] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-17T22:40:54.466003] [INFO ] [MAIN ] Derivative Progress: 1067/2083 symbols completed. LC took 1.1s. Estimated remaining: 6m 25s. Rate: 158.1 symbols/min [2025-10-17T22:40:54.466277] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:54.467805] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:54.468426] [INFO ] [MAIN ] LBRT: Generated 1820 derivative records from 53738 primary records. [2025-10-17T22:40:54.468485] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-10-17T22:40:54.488348] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1820 records). [2025-10-17T22:40:54.498881] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-10-17T22:40:54.501575] [INFO ] [MAIN ] Derivative Progress: 1068/2083 symbols completed. LBRT took 1.2s. Estimated remaining: 6m 25s. Rate: 158.3 symbols/min [2025-10-17T22:40:54.501848] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:54.520300] [DEBUG] [LOCAL ] LDI: Loaded 45582 existing records from primary storage. [2025-10-17T22:40:54.520475] [INFO ] [MAIN ] LDI: Loaded 45582 primary data records. [2025-10-17T22:40:54.624131] [DEBUG] [LOCAL ] LDP: Loaded 12949 existing records from primary storage. [2025-10-17T22:40:54.630319] [INFO ] [MAIN ] LDP: Loaded 12949 primary data records. [2025-10-17T22:40:54.950042] [DEBUG] [LOCAL ] LDOS: Loaded 45546 existing records from primary storage. [2025-10-17T22:40:54.961403] [INFO ] [MAIN ] LDOS: Loaded 45546 primary data records. [2025-10-17T22:40:55.484342] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:55.485779] [INFO ] [MAIN ] LDI: Generated 1820 derivative records from 45582 primary records. [2025-10-17T22:40:55.488029] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-17T22:40:55.518399] [DEBUG] [LOCAL ] LDI: Derivative data saved (1820 records). [2025-10-17T22:40:55.518625] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-17T22:40:55.521489] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:55.521054] [INFO ] [MAIN ] Derivative Progress: 1069/2083 symbols completed. LDI took 1.1s. Estimated remaining: 6m 25s. Rate: 158.0 symbols/min [2025-10-17T22:40:55.521821] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:55.522779] [INFO ] [MAIN ] LDP: Generated 1820 derivative records from 12949 primary records. [2025-10-17T22:40:55.523305] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-17T22:40:55.557543] [DEBUG] [LOCAL ] LDP: Derivative data saved (1820 records). [2025-10-17T22:40:55.557469] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:55.557727] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-17T22:40:55.558510] [INFO ] [MAIN ] LDOS: Generated 1820 derivative records from 45546 primary records. [2025-10-17T22:40:55.560811] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-17T22:40:55.560727] [INFO ] [MAIN ] Derivative Progress: 1070/2083 symbols completed. LDP took 1.1s. Estimated remaining: 6m 24s. Rate: 158.2 symbols/min [2025-10-17T22:40:55.561152] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:55.578553] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1820 records). [2025-10-17T22:40:55.578845] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-17T22:40:55.581248] [INFO ] [MAIN ] Derivative Progress: 1071/2083 symbols completed. LDOS took 1.1s. Estimated remaining: 6m 24s. Rate: 158.3 symbols/min [2025-10-17T22:40:55.581468] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:55.614766] [DEBUG] [LOCAL ] LEO: Loaded 16814 existing records from primary storage. [2025-10-17T22:40:55.615011] [INFO ] [MAIN ] LEO: Loaded 16814 primary data records. [2025-10-17T22:40:55.705294] [DEBUG] [LOCAL ] LEG: Loaded 50873 existing records from primary storage. [2025-10-17T22:40:55.729613] [INFO ] [MAIN ] LEG: Loaded 50873 primary data records. [2025-10-17T22:40:56.119097] [DEBUG] [LOCAL ] LEN: Loaded 53973 existing records from primary storage. [2025-10-17T22:40:56.179432] [INFO ] [MAIN ] LEN: Loaded 53973 primary data records. [2025-10-17T22:40:56.623364] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:56.624962] [INFO ] [MAIN ] LEO: Generated 1820 derivative records from 16814 primary records. [2025-10-17T22:40:56.632661] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-17T22:40:56.644912] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:56.649320] [INFO ] [MAIN ] LEG: Generated 1820 derivative records from 50873 primary records. [2025-10-17T22:40:56.653538] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-17T22:40:56.653472] [DEBUG] [LOCAL ] LEO: Derivative data saved (1820 records). [2025-10-17T22:40:56.654272] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-17T22:40:56.656738] [INFO ] [MAIN ] Derivative Progress: 1072/2083 symbols completed. LEO took 1.1s. Estimated remaining: 6m 24s. Rate: 158.0 symbols/min [2025-10-17T22:40:56.664182] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:56.672961] [DEBUG] [LOCAL ] LEG: Derivative data saved (1820 records). [2025-10-17T22:40:56.673250] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-17T22:40:56.675739] [INFO ] [MAIN ] Derivative Progress: 1073/2083 symbols completed. LEG took 1.2s. Estimated remaining: 6m 23s. Rate: 158.2 symbols/min [2025-10-17T22:40:56.676112] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:56.692710] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:56.693340] [INFO ] [MAIN ] LEN: Generated 1820 derivative records from 53973 primary records. [2025-10-17T22:40:56.693400] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-17T22:40:56.715328] [DEBUG] [LOCAL ] LEN: Derivative data saved (1820 records). [2025-10-17T22:40:56.715480] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-17T22:40:56.717774] [INFO ] [MAIN ] Derivative Progress: 1074/2083 symbols completed. LEN took 1.2s. Estimated remaining: 6m 22s. Rate: 158.3 symbols/min [2025-10-17T22:40:56.724902] [DEBUG] [LOCAL ] LFT: Loaded 18518 existing records from primary storage. [2025-10-17T22:40:56.724568] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:56.725080] [INFO ] [MAIN ] LFT: Loaded 18518 primary data records. [2025-10-17T22:40:56.912869] [DEBUG] [LOCAL ] LGI: Loaded 10171 existing records from primary storage. [2025-10-17T22:40:57.044121] [INFO ] [MAIN ] LGI: Loaded 10171 primary data records. [2025-10-17T22:40:57.070244] [DEBUG] [LOCAL ] LEVI: Loaded 52559 existing records from primary storage. [2025-10-17T22:40:57.096669] [INFO ] [MAIN ] LEVI: Loaded 52559 primary data records. [2025-10-17T22:40:57.735805] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:57.737438] [INFO ] [MAIN ] LFT: Generated 1820 derivative records from 18518 primary records. [2025-10-17T22:40:57.737790] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-17T22:40:57.755141] [DEBUG] [LOCAL ] LFT: Derivative data saved (1820 records). [2025-10-17T22:40:57.755338] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-17T22:40:57.757575] [INFO ] [MAIN ] Derivative Progress: 1075/2083 symbols completed. LFT took 1.1s. Estimated remaining: 6m 23s. Rate: 158.0 symbols/min [2025-10-17T22:40:57.757873] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:57.782524] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:57.784216] [INFO ] [MAIN ] LGI: Generated 1820 derivative records from 10171 primary records. [2025-10-17T22:40:57.797229] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-17T22:40:57.798938] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:57.801043] [INFO ] [MAIN ] LEVI: Generated 1820 derivative records from 52559 primary records. [2025-10-17T22:40:57.808588] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-17T22:40:57.835481] [DEBUG] [LOCAL ] LGI: Derivative data saved (1820 records). [2025-10-17T22:40:57.841034] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-17T22:40:57.843537] [INFO ] [MAIN ] Derivative Progress: 1076/2083 symbols completed. LGI took 1.1s. Estimated remaining: 6m 22s. Rate: 158.2 symbols/min [2025-10-17T22:40:57.844037] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:57.846014] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1820 records). [2025-10-17T22:40:57.856390] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-17T22:40:57.859831] [INFO ] [MAIN ] Derivative Progress: 1077/2083 symbols completed. LEVI took 1.2s. Estimated remaining: 6m 21s. Rate: 158.3 symbols/min [2025-10-17T22:40:57.860721] [DEBUG] [LOCAL ] LH: Loaded 38017 existing records from primary storage. [2025-10-17T22:40:57.860838] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:57.860996] [INFO ] [MAIN ] LH: Loaded 38017 primary data records. [2025-10-17T22:40:58.154356] [DEBUG] [LOCAL ] LII: Loaded 28209 existing records from primary storage. [2025-10-17T22:40:58.179385] [INFO ] [MAIN ] LII: Loaded 28209 primary data records. [2025-10-17T22:40:58.299267] [DEBUG] [LOCAL ] LHX: Loaded 49301 existing records from primary storage. [2025-10-17T22:40:58.310157] [INFO ] [MAIN ] LHX: Loaded 49301 primary data records. [2025-10-17T22:40:58.809666] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:58.811235] [INFO ] [MAIN ] LH: Generated 1820 derivative records from 38017 primary records. [2025-10-17T22:40:58.811346] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-17T22:40:58.829097] [DEBUG] [LOCAL ] LH: Derivative data saved (1820 records). [2025-10-17T22:40:58.829679] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-17T22:40:58.831912] [INFO ] [MAIN ] Derivative Progress: 1078/2083 symbols completed. LH took 1.1s. Estimated remaining: 6m 21s. Rate: 158.1 symbols/min [2025-10-17T22:40:58.851829] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:58.852735] [INFO ] [MAIN ] LII: Generated 1820 derivative records from 28209 primary records. [2025-10-17T22:40:58.852925] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-17T22:40:58.886044] [DEBUG] [LOCAL ] LII: Derivative data saved (1820 records). [2025-10-17T22:40:58.886578] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-17T22:40:58.889031] [INFO ] [MAIN ] Derivative Progress: 1079/2083 symbols completed. LII took 1.0s. Estimated remaining: 6m 21s. Rate: 158.2 symbols/min [2025-10-17T22:40:58.886402] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:58.889968] [INFO ] [MAIN ] LHX: Generated 1820 derivative records from 49301 primary records. [2025-10-17T22:40:58.890032] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-17T22:40:58.905561] [DEBUG] [LOCAL ] LHX: Derivative data saved (1820 records). [2025-10-17T22:40:58.905638] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-17T22:40:58.908218] [INFO ] [MAIN ] Derivative Progress: 1080/2083 symbols completed. LHX took 1.1s. Estimated remaining: 6m 20s. Rate: 158.3 symbols/min [2025-10-17T22:40:58.908692] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:58.909363] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:58.908857] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:40:58.918584] [DEBUG] [LOCAL ] LITB: Loaded 4239 existing records from primary storage. [2025-10-17T22:40:58.919312] [INFO ] [MAIN ] LITB: Loaded 4239 primary data records. [2025-10-17T22:40:59.265491] [DEBUG] [LOCAL ] LION: Loaded 47066 existing records from primary storage. [2025-10-17T22:40:59.265896] [INFO ] [MAIN ] LION: Loaded 47066 primary data records. [2025-10-17T22:40:59.389874] [DEBUG] [LOCAL ] LLY: Loaded 54022 existing records from primary storage. [2025-10-17T22:40:59.390195] [INFO ] [MAIN ] LLY: Loaded 54022 primary data records. [2025-10-17T22:40:59.980349] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:40:59.981902] [INFO ] [MAIN ] LITB: Generated 1820 derivative records from 4239 primary records. [2025-10-17T22:40:59.982458] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-17T22:40:59.998861] [DEBUG] [LOCAL ] LITB: Derivative data saved (1820 records). [2025-10-17T22:41:00.000400] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-10-17T22:41:00.003122] [INFO ] [MAIN ] Derivative Progress: 1081/2083 symbols completed. LITB took 1.1s. Estimated remaining: 6m 20s. Rate: 158.1 symbols/min [2025-10-17T22:41:00.003711] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:00.021254] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:00.021998] [INFO ] [MAIN ] LION: Generated 1820 derivative records from 47066 primary records. [2025-10-17T22:41:00.022256] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-17T22:41:00.050957] [DEBUG] [LOCAL ] LION: Derivative data saved (1820 records). [2025-10-17T22:41:00.063975] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-17T22:41:00.066283] [INFO ] [MAIN ] Derivative Progress: 1082/2083 symbols completed. LION took 1.2s. Estimated remaining: 6m 20s. Rate: 158.2 symbols/min [2025-10-17T22:41:00.066851] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:00.067567] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:00.068370] [INFO ] [MAIN ] LLY: Generated 1820 derivative records from 54022 primary records. [2025-10-17T22:41:00.068436] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-17T22:41:00.100100] [DEBUG] [LOCAL ] LLY: Derivative data saved (1820 records). [2025-10-17T22:41:00.100286] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-17T22:41:00.102970] [INFO ] [MAIN ] Derivative Progress: 1083/2083 symbols completed. LLY took 1.2s. Estimated remaining: 6m 19s. Rate: 158.3 symbols/min [2025-10-17T22:41:00.103224] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:00.122343] [DEBUG] [LOCAL ] LMND: Loaded 52841 existing records from primary storage. [2025-10-17T22:41:00.123933] [INFO ] [MAIN ] LMND: Loaded 52841 primary data records. [2025-10-17T22:41:00.170523] [DEBUG] [LOCAL ] LND: Loaded 5027 existing records from primary storage. [2025-10-17T22:41:00.208497] [INFO ] [MAIN ] LND: Loaded 5027 primary data records. [2025-10-17T22:41:00.447495] [DEBUG] [LOCAL ] LNC: Loaded 52301 existing records from primary storage. [2025-10-17T22:41:00.447782] [INFO ] [MAIN ] LNC: Loaded 52301 primary data records. [2025-10-17T22:41:01.112467] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:01.113940] [INFO ] [MAIN ] LND: Generated 1820 derivative records from 5027 primary records. [2025-10-17T22:41:01.114349] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-17T22:41:01.131562] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:01.133103] [INFO ] [MAIN ] LMND: Generated 1820 derivative records from 52841 primary records. [2025-10-17T22:41:01.133805] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-17T22:41:01.158453] [DEBUG] [LOCAL ] LND: Derivative data saved (1820 records). [2025-10-17T22:41:01.161251] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-17T22:41:01.167251] [INFO ] [MAIN ] Derivative Progress: 1084/2083 symbols completed. LND took 1.1s. Estimated remaining: 6m 19s. Rate: 158.0 symbols/min [2025-10-17T22:41:01.167944] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:01.168830] [DEBUG] [LOCAL ] LMND: Derivative data saved (1820 records). [2025-10-17T22:41:01.170470] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-17T22:41:01.173745] [INFO ] [MAIN ] Derivative Progress: 1085/2083 symbols completed. LMND took 1.2s. Estimated remaining: 6m 19s. Rate: 158.2 symbols/min [2025-10-17T22:41:01.174873] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:01.188629] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:01.189493] [INFO ] [MAIN ] LNC: Generated 1820 derivative records from 52301 primary records. [2025-10-17T22:41:01.189638] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-17T22:41:01.212874] [DEBUG] [LOCAL ] LNN: Loaded 11624 existing records from primary storage. [2025-10-17T22:41:01.213375] [INFO ] [MAIN ] LNN: Loaded 11624 primary data records. [2025-10-17T22:41:01.247135] [DEBUG] [LOCAL ] LNC: Derivative data saved (1820 records). [2025-10-17T22:41:01.252474] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-17T22:41:01.255340] [INFO ] [MAIN ] Derivative Progress: 1086/2083 symbols completed. LNC took 1.2s. Estimated remaining: 6m 18s. Rate: 158.3 symbols/min [2025-10-17T22:41:01.262217] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:01.569176] [DEBUG] [LOCAL ] LNG: Loaded 51953 existing records from primary storage. [2025-10-17T22:41:01.569448] [INFO ] [MAIN ] LNG: Loaded 51953 primary data records. [2025-10-17T22:41:01.696260] [DEBUG] [LOCAL ] LOAR: Loaded 42593 existing records from primary storage. [2025-10-17T22:41:01.794138] [INFO ] [MAIN ] LOAR: Loaded 42593 primary data records. [2025-10-17T22:41:02.224125] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:02.238157] [INFO ] [MAIN ] LNN: Generated 1820 derivative records from 11624 primary records. [2025-10-17T22:41:02.238937] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-17T22:41:02.256511] [DEBUG] [LOCAL ] LNN: Derivative data saved (1820 records). [2025-10-17T22:41:02.257609] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-17T22:41:02.260321] [INFO ] [MAIN ] Derivative Progress: 1087/2083 symbols completed. LNN took 1.1s. Estimated remaining: 6m 18s. Rate: 158.1 symbols/min [2025-10-17T22:41:02.260607] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:02.279311] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:02.280250] [INFO ] [MAIN ] LNG: Generated 1820 derivative records from 51953 primary records. [2025-10-17T22:41:02.280513] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-17T22:41:02.307749] [DEBUG] [LOCAL ] LNG: Derivative data saved (1820 records). [2025-10-17T22:41:02.316593] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-17T22:41:02.329414] [DEBUG] [LOCAL ] LOB: Loaded 27202 existing records from primary storage. [2025-10-17T22:41:02.331559] [INFO ] [MAIN ] Derivative Progress: 1088/2083 symbols completed. LNG took 1.2s. Estimated remaining: 6m 17s. Rate: 158.2 symbols/min [2025-10-17T22:41:02.329533] [INFO ] [MAIN ] LOB: Loaded 27202 primary data records. [2025-10-17T22:41:02.331959] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:02.332208] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:02.332995] [INFO ] [MAIN ] LOAR: Generated 1820 derivative records from 42593 primary records. [2025-10-17T22:41:02.344725] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-17T22:41:02.437762] [DEBUG] [LOCAL ] LOCL: Loaded 3843 existing records from primary storage. [2025-10-17T22:41:02.459507] [INFO ] [MAIN ] LOCL: Loaded 3843 primary data records. [2025-10-17T22:41:02.460242] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1820 records). [2025-10-17T22:41:02.503040] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-17T22:41:02.515805] [INFO ] [MAIN ] Derivative Progress: 1089/2083 symbols completed. LOAR took 1.3s. Estimated remaining: 6m 17s. Rate: 158.3 symbols/min [2025-10-17T22:41:02.614514] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:03.006835] [DEBUG] [LOCAL ] LOMA: Loaded 33150 existing records from primary storage. [2025-10-17T22:41:03.007170] [INFO ] [MAIN ] LOMA: Loaded 33150 primary data records. [2025-10-17T22:41:03.241503] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:03.323352] [INFO ] [MAIN ] LOB: Generated 1820 derivative records from 27202 primary records. [2025-10-17T22:41:03.323726] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-17T22:41:03.357787] [DEBUG] [LOCAL ] LOB: Derivative data saved (1820 records). [2025-10-17T22:41:03.358304] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-17T22:41:03.360578] [INFO ] [MAIN ] Derivative Progress: 1090/2083 symbols completed. LOB took 1.1s. Estimated remaining: 6m 17s. Rate: 158.1 symbols/min [2025-10-17T22:41:03.360754] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:03.362174] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:03.363949] [INFO ] [MAIN ] LOCL: Generated 1820 derivative records from 3843 primary records. [2025-10-17T22:41:03.364352] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-17T22:41:03.380319] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1820 records). [2025-10-17T22:41:03.380574] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-17T22:41:03.382916] [INFO ] [MAIN ] Derivative Progress: 1091/2083 symbols completed. LOCL took 1.1s. Estimated remaining: 6m 16s. Rate: 158.2 symbols/min [2025-10-17T22:41:03.383250] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:03.400286] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:03.402349] [INFO ] [MAIN ] LOMA: Generated 1820 derivative records from 33150 primary records. [2025-10-17T22:41:03.402631] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-17T22:41:03.432295] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1820 records). [2025-10-17T22:41:03.432464] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-17T22:41:03.434768] [INFO ] [MAIN ] Derivative Progress: 1092/2083 symbols completed. LOMA took 0.8s. Estimated remaining: 6m 16s. Rate: 158.3 symbols/min [2025-10-17T22:41:03.435030] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:03.452982] [DEBUG] [LOCAL ] LOW: Loaded 53762 existing records from primary storage. [2025-10-17T22:41:03.463374] [INFO ] [MAIN ] LOW: Loaded 53762 primary data records. [2025-10-17T22:41:03.574340] [DEBUG] [LOCAL ] LPG: Loaded 40105 existing records from primary storage. [2025-10-17T22:41:03.589163] [INFO ] [MAIN ] LPG: Loaded 40105 primary data records. [2025-10-17T22:41:03.667423] [DEBUG] [LOCAL ] LPL: Loaded 28863 existing records from primary storage. [2025-10-17T22:41:03.703254] [INFO ] [MAIN ] LPL: Loaded 28863 primary data records. [2025-10-17T22:41:04.462849] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:04.463778] [INFO ] [MAIN ] LOW: Generated 1820 derivative records from 53762 primary records. [2025-10-17T22:41:04.463883] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-17T22:41:04.484208] [DEBUG] [LOCAL ] LOW: Derivative data saved (1820 records). [2025-10-17T22:41:04.484463] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-17T22:41:04.499386] [INFO ] [MAIN ] Derivative Progress: 1093/2083 symbols completed. LOW took 1.1s. Estimated remaining: 6m 16s. Rate: 158.1 symbols/min [2025-10-17T22:41:04.499743] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:04.501173] [INFO ] [MAIN ] LPG: Generated 1820 derivative records from 40105 primary records. [2025-10-17T22:41:04.501407] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-17T22:41:04.519176] [DEBUG] [LOCAL ] LPG: Derivative data saved (1820 records). [2025-10-17T22:41:04.519300] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-17T22:41:04.522971] [INFO ] [MAIN ] Derivative Progress: 1094/2083 symbols completed. LPG took 1.1s. Estimated remaining: 6m 15s. Rate: 158.2 symbols/min [2025-10-17T22:41:04.536329] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:04.536965] [INFO ] [MAIN ] LPL: Generated 1820 derivative records from 28863 primary records. [2025-10-17T22:41:04.537026] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-17T22:41:04.551876] [DEBUG] [LOCAL ] LPL: Derivative data saved (1820 records). [2025-10-17T22:41:04.551936] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-17T22:41:04.554243] [INFO ] [MAIN ] Derivative Progress: 1095/2083 symbols completed. LPL took 1.1s. Estimated remaining: 6m 14s. Rate: 158.3 symbols/min [2025-10-17T22:41:04.554916] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:04.555118] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:04.554986] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:04.612290] [DEBUG] [LOCAL ] LSPD: Loaded 43208 existing records from primary storage. [2025-10-17T22:41:04.623532] [INFO ] [MAIN ] LSPD: Loaded 43208 primary data records. [2025-10-17T22:41:04.634287] [DEBUG] [LOCAL ] LPX: Loaded 40820 existing records from primary storage. [2025-10-17T22:41:04.656303] [INFO ] [MAIN ] LPX: Loaded 40820 primary data records. [2025-10-17T22:41:04.688611] [DEBUG] [LOCAL ] LRN: Loaded 40127 existing records from primary storage. [2025-10-17T22:41:04.694580] [INFO ] [MAIN ] LRN: Loaded 40127 primary data records. [2025-10-17T22:41:05.632212] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:05.634725] [INFO ] [MAIN ] LSPD: Generated 1820 derivative records from 43208 primary records. [2025-10-17T22:41:05.634954] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-17T22:41:05.662566] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:05.666730] [INFO ] [MAIN ] LPX: Generated 1820 derivative records from 40820 primary records. [2025-10-17T22:41:05.667832] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-17T22:41:05.694419] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:05.699060] [DEBUG] [LOCAL ] LPX: Derivative data saved (1820 records). [2025-10-17T22:41:05.699163] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-17T22:41:05.690068] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1820 records). [2025-10-17T22:41:05.701831] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-17T22:41:05.698254] [INFO ] [MAIN ] LRN: Generated 1820 derivative records from 40127 primary records. [2025-10-17T22:41:05.704272] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-17T22:41:05.701607] [INFO ] [MAIN ] Derivative Progress: 1096/2083 symbols completed. LPX took 1.1s. Estimated remaining: 6m 15s. Rate: 158.0 symbols/min [2025-10-17T22:41:05.704454] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:05.705159] [INFO ] [MAIN ] Derivative Progress: 1097/2083 symbols completed. LSPD took 1.1s. Estimated remaining: 6m 14s. Rate: 158.2 symbols/min [2025-10-17T22:41:05.705790] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:05.722496] [DEBUG] [LOCAL ] LRN: Derivative data saved (1820 records). [2025-10-17T22:41:05.722730] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-17T22:41:05.725158] [INFO ] [MAIN ] Derivative Progress: 1098/2083 symbols completed. LRN took 1.2s. Estimated remaining: 6m 13s. Rate: 158.3 symbols/min [2025-10-17T22:41:05.725390] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:05.759174] [DEBUG] [LOCAL ] LTC: Loaded 31063 existing records from primary storage. [2025-10-17T22:41:05.773606] [INFO ] [MAIN ] LTC: Loaded 31063 primary data records. [2025-10-17T22:41:05.934292] [DEBUG] [LOCAL ] LTM: Loaded 39389 existing records from primary storage. [2025-10-17T22:41:05.934408] [INFO ] [MAIN ] LTM: Loaded 39389 primary data records. [2025-10-17T22:41:05.923220] [DEBUG] [LOCAL ] LTH: Loaded 52497 existing records from primary storage. [2025-10-17T22:41:05.958938] [INFO ] [MAIN ] LTH: Loaded 52497 primary data records. [2025-10-17T22:41:06.734919] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:06.736492] [INFO ] [MAIN ] LTC: Generated 1820 derivative records from 31063 primary records. [2025-10-17T22:41:06.736780] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-17T22:41:06.773208] [DEBUG] [LOCAL ] LTC: Derivative data saved (1820 records). [2025-10-17T22:41:06.781245] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-17T22:41:06.789285] [INFO ] [MAIN ] Derivative Progress: 1099/2083 symbols completed. LTC took 1.1s. Estimated remaining: 6m 14s. Rate: 158.1 symbols/min [2025-10-17T22:41:06.790037] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:06.787148] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:06.790920] [INFO ] [MAIN ] LTM: Generated 1820 derivative records from 39389 primary records. [2025-10-17T22:41:06.792385] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-17T22:41:06.792309] [INFO ] [MAIN ] LTH: Generated 1820 derivative records from 52497 primary records. [2025-10-17T22:41:06.791226] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:06.793479] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-17T22:41:06.823604] [DEBUG] [LOCAL ] LTM: Derivative data saved (1820 records). [2025-10-17T22:41:06.827448] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-17T22:41:06.830695] [INFO ] [MAIN ] Derivative Progress: 1100/2083 symbols completed. LTM took 1.1s. Estimated remaining: 6m 13s. Rate: 158.2 symbols/min [2025-10-17T22:41:06.831423] [DEBUG] [LOCAL ] LTH: Derivative data saved (1820 records). [2025-10-17T22:41:06.831700] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:06.832320] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-17T22:41:06.835742] [INFO ] [MAIN ] Derivative Progress: 1101/2083 symbols completed. LTH took 1.1s. Estimated remaining: 6m 12s. Rate: 158.3 symbols/min [2025-10-17T22:41:06.836078] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:06.872539] [DEBUG] [LOCAL ] LUCK: Loaded 24521 existing records from primary storage. [2025-10-17T22:41:06.872711] [INFO ] [MAIN ] LUCK: Loaded 24521 primary data records. [2025-10-17T22:41:07.019731] [DEBUG] [LOCAL ] LU: Loaded 49804 existing records from primary storage. [2025-10-17T22:41:07.056900] [INFO ] [MAIN ] LU: Loaded 49804 primary data records. [2025-10-17T22:41:07.316226] [DEBUG] [LOCAL ] LUMN: Loaded 54426 existing records from primary storage. [2025-10-17T22:41:07.321560] [INFO ] [MAIN ] LUMN: Loaded 54426 primary data records. [2025-10-17T22:41:07.885393] [DEBUG] [MAIN ] LUCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:07.887716] [INFO ] [MAIN ] LUCK: Generated 1820 derivative records from 24521 primary records. [2025-10-17T22:41:07.888977] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-17T22:41:07.921130] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:07.923283] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1820 records). [2025-10-17T22:41:07.923976] [INFO ] [MAIN ] LU: Generated 1820 derivative records from 49804 primary records. [2025-10-17T22:41:07.924130] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-17T22:41:07.926967] [INFO ] [MAIN ] Derivative Progress: 1102/2083 symbols completed. LUCK took 1.1s. Estimated remaining: 6m 12s. Rate: 158.1 symbols/min [2025-10-17T22:41:07.924891] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-17T22:41:07.928285] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:07.954374] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:07.956770] [INFO ] [MAIN ] LUMN: Generated 1820 derivative records from 54426 primary records. [2025-10-17T22:41:07.957948] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-17T22:41:07.958024] [DEBUG] [LOCAL ] LU: Derivative data saved (1820 records). [2025-10-17T22:41:07.958585] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-17T22:41:07.961193] [INFO ] [MAIN ] Derivative Progress: 1103/2083 symbols completed. LU took 1.2s. Estimated remaining: 6m 12s. Rate: 158.2 symbols/min [2025-10-17T22:41:07.972444] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:07.976995] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1820 records). [2025-10-17T22:41:07.977136] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-17T22:41:07.979481] [INFO ] [MAIN ] Derivative Progress: 1104/2083 symbols completed. LUMN took 1.1s. Estimated remaining: 6m 11s. Rate: 158.3 symbols/min [2025-10-17T22:41:07.979991] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:08.018206] [DEBUG] [LOCAL ] LVWR: Loaded 18573 existing records from primary storage. [2025-10-17T22:41:08.018572] [INFO ] [MAIN ] LVWR: Loaded 18573 primary data records. [2025-10-17T22:41:08.076293] [DEBUG] [LOCAL ] LUV: Loaded 54469 existing records from primary storage. [2025-10-17T22:41:08.096876] [INFO ] [MAIN ] LUV: Loaded 54469 primary data records. [2025-10-17T22:41:08.349030] [DEBUG] [LOCAL ] LVS: Loaded 54350 existing records from primary storage. [2025-10-17T22:41:08.472685] [INFO ] [MAIN ] LVS: Loaded 54350 primary data records. [2025-10-17T22:41:09.016949] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:09.019133] [INFO ] [MAIN ] LVWR: Generated 1820 derivative records from 18573 primary records. [2025-10-17T22:41:09.019508] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-17T22:41:09.040410] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1820 records). [2025-10-17T22:41:09.041027] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-17T22:41:09.043613] [INFO ] [MAIN ] Derivative Progress: 1105/2083 symbols completed. LVWR took 1.1s. Estimated remaining: 6m 11s. Rate: 158.1 symbols/min [2025-10-17T22:41:09.044287] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:09.077347] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:09.077809] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:09.078733] [INFO ] [MAIN ] LUV: Generated 1820 derivative records from 54469 primary records. [2025-10-17T22:41:09.078831] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-17T22:41:09.079424] [INFO ] [MAIN ] LVS: Generated 1820 derivative records from 54350 primary records. [2025-10-17T22:41:09.079701] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-17T22:41:09.112269] [DEBUG] [LOCAL ] LVS: Derivative data saved (1820 records). [2025-10-17T22:41:09.114901] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-10-17T22:41:09.118865] [INFO ] [MAIN ] Derivative Progress: 1106/2083 symbols completed. LVS took 1.1s. Estimated remaining: 6m 11s. Rate: 158.2 symbols/min [2025-10-17T22:41:09.119868] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:09.122746] [DEBUG] [LOCAL ] LUV: Derivative data saved (1820 records). [2025-10-17T22:41:09.122970] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-17T22:41:09.126208] [INFO ] [MAIN ] Derivative Progress: 1107/2083 symbols completed. LUV took 1.2s. Estimated remaining: 6m 10s. Rate: 158.3 symbols/min [2025-10-17T22:41:09.126493] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:09.155886] [DEBUG] [LOCAL ] LXFR: Loaded 16810 existing records from primary storage. [2025-10-17T22:41:09.157292] [INFO ] [MAIN ] LXFR: Loaded 16810 primary data records. [2025-10-17T22:41:09.232907] [DEBUG] [LOCAL ] LW: Loaded 51966 existing records from primary storage. [2025-10-17T22:41:09.247305] [INFO ] [MAIN ] LW: Loaded 51966 primary data records. [2025-10-17T22:41:09.502121] [DEBUG] [LOCAL ] LXP: Loaded 51460 existing records from primary storage. [2025-10-17T22:41:09.572149] [INFO ] [MAIN ] LXP: Loaded 51460 primary data records. [2025-10-17T22:41:10.460740] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:10.462088] [INFO ] [MAIN ] LXFR: Generated 1820 derivative records from 16810 primary records. [2025-10-17T22:41:10.463551] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-17T22:41:10.483790] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1820 records). [2025-10-17T22:41:10.484235] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-17T22:41:10.486218] [INFO ] [MAIN ] Derivative Progress: 1108/2083 symbols completed. LXFR took 1.4s. Estimated remaining: 6m 10s. Rate: 158.0 symbols/min [2025-10-17T22:41:10.499752] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:10.500386] [INFO ] [MAIN ] LW: Generated 1820 derivative records from 51966 primary records. [2025-10-17T22:41:10.500460] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-17T22:41:10.531939] [DEBUG] [LOCAL ] LW: Derivative data saved (1820 records). [2025-10-17T22:41:10.531849] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:10.532138] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-17T22:41:10.532931] [INFO ] [MAIN ] LXP: Generated 1820 derivative records from 51460 primary records. [2025-10-17T22:41:10.535350] [INFO ] [MAIN ] Derivative Progress: 1109/2083 symbols completed. LW took 1.5s. Estimated remaining: 6m 10s. Rate: 158.1 symbols/min [2025-10-17T22:41:10.535465] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-17T22:41:10.551285] [DEBUG] [LOCAL ] LXP: Derivative data saved (1820 records). [2025-10-17T22:41:10.551384] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-17T22:41:10.553731] [INFO ] [MAIN ] Derivative Progress: 1110/2083 symbols completed. LXP took 1.4s. Estimated remaining: 6m 9s. Rate: 158.2 symbols/min [2025-10-17T22:41:10.554243] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:10.554170] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:10.554432] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:10.620514] [DEBUG] [LOCAL ] LXU: Loaded 32174 existing records from primary storage. [2025-10-17T22:41:10.620777] [INFO ] [MAIN ] LXU: Loaded 32174 primary data records. [2025-10-17T22:41:10.761803] [DEBUG] [LOCAL ] LYB: Loaded 54398 existing records from primary storage. [2025-10-17T22:41:10.762684] [DEBUG] [LOCAL ] LYG: Loaded 53435 existing records from primary storage. [2025-10-17T22:41:10.763047] [INFO ] [MAIN ] LYG: Loaded 53435 primary data records. [2025-10-17T22:41:10.763139] [INFO ] [MAIN ] LYB: Loaded 54398 primary data records. [2025-10-17T22:41:11.590505] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:11.591535] [INFO ] [MAIN ] LXU: Generated 1820 derivative records from 32174 primary records. [2025-10-17T22:41:11.592156] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-17T22:41:11.637135] [DEBUG] [LOCAL ] LXU: Derivative data saved (1820 records). [2025-10-17T22:41:11.638395] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:11.637834] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:11.639270] [INFO ] [MAIN ] LYG: Generated 1820 derivative records from 53435 primary records. [2025-10-17T22:41:11.638085] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-17T22:41:11.641163] [INFO ] [MAIN ] Derivative Progress: 1111/2083 symbols completed. LXU took 1.1s. Estimated remaining: 6m 9s. Rate: 158.0 symbols/min [2025-10-17T22:41:11.641976] [INFO ] [MAIN ] LYB: Generated 1820 derivative records from 54398 primary records. [2025-10-17T22:41:11.642200] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:11.642394] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-17T22:41:11.642076] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-17T22:41:11.673532] [DEBUG] [LOCAL ] LYG: Derivative data saved (1820 records). [2025-10-17T22:41:11.675303] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-17T22:41:11.675155] [DEBUG] [LOCAL ] LYB: Derivative data saved (1820 records). [2025-10-17T22:41:11.677778] [INFO ] [MAIN ] Derivative Progress: 1112/2083 symbols completed. LYG took 1.1s. Estimated remaining: 6m 9s. Rate: 158.1 symbols/min [2025-10-17T22:41:11.678078] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:11.678208] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-17T22:41:11.681048] [INFO ] [MAIN ] Derivative Progress: 1113/2083 symbols completed. LYB took 1.1s. Estimated remaining: 6m 8s. Rate: 158.2 symbols/min [2025-10-17T22:41:11.681633] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:11.722421] [DEBUG] [LOCAL ] LZM: Loaded 14886 existing records from primary storage. [2025-10-17T22:41:11.722622] [INFO ] [MAIN ] LZM: Loaded 14886 primary data records. [2025-10-17T22:41:11.815764] [DEBUG] [LOCAL ] LZB: Loaded 35693 existing records from primary storage. [2025-10-17T22:41:11.859539] [INFO ] [MAIN ] LZB: Loaded 35693 primary data records. [2025-10-17T22:41:11.880937] [DEBUG] [LOCAL ] LYV: Loaded 51878 existing records from primary storage. [2025-10-17T22:41:11.930739] [INFO ] [MAIN ] LYV: Loaded 51878 primary data records. [2025-10-17T22:41:12.697773] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:12.698931] [INFO ] [MAIN ] LZM: Generated 1820 derivative records from 14886 primary records. [2025-10-17T22:41:12.699400] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-17T22:41:12.718606] [DEBUG] [LOCAL ] LZM: Derivative data saved (1820 records). [2025-10-17T22:41:12.718799] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-17T22:41:12.721301] [INFO ] [MAIN ] Derivative Progress: 1114/2083 symbols completed. LZM took 1.0s. Estimated remaining: 6m 8s. Rate: 158.0 symbols/min [2025-10-17T22:41:12.722204] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:12.743899] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:12.749588] [INFO ] [MAIN ] LYV: Generated 1820 derivative records from 51878 primary records. [2025-10-17T22:41:12.748963] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:12.750323] [INFO ] [MAIN ] LZB: Generated 1820 derivative records from 35693 primary records. [2025-10-17T22:41:12.750426] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-17T22:41:12.751197] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-17T22:41:12.767207] [DEBUG] [LOCAL ] LYV: Derivative data saved (1820 records). [2025-10-17T22:41:12.774603] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-17T22:41:12.777055] [INFO ] [MAIN ] Derivative Progress: 1115/2083 symbols completed. LYV took 1.1s. Estimated remaining: 6m 7s. Rate: 158.1 symbols/min [2025-10-17T22:41:12.777255] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:12.786046] [DEBUG] [LOCAL ] LZB: Derivative data saved (1820 records). [2025-10-17T22:41:12.786135] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-17T22:41:12.788560] [INFO ] [MAIN ] Derivative Progress: 1116/2083 symbols completed. LZB took 1.1s. Estimated remaining: 6m 7s. Rate: 158.2 symbols/min [2025-10-17T22:41:12.788827] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:12.845360] [DEBUG] [LOCAL ] M: Loaded 54325 existing records from primary storage. [2025-10-17T22:41:12.845624] [INFO ] [MAIN ] M: Loaded 54325 primary data records. [2025-10-17T22:41:12.973129] [DEBUG] [LOCAL ] MA: Loaded 53252 existing records from primary storage. [2025-10-17T22:41:12.995200] [INFO ] [MAIN ] MA: Loaded 53252 primary data records. [2025-10-17T22:41:13.069370] [DEBUG] [LOCAL ] MAA: Loaded 43519 existing records from primary storage. [2025-10-17T22:41:13.121167] [INFO ] [MAIN ] MAA: Loaded 43519 primary data records. [2025-10-17T22:41:13.852489] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:13.854537] [INFO ] [MAIN ] M: Generated 1820 derivative records from 54325 primary records. [2025-10-17T22:41:13.854866] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-17T22:41:13.886506] [DEBUG] [LOCAL ] M: Derivative data saved (1820 records). [2025-10-17T22:41:13.892409] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-17T22:41:13.894361] [INFO ] [MAIN ] Derivative Progress: 1117/2083 symbols completed. M took 1.2s. Estimated remaining: 6m 7s. Rate: 158.0 symbols/min [2025-10-17T22:41:13.895301] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:13.896260] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:13.897210] [INFO ] [MAIN ] MA: Generated 1820 derivative records from 53252 primary records. [2025-10-17T22:41:13.897709] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-17T22:41:13.919596] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:13.922911] [INFO ] [MAIN ] MAA: Generated 1820 derivative records from 43519 primary records. [2025-10-17T22:41:13.924765] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-17T22:41:13.936950] [DEBUG] [LOCAL ] MA: Derivative data saved (1820 records). [2025-10-17T22:41:13.939670] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-17T22:41:13.941902] [INFO ] [MAIN ] Derivative Progress: 1118/2083 symbols completed. MA took 1.2s. Estimated remaining: 6m 6s. Rate: 158.1 symbols/min [2025-10-17T22:41:13.942707] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:13.947723] [DEBUG] [LOCAL ] MAA: Derivative data saved (1820 records). [2025-10-17T22:41:13.947926] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-17T22:41:13.950931] [INFO ] [MAIN ] Derivative Progress: 1119/2083 symbols completed. MAA took 1.2s. Estimated remaining: 6m 6s. Rate: 158.2 symbols/min [2025-10-17T22:41:13.951177] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:13.995256] [DEBUG] [LOCAL ] MAC: Loaded 50453 existing records from primary storage. [2025-10-17T22:41:13.995839] [INFO ] [MAIN ] MAC: Loaded 50453 primary data records. [2025-10-17T22:41:14.094863] [DEBUG] [LOCAL ] MAGN: Loaded 36703 existing records from primary storage. [2025-10-17T22:41:14.113384] [INFO ] [MAIN ] MAGN: Loaded 36703 primary data records. [2025-10-17T22:41:14.222272] [DEBUG] [LOCAL ] MAIN: Loaded 42467 existing records from primary storage. [2025-10-17T22:41:14.302143] [INFO ] [MAIN ] MAIN: Loaded 42467 primary data records. [2025-10-17T22:41:14.991157] [DEBUG] [MAIN ] MAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:14.993213] [INFO ] [MAIN ] MAC: Generated 1820 derivative records from 50453 primary records. [2025-10-17T22:41:14.993372] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-10-17T22:41:15.011565] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:15.025638] [INFO ] [MAIN ] MAGN: Generated 1820 derivative records from 36703 primary records. [2025-10-17T22:41:15.027364] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-17T22:41:15.030810] [DEBUG] [LOCAL ] MAC: Derivative data saved (1820 records). [2025-10-17T22:41:15.031671] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-10-17T22:41:15.052406] [INFO ] [MAIN ] Derivative Progress: 1120/2083 symbols completed. MAC took 1.2s. Estimated remaining: 6m 6s. Rate: 158.0 symbols/min [2025-10-17T22:41:15.054370] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:15.078541] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1820 records). [2025-10-17T22:41:15.078980] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:15.079220] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-17T22:41:15.080063] [INFO ] [MAIN ] MAIN: Generated 1820 derivative records from 42467 primary records. [2025-10-17T22:41:15.082580] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-17T22:41:15.082384] [INFO ] [MAIN ] Derivative Progress: 1121/2083 symbols completed. MAGN took 1.1s. Estimated remaining: 6m 5s. Rate: 158.1 symbols/min [2025-10-17T22:41:15.082787] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:15.102143] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1820 records). [2025-10-17T22:41:15.102426] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-17T22:41:15.104927] [INFO ] [MAIN ] Derivative Progress: 1122/2083 symbols completed. MAIN took 1.2s. Estimated remaining: 6m 4s. Rate: 158.2 symbols/min [2025-10-17T22:41:15.105279] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:15.137065] [DEBUG] [LOCAL ] MANU: Loaded 27565 existing records from primary storage. [2025-10-17T22:41:15.150265] [INFO ] [MAIN ] MANU: Loaded 27565 primary data records. [2025-10-17T22:41:15.151970] [DEBUG] [LOCAL ] MAN: Loaded 44786 existing records from primary storage. [2025-10-17T22:41:15.184688] [INFO ] [MAIN ] MAN: Loaded 44786 primary data records. [2025-10-17T22:41:15.659456] [DEBUG] [LOCAL ] MAS: Loaded 53044 existing records from primary storage. [2025-10-17T22:41:15.807701] [INFO ] [MAIN ] MAS: Loaded 53044 primary data records. [2025-10-17T22:41:16.144396] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:16.145575] [INFO ] [MAIN ] MANU: Generated 1820 derivative records from 27565 primary records. [2025-10-17T22:41:16.162758] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:16.162853] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-17T22:41:16.165009] [INFO ] [MAIN ] MAN: Generated 1820 derivative records from 44786 primary records. [2025-10-17T22:41:16.166276] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-17T22:41:16.194762] [DEBUG] [LOCAL ] MAN: Derivative data saved (1820 records). [2025-10-17T22:41:16.195785] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-17T22:41:16.199892] [INFO ] [MAIN ] Derivative Progress: 1123/2083 symbols completed. MAN took 1.1s. Estimated remaining: 6m 5s. Rate: 158.0 symbols/min [2025-10-17T22:41:16.204889] [DEBUG] [LOCAL ] MANU: Derivative data saved (1820 records). [2025-10-17T22:41:16.205843] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-17T22:41:16.209229] [INFO ] [MAIN ] Derivative Progress: 1124/2083 symbols completed. MANU took 1.1s. Estimated remaining: 6m 4s. Rate: 158.1 symbols/min [2025-10-17T22:41:16.222079] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:16.222736] [INFO ] [MAIN ] MAS: Generated 1820 derivative records from 53044 primary records. [2025-10-17T22:41:16.222800] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-17T22:41:16.238095] [DEBUG] [LOCAL ] MAS: Derivative data saved (1820 records). [2025-10-17T22:41:16.238165] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-17T22:41:16.240340] [INFO ] [MAIN ] Derivative Progress: 1125/2083 symbols completed. MAS took 1.1s. Estimated remaining: 6m 3s. Rate: 158.2 symbols/min [2025-10-17T22:41:16.240885] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:16.240971] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:16.240816] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:16.297013] [DEBUG] [LOCAL ] MAX: Loaded 31450 existing records from primary storage. [2025-10-17T22:41:16.297889] [DEBUG] [LOCAL ] MATX: Loaded 32418 existing records from primary storage. [2025-10-17T22:41:16.307857] [INFO ] [MAIN ] MATX: Loaded 32418 primary data records. [2025-10-17T22:41:16.307735] [INFO ] [MAIN ] MAX: Loaded 31450 primary data records. [2025-10-17T22:41:16.308408] [DEBUG] [LOCAL ] MATV: Loaded 36069 existing records from primary storage. [2025-10-17T22:41:16.308517] [INFO ] [MAIN ] MATV: Loaded 36069 primary data records. [2025-10-17T22:41:17.246768] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:17.255436] [INFO ] [MAIN ] MAX: Generated 1820 derivative records from 31450 primary records. [2025-10-17T22:41:17.255540] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-17T22:41:17.280149] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:17.284424] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:17.286373] [INFO ] [MAIN ] MATX: Generated 1820 derivative records from 32418 primary records. [2025-10-17T22:41:17.287107] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-17T22:41:17.288548] [INFO ] [MAIN ] MATV: Generated 1820 derivative records from 36069 primary records. [2025-10-17T22:41:17.288693] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-17T22:41:17.290536] [DEBUG] [LOCAL ] MAX: Derivative data saved (1820 records). [2025-10-17T22:41:17.298928] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-17T22:41:17.300847] [INFO ] [MAIN ] Derivative Progress: 1126/2083 symbols completed. MAX took 1.1s. Estimated remaining: 6m 3s. Rate: 158.0 symbols/min [2025-10-17T22:41:17.301025] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:17.320383] [DEBUG] [LOCAL ] MATX: Derivative data saved (1820 records). [2025-10-17T22:41:17.320558] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-17T22:41:17.323025] [INFO ] [MAIN ] Derivative Progress: 1127/2083 symbols completed. MATX took 1.1s. Estimated remaining: 6m 3s. Rate: 158.1 symbols/min [2025-10-17T22:41:17.324425] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:17.327958] [DEBUG] [LOCAL ] MATV: Derivative data saved (1820 records). [2025-10-17T22:41:17.328023] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-17T22:41:17.330213] [INFO ] [MAIN ] Derivative Progress: 1128/2083 symbols completed. MATV took 1.1s. Estimated remaining: 6m 2s. Rate: 158.2 symbols/min [2025-10-17T22:41:17.330435] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:17.362475] [DEBUG] [LOCAL ] MBI: Loaded 24689 existing records from primary storage. [2025-10-17T22:41:17.362710] [INFO ] [MAIN ] MBI: Loaded 24689 primary data records. [2025-10-17T22:41:17.486587] [DEBUG] [LOCAL ] MBC: Loaded 44551 existing records from primary storage. [2025-10-17T22:41:17.497512] [INFO ] [MAIN ] MBC: Loaded 44551 primary data records. [2025-10-17T22:41:17.566749] [DEBUG] [LOCAL ] MC: Loaded 44544 existing records from primary storage. [2025-10-17T22:41:17.751360] [INFO ] [MAIN ] MC: Loaded 44544 primary data records. [2025-10-17T22:41:18.396795] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:18.397883] [INFO ] [MAIN ] MBI: Generated 1820 derivative records from 24689 primary records. [2025-10-17T22:41:18.398075] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-17T22:41:18.430352] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:18.432290] [INFO ] [MAIN ] MBC: Generated 1820 derivative records from 44551 primary records. [2025-10-17T22:41:18.431615] [DEBUG] [LOCAL ] MBI: Derivative data saved (1820 records). [2025-10-17T22:41:18.432561] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-17T22:41:18.435493] [INFO ] [MAIN ] Derivative Progress: 1129/2083 symbols completed. MBI took 1.1s. Estimated remaining: 6m 2s. Rate: 158.0 symbols/min [2025-10-17T22:41:18.435923] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-17T22:41:18.435869] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:18.454292] [DEBUG] [LOCAL ] MBC: Derivative data saved (1820 records). [2025-10-17T22:41:18.454518] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-17T22:41:18.457636] [INFO ] [MAIN ] Derivative Progress: 1130/2083 symbols completed. MBC took 1.2s. Estimated remaining: 6m 2s. Rate: 158.1 symbols/min [2025-10-17T22:41:18.457942] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:18.470236] [DEBUG] [LOCAL ] MCB: Loaded 11549 existing records from primary storage. [2025-10-17T22:41:18.471989] [INFO ] [MAIN ] MCB: Loaded 11549 primary data records. [2025-10-17T22:41:18.524681] [DEBUG] [LOCAL ] MCI: Loaded 6457 existing records from primary storage. [2025-10-17T22:41:18.552282] [INFO ] [MAIN ] MCI: Loaded 6457 primary data records. [2025-10-17T22:41:18.573068] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:18.605716] [INFO ] [MAIN ] MC: Generated 1820 derivative records from 44544 primary records. [2025-10-17T22:41:18.623474] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-17T22:41:19.137289] [DEBUG] [LOCAL ] MC: Derivative data saved (1820 records). [2025-10-17T22:41:19.138600] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-17T22:41:19.141152] [INFO ] [MAIN ] Derivative Progress: 1131/2083 symbols completed. MC took 1.8s. Estimated remaining: 6m 2s. Rate: 158.0 symbols/min [2025-10-17T22:41:19.141709] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:19.166795] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:19.167820] [INFO ] [MAIN ] MCB: Generated 1820 derivative records from 11549 primary records. [2025-10-17T22:41:19.168283] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-17T22:41:19.184712] [DEBUG] [LOCAL ] MCB: Derivative data saved (1820 records). [2025-10-17T22:41:19.184849] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-17T22:41:19.187131] [INFO ] [MAIN ] Derivative Progress: 1132/2083 symbols completed. MCB took 0.8s. Estimated remaining: 6m 1s. Rate: 158.1 symbols/min [2025-10-17T22:41:19.198960] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:19.215206] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:19.216029] [INFO ] [MAIN ] MCI: Generated 1820 derivative records from 6457 primary records. [2025-10-17T22:41:19.218721] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-17T22:41:19.250406] [DEBUG] [LOCAL ] MCI: Derivative data saved (1820 records). [2025-10-17T22:41:19.249898] [DEBUG] [LOCAL ] MCN: Loaded 8247 existing records from primary storage. [2025-10-17T22:41:19.252174] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-17T22:41:19.251885] [DEBUG] [LOCAL ] MCK: Loaded 39064 existing records from primary storage. [2025-10-17T22:41:19.254611] [INFO ] [MAIN ] Derivative Progress: 1133/2083 symbols completed. MCI took 0.8s. Estimated remaining: 6m 0s. Rate: 158.2 symbols/min [2025-10-17T22:41:19.254888] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:19.255129] [INFO ] [MAIN ] MCN: Loaded 8247 primary data records. [2025-10-17T22:41:19.255346] [INFO ] [MAIN ] MCK: Loaded 39064 primary data records. [2025-10-17T22:41:19.782632] [DEBUG] [LOCAL ] MCO: Loaded 40089 existing records from primary storage. [2025-10-17T22:41:19.864947] [INFO ] [MAIN ] MCO: Loaded 40089 primary data records. [2025-10-17T22:41:20.298382] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:20.307341] [INFO ] [MAIN ] MCN: Generated 1820 derivative records from 8247 primary records. [2025-10-17T22:41:20.312306] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-17T22:41:20.314198] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:20.315464] [INFO ] [MAIN ] MCK: Generated 1820 derivative records from 39064 primary records. [2025-10-17T22:41:20.315967] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-17T22:41:20.332259] [DEBUG] [LOCAL ] MCN: Derivative data saved (1820 records). [2025-10-17T22:41:20.343956] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-17T22:41:20.347107] [INFO ] [MAIN ] Derivative Progress: 1134/2083 symbols completed. MCN took 1.1s. Estimated remaining: 6m 0s. Rate: 158.0 symbols/min [2025-10-17T22:41:20.349012] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:20.352068] [DEBUG] [LOCAL ] MCK: Derivative data saved (1820 records). [2025-10-17T22:41:20.352762] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-17T22:41:20.355488] [INFO ] [MAIN ] Derivative Progress: 1135/2083 symbols completed. MCK took 1.2s. Estimated remaining: 5m 60s. Rate: 158.1 symbols/min [2025-10-17T22:41:20.355913] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:20.375736] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:20.376607] [INFO ] [MAIN ] MCO: Generated 1820 derivative records from 40089 primary records. [2025-10-17T22:41:20.376853] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-17T22:41:20.398021] [DEBUG] [LOCAL ] MCO: Derivative data saved (1820 records). [2025-10-17T22:41:20.398212] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-17T22:41:20.389865] [DEBUG] [LOCAL ] MCR: Loaded 9061 existing records from primary storage. [2025-10-17T22:41:20.400559] [INFO ] [MAIN ] Derivative Progress: 1136/2083 symbols completed. MCO took 1.1s. Estimated remaining: 5m 59s. Rate: 158.2 symbols/min [2025-10-17T22:41:20.400826] [INFO ] [MAIN ] MCR: Loaded 9061 primary data records. [2025-10-17T22:41:20.400939] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:20.528451] [DEBUG] [LOCAL ] MCS: Loaded 21467 existing records from primary storage. [2025-10-17T22:41:20.546011] [INFO ] [MAIN ] MCS: Loaded 21467 primary data records. [2025-10-17T22:41:20.832985] [DEBUG] [LOCAL ] MCY: Loaded 24248 existing records from primary storage. [2025-10-17T22:41:20.836830] [INFO ] [MAIN ] MCY: Loaded 24248 primary data records. [2025-10-17T22:41:21.363585] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:21.364799] [INFO ] [MAIN ] MCR: Generated 1820 derivative records from 9061 primary records. [2025-10-17T22:41:21.365335] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-17T22:41:21.381591] [DEBUG] [LOCAL ] MCR: Derivative data saved (1820 records). [2025-10-17T22:41:21.382612] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-17T22:41:21.386961] [INFO ] [MAIN ] Derivative Progress: 1137/2083 symbols completed. MCR took 1.0s. Estimated remaining: 5m 59s. Rate: 158.0 symbols/min [2025-10-17T22:41:21.388336] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:21.402262] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:21.402979] [INFO ] [MAIN ] MCS: Generated 1820 derivative records from 21467 primary records. [2025-10-17T22:41:21.403179] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-17T22:41:21.420565] [DEBUG] [LOCAL ] MCS: Derivative data saved (1820 records). [2025-10-17T22:41:21.420792] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-17T22:41:21.423202] [INFO ] [MAIN ] Derivative Progress: 1138/2083 symbols completed. MCS took 1.1s. Estimated remaining: 5m 59s. Rate: 158.1 symbols/min [2025-10-17T22:41:21.438881] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:21.439583] [INFO ] [MAIN ] MCY: Generated 1820 derivative records from 24248 primary records. [2025-10-17T22:41:21.439667] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-17T22:41:21.464144] [DEBUG] [LOCAL ] MCY: Derivative data saved (1820 records). [2025-10-17T22:41:21.464208] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-17T22:41:21.466557] [INFO ] [MAIN ] Derivative Progress: 1139/2083 symbols completed. MCY took 1.1s. Estimated remaining: 5m 58s. Rate: 158.3 symbols/min [2025-10-17T22:41:21.480976] [DEBUG] [LOCAL ] MD: Loaded 39102 existing records from primary storage. [2025-10-17T22:41:21.481144] [INFO ] [MAIN ] MD: Loaded 39102 primary data records. [2025-10-17T22:41:21.821744] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:21.822365] [INFO ] [MAIN ] MD: Generated 1820 derivative records from 39102 primary records. [2025-10-17T22:41:21.822426] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-17T22:41:21.837669] [DEBUG] [LOCAL ] MD: Derivative data saved (1820 records). [2025-10-17T22:41:21.837751] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-17T22:41:21.839887] [INFO ] [MAIN ] Derivative Progress: 1140/2083 symbols completed. MD took 0.5s. Estimated remaining: 5m 58s. Rate: 158.3 symbols/min [2025-10-17T22:41:21.840677] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:21.840585] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:21.841765] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:21.849451] [DEBUG] [LOCAL ] MDST: Loaded 6124 existing records from primary storage. [2025-10-17T22:41:21.849732] [INFO ] [MAIN ] MDST: Loaded 6124 primary data records. [2025-10-17T22:41:22.204722] [DEBUG] [LOCAL ] MDT: Loaded 54458 existing records from primary storage. [2025-10-17T22:41:22.205518] [INFO ] [MAIN ] MDT: Loaded 54458 primary data records. [2025-10-17T22:41:22.306870] [DEBUG] [LOCAL ] MDU: Loaded 48794 existing records from primary storage. [2025-10-17T22:41:22.312364] [INFO ] [MAIN ] MDU: Loaded 48794 primary data records. [2025-10-17T22:41:22.857440] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:22.860210] [INFO ] [MAIN ] MDST: Generated 1820 derivative records from 6124 primary records. [2025-10-17T22:41:22.860577] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-17T22:41:22.880045] [DEBUG] [LOCAL ] MDST: Derivative data saved (1820 records). [2025-10-17T22:41:22.880808] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-17T22:41:22.883352] [INFO ] [MAIN ] Derivative Progress: 1141/2083 symbols completed. MDST took 1.0s. Estimated remaining: 5m 58s. Rate: 158.0 symbols/min [2025-10-17T22:41:22.883683] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:22.904927] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:22.908031] [INFO ] [MAIN ] MDT: Generated 1820 derivative records from 54458 primary records. [2025-10-17T22:41:22.908873] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-17T22:41:22.912831] [DEBUG] [LOCAL ] MDV: Loaded 8524 existing records from primary storage. [2025-10-17T22:41:22.913893] [INFO ] [MAIN ] MDV: Loaded 8524 primary data records. [2025-10-17T22:41:22.969606] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:23.003681] [INFO ] [MAIN ] MDU: Generated 1820 derivative records from 48794 primary records. [2025-10-17T22:41:23.003803] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-17T22:41:23.069755] [DEBUG] [LOCAL ] MDU: Derivative data saved (1820 records). [2025-10-17T22:41:23.076385] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-17T22:41:23.078983] [INFO ] [MAIN ] Derivative Progress: 1142/2083 symbols completed. MDU took 1.2s. Estimated remaining: 5m 57s. Rate: 158.1 symbols/min [2025-10-17T22:41:23.089949] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:23.254754] [DEBUG] [LOCAL ] MDT: Derivative data saved (1820 records). [2025-10-17T22:41:23.254966] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-17T22:41:23.261742] [INFO ] [MAIN ] Derivative Progress: 1143/2083 symbols completed. MDT took 1.4s. Estimated remaining: 5m 57s. Rate: 158.2 symbols/min [2025-10-17T22:41:23.262565] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:23.272341] [DEBUG] [LOCAL ] MEC: Loaded 16672 existing records from primary storage. [2025-10-17T22:41:23.272611] [INFO ] [MAIN ] MEC: Loaded 16672 primary data records. [2025-10-17T22:41:23.431000] [DEBUG] [LOCAL ] MED: Loaded 21503 existing records from primary storage. [2025-10-17T22:41:23.436543] [INFO ] [MAIN ] MED: Loaded 21503 primary data records. [2025-10-17T22:41:23.820054] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:23.852822] [INFO ] [MAIN ] MDV: Generated 1820 derivative records from 8524 primary records. [2025-10-17T22:41:23.870859] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-17T22:41:24.029783] [DEBUG] [LOCAL ] MDV: Derivative data saved (1820 records). [2025-10-17T22:41:24.031480] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-17T22:41:24.034484] [INFO ] [MAIN ] Derivative Progress: 1144/2083 symbols completed. MDV took 1.2s. Estimated remaining: 5m 57s. Rate: 158.0 symbols/min [2025-10-17T22:41:24.034666] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:24.075766] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:24.076486] [INFO ] [MAIN ] MED: Generated 1820 derivative records from 21503 primary records. [2025-10-17T22:41:24.076550] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-17T22:41:24.091052] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:24.102618] [INFO ] [MAIN ] MEC: Generated 1820 derivative records from 16672 primary records. [2025-10-17T22:41:24.103200] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-17T22:41:24.108771] [DEBUG] [LOCAL ] MED: Derivative data saved (1820 records). [2025-10-17T22:41:24.118627] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-17T22:41:24.121289] [INFO ] [MAIN ] Derivative Progress: 1145/2083 symbols completed. MED took 0.9s. Estimated remaining: 5m 56s. Rate: 158.1 symbols/min [2025-10-17T22:41:24.131241] [DEBUG] [LOCAL ] MEG: Loaded 32094 existing records from primary storage. [2025-10-17T22:41:24.129826] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:24.134999] [INFO ] [MAIN ] MEG: Loaded 32094 primary data records. [2025-10-17T22:41:24.152007] [DEBUG] [LOCAL ] MEC: Derivative data saved (1820 records). [2025-10-17T22:41:24.163673] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-17T22:41:24.176531] [INFO ] [MAIN ] Derivative Progress: 1146/2083 symbols completed. MEC took 1.1s. Estimated remaining: 5m 55s. Rate: 158.2 symbols/min [2025-10-17T22:41:24.181860] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:24.317744] [DEBUG] [LOCAL ] MEGI: Loaded 20099 existing records from primary storage. [2025-10-17T22:41:24.343839] [INFO ] [MAIN ] MEGI: Loaded 20099 primary data records. [2025-10-17T22:41:24.603173] [DEBUG] [LOCAL ] MEI: Loaded 32083 existing records from primary storage. [2025-10-17T22:41:24.603862] [INFO ] [MAIN ] MEI: Loaded 32083 primary data records. [2025-10-17T22:41:25.132747] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:25.134442] [INFO ] [MAIN ] MEG: Generated 1820 derivative records from 32094 primary records. [2025-10-17T22:41:25.134604] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-17T22:41:25.155393] [DEBUG] [LOCAL ] MEG: Derivative data saved (1820 records). [2025-10-17T22:41:25.155871] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-17T22:41:25.158552] [INFO ] [MAIN ] Derivative Progress: 1147/2083 symbols completed. MEG took 1.1s. Estimated remaining: 5m 55s. Rate: 158.0 symbols/min [2025-10-17T22:41:25.159111] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:25.177738] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:25.178582] [INFO ] [MAIN ] MEGI: Generated 1820 derivative records from 20099 primary records. [2025-10-17T22:41:25.178851] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-17T22:41:25.212767] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1820 records). [2025-10-17T22:41:25.213149] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:25.213405] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-17T22:41:25.216090] [INFO ] [MAIN ] Derivative Progress: 1148/2083 symbols completed. MEGI took 1.1s. Estimated remaining: 5m 55s. Rate: 158.1 symbols/min [2025-10-17T22:41:25.217003] [INFO ] [MAIN ] MEI: Generated 1820 derivative records from 32083 primary records. [2025-10-17T22:41:25.217179] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-17T22:41:25.217427] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:25.249573] [DEBUG] [LOCAL ] MEI: Derivative data saved (1820 records). [2025-10-17T22:41:25.249749] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-17T22:41:25.251942] [INFO ] [MAIN ] Derivative Progress: 1149/2083 symbols completed. MEI took 1.1s. Estimated remaining: 5m 54s. Rate: 158.3 symbols/min [2025-10-17T22:41:25.252188] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:25.271523] [DEBUG] [LOCAL ] MET: Loaded 54096 existing records from primary storage. [2025-10-17T22:41:25.274272] [DEBUG] [LOCAL ] MFAN: Loaded 4421 existing records from primary storage. [2025-10-17T22:41:25.274491] [INFO ] [MAIN ] MET: Loaded 54096 primary data records. [2025-10-17T22:41:25.274431] [INFO ] [MAIN ] MFAN: Loaded 4421 primary data records. [2025-10-17T22:41:25.638332] [DEBUG] [LOCAL ] MFA: Loaded 46378 existing records from primary storage. [2025-10-17T22:41:25.777255] [INFO ] [MAIN ] MFA: Loaded 46378 primary data records. [2025-10-17T22:41:26.289279] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:26.295074] [INFO ] [MAIN ] MET: Generated 1820 derivative records from 54096 primary records. [2025-10-17T22:41:26.295966] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-17T22:41:26.295891] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:41:26.296638] [INFO ] [MAIN ] MFAN: Generated 1819 derivative records from 4421 primary records. [2025-10-17T22:41:26.296763] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-17T22:41:26.328681] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1819 records). [2025-10-17T22:41:26.330275] [DEBUG] [LOCAL ] MET: Derivative data saved (1820 records). [2025-10-17T22:41:26.330494] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-17T22:41:26.332742] [INFO ] [MAIN ] Derivative Progress: 1150/2083 symbols completed. MFAN took 1.1s. Estimated remaining: 5m 54s. Rate: 158.0 symbols/min [2025-10-17T22:41:26.333025] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:26.334028] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-17T22:41:26.337305] [INFO ] [MAIN ] Derivative Progress: 1151/2083 symbols completed. MET took 1.2s. Estimated remaining: 5m 54s. Rate: 158.1 symbols/min [2025-10-17T22:41:26.337670] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:26.342932] [DEBUG] [LOCAL ] MFAO: Loaded 4021 existing records from primary storage. [2025-10-17T22:41:26.343282] [INFO ] [MAIN ] MFAO: Loaded 4021 primary data records. [2025-10-17T22:41:26.484491] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:26.519778] [INFO ] [MAIN ] MFA: Generated 1820 derivative records from 46378 primary records. [2025-10-17T22:41:26.536522] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-17T22:41:26.715315] [DEBUG] [LOCAL ] MFA: Derivative data saved (1820 records). [2025-10-17T22:41:26.716344] [DEBUG] [LOCAL ] MFC: Loaded 51852 existing records from primary storage. [2025-10-17T22:41:26.716530] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-17T22:41:26.717346] [INFO ] [MAIN ] MFC: Loaded 51852 primary data records. [2025-10-17T22:41:26.721610] [INFO ] [MAIN ] Derivative Progress: 1152/2083 symbols completed. MFA took 1.5s. Estimated remaining: 5m 53s. Rate: 158.1 symbols/min [2025-10-17T22:41:26.743476] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:27.048777] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:41:27.050371] [INFO ] [MAIN ] MFAO: Generated 1819 derivative records from 4021 primary records. [2025-10-17T22:41:27.050699] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-17T22:41:27.067870] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1819 records). [2025-10-17T22:41:27.081131] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-17T22:41:27.085519] [INFO ] [MAIN ] Derivative Progress: 1153/2083 symbols completed. MFAO took 0.8s. Estimated remaining: 5m 53s. Rate: 158.1 symbols/min [2025-10-17T22:41:27.089558] [DEBUG] [LOCAL ] MFG: Loaded 50230 existing records from primary storage. [2025-10-17T22:41:27.089697] [INFO ] [MAIN ] MFG: Loaded 50230 primary data records. [2025-10-17T22:41:27.309440] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:27.388674] [INFO ] [MAIN ] MFC: Generated 1820 derivative records from 51852 primary records. [2025-10-17T22:41:27.402049] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-17T22:41:27.420941] [DEBUG] [LOCAL ] MFC: Derivative data saved (1820 records). [2025-10-17T22:41:27.421362] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-17T22:41:27.423994] [INFO ] [MAIN ] Derivative Progress: 1154/2083 symbols completed. MFC took 1.1s. Estimated remaining: 5m 52s. Rate: 158.2 symbols/min [2025-10-17T22:41:27.443384] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:27.444112] [INFO ] [MAIN ] MFG: Generated 1820 derivative records from 50230 primary records. [2025-10-17T22:41:27.444174] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-17T22:41:27.460029] [DEBUG] [LOCAL ] MFG: Derivative data saved (1820 records). [2025-10-17T22:41:27.460112] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-17T22:41:27.462698] [INFO ] [MAIN ] Derivative Progress: 1155/2083 symbols completed. MFG took 0.7s. Estimated remaining: 5m 52s. Rate: 158.3 symbols/min [2025-10-17T22:41:27.463422] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:27.463783] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:27.463694] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:27.485881] [DEBUG] [LOCAL ] MFSI: Loaded 12436 existing records from primary storage. [2025-10-17T22:41:27.490762] [INFO ] [MAIN ] MFSI: Loaded 12436 primary data records. [2025-10-17T22:41:27.491077] [DEBUG] [LOCAL ] MFM: Loaded 14700 existing records from primary storage. [2025-10-17T22:41:27.480743] [DEBUG] [LOCAL ] MFSG: Loaded 5881 existing records from primary storage. [2025-10-17T22:41:27.502406] [INFO ] [MAIN ] MFSG: Loaded 5881 primary data records. [2025-10-17T22:41:27.502506] [INFO ] [MAIN ] MFM: Loaded 14700 primary data records. [2025-10-17T22:41:28.463208] [DEBUG] [MAIN ] MFSI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:41:28.466447] [INFO ] [MAIN ] MFSI: Generated 1819 derivative records from 12436 primary records. [2025-10-17T22:41:28.468101] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-17T22:41:28.493083] [DEBUG] [MAIN ] MFSG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:28.505195] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1819 records). [2025-10-17T22:41:28.506185] [INFO ] [MAIN ] MFSG: Generated 1820 derivative records from 5881 primary records. [2025-10-17T22:41:28.505342] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-17T22:41:28.513371] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-17T22:41:28.508558] [INFO ] [MAIN ] Derivative Progress: 1156/2083 symbols completed. MFSI took 1.0s. Estimated remaining: 5m 52s. Rate: 158.0 symbols/min [2025-10-17T22:41:28.513998] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:28.516299] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:28.523869] [INFO ] [MAIN ] MFM: Generated 1820 derivative records from 14700 primary records. [2025-10-17T22:41:28.525507] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-17T22:41:28.532532] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1820 records). [2025-10-17T22:41:28.534104] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-17T22:41:28.546911] [INFO ] [MAIN ] Derivative Progress: 1157/2083 symbols completed. MFSG took 1.1s. Estimated remaining: 5m 51s. Rate: 158.2 symbols/min [2025-10-17T22:41:28.551270] [DEBUG] [LOCAL ] MFM: Derivative data saved (1820 records). [2025-10-17T22:41:28.549767] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:28.551765] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-17T22:41:28.556912] [DEBUG] [LOCAL ] MFSV: Loaded 2916 existing records from primary storage. [2025-10-17T22:41:28.554414] [INFO ] [MAIN ] Derivative Progress: 1158/2083 symbols completed. MFM took 1.1s. Estimated remaining: 5m 51s. Rate: 158.3 symbols/min [2025-10-17T22:41:28.557267] [INFO ] [MAIN ] MFSV: Loaded 2916 primary data records. [2025-10-17T22:41:28.557196] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:28.670469] [DEBUG] [LOCAL ] MG: Loaded 16048 existing records from primary storage. [2025-10-17T22:41:28.681480] [INFO ] [MAIN ] MG: Loaded 16048 primary data records. [2025-10-17T22:41:29.037825] [DEBUG] [LOCAL ] MGA: Loaded 51244 existing records from primary storage. [2025-10-17T22:41:29.076674] [INFO ] [MAIN ] MGA: Loaded 51244 primary data records. [2025-10-17T22:41:29.568548] [DEBUG] [MAIN ] MFSV: Filtered 7001 bins outside market hours, 7796 incomplete bins [2025-10-17T22:41:29.570515] [INFO ] [MAIN ] MFSV: Generated 1818 derivative records from 2916 primary records. [2025-10-17T22:41:29.571017] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-17T22:41:29.587975] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1818 records). [2025-10-17T22:41:29.589546] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-17T22:41:29.591914] [INFO ] [MAIN ] Derivative Progress: 1159/2083 symbols completed. MFSV took 1.1s. Estimated remaining: 5m 51s. Rate: 158.1 symbols/min [2025-10-17T22:41:29.592209] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:29.608597] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:29.611734] [DEBUG] [LOCAL ] MGF: Loaded 4196 existing records from primary storage. [2025-10-17T22:41:29.612679] [INFO ] [MAIN ] MG: Generated 1820 derivative records from 16048 primary records. [2025-10-17T22:41:29.612902] [INFO ] [MAIN ] MGF: Loaded 4196 primary data records. [2025-10-17T22:41:29.612993] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-17T22:41:29.671142] [DEBUG] [LOCAL ] MG: Derivative data saved (1820 records). [2025-10-17T22:41:29.671362] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-17T22:41:29.707735] [INFO ] [MAIN ] Derivative Progress: 1160/2083 symbols completed. MG took 1.2s. Estimated remaining: 5m 50s. Rate: 158.2 symbols/min [2025-10-17T22:41:29.718386] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:29.935674] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:29.942001] [INFO ] [MAIN ] MGA: Generated 1820 derivative records from 51244 primary records. [2025-10-17T22:41:29.950837] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-17T22:41:29.970596] [DEBUG] [LOCAL ] MGA: Derivative data saved (1820 records). [2025-10-17T22:41:29.970930] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-17T22:41:29.974366] [INFO ] [MAIN ] Derivative Progress: 1161/2083 symbols completed. MGA took 1.4s. Estimated remaining: 5m 50s. Rate: 158.2 symbols/min [2025-10-17T22:41:29.974831] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:29.984450] [DEBUG] [LOCAL ] MGR: Loaded 5666 existing records from primary storage. [2025-10-17T22:41:30.005414] [INFO ] [MAIN ] MGR: Loaded 5666 primary data records. [2025-10-17T22:41:30.151055] [DEBUG] [LOCAL ] MGM: Loaded 54387 existing records from primary storage. [2025-10-17T22:41:30.178280] [INFO ] [MAIN ] MGM: Loaded 54387 primary data records. [2025-10-17T22:41:30.234993] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:30.411050] [INFO ] [MAIN ] MGF: Generated 1820 derivative records from 4196 primary records. [2025-10-17T22:41:30.422898] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-17T22:41:30.646353] [DEBUG] [LOCAL ] MGF: Derivative data saved (1820 records). [2025-10-17T22:41:30.656800] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-17T22:41:30.659145] [INFO ] [MAIN ] Derivative Progress: 1162/2083 symbols completed. MGF took 1.1s. Estimated remaining: 5m 50s. Rate: 158.1 symbols/min [2025-10-17T22:41:30.659297] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:30.667344] [DEBUG] [LOCAL ] MGRB: Loaded 4058 existing records from primary storage. [2025-10-17T22:41:30.667761] [INFO ] [MAIN ] MGRB: Loaded 4058 primary data records. [2025-10-17T22:41:30.803916] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:30.810254] [INFO ] [MAIN ] MGR: Generated 1820 derivative records from 5666 primary records. [2025-10-17T22:41:30.829826] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-17T22:41:30.991192] [DEBUG] [LOCAL ] MGR: Derivative data saved (1820 records). [2025-10-17T22:41:31.005632] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-17T22:41:31.008818] [INFO ] [MAIN ] Derivative Progress: 1163/2083 symbols completed. MGR took 1.0s. Estimated remaining: 5m 49s. Rate: 158.1 symbols/min [2025-10-17T22:41:31.009157] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:31.025928] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:31.027215] [INFO ] [MAIN ] MGM: Generated 1820 derivative records from 54387 primary records. [2025-10-17T22:41:31.029909] [DEBUG] [LOCAL ] MGRD: Loaded 2248 existing records from primary storage. [2025-10-17T22:41:31.027602] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-17T22:41:31.030984] [INFO ] [MAIN ] MGRD: Loaded 2248 primary data records. [2025-10-17T22:41:31.125739] [DEBUG] [LOCAL ] MGM: Derivative data saved (1820 records). [2025-10-17T22:41:31.136779] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-17T22:41:31.144756] [INFO ] [MAIN ] Derivative Progress: 1164/2083 symbols completed. MGM took 1.4s. Estimated remaining: 5m 49s. Rate: 158.2 symbols/min [2025-10-17T22:41:31.156537] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:31.242402] [DEBUG] [LOCAL ] MGRE: Loaded 6619 existing records from primary storage. [2025-10-17T22:41:31.393034] [INFO ] [MAIN ] MGRE: Loaded 6619 primary data records. [2025-10-17T22:41:31.516994] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:31.534320] [INFO ] [MAIN ] MGRB: Generated 1820 derivative records from 4058 primary records. [2025-10-17T22:41:31.534428] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-17T22:41:31.733105] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1820 records). [2025-10-17T22:41:31.741871] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-17T22:41:31.744232] [INFO ] [MAIN ] Derivative Progress: 1165/2083 symbols completed. MGRB took 1.1s. Estimated remaining: 5m 48s. Rate: 158.1 symbols/min [2025-10-17T22:41:31.744423] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:31.767505] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:31.768383] [INFO ] [MAIN ] MGRD: Generated 1820 derivative records from 2248 primary records. [2025-10-17T22:41:31.768563] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-17T22:41:31.784148] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1820 records). [2025-10-17T22:41:31.784301] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-17T22:41:31.786769] [INFO ] [MAIN ] Derivative Progress: 1166/2083 symbols completed. MGRD took 0.8s. Estimated remaining: 5m 48s. Rate: 158.2 symbols/min [2025-10-17T22:41:31.787433] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:31.818900] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:31.819608] [INFO ] [MAIN ] MGRE: Generated 1820 derivative records from 6619 primary records. [2025-10-17T22:41:31.822047] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-17T22:41:31.837604] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1820 records). [2025-10-17T22:41:31.847961] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-17T22:41:31.847811] [DEBUG] [LOCAL ] MHD: Loaded 12323 existing records from primary storage. [2025-10-17T22:41:31.865869] [INFO ] [MAIN ] MHD: Loaded 12323 primary data records. [2025-10-17T22:41:31.850366] [INFO ] [MAIN ] Derivative Progress: 1167/2083 symbols completed. MGRE took 0.7s. Estimated remaining: 5m 47s. Rate: 158.3 symbols/min [2025-10-17T22:41:31.921620] [DEBUG] [LOCAL ] MGY: Loaded 53185 existing records from primary storage. [2025-10-17T22:41:31.919941] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:31.934212] [INFO ] [MAIN ] MGY: Loaded 53185 primary data records. [2025-10-17T22:41:32.157116] [DEBUG] [LOCAL ] MHF: Loaded 9100 existing records from primary storage. [2025-10-17T22:41:32.162149] [INFO ] [MAIN ] MHF: Loaded 9100 primary data records. [2025-10-17T22:41:32.802293] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:32.804439] [INFO ] [MAIN ] MHD: Generated 1820 derivative records from 12323 primary records. [2025-10-17T22:41:32.804818] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-17T22:41:32.831797] [DEBUG] [LOCAL ] MHD: Derivative data saved (1820 records). [2025-10-17T22:41:32.836670] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-17T22:41:32.840024] [INFO ] [MAIN ] Derivative Progress: 1168/2083 symbols completed. MHD took 1.1s. Estimated remaining: 5m 47s. Rate: 158.1 symbols/min [2025-10-17T22:41:32.837196] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:32.842225] [INFO ] [MAIN ] MGY: Generated 1820 derivative records from 53185 primary records. [2025-10-17T22:41:32.842406] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-17T22:41:32.864471] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:32.867831] [INFO ] [MAIN ] MHF: Generated 1820 derivative records from 9100 primary records. [2025-10-17T22:41:32.870442] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-17T22:41:32.872517] [DEBUG] [LOCAL ] MGY: Derivative data saved (1820 records). [2025-10-17T22:41:32.872772] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-17T22:41:32.875088] [INFO ] [MAIN ] Derivative Progress: 1169/2083 symbols completed. MGY took 1.1s. Estimated remaining: 5m 47s. Rate: 158.2 symbols/min [2025-10-17T22:41:32.888826] [DEBUG] [LOCAL ] MHF: Derivative data saved (1820 records). [2025-10-17T22:41:32.888884] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-17T22:41:32.890919] [INFO ] [MAIN ] Derivative Progress: 1170/2083 symbols completed. MHF took 1.0s. Estimated remaining: 5m 46s. Rate: 158.4 symbols/min [2025-10-17T22:41:32.891402] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:32.891327] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:32.891473] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:32.901080] [DEBUG] [LOCAL ] MHN: Loaded 7574 existing records from primary storage. [2025-10-17T22:41:32.901373] [INFO ] [MAIN ] MHN: Loaded 7574 primary data records. [2025-10-17T22:41:33.081007] [DEBUG] [LOCAL ] MHO: Loaded 24095 existing records from primary storage. [2025-10-17T22:41:33.082187] [INFO ] [MAIN ] MHO: Loaded 24095 primary data records. [2025-10-17T22:41:33.321041] [DEBUG] [LOCAL ] MHK: Loaded 42681 existing records from primary storage. [2025-10-17T22:41:33.332465] [INFO ] [MAIN ] MHK: Loaded 42681 primary data records. [2025-10-17T22:41:33.886125] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:33.887373] [INFO ] [MAIN ] MHN: Generated 1820 derivative records from 7574 primary records. [2025-10-17T22:41:33.887565] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-17T22:41:33.917129] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:33.918623] [INFO ] [MAIN ] MHO: Generated 1820 derivative records from 24095 primary records. [2025-10-17T22:41:33.918825] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-17T22:41:33.923793] [DEBUG] [LOCAL ] MHN: Derivative data saved (1820 records). [2025-10-17T22:41:33.923951] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-17T22:41:33.934556] [INFO ] [MAIN ] Derivative Progress: 1171/2083 symbols completed. MHN took 1.0s. Estimated remaining: 5m 46s. Rate: 158.1 symbols/min [2025-10-17T22:41:33.937499] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:33.949624] [DEBUG] [LOCAL ] MHO: Derivative data saved (1820 records). [2025-10-17T22:41:33.954561] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-17T22:41:33.956943] [INFO ] [MAIN ] Derivative Progress: 1172/2083 symbols completed. MHO took 1.1s. Estimated remaining: 5m 45s. Rate: 158.3 symbols/min [2025-10-17T22:41:33.954787] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:33.957892] [INFO ] [MAIN ] MHK: Generated 1820 derivative records from 42681 primary records. [2025-10-17T22:41:33.958044] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:33.958538] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-17T22:41:33.979251] [DEBUG] [LOCAL ] MHK: Derivative data saved (1820 records). [2025-10-17T22:41:33.979423] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-17T22:41:33.982520] [INFO ] [MAIN ] Derivative Progress: 1173/2083 symbols completed. MHK took 1.1s. Estimated remaining: 5m 45s. Rate: 158.4 symbols/min [2025-10-17T22:41:33.987780] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:33.988476] [DEBUG] [LOCAL ] MIN: Loaded 14068 existing records from primary storage. [2025-10-17T22:41:33.988722] [INFO ] [MAIN ] MIN: Loaded 14068 primary data records. [2025-10-17T22:41:34.061938] [DEBUG] [LOCAL ] MITP: Loaded 2336 existing records from primary storage. [2025-10-17T22:41:34.093722] [INFO ] [MAIN ] MITP: Loaded 2336 primary data records. [2025-10-17T22:41:34.480595] [DEBUG] [LOCAL ] MIR: Loaded 52051 existing records from primary storage. [2025-10-17T22:41:34.506534] [INFO ] [MAIN ] MIR: Loaded 52051 primary data records. [2025-10-17T22:41:34.971127] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:34.972764] [INFO ] [MAIN ] MIN: Generated 1820 derivative records from 14068 primary records. [2025-10-17T22:41:34.972918] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-17T22:41:34.990786] [DEBUG] [LOCAL ] MIN: Derivative data saved (1820 records). [2025-10-17T22:41:34.992292] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-17T22:41:34.996522] [INFO ] [MAIN ] Derivative Progress: 1174/2083 symbols completed. MIN took 1.1s. Estimated remaining: 5m 45s. Rate: 158.2 symbols/min [2025-10-17T22:41:34.996895] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:35.012166] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7797 incomplete bins [2025-10-17T22:41:35.013231] [INFO ] [MAIN ] MITP: Generated 1817 derivative records from 2336 primary records. [2025-10-17T22:41:35.013464] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-17T22:41:35.029071] [DEBUG] [LOCAL ] MITP: Derivative data saved (1817 records). [2025-10-17T22:41:35.035025] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-10-17T22:41:35.037336] [INFO ] [MAIN ] Derivative Progress: 1175/2083 symbols completed. MITP took 1.0s. Estimated remaining: 5m 44s. Rate: 158.3 symbols/min [2025-10-17T22:41:35.037768] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:35.051306] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:35.052163] [INFO ] [MAIN ] MIR: Generated 1820 derivative records from 52051 primary records. [2025-10-17T22:41:35.059979] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-17T22:41:35.061334] [DEBUG] [LOCAL ] MITT: Loaded 22934 existing records from primary storage. [2025-10-17T22:41:35.063183] [INFO ] [MAIN ] MITT: Loaded 22934 primary data records. [2025-10-17T22:41:35.116938] [DEBUG] [LOCAL ] MIY: Loaded 6335 existing records from primary storage. [2025-10-17T22:41:35.127481] [INFO ] [MAIN ] MIY: Loaded 6335 primary data records. [2025-10-17T22:41:35.234504] [DEBUG] [LOCAL ] MIR: Derivative data saved (1820 records). [2025-10-17T22:41:35.284250] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-17T22:41:35.296022] [INFO ] [MAIN ] Derivative Progress: 1176/2083 symbols completed. MIR took 1.3s. Estimated remaining: 5m 44s. Rate: 158.3 symbols/min [2025-10-17T22:41:35.349260] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:35.790367] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:35.791716] [INFO ] [MAIN ] MITT: Generated 1820 derivative records from 22934 primary records. [2025-10-17T22:41:35.804493] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-17T22:41:35.818946] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:35.821675] [INFO ] [MAIN ] MIY: Generated 1820 derivative records from 6335 primary records. [2025-10-17T22:41:35.823116] [DEBUG] [LOCAL ] MKC: Loaded 53279 existing records from primary storage. [2025-10-17T22:41:35.830185] [INFO ] [MAIN ] MKC: Loaded 53279 primary data records. [2025-10-17T22:41:35.822036] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-17T22:41:35.838559] [DEBUG] [LOCAL ] MITT: Derivative data saved (1820 records). [2025-10-17T22:41:35.850033] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-17T22:41:35.872836] [INFO ] [MAIN ] Derivative Progress: 1177/2083 symbols completed. MITT took 0.9s. Estimated remaining: 5m 43s. Rate: 158.3 symbols/min [2025-10-17T22:41:35.878229] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:35.922133] [DEBUG] [LOCAL ] MIY: Derivative data saved (1820 records). [2025-10-17T22:41:35.927543] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-17T22:41:35.962957] [INFO ] [MAIN ] Derivative Progress: 1178/2083 symbols completed. MIY took 0.9s. Estimated remaining: 5m 43s. Rate: 158.4 symbols/min [2025-10-17T22:41:35.983854] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:36.187445] [DEBUG] [LOCAL ] MKL: Loaded 34581 existing records from primary storage. [2025-10-17T22:41:36.187751] [INFO ] [MAIN ] MKL: Loaded 34581 primary data records. [2025-10-17T22:41:36.544363] [DEBUG] [LOCAL ] MLI: Loaded 44088 existing records from primary storage. [2025-10-17T22:41:36.547064] [INFO ] [MAIN ] MLI: Loaded 44088 primary data records. [2025-10-17T22:41:36.676286] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:36.698594] [INFO ] [MAIN ] MKC: Generated 1820 derivative records from 53279 primary records. [2025-10-17T22:41:36.758924] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-17T22:41:36.903986] [DEBUG] [LOCAL ] MKC: Derivative data saved (1820 records). [2025-10-17T22:41:36.904635] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-17T22:41:36.907977] [INFO ] [MAIN ] Derivative Progress: 1179/2083 symbols completed. MKC took 1.6s. Estimated remaining: 5m 43s. Rate: 158.2 symbols/min [2025-10-17T22:41:36.908355] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:36.933017] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:36.933908] [INFO ] [MAIN ] MKL: Generated 1820 derivative records from 34581 primary records. [2025-10-17T22:41:36.934097] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-17T22:41:36.959503] [DEBUG] [LOCAL ] MKL: Derivative data saved (1820 records). [2025-10-17T22:41:36.959962] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-17T22:41:36.962332] [INFO ] [MAIN ] Derivative Progress: 1180/2083 symbols completed. MKL took 1.1s. Estimated remaining: 5m 42s. Rate: 158.3 symbols/min [2025-10-17T22:41:36.963357] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:36.976231] [DEBUG] [LOCAL ] MLM: Loaded 29602 existing records from primary storage. [2025-10-17T22:41:36.976597] [INFO ] [MAIN ] MLM: Loaded 29602 primary data records. [2025-10-17T22:41:37.032915] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:37.039362] [INFO ] [MAIN ] MLI: Generated 1820 derivative records from 44088 primary records. [2025-10-17T22:41:37.081031] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-17T22:41:37.204588] [DEBUG] [LOCAL ] MLNK: Loaded 27410 existing records from primary storage. [2025-10-17T22:41:37.353376] [INFO ] [MAIN ] MLNK: Loaded 27410 primary data records. [2025-10-17T22:41:37.468184] [DEBUG] [LOCAL ] MLI: Derivative data saved (1820 records). [2025-10-17T22:41:37.471995] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-17T22:41:37.484846] [INFO ] [MAIN ] Derivative Progress: 1181/2083 symbols completed. MLI took 1.5s. Estimated remaining: 5m 42s. Rate: 158.2 symbols/min [2025-10-17T22:41:37.485154] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:37.677146] [DEBUG] [LOCAL ] MLP: Loaded 3109 existing records from primary storage. [2025-10-17T22:41:37.677631] [INFO ] [MAIN ] MLP: Loaded 3109 primary data records. [2025-10-17T22:41:38.018511] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:38.019332] [INFO ] [MAIN ] MLM: Generated 1820 derivative records from 29602 primary records. [2025-10-17T22:41:38.019499] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-17T22:41:38.037732] [DEBUG] [LOCAL ] MLM: Derivative data saved (1820 records). [2025-10-17T22:41:38.038500] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-17T22:41:38.040800] [INFO ] [MAIN ] Derivative Progress: 1182/2083 symbols completed. MLM took 1.1s. Estimated remaining: 5m 42s. Rate: 158.2 symbols/min [2025-10-17T22:41:38.040974] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:38.062887] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:38.063708] [INFO ] [MAIN ] MLNK: Generated 1820 derivative records from 27410 primary records. [2025-10-17T22:41:38.063921] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-17T22:41:38.080786] [DEBUG] [LOCAL ] MLR: Loaded 12610 existing records from primary storage. [2025-10-17T22:41:38.081369] [INFO ] [MAIN ] MLR: Loaded 12610 primary data records. [2025-10-17T22:41:38.115721] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1820 records). [2025-10-17T22:41:38.127469] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-10-17T22:41:38.149863] [INFO ] [MAIN ] Derivative Progress: 1183/2083 symbols completed. MLNK took 1.2s. Estimated remaining: 5m 41s. Rate: 158.3 symbols/min [2025-10-17T22:41:38.223790] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:38.241854] [INFO ] [MAIN ] MLP: Generated 1820 derivative records from 3109 primary records. [2025-10-17T22:41:38.250284] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-17T22:41:38.409044] [DEBUG] [LOCAL ] MLP: Derivative data saved (1820 records). [2025-10-17T22:41:38.409536] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-17T22:41:38.411859] [INFO ] [MAIN ] Derivative Progress: 1184/2083 symbols completed. MLP took 0.9s. Estimated remaining: 5m 41s. Rate: 158.3 symbols/min [2025-10-17T22:41:38.431426] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:38.432039] [INFO ] [MAIN ] MLR: Generated 1820 derivative records from 12610 primary records. [2025-10-17T22:41:38.432103] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-17T22:41:38.447300] [DEBUG] [LOCAL ] MLR: Derivative data saved (1820 records). [2025-10-17T22:41:38.447361] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-17T22:41:38.449693] [INFO ] [MAIN ] Derivative Progress: 1185/2083 symbols completed. MLR took 0.4s. Estimated remaining: 5m 40s. Rate: 158.4 symbols/min [2025-10-17T22:41:38.450176] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:38.450279] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:38.450112] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:38.468578] [DEBUG] [LOCAL ] MMD: Loaded 11032 existing records from primary storage. [2025-10-17T22:41:38.468733] [INFO ] [MAIN ] MMD: Loaded 11032 primary data records. [2025-10-17T22:41:38.516144] [DEBUG] [LOCAL ] MMI: Loaded 15785 existing records from primary storage. [2025-10-17T22:41:38.547467] [INFO ] [MAIN ] MMI: Loaded 15785 primary data records. [2025-10-17T22:41:39.180874] [DEBUG] [LOCAL ] MMC: Loaded 52707 existing records from primary storage. [2025-10-17T22:41:39.181316] [INFO ] [MAIN ] MMC: Loaded 52707 primary data records. [2025-10-17T22:41:39.526873] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:39.530194] [INFO ] [MAIN ] MMD: Generated 1820 derivative records from 11032 primary records. [2025-10-17T22:41:39.530476] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-17T22:41:39.558948] [DEBUG] [LOCAL ] MMD: Derivative data saved (1820 records). [2025-10-17T22:41:39.559301] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:39.559429] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-17T22:41:39.560181] [INFO ] [MAIN ] MMI: Generated 1820 derivative records from 15785 primary records. [2025-10-17T22:41:39.561110] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-17T22:41:39.563575] [INFO ] [MAIN ] Derivative Progress: 1186/2083 symbols completed. MMD took 1.1s. Estimated remaining: 5m 40s. Rate: 158.2 symbols/min [2025-10-17T22:41:39.564603] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:39.581480] [DEBUG] [LOCAL ] MMI: Derivative data saved (1820 records). [2025-10-17T22:41:39.581576] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-17T22:41:39.583882] [INFO ] [MAIN ] Derivative Progress: 1187/2083 symbols completed. MMI took 1.1s. Estimated remaining: 5m 40s. Rate: 158.3 symbols/min [2025-10-17T22:41:39.584157] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:39.601269] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:39.601916] [INFO ] [MAIN ] MMC: Generated 1820 derivative records from 52707 primary records. [2025-10-17T22:41:39.601976] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-17T22:41:39.618995] [DEBUG] [LOCAL ] MMC: Derivative data saved (1820 records). [2025-10-17T22:41:39.619303] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-17T22:41:39.621475] [INFO ] [MAIN ] Derivative Progress: 1188/2083 symbols completed. MMC took 1.2s. Estimated remaining: 5m 39s. Rate: 158.4 symbols/min [2025-10-17T22:41:39.621760] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:39.652806] [DEBUG] [LOCAL ] MMT: Loaded 10420 existing records from primary storage. [2025-10-17T22:41:39.652942] [INFO ] [MAIN ] MMT: Loaded 10420 primary data records. [2025-10-17T22:41:39.756066] [DEBUG] [LOCAL ] MMS: Loaded 34279 existing records from primary storage. [2025-10-17T22:41:39.819853] [DEBUG] [LOCAL ] MMM: Loaded 53890 existing records from primary storage. [2025-10-17T22:41:39.806681] [INFO ] [MAIN ] MMS: Loaded 34279 primary data records. [2025-10-17T22:41:39.857053] [INFO ] [MAIN ] MMM: Loaded 53890 primary data records. [2025-10-17T22:41:40.594625] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:40.595424] [INFO ] [MAIN ] MMT: Generated 1820 derivative records from 10420 primary records. [2025-10-17T22:41:40.595790] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-17T22:41:40.612223] [DEBUG] [LOCAL ] MMT: Derivative data saved (1820 records). [2025-10-17T22:41:40.612329] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-17T22:41:40.614435] [INFO ] [MAIN ] Derivative Progress: 1189/2083 symbols completed. MMT took 1.0s. Estimated remaining: 5m 39s. Rate: 158.2 symbols/min [2025-10-17T22:41:40.614710] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:40.631101] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:40.632612] [INFO ] [MAIN ] MMM: Generated 1820 derivative records from 53890 primary records. [2025-10-17T22:41:40.638020] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-17T22:41:40.667763] [DEBUG] [LOCAL ] MMU: Loaded 16787 existing records from primary storage. [2025-10-17T22:41:40.669917] [INFO ] [MAIN ] MMU: Loaded 16787 primary data records. [2025-10-17T22:41:40.671000] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:40.672895] [DEBUG] [LOCAL ] MMM: Derivative data saved (1820 records). [2025-10-17T22:41:40.673639] [INFO ] [MAIN ] MMS: Generated 1820 derivative records from 34279 primary records. [2025-10-17T22:41:40.693727] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-17T22:41:40.705760] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-17T22:41:40.705689] [INFO ] [MAIN ] Derivative Progress: 1190/2083 symbols completed. MMM took 1.1s. Estimated remaining: 5m 38s. Rate: 158.3 symbols/min [2025-10-17T22:41:40.749832] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:40.797615] [DEBUG] [LOCAL ] MMS: Derivative data saved (1820 records). [2025-10-17T22:41:40.813991] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-17T22:41:40.842887] [INFO ] [MAIN ] Derivative Progress: 1191/2083 symbols completed. MMS took 1.3s. Estimated remaining: 5m 38s. Rate: 158.4 symbols/min [2025-10-17T22:41:40.930765] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:41.017850] [DEBUG] [LOCAL ] MNR: Loaded 25302 existing records from primary storage. [2025-10-17T22:41:41.018306] [INFO ] [MAIN ] MNR: Loaded 25302 primary data records. [2025-10-17T22:41:41.368987] [DEBUG] [LOCAL ] MNSO: Loaded 44819 existing records from primary storage. [2025-10-17T22:41:41.370296] [INFO ] [MAIN ] MNSO: Loaded 44819 primary data records. [2025-10-17T22:41:41.490171] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:41.496930] [INFO ] [MAIN ] MMU: Generated 1820 derivative records from 16787 primary records. [2025-10-17T22:41:41.507914] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-17T22:41:41.699202] [DEBUG] [LOCAL ] MMU: Derivative data saved (1820 records). [2025-10-17T22:41:41.699678] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-17T22:41:41.701763] [INFO ] [MAIN ] Derivative Progress: 1192/2083 symbols completed. MMU took 1.1s. Estimated remaining: 5m 38s. Rate: 158.2 symbols/min [2025-10-17T22:41:41.701933] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:41.720429] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:41.721192] [INFO ] [MAIN ] MNR: Generated 1820 derivative records from 25302 primary records. [2025-10-17T22:41:41.721316] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-17T22:41:41.739285] [DEBUG] [LOCAL ] MNR: Derivative data saved (1820 records). [2025-10-17T22:41:41.739446] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-17T22:41:41.741559] [INFO ] [MAIN ] Derivative Progress: 1193/2083 symbols completed. MNR took 1.0s. Estimated remaining: 5m 37s. Rate: 158.3 symbols/min [2025-10-17T22:41:41.741748] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:41.770209] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:41.770986] [INFO ] [MAIN ] MNSO: Generated 1820 derivative records from 44819 primary records. [2025-10-17T22:41:41.771117] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-17T22:41:41.787936] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1820 records). [2025-10-17T22:41:41.788170] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-17T22:41:41.790379] [INFO ] [MAIN ] Derivative Progress: 1194/2083 symbols completed. MNSO took 0.9s. Estimated remaining: 5m 37s. Rate: 158.4 symbols/min [2025-10-17T22:41:41.803198] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:41.804245] [DEBUG] [LOCAL ] MOD: Loaded 45405 existing records from primary storage. [2025-10-17T22:41:41.804438] [INFO ] [MAIN ] MOD: Loaded 45405 primary data records. [2025-10-17T22:41:41.948835] [DEBUG] [LOCAL ] MODG: Loaded 52312 existing records from primary storage. [2025-10-17T22:41:41.971790] [INFO ] [MAIN ] MODG: Loaded 52312 primary data records. [2025-10-17T22:41:42.347821] [DEBUG] [LOCAL ] MOH: Loaded 43308 existing records from primary storage. [2025-10-17T22:41:42.347973] [INFO ] [MAIN ] MOH: Loaded 43308 primary data records. [2025-10-17T22:41:42.778434] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:42.780326] [INFO ] [MAIN ] MOD: Generated 1820 derivative records from 45405 primary records. [2025-10-17T22:41:42.781023] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-17T22:41:42.799180] [DEBUG] [LOCAL ] MOD: Derivative data saved (1820 records). [2025-10-17T22:41:42.802769] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-17T22:41:42.805256] [INFO ] [MAIN ] Derivative Progress: 1195/2083 symbols completed. MOD took 1.1s. Estimated remaining: 5m 37s. Rate: 158.2 symbols/min [2025-10-17T22:41:42.813109] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:42.819448] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:42.820521] [INFO ] [MAIN ] MODG: Generated 1820 derivative records from 52312 primary records. [2025-10-17T22:41:42.820705] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-17T22:41:42.850239] [DEBUG] [LOCAL ] MODG: Derivative data saved (1820 records). [2025-10-17T22:41:42.855408] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-17T22:41:42.855724] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:42.858037] [INFO ] [MAIN ] Derivative Progress: 1196/2083 symbols completed. MODG took 1.1s. Estimated remaining: 5m 36s. Rate: 158.3 symbols/min [2025-10-17T22:41:42.859026] [INFO ] [MAIN ] MOH: Generated 1820 derivative records from 43308 primary records. [2025-10-17T22:41:42.858210] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:42.859469] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-17T22:41:42.889497] [DEBUG] [LOCAL ] MOH: Derivative data saved (1820 records). [2025-10-17T22:41:42.889626] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-10-17T22:41:42.891838] [INFO ] [MAIN ] Derivative Progress: 1197/2083 symbols completed. MOH took 1.1s. Estimated remaining: 5m 35s. Rate: 158.5 symbols/min [2025-10-17T22:41:42.892084] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:42.911441] [DEBUG] [LOCAL ] MOV: Loaded 21884 existing records from primary storage. [2025-10-17T22:41:42.911802] [INFO ] [MAIN ] MOV: Loaded 21884 primary data records. [2025-10-17T22:41:42.996062] [DEBUG] [LOCAL ] MOS: Loaded 54288 existing records from primary storage. [2025-10-17T22:41:43.008248] [INFO ] [MAIN ] MOS: Loaded 54288 primary data records. [2025-10-17T22:41:43.245070] [DEBUG] [LOCAL ] MP: Loaded 54502 existing records from primary storage. [2025-10-17T22:41:43.245261] [INFO ] [MAIN ] MP: Loaded 54502 primary data records. [2025-10-17T22:41:43.892882] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:43.893878] [INFO ] [MAIN ] MOV: Generated 1820 derivative records from 21884 primary records. [2025-10-17T22:41:43.893967] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-17T22:41:43.912586] [DEBUG] [LOCAL ] MOV: Derivative data saved (1820 records). [2025-10-17T22:41:43.925771] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-10-17T22:41:43.928264] [INFO ] [MAIN ] Derivative Progress: 1198/2083 symbols completed. MOV took 1.1s. Estimated remaining: 5m 36s. Rate: 158.2 symbols/min [2025-10-17T22:41:43.928898] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:43.930479] [INFO ] [MAIN ] MOS: Generated 1820 derivative records from 54288 primary records. [2025-10-17T22:41:43.930748] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-17T22:41:43.943683] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:43.944441] [INFO ] [MAIN ] MP: Generated 1820 derivative records from 54502 primary records. [2025-10-17T22:41:43.955157] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-10-17T22:41:43.959586] [DEBUG] [LOCAL ] MOS: Derivative data saved (1820 records). [2025-10-17T22:41:43.959693] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-17T22:41:43.962093] [INFO ] [MAIN ] Derivative Progress: 1199/2083 symbols completed. MOS took 1.1s. Estimated remaining: 5m 35s. Rate: 158.3 symbols/min [2025-10-17T22:41:43.976542] [DEBUG] [LOCAL ] MP: Derivative data saved (1820 records). [2025-10-17T22:41:43.976600] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-10-17T22:41:43.978750] [INFO ] [MAIN ] Derivative Progress: 1200/2083 symbols completed. MP took 1.1s. Estimated remaining: 5m 34s. Rate: 158.5 symbols/min [2025-10-17T22:41:43.979087] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:43.979249] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:43.979191] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:43.988139] [DEBUG] [LOCAL ] MPA: Loaded 5405 existing records from primary storage. [2025-10-17T22:41:43.988403] [INFO ] [MAIN ] MPA: Loaded 5405 primary data records. [2025-10-17T22:41:44.322728] [DEBUG] [LOCAL ] MPLX: Loaded 51524 existing records from primary storage. [2025-10-17T22:41:44.323296] [INFO ] [MAIN ] MPLX: Loaded 51524 primary data records. [2025-10-17T22:41:44.441041] [DEBUG] [LOCAL ] MPC: Loaded 52777 existing records from primary storage. [2025-10-17T22:41:44.452804] [INFO ] [MAIN ] MPC: Loaded 52777 primary data records. [2025-10-17T22:41:44.980419] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:44.981258] [INFO ] [MAIN ] MPA: Generated 1820 derivative records from 5405 primary records. [2025-10-17T22:41:44.981472] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-17T22:41:44.999787] [DEBUG] [LOCAL ] MPA: Derivative data saved (1820 records). [2025-10-17T22:41:44.999926] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-17T22:41:45.002120] [INFO ] [MAIN ] Derivative Progress: 1201/2083 symbols completed. MPA took 1.0s. Estimated remaining: 5m 34s. Rate: 158.2 symbols/min [2025-10-17T22:41:45.002967] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:45.020760] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:45.021477] [INFO ] [MAIN ] MPLX: Generated 1820 derivative records from 51524 primary records. [2025-10-17T22:41:45.021679] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-10-17T22:41:45.024433] [DEBUG] [LOCAL ] MPV: Loaded 4696 existing records from primary storage. [2025-10-17T22:41:45.025188] [INFO ] [MAIN ] MPV: Loaded 4696 primary data records. [2025-10-17T22:41:45.102761] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1820 records). [2025-10-17T22:41:45.129907] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-10-17T22:41:45.131812] [INFO ] [MAIN ] Derivative Progress: 1202/2083 symbols completed. MPLX took 1.2s. Estimated remaining: 5m 34s. Rate: 158.3 symbols/min [2025-10-17T22:41:45.132045] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:45.240808] [DEBUG] [MAIN ] MPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:45.262303] [INFO ] [MAIN ] MPC: Generated 1820 derivative records from 52777 primary records. [2025-10-17T22:41:45.349323] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-10-17T22:41:45.369080] [DEBUG] [LOCAL ] MPC: Derivative data saved (1820 records). [2025-10-17T22:41:45.369612] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-10-17T22:41:45.384831] [INFO ] [MAIN ] Derivative Progress: 1203/2083 symbols completed. MPC took 1.4s. Estimated remaining: 5m 33s. Rate: 158.4 symbols/min [2025-10-17T22:41:45.385146] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:45.391668] [DEBUG] [LOCAL ] MPX: Loaded 4090 existing records from primary storage. [2025-10-17T22:41:45.392027] [INFO ] [MAIN ] MPX: Loaded 4090 primary data records. [2025-10-17T22:41:45.507484] [DEBUG] [LOCAL ] MPW: Loaded 54274 existing records from primary storage. [2025-10-17T22:41:45.507735] [INFO ] [MAIN ] MPW: Loaded 54274 primary data records. [2025-10-17T22:41:45.702356] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:45.805438] [INFO ] [MAIN ] MPV: Generated 1820 derivative records from 4696 primary records. [2025-10-17T22:41:45.835294] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-17T22:41:46.026834] [DEBUG] [LOCAL ] MPV: Derivative data saved (1820 records). [2025-10-17T22:41:46.027138] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-10-17T22:41:46.029280] [INFO ] [MAIN ] Derivative Progress: 1204/2083 symbols completed. MPV took 1.0s. Estimated remaining: 5m 33s. Rate: 158.3 symbols/min [2025-10-17T22:41:46.029866] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:46.041319] [DEBUG] [LOCAL ] MQT: Loaded 8424 existing records from primary storage. [2025-10-17T22:41:46.042559] [INFO ] [MAIN ] MQT: Loaded 8424 primary data records. [2025-10-17T22:41:46.240294] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:46.249169] [INFO ] [MAIN ] MPX: Generated 1820 derivative records from 4090 primary records. [2025-10-17T22:41:46.261732] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-10-17T22:41:46.248490] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:46.366613] [INFO ] [MAIN ] MPW: Generated 1820 derivative records from 54274 primary records. [2025-10-17T22:41:46.367888] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-10-17T22:41:46.399125] [DEBUG] [LOCAL ] MPX: Derivative data saved (1820 records). [2025-10-17T22:41:46.399829] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-10-17T22:41:46.401912] [INFO ] [MAIN ] Derivative Progress: 1205/2083 symbols completed. MPX took 1.0s. Estimated remaining: 5m 33s. Rate: 158.3 symbols/min [2025-10-17T22:41:46.399762] [DEBUG] [LOCAL ] MPW: Derivative data saved (1820 records). [2025-10-17T22:41:46.402198] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:46.402361] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-10-17T22:41:46.405709] [INFO ] [MAIN ] Derivative Progress: 1206/2083 symbols completed. MPW took 1.3s. Estimated remaining: 5m 32s. Rate: 158.4 symbols/min [2025-10-17T22:41:46.405952] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:46.429749] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:46.430566] [INFO ] [MAIN ] MQT: Generated 1820 derivative records from 8424 primary records. [2025-10-17T22:41:46.430711] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-17T22:41:46.452337] [DEBUG] [LOCAL ] MQT: Derivative data saved (1820 records). [2025-10-17T22:41:46.451665] [DEBUG] [LOCAL ] MQY: Loaded 17099 existing records from primary storage. [2025-10-17T22:41:46.460068] [INFO ] [MAIN ] MQY: Loaded 17099 primary data records. [2025-10-17T22:41:46.471356] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-10-17T22:41:46.482733] [INFO ] [MAIN ] Derivative Progress: 1207/2083 symbols completed. MQT took 0.5s. Estimated remaining: 5m 32s. Rate: 158.5 symbols/min [2025-10-17T22:41:46.504885] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:46.575031] [DEBUG] [LOCAL ] MRC: Loaded 37839 existing records from primary storage. [2025-10-17T22:41:46.581029] [INFO ] [MAIN ] MRC: Loaded 37839 primary data records. [2025-10-17T22:41:46.875684] [DEBUG] [LOCAL ] MSA: Loaded 19108 existing records from primary storage. [2025-10-17T22:41:46.875859] [INFO ] [MAIN ] MSA: Loaded 19108 primary data records. [2025-10-17T22:41:47.412275] [DEBUG] [MAIN ] MQY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:47.414119] [INFO ] [MAIN ] MQY: Generated 1820 derivative records from 17099 primary records. [2025-10-17T22:41:47.415071] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-10-17T22:41:47.442820] [DEBUG] [MAIN ] MRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:47.446744] [DEBUG] [LOCAL ] MQY: Derivative data saved (1820 records). [2025-10-17T22:41:47.445138] [INFO ] [MAIN ] MRC: Generated 1820 derivative records from 37839 primary records. [2025-10-17T22:41:47.446946] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-10-17T22:41:47.447857] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-10-17T22:41:47.450984] [INFO ] [MAIN ] Derivative Progress: 1208/2083 symbols completed. MQY took 1.0s. Estimated remaining: 5m 32s. Rate: 158.3 symbols/min [2025-10-17T22:41:47.452054] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:47.478356] [DEBUG] [MAIN ] MSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:47.481307] [INFO ] [MAIN ] MSA: Generated 1820 derivative records from 19108 primary records. [2025-10-17T22:41:47.482114] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-10-17T22:41:47.486810] [DEBUG] [LOCAL ] MSB: Loaded 7917 existing records from primary storage. [2025-10-17T22:41:47.487333] [INFO ] [MAIN ] MSB: Loaded 7917 primary data records. [2025-10-17T22:41:47.506032] [DEBUG] [LOCAL ] MRC: Derivative data saved (1820 records). [2025-10-17T22:41:47.540428] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-10-17T22:41:47.603684] [INFO ] [MAIN ] Derivative Progress: 1209/2083 symbols completed. MRC took 1.2s. Estimated remaining: 5m 31s. Rate: 158.4 symbols/min [2025-10-17T22:41:47.564674] [DEBUG] [LOCAL ] MSA: Derivative data saved (1820 records). [2025-10-17T22:41:47.604032] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-10-17T22:41:47.606258] [INFO ] [MAIN ] Derivative Progress: 1210/2083 symbols completed. MSA took 1.1s. Estimated remaining: 5m 30s. Rate: 158.5 symbols/min [2025-10-17T22:41:47.603892] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:47.606415] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:47.815996] [DEBUG] [LOCAL ] MSD: Loaded 16810 existing records from primary storage. [2025-10-17T22:41:47.816132] [INFO ] [MAIN ] MSD: Loaded 16810 primary data records. [2025-10-17T22:41:47.908910] [DEBUG] [LOCAL ] MSCI: Loaded 34965 existing records from primary storage. [2025-10-17T22:41:47.927388] [INFO ] [MAIN ] MSCI: Loaded 34965 primary data records. [2025-10-17T22:41:48.475190] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:48.476049] [INFO ] [MAIN ] MSB: Generated 1820 derivative records from 7917 primary records. [2025-10-17T22:41:48.476606] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-10-17T22:41:48.495912] [DEBUG] [LOCAL ] MSB: Derivative data saved (1820 records). [2025-10-17T22:41:48.496057] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-10-17T22:41:48.498759] [INFO ] [MAIN ] Derivative Progress: 1211/2083 symbols completed. MSB took 1.0s. Estimated remaining: 5m 30s. Rate: 158.3 symbols/min [2025-10-17T22:41:48.499321] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:48.521486] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:48.522489] [INFO ] [MAIN ] MSD: Generated 1820 derivative records from 16810 primary records. [2025-10-17T22:41:48.522901] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-10-17T22:41:48.549345] [DEBUG] [LOCAL ] MSD: Derivative data saved (1820 records). [2025-10-17T22:41:48.549766] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-10-17T22:41:48.551775] [INFO ] [MAIN ] Derivative Progress: 1212/2083 symbols completed. MSD took 0.9s. Estimated remaining: 5m 30s. Rate: 158.5 symbols/min [2025-10-17T22:41:48.553090] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:48.580366] [DEBUG] [MAIN ] MSCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:48.582766] [INFO ] [MAIN ] MSCI: Generated 1820 derivative records from 34965 primary records. [2025-10-17T22:41:48.582911] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-10-17T22:41:48.584124] [DEBUG] [LOCAL ] MSDL: Loaded 39331 existing records from primary storage. [2025-10-17T22:41:48.585155] [INFO ] [MAIN ] MSDL: Loaded 39331 primary data records. [2025-10-17T22:41:48.676974] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1820 records). [2025-10-17T22:41:48.682815] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-10-17T22:41:48.698856] [INFO ] [MAIN ] Derivative Progress: 1213/2083 symbols completed. MSCI took 1.1s. Estimated remaining: 5m 29s. Rate: 158.5 symbols/min [2025-10-17T22:41:48.720284] [DEBUG] [LOCAL ] MSGE: Loaded 27423 existing records from primary storage. [2025-10-17T22:41:48.720511] [INFO ] [MAIN ] MSGE: Loaded 27423 primary data records. [2025-10-17T22:41:49.246967] [DEBUG] [MAIN ] MSDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:49.247830] [INFO ] [MAIN ] MSDL: Generated 1820 derivative records from 39331 primary records. [2025-10-17T22:41:49.247975] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-10-17T22:41:49.277427] [DEBUG] [MAIN ] MSGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:49.278194] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1820 records). [2025-10-17T22:41:49.278272] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-10-17T22:41:49.280940] [INFO ] [MAIN ] Derivative Progress: 1214/2083 symbols completed. MSDL took 0.8s. Estimated remaining: 5m 29s. Rate: 158.5 symbols/min [2025-10-17T22:41:49.278906] [INFO ] [MAIN ] MSGE: Generated 1820 derivative records from 27423 primary records. [2025-10-17T22:41:49.281065] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-10-17T22:41:49.296674] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1820 records). [2025-10-17T22:41:49.296735] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-10-17T22:41:49.298898] [INFO ] [MAIN ] Derivative Progress: 1215/2083 symbols completed. MSGE took 0.7s. Estimated remaining: 5m 28s. Rate: 158.6 symbols/min [2025-10-17T22:41:49.299892] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:49.300003] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:49.299745] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:49.333951] [DEBUG] [LOCAL ] MSGS: Loaded 17627 existing records from primary storage. [2025-10-17T22:41:49.334335] [INFO ] [MAIN ] MSGS: Loaded 17627 primary data records. [2025-10-17T22:41:49.482684] [DEBUG] [LOCAL ] MSM: Loaded 36195 existing records from primary storage. [2025-10-17T22:41:49.493217] [INFO ] [MAIN ] MSM: Loaded 36195 primary data records. [2025-10-17T22:41:49.499194] [DEBUG] [LOCAL ] MT: Loaded 51241 existing records from primary storage. [2025-10-17T22:41:49.504688] [INFO ] [MAIN ] MT: Loaded 51241 primary data records. [2025-10-17T22:41:50.346517] [DEBUG] [MAIN ] MSGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:50.348054] [INFO ] [MAIN ] MSGS: Generated 1820 derivative records from 17627 primary records. [2025-10-17T22:41:50.348432] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-10-17T22:41:50.378060] [DEBUG] [MAIN ] MSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:50.381957] [INFO ] [MAIN ] MSM: Generated 1820 derivative records from 36195 primary records. [2025-10-17T22:41:50.382907] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-10-17T22:41:50.397960] [DEBUG] [MAIN ] MT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:50.406815] [INFO ] [MAIN ] MT: Generated 1820 derivative records from 51241 primary records. [2025-10-17T22:41:50.407174] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-10-17T22:41:50.422504] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1820 records). [2025-10-17T22:41:50.432515] [DEBUG] [LOCAL ] MSM: Derivative data saved (1820 records). [2025-10-17T22:41:50.432628] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-10-17T22:41:50.431399] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-10-17T22:41:50.434607] [INFO ] [MAIN ] Derivative Progress: 1216/2083 symbols completed. MSGS took 1.1s. Estimated remaining: 5m 29s. Rate: 158.3 symbols/min [2025-10-17T22:41:50.437237] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:50.438509] [DEBUG] [LOCAL ] MT: Derivative data saved (1820 records). [2025-10-17T22:41:50.438813] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-10-17T22:41:50.438384] [INFO ] [MAIN ] Derivative Progress: 1217/2083 symbols completed. MSM took 1.1s. Estimated remaining: 5m 28s. Rate: 158.5 symbols/min [2025-10-17T22:41:50.439288] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:50.442189] [INFO ] [MAIN ] Derivative Progress: 1218/2083 symbols completed. MT took 1.1s. Estimated remaining: 5m 27s. Rate: 158.6 symbols/min [2025-10-17T22:41:50.442594] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:50.459129] [DEBUG] [LOCAL ] MTD: Loaded 15618 existing records from primary storage. [2025-10-17T22:41:50.459372] [INFO ] [MAIN ] MTD: Loaded 15618 primary data records. [2025-10-17T22:41:50.846734] [DEBUG] [LOCAL ] MTDR: Loaded 52441 existing records from primary storage. [2025-10-17T22:41:50.847719] [DEBUG] [LOCAL ] MTB: Loaded 47322 existing records from primary storage. [2025-10-17T22:41:50.847940] [INFO ] [MAIN ] MTDR: Loaded 52441 primary data records. [2025-10-17T22:41:50.848246] [INFO ] [MAIN ] MTB: Loaded 47322 primary data records. [2025-10-17T22:41:51.478325] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:51.480289] [INFO ] [MAIN ] MTD: Generated 1820 derivative records from 15618 primary records. [2025-10-17T22:41:51.480401] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-10-17T22:41:51.499072] [DEBUG] [LOCAL ] MTD: Derivative data saved (1820 records). [2025-10-17T22:41:51.499391] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-10-17T22:41:51.502467] [INFO ] [MAIN ] Derivative Progress: 1219/2083 symbols completed. MTD took 1.1s. Estimated remaining: 5m 27s. Rate: 158.4 symbols/min [2025-10-17T22:41:51.503912] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:51.528244] [DEBUG] [MAIN ] MTDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:51.530024] [INFO ] [MAIN ] MTDR: Generated 1820 derivative records from 52441 primary records. [2025-10-17T22:41:51.530343] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-10-17T22:41:51.552389] [DEBUG] [MAIN ] MTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:51.560792] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1820 records). [2025-10-17T22:41:51.562010] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-10-17T22:41:51.561883] [INFO ] [MAIN ] MTB: Generated 1820 derivative records from 47322 primary records. [2025-10-17T22:41:51.564070] [INFO ] [MAIN ] Derivative Progress: 1220/2083 symbols completed. MTDR took 1.1s. Estimated remaining: 5m 27s. Rate: 158.5 symbols/min [2025-10-17T22:41:51.562198] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-10-17T22:41:51.578160] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:51.595783] [DEBUG] [LOCAL ] MTB: Derivative data saved (1820 records). [2025-10-17T22:41:51.596030] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-10-17T22:41:51.599120] [INFO ] [MAIN ] Derivative Progress: 1221/2083 symbols completed. MTB took 1.2s. Estimated remaining: 5m 26s. Rate: 158.6 symbols/min [2025-10-17T22:41:51.599393] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:51.618174] [DEBUG] [LOCAL ] MTG: Loaded 51857 existing records from primary storage. [2025-10-17T22:41:51.618390] [INFO ] [MAIN ] MTG: Loaded 51857 primary data records. [2025-10-17T22:41:51.949614] [DEBUG] [LOCAL ] MTH: Loaded 44523 existing records from primary storage. [2025-10-17T22:41:51.950379] [INFO ] [MAIN ] MTH: Loaded 44523 primary data records. [2025-10-17T22:41:52.020308] [DEBUG] [LOCAL ] MTN: Loaded 40099 existing records from primary storage. [2025-10-17T22:41:52.042450] [INFO ] [MAIN ] MTN: Loaded 40099 primary data records. [2025-10-17T22:41:52.747631] [DEBUG] [MAIN ] MTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:52.748707] [INFO ] [MAIN ] MTG: Generated 1820 derivative records from 51857 primary records. [2025-10-17T22:41:52.749120] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-10-17T22:41:52.776614] [DEBUG] [LOCAL ] MTG: Derivative data saved (1820 records). [2025-10-17T22:41:52.778880] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-10-17T22:41:52.782108] [INFO ] [MAIN ] Derivative Progress: 1222/2083 symbols completed. MTG took 1.3s. Estimated remaining: 5m 26s. Rate: 158.3 symbols/min [2025-10-17T22:41:52.782571] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:52.797434] [DEBUG] [MAIN ] MTH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:52.798810] [INFO ] [MAIN ] MTH: Generated 1820 derivative records from 44523 primary records. [2025-10-17T22:41:52.798912] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-10-17T22:41:52.821998] [DEBUG] [LOCAL ] MTH: Derivative data saved (1820 records). [2025-10-17T22:41:52.823440] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-10-17T22:41:52.827106] [INFO ] [MAIN ] Derivative Progress: 1223/2083 symbols completed. MTH took 1.2s. Estimated remaining: 5m 26s. Rate: 158.4 symbols/min [2025-10-17T22:41:52.827391] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:52.849051] [DEBUG] [LOCAL ] MTRN: Loaded 18534 existing records from primary storage. [2025-10-17T22:41:52.849702] [INFO ] [MAIN ] MTRN: Loaded 18534 primary data records. [2025-10-17T22:41:52.849427] [DEBUG] [MAIN ] MTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:52.871532] [INFO ] [MAIN ] MTN: Generated 1820 derivative records from 40099 primary records. [2025-10-17T22:41:52.882019] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-10-17T22:41:52.998711] [DEBUG] [LOCAL ] MTN: Derivative data saved (1820 records). [2025-10-17T22:41:53.072092] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-10-17T22:41:53.175951] [DEBUG] [LOCAL ] MTW: Loaded 26834 existing records from primary storage. [2025-10-17T22:41:53.188242] [INFO ] [MAIN ] MTW: Loaded 26834 primary data records. [2025-10-17T22:41:53.187970] [INFO ] [MAIN ] Derivative Progress: 1224/2083 symbols completed. MTN took 1.6s. Estimated remaining: 5m 25s. Rate: 158.4 symbols/min [2025-10-17T22:41:53.200088] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:53.526146] [DEBUG] [LOCAL ] MTX: Loaded 22982 existing records from primary storage. [2025-10-17T22:41:53.535565] [INFO ] [MAIN ] MTX: Loaded 22982 primary data records. [2025-10-17T22:41:53.751348] [DEBUG] [MAIN ] MTRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:53.760238] [INFO ] [MAIN ] MTRN: Generated 1820 derivative records from 18534 primary records. [2025-10-17T22:41:53.760348] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-10-17T22:41:53.908307] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1820 records). [2025-10-17T22:41:53.909972] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-10-17T22:41:53.912598] [INFO ] [MAIN ] Derivative Progress: 1225/2083 symbols completed. MTRN took 1.1s. Estimated remaining: 5m 25s. Rate: 158.3 symbols/min [2025-10-17T22:41:53.912796] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:53.933078] [DEBUG] [MAIN ] MTW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:53.933994] [INFO ] [MAIN ] MTW: Generated 1820 derivative records from 26834 primary records. [2025-10-17T22:41:53.934146] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-10-17T22:41:53.955670] [DEBUG] [LOCAL ] MTW: Derivative data saved (1820 records). [2025-10-17T22:41:53.955969] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-10-17T22:41:53.958873] [INFO ] [MAIN ] Derivative Progress: 1226/2083 symbols completed. MTW took 1.1s. Estimated remaining: 5m 25s. Rate: 158.4 symbols/min [2025-10-17T22:41:53.959154] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:53.990866] [DEBUG] [MAIN ] MTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:53.991715] [INFO ] [MAIN ] MTX: Generated 1820 derivative records from 22982 primary records. [2025-10-17T22:41:53.991899] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-10-17T22:41:54.014924] [DEBUG] [LOCAL ] MTX: Derivative data saved (1820 records). [2025-10-17T22:41:54.010839] [DEBUG] [LOCAL ] MUA: Loaded 11702 existing records from primary storage. [2025-10-17T22:41:54.015413] [INFO ] [MAIN ] MUA: Loaded 11702 primary data records. [2025-10-17T22:41:54.015109] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-10-17T22:41:54.022759] [INFO ] [MAIN ] Derivative Progress: 1227/2083 symbols completed. MTX took 0.8s. Estimated remaining: 5m 24s. Rate: 158.5 symbols/min [2025-10-17T22:41:54.030065] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:54.092939] [DEBUG] [LOCAL ] MTZ: Loaded 43615 existing records from primary storage. [2025-10-17T22:41:54.116623] [INFO ] [MAIN ] MTZ: Loaded 43615 primary data records. [2025-10-17T22:41:54.273160] [DEBUG] [LOCAL ] MUC: Loaded 21055 existing records from primary storage. [2025-10-17T22:41:54.337839] [INFO ] [MAIN ] MUC: Loaded 21055 primary data records. [2025-10-17T22:41:55.095065] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:55.096728] [INFO ] [MAIN ] MUA: Generated 1820 derivative records from 11702 primary records. [2025-10-17T22:41:55.099233] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-10-17T22:41:55.134041] [DEBUG] [MAIN ] MTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:55.135232] [DEBUG] [LOCAL ] MUA: Derivative data saved (1820 records). [2025-10-17T22:41:55.138673] [INFO ] [MAIN ] MTZ: Generated 1820 derivative records from 43615 primary records. [2025-10-17T22:41:55.138899] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-10-17T22:41:55.138984] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-10-17T22:41:55.141754] [INFO ] [MAIN ] Derivative Progress: 1228/2083 symbols completed. MUA took 1.2s. Estimated remaining: 5m 24s. Rate: 158.3 symbols/min [2025-10-17T22:41:55.163997] [DEBUG] [MAIN ] MUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:55.174324] [INFO ] [MAIN ] MUC: Generated 1820 derivative records from 21055 primary records. [2025-10-17T22:41:55.174570] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-10-17T22:41:55.174450] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1820 records). [2025-10-17T22:41:55.175254] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-10-17T22:41:55.178970] [INFO ] [MAIN ] Derivative Progress: 1229/2083 symbols completed. MTZ took 1.3s. Estimated remaining: 5m 23s. Rate: 158.4 symbols/min [2025-10-17T22:41:55.194958] [DEBUG] [LOCAL ] MUC: Derivative data saved (1820 records). [2025-10-17T22:41:55.195047] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-10-17T22:41:55.197709] [INFO ] [MAIN ] Derivative Progress: 1230/2083 symbols completed. MUC took 1.2s. Estimated remaining: 5m 23s. Rate: 158.5 symbols/min [2025-10-17T22:41:55.198451] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:55.198239] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:55.198341] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:55.214272] [DEBUG] [LOCAL ] MUE: Loaded 12287 existing records from primary storage. [2025-10-17T22:41:55.221050] [INFO ] [MAIN ] MUE: Loaded 12287 primary data records. [2025-10-17T22:41:55.317830] [DEBUG] [LOCAL ] MUJ: Loaded 14061 existing records from primary storage. [2025-10-17T22:41:55.349151] [INFO ] [MAIN ] MUJ: Loaded 14061 primary data records. [2025-10-17T22:41:55.691924] [DEBUG] [LOCAL ] MUFG: Loaded 53237 existing records from primary storage. [2025-10-17T22:41:55.708848] [INFO ] [MAIN ] MUFG: Loaded 53237 primary data records. [2025-10-17T22:41:56.255864] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:56.257302] [INFO ] [MAIN ] MUE: Generated 1820 derivative records from 12287 primary records. [2025-10-17T22:41:56.257932] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-17T22:41:56.282217] [DEBUG] [LOCAL ] MUE: Derivative data saved (1820 records). [2025-10-17T22:41:56.282617] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-10-17T22:41:56.284720] [INFO ] [MAIN ] Derivative Progress: 1231/2083 symbols completed. MUE took 1.1s. Estimated remaining: 5m 23s. Rate: 158.3 symbols/min [2025-10-17T22:41:56.285279] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:56.301837] [DEBUG] [MAIN ] MUJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:56.306456] [INFO ] [MAIN ] MUJ: Generated 1820 derivative records from 14061 primary records. [2025-10-17T22:41:56.306699] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-10-17T22:41:56.334130] [DEBUG] [MAIN ] MUFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:56.335747] [INFO ] [MAIN ] MUFG: Generated 1820 derivative records from 53237 primary records. [2025-10-17T22:41:56.336929] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-10-17T22:41:56.352950] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1820 records). [2025-10-17T22:41:56.355840] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-10-17T22:41:56.358962] [INFO ] [MAIN ] Derivative Progress: 1232/2083 symbols completed. MUJ took 1.2s. Estimated remaining: 5m 22s. Rate: 158.4 symbols/min [2025-10-17T22:41:56.360874] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1820 records). [2025-10-17T22:41:56.361324] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-10-17T22:41:56.361249] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:56.363668] [INFO ] [MAIN ] Derivative Progress: 1233/2083 symbols completed. MUFG took 1.2s. Estimated remaining: 5m 22s. Rate: 158.5 symbols/min [2025-10-17T22:41:56.363991] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:56.423598] [DEBUG] [LOCAL ] MUR: Loaded 53689 existing records from primary storage. [2025-10-17T22:41:56.421609] [DEBUG] [LOCAL ] MUSA: Loaded 24959 existing records from primary storage. [2025-10-17T22:41:56.436803] [INFO ] [MAIN ] MUR: Loaded 53689 primary data records. [2025-10-17T22:41:56.436988] [INFO ] [MAIN ] MUSA: Loaded 24959 primary data records. [2025-10-17T22:41:56.625413] [DEBUG] [LOCAL ] MUX: Loaded 44165 existing records from primary storage. [2025-10-17T22:41:56.648504] [INFO ] [MAIN ] MUX: Loaded 44165 primary data records. [2025-10-17T22:41:57.529564] [DEBUG] [MAIN ] MUSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:57.530699] [INFO ] [MAIN ] MUSA: Generated 1820 derivative records from 24959 primary records. [2025-10-17T22:41:57.531094] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-10-17T22:41:57.548324] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1820 records). [2025-10-17T22:41:57.548772] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-10-17T22:41:57.550942] [INFO ] [MAIN ] Derivative Progress: 1234/2083 symbols completed. MUSA took 1.2s. Estimated remaining: 5m 22s. Rate: 158.2 symbols/min [2025-10-17T22:41:57.551999] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:57.587414] [DEBUG] [MAIN ] MUR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:57.588840] [INFO ] [MAIN ] MUR: Generated 1820 derivative records from 53689 primary records. [2025-10-17T22:41:57.587842] [DEBUG] [MAIN ] MUX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:57.594099] [INFO ] [MAIN ] MUX: Generated 1820 derivative records from 44165 primary records. [2025-10-17T22:41:57.594207] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-10-17T22:41:57.593275] [DEBUG] [LOCAL ] MVO: Loaded 9002 existing records from primary storage. [2025-10-17T22:41:57.592947] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-10-17T22:41:57.594765] [INFO ] [MAIN ] MVO: Loaded 9002 primary data records. [2025-10-17T22:41:57.697426] [DEBUG] [LOCAL ] MUR: Derivative data saved (1820 records). [2025-10-17T22:41:57.715310] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-10-17T22:41:57.718888] [INFO ] [MAIN ] Derivative Progress: 1235/2083 symbols completed. MUR took 1.4s. Estimated remaining: 5m 21s. Rate: 158.3 symbols/min [2025-10-17T22:41:57.726543] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:57.742941] [DEBUG] [LOCAL ] MUX: Derivative data saved (1820 records). [2025-10-17T22:41:57.748475] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-10-17T22:41:57.774144] [INFO ] [MAIN ] Derivative Progress: 1236/2083 symbols completed. MUX took 1.4s. Estimated remaining: 5m 21s. Rate: 158.4 symbols/min [2025-10-17T22:41:57.774421] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:57.820866] [DEBUG] [LOCAL ] MVT: Loaded 10095 existing records from primary storage. [2025-10-17T22:41:57.937882] [INFO ] [MAIN ] MVT: Loaded 10095 primary data records. [2025-10-17T22:41:58.284137] [DEBUG] [LOCAL ] MWA: Loaded 46654 existing records from primary storage. [2025-10-17T22:41:58.284487] [INFO ] [MAIN ] MWA: Loaded 46654 primary data records. [2025-10-17T22:41:58.623931] [DEBUG] [MAIN ] MVO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:58.625301] [INFO ] [MAIN ] MVO: Generated 1820 derivative records from 9002 primary records. [2025-10-17T22:41:58.625722] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-10-17T22:41:58.641822] [DEBUG] [LOCAL ] MVO: Derivative data saved (1820 records). [2025-10-17T22:41:58.643008] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-10-17T22:41:58.645508] [INFO ] [MAIN ] Derivative Progress: 1237/2083 symbols completed. MVO took 1.1s. Estimated remaining: 5m 21s. Rate: 158.2 symbols/min [2025-10-17T22:41:58.646030] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:58.664189] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:58.665129] [INFO ] [MAIN ] MVT: Generated 1820 derivative records from 10095 primary records. [2025-10-17T22:41:58.665405] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-17T22:41:58.696044] [DEBUG] [LOCAL ] MVT: Derivative data saved (1820 records). [2025-10-17T22:41:58.698072] [DEBUG] [LOCAL ] MX: Loaded 22627 existing records from primary storage. [2025-10-17T22:41:58.698183] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-10-17T22:41:58.700419] [INFO ] [MAIN ] Derivative Progress: 1238/2083 symbols completed. MVT took 1.0s. Estimated remaining: 5m 20s. Rate: 158.4 symbols/min [2025-10-17T22:41:58.700824] [INFO ] [MAIN ] MX: Loaded 22627 primary data records. [2025-10-17T22:41:58.700903] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:58.768773] [DEBUG] [MAIN ] MWA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:58.806024] [INFO ] [MAIN ] MWA: Generated 1820 derivative records from 46654 primary records. [2025-10-17T22:41:58.816460] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-10-17T22:41:58.836172] [DEBUG] [LOCAL ] MXF: Loaded 5717 existing records from primary storage. [2025-10-17T22:41:58.847956] [INFO ] [MAIN ] MXF: Loaded 5717 primary data records. [2025-10-17T22:41:59.182978] [DEBUG] [LOCAL ] MWA: Derivative data saved (1820 records). [2025-10-17T22:41:59.194972] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-10-17T22:41:59.210358] [INFO ] [MAIN ] Derivative Progress: 1239/2083 symbols completed. MWA took 1.4s. Estimated remaining: 5m 20s. Rate: 158.3 symbols/min [2025-10-17T22:41:59.222226] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:59.389398] [DEBUG] [LOCAL ] MYD: Loaded 13587 existing records from primary storage. [2025-10-17T22:41:59.390208] [INFO ] [MAIN ] MYD: Loaded 13587 primary data records. [2025-10-17T22:41:59.525558] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:59.537447] [INFO ] [MAIN ] MX: Generated 1820 derivative records from 22627 primary records. [2025-10-17T22:41:59.537852] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-10-17T22:41:59.735477] [DEBUG] [LOCAL ] MX: Derivative data saved (1820 records). [2025-10-17T22:41:59.736288] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-10-17T22:41:59.738628] [INFO ] [MAIN ] Derivative Progress: 1240/2083 symbols completed. MX took 1.1s. Estimated remaining: 5m 20s. Rate: 158.3 symbols/min [2025-10-17T22:41:59.741727] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:59.758835] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:59.760100] [INFO ] [MAIN ] MXF: Generated 1820 derivative records from 5717 primary records. [2025-10-17T22:41:59.760261] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-10-17T22:41:59.787013] [DEBUG] [LOCAL ] MXF: Derivative data saved (1820 records). [2025-10-17T22:41:59.787164] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-10-17T22:41:59.790286] [INFO ] [MAIN ] Derivative Progress: 1241/2083 symbols completed. MXF took 1.1s. Estimated remaining: 5m 19s. Rate: 158.4 symbols/min [2025-10-17T22:41:59.790786] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:41:59.800508] [DEBUG] [LOCAL ] MYE: Loaded 24710 existing records from primary storage. [2025-10-17T22:41:59.800811] [INFO ] [MAIN ] MYE: Loaded 24710 primary data records. [2025-10-17T22:41:59.935411] [DEBUG] [MAIN ] MYD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:41:59.941729] [DEBUG] [LOCAL ] MYI: Loaded 19288 existing records from primary storage. [2025-10-17T22:41:59.977555] [INFO ] [MAIN ] MYD: Generated 1820 derivative records from 13587 primary records. [2025-10-17T22:41:59.976532] [INFO ] [MAIN ] MYI: Loaded 19288 primary data records. [2025-10-17T22:42:00.014560] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-10-17T22:42:00.454221] [DEBUG] [LOCAL ] MYD: Derivative data saved (1820 records). [2025-10-17T22:42:00.454769] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-10-17T22:42:00.457156] [INFO ] [MAIN ] Derivative Progress: 1242/2083 symbols completed. MYD took 1.2s. Estimated remaining: 5m 19s. Rate: 158.3 symbols/min [2025-10-17T22:42:00.457441] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:00.475277] [DEBUG] [LOCAL ] MYN: Loaded 10035 existing records from primary storage. [2025-10-17T22:42:00.483555] [INFO ] [MAIN ] MYN: Loaded 10035 primary data records. [2025-10-17T22:42:00.500538] [DEBUG] [MAIN ] MYE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:00.526852] [INFO ] [MAIN ] MYE: Generated 1820 derivative records from 24710 primary records. [2025-10-17T22:42:00.545547] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-10-17T22:42:00.609011] [DEBUG] [LOCAL ] MYE: Derivative data saved (1820 records). [2025-10-17T22:42:00.609145] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-10-17T22:42:00.612033] [INFO ] [MAIN ] Derivative Progress: 1243/2083 symbols completed. MYE took 0.9s. Estimated remaining: 5m 18s. Rate: 158.3 symbols/min [2025-10-17T22:42:00.701751] [DEBUG] [MAIN ] MYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:00.849207] [INFO ] [MAIN ] MYI: Generated 1820 derivative records from 19288 primary records. [2025-10-17T22:42:00.862363] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-10-17T22:42:00.880165] [DEBUG] [LOCAL ] MYI: Derivative data saved (1820 records). [2025-10-17T22:42:00.880825] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-10-17T22:42:00.883210] [INFO ] [MAIN ] Derivative Progress: 1244/2083 symbols completed. MYI took 1.1s. Estimated remaining: 5m 18s. Rate: 158.4 symbols/min [2025-10-17T22:42:00.903546] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:00.904187] [INFO ] [MAIN ] MYN: Generated 1820 derivative records from 10035 primary records. [2025-10-17T22:42:00.904248] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-17T22:42:00.918855] [DEBUG] [LOCAL ] MYN: Derivative data saved (1820 records). [2025-10-17T22:42:00.918912] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-10-17T22:42:00.921227] [INFO ] [MAIN ] Derivative Progress: 1245/2083 symbols completed. MYN took 0.5s. Estimated remaining: 5m 17s. Rate: 158.5 symbols/min [2025-10-17T22:42:00.921781] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:00.921891] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:00.921693] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:00.964989] [DEBUG] [LOCAL ] NAC: Loaded 24827 existing records from primary storage. [2025-10-17T22:42:00.965267] [INFO ] [MAIN ] NAC: Loaded 24827 primary data records. [2025-10-17T22:42:01.099929] [DEBUG] [LOCAL ] NABL: Loaded 39737 existing records from primary storage. [2025-10-17T22:42:01.108340] [INFO ] [MAIN ] NABL: Loaded 39737 primary data records. [2025-10-17T22:42:01.079782] [DEBUG] [LOCAL ] NAD: Loaded 34190 existing records from primary storage. [2025-10-17T22:42:01.120103] [INFO ] [MAIN ] NAD: Loaded 34190 primary data records. [2025-10-17T22:42:02.145382] [DEBUG] [MAIN ] NAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:02.146590] [INFO ] [MAIN ] NAC: Generated 1820 derivative records from 24827 primary records. [2025-10-17T22:42:02.147213] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-10-17T22:42:02.176630] [DEBUG] [LOCAL ] NAC: Derivative data saved (1820 records). [2025-10-17T22:42:02.177262] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-10-17T22:42:02.182809] [INFO ] [MAIN ] Derivative Progress: 1246/2083 symbols completed. NAC took 1.3s. Estimated remaining: 5m 17s. Rate: 158.2 symbols/min [2025-10-17T22:42:02.184310] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:02.208133] [DEBUG] [MAIN ] NAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:02.209044] [INFO ] [MAIN ] NAD: Generated 1820 derivative records from 34190 primary records. [2025-10-17T22:42:02.210481] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-10-17T22:42:02.246308] [DEBUG] [LOCAL ] NAD: Derivative data saved (1820 records). [2025-10-17T22:42:02.265909] [DEBUG] [LOCAL ] NAN: Loaded 8601 existing records from primary storage. [2025-10-17T22:42:02.267829] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-10-17T22:42:02.267972] [INFO ] [MAIN ] NAN: Loaded 8601 primary data records. [2025-10-17T22:42:02.270805] [INFO ] [MAIN ] Derivative Progress: 1247/2083 symbols completed. NAD took 1.3s. Estimated remaining: 5m 17s. Rate: 158.3 symbols/min [2025-10-17T22:42:02.271432] [DEBUG] [MAIN ] NABL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:02.322364] [INFO ] [MAIN ] NABL: Generated 1820 derivative records from 39737 primary records. [2025-10-17T22:42:02.315915] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:02.338054] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-10-17T22:42:02.419049] [DEBUG] [LOCAL ] NABL: Derivative data saved (1820 records). [2025-10-17T22:42:02.430846] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-10-17T22:42:02.438952] [INFO ] [MAIN ] Derivative Progress: 1248/2083 symbols completed. NABL took 1.5s. Estimated remaining: 5m 16s. Rate: 158.4 symbols/min [2025-10-17T22:42:02.444587] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:02.697359] [DEBUG] [LOCAL ] NAT: Loaded 49970 existing records from primary storage. [2025-10-17T22:42:02.698421] [INFO ] [MAIN ] NAT: Loaded 49970 primary data records. [2025-10-17T22:42:02.840372] [DEBUG] [MAIN ] NAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:02.846029] [DEBUG] [LOCAL ] NATL: Loaded 33023 existing records from primary storage. [2025-10-17T22:42:02.874988] [INFO ] [MAIN ] NAN: Generated 1820 derivative records from 8601 primary records. [2025-10-17T22:42:02.893915] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-10-17T22:42:02.908328] [INFO ] [MAIN ] NATL: Loaded 33023 primary data records. [2025-10-17T22:42:03.082040] [DEBUG] [LOCAL ] NAN: Derivative data saved (1820 records). [2025-10-17T22:42:03.112444] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-10-17T22:42:03.120078] [INFO ] [MAIN ] Derivative Progress: 1249/2083 symbols completed. NAN took 0.9s. Estimated remaining: 5m 16s. Rate: 158.3 symbols/min [2025-10-17T22:42:03.132408] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:03.240938] [DEBUG] [LOCAL ] NAZ: Loaded 2699 existing records from primary storage. [2025-10-17T22:42:03.241459] [INFO ] [MAIN ] NAZ: Loaded 2699 primary data records. [2025-10-17T22:42:03.743841] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:03.744667] [INFO ] [MAIN ] NAT: Generated 1820 derivative records from 49970 primary records. [2025-10-17T22:42:03.745080] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-10-17T22:42:03.764837] [DEBUG] [LOCAL ] NAT: Derivative data saved (1820 records). [2025-10-17T22:42:03.764972] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-10-17T22:42:03.769352] [INFO ] [MAIN ] Derivative Progress: 1250/2083 symbols completed. NAT took 1.5s. Estimated remaining: 5m 16s. Rate: 158.2 symbols/min [2025-10-17T22:42:03.770582] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:03.785505] [DEBUG] [MAIN ] NATL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:03.786586] [INFO ] [MAIN ] NATL: Generated 1820 derivative records from 33023 primary records. [2025-10-17T22:42:03.786883] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-10-17T22:42:03.806283] [DEBUG] [LOCAL ] NBB: Loaded 9173 existing records from primary storage. [2025-10-17T22:42:03.809109] [INFO ] [MAIN ] NBB: Loaded 9173 primary data records. [2025-10-17T22:42:03.822142] [DEBUG] [LOCAL ] NATL: Derivative data saved (1820 records). [2025-10-17T22:42:03.854453] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-10-17T22:42:03.857256] [INFO ] [MAIN ] Derivative Progress: 1251/2083 symbols completed. NATL took 1.4s. Estimated remaining: 5m 15s. Rate: 158.3 symbols/min [2025-10-17T22:42:03.879250] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:03.941203] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:03.972160] [INFO ] [MAIN ] NAZ: Generated 1820 derivative records from 2699 primary records. [2025-10-17T22:42:04.006323] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-17T22:42:04.149364] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1820 records). [2025-10-17T22:42:04.158088] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-10-17T22:42:04.161599] [INFO ] [MAIN ] Derivative Progress: 1252/2083 symbols completed. NAZ took 1.0s. Estimated remaining: 5m 15s. Rate: 158.3 symbols/min [2025-10-17T22:42:04.159244] [DEBUG] [LOCAL ] NBHC: Loaded 24150 existing records from primary storage. [2025-10-17T22:42:04.162517] [INFO ] [MAIN ] NBHC: Loaded 24150 primary data records. [2025-10-17T22:42:04.162709] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:04.492898] [DEBUG] [LOCAL ] NBR: Loaded 34897 existing records from primary storage. [2025-10-17T22:42:04.493567] [INFO ] [MAIN ] NBR: Loaded 34897 primary data records. [2025-10-17T22:42:04.639608] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:04.646945] [INFO ] [MAIN ] NBB: Generated 1820 derivative records from 9173 primary records. [2025-10-17T22:42:04.647228] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-17T22:42:04.849372] [DEBUG] [LOCAL ] NBB: Derivative data saved (1820 records). [2025-10-17T22:42:04.849738] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-10-17T22:42:04.851947] [INFO ] [MAIN ] Derivative Progress: 1253/2083 symbols completed. NBB took 1.1s. Estimated remaining: 5m 15s. Rate: 158.2 symbols/min [2025-10-17T22:42:04.852712] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:04.877337] [DEBUG] [MAIN ] NBHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:04.884525] [INFO ] [MAIN ] NBHC: Generated 1820 derivative records from 24150 primary records. [2025-10-17T22:42:04.884802] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-10-17T22:42:04.913428] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1820 records). [2025-10-17T22:42:04.914102] [DEBUG] [LOCAL ] NBXG: Loaded 22256 existing records from primary storage. [2025-10-17T22:42:04.914190] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-10-17T22:42:04.916703] [INFO ] [MAIN ] Derivative Progress: 1254/2083 symbols completed. NBHC took 1.0s. Estimated remaining: 5m 14s. Rate: 158.3 symbols/min [2025-10-17T22:42:04.917105] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:04.917478] [INFO ] [MAIN ] NBXG: Loaded 22256 primary data records. [2025-10-17T22:42:04.979570] [DEBUG] [LOCAL ] NC: Loaded 2000 existing records from primary storage. [2025-10-17T22:42:05.005571] [INFO ] [MAIN ] NC: Loaded 2000 primary data records. [2025-10-17T22:42:05.156380] [DEBUG] [MAIN ] NBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:05.206064] [INFO ] [MAIN ] NBR: Generated 1820 derivative records from 34897 primary records. [2025-10-17T22:42:05.375224] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-10-17T22:42:05.603119] [DEBUG] [LOCAL ] NBR: Derivative data saved (1820 records). [2025-10-17T22:42:05.613376] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-10-17T22:42:05.615381] [INFO ] [MAIN ] Derivative Progress: 1255/2083 symbols completed. NBR took 1.5s. Estimated remaining: 5m 14s. Rate: 158.2 symbols/min [2025-10-17T22:42:05.615547] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:05.628859] [DEBUG] [LOCAL ] NCA: Loaded 10059 existing records from primary storage. [2025-10-17T22:42:05.629453] [INFO ] [MAIN ] NCA: Loaded 10059 primary data records. [2025-10-17T22:42:05.793966] [DEBUG] [MAIN ] NBXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:05.925394] [INFO ] [MAIN ] NBXG: Generated 1820 derivative records from 22256 primary records. [2025-10-17T22:42:05.939283] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-10-17T22:42:05.954088] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:42:05.955963] [INFO ] [MAIN ] NC: Generated 1819 derivative records from 2000 primary records. [2025-10-17T22:42:05.956071] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-10-17T22:42:05.989847] [DEBUG] [LOCAL ] NC: Derivative data saved (1819 records). [2025-10-17T22:42:05.989531] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1820 records). [2025-10-17T22:42:05.990572] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-10-17T22:42:05.992981] [INFO ] [MAIN ] Derivative Progress: 1256/2083 symbols completed. NBXG took 1.1s. Estimated remaining: 5m 14s. Rate: 158.2 symbols/min [2025-10-17T22:42:05.989997] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-10-17T22:42:05.995568] [INFO ] [MAIN ] Derivative Progress: 1257/2083 symbols completed. NC took 1.1s. Estimated remaining: 5m 13s. Rate: 158.3 symbols/min [2025-10-17T22:42:05.995429] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:05.995717] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:06.031828] [DEBUG] [LOCAL ] NCV: Loaded 14136 existing records from primary storage. [2025-10-17T22:42:06.031520] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:06.031983] [INFO ] [MAIN ] NCV: Loaded 14136 primary data records. [2025-10-17T22:42:06.032691] [INFO ] [MAIN ] NCA: Generated 1820 derivative records from 10059 primary records. [2025-10-17T22:42:06.052086] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-17T22:42:06.098414] [DEBUG] [LOCAL ] NCDL: Loaded 22009 existing records from primary storage. [2025-10-17T22:42:06.143061] [INFO ] [MAIN ] NCDL: Loaded 22009 primary data records. [2025-10-17T22:42:06.180804] [DEBUG] [LOCAL ] NCA: Derivative data saved (1820 records). [2025-10-17T22:42:06.196844] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-10-17T22:42:06.225258] [INFO ] [MAIN ] Derivative Progress: 1258/2083 symbols completed. NCA took 0.6s. Estimated remaining: 5m 13s. Rate: 158.4 symbols/min [2025-10-17T22:42:06.684871] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:06.685730] [INFO ] [MAIN ] NCV: Generated 1820 derivative records from 14136 primary records. [2025-10-17T22:42:06.685818] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-10-17T22:42:06.717592] [DEBUG] [LOCAL ] NCV: Derivative data saved (1820 records). [2025-10-17T22:42:06.718124] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-10-17T22:42:06.717964] [DEBUG] [MAIN ] NCDL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:06.720409] [INFO ] [MAIN ] Derivative Progress: 1259/2083 symbols completed. NCV took 0.7s. Estimated remaining: 5m 12s. Rate: 158.3 symbols/min [2025-10-17T22:42:06.721400] [INFO ] [MAIN ] NCDL: Generated 1820 derivative records from 22009 primary records. [2025-10-17T22:42:06.721506] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-10-17T22:42:06.737028] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1820 records). [2025-10-17T22:42:06.737088] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-10-17T22:42:06.739265] [INFO ] [MAIN ] Derivative Progress: 1260/2083 symbols completed. NCDL took 0.7s. Estimated remaining: 5m 12s. Rate: 158.5 symbols/min [2025-10-17T22:42:06.739762] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:06.739840] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:06.739679] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:06.758962] [DEBUG] [LOCAL ] NCZ: Loaded 12580 existing records from primary storage. [2025-10-17T22:42:06.764737] [INFO ] [MAIN ] NCZ: Loaded 12580 primary data records. [2025-10-17T22:42:06.785878] [DEBUG] [LOCAL ] NDMO: Loaded 17181 existing records from primary storage. [2025-10-17T22:42:06.819408] [INFO ] [MAIN ] NDMO: Loaded 17181 primary data records. [2025-10-17T22:42:07.079616] [DEBUG] [LOCAL ] NE: Loaded 53135 existing records from primary storage. [2025-10-17T22:42:07.246505] [INFO ] [MAIN ] NE: Loaded 53135 primary data records. [2025-10-17T22:42:07.778305] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:07.779458] [INFO ] [MAIN ] NCZ: Generated 1820 derivative records from 12580 primary records. [2025-10-17T22:42:07.779598] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-17T22:42:07.815093] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1820 records). [2025-10-17T22:42:07.816757] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-10-17T22:42:07.819337] [INFO ] [MAIN ] Derivative Progress: 1261/2083 symbols completed. NCZ took 1.1s. Estimated remaining: 5m 12s. Rate: 158.2 symbols/min [2025-10-17T22:42:07.819501] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:07.817166] [DEBUG] [MAIN ] NDMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:07.821568] [INFO ] [MAIN ] NDMO: Generated 1820 derivative records from 17181 primary records. [2025-10-17T22:42:07.822073] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-10-17T22:42:07.855388] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1820 records). [2025-10-17T22:42:07.856067] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-10-17T22:42:07.858832] [INFO ] [MAIN ] Derivative Progress: 1262/2083 symbols completed. NDMO took 1.1s. Estimated remaining: 5m 11s. Rate: 158.3 symbols/min [2025-10-17T22:42:07.856453] [DEBUG] [MAIN ] NE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:07.859175] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:07.860186] [INFO ] [MAIN ] NE: Generated 1820 derivative records from 53135 primary records. [2025-10-17T22:42:07.860332] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-10-17T22:42:07.887235] [DEBUG] [LOCAL ] NE: Derivative data saved (1820 records). [2025-10-17T22:42:07.887433] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-10-17T22:42:07.889843] [INFO ] [MAIN ] Derivative Progress: 1263/2083 symbols completed. NE took 1.1s. Estimated remaining: 5m 11s. Rate: 158.4 symbols/min [2025-10-17T22:42:07.890139] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:07.904958] [DEBUG] [LOCAL ] NEA: Loaded 35712 existing records from primary storage. [2025-10-17T22:42:07.905189] [INFO ] [MAIN ] NEA: Loaded 35712 primary data records. [2025-10-17T22:42:08.289834] [DEBUG] [LOCAL ] NEE: Loaded 54487 existing records from primary storage. [2025-10-17T22:42:08.290853] [INFO ] [MAIN ] NEE: Loaded 54487 primary data records. [2025-10-17T22:42:08.290637] [DEBUG] [LOCAL ] NEM: Loaded 54488 existing records from primary storage. [2025-10-17T22:42:08.297263] [INFO ] [MAIN ] NEM: Loaded 54488 primary data records. [2025-10-17T22:42:08.987250] [DEBUG] [MAIN ] NEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:08.988621] [INFO ] [MAIN ] NEA: Generated 1820 derivative records from 35712 primary records. [2025-10-17T22:42:08.988990] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-10-17T22:42:09.008357] [DEBUG] [LOCAL ] NEA: Derivative data saved (1820 records). [2025-10-17T22:42:09.008947] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-10-17T22:42:09.011310] [INFO ] [MAIN ] Derivative Progress: 1264/2083 symbols completed. NEA took 1.2s. Estimated remaining: 5m 11s. Rate: 158.2 symbols/min [2025-10-17T22:42:09.011695] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:09.039330] [DEBUG] [MAIN ] NEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:09.044627] [DEBUG] [MAIN ] NEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:09.045506] [INFO ] [MAIN ] NEE: Generated 1820 derivative records from 54487 primary records. [2025-10-17T22:42:09.046355] [INFO ] [MAIN ] NEM: Generated 1820 derivative records from 54488 primary records. [2025-10-17T22:42:09.046458] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-10-17T22:42:09.047394] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-10-17T22:42:09.072097] [DEBUG] [LOCAL ] NEE: Derivative data saved (1820 records). [2025-10-17T22:42:09.074888] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-10-17T22:42:09.080933] [INFO ] [MAIN ] Derivative Progress: 1265/2083 symbols completed. NEE took 1.2s. Estimated remaining: 5m 10s. Rate: 158.3 symbols/min [2025-10-17T22:42:09.078973] [DEBUG] [LOCAL ] NEM: Derivative data saved (1820 records). [2025-10-17T22:42:09.081192] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-10-17T22:42:09.081318] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:09.083699] [INFO ] [MAIN ] Derivative Progress: 1266/2083 symbols completed. NEM took 1.2s. Estimated remaining: 5m 9s. Rate: 158.4 symbols/min [2025-10-17T22:42:09.083947] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:09.105968] [DEBUG] [LOCAL ] NEXA: Loaded 5430 existing records from primary storage. [2025-10-17T22:42:09.106197] [INFO ] [MAIN ] NEXA: Loaded 5430 primary data records. [2025-10-17T22:42:09.202685] [DEBUG] [LOCAL ] NEU: Loaded 8654 existing records from primary storage. [2025-10-17T22:42:09.222108] [INFO ] [MAIN ] NEU: Loaded 8654 primary data records. [2025-10-17T22:42:09.273937] [DEBUG] [LOCAL ] NET: Loaded 53652 existing records from primary storage. [2025-10-17T22:42:09.353198] [INFO ] [MAIN ] NET: Loaded 53652 primary data records. [2025-10-17T22:42:10.074817] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:10.076013] [INFO ] [MAIN ] NEXA: Generated 1820 derivative records from 5430 primary records. [2025-10-17T22:42:10.076354] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-10-17T22:42:10.092690] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1820 records). [2025-10-17T22:42:10.093151] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-10-17T22:42:10.095262] [INFO ] [MAIN ] Derivative Progress: 1267/2083 symbols completed. NEXA took 1.0s. Estimated remaining: 5m 9s. Rate: 158.2 symbols/min [2025-10-17T22:42:10.096375] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:10.111916] [DEBUG] [MAIN ] NEU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:10.113048] [INFO ] [MAIN ] NEU: Generated 1820 derivative records from 8654 primary records. [2025-10-17T22:42:10.113913] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-10-17T22:42:10.143338] [DEBUG] [MAIN ] NET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:10.145250] [INFO ] [MAIN ] NET: Generated 1820 derivative records from 53652 primary records. [2025-10-17T22:42:10.146751] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-10-17T22:42:10.174251] [DEBUG] [LOCAL ] NET: Derivative data saved (1820 records). [2025-10-17T22:42:10.174392] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-10-17T22:42:10.173146] [DEBUG] [LOCAL ] NEU: Derivative data saved (1820 records). [2025-10-17T22:42:10.176622] [INFO ] [MAIN ] Derivative Progress: 1268/2083 symbols completed. NET took 1.2s. Estimated remaining: 5m 9s. Rate: 158.3 symbols/min [2025-10-17T22:42:10.177105] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:10.176952] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-10-17T22:42:10.180558] [INFO ] [MAIN ] Derivative Progress: 1269/2083 symbols completed. NEU took 1.1s. Estimated remaining: 5m 8s. Rate: 158.4 symbols/min [2025-10-17T22:42:10.190751] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:10.193771] [DEBUG] [LOCAL ] NFG: Loaded 39051 existing records from primary storage. [2025-10-17T22:42:10.194136] [INFO ] [MAIN ] NFG: Loaded 39051 primary data records. [2025-10-17T22:42:10.355625] [DEBUG] [LOCAL ] NFJ: Loaded 20526 existing records from primary storage. [2025-10-17T22:42:10.372313] [INFO ] [MAIN ] NFJ: Loaded 20526 primary data records. [2025-10-17T22:42:10.645559] [DEBUG] [LOCAL ] NGG: Loaded 47373 existing records from primary storage. [2025-10-17T22:42:10.646134] [INFO ] [MAIN ] NGG: Loaded 47373 primary data records. [2025-10-17T22:42:11.240486] [DEBUG] [MAIN ] NFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:11.242860] [INFO ] [MAIN ] NFG: Generated 1820 derivative records from 39051 primary records. [2025-10-17T22:42:11.243146] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-10-17T22:42:11.264916] [DEBUG] [LOCAL ] NFG: Derivative data saved (1820 records). [2025-10-17T22:42:11.265247] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-10-17T22:42:11.267638] [INFO ] [MAIN ] Derivative Progress: 1270/2083 symbols completed. NFG took 1.2s. Estimated remaining: 5m 8s. Rate: 158.2 symbols/min [2025-10-17T22:42:11.276272] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:11.282917] [DEBUG] [MAIN ] NFJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:11.284289] [INFO ] [MAIN ] NFJ: Generated 1820 derivative records from 20526 primary records. [2025-10-17T22:42:11.284730] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-10-17T22:42:11.303055] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1820 records). [2025-10-17T22:42:11.304338] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-10-17T22:42:11.307513] [INFO ] [MAIN ] Derivative Progress: 1271/2083 symbols completed. NFJ took 1.1s. Estimated remaining: 5m 8s. Rate: 158.3 symbols/min [2025-10-17T22:42:11.307769] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:11.322628] [DEBUG] [MAIN ] NGG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:11.323467] [INFO ] [MAIN ] NGG: Generated 1820 derivative records from 47373 primary records. [2025-10-17T22:42:11.323607] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-10-17T22:42:11.364232] [DEBUG] [LOCAL ] NGS: Loaded 11294 existing records from primary storage. [2025-10-17T22:42:11.364886] [INFO ] [MAIN ] NGS: Loaded 11294 primary data records. [2025-10-17T22:42:11.364982] [DEBUG] [LOCAL ] NGG: Derivative data saved (1820 records). [2025-10-17T22:42:11.377319] [DEBUG] [LOCAL ] NGL: Loaded 30303 existing records from primary storage. [2025-10-17T22:42:11.386602] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-10-17T22:42:11.402817] [INFO ] [MAIN ] NGL: Loaded 30303 primary data records. [2025-10-17T22:42:11.412609] [INFO ] [MAIN ] Derivative Progress: 1272/2083 symbols completed. NGG took 1.2s. Estimated remaining: 5m 7s. Rate: 158.4 symbols/min [2025-10-17T22:42:11.445050] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:11.697744] [DEBUG] [LOCAL ] NGVC: Loaded 23195 existing records from primary storage. [2025-10-17T22:42:11.847292] [INFO ] [MAIN ] NGVC: Loaded 23195 primary data records. [2025-10-17T22:42:12.330176] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:12.316529] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:12.331365] [INFO ] [MAIN ] NGL: Generated 1820 derivative records from 30303 primary records. [2025-10-17T22:42:12.331465] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-10-17T22:42:12.333048] [INFO ] [MAIN ] NGS: Generated 1820 derivative records from 11294 primary records. [2025-10-17T22:42:12.341016] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-10-17T22:42:12.363851] [DEBUG] [LOCAL ] NGL: Derivative data saved (1820 records). [2025-10-17T22:42:12.366376] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-10-17T22:42:12.368852] [INFO ] [MAIN ] Derivative Progress: 1273/2083 symbols completed. NGL took 1.1s. Estimated remaining: 5m 7s. Rate: 158.2 symbols/min [2025-10-17T22:42:12.366293] [DEBUG] [LOCAL ] NGS: Derivative data saved (1820 records). [2025-10-17T22:42:12.369304] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-10-17T22:42:12.371806] [INFO ] [MAIN ] Derivative Progress: 1274/2083 symbols completed. NGS took 1.1s. Estimated remaining: 5m 7s. Rate: 158.3 symbols/min [2025-10-17T22:42:12.387503] [DEBUG] [MAIN ] NGVC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:12.388091] [INFO ] [MAIN ] NGVC: Generated 1820 derivative records from 23195 primary records. [2025-10-17T22:42:12.388151] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-10-17T22:42:12.403416] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1820 records). [2025-10-17T22:42:12.403473] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-10-17T22:42:12.405795] [INFO ] [MAIN ] Derivative Progress: 1275/2083 symbols completed. NGVC took 1.0s. Estimated remaining: 5m 6s. Rate: 158.5 symbols/min [2025-10-17T22:42:12.406322] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:12.406394] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:12.406470] [INFO ] [MAIN ] NI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:12.435745] [DEBUG] [LOCAL ] NHI: Loaded 22366 existing records from primary storage. [2025-10-17T22:42:12.435878] [INFO ] [MAIN ] NHI: Loaded 22366 primary data records. [2025-10-17T22:42:12.480461] [DEBUG] [LOCAL ] NGVT: Loaded 24418 existing records from primary storage. [2025-10-17T22:42:12.499804] [INFO ] [MAIN ] NGVT: Loaded 24418 primary data records. [2025-10-17T22:42:13.041767] [DEBUG] [LOCAL ] NI: Loaded 54184 existing records from primary storage. [2025-10-17T22:42:13.105029] [INFO ] [MAIN ] NI: Loaded 54184 primary data records. [2025-10-17T22:42:13.429808] [DEBUG] [MAIN ] NHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:13.432283] [INFO ] [MAIN ] NHI: Generated 1820 derivative records from 22366 primary records. [2025-10-17T22:42:13.433060] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-10-17T22:42:13.460871] [DEBUG] [MAIN ] NGVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:13.462401] [INFO ] [MAIN ] NGVT: Generated 1820 derivative records from 24418 primary records. [2025-10-17T22:42:13.463405] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-10-17T22:42:13.466454] [DEBUG] [LOCAL ] NHI: Derivative data saved (1820 records). [2025-10-17T22:42:13.477437] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-10-17T22:42:13.484158] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1820 records). [2025-10-17T22:42:13.484278] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-10-17T22:42:13.480891] [INFO ] [MAIN ] Derivative Progress: 1276/2083 symbols completed. NHI took 1.1s. Estimated remaining: 5m 6s. Rate: 158.2 symbols/min [2025-10-17T22:42:13.486813] [INFO ] [MAIN ] Derivative Progress: 1277/2083 symbols completed. NGVT took 1.1s. Estimated remaining: 5m 5s. Rate: 158.4 symbols/min [2025-10-17T22:42:13.486750] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:13.486960] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:13.504161] [DEBUG] [MAIN ] NI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:13.504895] [INFO ] [MAIN ] NI: Generated 1820 derivative records from 54184 primary records. [2025-10-17T22:42:13.510417] [DEBUG] [LOCAL ] NI: Saving derivative data. [2025-10-17T22:42:13.527617] [DEBUG] [LOCAL ] NIC: Loaded 9031 existing records from primary storage. [2025-10-17T22:42:13.532852] [INFO ] [MAIN ] NIC: Loaded 9031 primary data records. [2025-10-17T22:42:13.557271] [DEBUG] [LOCAL ] NI: Derivative data saved (1820 records). [2025-10-17T22:42:13.556143] [DEBUG] [LOCAL ] NIE: Loaded 12094 existing records from primary storage. [2025-10-17T22:42:13.591842] [INFO ] [MAIN ] NI: Successfully saved derivative data. [2025-10-17T22:42:13.592097] [INFO ] [MAIN ] NIE: Loaded 12094 primary data records. [2025-10-17T22:42:13.614316] [INFO ] [MAIN ] Derivative Progress: 1278/2083 symbols completed. NI took 1.2s. Estimated remaining: 5m 5s. Rate: 158.4 symbols/min [2025-10-17T22:42:13.669893] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:13.835003] [DEBUG] [LOCAL ] NIM: Loaded 3590 existing records from primary storage. [2025-10-17T22:42:13.942709] [INFO ] [MAIN ] NIM: Loaded 3590 primary data records. [2025-10-17T22:42:14.476476] [DEBUG] [MAIN ] NIC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:14.477487] [INFO ] [MAIN ] NIC: Generated 1820 derivative records from 9031 primary records. [2025-10-17T22:42:14.479336] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-10-17T22:42:14.508247] [DEBUG] [LOCAL ] NIC: Derivative data saved (1820 records). [2025-10-17T22:42:14.509187] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-10-17T22:42:14.511515] [INFO ] [MAIN ] Derivative Progress: 1279/2083 symbols completed. NIC took 1.0s. Estimated remaining: 5m 5s. Rate: 158.3 symbols/min [2025-10-17T22:42:14.511692] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:14.509367] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:14.512777] [INFO ] [MAIN ] NIE: Generated 1820 derivative records from 12094 primary records. [2025-10-17T22:42:14.512946] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-17T22:42:14.539556] [DEBUG] [LOCAL ] NIE: Derivative data saved (1820 records). [2025-10-17T22:42:14.545366] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-10-17T22:42:14.545301] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:14.546287] [INFO ] [MAIN ] NIM: Generated 1820 derivative records from 3590 primary records. [2025-10-17T22:42:14.548756] [INFO ] [MAIN ] Derivative Progress: 1280/2083 symbols completed. NIE took 1.1s. Estimated remaining: 5m 4s. Rate: 158.4 symbols/min [2025-10-17T22:42:14.548891] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:14.549479] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-10-17T22:42:14.583195] [DEBUG] [LOCAL ] NIM: Derivative data saved (1820 records). [2025-10-17T22:42:14.584639] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-10-17T22:42:14.587814] [INFO ] [MAIN ] Derivative Progress: 1281/2083 symbols completed. NIM took 0.9s. Estimated remaining: 5m 4s. Rate: 158.5 symbols/min [2025-10-17T22:42:14.587983] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:14.588941] [DEBUG] [LOCAL ] NINE: Loaded 28875 existing records from primary storage. [2025-10-17T22:42:14.590502] [INFO ] [MAIN ] NINE: Loaded 28875 primary data records. [2025-10-17T22:42:14.981540] [DEBUG] [LOCAL ] NIO: Loaded 54582 existing records from primary storage. [2025-10-17T22:42:14.981773] [INFO ] [MAIN ] NIO: Loaded 54582 primary data records. [2025-10-17T22:42:14.982352] [DEBUG] [LOCAL ] NJR: Loaded 38726 existing records from primary storage. [2025-10-17T22:42:15.002864] [INFO ] [MAIN ] NJR: Loaded 38726 primary data records. [2025-10-17T22:42:15.616202] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:15.618557] [INFO ] [MAIN ] NINE: Generated 1820 derivative records from 28875 primary records. [2025-10-17T22:42:15.618964] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-10-17T22:42:15.637468] [DEBUG] [LOCAL ] NINE: Derivative data saved (1820 records). [2025-10-17T22:42:15.639033] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-10-17T22:42:15.641547] [INFO ] [MAIN ] Derivative Progress: 1282/2083 symbols completed. NINE took 1.1s. Estimated remaining: 5m 4s. Rate: 158.3 symbols/min [2025-10-17T22:42:15.641742] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:15.658369] [DEBUG] [MAIN ] NJR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:15.660937] [INFO ] [MAIN ] NJR: Generated 1820 derivative records from 38726 primary records. [2025-10-17T22:42:15.661213] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-10-17T22:42:15.686370] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:15.688527] [INFO ] [MAIN ] NIO: Generated 1820 derivative records from 54582 primary records. [2025-10-17T22:42:15.691340] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-10-17T22:42:15.714784] [DEBUG] [LOCAL ] NJR: Derivative data saved (1820 records). [2025-10-17T22:42:15.715156] [DEBUG] [LOCAL ] NKX: Loaded 13862 existing records from primary storage. [2025-10-17T22:42:15.717869] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-10-17T22:42:15.721609] [DEBUG] [LOCAL ] NIO: Derivative data saved (1820 records). [2025-10-17T22:42:15.721796] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-10-17T22:42:15.720941] [INFO ] [MAIN ] Derivative Progress: 1283/2083 symbols completed. NJR took 1.1s. Estimated remaining: 5m 3s. Rate: 158.4 symbols/min [2025-10-17T22:42:15.724176] [INFO ] [MAIN ] NKX: Loaded 13862 primary data records. [2025-10-17T22:42:15.724447] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:15.730033] [INFO ] [MAIN ] Derivative Progress: 1284/2083 symbols completed. NIO took 1.2s. Estimated remaining: 5m 2s. Rate: 158.5 symbols/min [2025-10-17T22:42:15.763345] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:15.881475] [DEBUG] [LOCAL ] NLOP: Loaded 11880 existing records from primary storage. [2025-10-17T22:42:15.920839] [INFO ] [MAIN ] NLOP: Loaded 11880 primary data records. [2025-10-17T22:42:16.058282] [DEBUG] [LOCAL ] NMAI: Loaded 13002 existing records from primary storage. [2025-10-17T22:42:16.102278] [INFO ] [MAIN ] NMAI: Loaded 13002 primary data records. [2025-10-17T22:42:16.684486] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:16.686302] [INFO ] [MAIN ] NKX: Generated 1820 derivative records from 13862 primary records. [2025-10-17T22:42:16.686696] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-10-17T22:42:16.704413] [DEBUG] [LOCAL ] NKX: Derivative data saved (1820 records). [2025-10-17T22:42:16.704679] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-10-17T22:42:16.708130] [INFO ] [MAIN ] Derivative Progress: 1285/2083 symbols completed. NKX took 1.1s. Estimated remaining: 5m 2s. Rate: 158.3 symbols/min [2025-10-17T22:42:16.710535] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:16.724903] [DEBUG] [MAIN ] NLOP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:16.725888] [INFO ] [MAIN ] NLOP: Generated 1820 derivative records from 11880 primary records. [2025-10-17T22:42:16.726212] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-10-17T22:42:16.762916] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1820 records). [2025-10-17T22:42:16.763222] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:16.768817] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-10-17T22:42:16.770350] [INFO ] [MAIN ] NMAI: Generated 1820 derivative records from 13002 primary records. [2025-10-17T22:42:16.770882] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-10-17T22:42:16.770725] [DEBUG] [LOCAL ] NMCO: Loaded 16861 existing records from primary storage. [2025-10-17T22:42:16.773307] [INFO ] [MAIN ] Derivative Progress: 1286/2083 symbols completed. NLOP took 1.0s. Estimated remaining: 5m 2s. Rate: 158.4 symbols/min [2025-10-17T22:42:16.773426] [INFO ] [MAIN ] NMCO: Loaded 16861 primary data records. [2025-10-17T22:42:16.773600] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:16.896527] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1820 records). [2025-10-17T22:42:16.897063] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-10-17T22:42:16.899472] [INFO ] [MAIN ] Derivative Progress: 1287/2083 symbols completed. NMAI took 1.1s. Estimated remaining: 5m 1s. Rate: 158.5 symbols/min [2025-10-17T22:42:16.904915] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:16.920794] [DEBUG] [LOCAL ] NMG: Loaded 11397 existing records from primary storage. [2025-10-17T22:42:16.944315] [INFO ] [MAIN ] NMG: Loaded 11397 primary data records. [2025-10-17T22:42:17.138026] [DEBUG] [LOCAL ] NMI: Loaded 4080 existing records from primary storage. [2025-10-17T22:42:17.156418] [INFO ] [MAIN ] NMI: Loaded 4080 primary data records. [2025-10-17T22:42:17.778074] [DEBUG] [MAIN ] NMCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:17.779739] [INFO ] [MAIN ] NMCO: Generated 1820 derivative records from 16861 primary records. [2025-10-17T22:42:17.779968] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-10-17T22:42:17.800013] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1820 records). [2025-10-17T22:42:17.800439] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-10-17T22:42:17.802828] [INFO ] [MAIN ] Derivative Progress: 1288/2083 symbols completed. NMCO took 1.1s. Estimated remaining: 5m 1s. Rate: 158.3 symbols/min [2025-10-17T22:42:17.819665] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:17.821073] [INFO ] [MAIN ] NMI: Generated 1820 derivative records from 4080 primary records. [2025-10-17T22:42:17.821808] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-17T22:42:17.847038] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:17.849213] [INFO ] [MAIN ] NMG: Generated 1820 derivative records from 11397 primary records. [2025-10-17T22:42:17.849555] [DEBUG] [LOCAL ] NMI: Derivative data saved (1820 records). [2025-10-17T22:42:17.849620] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-10-17T22:42:17.849725] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-10-17T22:42:17.851864] [INFO ] [MAIN ] Derivative Progress: 1289/2083 symbols completed. NMI took 0.9s. Estimated remaining: 5m 1s. Rate: 158.4 symbols/min [2025-10-17T22:42:17.866761] [DEBUG] [LOCAL ] NMG: Derivative data saved (1820 records). [2025-10-17T22:42:17.866820] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-10-17T22:42:17.869158] [INFO ] [MAIN ] Derivative Progress: 1290/2083 symbols completed. NMG took 1.1s. Estimated remaining: 5m 0s. Rate: 158.5 symbols/min [2025-10-17T22:42:17.869610] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:17.869741] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:17.870258] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:17.876035] [DEBUG] [LOCAL ] NMS: Loaded 2936 existing records from primary storage. [2025-10-17T22:42:17.876210] [INFO ] [MAIN ] NMS: Loaded 2936 primary data records. [2025-10-17T22:42:17.996978] [DEBUG] [LOCAL ] NMM: Loaded 14552 existing records from primary storage. [2025-10-17T22:42:18.013238] [INFO ] [MAIN ] NMM: Loaded 14552 primary data records. [2025-10-17T22:42:18.123677] [DEBUG] [LOCAL ] NMR: Loaded 36138 existing records from primary storage. [2025-10-17T22:42:18.131913] [INFO ] [MAIN ] NMR: Loaded 36138 primary data records. [2025-10-17T22:42:18.896555] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:18.897528] [INFO ] [MAIN ] NMS: Generated 1820 derivative records from 2936 primary records. [2025-10-17T22:42:18.897755] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-17T22:42:18.913696] [DEBUG] [LOCAL ] NMS: Derivative data saved (1820 records). [2025-10-17T22:42:18.913886] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-10-17T22:42:18.915954] [INFO ] [MAIN ] Derivative Progress: 1291/2083 symbols completed. NMS took 1.0s. Estimated remaining: 5m 0s. Rate: 158.3 symbols/min [2025-10-17T22:42:18.916243] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:18.935586] [DEBUG] [MAIN ] NMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:18.935876] [DEBUG] [LOCAL ] NMT: Loaded 2867 existing records from primary storage. [2025-10-17T22:42:18.936189] [INFO ] [MAIN ] NMT: Loaded 2867 primary data records. [2025-10-17T22:42:18.936860] [INFO ] [MAIN ] NMM: Generated 1820 derivative records from 14552 primary records. [2025-10-17T22:42:18.936952] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-10-17T22:42:19.063824] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:19.066093] [INFO ] [MAIN ] NMR: Generated 1820 derivative records from 36138 primary records. [2025-10-17T22:42:19.076785] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-10-17T22:42:19.083149] [DEBUG] [LOCAL ] NMM: Derivative data saved (1820 records). [2025-10-17T22:42:19.083494] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-10-17T22:42:19.096343] [INFO ] [MAIN ] Derivative Progress: 1292/2083 symbols completed. NMM took 1.2s. Estimated remaining: 4m 60s. Rate: 158.4 symbols/min [2025-10-17T22:42:19.141276] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:19.276580] [DEBUG] [LOCAL ] NMR: Derivative data saved (1820 records). [2025-10-17T22:42:19.276828] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-10-17T22:42:19.278961] [INFO ] [MAIN ] Derivative Progress: 1293/2083 symbols completed. NMR took 1.4s. Estimated remaining: 4m 59s. Rate: 158.4 symbols/min [2025-10-17T22:42:19.279755] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:19.305816] [DEBUG] [LOCAL ] NMZ: Loaded 21897 existing records from primary storage. [2025-10-17T22:42:19.305472] [DEBUG] [LOCAL ] NNI: Loaded 10605 existing records from primary storage. [2025-10-17T22:42:19.306062] [INFO ] [MAIN ] NNI: Loaded 10605 primary data records. [2025-10-17T22:42:19.306014] [INFO ] [MAIN ] NMZ: Loaded 21897 primary data records. [2025-10-17T22:42:19.792285] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:19.908593] [INFO ] [MAIN ] NMT: Generated 1820 derivative records from 2867 primary records. [2025-10-17T22:42:19.912907] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-17T22:42:19.931700] [DEBUG] [LOCAL ] NMT: Derivative data saved (1820 records). [2025-10-17T22:42:19.931869] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-10-17T22:42:19.934098] [INFO ] [MAIN ] Derivative Progress: 1294/2083 symbols completed. NMT took 1.0s. Estimated remaining: 4m 59s. Rate: 158.3 symbols/min [2025-10-17T22:42:19.934343] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:19.971504] [DEBUG] [MAIN ] NMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:19.971705] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:19.972460] [INFO ] [MAIN ] NNI: Generated 1820 derivative records from 10605 primary records. [2025-10-17T22:42:19.973172] [INFO ] [MAIN ] NMZ: Generated 1820 derivative records from 21897 primary records. [2025-10-17T22:42:19.972588] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-10-17T22:42:19.973306] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-10-17T22:42:20.015020] [DEBUG] [LOCAL ] NNI: Derivative data saved (1820 records). [2025-10-17T22:42:20.027568] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-10-17T22:42:20.014961] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1820 records). [2025-10-17T22:42:20.028815] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-10-17T22:42:20.031156] [INFO ] [MAIN ] Derivative Progress: 1295/2083 symbols completed. NNI took 0.8s. Estimated remaining: 4m 58s. Rate: 158.4 symbols/min [2025-10-17T22:42:20.033511] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:20.033661] [INFO ] [MAIN ] Derivative Progress: 1296/2083 symbols completed. NMZ took 0.9s. Estimated remaining: 4m 58s. Rate: 158.6 symbols/min [2025-10-17T22:42:20.035041] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:20.034836] [DEBUG] [LOCAL ] NNN: Loaded 48962 existing records from primary storage. [2025-10-17T22:42:20.035447] [INFO ] [MAIN ] NNN: Loaded 48962 primary data records. [2025-10-17T22:42:20.134102] [DEBUG] [LOCAL ] NNY: Loaded 5778 existing records from primary storage. [2025-10-17T22:42:20.144825] [INFO ] [MAIN ] NNY: Loaded 5778 primary data records. [2025-10-17T22:42:20.206838] [DEBUG] [LOCAL ] NOA: Loaded 16210 existing records from primary storage. [2025-10-17T22:42:20.231337] [INFO ] [MAIN ] NOA: Loaded 16210 primary data records. [2025-10-17T22:42:21.002804] [DEBUG] [MAIN ] NNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:21.003692] [INFO ] [MAIN ] NNN: Generated 1820 derivative records from 48962 primary records. [2025-10-17T22:42:21.003925] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-10-17T22:42:21.033770] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:21.036146] [INFO ] [MAIN ] NNY: Generated 1820 derivative records from 5778 primary records. [2025-10-17T22:42:21.036597] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-17T22:42:21.039423] [DEBUG] [LOCAL ] NNN: Derivative data saved (1820 records). [2025-10-17T22:42:21.039808] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-10-17T22:42:21.054965] [INFO ] [MAIN ] Derivative Progress: 1297/2083 symbols completed. NNN took 1.1s. Estimated remaining: 4m 58s. Rate: 158.4 symbols/min [2025-10-17T22:42:21.055288] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:21.058178] [DEBUG] [LOCAL ] NNY: Derivative data saved (1820 records). [2025-10-17T22:42:21.065953] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-10-17T22:42:21.068510] [INFO ] [MAIN ] Derivative Progress: 1298/2083 symbols completed. NNY took 1.0s. Estimated remaining: 4m 57s. Rate: 158.5 symbols/min [2025-10-17T22:42:21.074256] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:21.074151] [DEBUG] [MAIN ] NOA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:21.075272] [INFO ] [MAIN ] NOA: Generated 1820 derivative records from 16210 primary records. [2025-10-17T22:42:21.075494] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-10-17T22:42:21.099411] [DEBUG] [LOCAL ] NOA: Derivative data saved (1820 records). [2025-10-17T22:42:21.099545] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-10-17T22:42:21.101723] [INFO ] [MAIN ] Derivative Progress: 1299/2083 symbols completed. NOA took 1.1s. Estimated remaining: 4m 57s. Rate: 158.6 symbols/min [2025-10-17T22:42:21.101943] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:21.111628] [DEBUG] [LOCAL ] NOAH: Loaded 20519 existing records from primary storage. [2025-10-17T22:42:21.111867] [INFO ] [MAIN ] NOAH: Loaded 20519 primary data records. [2025-10-17T22:42:21.289247] [DEBUG] [LOCAL ] NOC: Loaded 42214 existing records from primary storage. [2025-10-17T22:42:21.435452] [INFO ] [MAIN ] NOC: Loaded 42214 primary data records. [2025-10-17T22:42:21.594172] [DEBUG] [LOCAL ] NOG: Loaded 52110 existing records from primary storage. [2025-10-17T22:42:21.600093] [INFO ] [MAIN ] NOG: Loaded 52110 primary data records. [2025-10-17T22:42:22.125098] [DEBUG] [MAIN ] NOAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:22.126362] [INFO ] [MAIN ] NOAH: Generated 1820 derivative records from 20519 primary records. [2025-10-17T22:42:22.126537] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-10-17T22:42:22.164315] [DEBUG] [MAIN ] NOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:22.163962] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1820 records). [2025-10-17T22:42:22.164527] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-10-17T22:42:22.168001] [INFO ] [MAIN ] NOC: Generated 1820 derivative records from 42214 primary records. [2025-10-17T22:42:22.167032] [INFO ] [MAIN ] Derivative Progress: 1300/2083 symbols completed. NOAH took 1.1s. Estimated remaining: 4m 57s. Rate: 158.4 symbols/min [2025-10-17T22:42:22.168235] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:22.168934] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-10-17T22:42:22.194866] [DEBUG] [LOCAL ] NOC: Derivative data saved (1820 records). [2025-10-17T22:42:22.195372] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-10-17T22:42:22.199638] [INFO ] [MAIN ] Derivative Progress: 1301/2083 symbols completed. NOC took 1.1s. Estimated remaining: 4m 56s. Rate: 158.5 symbols/min [2025-10-17T22:42:22.200541] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:22.217882] [DEBUG] [MAIN ] NOG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:22.218691] [INFO ] [MAIN ] NOG: Generated 1820 derivative records from 52110 primary records. [2025-10-17T22:42:22.218757] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-10-17T22:42:22.250356] [DEBUG] [LOCAL ] NOG: Derivative data saved (1820 records). [2025-10-17T22:42:22.250567] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-10-17T22:42:22.252759] [INFO ] [MAIN ] Derivative Progress: 1302/2083 symbols completed. NOG took 1.2s. Estimated remaining: 4m 55s. Rate: 158.6 symbols/min [2025-10-17T22:42:22.252997] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:22.274354] [DEBUG] [LOCAL ] NOK: Loaded 54402 existing records from primary storage. [2025-10-17T22:42:22.286802] [INFO ] [MAIN ] NOK: Loaded 54402 primary data records. [2025-10-17T22:42:22.459259] [DEBUG] [LOCAL ] NOMD: Loaded 43553 existing records from primary storage. [2025-10-17T22:42:22.510998] [INFO ] [MAIN ] NOMD: Loaded 43553 primary data records. [2025-10-17T22:42:22.649356] [DEBUG] [LOCAL ] NOTE: Loaded 40766 existing records from primary storage. [2025-10-17T22:42:22.668324] [INFO ] [MAIN ] NOTE: Loaded 40766 primary data records. [2025-10-17T22:42:23.295086] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:23.296733] [INFO ] [MAIN ] NOK: Generated 1820 derivative records from 54402 primary records. [2025-10-17T22:42:23.297782] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-10-17T22:42:23.315366] [DEBUG] [LOCAL ] NOK: Derivative data saved (1820 records). [2025-10-17T22:42:23.315608] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-10-17T22:42:23.318275] [INFO ] [MAIN ] Derivative Progress: 1303/2083 symbols completed. NOK took 1.2s. Estimated remaining: 4m 56s. Rate: 158.4 symbols/min [2025-10-17T22:42:23.337418] [DEBUG] [MAIN ] NOMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:23.338977] [INFO ] [MAIN ] NOMD: Generated 1820 derivative records from 43553 primary records. [2025-10-17T22:42:23.339097] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-10-17T22:42:23.359816] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:23.366065] [INFO ] [MAIN ] NOTE: Generated 1820 derivative records from 40766 primary records. [2025-10-17T22:42:23.366147] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-10-17T22:42:23.369619] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1820 records). [2025-10-17T22:42:23.369903] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-10-17T22:42:23.378139] [INFO ] [MAIN ] Derivative Progress: 1304/2083 symbols completed. NOMD took 1.2s. Estimated remaining: 4m 55s. Rate: 158.5 symbols/min [2025-10-17T22:42:23.385573] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1820 records). [2025-10-17T22:42:23.385668] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-10-17T22:42:23.387823] [INFO ] [MAIN ] Derivative Progress: 1305/2083 symbols completed. NOTE took 1.1s. Estimated remaining: 4m 54s. Rate: 158.6 symbols/min [2025-10-17T22:42:23.388298] [INFO ] [MAIN ] NOW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:23.388448] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:23.388230] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:23.409375] [DEBUG] [LOCAL ] NPCT: Loaded 16917 existing records from primary storage. [2025-10-17T22:42:23.409498] [INFO ] [MAIN ] NPCT: Loaded 16917 primary data records. [2025-10-17T22:42:23.750704] [DEBUG] [LOCAL ] NOW: Loaded 48724 existing records from primary storage. [2025-10-17T22:42:23.751007] [INFO ] [MAIN ] NOW: Loaded 48724 primary data records. [2025-10-17T22:42:23.821325] [DEBUG] [LOCAL ] NOV: Loaded 53950 existing records from primary storage. [2025-10-17T22:42:23.827028] [INFO ] [MAIN ] NOV: Loaded 53950 primary data records. [2025-10-17T22:42:24.418930] [DEBUG] [MAIN ] NPCT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:24.420579] [INFO ] [MAIN ] NPCT: Generated 1820 derivative records from 16917 primary records. [2025-10-17T22:42:24.421253] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-10-17T22:42:24.440906] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1820 records). [2025-10-17T22:42:24.441784] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-10-17T22:42:24.444115] [INFO ] [MAIN ] Derivative Progress: 1306/2083 symbols completed. NPCT took 1.1s. Estimated remaining: 4m 54s. Rate: 158.4 symbols/min [2025-10-17T22:42:24.444299] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:24.459880] [DEBUG] [MAIN ] NOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:24.460529] [INFO ] [MAIN ] NOW: Generated 1820 derivative records from 48724 primary records. [2025-10-17T22:42:24.460700] [DEBUG] [LOCAL ] NOW: Saving derivative data. [2025-10-17T22:42:24.482548] [DEBUG] [LOCAL ] NPFD: Loaded 10224 existing records from primary storage. [2025-10-17T22:42:24.496947] [INFO ] [MAIN ] NPFD: Loaded 10224 primary data records. [2025-10-17T22:42:24.509578] [DEBUG] [MAIN ] NOV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:24.535970] [INFO ] [MAIN ] NOV: Generated 1820 derivative records from 53950 primary records. [2025-10-17T22:42:24.543229] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-10-17T22:42:24.601320] [DEBUG] [LOCAL ] NOW: Derivative data saved (1820 records). [2025-10-17T22:42:24.622583] [INFO ] [MAIN ] NOW: Successfully saved derivative data. [2025-10-17T22:42:24.630594] [INFO ] [MAIN ] Derivative Progress: 1307/2083 symbols completed. NOW took 1.2s. Estimated remaining: 4m 54s. Rate: 158.4 symbols/min [2025-10-17T22:42:24.637626] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:24.649102] [DEBUG] [LOCAL ] NOV: Derivative data saved (1820 records). [2025-10-17T22:42:24.649300] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-10-17T22:42:24.657349] [INFO ] [MAIN ] Derivative Progress: 1308/2083 symbols completed. NOV took 1.3s. Estimated remaining: 4m 53s. Rate: 158.5 symbols/min [2025-10-17T22:42:24.684405] [INFO ] [MAIN ] NPKI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:24.866701] [DEBUG] [LOCAL ] NPK: Loaded 8568 existing records from primary storage. [2025-10-17T22:42:24.866897] [INFO ] [MAIN ] NPK: Loaded 8568 primary data records. [2025-10-17T22:42:25.083375] [DEBUG] [LOCAL ] NPKI: Loaded 40905 existing records from primary storage. [2025-10-17T22:42:25.209816] [INFO ] [MAIN ] NPKI: Loaded 40905 primary data records. [2025-10-17T22:42:25.337536] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:25.373108] [INFO ] [MAIN ] NPFD: Generated 1820 derivative records from 10224 primary records. [2025-10-17T22:42:25.390093] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-10-17T22:42:25.550467] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1820 records). [2025-10-17T22:42:25.550675] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-10-17T22:42:25.552736] [INFO ] [MAIN ] Derivative Progress: 1309/2083 symbols completed. NPFD took 1.1s. Estimated remaining: 4m 53s. Rate: 158.4 symbols/min [2025-10-17T22:42:25.553128] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:25.573621] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:25.574486] [INFO ] [MAIN ] NPK: Generated 1820 derivative records from 8568 primary records. [2025-10-17T22:42:25.574680] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-10-17T22:42:25.595759] [DEBUG] [LOCAL ] NPK: Derivative data saved (1820 records). [2025-10-17T22:42:25.595918] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-10-17T22:42:25.598129] [INFO ] [MAIN ] Derivative Progress: 1310/2083 symbols completed. NPK took 1.0s. Estimated remaining: 4m 53s. Rate: 158.5 symbols/min [2025-10-17T22:42:25.604348] [DEBUG] [LOCAL ] NPO: Loaded 13896 existing records from primary storage. [2025-10-17T22:42:25.603939] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:25.604869] [INFO ] [MAIN ] NPO: Loaded 13896 primary data records. [2025-10-17T22:42:25.715639] [DEBUG] [LOCAL ] NPV: Loaded 5437 existing records from primary storage. [2025-10-17T22:42:25.735042] [INFO ] [MAIN ] NPV: Loaded 5437 primary data records. [2025-10-17T22:42:25.847634] [DEBUG] [MAIN ] NPKI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:25.890278] [INFO ] [MAIN ] NPKI: Generated 1820 derivative records from 40905 primary records. [2025-10-17T22:42:25.900954] [DEBUG] [LOCAL ] NPKI: Saving derivative data. [2025-10-17T22:42:26.258995] [DEBUG] [LOCAL ] NPKI: Derivative data saved (1820 records). [2025-10-17T22:42:26.259213] [INFO ] [MAIN ] NPKI: Successfully saved derivative data. [2025-10-17T22:42:26.261544] [INFO ] [MAIN ] Derivative Progress: 1311/2083 symbols completed. NPKI took 1.6s. Estimated remaining: 4m 52s. Rate: 158.4 symbols/min [2025-10-17T22:42:26.263045] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:26.289527] [DEBUG] [MAIN ] NPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:26.290501] [INFO ] [MAIN ] NPO: Generated 1820 derivative records from 13896 primary records. [2025-10-17T22:42:26.290781] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-10-17T22:42:26.332333] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:26.334055] [INFO ] [MAIN ] NPV: Generated 1820 derivative records from 5437 primary records. [2025-10-17T22:42:26.334362] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-17T22:42:26.347965] [DEBUG] [LOCAL ] NPO: Derivative data saved (1820 records). [2025-10-17T22:42:26.359386] [DEBUG] [LOCAL ] NPWR: Loaded 44112 existing records from primary storage. [2025-10-17T22:42:26.359533] [INFO ] [MAIN ] NPWR: Loaded 44112 primary data records. [2025-10-17T22:42:26.358610] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-10-17T22:42:26.363502] [DEBUG] [LOCAL ] NPV: Derivative data saved (1820 records). [2025-10-17T22:42:26.365962] [INFO ] [MAIN ] Derivative Progress: 1312/2083 symbols completed. NPO took 0.8s. Estimated remaining: 4m 52s. Rate: 158.5 symbols/min [2025-10-17T22:42:26.366124] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-10-17T22:42:26.388981] [INFO ] [MAIN ] Derivative Progress: 1313/2083 symbols completed. NPV took 0.8s. Estimated remaining: 4m 51s. Rate: 158.6 symbols/min [2025-10-17T22:42:26.389192] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:26.366244] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:26.704236] [DEBUG] [LOCAL ] NQP: Loaded 9363 existing records from primary storage. [2025-10-17T22:42:26.704497] [INFO ] [MAIN ] NQP: Loaded 9363 primary data records. [2025-10-17T22:42:26.811271] [DEBUG] [LOCAL ] NRDY: Loaded 33086 existing records from primary storage. [2025-10-17T22:42:26.823397] [INFO ] [MAIN ] NRDY: Loaded 33086 primary data records. [2025-10-17T22:42:27.371849] [DEBUG] [MAIN ] NPWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:27.374041] [INFO ] [MAIN ] NPWR: Generated 1820 derivative records from 44112 primary records. [2025-10-17T22:42:27.374581] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-10-17T22:42:27.398151] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1820 records). [2025-10-17T22:42:27.413341] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-10-17T22:42:27.417824] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:27.417065] [INFO ] [MAIN ] Derivative Progress: 1314/2083 symbols completed. NPWR took 1.2s. Estimated remaining: 4m 51s. Rate: 158.4 symbols/min [2025-10-17T22:42:27.418534] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:27.419792] [INFO ] [MAIN ] NQP: Generated 1820 derivative records from 9363 primary records. [2025-10-17T22:42:27.420280] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-10-17T22:42:27.441754] [DEBUG] [LOCAL ] NQP: Derivative data saved (1820 records). [2025-10-17T22:42:27.442211] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-10-17T22:42:27.444729] [INFO ] [MAIN ] Derivative Progress: 1315/2083 symbols completed. NQP took 1.1s. Estimated remaining: 4m 51s. Rate: 158.5 symbols/min [2025-10-17T22:42:27.444944] [INFO ] [MAIN ] NRG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:27.450826] [DEBUG] [LOCAL ] NREF: Loaded 7969 existing records from primary storage. [2025-10-17T22:42:27.451187] [INFO ] [MAIN ] NREF: Loaded 7969 primary data records. [2025-10-17T22:42:27.581794] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:27.582527] [INFO ] [MAIN ] NRDY: Generated 1820 derivative records from 33086 primary records. [2025-10-17T22:42:27.582598] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-10-17T22:42:27.642133] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1820 records). [2025-10-17T22:42:27.645757] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-10-17T22:42:27.660116] [INFO ] [MAIN ] Derivative Progress: 1316/2083 symbols completed. NRDY took 1.3s. Estimated remaining: 4m 50s. Rate: 158.5 symbols/min [2025-10-17T22:42:27.660688] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:27.840347] [DEBUG] [LOCAL ] NRG: Loaded 53621 existing records from primary storage. [2025-10-17T22:42:27.841231] [INFO ] [MAIN ] NRG: Loaded 53621 primary data records. [2025-10-17T22:42:28.178266] [DEBUG] [LOCAL ] NRGV: Loaded 44503 existing records from primary storage. [2025-10-17T22:42:28.187206] [INFO ] [MAIN ] NRGV: Loaded 44503 primary data records. [2025-10-17T22:42:28.305177] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:28.331739] [INFO ] [MAIN ] NREF: Generated 1820 derivative records from 7969 primary records. [2025-10-17T22:42:28.331985] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-10-17T22:42:28.565350] [DEBUG] [LOCAL ] NREF: Derivative data saved (1820 records). [2025-10-17T22:42:28.566392] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-10-17T22:42:28.570254] [INFO ] [MAIN ] Derivative Progress: 1317/2083 symbols completed. NREF took 1.2s. Estimated remaining: 4m 50s. Rate: 158.4 symbols/min [2025-10-17T22:42:28.570608] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:28.589011] [DEBUG] [MAIN ] NRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:28.590448] [INFO ] [MAIN ] NRG: Generated 1820 derivative records from 53621 primary records. [2025-10-17T22:42:28.590786] [DEBUG] [LOCAL ] NRG: Saving derivative data. [2025-10-17T22:42:28.607632] [DEBUG] [LOCAL ] NRG: Derivative data saved (1820 records). [2025-10-17T22:42:28.608045] [INFO ] [MAIN ] NRG: Successfully saved derivative data. [2025-10-17T22:42:28.610774] [INFO ] [MAIN ] Derivative Progress: 1318/2083 symbols completed. NRG took 1.2s. Estimated remaining: 4m 50s. Rate: 158.5 symbols/min [2025-10-17T22:42:28.626741] [DEBUG] [LOCAL ] NRK: Loaded 20563 existing records from primary storage. [2025-10-17T22:42:28.626896] [INFO ] [MAIN ] NRK: Loaded 20563 primary data records. [2025-10-17T22:42:28.704458] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:28.722376] [INFO ] [MAIN ] NRGV: Generated 1820 derivative records from 44503 primary records. [2025-10-17T22:42:28.741457] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-10-17T22:42:28.808535] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1820 records). [2025-10-17T22:42:28.818032] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-10-17T22:42:28.820259] [INFO ] [MAIN ] Derivative Progress: 1319/2083 symbols completed. NRGV took 1.2s. Estimated remaining: 4m 49s. Rate: 158.5 symbols/min [2025-10-17T22:42:28.973606] [DEBUG] [MAIN ] NRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:28.974260] [INFO ] [MAIN ] NRK: Generated 1820 derivative records from 20563 primary records. [2025-10-17T22:42:28.974322] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-10-17T22:42:28.989865] [DEBUG] [LOCAL ] NRK: Derivative data saved (1820 records). [2025-10-17T22:42:28.989930] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-10-17T22:42:28.991980] [INFO ] [MAIN ] Derivative Progress: 1320/2083 symbols completed. NRK took 0.4s. Estimated remaining: 4m 49s. Rate: 158.6 symbols/min [2025-10-17T22:42:28.992639] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:28.992813] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:28.992469] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:29.000512] [DEBUG] [LOCAL ] NRUC: Loaded 3185 existing records from primary storage. [2025-10-17T22:42:29.000767] [INFO ] [MAIN ] NRUC: Loaded 3185 primary data records. [2025-10-17T22:42:29.036388] [DEBUG] [LOCAL ] NRP: Loaded 4238 existing records from primary storage. [2025-10-17T22:42:29.048399] [INFO ] [MAIN ] NRP: Loaded 4238 primary data records. [2025-10-17T22:42:29.119218] [DEBUG] [LOCAL ] NRT: Loaded 4988 existing records from primary storage. [2025-10-17T22:42:29.161559] [INFO ] [MAIN ] NRT: Loaded 4988 primary data records. [2025-10-17T22:42:30.020944] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:30.022803] [INFO ] [MAIN ] NRP: Generated 1820 derivative records from 4238 primary records. [2025-10-17T22:42:30.023750] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-10-17T22:42:30.023573] [DEBUG] [MAIN ] NRUC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:30.025466] [INFO ] [MAIN ] NRUC: Generated 1820 derivative records from 3185 primary records. [2025-10-17T22:42:30.026162] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-10-17T22:42:30.055624] [DEBUG] [LOCAL ] NRP: Derivative data saved (1820 records). [2025-10-17T22:42:30.059698] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1820 records). [2025-10-17T22:42:30.060091] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-10-17T22:42:30.059936] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-10-17T22:42:30.062371] [INFO ] [MAIN ] Derivative Progress: 1321/2083 symbols completed. NRUC took 1.1s. Estimated remaining: 4m 49s. Rate: 158.4 symbols/min [2025-10-17T22:42:30.062718] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:30.072942] [INFO ] [MAIN ] Derivative Progress: 1322/2083 symbols completed. NRP took 1.1s. Estimated remaining: 4m 48s. Rate: 158.5 symbols/min [2025-10-17T22:42:30.078894] [INFO ] [MAIN ] NSC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:30.079239] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:30.080584] [INFO ] [MAIN ] NRT: Generated 1820 derivative records from 4988 primary records. [2025-10-17T22:42:30.080752] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-10-17T22:42:30.096386] [DEBUG] [LOCAL ] NRT: Derivative data saved (1820 records). [2025-10-17T22:42:30.096942] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-10-17T22:42:30.099235] [INFO ] [MAIN ] Derivative Progress: 1323/2083 symbols completed. NRT took 1.1s. Estimated remaining: 4m 47s. Rate: 158.6 symbols/min [2025-10-17T22:42:30.099448] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:30.153694] [DEBUG] [LOCAL ] NSA: Loaded 45821 existing records from primary storage. [2025-10-17T22:42:30.154062] [INFO ] [MAIN ] NSA: Loaded 45821 primary data records. [2025-10-17T22:42:30.240087] [DEBUG] [LOCAL ] NSP: Loaded 36092 existing records from primary storage. [2025-10-17T22:42:30.285149] [DEBUG] [LOCAL ] NSC: Loaded 49475 existing records from primary storage. [2025-10-17T22:42:30.283101] [INFO ] [MAIN ] NSP: Loaded 36092 primary data records. [2025-10-17T22:42:30.306326] [INFO ] [MAIN ] NSC: Loaded 49475 primary data records. [2025-10-17T22:42:31.197328] [DEBUG] [MAIN ] NSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:31.199107] [INFO ] [MAIN ] NSA: Generated 1820 derivative records from 45821 primary records. [2025-10-17T22:42:31.199507] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-10-17T22:42:31.227515] [DEBUG] [MAIN ] NSP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:31.229821] [INFO ] [MAIN ] NSP: Generated 1820 derivative records from 36092 primary records. [2025-10-17T22:42:31.233194] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-10-17T22:42:31.258310] [DEBUG] [LOCAL ] NSA: Derivative data saved (1820 records). [2025-10-17T22:42:31.263232] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-10-17T22:42:31.263568] [DEBUG] [MAIN ] NSC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:31.271789] [DEBUG] [LOCAL ] NSP: Derivative data saved (1820 records). [2025-10-17T22:42:31.266675] [INFO ] [MAIN ] Derivative Progress: 1324/2083 symbols completed. NSA took 1.2s. Estimated remaining: 4m 48s. Rate: 158.4 symbols/min [2025-10-17T22:42:31.268163] [INFO ] [MAIN ] NSC: Generated 1820 derivative records from 49475 primary records. [2025-10-17T22:42:31.272131] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:31.272233] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-10-17T22:42:31.272925] [DEBUG] [LOCAL ] NSC: Saving derivative data. [2025-10-17T22:42:31.275354] [INFO ] [MAIN ] Derivative Progress: 1325/2083 symbols completed. NSP took 1.2s. Estimated remaining: 4m 47s. Rate: 158.5 symbols/min [2025-10-17T22:42:31.275677] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:31.296049] [DEBUG] [LOCAL ] NSC: Derivative data saved (1820 records). [2025-10-17T22:42:31.301855] [INFO ] [MAIN ] NSC: Successfully saved derivative data. [2025-10-17T22:42:31.304273] [INFO ] [MAIN ] Derivative Progress: 1326/2083 symbols completed. NSC took 1.2s. Estimated remaining: 4m 46s. Rate: 158.6 symbols/min [2025-10-17T22:42:31.304547] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:31.314985] [DEBUG] [LOCAL ] NTB: Loaded 20647 existing records from primary storage. [2025-10-17T22:42:31.315203] [INFO ] [MAIN ] NTB: Loaded 20647 primary data records. [2025-10-17T22:42:31.661569] [DEBUG] [LOCAL ] NTR: Loaded 53379 existing records from primary storage. [2025-10-17T22:42:31.670123] [INFO ] [MAIN ] NTR: Loaded 53379 primary data records. [2025-10-17T22:42:31.754831] [DEBUG] [LOCAL ] NTST: Loaded 44754 existing records from primary storage. [2025-10-17T22:42:31.784770] [INFO ] [MAIN ] NTST: Loaded 44754 primary data records. [2025-10-17T22:42:32.324775] [DEBUG] [MAIN ] NTB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:32.326495] [INFO ] [MAIN ] NTB: Generated 1820 derivative records from 20647 primary records. [2025-10-17T22:42:32.326876] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-10-17T22:42:32.344226] [DEBUG] [LOCAL ] NTB: Derivative data saved (1820 records). [2025-10-17T22:42:32.344384] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-10-17T22:42:32.346481] [INFO ] [MAIN ] Derivative Progress: 1327/2083 symbols completed. NTB took 1.1s. Estimated remaining: 4m 46s. Rate: 158.4 symbols/min [2025-10-17T22:42:32.346842] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:32.365246] [DEBUG] [MAIN ] NTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:32.366087] [INFO ] [MAIN ] NTR: Generated 1820 derivative records from 53379 primary records. [2025-10-17T22:42:32.366259] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-10-17T22:42:32.383683] [DEBUG] [LOCAL ] NTR: Derivative data saved (1820 records). [2025-10-17T22:42:32.384853] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-10-17T22:42:32.388312] [INFO ] [MAIN ] Derivative Progress: 1328/2083 symbols completed. NTR took 1.1s. Estimated remaining: 4m 46s. Rate: 158.5 symbols/min [2025-10-17T22:42:32.388594] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:32.402199] [DEBUG] [MAIN ] NTST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:32.402938] [INFO ] [MAIN ] NTST: Generated 1820 derivative records from 44754 primary records. [2025-10-17T22:42:32.403046] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-10-17T22:42:32.434134] [DEBUG] [LOCAL ] NTST: Derivative data saved (1820 records). [2025-10-17T22:42:32.434452] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-10-17T22:42:32.437412] [INFO ] [MAIN ] Derivative Progress: 1329/2083 symbols completed. NTST took 1.1s. Estimated remaining: 4m 45s. Rate: 158.6 symbols/min [2025-10-17T22:42:32.437951] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:32.464327] [DEBUG] [LOCAL ] NU: Loaded 54526 existing records from primary storage. [2025-10-17T22:42:32.464472] [INFO ] [MAIN ] NU: Loaded 54526 primary data records. [2025-10-17T22:42:32.582913] [DEBUG] [LOCAL ] NUS: Loaded 36728 existing records from primary storage. [2025-10-17T22:42:32.593825] [INFO ] [MAIN ] NUS: Loaded 36728 primary data records. [2025-10-17T22:42:32.702225] [DEBUG] [LOCAL ] NUV: Loaded 24144 existing records from primary storage. [2025-10-17T22:42:32.874936] [INFO ] [MAIN ] NUV: Loaded 24144 primary data records. [2025-10-17T22:42:33.428762] [DEBUG] [MAIN ] NU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:33.429902] [INFO ] [MAIN ] NU: Generated 1820 derivative records from 54526 primary records. [2025-10-17T22:42:33.430215] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-10-17T22:42:33.447856] [DEBUG] [LOCAL ] NU: Derivative data saved (1820 records). [2025-10-17T22:42:33.448830] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-10-17T22:42:33.453162] [INFO ] [MAIN ] Derivative Progress: 1330/2083 symbols completed. NU took 1.1s. Estimated remaining: 4m 45s. Rate: 158.4 symbols/min [2025-10-17T22:42:33.453572] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:33.468085] [DEBUG] [MAIN ] NUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:33.471495] [INFO ] [MAIN ] NUS: Generated 1820 derivative records from 36728 primary records. [2025-10-17T22:42:33.471739] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-10-17T22:42:33.488142] [DEBUG] [LOCAL ] NUS: Derivative data saved (1820 records). [2025-10-17T22:42:33.488273] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-10-17T22:42:33.490416] [INFO ] [MAIN ] Derivative Progress: 1331/2083 symbols completed. NUS took 1.1s. Estimated remaining: 4m 45s. Rate: 158.5 symbols/min [2025-10-17T22:42:33.490635] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:33.508934] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:33.509842] [INFO ] [MAIN ] NUV: Generated 1820 derivative records from 24144 primary records. [2025-10-17T22:42:33.509965] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-17T22:42:33.523138] [DEBUG] [LOCAL ] NUW: Loaded 6809 existing records from primary storage. [2025-10-17T22:42:33.526318] [INFO ] [MAIN ] NUW: Loaded 6809 primary data records. [2025-10-17T22:42:33.667830] [DEBUG] [LOCAL ] NUV: Derivative data saved (1820 records). [2025-10-17T22:42:33.667976] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-10-17T22:42:33.670261] [INFO ] [MAIN ] Derivative Progress: 1332/2083 symbols completed. NUV took 1.2s. Estimated remaining: 4m 44s. Rate: 158.6 symbols/min [2025-10-17T22:42:33.670409] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:33.682885] [DEBUG] [LOCAL ] NUVB: Loaded 52343 existing records from primary storage. [2025-10-17T22:42:33.698979] [INFO ] [MAIN ] NUVB: Loaded 52343 primary data records. [2025-10-17T22:42:34.042678] [DEBUG] [LOCAL ] NVG: Loaded 27878 existing records from primary storage. [2025-10-17T22:42:34.172775] [INFO ] [MAIN ] NVG: Loaded 27878 primary data records. [2025-10-17T22:42:34.562321] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:34.563573] [INFO ] [MAIN ] NUW: Generated 1820 derivative records from 6809 primary records. [2025-10-17T22:42:34.564497] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-10-17T22:42:34.583217] [DEBUG] [LOCAL ] NUW: Derivative data saved (1820 records). [2025-10-17T22:42:34.591409] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-10-17T22:42:34.599743] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:34.593372] [INFO ] [MAIN ] Derivative Progress: 1333/2083 symbols completed. NUW took 1.1s. Estimated remaining: 4m 44s. Rate: 158.4 symbols/min [2025-10-17T22:42:34.600484] [INFO ] [MAIN ] NUVB: Generated 1820 derivative records from 52343 primary records. [2025-10-17T22:42:34.600942] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-10-17T22:42:34.618161] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1820 records). [2025-10-17T22:42:34.618360] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-10-17T22:42:34.620584] [INFO ] [MAIN ] Derivative Progress: 1334/2083 symbols completed. NUVB took 1.2s. Estimated remaining: 4m 44s. Rate: 158.5 symbols/min [2025-10-17T22:42:34.636781] [DEBUG] [MAIN ] NVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:34.637410] [INFO ] [MAIN ] NVG: Generated 1820 derivative records from 27878 primary records. [2025-10-17T22:42:34.637470] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-10-17T22:42:34.653570] [DEBUG] [LOCAL ] NVG: Derivative data saved (1820 records). [2025-10-17T22:42:34.653634] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-10-17T22:42:34.655754] [INFO ] [MAIN ] Derivative Progress: 1335/2083 symbols completed. NVG took 1.0s. Estimated remaining: 4m 43s. Rate: 158.6 symbols/min [2025-10-17T22:42:34.656340] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:34.656237] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:34.656165] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:34.683402] [DEBUG] [LOCAL ] NVR: Loaded 18842 existing records from primary storage. [2025-10-17T22:42:34.683506] [INFO ] [MAIN ] NVR: Loaded 18842 primary data records. [2025-10-17T22:42:34.784928] [DEBUG] [LOCAL ] NVGS: Loaded 30546 existing records from primary storage. [2025-10-17T22:42:34.809896] [INFO ] [MAIN ] NVGS: Loaded 30546 primary data records. [2025-10-17T22:42:35.127167] [DEBUG] [LOCAL ] NVO: Loaded 54564 existing records from primary storage. [2025-10-17T22:42:35.134234] [INFO ] [MAIN ] NVO: Loaded 54564 primary data records. [2025-10-17T22:42:35.669475] [DEBUG] [MAIN ] NVR: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:42:35.672021] [INFO ] [MAIN ] NVR: Generated 1819 derivative records from 18842 primary records. [2025-10-17T22:42:35.672334] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-10-17T22:42:35.699767] [DEBUG] [MAIN ] NVGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:35.702577] [INFO ] [MAIN ] NVGS: Generated 1820 derivative records from 30546 primary records. [2025-10-17T22:42:35.703167] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-10-17T22:42:35.718531] [DEBUG] [LOCAL ] NVR: Derivative data saved (1819 records). [2025-10-17T22:42:35.722481] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1820 records). [2025-10-17T22:42:35.722770] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-10-17T22:42:35.724980] [INFO ] [MAIN ] Derivative Progress: 1336/2083 symbols completed. NVGS took 1.1s. Estimated remaining: 4m 43s. Rate: 158.4 symbols/min [2025-10-17T22:42:35.722618] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-10-17T22:42:35.725145] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:35.727548] [INFO ] [MAIN ] Derivative Progress: 1337/2083 symbols completed. NVR took 1.1s. Estimated remaining: 4m 42s. Rate: 158.5 symbols/min [2025-10-17T22:42:35.727770] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:35.749534] [DEBUG] [MAIN ] NVO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:35.750688] [INFO ] [MAIN ] NVO: Generated 1820 derivative records from 54564 primary records. [2025-10-17T22:42:35.750833] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-10-17T22:42:35.772211] [DEBUG] [LOCAL ] NVO: Derivative data saved (1820 records). [2025-10-17T22:42:35.781983] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-10-17T22:42:35.784234] [INFO ] [MAIN ] Derivative Progress: 1338/2083 symbols completed. NVO took 1.1s. Estimated remaining: 4m 42s. Rate: 158.6 symbols/min [2025-10-17T22:42:35.784528] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:35.812227] [DEBUG] [LOCAL ] NVRI: Loaded 39555 existing records from primary storage. [2025-10-17T22:42:35.812367] [INFO ] [MAIN ] NVRI: Loaded 39555 primary data records. [2025-10-17T22:42:35.930523] [DEBUG] [LOCAL ] NVS: Loaded 52190 existing records from primary storage. [2025-10-17T22:42:35.991988] [INFO ] [MAIN ] NVS: Loaded 52190 primary data records. [2025-10-17T22:42:36.233246] [DEBUG] [LOCAL ] NVST: Loaded 52300 existing records from primary storage. [2025-10-17T22:42:36.264094] [INFO ] [MAIN ] NVST: Loaded 52300 primary data records. [2025-10-17T22:42:36.826529] [DEBUG] [MAIN ] NVRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:36.828180] [INFO ] [MAIN ] NVRI: Generated 1820 derivative records from 39555 primary records. [2025-10-17T22:42:36.828376] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-10-17T22:42:36.846154] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1820 records). [2025-10-17T22:42:36.846840] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-10-17T22:42:36.849172] [INFO ] [MAIN ] Derivative Progress: 1339/2083 symbols completed. NVRI took 1.1s. Estimated remaining: 4m 42s. Rate: 158.4 symbols/min [2025-10-17T22:42:36.849435] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:36.867174] [DEBUG] [MAIN ] NVS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:36.868050] [INFO ] [MAIN ] NVS: Generated 1820 derivative records from 52190 primary records. [2025-10-17T22:42:36.868263] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-10-17T22:42:36.888902] [DEBUG] [LOCAL ] NVS: Derivative data saved (1820 records). [2025-10-17T22:42:36.889067] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-10-17T22:42:36.891284] [INFO ] [MAIN ] Derivative Progress: 1340/2083 symbols completed. NVS took 1.2s. Estimated remaining: 4m 41s. Rate: 158.5 symbols/min [2025-10-17T22:42:36.891473] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:36.904871] [DEBUG] [MAIN ] NVST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:36.905600] [INFO ] [MAIN ] NVST: Generated 1820 derivative records from 52300 primary records. [2025-10-17T22:42:36.905746] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-10-17T22:42:36.922280] [DEBUG] [LOCAL ] NVST: Derivative data saved (1820 records). [2025-10-17T22:42:36.922419] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-10-17T22:42:36.924609] [INFO ] [MAIN ] Derivative Progress: 1341/2083 symbols completed. NVST took 1.1s. Estimated remaining: 4m 41s. Rate: 158.6 symbols/min [2025-10-17T22:42:36.938253] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:36.980515] [DEBUG] [LOCAL ] NVT: Loaded 52222 existing records from primary storage. [2025-10-17T22:42:36.980822] [INFO ] [MAIN ] NVT: Loaded 52222 primary data records. [2025-10-17T22:42:37.039470] [DEBUG] [LOCAL ] NWN: Loaded 27037 existing records from primary storage. [2025-10-17T22:42:37.052616] [INFO ] [MAIN ] NWN: Loaded 27037 primary data records. [2025-10-17T22:42:37.209904] [DEBUG] [LOCAL ] NWG: Loaded 52188 existing records from primary storage. [2025-10-17T22:42:37.287403] [INFO ] [MAIN ] NWG: Loaded 52188 primary data records. [2025-10-17T22:42:37.971789] [DEBUG] [MAIN ] NVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:37.974308] [INFO ] [MAIN ] NVT: Generated 1820 derivative records from 52222 primary records. [2025-10-17T22:42:37.974446] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-10-17T22:42:37.995908] [DEBUG] [MAIN ] NWN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:38.000980] [INFO ] [MAIN ] NWN: Generated 1820 derivative records from 27037 primary records. [2025-10-17T22:42:38.001499] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-10-17T22:42:38.013809] [DEBUG] [LOCAL ] NVT: Derivative data saved (1820 records). [2025-10-17T22:42:38.017327] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-10-17T22:42:38.019154] [INFO ] [MAIN ] Derivative Progress: 1342/2083 symbols completed. NVT took 1.2s. Estimated remaining: 4m 41s. Rate: 158.4 symbols/min [2025-10-17T22:42:38.022523] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:38.023600] [DEBUG] [LOCAL ] NWN: Derivative data saved (1820 records). [2025-10-17T22:42:38.023930] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-10-17T22:42:38.027025] [INFO ] [MAIN ] Derivative Progress: 1343/2083 symbols completed. NWN took 1.1s. Estimated remaining: 4m 40s. Rate: 158.5 symbols/min [2025-10-17T22:42:38.027591] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:38.045383] [DEBUG] [MAIN ] NWG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:38.046298] [INFO ] [MAIN ] NWG: Generated 1820 derivative records from 52188 primary records. [2025-10-17T22:42:38.046515] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-10-17T22:42:38.050248] [DEBUG] [LOCAL ] NXC: Loaded 4164 existing records from primary storage. [2025-10-17T22:42:38.051025] [INFO ] [MAIN ] NXC: Loaded 4164 primary data records. [2025-10-17T22:42:38.102691] [DEBUG] [LOCAL ] NWG: Derivative data saved (1820 records). [2025-10-17T22:42:38.109468] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-10-17T22:42:38.140553] [INFO ] [MAIN ] Derivative Progress: 1344/2083 symbols completed. NWG took 1.2s. Estimated remaining: 4m 40s. Rate: 158.6 symbols/min [2025-10-17T22:42:38.146771] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:38.269007] [DEBUG] [LOCAL ] NX: Loaded 33799 existing records from primary storage. [2025-10-17T22:42:38.382702] [INFO ] [MAIN ] NX: Loaded 33799 primary data records. [2025-10-17T22:42:38.449106] [DEBUG] [LOCAL ] NXDT: Loaded 15223 existing records from primary storage. [2025-10-17T22:42:38.505700] [INFO ] [MAIN ] NXDT: Loaded 15223 primary data records. [2025-10-17T22:42:39.050262] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:39.051798] [INFO ] [MAIN ] NXC: Generated 1820 derivative records from 4164 primary records. [2025-10-17T22:42:39.051909] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-17T22:42:39.081570] [DEBUG] [LOCAL ] NXC: Derivative data saved (1820 records). [2025-10-17T22:42:39.087575] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-10-17T22:42:39.087482] [DEBUG] [MAIN ] NX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:39.088817] [INFO ] [MAIN ] NX: Generated 1820 derivative records from 33799 primary records. [2025-10-17T22:42:39.091006] [INFO ] [MAIN ] Derivative Progress: 1345/2083 symbols completed. NXC took 1.1s. Estimated remaining: 4m 40s. Rate: 158.4 symbols/min [2025-10-17T22:42:39.088995] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-10-17T22:42:39.091827] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:39.111431] [DEBUG] [LOCAL ] NX: Derivative data saved (1820 records). [2025-10-17T22:42:39.124941] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-10-17T22:42:39.125232] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:39.127581] [INFO ] [MAIN ] Derivative Progress: 1346/2083 symbols completed. NX took 1.1s. Estimated remaining: 4m 39s. Rate: 158.5 symbols/min [2025-10-17T22:42:39.128377] [INFO ] [MAIN ] NXDT: Generated 1820 derivative records from 15223 primary records. [2025-10-17T22:42:39.128557] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:39.129479] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-10-17T22:42:39.149264] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1820 records). [2025-10-17T22:42:39.149507] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-10-17T22:42:39.151723] [INFO ] [MAIN ] Derivative Progress: 1347/2083 symbols completed. NXDT took 1.0s. Estimated remaining: 4m 38s. Rate: 158.6 symbols/min [2025-10-17T22:42:39.152033] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:39.170921] [DEBUG] [LOCAL ] NXG: Loaded 10631 existing records from primary storage. [2025-10-17T22:42:39.171042] [INFO ] [MAIN ] NXG: Loaded 10631 primary data records. [2025-10-17T22:42:39.302973] [DEBUG] [LOCAL ] NXE: Loaded 53824 existing records from primary storage. [2025-10-17T22:42:39.308760] [INFO ] [MAIN ] NXE: Loaded 53824 primary data records. [2025-10-17T22:42:39.366572] [DEBUG] [LOCAL ] NXJ: Loaded 15122 existing records from primary storage. [2025-10-17T22:42:39.453966] [INFO ] [MAIN ] NXJ: Loaded 15122 primary data records. [2025-10-17T22:42:40.156605] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:40.158099] [INFO ] [MAIN ] NXG: Generated 1820 derivative records from 10631 primary records. [2025-10-17T22:42:40.158360] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-10-17T22:42:40.178345] [DEBUG] [LOCAL ] NXG: Derivative data saved (1820 records). [2025-10-17T22:42:40.178596] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-10-17T22:42:40.181714] [INFO ] [MAIN ] Derivative Progress: 1348/2083 symbols completed. NXG took 1.1s. Estimated remaining: 4m 38s. Rate: 158.4 symbols/min [2025-10-17T22:42:40.195620] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:40.196527] [INFO ] [MAIN ] NXE: Generated 1820 derivative records from 53824 primary records. [2025-10-17T22:42:40.196616] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-10-17T22:42:40.227906] [DEBUG] [MAIN ] NXJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:40.232208] [INFO ] [MAIN ] NXJ: Generated 1820 derivative records from 15122 primary records. [2025-10-17T22:42:40.231207] [DEBUG] [LOCAL ] NXE: Derivative data saved (1820 records). [2025-10-17T22:42:40.232432] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-10-17T22:42:40.232560] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-10-17T22:42:40.235330] [INFO ] [MAIN ] Derivative Progress: 1349/2083 symbols completed. NXE took 1.1s. Estimated remaining: 4m 38s. Rate: 158.5 symbols/min [2025-10-17T22:42:40.252164] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1820 records). [2025-10-17T22:42:40.252281] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-10-17T22:42:40.255383] [INFO ] [MAIN ] Derivative Progress: 1350/2083 symbols completed. NXJ took 1.1s. Estimated remaining: 4m 37s. Rate: 158.6 symbols/min [2025-10-17T22:42:40.256210] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:40.256522] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:40.256418] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:40.263579] [DEBUG] [LOCAL ] NXN: Loaded 2305 existing records from primary storage. [2025-10-17T22:42:40.263868] [INFO ] [MAIN ] NXN: Loaded 2305 primary data records. [2025-10-17T22:42:40.386198] [DEBUG] [LOCAL ] NXP: Loaded 12478 existing records from primary storage. [2025-10-17T22:42:40.392105] [INFO ] [MAIN ] NXP: Loaded 12478 primary data records. [2025-10-17T22:42:40.405209] [DEBUG] [LOCAL ] NXRT: Loaded 19213 existing records from primary storage. [2025-10-17T22:42:40.442038] [INFO ] [MAIN ] NXRT: Loaded 19213 primary data records. [2025-10-17T22:42:41.288145] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:41.289190] [INFO ] [MAIN ] NXP: Generated 1820 derivative records from 12478 primary records. [2025-10-17T22:42:41.289406] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:41.290332] [INFO ] [MAIN ] NXN: Generated 1820 derivative records from 2305 primary records. [2025-10-17T22:42:41.290637] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-17T22:42:41.290716] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-17T22:42:41.332226] [DEBUG] [LOCAL ] NXP: Derivative data saved (1820 records). [2025-10-17T22:42:41.332507] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-10-17T22:42:41.331805] [DEBUG] [LOCAL ] NXN: Derivative data saved (1820 records). [2025-10-17T22:42:41.342775] [INFO ] [MAIN ] Derivative Progress: 1351/2083 symbols completed. NXP took 1.1s. Estimated remaining: 4m 37s. Rate: 158.4 symbols/min [2025-10-17T22:42:41.340386] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-10-17T22:42:41.347196] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:41.350375] [INFO ] [MAIN ] Derivative Progress: 1352/2083 symbols completed. NXN took 1.1s. Estimated remaining: 4m 37s. Rate: 158.5 symbols/min [2025-10-17T22:42:41.351942] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:41.351704] [DEBUG] [MAIN ] NXRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:41.353581] [INFO ] [MAIN ] NXRT: Generated 1820 derivative records from 19213 primary records. [2025-10-17T22:42:41.353920] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-10-17T22:42:41.370508] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1820 records). [2025-10-17T22:42:41.370759] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-10-17T22:42:41.373188] [INFO ] [MAIN ] Derivative Progress: 1353/2083 symbols completed. NXRT took 1.1s. Estimated remaining: 4m 36s. Rate: 158.6 symbols/min [2025-10-17T22:42:41.373479] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:41.405956] [DEBUG] [LOCAL ] NZF: Loaded 29261 existing records from primary storage. [2025-10-17T22:42:41.406096] [INFO ] [MAIN ] NZF: Loaded 29261 primary data records. [2025-10-17T22:42:41.542294] [DEBUG] [LOCAL ] NYT: Loaded 50375 existing records from primary storage. [2025-10-17T22:42:41.558065] [INFO ] [MAIN ] NYT: Loaded 50375 primary data records. [2025-10-17T22:42:41.845396] [DEBUG] [LOCAL ] OBDC: Loaded 52457 existing records from primary storage. [2025-10-17T22:42:41.849186] [INFO ] [MAIN ] OBDC: Loaded 52457 primary data records. [2025-10-17T22:42:42.439783] [DEBUG] [MAIN ] NZF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:42.442434] [INFO ] [MAIN ] NZF: Generated 1820 derivative records from 29261 primary records. [2025-10-17T22:42:42.442547] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-10-17T22:42:42.464371] [DEBUG] [LOCAL ] NZF: Derivative data saved (1820 records). [2025-10-17T22:42:42.464929] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-10-17T22:42:42.467115] [INFO ] [MAIN ] Derivative Progress: 1354/2083 symbols completed. NZF took 1.1s. Estimated remaining: 4m 36s. Rate: 158.4 symbols/min [2025-10-17T22:42:42.475501] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:42.481901] [DEBUG] [MAIN ] NYT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:42.482994] [INFO ] [MAIN ] NYT: Generated 1820 derivative records from 50375 primary records. [2025-10-17T22:42:42.484181] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-10-17T22:42:42.514886] [DEBUG] [LOCAL ] NYT: Derivative data saved (1820 records). [2025-10-17T22:42:42.515683] [DEBUG] [MAIN ] OBDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:42.515339] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-10-17T22:42:42.522571] [INFO ] [MAIN ] Derivative Progress: 1355/2083 symbols completed. NYT took 1.2s. Estimated remaining: 4m 36s. Rate: 158.5 symbols/min [2025-10-17T22:42:42.523702] [INFO ] [MAIN ] OBDC: Generated 1820 derivative records from 52457 primary records. [2025-10-17T22:42:42.523838] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-10-17T22:42:42.522864] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:42.545824] [DEBUG] [LOCAL ] OBK: Loaded 16702 existing records from primary storage. [2025-10-17T22:42:42.546783] [INFO ] [MAIN ] OBK: Loaded 16702 primary data records. [2025-10-17T22:42:42.635022] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1820 records). [2025-10-17T22:42:42.646590] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-10-17T22:42:42.660445] [INFO ] [MAIN ] Derivative Progress: 1356/2083 symbols completed. OBDC took 1.3s. Estimated remaining: 4m 35s. Rate: 158.6 symbols/min [2025-10-17T22:42:42.687915] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:42.888012] [DEBUG] [LOCAL ] OCFT: Loaded 7392 existing records from primary storage. [2025-10-17T22:42:42.900434] [INFO ] [MAIN ] OCFT: Loaded 7392 primary data records. [2025-10-17T22:42:42.939162] [DEBUG] [LOCAL ] OC: Loaded 45614 existing records from primary storage. [2025-10-17T22:42:42.968725] [INFO ] [MAIN ] OC: Loaded 45614 primary data records. [2025-10-17T22:42:43.524438] [DEBUG] [MAIN ] OBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:43.525576] [INFO ] [MAIN ] OBK: Generated 1820 derivative records from 16702 primary records. [2025-10-17T22:42:43.525964] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-10-17T22:42:43.546814] [DEBUG] [LOCAL ] OBK: Derivative data saved (1820 records). [2025-10-17T22:42:43.546973] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-10-17T22:42:43.549093] [INFO ] [MAIN ] Derivative Progress: 1357/2083 symbols completed. OBK took 1.1s. Estimated remaining: 4m 35s. Rate: 158.4 symbols/min [2025-10-17T22:42:43.549503] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:43.570286] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:43.571131] [INFO ] [MAIN ] OCFT: Generated 1820 derivative records from 7392 primary records. [2025-10-17T22:42:43.571279] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-10-17T22:42:43.576123] [DEBUG] [LOCAL ] ODC: Loaded 8687 existing records from primary storage. [2025-10-17T22:42:43.584846] [INFO ] [MAIN ] ODC: Loaded 8687 primary data records. [2025-10-17T22:42:43.613355] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1820 records). [2025-10-17T22:42:43.635637] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-10-17T22:42:43.664376] [INFO ] [MAIN ] Derivative Progress: 1358/2083 symbols completed. OCFT took 1.0s. Estimated remaining: 4m 34s. Rate: 158.5 symbols/min [2025-10-17T22:42:43.700540] [DEBUG] [MAIN ] OC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:43.711607] [INFO ] [MAIN ] OC: Generated 1820 derivative records from 45614 primary records. [2025-10-17T22:42:43.717414] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:43.738314] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-10-17T22:42:43.933280] [DEBUG] [LOCAL ] OC: Derivative data saved (1820 records). [2025-10-17T22:42:43.933421] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-10-17T22:42:43.935807] [INFO ] [MAIN ] Derivative Progress: 1359/2083 symbols completed. OC took 1.4s. Estimated remaining: 4m 34s. Rate: 158.5 symbols/min [2025-10-17T22:42:43.935967] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:43.948989] [DEBUG] [LOCAL ] ODV: Loaded 29656 existing records from primary storage. [2025-10-17T22:42:43.949376] [INFO ] [MAIN ] ODV: Loaded 29656 primary data records. [2025-10-17T22:42:44.167051] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:44.168177] [DEBUG] [LOCAL ] OEC: Loaded 37875 existing records from primary storage. [2025-10-17T22:42:44.287581] [INFO ] [MAIN ] ODC: Generated 1820 derivative records from 8687 primary records. [2025-10-17T22:42:44.322746] [INFO ] [MAIN ] OEC: Loaded 37875 primary data records. [2025-10-17T22:42:44.323394] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-10-17T22:42:44.463377] [DEBUG] [LOCAL ] ODC: Derivative data saved (1820 records). [2025-10-17T22:42:44.502423] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-10-17T22:42:44.525279] [INFO ] [MAIN ] Derivative Progress: 1360/2083 symbols completed. ODC took 1.0s. Estimated remaining: 4m 34s. Rate: 158.5 symbols/min [2025-10-17T22:42:44.640323] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:44.668758] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:44.669870] [INFO ] [MAIN ] ODV: Generated 1820 derivative records from 29656 primary records. [2025-10-17T22:42:44.670162] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-10-17T22:42:44.693369] [DEBUG] [LOCAL ] ODV: Derivative data saved (1820 records). [2025-10-17T22:42:44.693490] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-10-17T22:42:44.689196] [DEBUG] [LOCAL ] OFG: Loaded 21171 existing records from primary storage. [2025-10-17T22:42:44.695900] [INFO ] [MAIN ] Derivative Progress: 1361/2083 symbols completed. ODV took 1.0s. Estimated remaining: 4m 33s. Rate: 158.5 symbols/min [2025-10-17T22:42:44.696023] [INFO ] [MAIN ] OFG: Loaded 21171 primary data records. [2025-10-17T22:42:44.696170] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:44.818422] [DEBUG] [MAIN ] OEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:44.821686] [INFO ] [MAIN ] OEC: Generated 1820 derivative records from 37875 primary records. [2025-10-17T22:42:44.822015] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-10-17T22:42:44.895489] [DEBUG] [LOCAL ] OEC: Derivative data saved (1820 records). [2025-10-17T22:42:44.917897] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-10-17T22:42:45.023224] [INFO ] [MAIN ] Derivative Progress: 1362/2083 symbols completed. OEC took 1.1s. Estimated remaining: 4m 33s. Rate: 158.6 symbols/min [2025-10-17T22:42:45.036944] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:45.067843] [DEBUG] [LOCAL ] OGE: Loaded 46620 existing records from primary storage. [2025-10-17T22:42:45.069221] [INFO ] [MAIN ] OGE: Loaded 46620 primary data records. [2025-10-17T22:42:45.409580] [DEBUG] [MAIN ] OFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:45.411551] [DEBUG] [LOCAL ] OGN: Loaded 53908 existing records from primary storage. [2025-10-17T22:42:45.412617] [INFO ] [MAIN ] OFG: Generated 1820 derivative records from 21171 primary records. [2025-10-17T22:42:45.412887] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-10-17T22:42:45.412816] [INFO ] [MAIN ] OGN: Loaded 53908 primary data records. [2025-10-17T22:42:45.606576] [DEBUG] [LOCAL ] OFG: Derivative data saved (1820 records). [2025-10-17T22:42:45.726366] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-10-17T22:42:45.730260] [INFO ] [MAIN ] Derivative Progress: 1363/2083 symbols completed. OFG took 1.1s. Estimated remaining: 4m 33s. Rate: 158.5 symbols/min [2025-10-17T22:42:45.750956] [DEBUG] [MAIN ] OGE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:45.751677] [INFO ] [MAIN ] OGE: Generated 1820 derivative records from 46620 primary records. [2025-10-17T22:42:45.751784] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-10-17T22:42:45.768763] [DEBUG] [LOCAL ] OGE: Derivative data saved (1820 records). [2025-10-17T22:42:45.769001] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-10-17T22:42:45.771446] [INFO ] [MAIN ] Derivative Progress: 1364/2083 symbols completed. OGE took 1.1s. Estimated remaining: 4m 32s. Rate: 158.6 symbols/min [2025-10-17T22:42:45.788673] [DEBUG] [MAIN ] OGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:45.789404] [INFO ] [MAIN ] OGN: Generated 1820 derivative records from 53908 primary records. [2025-10-17T22:42:45.789466] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-10-17T22:42:45.805053] [DEBUG] [LOCAL ] OGN: Derivative data saved (1820 records). [2025-10-17T22:42:45.805140] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-10-17T22:42:45.807451] [INFO ] [MAIN ] Derivative Progress: 1365/2083 symbols completed. OGN took 0.8s. Estimated remaining: 4m 32s. Rate: 158.7 symbols/min [2025-10-17T22:42:45.807987] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:45.808124] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:45.808253] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:45.863279] [DEBUG] [LOCAL ] OGS: Loaded 34532 existing records from primary storage. [2025-10-17T22:42:45.863435] [INFO ] [MAIN ] OGS: Loaded 34532 primary data records. [2025-10-17T22:42:45.993766] [DEBUG] [LOCAL ] OHI: Loaded 52674 existing records from primary storage. [2025-10-17T22:42:45.999788] [DEBUG] [LOCAL ] OI: Loaded 47958 existing records from primary storage. [2025-10-17T22:42:46.021335] [INFO ] [MAIN ] OI: Loaded 47958 primary data records. [2025-10-17T22:42:46.021535] [INFO ] [MAIN ] OHI: Loaded 52674 primary data records. [2025-10-17T22:42:46.927015] [DEBUG] [MAIN ] OGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:46.928808] [INFO ] [MAIN ] OGS: Generated 1820 derivative records from 34532 primary records. [2025-10-17T22:42:46.929278] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-10-17T22:42:46.966354] [DEBUG] [LOCAL ] OGS: Derivative data saved (1820 records). [2025-10-17T22:42:46.974950] [DEBUG] [MAIN ] OHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:46.975076] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-10-17T22:42:46.980816] [DEBUG] [MAIN ] OI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:46.981849] [INFO ] [MAIN ] OHI: Generated 1820 derivative records from 52674 primary records. [2025-10-17T22:42:46.985264] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-10-17T22:42:46.985088] [INFO ] [MAIN ] OI: Generated 1820 derivative records from 47958 primary records. [2025-10-17T22:42:46.983856] [INFO ] [MAIN ] Derivative Progress: 1366/2083 symbols completed. OGS took 1.2s. Estimated remaining: 4m 32s. Rate: 158.4 symbols/min [2025-10-17T22:42:46.985980] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-10-17T22:42:46.987074] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:47.013622] [DEBUG] [LOCAL ] OI: Derivative data saved (1820 records). [2025-10-17T22:42:47.022790] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-10-17T22:42:47.022933] [DEBUG] [LOCAL ] OHI: Derivative data saved (1820 records). [2025-10-17T22:42:47.025597] [INFO ] [MAIN ] Derivative Progress: 1367/2083 symbols completed. OI took 1.2s. Estimated remaining: 4m 31s. Rate: 158.5 symbols/min [2025-10-17T22:42:47.025854] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-10-17T22:42:47.029866] [INFO ] [MAIN ] Derivative Progress: 1368/2083 symbols completed. OHI took 1.2s. Estimated remaining: 4m 30s. Rate: 158.6 symbols/min [2025-10-17T22:42:47.029626] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:47.030267] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:47.048864] [DEBUG] [LOCAL ] OIA: Loaded 13271 existing records from primary storage. [2025-10-17T22:42:47.049204] [INFO ] [MAIN ] OIA: Loaded 13271 primary data records. [2025-10-17T22:42:47.409532] [DEBUG] [LOCAL ] OIS: Loaded 40550 existing records from primary storage. [2025-10-17T22:42:47.409860] [INFO ] [MAIN ] OIS: Loaded 40550 primary data records. [2025-10-17T22:42:47.410716] [DEBUG] [LOCAL ] OII: Loaded 42618 existing records from primary storage. [2025-10-17T22:42:47.433718] [INFO ] [MAIN ] OII: Loaded 42618 primary data records. [2025-10-17T22:42:48.085181] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:48.087467] [INFO ] [MAIN ] OIA: Generated 1820 derivative records from 13271 primary records. [2025-10-17T22:42:48.087964] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-10-17T22:42:48.107485] [DEBUG] [LOCAL ] OIA: Derivative data saved (1820 records). [2025-10-17T22:42:48.107639] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-10-17T22:42:48.109927] [INFO ] [MAIN ] Derivative Progress: 1369/2083 symbols completed. OIA took 1.1s. Estimated remaining: 4m 30s. Rate: 158.4 symbols/min [2025-10-17T22:42:48.110163] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:48.138136] [DEBUG] [MAIN ] OII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:48.139348] [INFO ] [MAIN ] OII: Generated 1820 derivative records from 42618 primary records. [2025-10-17T22:42:48.152496] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-10-17T22:42:48.154245] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:48.164903] [INFO ] [MAIN ] OIS: Generated 1820 derivative records from 40550 primary records. [2025-10-17T22:42:48.167961] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-10-17T22:42:48.173108] [DEBUG] [LOCAL ] OII: Derivative data saved (1820 records). [2025-10-17T22:42:48.173687] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-10-17T22:42:48.175978] [INFO ] [MAIN ] Derivative Progress: 1370/2083 symbols completed. OII took 1.1s. Estimated remaining: 4m 30s. Rate: 158.5 symbols/min [2025-10-17T22:42:48.176432] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:48.192532] [DEBUG] [LOCAL ] OIS: Derivative data saved (1820 records). [2025-10-17T22:42:48.192719] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-10-17T22:42:48.211006] [INFO ] [MAIN ] Derivative Progress: 1371/2083 symbols completed. OIS took 1.2s. Estimated remaining: 4m 29s. Rate: 158.6 symbols/min [2025-10-17T22:42:48.211436] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:48.254588] [DEBUG] [LOCAL ] OKE: Loaded 54350 existing records from primary storage. [2025-10-17T22:42:48.255071] [INFO ] [MAIN ] OKE: Loaded 54350 primary data records. [2025-10-17T22:42:48.322587] [DEBUG] [LOCAL ] OLP: Loaded 10256 existing records from primary storage. [2025-10-17T22:42:48.348160] [INFO ] [MAIN ] OLP: Loaded 10256 primary data records. [2025-10-17T22:42:48.738264] [DEBUG] [LOCAL ] OLN: Loaded 52723 existing records from primary storage. [2025-10-17T22:42:48.745278] [INFO ] [MAIN ] OLN: Loaded 52723 primary data records. [2025-10-17T22:42:49.283835] [DEBUG] [MAIN ] OKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:49.285632] [INFO ] [MAIN ] OKE: Generated 1820 derivative records from 54350 primary records. [2025-10-17T22:42:49.285858] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-10-17T22:42:49.299168] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:49.300098] [INFO ] [MAIN ] OLP: Generated 1820 derivative records from 10256 primary records. [2025-10-17T22:42:49.307597] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-10-17T22:42:49.332319] [DEBUG] [LOCAL ] OLP: Derivative data saved (1820 records). [2025-10-17T22:42:49.332696] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-10-17T22:42:49.336246] [INFO ] [MAIN ] Derivative Progress: 1372/2083 symbols completed. OLP took 1.1s. Estimated remaining: 4m 29s. Rate: 158.4 symbols/min [2025-10-17T22:42:49.336822] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:49.333820] [DEBUG] [LOCAL ] OKE: Derivative data saved (1820 records). [2025-10-17T22:42:49.337339] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-10-17T22:42:49.339439] [INFO ] [MAIN ] Derivative Progress: 1373/2083 symbols completed. OKE took 1.2s. Estimated remaining: 4m 29s. Rate: 158.5 symbols/min [2025-10-17T22:42:49.340203] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:49.361260] [DEBUG] [MAIN ] OLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:49.362403] [INFO ] [MAIN ] OLN: Generated 1820 derivative records from 52723 primary records. [2025-10-17T22:42:49.362473] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-10-17T22:42:49.387941] [DEBUG] [LOCAL ] OLN: Derivative data saved (1820 records). [2025-10-17T22:42:49.388158] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-10-17T22:42:49.391843] [INFO ] [MAIN ] Derivative Progress: 1374/2083 symbols completed. OLN took 1.2s. Estimated remaining: 4m 28s. Rate: 158.6 symbols/min [2025-10-17T22:42:49.392247] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:49.453787] [DEBUG] [LOCAL ] OMC: Loaded 54070 existing records from primary storage. [2025-10-17T22:42:49.454055] [INFO ] [MAIN ] OMC: Loaded 54070 primary data records. [2025-10-17T22:42:49.454799] [DEBUG] [LOCAL ] OMF: Loaded 47130 existing records from primary storage. [2025-10-17T22:42:49.475296] [INFO ] [MAIN ] OMF: Loaded 47130 primary data records. [2025-10-17T22:42:49.724990] [DEBUG] [LOCAL ] OMI: Loaded 46830 existing records from primary storage. [2025-10-17T22:42:49.748731] [INFO ] [MAIN ] OMI: Loaded 46830 primary data records. [2025-10-17T22:42:50.544841] [DEBUG] [MAIN ] OMF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:50.544322] [DEBUG] [MAIN ] OMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:50.546349] [INFO ] [MAIN ] OMF: Generated 1820 derivative records from 47130 primary records. [2025-10-17T22:42:50.545761] [INFO ] [MAIN ] OMC: Generated 1820 derivative records from 54070 primary records. [2025-10-17T22:42:50.546834] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-10-17T22:42:50.547086] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-10-17T22:42:50.572336] [DEBUG] [LOCAL ] OMC: Derivative data saved (1820 records). [2025-10-17T22:42:50.576249] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-10-17T22:42:50.581848] [INFO ] [MAIN ] Derivative Progress: 1375/2083 symbols completed. OMC took 1.2s. Estimated remaining: 4m 28s. Rate: 158.4 symbols/min [2025-10-17T22:42:50.579854] [DEBUG] [LOCAL ] OMF: Derivative data saved (1820 records). [2025-10-17T22:42:50.582025] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-10-17T22:42:50.584530] [INFO ] [MAIN ] Derivative Progress: 1376/2083 symbols completed. OMF took 1.2s. Estimated remaining: 4m 28s. Rate: 158.5 symbols/min [2025-10-17T22:42:50.584712] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:50.582163] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:50.603741] [DEBUG] [MAIN ] OMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:50.606996] [INFO ] [MAIN ] OMI: Generated 1820 derivative records from 46830 primary records. [2025-10-17T22:42:50.607182] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-10-17T22:42:50.621586] [DEBUG] [LOCAL ] ONIT: Loaded 7728 existing records from primary storage. [2025-10-17T22:42:50.629057] [DEBUG] [LOCAL ] OMI: Derivative data saved (1820 records). [2025-10-17T22:42:50.624769] [INFO ] [MAIN ] ONIT: Loaded 7728 primary data records. [2025-10-17T22:42:50.629294] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-10-17T22:42:50.632919] [INFO ] [MAIN ] Derivative Progress: 1377/2083 symbols completed. OMI took 1.2s. Estimated remaining: 4m 27s. Rate: 158.6 symbols/min [2025-10-17T22:42:50.683513] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:50.767783] [DEBUG] [LOCAL ] ONL: Loaded 29936 existing records from primary storage. [2025-10-17T22:42:50.778472] [INFO ] [MAIN ] ONL: Loaded 29936 primary data records. [2025-10-17T22:42:51.297835] [DEBUG] [LOCAL ] ONON: Loaded 54394 existing records from primary storage. [2025-10-17T22:42:51.299430] [INFO ] [MAIN ] ONON: Loaded 54394 primary data records. [2025-10-17T22:42:51.640632] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:51.642336] [INFO ] [MAIN ] ONIT: Generated 1820 derivative records from 7728 primary records. [2025-10-17T22:42:51.643362] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-10-17T22:42:51.678614] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1820 records). [2025-10-17T22:42:51.678959] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-10-17T22:42:51.679506] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:51.681747] [INFO ] [MAIN ] Derivative Progress: 1378/2083 symbols completed. ONIT took 1.1s. Estimated remaining: 4m 27s. Rate: 158.4 symbols/min [2025-10-17T22:42:51.683155] [INFO ] [MAIN ] ONL: Generated 1820 derivative records from 29936 primary records. [2025-10-17T22:42:51.683442] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-10-17T22:42:51.702364] [DEBUG] [LOCAL ] ONL: Derivative data saved (1820 records). [2025-10-17T22:42:51.702456] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-10-17T22:42:51.704832] [INFO ] [MAIN ] Derivative Progress: 1379/2083 symbols completed. ONL took 1.1s. Estimated remaining: 4m 27s. Rate: 158.5 symbols/min [2025-10-17T22:42:51.724488] [DEBUG] [MAIN ] ONON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:51.725087] [INFO ] [MAIN ] ONON: Generated 1820 derivative records from 54394 primary records. [2025-10-17T22:42:51.725147] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-10-17T22:42:51.741122] [DEBUG] [LOCAL ] ONON: Derivative data saved (1820 records). [2025-10-17T22:42:51.741216] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-10-17T22:42:51.743553] [INFO ] [MAIN ] Derivative Progress: 1380/2083 symbols completed. ONON took 1.1s. Estimated remaining: 4m 26s. Rate: 158.6 symbols/min [2025-10-17T22:42:51.744024] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:51.744140] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:51.744701] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:51.778971] [DEBUG] [LOCAL ] OOMA: Loaded 18820 existing records from primary storage. [2025-10-17T22:42:51.779155] [INFO ] [MAIN ] OOMA: Loaded 18820 primary data records. [2025-10-17T22:42:51.779725] [DEBUG] [LOCAL ] ONTF: Loaded 22973 existing records from primary storage. [2025-10-17T22:42:51.779900] [INFO ] [MAIN ] ONTF: Loaded 22973 primary data records. [2025-10-17T22:42:52.073820] [DEBUG] [LOCAL ] ONTO: Loaded 47950 existing records from primary storage. [2025-10-17T22:42:52.410321] [INFO ] [MAIN ] ONTO: Loaded 47950 primary data records. [2025-10-17T22:42:52.755977] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:52.757601] [INFO ] [MAIN ] ONTF: Generated 1820 derivative records from 22973 primary records. [2025-10-17T22:42:52.757786] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-10-17T22:42:52.779823] [DEBUG] [MAIN ] OOMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:52.784227] [INFO ] [MAIN ] OOMA: Generated 1820 derivative records from 18820 primary records. [2025-10-17T22:42:52.784323] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-10-17T22:42:52.803106] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1820 records). [2025-10-17T22:42:52.803259] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-10-17T22:42:52.805475] [INFO ] [MAIN ] Derivative Progress: 1381/2083 symbols completed. ONTF took 1.1s. Estimated remaining: 4m 26s. Rate: 158.4 symbols/min [2025-10-17T22:42:52.805873] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:52.810995] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1820 records). [2025-10-17T22:42:52.811313] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-10-17T22:42:52.815362] [INFO ] [MAIN ] Derivative Progress: 1382/2083 symbols completed. OOMA took 1.1s. Estimated remaining: 4m 25s. Rate: 158.5 symbols/min [2025-10-17T22:42:52.816260] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:52.837316] [DEBUG] [MAIN ] ONTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:52.838108] [INFO ] [MAIN ] ONTO: Generated 1820 derivative records from 47950 primary records. [2025-10-17T22:42:52.838332] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-10-17T22:42:52.855802] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1820 records). [2025-10-17T22:42:52.864268] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-10-17T22:42:52.866800] [INFO ] [MAIN ] Derivative Progress: 1383/2083 symbols completed. ONTO took 1.1s. Estimated remaining: 4m 25s. Rate: 158.6 symbols/min [2025-10-17T22:42:52.868131] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:52.869137] [DEBUG] [LOCAL ] OPAD: Loaded 25646 existing records from primary storage. [2025-10-17T22:42:52.869389] [INFO ] [MAIN ] OPAD: Loaded 25646 primary data records. [2025-10-17T22:42:53.018835] [DEBUG] [LOCAL ] OPFI: Loaded 46886 existing records from primary storage. [2025-10-17T22:42:53.017944] [DEBUG] [LOCAL ] OPP: Loaded 12536 existing records from primary storage. [2025-10-17T22:42:53.019020] [INFO ] [MAIN ] OPP: Loaded 12536 primary data records. [2025-10-17T22:42:53.019120] [INFO ] [MAIN ] OPFI: Loaded 46886 primary data records. [2025-10-17T22:42:53.809099] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:53.810819] [INFO ] [MAIN ] OPAD: Generated 1820 derivative records from 25646 primary records. [2025-10-17T22:42:53.811483] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-10-17T22:42:53.869362] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1820 records). [2025-10-17T22:42:53.869726] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-10-17T22:42:53.872348] [INFO ] [MAIN ] Derivative Progress: 1384/2083 symbols completed. OPAD took 1.1s. Estimated remaining: 4m 25s. Rate: 158.4 symbols/min [2025-10-17T22:42:53.870106] [DEBUG] [MAIN ] OPFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:53.874238] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:53.873046] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:53.874081] [INFO ] [MAIN ] OPFI: Generated 1820 derivative records from 46886 primary records. [2025-10-17T22:42:53.875494] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-10-17T22:42:53.875412] [INFO ] [MAIN ] OPP: Generated 1820 derivative records from 12536 primary records. [2025-10-17T22:42:53.877318] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-17T22:42:53.911059] [DEBUG] [LOCAL ] OPP: Derivative data saved (1820 records). [2025-10-17T22:42:53.912390] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-10-17T22:42:53.916349] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1820 records). [2025-10-17T22:42:53.916472] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-10-17T22:42:53.915947] [INFO ] [MAIN ] Derivative Progress: 1385/2083 symbols completed. OPP took 1.0s. Estimated remaining: 4m 24s. Rate: 158.5 symbols/min [2025-10-17T22:42:53.919246] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:53.919559] [INFO ] [MAIN ] Derivative Progress: 1386/2083 symbols completed. OPFI took 1.1s. Estimated remaining: 4m 24s. Rate: 158.6 symbols/min [2025-10-17T22:42:53.919740] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:53.970207] [DEBUG] [LOCAL ] ORN: Loaded 31321 existing records from primary storage. [2025-10-17T22:42:53.970465] [INFO ] [MAIN ] ORN: Loaded 31321 primary data records. [2025-10-17T22:42:54.065292] [DEBUG] [LOCAL ] OR: Loaded 47473 existing records from primary storage. [2025-10-17T22:42:54.077891] [DEBUG] [LOCAL ] ORA: Loaded 33548 existing records from primary storage. [2025-10-17T22:42:54.078033] [INFO ] [MAIN ] OR: Loaded 47473 primary data records. [2025-10-17T22:42:54.089245] [INFO ] [MAIN ] ORA: Loaded 33548 primary data records. [2025-10-17T22:42:55.033843] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:55.040187] [INFO ] [MAIN ] ORN: Generated 1820 derivative records from 31321 primary records. [2025-10-17T22:42:55.039295] [DEBUG] [MAIN ] OR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:55.053411] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-10-17T22:42:55.048824] [INFO ] [MAIN ] OR: Generated 1820 derivative records from 47473 primary records. [2025-10-17T22:42:55.054460] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-10-17T22:42:55.055622] [DEBUG] [MAIN ] ORA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:55.057145] [INFO ] [MAIN ] ORA: Generated 1820 derivative records from 33548 primary records. [2025-10-17T22:42:55.071727] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-10-17T22:42:55.085263] [DEBUG] [LOCAL ] OR: Derivative data saved (1820 records). [2025-10-17T22:42:55.093555] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-10-17T22:42:55.096243] [INFO ] [MAIN ] Derivative Progress: 1387/2083 symbols completed. OR took 1.2s. Estimated remaining: 4m 24s. Rate: 158.4 symbols/min [2025-10-17T22:42:55.101081] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:55.107927] [DEBUG] [LOCAL ] ORA: Derivative data saved (1820 records). [2025-10-17T22:42:55.109074] [DEBUG] [LOCAL ] ORN: Derivative data saved (1820 records). [2025-10-17T22:42:55.108614] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-10-17T22:42:55.111693] [INFO ] [MAIN ] Derivative Progress: 1388/2083 symbols completed. ORA took 1.2s. Estimated remaining: 4m 23s. Rate: 158.5 symbols/min [2025-10-17T22:42:55.111873] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-10-17T22:42:55.114193] [INFO ] [MAIN ] Derivative Progress: 1389/2083 symbols completed. ORN took 1.2s. Estimated remaining: 4m 23s. Rate: 158.6 symbols/min [2025-10-17T22:42:55.112022] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:55.114502] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:55.190195] [DEBUG] [LOCAL ] OSCR: Loaded 54539 existing records from primary storage. [2025-10-17T22:42:55.190409] [INFO ] [MAIN ] OSCR: Loaded 54539 primary data records. [2025-10-17T22:42:55.322732] [DEBUG] [LOCAL ] OTIS: Loaded 53507 existing records from primary storage. [2025-10-17T22:42:55.323035] [INFO ] [MAIN ] OTIS: Loaded 53507 primary data records. [2025-10-17T22:42:55.324398] [DEBUG] [LOCAL ] OUT: Loaded 48459 existing records from primary storage. [2025-10-17T22:42:55.359933] [INFO ] [MAIN ] OUT: Loaded 48459 primary data records. [2025-10-17T22:42:56.168571] [DEBUG] [MAIN ] OSCR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:56.169932] [INFO ] [MAIN ] OSCR: Generated 1820 derivative records from 54539 primary records. [2025-10-17T22:42:56.170198] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-10-17T22:42:56.216271] [DEBUG] [MAIN ] OTIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:56.223051] [DEBUG] [MAIN ] OUT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:56.224594] [INFO ] [MAIN ] OUT: Generated 1820 derivative records from 48459 primary records. [2025-10-17T22:42:56.225449] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-10-17T22:42:56.223831] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1820 records). [2025-10-17T22:42:56.226190] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-10-17T22:42:56.225589] [INFO ] [MAIN ] OTIS: Generated 1820 derivative records from 53507 primary records. [2025-10-17T22:42:56.229185] [INFO ] [MAIN ] Derivative Progress: 1390/2083 symbols completed. OSCR took 1.1s. Estimated remaining: 4m 23s. Rate: 158.4 symbols/min [2025-10-17T22:42:56.226908] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-10-17T22:42:56.238253] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:56.261260] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1820 records). [2025-10-17T22:42:56.262744] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-10-17T22:42:56.265788] [INFO ] [MAIN ] Derivative Progress: 1391/2083 symbols completed. OTIS took 1.2s. Estimated remaining: 4m 22s. Rate: 158.5 symbols/min [2025-10-17T22:42:56.266499] [DEBUG] [LOCAL ] OUT: Derivative data saved (1820 records). [2025-10-17T22:42:56.266909] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-10-17T22:42:56.266615] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:56.269356] [INFO ] [MAIN ] Derivative Progress: 1392/2083 symbols completed. OUT took 1.2s. Estimated remaining: 4m 21s. Rate: 158.6 symbols/min [2025-10-17T22:42:56.270026] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:56.290314] [DEBUG] [LOCAL ] OWLT: Loaded 9544 existing records from primary storage. [2025-10-17T22:42:56.290682] [INFO ] [MAIN ] OWLT: Loaded 9544 primary data records. [2025-10-17T22:42:56.493927] [DEBUG] [LOCAL ] OVV: Loaded 54291 existing records from primary storage. [2025-10-17T22:42:56.543500] [INFO ] [MAIN ] OVV: Loaded 54291 primary data records. [2025-10-17T22:42:56.550438] [DEBUG] [LOCAL ] OWL: Loaded 54336 existing records from primary storage. [2025-10-17T22:42:56.695271] [INFO ] [MAIN ] OWL: Loaded 54336 primary data records. [2025-10-17T22:42:57.375911] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:57.378813] [INFO ] [MAIN ] OWLT: Generated 1820 derivative records from 9544 primary records. [2025-10-17T22:42:57.379056] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-10-17T22:42:57.396481] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1820 records). [2025-10-17T22:42:57.397162] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-10-17T22:42:57.399470] [INFO ] [MAIN ] Derivative Progress: 1393/2083 symbols completed. OWLT took 1.1s. Estimated remaining: 4m 21s. Rate: 158.4 symbols/min [2025-10-17T22:42:57.436127] [DEBUG] [MAIN ] OWL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:57.436408] [DEBUG] [MAIN ] OVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:57.437471] [INFO ] [MAIN ] OWL: Generated 1820 derivative records from 54336 primary records. [2025-10-17T22:42:57.438485] [INFO ] [MAIN ] OVV: Generated 1820 derivative records from 54291 primary records. [2025-10-17T22:42:57.438617] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-10-17T22:42:57.438766] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-10-17T22:42:57.470709] [DEBUG] [LOCAL ] OWL: Derivative data saved (1820 records). [2025-10-17T22:42:57.472513] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-10-17T22:42:57.476173] [INFO ] [MAIN ] Derivative Progress: 1394/2083 symbols completed. OWL took 1.2s. Estimated remaining: 4m 21s. Rate: 158.5 symbols/min [2025-10-17T22:42:57.478589] [DEBUG] [LOCAL ] OVV: Derivative data saved (1820 records). [2025-10-17T22:42:57.478709] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-10-17T22:42:57.481342] [INFO ] [MAIN ] Derivative Progress: 1395/2083 symbols completed. OVV took 1.2s. Estimated remaining: 4m 20s. Rate: 158.6 symbols/min [2025-10-17T22:42:57.481838] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:57.482010] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:57.482186] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:57.498469] [DEBUG] [LOCAL ] PAC: Loaded 11922 existing records from primary storage. [2025-10-17T22:42:57.498931] [INFO ] [MAIN ] PAC: Loaded 11922 primary data records. [2025-10-17T22:42:57.849868] [DEBUG] [LOCAL ] OXM: Loaded 33719 existing records from primary storage. [2025-10-17T22:42:57.866713] [INFO ] [MAIN ] OXM: Loaded 33719 primary data records. [2025-10-17T22:42:57.882680] [DEBUG] [LOCAL ] PAAS: Loaded 54403 existing records from primary storage. [2025-10-17T22:42:57.939364] [INFO ] [MAIN ] PAAS: Loaded 54403 primary data records. [2025-10-17T22:42:58.599496] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:58.610534] [INFO ] [MAIN ] PAC: Generated 1820 derivative records from 11922 primary records. [2025-10-17T22:42:58.611714] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-10-17T22:42:58.632185] [DEBUG] [LOCAL ] PAC: Derivative data saved (1820 records). [2025-10-17T22:42:58.633700] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-10-17T22:42:58.636370] [INFO ] [MAIN ] Derivative Progress: 1396/2083 symbols completed. PAC took 1.2s. Estimated remaining: 4m 20s. Rate: 158.3 symbols/min [2025-10-17T22:42:58.636542] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:58.682299] [DEBUG] [MAIN ] PAAS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:58.698052] [INFO ] [MAIN ] PAAS: Generated 1820 derivative records from 54403 primary records. [2025-10-17T22:42:58.700625] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-10-17T22:42:58.701604] [DEBUG] [MAIN ] OXM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:58.712176] [INFO ] [MAIN ] OXM: Generated 1820 derivative records from 33719 primary records. [2025-10-17T22:42:58.730180] [DEBUG] [LOCAL ] PACK: Loaded 32458 existing records from primary storage. [2025-10-17T22:42:58.729505] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1820 records). [2025-10-17T22:42:58.730396] [INFO ] [MAIN ] PACK: Loaded 32458 primary data records. [2025-10-17T22:42:58.730325] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-10-17T22:42:58.730503] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-10-17T22:42:58.772259] [INFO ] [MAIN ] Derivative Progress: 1397/2083 symbols completed. PAAS took 1.3s. Estimated remaining: 4m 20s. Rate: 158.4 symbols/min [2025-10-17T22:42:58.785258] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:58.808345] [DEBUG] [LOCAL ] OXM: Derivative data saved (1820 records). [2025-10-17T22:42:58.831973] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-10-17T22:42:58.834415] [INFO ] [MAIN ] Derivative Progress: 1398/2083 symbols completed. OXM took 1.4s. Estimated remaining: 4m 19s. Rate: 158.5 symbols/min [2025-10-17T22:42:58.834736] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:59.099964] [DEBUG] [LOCAL ] PAG: Loaded 21914 existing records from primary storage. [2025-10-17T22:42:59.100113] [INFO ] [MAIN ] PAG: Loaded 21914 primary data records. [2025-10-17T22:42:59.216734] [DEBUG] [LOCAL ] PACS: Loaded 35165 existing records from primary storage. [2025-10-17T22:42:59.217814] [INFO ] [MAIN ] PACS: Loaded 35165 primary data records. [2025-10-17T22:42:59.768033] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:59.771360] [INFO ] [MAIN ] PACK: Generated 1820 derivative records from 32458 primary records. [2025-10-17T22:42:59.771890] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-10-17T22:42:59.792833] [DEBUG] [LOCAL ] PACK: Derivative data saved (1820 records). [2025-10-17T22:42:59.792975] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-10-17T22:42:59.795387] [INFO ] [MAIN ] Derivative Progress: 1399/2083 symbols completed. PACK took 1.2s. Estimated remaining: 4m 19s. Rate: 158.3 symbols/min [2025-10-17T22:42:59.795703] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:59.810882] [DEBUG] [MAIN ] PAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:59.812014] [INFO ] [MAIN ] PAG: Generated 1820 derivative records from 21914 primary records. [2025-10-17T22:42:59.812444] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-10-17T22:42:59.833491] [DEBUG] [LOCAL ] PAG: Derivative data saved (1820 records). [2025-10-17T22:42:59.834093] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-10-17T22:42:59.836408] [INFO ] [MAIN ] Derivative Progress: 1400/2083 symbols completed. PAG took 1.0s. Estimated remaining: 4m 19s. Rate: 158.4 symbols/min [2025-10-17T22:42:59.836855] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:42:59.845768] [DEBUG] [LOCAL ] PAI: Loaded 2805 existing records from primary storage. [2025-10-17T22:42:59.859139] [INFO ] [MAIN ] PAI: Loaded 2805 primary data records. [2025-10-17T22:42:59.945779] [DEBUG] [MAIN ] PACS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:42:59.993411] [INFO ] [MAIN ] PACS: Generated 1820 derivative records from 35165 primary records. [2025-10-17T22:42:59.994619] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-10-17T22:43:00.027400] [DEBUG] [LOCAL ] PAGS: Loaded 53590 existing records from primary storage. [2025-10-17T22:43:00.049170] [INFO ] [MAIN ] PAGS: Loaded 53590 primary data records. [2025-10-17T22:43:00.299350] [DEBUG] [LOCAL ] PACS: Derivative data saved (1820 records). [2025-10-17T22:43:00.306932] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-10-17T22:43:00.322677] [INFO ] [MAIN ] Derivative Progress: 1401/2083 symbols completed. PACS took 1.5s. Estimated remaining: 4m 18s. Rate: 158.4 symbols/min [2025-10-17T22:43:00.330132] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:00.640936] [DEBUG] [LOCAL ] PAM: Loaded 29195 existing records from primary storage. [2025-10-17T22:43:00.654537] [INFO ] [MAIN ] PAM: Loaded 29195 primary data records. [2025-10-17T22:43:00.655787] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:00.678910] [INFO ] [MAIN ] PAI: Generated 1820 derivative records from 2805 primary records. [2025-10-17T22:43:00.695530] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-17T22:43:00.789763] [DEBUG] [LOCAL ] PAI: Derivative data saved (1820 records). [2025-10-17T22:43:00.795685] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-10-17T22:43:00.809562] [INFO ] [MAIN ] Derivative Progress: 1402/2083 symbols completed. PAI took 1.0s. Estimated remaining: 4m 18s. Rate: 158.4 symbols/min [2025-10-17T22:43:00.809914] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:01.035938] [DEBUG] [MAIN ] PAGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:01.042911] [INFO ] [MAIN ] PAGS: Generated 1820 derivative records from 53590 primary records. [2025-10-17T22:43:01.043124] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-10-17T22:43:01.089171] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1820 records). [2025-10-17T22:43:01.091113] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-10-17T22:43:01.093740] [INFO ] [MAIN ] Derivative Progress: 1403/2083 symbols completed. PAGS took 1.3s. Estimated remaining: 4m 18s. Rate: 158.4 symbols/min [2025-10-17T22:43:01.094301] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:01.097012] [DEBUG] [LOCAL ] PAR: Loaded 34624 existing records from primary storage. [2025-10-17T22:43:01.097266] [INFO ] [MAIN ] PAR: Loaded 34624 primary data records. [2025-10-17T22:43:01.442223] [DEBUG] [MAIN ] PAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:01.444465] [INFO ] [MAIN ] PAM: Generated 1820 derivative records from 29195 primary records. [2025-10-17T22:43:01.444978] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-10-17T22:43:01.482159] [DEBUG] [LOCAL ] PAM: Derivative data saved (1820 records). [2025-10-17T22:43:01.482582] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-10-17T22:43:01.485258] [DEBUG] [LOCAL ] PARR: Loaded 48792 existing records from primary storage. [2025-10-17T22:43:01.486082] [INFO ] [MAIN ] PARR: Loaded 48792 primary data records. [2025-10-17T22:43:01.489181] [INFO ] [MAIN ] Derivative Progress: 1404/2083 symbols completed. PAM took 1.2s. Estimated remaining: 4m 17s. Rate: 158.4 symbols/min [2025-10-17T22:43:01.496815] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:01.708815] [DEBUG] [MAIN ] PAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:01.836548] [INFO ] [MAIN ] PAR: Generated 1820 derivative records from 34624 primary records. [2025-10-17T22:43:01.838197] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-10-17T22:43:01.877160] [DEBUG] [LOCAL ] PAR: Derivative data saved (1820 records). [2025-10-17T22:43:01.879704] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-10-17T22:43:01.883395] [INFO ] [MAIN ] Derivative Progress: 1405/2083 symbols completed. PAR took 1.1s. Estimated remaining: 4m 17s. Rate: 158.4 symbols/min [2025-10-17T22:43:01.883767] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:01.905347] [DEBUG] [LOCAL ] PATH: Loaded 54460 existing records from primary storage. [2025-10-17T22:43:01.907411] [INFO ] [MAIN ] PATH: Loaded 54460 primary data records. [2025-10-17T22:43:02.070758] [DEBUG] [LOCAL ] PAXS: Loaded 21123 existing records from primary storage. [2025-10-17T22:43:02.082435] [INFO ] [MAIN ] PAXS: Loaded 21123 primary data records. [2025-10-17T22:43:02.178329] [DEBUG] [MAIN ] PARR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:02.234807] [INFO ] [MAIN ] PARR: Generated 1820 derivative records from 48792 primary records. [2025-10-17T22:43:02.242710] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-10-17T22:43:02.487283] [DEBUG] [LOCAL ] PARR: Derivative data saved (1820 records). [2025-10-17T22:43:02.487628] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-10-17T22:43:02.524811] [INFO ] [MAIN ] Derivative Progress: 1406/2083 symbols completed. PARR took 1.4s. Estimated remaining: 4m 17s. Rate: 158.3 symbols/min [2025-10-17T22:43:02.605805] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:02.632446] [DEBUG] [MAIN ] PATH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:02.633481] [INFO ] [MAIN ] PATH: Generated 1820 derivative records from 54460 primary records. [2025-10-17T22:43:02.633678] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-10-17T22:43:02.673962] [DEBUG] [MAIN ] PAXS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:02.685557] [INFO ] [MAIN ] PAXS: Generated 1820 derivative records from 21123 primary records. [2025-10-17T22:43:02.685683] [DEBUG] [LOCAL ] PATH: Derivative data saved (1820 records). [2025-10-17T22:43:02.685864] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-10-17T22:43:02.685805] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-10-17T22:43:02.689151] [INFO ] [MAIN ] Derivative Progress: 1407/2083 symbols completed. PATH took 1.2s. Estimated remaining: 4m 16s. Rate: 158.4 symbols/min [2025-10-17T22:43:02.686414] [DEBUG] [LOCAL ] PAY: Loaded 39122 existing records from primary storage. [2025-10-17T22:43:02.689661] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:02.690158] [INFO ] [MAIN ] PAY: Loaded 39122 primary data records. [2025-10-17T22:43:02.844035] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1820 records). [2025-10-17T22:43:02.931875] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-10-17T22:43:03.038546] [INFO ] [MAIN ] Derivative Progress: 1408/2083 symbols completed. PAXS took 1.2s. Estimated remaining: 4m 16s. Rate: 158.4 symbols/min [2025-10-17T22:43:03.051568] [DEBUG] [LOCAL ] PAYC: Loaded 36844 existing records from primary storage. [2025-10-17T22:43:03.052624] [INFO ] [MAIN ] PAYC: Loaded 36844 primary data records. [2025-10-17T22:43:03.362665] [DEBUG] [MAIN ] PAY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:03.363512] [INFO ] [MAIN ] PAY: Generated 1820 derivative records from 39122 primary records. [2025-10-17T22:43:03.364635] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-10-17T22:43:03.384085] [DEBUG] [LOCAL ] PAY: Derivative data saved (1820 records). [2025-10-17T22:43:03.384308] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-10-17T22:43:03.386580] [INFO ] [MAIN ] Derivative Progress: 1409/2083 symbols completed. PAY took 0.8s. Estimated remaining: 4m 15s. Rate: 158.4 symbols/min [2025-10-17T22:43:03.403736] [DEBUG] [MAIN ] PAYC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:03.404396] [INFO ] [MAIN ] PAYC: Generated 1820 derivative records from 36844 primary records. [2025-10-17T22:43:03.404457] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-10-17T22:43:03.420410] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1820 records). [2025-10-17T22:43:03.420472] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-10-17T22:43:03.422833] [INFO ] [MAIN ] Derivative Progress: 1410/2083 symbols completed. PAYC took 0.7s. Estimated remaining: 4m 15s. Rate: 158.5 symbols/min [2025-10-17T22:43:03.423292] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:03.423398] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:03.423911] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:03.490405] [DEBUG] [LOCAL ] PB: Loaded 42728 existing records from primary storage. [2025-10-17T22:43:03.504540] [INFO ] [MAIN ] PB: Loaded 42728 primary data records. [2025-10-17T22:43:03.526352] [DEBUG] [LOCAL ] PBA: Loaded 49917 existing records from primary storage. [2025-10-17T22:43:03.549964] [INFO ] [MAIN ] PBA: Loaded 49917 primary data records. [2025-10-17T22:43:03.669039] [DEBUG] [LOCAL ] PBF: Loaded 53909 existing records from primary storage. [2025-10-17T22:43:03.705962] [INFO ] [MAIN ] PBF: Loaded 53909 primary data records. [2025-10-17T22:43:04.467807] [DEBUG] [MAIN ] PB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:04.470259] [INFO ] [MAIN ] PB: Generated 1820 derivative records from 42728 primary records. [2025-10-17T22:43:04.470739] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-10-17T22:43:04.492005] [DEBUG] [MAIN ] PBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:04.498559] [INFO ] [MAIN ] PBA: Generated 1820 derivative records from 49917 primary records. [2025-10-17T22:43:04.501425] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-10-17T22:43:04.502888] [DEBUG] [LOCAL ] PB: Derivative data saved (1820 records). [2025-10-17T22:43:04.503118] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-10-17T22:43:04.524885] [INFO ] [MAIN ] Derivative Progress: 1411/2083 symbols completed. PB took 1.1s. Estimated remaining: 4m 15s. Rate: 158.3 symbols/min [2025-10-17T22:43:04.526302] [DEBUG] [MAIN ] PBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:04.529787] [INFO ] [MAIN ] PBF: Generated 1820 derivative records from 53909 primary records. [2025-10-17T22:43:04.529927] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:04.531707] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-10-17T22:43:04.534971] [DEBUG] [LOCAL ] PBA: Derivative data saved (1820 records). [2025-10-17T22:43:04.535235] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-10-17T22:43:04.537502] [INFO ] [MAIN ] Derivative Progress: 1412/2083 symbols completed. PBA took 1.1s. Estimated remaining: 4m 14s. Rate: 158.4 symbols/min [2025-10-17T22:43:04.548552] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:04.554012] [DEBUG] [LOCAL ] PBF: Derivative data saved (1820 records). [2025-10-17T22:43:04.554130] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-10-17T22:43:04.556380] [INFO ] [MAIN ] Derivative Progress: 1413/2083 symbols completed. PBF took 1.1s. Estimated remaining: 4m 14s. Rate: 158.5 symbols/min [2025-10-17T22:43:04.556814] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:04.617990] [DEBUG] [LOCAL ] PBH: Loaded 33130 existing records from primary storage. [2025-10-17T22:43:04.618753] [INFO ] [MAIN ] PBH: Loaded 33130 primary data records. [2025-10-17T22:43:04.689716] [DEBUG] [LOCAL ] PBI: Loaded 50739 existing records from primary storage. [2025-10-17T22:43:04.760138] [INFO ] [MAIN ] PBI: Loaded 50739 primary data records. [2025-10-17T22:43:04.760802] [DEBUG] [LOCAL ] PBR: Loaded 54493 existing records from primary storage. [2025-10-17T22:43:04.771859] [INFO ] [MAIN ] PBR: Loaded 54493 primary data records. [2025-10-17T22:43:05.634574] [DEBUG] [MAIN ] PBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:05.635531] [INFO ] [MAIN ] PBH: Generated 1820 derivative records from 33130 primary records. [2025-10-17T22:43:05.635940] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-10-17T22:43:05.657578] [DEBUG] [LOCAL ] PBH: Derivative data saved (1820 records). [2025-10-17T22:43:05.658548] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-10-17T22:43:05.660491] [INFO ] [MAIN ] Derivative Progress: 1414/2083 symbols completed. PBH took 1.1s. Estimated remaining: 4m 14s. Rate: 158.3 symbols/min [2025-10-17T22:43:05.661273] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:05.683105] [DEBUG] [MAIN ] PBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:05.689949] [INFO ] [MAIN ] PBR: Generated 1820 derivative records from 54493 primary records. [2025-10-17T22:43:05.690039] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-10-17T22:43:05.689121] [DEBUG] [MAIN ] PBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:05.691888] [INFO ] [MAIN ] PBI: Generated 1820 derivative records from 50739 primary records. [2025-10-17T22:43:05.692355] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-10-17T22:43:05.735879] [DEBUG] [LOCAL ] PBI: Derivative data saved (1820 records). [2025-10-17T22:43:05.738355] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-10-17T22:43:05.738095] [DEBUG] [LOCAL ] PBR: Derivative data saved (1820 records). [2025-10-17T22:43:05.742228] [INFO ] [MAIN ] Derivative Progress: 1415/2083 symbols completed. PBI took 1.2s. Estimated remaining: 4m 13s. Rate: 158.4 symbols/min [2025-10-17T22:43:05.742778] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:05.742600] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-10-17T22:43:05.745991] [INFO ] [MAIN ] Derivative Progress: 1416/2083 symbols completed. PBR took 1.2s. Estimated remaining: 4m 13s. Rate: 158.5 symbols/min [2025-10-17T22:43:05.753617] [INFO ] [MAIN ] PCG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:05.755714] [DEBUG] [LOCAL ] PBT: Loaded 17711 existing records from primary storage. [2025-10-17T22:43:05.756672] [INFO ] [MAIN ] PBT: Loaded 17711 primary data records. [2025-10-17T22:43:05.851683] [DEBUG] [LOCAL ] PCF: Loaded 9163 existing records from primary storage. [2025-10-17T22:43:05.870070] [INFO ] [MAIN ] PCF: Loaded 9163 primary data records. [2025-10-17T22:43:06.417740] [DEBUG] [LOCAL ] PCG: Loaded 54499 existing records from primary storage. [2025-10-17T22:43:06.419982] [INFO ] [MAIN ] PCG: Loaded 54499 primary data records. [2025-10-17T22:43:06.648510] [DEBUG] [MAIN ] PBT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:06.650370] [INFO ] [MAIN ] PBT: Generated 1820 derivative records from 17711 primary records. [2025-10-17T22:43:06.851497] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-10-17T22:43:06.911098] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:06.912112] [INFO ] [MAIN ] PCF: Generated 1820 derivative records from 9163 primary records. [2025-10-17T22:43:06.912693] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-17T22:43:06.910742] [DEBUG] [LOCAL ] PBT: Derivative data saved (1820 records). [2025-10-17T22:43:06.913931] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-10-17T22:43:06.917432] [INFO ] [MAIN ] Derivative Progress: 1417/2083 symbols completed. PBT took 1.3s. Estimated remaining: 4m 13s. Rate: 158.2 symbols/min [2025-10-17T22:43:06.928213] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:06.933138] [DEBUG] [LOCAL ] PCF: Derivative data saved (1820 records). [2025-10-17T22:43:06.933353] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-10-17T22:43:06.936041] [INFO ] [MAIN ] Derivative Progress: 1418/2083 symbols completed. PCF took 1.2s. Estimated remaining: 4m 12s. Rate: 158.3 symbols/min [2025-10-17T22:43:06.936482] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:06.946734] [DEBUG] [LOCAL ] PCM: Loaded 6870 existing records from primary storage. [2025-10-17T22:43:06.959555] [DEBUG] [MAIN ] PCG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:06.959284] [INFO ] [MAIN ] PCM: Loaded 6870 primary data records. [2025-10-17T22:43:06.960350] [INFO ] [MAIN ] PCG: Generated 1820 derivative records from 54499 primary records. [2025-10-17T22:43:06.980628] [DEBUG] [LOCAL ] PCG: Saving derivative data. [2025-10-17T22:43:07.084429] [DEBUG] [LOCAL ] PCG: Derivative data saved (1820 records). [2025-10-17T22:43:07.092901] [INFO ] [MAIN ] PCG: Successfully saved derivative data. [2025-10-17T22:43:07.116549] [INFO ] [MAIN ] Derivative Progress: 1419/2083 symbols completed. PCG took 1.4s. Estimated remaining: 4m 12s. Rate: 158.4 symbols/min [2025-10-17T22:43:07.109259] [DEBUG] [LOCAL ] PCN: Loaded 25556 existing records from primary storage. [2025-10-17T22:43:07.134361] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:07.143176] [INFO ] [MAIN ] PCN: Loaded 25556 primary data records. [2025-10-17T22:43:07.629356] [DEBUG] [LOCAL ] PCOR: Loaded 48362 existing records from primary storage. [2025-10-17T22:43:07.629887] [INFO ] [MAIN ] PCOR: Loaded 48362 primary data records. [2025-10-17T22:43:07.769742] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:07.773845] [INFO ] [MAIN ] PCM: Generated 1820 derivative records from 6870 primary records. [2025-10-17T22:43:07.774032] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-17T22:43:08.018269] [DEBUG] [LOCAL ] PCM: Derivative data saved (1820 records). [2025-10-17T22:43:08.026323] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-10-17T22:43:08.033465] [INFO ] [MAIN ] Derivative Progress: 1420/2083 symbols completed. PCM took 1.1s. Estimated remaining: 4m 11s. Rate: 158.2 symbols/min [2025-10-17T22:43:08.034723] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:08.034578] [DEBUG] [MAIN ] PCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:08.037060] [INFO ] [MAIN ] PCN: Generated 1820 derivative records from 25556 primary records. [2025-10-17T22:43:08.037422] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-10-17T22:43:08.064938] [DEBUG] [LOCAL ] PCN: Derivative data saved (1820 records). [2025-10-17T22:43:08.065278] [DEBUG] [LOCAL ] PCQ: Loaded 12357 existing records from primary storage. [2025-10-17T22:43:08.065422] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-10-17T22:43:08.065589] [INFO ] [MAIN ] PCQ: Loaded 12357 primary data records. [2025-10-17T22:43:08.067803] [INFO ] [MAIN ] Derivative Progress: 1421/2083 symbols completed. PCN took 1.1s. Estimated remaining: 4m 11s. Rate: 158.3 symbols/min [2025-10-17T22:43:08.079146] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:08.268576] [DEBUG] [MAIN ] PCOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:08.362439] [INFO ] [MAIN ] PCOR: Generated 1820 derivative records from 48362 primary records. [2025-10-17T22:43:08.383804] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-10-17T22:43:08.412133] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1820 records). [2025-10-17T22:43:08.412780] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-10-17T22:43:08.414844] [INFO ] [MAIN ] Derivative Progress: 1422/2083 symbols completed. PCOR took 1.3s. Estimated remaining: 4m 10s. Rate: 158.4 symbols/min [2025-10-17T22:43:08.415434] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:08.433165] [DEBUG] [LOCAL ] PD: Loaded 48923 existing records from primary storage. [2025-10-17T22:43:08.433831] [INFO ] [MAIN ] PD: Loaded 48923 primary data records. [2025-10-17T22:43:08.599692] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:08.627549] [INFO ] [MAIN ] PCQ: Generated 1820 derivative records from 12357 primary records. [2025-10-17T22:43:08.644441] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-17T22:43:08.840753] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1820 records). [2025-10-17T22:43:08.842437] [DEBUG] [LOCAL ] PDI: Loaded 50903 existing records from primary storage. [2025-10-17T22:43:08.843086] [INFO ] [MAIN ] PDI: Loaded 50903 primary data records. [2025-10-17T22:43:08.842794] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-10-17T22:43:08.845188] [INFO ] [MAIN ] Derivative Progress: 1423/2083 symbols completed. PCQ took 0.8s. Estimated remaining: 4m 10s. Rate: 158.3 symbols/min [2025-10-17T22:43:09.159020] [DEBUG] [MAIN ] PD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:09.160242] [INFO ] [MAIN ] PD: Generated 1820 derivative records from 48923 primary records. [2025-10-17T22:43:09.160691] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-10-17T22:43:09.178004] [DEBUG] [LOCAL ] PD: Derivative data saved (1820 records). [2025-10-17T22:43:09.178276] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-10-17T22:43:09.180320] [INFO ] [MAIN ] Derivative Progress: 1424/2083 symbols completed. PD took 1.1s. Estimated remaining: 4m 10s. Rate: 158.4 symbols/min [2025-10-17T22:43:09.198014] [DEBUG] [MAIN ] PDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:09.198541] [INFO ] [MAIN ] PDI: Generated 1820 derivative records from 50903 primary records. [2025-10-17T22:43:09.198598] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-10-17T22:43:09.214148] [DEBUG] [LOCAL ] PDI: Derivative data saved (1820 records). [2025-10-17T22:43:09.214207] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-10-17T22:43:09.216177] [INFO ] [MAIN ] Derivative Progress: 1425/2083 symbols completed. PDI took 0.8s. Estimated remaining: 4m 9s. Rate: 158.5 symbols/min [2025-10-17T22:43:09.216610] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:09.216546] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:09.216847] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:09.234996] [DEBUG] [LOCAL ] PDS: Loaded 17407 existing records from primary storage. [2025-10-17T22:43:09.235148] [INFO ] [MAIN ] PDS: Loaded 17407 primary data records. [2025-10-17T22:43:09.422685] [DEBUG] [LOCAL ] PDO: Loaded 31991 existing records from primary storage. [2025-10-17T22:43:09.556206] [DEBUG] [LOCAL ] PDM: Loaded 40439 existing records from primary storage. [2025-10-17T22:43:09.456337] [INFO ] [MAIN ] PDO: Loaded 31991 primary data records. [2025-10-17T22:43:09.569866] [INFO ] [MAIN ] PDM: Loaded 40439 primary data records. [2025-10-17T22:43:10.260188] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:10.261403] [INFO ] [MAIN ] PDS: Generated 1820 derivative records from 17407 primary records. [2025-10-17T22:43:10.262454] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-10-17T22:43:10.290174] [DEBUG] [LOCAL ] PDS: Derivative data saved (1820 records). [2025-10-17T22:43:10.290465] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-10-17T22:43:10.293518] [INFO ] [MAIN ] Derivative Progress: 1426/2083 symbols completed. PDS took 1.1s. Estimated remaining: 4m 9s. Rate: 158.2 symbols/min [2025-10-17T22:43:10.293787] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:10.313212] [DEBUG] [MAIN ] PDO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:10.314336] [INFO ] [MAIN ] PDO: Generated 1820 derivative records from 31991 primary records. [2025-10-17T22:43:10.314522] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-10-17T22:43:10.372204] [DEBUG] [LOCAL ] PDT: Loaded 17796 existing records from primary storage. [2025-10-17T22:43:10.378122] [INFO ] [MAIN ] PDT: Loaded 17796 primary data records. [2025-10-17T22:43:10.443015] [DEBUG] [LOCAL ] PDO: Derivative data saved (1820 records). [2025-10-17T22:43:10.415882] [DEBUG] [MAIN ] PDM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:10.463343] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-10-17T22:43:10.488857] [INFO ] [MAIN ] Derivative Progress: 1427/2083 symbols completed. PDO took 1.3s. Estimated remaining: 4m 9s. Rate: 158.3 symbols/min [2025-10-17T22:43:10.486253] [INFO ] [MAIN ] PDM: Generated 1820 derivative records from 40439 primary records. [2025-10-17T22:43:10.494563] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:10.505334] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-10-17T22:43:10.677937] [DEBUG] [LOCAL ] PDM: Derivative data saved (1820 records). [2025-10-17T22:43:10.693790] [DEBUG] [LOCAL ] PDX: Loaded 14520 existing records from primary storage. [2025-10-17T22:43:10.693990] [INFO ] [MAIN ] PDX: Loaded 14520 primary data records. [2025-10-17T22:43:10.692748] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-10-17T22:43:10.848018] [INFO ] [MAIN ] Derivative Progress: 1428/2083 symbols completed. PDM took 1.6s. Estimated remaining: 4m 8s. Rate: 158.3 symbols/min [2025-10-17T22:43:10.872914] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:11.296536] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:11.298846] [INFO ] [MAIN ] PDT: Generated 1820 derivative records from 17796 primary records. [2025-10-17T22:43:11.297897] [DEBUG] [LOCAL ] PEB: Loaded 51448 existing records from primary storage. [2025-10-17T22:43:11.299016] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-17T22:43:11.299137] [INFO ] [MAIN ] PEB: Loaded 51448 primary data records. [2025-10-17T22:43:11.427352] [DEBUG] [LOCAL ] PDT: Derivative data saved (1820 records). [2025-10-17T22:43:11.457749] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-10-17T22:43:11.457612] [DEBUG] [MAIN ] PDX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:11.484917] [INFO ] [MAIN ] PDX: Generated 1820 derivative records from 14520 primary records. [2025-10-17T22:43:11.470348] [INFO ] [MAIN ] Derivative Progress: 1429/2083 symbols completed. PDT took 1.2s. Estimated remaining: 4m 8s. Rate: 158.2 symbols/min [2025-10-17T22:43:11.519290] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-10-17T22:43:11.634165] [INFO ] [MAIN ] PEG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:11.661973] [DEBUG] [LOCAL ] PDX: Derivative data saved (1820 records). [2025-10-17T22:43:11.662284] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-10-17T22:43:11.664734] [INFO ] [MAIN ] Derivative Progress: 1430/2083 symbols completed. PDX took 1.2s. Estimated remaining: 4m 8s. Rate: 158.3 symbols/min [2025-10-17T22:43:11.665083] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:11.693970] [DEBUG] [LOCAL ] PEO: Loaded 11292 existing records from primary storage. [2025-10-17T22:43:11.694220] [INFO ] [MAIN ] PEO: Loaded 11292 primary data records. [2025-10-17T22:43:11.744005] [DEBUG] [MAIN ] PEB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:11.787012] [INFO ] [MAIN ] PEB: Generated 1820 derivative records from 51448 primary records. [2025-10-17T22:43:11.810863] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-10-17T22:43:11.805521] [DEBUG] [LOCAL ] PEG: Loaded 53920 existing records from primary storage. [2025-10-17T22:43:11.829777] [INFO ] [MAIN ] PEG: Loaded 53920 primary data records. [2025-10-17T22:43:12.136611] [DEBUG] [LOCAL ] PEB: Derivative data saved (1820 records). [2025-10-17T22:43:12.145466] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-10-17T22:43:12.148230] [INFO ] [MAIN ] Derivative Progress: 1431/2083 symbols completed. PEB took 1.3s. Estimated remaining: 4m 7s. Rate: 158.3 symbols/min [2025-10-17T22:43:12.164077] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:12.357069] [DEBUG] [LOCAL ] PERF: Loaded 14549 existing records from primary storage. [2025-10-17T22:43:12.358143] [INFO ] [MAIN ] PERF: Loaded 14549 primary data records. [2025-10-17T22:43:12.682841] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:12.683753] [INFO ] [MAIN ] PEO: Generated 1820 derivative records from 11292 primary records. [2025-10-17T22:43:12.683923] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-10-17T22:43:12.717484] [DEBUG] [MAIN ] PEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:12.719195] [INFO ] [MAIN ] PEG: Generated 1820 derivative records from 53920 primary records. [2025-10-17T22:43:12.720212] [DEBUG] [LOCAL ] PEO: Derivative data saved (1820 records). [2025-10-17T22:43:12.719942] [DEBUG] [LOCAL ] PEG: Saving derivative data. [2025-10-17T22:43:12.720353] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-10-17T22:43:12.724096] [INFO ] [MAIN ] Derivative Progress: 1432/2083 symbols completed. PEO took 1.1s. Estimated remaining: 4m 7s. Rate: 158.2 symbols/min [2025-10-17T22:43:12.724284] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:12.740540] [DEBUG] [LOCAL ] PEG: Derivative data saved (1820 records). [2025-10-17T22:43:12.740926] [INFO ] [MAIN ] PEG: Successfully saved derivative data. [2025-10-17T22:43:12.743145] [INFO ] [MAIN ] Derivative Progress: 1433/2083 symbols completed. PEG took 1.1s. Estimated remaining: 4m 6s. Rate: 158.3 symbols/min [2025-10-17T22:43:12.743480] [INFO ] [MAIN ] PFE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:12.749131] [DEBUG] [LOCAL ] PFD: Loaded 5443 existing records from primary storage. [2025-10-17T22:43:12.749487] [INFO ] [MAIN ] PFD: Loaded 5443 primary data records. [2025-10-17T22:43:13.111812] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:13.112770] [INFO ] [MAIN ] PERF: Generated 1820 derivative records from 14549 primary records. [2025-10-17T22:43:13.112906] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-10-17T22:43:13.133243] [DEBUG] [LOCAL ] PERF: Derivative data saved (1820 records). [2025-10-17T22:43:13.147787] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-10-17T22:43:13.149977] [INFO ] [MAIN ] Derivative Progress: 1434/2083 symbols completed. PERF took 1.0s. Estimated remaining: 4m 6s. Rate: 158.3 symbols/min [2025-10-17T22:43:13.150189] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:13.151925] [DEBUG] [LOCAL ] PFE: Loaded 54593 existing records from primary storage. [2025-10-17T22:43:13.153185] [INFO ] [MAIN ] PFE: Loaded 54593 primary data records. [2025-10-17T22:43:13.475685] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:13.476413] [INFO ] [MAIN ] PFD: Generated 1820 derivative records from 5443 primary records. [2025-10-17T22:43:13.476512] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-10-17T22:43:13.507591] [DEBUG] [LOCAL ] PFGC: Loaded 47796 existing records from primary storage. [2025-10-17T22:43:13.509613] [DEBUG] [LOCAL ] PFD: Derivative data saved (1820 records). [2025-10-17T22:43:13.509779] [INFO ] [MAIN ] PFGC: Loaded 47796 primary data records. [2025-10-17T22:43:13.509893] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-10-17T22:43:13.512319] [INFO ] [MAIN ] Derivative Progress: 1435/2083 symbols completed. PFD took 0.8s. Estimated remaining: 4m 6s. Rate: 158.3 symbols/min [2025-10-17T22:43:13.512967] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:13.625233] [DEBUG] [LOCAL ] PFH: Loaded 6643 existing records from primary storage. [2025-10-17T22:43:13.641720] [INFO ] [MAIN ] PFH: Loaded 6643 primary data records. [2025-10-17T22:43:13.953848] [DEBUG] [MAIN ] PFE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:13.958219] [INFO ] [MAIN ] PFE: Generated 1820 derivative records from 54593 primary records. [2025-10-17T22:43:13.958367] [DEBUG] [LOCAL ] PFE: Saving derivative data. [2025-10-17T22:43:14.039350] [DEBUG] [LOCAL ] PFE: Derivative data saved (1820 records). [2025-10-17T22:43:14.176090] [INFO ] [MAIN ] PFE: Successfully saved derivative data. [2025-10-17T22:43:14.178919] [INFO ] [MAIN ] Derivative Progress: 1436/2083 symbols completed. PFE took 1.4s. Estimated remaining: 4m 5s. Rate: 158.2 symbols/min [2025-10-17T22:43:14.179304] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:14.197400] [DEBUG] [LOCAL ] PFL: Loaded 14622 existing records from primary storage. [2025-10-17T22:43:14.209825] [INFO ] [MAIN ] PFL: Loaded 14622 primary data records. [2025-10-17T22:43:14.210377] [DEBUG] [MAIN ] PFGC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:14.222273] [INFO ] [MAIN ] PFGC: Generated 1820 derivative records from 47796 primary records. [2025-10-17T22:43:14.242351] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-10-17T22:43:14.355366] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:14.367245] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1820 records). [2025-10-17T22:43:14.394219] [INFO ] [MAIN ] PFH: Generated 1820 derivative records from 6643 primary records. [2025-10-17T22:43:14.402165] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-10-17T22:43:14.394348] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-10-17T22:43:14.421581] [INFO ] [MAIN ] Derivative Progress: 1437/2083 symbols completed. PFGC took 1.3s. Estimated remaining: 4m 5s. Rate: 158.3 symbols/min [2025-10-17T22:43:14.477832] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:14.562476] [DEBUG] [LOCAL ] PFH: Derivative data saved (1820 records). [2025-10-17T22:43:14.563234] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-10-17T22:43:14.565578] [INFO ] [MAIN ] Derivative Progress: 1438/2083 symbols completed. PFH took 1.1s. Estimated remaining: 4m 4s. Rate: 158.3 symbols/min [2025-10-17T22:43:14.597982] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:14.598620] [INFO ] [MAIN ] PFL: Generated 1820 derivative records from 14622 primary records. [2025-10-17T22:43:14.598767] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-17T22:43:14.626306] [DEBUG] [LOCAL ] PFLT: Loaded 44975 existing records from primary storage. [2025-10-17T22:43:14.626766] [DEBUG] [LOCAL ] PFL: Derivative data saved (1820 records). [2025-10-17T22:43:14.626904] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-10-17T22:43:14.626976] [INFO ] [MAIN ] PFLT: Loaded 44975 primary data records. [2025-10-17T22:43:14.629209] [INFO ] [MAIN ] Derivative Progress: 1439/2083 symbols completed. PFL took 0.4s. Estimated remaining: 4m 4s. Rate: 158.4 symbols/min [2025-10-17T22:43:14.963533] [DEBUG] [MAIN ] PFLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:14.964201] [INFO ] [MAIN ] PFLT: Generated 1820 derivative records from 44975 primary records. [2025-10-17T22:43:14.964265] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-10-17T22:43:14.979549] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1820 records). [2025-10-17T22:43:14.979607] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-10-17T22:43:14.981808] [INFO ] [MAIN ] Derivative Progress: 1440/2083 symbols completed. PFLT took 0.5s. Estimated remaining: 4m 4s. Rate: 158.4 symbols/min [2025-10-17T22:43:14.982277] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:14.982209] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:14.982415] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:14.992035] [DEBUG] [LOCAL ] PFO: Loaded 6140 existing records from primary storage. [2025-10-17T22:43:14.992181] [INFO ] [MAIN ] PFO: Loaded 6140 primary data records. [2025-10-17T22:43:15.312684] [DEBUG] [LOCAL ] PFN: Loaded 22752 existing records from primary storage. [2025-10-17T22:43:15.328562] [INFO ] [MAIN ] PFN: Loaded 22752 primary data records. [2025-10-17T22:43:15.329377] [DEBUG] [LOCAL ] PFS: Loaded 36502 existing records from primary storage. [2025-10-17T22:43:15.329921] [INFO ] [MAIN ] PFS: Loaded 36502 primary data records. [2025-10-17T22:43:15.990265] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:15.991587] [INFO ] [MAIN ] PFO: Generated 1820 derivative records from 6140 primary records. [2025-10-17T22:43:15.993075] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-17T22:43:16.012205] [DEBUG] [LOCAL ] PFO: Derivative data saved (1820 records). [2025-10-17T22:43:16.012747] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-10-17T22:43:16.015167] [INFO ] [MAIN ] Derivative Progress: 1441/2083 symbols completed. PFO took 1.0s. Estimated remaining: 4m 3s. Rate: 158.2 symbols/min [2025-10-17T22:43:16.015369] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:16.036371] [DEBUG] [MAIN ] PFS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:16.037535] [INFO ] [MAIN ] PFS: Generated 1820 derivative records from 36502 primary records. [2025-10-17T22:43:16.039134] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-10-17T22:43:16.079682] [DEBUG] [LOCAL ] PFS: Derivative data saved (1820 records). [2025-10-17T22:43:16.085097] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-10-17T22:43:16.085426] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:16.087953] [INFO ] [MAIN ] Derivative Progress: 1442/2083 symbols completed. PFS took 1.1s. Estimated remaining: 4m 3s. Rate: 158.3 symbols/min [2025-10-17T22:43:16.089069] [INFO ] [MAIN ] PFN: Generated 1820 derivative records from 22752 primary records. [2025-10-17T22:43:16.089596] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-17T22:43:16.089491] [INFO ] [MAIN ] PG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:16.115948] [DEBUG] [LOCAL ] PFSI: Loaded 29716 existing records from primary storage. [2025-10-17T22:43:16.116951] [INFO ] [MAIN ] PFSI: Loaded 29716 primary data records. [2025-10-17T22:43:16.125309] [DEBUG] [LOCAL ] PFN: Derivative data saved (1820 records). [2025-10-17T22:43:16.125409] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-10-17T22:43:16.154407] [INFO ] [MAIN ] Derivative Progress: 1443/2083 symbols completed. PFN took 1.2s. Estimated remaining: 4m 2s. Rate: 158.4 symbols/min [2025-10-17T22:43:16.167122] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:16.323046] [DEBUG] [LOCAL ] PGP: Loaded 5778 existing records from primary storage. [2025-10-17T22:43:16.329778] [INFO ] [MAIN ] PGP: Loaded 5778 primary data records. [2025-10-17T22:43:16.639001] [DEBUG] [LOCAL ] PG: Loaded 54533 existing records from primary storage. [2025-10-17T22:43:16.704551] [INFO ] [MAIN ] PG: Loaded 54533 primary data records. [2025-10-17T22:43:17.208929] [DEBUG] [MAIN ] PFSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:17.224367] [INFO ] [MAIN ] PFSI: Generated 1820 derivative records from 29716 primary records. [2025-10-17T22:43:17.224817] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-10-17T22:43:17.247755] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1820 records). [2025-10-17T22:43:17.247974] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-10-17T22:43:17.250730] [INFO ] [MAIN ] Derivative Progress: 1444/2083 symbols completed. PFSI took 1.2s. Estimated remaining: 4m 2s. Rate: 158.2 symbols/min [2025-10-17T22:43:17.264048] [INFO ] [MAIN ] PGR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:17.265304] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:17.266837] [INFO ] [MAIN ] PGP: Generated 1820 derivative records from 5778 primary records. [2025-10-17T22:43:17.267072] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-17T22:43:17.286448] [DEBUG] [LOCAL ] PGP: Derivative data saved (1820 records). [2025-10-17T22:43:17.286965] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-10-17T22:43:17.289982] [INFO ] [MAIN ] Derivative Progress: 1445/2083 symbols completed. PGP took 1.1s. Estimated remaining: 4m 2s. Rate: 158.3 symbols/min [2025-10-17T22:43:17.290391] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:17.308463] [DEBUG] [MAIN ] PG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:17.309257] [INFO ] [MAIN ] PG: Generated 1820 derivative records from 54533 primary records. [2025-10-17T22:43:17.309477] [DEBUG] [LOCAL ] PG: Saving derivative data. [2025-10-17T22:43:17.326564] [DEBUG] [LOCAL ] PG: Derivative data saved (1820 records). [2025-10-17T22:43:17.326937] [INFO ] [MAIN ] PG: Successfully saved derivative data. [2025-10-17T22:43:17.329336] [INFO ] [MAIN ] Derivative Progress: 1446/2083 symbols completed. PG took 1.2s. Estimated remaining: 4m 1s. Rate: 158.4 symbols/min [2025-10-17T22:43:17.343072] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:17.370298] [DEBUG] [LOCAL ] PGZ: Loaded 5636 existing records from primary storage. [2025-10-17T22:43:17.370487] [INFO ] [MAIN ] PGZ: Loaded 5636 primary data records. [2025-10-17T22:43:17.370081] [DEBUG] [LOCAL ] PGR: Loaded 53647 existing records from primary storage. [2025-10-17T22:43:17.384973] [INFO ] [MAIN ] PGR: Loaded 53647 primary data records. [2025-10-17T22:43:17.633908] [DEBUG] [LOCAL ] PGRE: Loaded 47694 existing records from primary storage. [2025-10-17T22:43:17.660135] [INFO ] [MAIN ] PGRE: Loaded 47694 primary data records. [2025-10-17T22:43:18.413963] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:18.416591] [INFO ] [MAIN ] PGZ: Generated 1820 derivative records from 5636 primary records. [2025-10-17T22:43:18.417018] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-17T22:43:18.439475] [DEBUG] [MAIN ] PGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:18.446634] [INFO ] [MAIN ] PGR: Generated 1820 derivative records from 53647 primary records. [2025-10-17T22:43:18.447172] [DEBUG] [LOCAL ] PGR: Saving derivative data. [2025-10-17T22:43:18.447944] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1820 records). [2025-10-17T22:43:18.448530] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-10-17T22:43:18.450772] [INFO ] [MAIN ] Derivative Progress: 1447/2083 symbols completed. PGZ took 1.1s. Estimated remaining: 4m 1s. Rate: 158.2 symbols/min [2025-10-17T22:43:18.451046] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:18.471318] [DEBUG] [LOCAL ] PGR: Derivative data saved (1820 records). [2025-10-17T22:43:18.471821] [INFO ] [MAIN ] PGR: Successfully saved derivative data. [2025-10-17T22:43:18.473951] [INFO ] [MAIN ] Derivative Progress: 1448/2083 symbols completed. PGR took 1.2s. Estimated remaining: 4m 1s. Rate: 158.3 symbols/min [2025-10-17T22:43:18.474304] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:18.487980] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:18.489016] [INFO ] [MAIN ] PGRE: Generated 1820 derivative records from 47694 primary records. [2025-10-17T22:43:18.489081] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-10-17T22:43:18.514725] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1820 records). [2025-10-17T22:43:18.515000] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-10-17T22:43:18.517116] [INFO ] [MAIN ] Derivative Progress: 1449/2083 symbols completed. PGRE took 1.2s. Estimated remaining: 4m 0s. Rate: 158.4 symbols/min [2025-10-17T22:43:18.517357] [INFO ] [MAIN ] PHM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:18.536613] [DEBUG] [LOCAL ] PHIN: Loaded 32358 existing records from primary storage. [2025-10-17T22:43:18.536879] [INFO ] [MAIN ] PHIN: Loaded 32358 primary data records. [2025-10-17T22:43:18.635496] [DEBUG] [LOCAL ] PHK: Loaded 27189 existing records from primary storage. [2025-10-17T22:43:18.646001] [INFO ] [MAIN ] PHK: Loaded 27189 primary data records. [2025-10-17T22:43:19.109917] [DEBUG] [LOCAL ] PHM: Loaded 52425 existing records from primary storage. [2025-10-17T22:43:19.203225] [INFO ] [MAIN ] PHM: Loaded 52425 primary data records. [2025-10-17T22:43:19.529609] [DEBUG] [MAIN ] PHIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:19.530690] [INFO ] [MAIN ] PHIN: Generated 1820 derivative records from 32358 primary records. [2025-10-17T22:43:19.530894] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-10-17T22:43:19.546416] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:19.556596] [INFO ] [MAIN ] PHK: Generated 1820 derivative records from 27189 primary records. [2025-10-17T22:43:19.559432] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-10-17T22:43:19.581689] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1820 records). [2025-10-17T22:43:19.583137] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-10-17T22:43:19.584484] [DEBUG] [LOCAL ] PHK: Derivative data saved (1820 records). [2025-10-17T22:43:19.587251] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-10-17T22:43:19.587002] [INFO ] [MAIN ] Derivative Progress: 1450/2083 symbols completed. PHIN took 1.1s. Estimated remaining: 4m 0s. Rate: 158.2 symbols/min [2025-10-17T22:43:19.597464] [INFO ] [MAIN ] Derivative Progress: 1451/2083 symbols completed. PHK took 1.1s. Estimated remaining: 3m 60s. Rate: 158.3 symbols/min [2025-10-17T22:43:19.587483] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:19.602673] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:19.603559] [DEBUG] [MAIN ] PHM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:19.604306] [INFO ] [MAIN ] PHM: Generated 1820 derivative records from 52425 primary records. [2025-10-17T22:43:19.604506] [DEBUG] [LOCAL ] PHM: Saving derivative data. [2025-10-17T22:43:19.621522] [DEBUG] [LOCAL ] PHM: Derivative data saved (1820 records). [2025-10-17T22:43:19.621778] [INFO ] [MAIN ] PHM: Successfully saved derivative data. [2025-10-17T22:43:19.623871] [INFO ] [MAIN ] Derivative Progress: 1452/2083 symbols completed. PHM took 1.1s. Estimated remaining: 3m 59s. Rate: 158.4 symbols/min [2025-10-17T22:43:19.624105] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:19.632161] [DEBUG] [LOCAL ] PIM: Loaded 4880 existing records from primary storage. [2025-10-17T22:43:19.632361] [INFO ] [MAIN ] PIM: Loaded 4880 primary data records. [2025-10-17T22:43:19.820290] [DEBUG] [LOCAL ] PII: Loaded 49613 existing records from primary storage. [2025-10-17T22:43:19.830526] [INFO ] [MAIN ] PII: Loaded 49613 primary data records. [2025-10-17T22:43:20.077328] [DEBUG] [LOCAL ] PHR: Loaded 38391 existing records from primary storage. [2025-10-17T22:43:20.078079] [INFO ] [MAIN ] PHR: Loaded 38391 primary data records. [2025-10-17T22:43:20.611351] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:20.612538] [INFO ] [MAIN ] PIM: Generated 1820 derivative records from 4880 primary records. [2025-10-17T22:43:20.613277] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-17T22:43:20.633267] [DEBUG] [LOCAL ] PIM: Derivative data saved (1820 records). [2025-10-17T22:43:20.633616] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-10-17T22:43:20.636480] [INFO ] [MAIN ] Derivative Progress: 1453/2083 symbols completed. PIM took 1.0s. Estimated remaining: 3m 59s. Rate: 158.2 symbols/min [2025-10-17T22:43:20.649744] [DEBUG] [MAIN ] PII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:20.650524] [INFO ] [MAIN ] PII: Generated 1820 derivative records from 49613 primary records. [2025-10-17T22:43:20.650736] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-10-17T22:43:20.677954] [DEBUG] [MAIN ] PHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:20.680443] [INFO ] [MAIN ] PHR: Generated 1820 derivative records from 38391 primary records. [2025-10-17T22:43:20.680987] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-10-17T22:43:20.683205] [DEBUG] [LOCAL ] PII: Derivative data saved (1820 records). [2025-10-17T22:43:20.683604] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-10-17T22:43:20.685852] [INFO ] [MAIN ] Derivative Progress: 1454/2083 symbols completed. PII took 1.1s. Estimated remaining: 3m 58s. Rate: 158.3 symbols/min [2025-10-17T22:43:20.700843] [DEBUG] [LOCAL ] PHR: Derivative data saved (1820 records). [2025-10-17T22:43:20.700912] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-10-17T22:43:20.703152] [INFO ] [MAIN ] Derivative Progress: 1455/2083 symbols completed. PHR took 1.1s. Estimated remaining: 3m 58s. Rate: 158.4 symbols/min [2025-10-17T22:43:20.703678] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:20.703753] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:20.703605] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:20.725050] [DEBUG] [LOCAL ] PIPR: Loaded 15399 existing records from primary storage. [2025-10-17T22:43:20.725326] [INFO ] [MAIN ] PIPR: Loaded 15399 primary data records. [2025-10-17T22:43:20.810044] [DEBUG] [LOCAL ] PINE: Loaded 14582 existing records from primary storage. [2025-10-17T22:43:20.828031] [INFO ] [MAIN ] PINE: Loaded 14582 primary data records. [2025-10-17T22:43:21.183554] [DEBUG] [LOCAL ] PINS: Loaded 54473 existing records from primary storage. [2025-10-17T22:43:21.206294] [INFO ] [MAIN ] PINS: Loaded 54473 primary data records. [2025-10-17T22:43:21.705428] [DEBUG] [MAIN ] PIPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:21.706568] [INFO ] [MAIN ] PIPR: Generated 1820 derivative records from 15399 primary records. [2025-10-17T22:43:21.707619] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-10-17T22:43:21.733135] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1820 records). [2025-10-17T22:43:21.738176] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-10-17T22:43:21.738473] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:21.739365] [INFO ] [MAIN ] PINE: Generated 1820 derivative records from 14582 primary records. [2025-10-17T22:43:21.741936] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-10-17T22:43:21.741839] [INFO ] [MAIN ] Derivative Progress: 1456/2083 symbols completed. PIPR took 1.0s. Estimated remaining: 3m 58s. Rate: 158.2 symbols/min [2025-10-17T22:43:21.742411] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:21.762008] [DEBUG] [LOCAL ] PINE: Derivative data saved (1820 records). [2025-10-17T22:43:21.762409] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-10-17T22:43:21.764746] [INFO ] [MAIN ] Derivative Progress: 1457/2083 symbols completed. PINE took 1.1s. Estimated remaining: 3m 57s. Rate: 158.3 symbols/min [2025-10-17T22:43:21.764932] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:21.779839] [DEBUG] [MAIN ] PINS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:21.780593] [INFO ] [MAIN ] PINS: Generated 1820 derivative records from 54473 primary records. [2025-10-17T22:43:21.780771] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-10-17T22:43:21.802475] [DEBUG] [LOCAL ] PINS: Derivative data saved (1820 records). [2025-10-17T22:43:21.802546] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-10-17T22:43:21.804596] [INFO ] [MAIN ] Derivative Progress: 1458/2083 symbols completed. PINS took 1.1s. Estimated remaining: 3m 57s. Rate: 158.4 symbols/min [2025-10-17T22:43:21.804828] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:21.816885] [DEBUG] [LOCAL ] PJT: Loaded 21931 existing records from primary storage. [2025-10-17T22:43:21.817154] [INFO ] [MAIN ] PJT: Loaded 21931 primary data records. [2025-10-17T22:43:21.946080] [DEBUG] [LOCAL ] PKE: Loaded 14335 existing records from primary storage. [2025-10-17T22:43:21.946282] [INFO ] [MAIN ] PKE: Loaded 14335 primary data records. [2025-10-17T22:43:22.263795] [DEBUG] [LOCAL ] PK: Loaded 53536 existing records from primary storage. [2025-10-17T22:43:22.267508] [INFO ] [MAIN ] PK: Loaded 53536 primary data records. [2025-10-17T22:43:22.846223] [DEBUG] [MAIN ] PJT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:22.847870] [INFO ] [MAIN ] PJT: Generated 1820 derivative records from 21931 primary records. [2025-10-17T22:43:22.848334] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-10-17T22:43:22.871450] [DEBUG] [LOCAL ] PJT: Derivative data saved (1820 records). [2025-10-17T22:43:22.872723] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-10-17T22:43:22.875196] [INFO ] [MAIN ] Derivative Progress: 1459/2083 symbols completed. PJT took 1.1s. Estimated remaining: 3m 57s. Rate: 158.2 symbols/min [2025-10-17T22:43:22.875637] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:22.890493] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:22.894239] [INFO ] [MAIN ] PKE: Generated 1820 derivative records from 14335 primary records. [2025-10-17T22:43:22.894559] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-10-17T22:43:22.918296] [DEBUG] [MAIN ] PK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:22.923107] [INFO ] [MAIN ] PK: Generated 1820 derivative records from 53536 primary records. [2025-10-17T22:43:22.923273] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-10-17T22:43:22.942110] [DEBUG] [LOCAL ] PK: Derivative data saved (1820 records). [2025-10-17T22:43:22.943057] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-10-17T22:43:22.946000] [INFO ] [MAIN ] Derivative Progress: 1460/2083 symbols completed. PK took 1.2s. Estimated remaining: 3m 56s. Rate: 158.3 symbols/min [2025-10-17T22:43:22.946492] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:22.947170] [DEBUG] [LOCAL ] PKE: Derivative data saved (1820 records). [2025-10-17T22:43:22.947725] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-10-17T22:43:22.949884] [INFO ] [MAIN ] Derivative Progress: 1461/2083 symbols completed. PKE took 1.1s. Estimated remaining: 3m 56s. Rate: 158.4 symbols/min [2025-10-17T22:43:22.950406] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:22.990877] [DEBUG] [LOCAL ] PKST: Loaded 18809 existing records from primary storage. [2025-10-17T22:43:22.991109] [INFO ] [MAIN ] PKST: Loaded 18809 primary data records. [2025-10-17T22:43:23.035956] [DEBUG] [LOCAL ] PKG: Loaded 39212 existing records from primary storage. [2025-10-17T22:43:23.055123] [INFO ] [MAIN ] PKG: Loaded 39212 primary data records. [2025-10-17T22:43:23.201134] [DEBUG] [LOCAL ] PKX: Loaded 23348 existing records from primary storage. [2025-10-17T22:43:23.224768] [INFO ] [MAIN ] PKX: Loaded 23348 primary data records. [2025-10-17T22:43:24.001760] [DEBUG] [MAIN ] PKST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:24.003925] [INFO ] [MAIN ] PKST: Generated 1820 derivative records from 18809 primary records. [2025-10-17T22:43:24.004169] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-10-17T22:43:24.035909] [DEBUG] [MAIN ] PKG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:24.036002] [DEBUG] [LOCAL ] PKST: Derivative data saved (1820 records). [2025-10-17T22:43:24.037256] [INFO ] [MAIN ] PKG: Generated 1820 derivative records from 39212 primary records. [2025-10-17T22:43:24.037374] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-10-17T22:43:24.037495] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-10-17T22:43:24.040334] [INFO ] [MAIN ] Derivative Progress: 1462/2083 symbols completed. PKST took 1.1s. Estimated remaining: 3m 55s. Rate: 158.2 symbols/min [2025-10-17T22:43:24.040810] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:24.065822] [DEBUG] [LOCAL ] PKG: Derivative data saved (1820 records). [2025-10-17T22:43:24.071067] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-10-17T22:43:24.071003] [DEBUG] [MAIN ] PKX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:24.071797] [INFO ] [MAIN ] PKX: Generated 1820 derivative records from 23348 primary records. [2025-10-17T22:43:24.074388] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-10-17T22:43:24.074197] [INFO ] [MAIN ] Derivative Progress: 1463/2083 symbols completed. PKG took 1.2s. Estimated remaining: 3m 55s. Rate: 158.3 symbols/min [2025-10-17T22:43:24.074530] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:24.091881] [DEBUG] [LOCAL ] PKX: Derivative data saved (1820 records). [2025-10-17T22:43:24.092132] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-10-17T22:43:24.094225] [INFO ] [MAIN ] Derivative Progress: 1464/2083 symbols completed. PKX took 1.1s. Estimated remaining: 3m 54s. Rate: 158.4 symbols/min [2025-10-17T22:43:24.094492] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:24.148293] [DEBUG] [LOCAL ] PL: Loaded 53962 existing records from primary storage. [2025-10-17T22:43:24.148566] [INFO ] [MAIN ] PL: Loaded 53962 primary data records. [2025-10-17T22:43:24.310941] [DEBUG] [LOCAL ] PLD: Loaded 54196 existing records from primary storage. [2025-10-17T22:43:24.316437] [INFO ] [MAIN ] PLD: Loaded 54196 primary data records. [2025-10-17T22:43:24.338308] [DEBUG] [LOCAL ] PLNT: Loaded 48907 existing records from primary storage. [2025-10-17T22:43:24.373862] [INFO ] [MAIN ] PLNT: Loaded 48907 primary data records. [2025-10-17T22:43:25.165757] [DEBUG] [MAIN ] PL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:25.166913] [INFO ] [MAIN ] PL: Generated 1820 derivative records from 53962 primary records. [2025-10-17T22:43:25.167124] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-10-17T22:43:25.185509] [DEBUG] [LOCAL ] PL: Derivative data saved (1820 records). [2025-10-17T22:43:25.186580] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-10-17T22:43:25.191878] [INFO ] [MAIN ] Derivative Progress: 1465/2083 symbols completed. PL took 1.2s. Estimated remaining: 3m 54s. Rate: 158.2 symbols/min [2025-10-17T22:43:25.194516] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:25.208385] [DEBUG] [MAIN ] PLNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:25.209155] [INFO ] [MAIN ] PLNT: Generated 1820 derivative records from 48907 primary records. [2025-10-17T22:43:25.209252] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-10-17T22:43:25.223579] [DEBUG] [MAIN ] PLD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:25.233279] [INFO ] [MAIN ] PLD: Generated 1820 derivative records from 54196 primary records. [2025-10-17T22:43:25.237311] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-10-17T22:43:25.262936] [DEBUG] [LOCAL ] PLD: Derivative data saved (1820 records). [2025-10-17T22:43:25.263140] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-10-17T22:43:25.258574] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1820 records). [2025-10-17T22:43:25.265680] [INFO ] [MAIN ] Derivative Progress: 1466/2083 symbols completed. PLD took 1.2s. Estimated remaining: 3m 54s. Rate: 158.3 symbols/min [2025-10-17T22:43:25.272485] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:25.272590] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-10-17T22:43:25.275421] [INFO ] [MAIN ] Derivative Progress: 1467/2083 symbols completed. PLNT took 1.2s. Estimated remaining: 3m 53s. Rate: 158.4 symbols/min [2025-10-17T22:43:25.276103] [DEBUG] [LOCAL ] PLOW: Loaded 20316 existing records from primary storage. [2025-10-17T22:43:25.276229] [INFO ] [MAIN ] PLOW: Loaded 20316 primary data records. [2025-10-17T22:43:25.276354] [INFO ] [MAIN ] PM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:25.604834] [DEBUG] [LOCAL ] PLYM: Loaded 34815 existing records from primary storage. [2025-10-17T22:43:25.605247] [INFO ] [MAIN ] PLYM: Loaded 34815 primary data records. [2025-10-17T22:43:25.774306] [DEBUG] [LOCAL ] PM: Loaded 54453 existing records from primary storage. [2025-10-17T22:43:25.806755] [INFO ] [MAIN ] PM: Loaded 54453 primary data records. [2025-10-17T22:43:26.272946] [DEBUG] [MAIN ] PLOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:26.274318] [INFO ] [MAIN ] PLOW: Generated 1820 derivative records from 20316 primary records. [2025-10-17T22:43:26.274402] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-10-17T22:43:26.300809] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1820 records). [2025-10-17T22:43:26.301523] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-10-17T22:43:26.303678] [INFO ] [MAIN ] Derivative Progress: 1468/2083 symbols completed. PLOW took 1.1s. Estimated remaining: 3m 53s. Rate: 158.2 symbols/min [2025-10-17T22:43:26.316981] [DEBUG] [MAIN ] PLYM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:26.319506] [INFO ] [MAIN ] PLYM: Generated 1820 derivative records from 34815 primary records. [2025-10-17T22:43:26.319590] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-10-17T22:43:26.338139] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1820 records). [2025-10-17T22:43:26.338374] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-10-17T22:43:26.340682] [INFO ] [MAIN ] Derivative Progress: 1469/2083 symbols completed. PLYM took 1.1s. Estimated remaining: 3m 53s. Rate: 158.3 symbols/min [2025-10-17T22:43:26.357215] [DEBUG] [MAIN ] PM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:26.358038] [INFO ] [MAIN ] PM: Generated 1820 derivative records from 54453 primary records. [2025-10-17T22:43:26.358113] [DEBUG] [LOCAL ] PM: Saving derivative data. [2025-10-17T22:43:26.374577] [DEBUG] [LOCAL ] PM: Derivative data saved (1820 records). [2025-10-17T22:43:26.374637] [INFO ] [MAIN ] PM: Successfully saved derivative data. [2025-10-17T22:43:26.378144] [INFO ] [MAIN ] Derivative Progress: 1470/2083 symbols completed. PM took 1.1s. Estimated remaining: 3m 52s. Rate: 158.4 symbols/min [2025-10-17T22:43:26.378878] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:26.378796] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:26.379077] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:26.400634] [DEBUG] [LOCAL ] PMM: Loaded 10328 existing records from primary storage. [2025-10-17T22:43:26.405625] [INFO ] [MAIN ] PMM: Loaded 10328 primary data records. [2025-10-17T22:43:26.405492] [DEBUG] [LOCAL ] PMO: Loaded 9956 existing records from primary storage. [2025-10-17T22:43:26.437421] [INFO ] [MAIN ] PMO: Loaded 9956 primary data records. [2025-10-17T22:43:26.540351] [DEBUG] [LOCAL ] PML: Loaded 22320 existing records from primary storage. [2025-10-17T22:43:26.573860] [INFO ] [MAIN ] PML: Loaded 22320 primary data records. [2025-10-17T22:43:27.455300] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:27.457261] [INFO ] [MAIN ] PMM: Generated 1820 derivative records from 10328 primary records. [2025-10-17T22:43:27.457775] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-17T22:43:27.482811] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:27.487305] [INFO ] [MAIN ] PMO: Generated 1820 derivative records from 9956 primary records. [2025-10-17T22:43:27.488056] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-17T22:43:27.519272] [DEBUG] [LOCAL ] PMO: Derivative data saved (1820 records). [2025-10-17T22:43:27.520924] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-10-17T22:43:27.523973] [INFO ] [MAIN ] Derivative Progress: 1471/2083 symbols completed. PMO took 1.1s. Estimated remaining: 3m 52s. Rate: 158.2 symbols/min [2025-10-17T22:43:27.521321] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:27.525469] [DEBUG] [LOCAL ] PMM: Derivative data saved (1820 records). [2025-10-17T22:43:27.525736] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-10-17T22:43:27.525634] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:27.526339] [INFO ] [MAIN ] PML: Generated 1820 derivative records from 22320 primary records. [2025-10-17T22:43:27.528887] [INFO ] [MAIN ] Derivative Progress: 1472/2083 symbols completed. PMM took 1.2s. Estimated remaining: 3m 52s. Rate: 158.3 symbols/min [2025-10-17T22:43:27.529294] [INFO ] [MAIN ] PNC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:27.529467] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-17T22:43:27.550563] [DEBUG] [LOCAL ] PML: Derivative data saved (1820 records). [2025-10-17T22:43:27.550999] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-10-17T22:43:27.553973] [INFO ] [MAIN ] Derivative Progress: 1473/2083 symbols completed. PML took 1.2s. Estimated remaining: 3m 51s. Rate: 158.4 symbols/min [2025-10-17T22:43:27.554320] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:27.565674] [DEBUG] [LOCAL ] PNI: Loaded 6950 existing records from primary storage. [2025-10-17T22:43:27.576161] [INFO ] [MAIN ] PNI: Loaded 6950 primary data records. [2025-10-17T22:43:27.695208] [DEBUG] [LOCAL ] PMT: Loaded 41335 existing records from primary storage. [2025-10-17T22:43:27.715455] [INFO ] [MAIN ] PMT: Loaded 41335 primary data records. [2025-10-17T22:43:27.897813] [DEBUG] [LOCAL ] PNC: Loaded 52874 existing records from primary storage. [2025-10-17T22:43:28.044868] [INFO ] [MAIN ] PNC: Loaded 52874 primary data records. [2025-10-17T22:43:28.597807] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:28.600389] [INFO ] [MAIN ] PNI: Generated 1820 derivative records from 6950 primary records. [2025-10-17T22:43:28.600599] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-10-17T22:43:28.620934] [DEBUG] [LOCAL ] PNI: Derivative data saved (1820 records). [2025-10-17T22:43:28.621182] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-10-17T22:43:28.623244] [INFO ] [MAIN ] Derivative Progress: 1474/2083 symbols completed. PNI took 1.1s. Estimated remaining: 3m 51s. Rate: 158.2 symbols/min [2025-10-17T22:43:28.623546] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:28.643267] [DEBUG] [MAIN ] PMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:28.656264] [DEBUG] [MAIN ] PNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:28.657564] [INFO ] [MAIN ] PMT: Generated 1820 derivative records from 41335 primary records. [2025-10-17T22:43:28.658706] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-10-17T22:43:28.658607] [INFO ] [MAIN ] PNC: Generated 1820 derivative records from 52874 primary records. [2025-10-17T22:43:28.660039] [DEBUG] [LOCAL ] PNC: Saving derivative data. [2025-10-17T22:43:28.706943] [DEBUG] [LOCAL ] PMT: Derivative data saved (1820 records). [2025-10-17T22:43:28.708969] [DEBUG] [LOCAL ] PNC: Derivative data saved (1820 records). [2025-10-17T22:43:28.719148] [INFO ] [MAIN ] PNC: Successfully saved derivative data. [2025-10-17T22:43:28.721421] [INFO ] [MAIN ] Derivative Progress: 1475/2083 symbols completed. PNC took 1.2s. Estimated remaining: 3m 50s. Rate: 158.3 symbols/min [2025-10-17T22:43:28.709125] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-10-17T22:43:28.721716] [INFO ] [MAIN ] PNR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:28.724207] [INFO ] [MAIN ] Derivative Progress: 1476/2083 symbols completed. PMT took 1.2s. Estimated remaining: 3m 50s. Rate: 158.4 symbols/min [2025-10-17T22:43:28.725126] [DEBUG] [LOCAL ] PNNT: Loaded 33922 existing records from primary storage. [2025-10-17T22:43:28.725674] [INFO ] [MAIN ] PNNT: Loaded 33922 primary data records. [2025-10-17T22:43:28.725859] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:29.147145] [DEBUG] [LOCAL ] PNR: Loaded 48223 existing records from primary storage. [2025-10-17T22:43:29.146358] [DEBUG] [LOCAL ] PNW: Loaded 46225 existing records from primary storage. [2025-10-17T22:43:29.147476] [INFO ] [MAIN ] PNR: Loaded 48223 primary data records. [2025-10-17T22:43:29.147556] [INFO ] [MAIN ] PNW: Loaded 46225 primary data records. [2025-10-17T22:43:29.784007] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:29.785598] [INFO ] [MAIN ] PNNT: Generated 1820 derivative records from 33922 primary records. [2025-10-17T22:43:29.785758] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-10-17T22:43:29.807544] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1820 records). [2025-10-17T22:43:29.808081] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-10-17T22:43:29.810531] [INFO ] [MAIN ] Derivative Progress: 1477/2083 symbols completed. PNNT took 1.2s. Estimated remaining: 3m 50s. Rate: 158.2 symbols/min [2025-10-17T22:43:29.810947] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:29.850296] [DEBUG] [MAIN ] PNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:29.851794] [INFO ] [MAIN ] PNR: Generated 1820 derivative records from 48223 primary records. [2025-10-17T22:43:29.851898] [DEBUG] [LOCAL ] PNR: Saving derivative data. [2025-10-17T22:43:29.850914] [DEBUG] [MAIN ] PNW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:29.853880] [INFO ] [MAIN ] PNW: Generated 1820 derivative records from 46225 primary records. [2025-10-17T22:43:29.854077] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-10-17T22:43:29.883009] [DEBUG] [LOCAL ] PNR: Derivative data saved (1820 records). [2025-10-17T22:43:29.895300] [INFO ] [MAIN ] PNR: Successfully saved derivative data. [2025-10-17T22:43:29.897636] [INFO ] [MAIN ] Derivative Progress: 1478/2083 symbols completed. PNR took 1.2s. Estimated remaining: 3m 49s. Rate: 158.3 symbols/min [2025-10-17T22:43:29.897858] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:29.904757] [DEBUG] [LOCAL ] PNW: Derivative data saved (1820 records). [2025-10-17T22:43:29.905007] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-10-17T22:43:29.908667] [INFO ] [MAIN ] Derivative Progress: 1479/2083 symbols completed. PNW took 1.2s. Estimated remaining: 3m 49s. Rate: 158.4 symbols/min [2025-10-17T22:43:29.909130] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:29.927054] [DEBUG] [LOCAL ] POR: Loaded 47568 existing records from primary storage. [2025-10-17T22:43:29.927347] [INFO ] [MAIN ] POR: Loaded 47568 primary data records. [2025-10-17T22:43:30.116812] [DEBUG] [LOCAL ] POST: Loaded 39267 existing records from primary storage. [2025-10-17T22:43:30.152366] [INFO ] [MAIN ] POST: Loaded 39267 primary data records. [2025-10-17T22:43:30.420812] [DEBUG] [LOCAL ] PPG: Loaded 51405 existing records from primary storage. [2025-10-17T22:43:30.427746] [INFO ] [MAIN ] PPG: Loaded 51405 primary data records. [2025-10-17T22:43:31.024507] [DEBUG] [MAIN ] POR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:31.026761] [INFO ] [MAIN ] POR: Generated 1820 derivative records from 47568 primary records. [2025-10-17T22:43:31.028454] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-10-17T22:43:31.052344] [DEBUG] [LOCAL ] POR: Derivative data saved (1820 records). [2025-10-17T22:43:31.052501] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-10-17T22:43:31.054917] [INFO ] [MAIN ] Derivative Progress: 1480/2083 symbols completed. POR took 1.2s. Estimated remaining: 3m 49s. Rate: 158.2 symbols/min [2025-10-17T22:43:31.059351] [INFO ] [MAIN ] PPL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:31.082859] [DEBUG] [MAIN ] POST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:31.084838] [INFO ] [MAIN ] POST: Generated 1820 derivative records from 39267 primary records. [2025-10-17T22:43:31.085209] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-10-17T22:43:31.102629] [DEBUG] [LOCAL ] POST: Derivative data saved (1820 records). [2025-10-17T22:43:31.102850] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-10-17T22:43:31.105159] [INFO ] [MAIN ] Derivative Progress: 1481/2083 symbols completed. POST took 1.2s. Estimated remaining: 3m 48s. Rate: 158.3 symbols/min [2025-10-17T22:43:31.107503] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:31.122473] [DEBUG] [MAIN ] PPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:31.123231] [INFO ] [MAIN ] PPG: Generated 1820 derivative records from 51405 primary records. [2025-10-17T22:43:31.123294] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-10-17T22:43:31.153061] [DEBUG] [LOCAL ] PPT: Loaded 20031 existing records from primary storage. [2025-10-17T22:43:31.153738] [DEBUG] [LOCAL ] PPG: Derivative data saved (1820 records). [2025-10-17T22:43:31.153860] [INFO ] [MAIN ] PPT: Loaded 20031 primary data records. [2025-10-17T22:43:31.165169] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-10-17T22:43:31.167532] [INFO ] [MAIN ] Derivative Progress: 1482/2083 symbols completed. PPG took 1.3s. Estimated remaining: 3m 48s. Rate: 158.4 symbols/min [2025-10-17T22:43:31.176956] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:31.376802] [DEBUG] [LOCAL ] PPL: Loaded 54281 existing records from primary storage. [2025-10-17T22:43:31.495026] [INFO ] [MAIN ] PPL: Loaded 54281 primary data records. [2025-10-17T22:43:31.834492] [DEBUG] [LOCAL ] PR: Loaded 54390 existing records from primary storage. [2025-10-17T22:43:31.834984] [INFO ] [MAIN ] PR: Loaded 54390 primary data records. [2025-10-17T22:43:31.990163] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:32.018274] [INFO ] [MAIN ] PPT: Generated 1820 derivative records from 20031 primary records. [2025-10-17T22:43:32.027572] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-17T22:43:32.185151] [DEBUG] [LOCAL ] PPT: Derivative data saved (1820 records). [2025-10-17T22:43:32.185685] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-10-17T22:43:32.189152] [INFO ] [MAIN ] Derivative Progress: 1483/2083 symbols completed. PPT took 1.1s. Estimated remaining: 3m 48s. Rate: 158.2 symbols/min [2025-10-17T22:43:32.209550] [DEBUG] [MAIN ] PPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:32.210957] [INFO ] [MAIN ] PPL: Generated 1820 derivative records from 54281 primary records. [2025-10-17T22:43:32.211070] [DEBUG] [LOCAL ] PPL: Saving derivative data. [2025-10-17T22:43:32.229334] [DEBUG] [LOCAL ] PPL: Derivative data saved (1820 records). [2025-10-17T22:43:32.229751] [INFO ] [MAIN ] PPL: Successfully saved derivative data. [2025-10-17T22:43:32.232133] [INFO ] [MAIN ] Derivative Progress: 1484/2083 symbols completed. PPL took 1.2s. Estimated remaining: 3m 47s. Rate: 158.3 symbols/min [2025-10-17T22:43:32.249531] [DEBUG] [MAIN ] PR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:32.250186] [INFO ] [MAIN ] PR: Generated 1820 derivative records from 54390 primary records. [2025-10-17T22:43:32.250246] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-10-17T22:43:32.265720] [DEBUG] [LOCAL ] PR: Derivative data saved (1820 records). [2025-10-17T22:43:32.265778] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-10-17T22:43:32.268050] [INFO ] [MAIN ] Derivative Progress: 1485/2083 symbols completed. PR took 1.1s. Estimated remaining: 3m 47s. Rate: 158.4 symbols/min [2025-10-17T22:43:32.268705] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:32.268902] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:32.268548] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:32.275604] [DEBUG] [LOCAL ] PRCS: Loaded 2830 existing records from primary storage. [2025-10-17T22:43:32.275826] [INFO ] [MAIN ] PRCS: Loaded 2830 primary data records. [2025-10-17T22:43:32.599013] [DEBUG] [LOCAL ] PRG: Loaded 30087 existing records from primary storage. [2025-10-17T22:43:32.610075] [INFO ] [MAIN ] PRG: Loaded 30087 primary data records. [2025-10-17T22:43:32.615978] [DEBUG] [LOCAL ] PRA: Loaded 35319 existing records from primary storage. [2025-10-17T22:43:32.634776] [INFO ] [MAIN ] PRA: Loaded 35319 primary data records. [2025-10-17T22:43:33.312400] [DEBUG] [MAIN ] PRCS: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:43:33.315099] [INFO ] [MAIN ] PRCS: Generated 1819 derivative records from 2830 primary records. [2025-10-17T22:43:33.315610] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-17T22:43:33.333437] [DEBUG] [LOCAL ] PRCS: Derivative data saved (1819 records). [2025-10-17T22:43:33.334142] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-10-17T22:43:33.336337] [INFO ] [MAIN ] Derivative Progress: 1486/2083 symbols completed. PRCS took 1.1s. Estimated remaining: 3m 46s. Rate: 158.2 symbols/min [2025-10-17T22:43:33.336715] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:33.362281] [DEBUG] [MAIN ] PRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:33.377003] [INFO ] [MAIN ] PRG: Generated 1820 derivative records from 30087 primary records. [2025-10-17T22:43:33.376073] [DEBUG] [MAIN ] PRA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:33.377942] [INFO ] [MAIN ] PRA: Generated 1820 derivative records from 35319 primary records. [2025-10-17T22:43:33.378058] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-10-17T22:43:33.378170] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-10-17T22:43:33.418726] [DEBUG] [LOCAL ] PRA: Derivative data saved (1820 records). [2025-10-17T22:43:33.421693] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-10-17T22:43:33.425943] [INFO ] [MAIN ] Derivative Progress: 1487/2083 symbols completed. PRA took 1.2s. Estimated remaining: 3m 46s. Rate: 158.2 symbols/min [2025-10-17T22:43:33.439203] [DEBUG] [LOCAL ] PRG: Derivative data saved (1820 records). [2025-10-17T22:43:33.440730] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-10-17T22:43:33.439356] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:33.443820] [INFO ] [MAIN ] Derivative Progress: 1488/2083 symbols completed. PRG took 1.2s. Estimated remaining: 3m 45s. Rate: 158.3 symbols/min [2025-10-17T22:43:33.444528] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:33.445826] [DEBUG] [LOCAL ] PRGO: Loaded 47838 existing records from primary storage. [2025-10-17T22:43:33.446113] [INFO ] [MAIN ] PRGO: Loaded 47838 primary data records. [2025-10-17T22:43:33.552070] [DEBUG] [LOCAL ] PRH: Loaded 4808 existing records from primary storage. [2025-10-17T22:43:33.566023] [INFO ] [MAIN ] PRH: Loaded 4808 primary data records. [2025-10-17T22:43:33.701083] [DEBUG] [LOCAL ] PRI: Loaded 18363 existing records from primary storage. [2025-10-17T22:43:33.767744] [INFO ] [MAIN ] PRI: Loaded 18363 primary data records. [2025-10-17T22:43:34.456380] [DEBUG] [MAIN ] PRGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:34.457747] [INFO ] [MAIN ] PRGO: Generated 1820 derivative records from 47838 primary records. [2025-10-17T22:43:34.458511] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-10-17T22:43:34.477372] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1820 records). [2025-10-17T22:43:34.477619] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-10-17T22:43:34.487132] [INFO ] [MAIN ] Derivative Progress: 1489/2083 symbols completed. PRGO took 1.2s. Estimated remaining: 3m 45s. Rate: 158.2 symbols/min [2025-10-17T22:43:34.488367] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:34.504375] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:34.508481] [INFO ] [MAIN ] PRH: Generated 1820 derivative records from 4808 primary records. [2025-10-17T22:43:34.508786] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-10-17T22:43:34.534342] [DEBUG] [MAIN ] PRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:34.538685] [DEBUG] [LOCAL ] PRH: Derivative data saved (1820 records). [2025-10-17T22:43:34.540187] [INFO ] [MAIN ] PRI: Generated 1820 derivative records from 18363 primary records. [2025-10-17T22:43:34.540290] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-10-17T22:43:34.543023] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-10-17T22:43:34.542893] [INFO ] [MAIN ] Derivative Progress: 1490/2083 symbols completed. PRH took 1.1s. Estimated remaining: 3m 45s. Rate: 158.3 symbols/min [2025-10-17T22:43:34.544509] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:34.560519] [DEBUG] [LOCAL ] PRI: Derivative data saved (1820 records). [2025-10-17T22:43:34.571457] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-10-17T22:43:34.573890] [INFO ] [MAIN ] Derivative Progress: 1491/2083 symbols completed. PRI took 1.1s. Estimated remaining: 3m 44s. Rate: 158.4 symbols/min [2025-10-17T22:43:34.574200] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:34.593609] [DEBUG] [LOCAL ] PRIM: Loaded 44853 existing records from primary storage. [2025-10-17T22:43:34.599627] [INFO ] [MAIN ] PRIM: Loaded 44853 primary data records. [2025-10-17T22:43:34.734368] [DEBUG] [LOCAL ] PRLB: Loaded 20632 existing records from primary storage. [2025-10-17T22:43:34.735196] [DEBUG] [LOCAL ] PRKS: Loaded 43185 existing records from primary storage. [2025-10-17T22:43:34.751467] [INFO ] [MAIN ] PRLB: Loaded 20632 primary data records. [2025-10-17T22:43:34.751606] [INFO ] [MAIN ] PRKS: Loaded 43185 primary data records. [2025-10-17T22:43:35.632495] [DEBUG] [MAIN ] PRIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:35.633283] [INFO ] [MAIN ] PRIM: Generated 1820 derivative records from 44853 primary records. [2025-10-17T22:43:35.633514] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-10-17T22:43:35.653947] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1820 records). [2025-10-17T22:43:35.657083] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-10-17T22:43:35.659522] [INFO ] [MAIN ] Derivative Progress: 1492/2083 symbols completed. PRIM took 1.2s. Estimated remaining: 3m 44s. Rate: 158.2 symbols/min [2025-10-17T22:43:35.660016] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:35.686952] [DEBUG] [MAIN ] PRKS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:35.688466] [INFO ] [MAIN ] PRKS: Generated 1820 derivative records from 43185 primary records. [2025-10-17T22:43:35.687494] [DEBUG] [MAIN ] PRLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:35.688724] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-10-17T22:43:35.689531] [INFO ] [MAIN ] PRLB: Generated 1820 derivative records from 20632 primary records. [2025-10-17T22:43:35.690086] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-10-17T22:43:35.718894] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1820 records). [2025-10-17T22:43:35.720762] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-10-17T22:43:35.723446] [INFO ] [MAIN ] Derivative Progress: 1493/2083 symbols completed. PRLB took 1.1s. Estimated remaining: 3m 44s. Rate: 158.2 symbols/min [2025-10-17T22:43:35.723925] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:35.726058] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1820 records). [2025-10-17T22:43:35.726133] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-10-17T22:43:35.728527] [INFO ] [MAIN ] Derivative Progress: 1494/2083 symbols completed. PRKS took 1.2s. Estimated remaining: 3m 43s. Rate: 158.3 symbols/min [2025-10-17T22:43:35.728754] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:35.765787] [DEBUG] [LOCAL ] PRM: Loaded 45003 existing records from primary storage. [2025-10-17T22:43:35.766091] [INFO ] [MAIN ] PRM: Loaded 45003 primary data records. [2025-10-17T22:43:35.906421] [DEBUG] [LOCAL ] PRO: Loaded 40543 existing records from primary storage. [2025-10-17T22:43:35.917005] [INFO ] [MAIN ] PRO: Loaded 40543 primary data records. [2025-10-17T22:43:36.272876] [DEBUG] [LOCAL ] PRMB: Loaded 53905 existing records from primary storage. [2025-10-17T22:43:36.305573] [INFO ] [MAIN ] PRMB: Loaded 53905 primary data records. [2025-10-17T22:43:36.758705] [DEBUG] [MAIN ] PRM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:36.760365] [INFO ] [MAIN ] PRM: Generated 1820 derivative records from 45003 primary records. [2025-10-17T22:43:36.760994] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-10-17T22:43:36.790120] [DEBUG] [MAIN ] PRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:36.791284] [INFO ] [MAIN ] PRO: Generated 1820 derivative records from 40543 primary records. [2025-10-17T22:43:36.792343] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-10-17T22:43:36.810961] [DEBUG] [LOCAL ] PRO: Derivative data saved (1820 records). [2025-10-17T22:43:36.811190] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-10-17T22:43:36.814087] [INFO ] [MAIN ] Derivative Progress: 1495/2083 symbols completed. PRO took 1.1s. Estimated remaining: 3m 43s. Rate: 158.1 symbols/min [2025-10-17T22:43:36.814472] [DEBUG] [LOCAL ] PRM: Derivative data saved (1820 records). [2025-10-17T22:43:36.814635] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:36.814775] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-10-17T22:43:36.817096] [INFO ] [MAIN ] Derivative Progress: 1496/2083 symbols completed. PRM took 1.2s. Estimated remaining: 3m 43s. Rate: 158.3 symbols/min [2025-10-17T22:43:36.818247] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:36.840739] [DEBUG] [MAIN ] PRMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:36.840977] [DEBUG] [LOCAL ] PRT: Loaded 5219 existing records from primary storage. [2025-10-17T22:43:36.842081] [INFO ] [MAIN ] PRMB: Generated 1820 derivative records from 53905 primary records. [2025-10-17T22:43:36.841322] [INFO ] [MAIN ] PRT: Loaded 5219 primary data records. [2025-10-17T22:43:36.853527] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-10-17T22:43:36.973286] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1820 records). [2025-10-17T22:43:36.973591] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-10-17T22:43:36.976327] [INFO ] [MAIN ] Derivative Progress: 1497/2083 symbols completed. PRMB took 1.3s. Estimated remaining: 3m 42s. Rate: 158.3 symbols/min [2025-10-17T22:43:37.003484] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:37.229902] [DEBUG] [LOCAL ] PRU: Loaded 52007 existing records from primary storage. [2025-10-17T22:43:37.230580] [INFO ] [MAIN ] PRU: Loaded 52007 primary data records. [2025-10-17T22:43:37.437054] [DEBUG] [LOCAL ] PSA: Loaded 42766 existing records from primary storage. [2025-10-17T22:43:37.454049] [INFO ] [MAIN ] PSA: Loaded 42766 primary data records. [2025-10-17T22:43:37.718368] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:37.725180] [INFO ] [MAIN ] PRT: Generated 1820 derivative records from 5219 primary records. [2025-10-17T22:43:37.736263] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-10-17T22:43:37.907856] [DEBUG] [LOCAL ] PRT: Derivative data saved (1820 records). [2025-10-17T22:43:37.921395] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-10-17T22:43:37.924737] [INFO ] [MAIN ] Derivative Progress: 1498/2083 symbols completed. PRT took 1.1s. Estimated remaining: 3m 42s. Rate: 158.2 symbols/min [2025-10-17T22:43:37.946904] [DEBUG] [MAIN ] PRU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:37.947850] [INFO ] [MAIN ] PRU: Generated 1820 derivative records from 52007 primary records. [2025-10-17T22:43:37.948001] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-10-17T22:43:37.964509] [DEBUG] [LOCAL ] PRU: Derivative data saved (1820 records). [2025-10-17T22:43:37.964667] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-10-17T22:43:37.968520] [INFO ] [MAIN ] Derivative Progress: 1499/2083 symbols completed. PRU took 1.2s. Estimated remaining: 3m 41s. Rate: 158.3 symbols/min [2025-10-17T22:43:37.982740] [DEBUG] [MAIN ] PSA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:37.983284] [INFO ] [MAIN ] PSA: Generated 1820 derivative records from 42766 primary records. [2025-10-17T22:43:37.983344] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-10-17T22:43:37.998893] [DEBUG] [LOCAL ] PSA: Derivative data saved (1820 records). [2025-10-17T22:43:37.998952] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-10-17T22:43:38.001475] [INFO ] [MAIN ] Derivative Progress: 1500/2083 symbols completed. PSA took 1.0s. Estimated remaining: 3m 41s. Rate: 158.3 symbols/min [2025-10-17T22:43:38.001974] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:38.002667] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:38.002117] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:38.017795] [DEBUG] [LOCAL ] PSF: Loaded 7069 existing records from primary storage. [2025-10-17T22:43:38.017988] [INFO ] [MAIN ] PSF: Loaded 7069 primary data records. [2025-10-17T22:43:38.048562] [DEBUG] [LOCAL ] PSBD: Loaded 8292 existing records from primary storage. [2025-10-17T22:43:38.085797] [INFO ] [MAIN ] PSBD: Loaded 8292 primary data records. [2025-10-17T22:43:38.236895] [DEBUG] [LOCAL ] PSFE: Loaded 30299 existing records from primary storage. [2025-10-17T22:43:38.267181] [INFO ] [MAIN ] PSFE: Loaded 30299 primary data records. [2025-10-17T22:43:39.106334] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:39.101150] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:39.108396] [INFO ] [MAIN ] PSBD: Generated 1820 derivative records from 8292 primary records. [2025-10-17T22:43:39.107820] [INFO ] [MAIN ] PSF: Generated 1820 derivative records from 7069 primary records. [2025-10-17T22:43:39.108854] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-17T22:43:39.108615] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-10-17T22:43:39.138730] [DEBUG] [LOCAL ] PSF: Derivative data saved (1820 records). [2025-10-17T22:43:39.141806] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1820 records). [2025-10-17T22:43:39.142048] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-10-17T22:43:39.144136] [INFO ] [MAIN ] Derivative Progress: 1501/2083 symbols completed. PSF took 1.1s. Estimated remaining: 3m 41s. Rate: 158.1 symbols/min [2025-10-17T22:43:39.144347] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-10-17T22:43:39.146967] [INFO ] [MAIN ] Derivative Progress: 1502/2083 symbols completed. PSBD took 1.1s. Estimated remaining: 3m 40s. Rate: 158.2 symbols/min [2025-10-17T22:43:39.146896] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:39.147251] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:39.163948] [DEBUG] [MAIN ] PSFE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:39.164624] [INFO ] [MAIN ] PSFE: Generated 1820 derivative records from 30299 primary records. [2025-10-17T22:43:39.164842] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-10-17T22:43:39.181085] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1820 records). [2025-10-17T22:43:39.181367] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-10-17T22:43:39.184492] [INFO ] [MAIN ] Derivative Progress: 1503/2083 symbols completed. PSFE took 1.2s. Estimated remaining: 3m 40s. Rate: 158.3 symbols/min [2025-10-17T22:43:39.184774] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:39.221046] [DEBUG] [LOCAL ] PSQH: Loaded 36091 existing records from primary storage. [2025-10-17T22:43:39.221270] [INFO ] [MAIN ] PSQH: Loaded 36091 primary data records. [2025-10-17T22:43:39.356921] [DEBUG] [LOCAL ] PSN: Loaded 46125 existing records from primary storage. [2025-10-17T22:43:39.383843] [INFO ] [MAIN ] PSN: Loaded 46125 primary data records. [2025-10-17T22:43:39.674336] [DEBUG] [LOCAL ] PSTG: Loaded 53630 existing records from primary storage. [2025-10-17T22:43:39.678341] [INFO ] [MAIN ] PSTG: Loaded 53630 primary data records. [2025-10-17T22:43:40.242424] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:40.243421] [INFO ] [MAIN ] PSQH: Generated 1820 derivative records from 36091 primary records. [2025-10-17T22:43:40.245134] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-10-17T22:43:40.264479] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1820 records). [2025-10-17T22:43:40.264781] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-10-17T22:43:40.267034] [INFO ] [MAIN ] Derivative Progress: 1504/2083 symbols completed. PSQH took 1.1s. Estimated remaining: 3m 40s. Rate: 158.1 symbols/min [2025-10-17T22:43:40.267776] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:40.281773] [DEBUG] [MAIN ] PSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:40.282576] [INFO ] [MAIN ] PSN: Generated 1820 derivative records from 46125 primary records. [2025-10-17T22:43:40.282873] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-10-17T22:43:40.322756] [DEBUG] [MAIN ] PSTG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:40.330728] [INFO ] [MAIN ] PSTG: Generated 1820 derivative records from 53630 primary records. [2025-10-17T22:43:40.331091] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-10-17T22:43:40.331821] [DEBUG] [LOCAL ] PSN: Derivative data saved (1820 records). [2025-10-17T22:43:40.332620] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-10-17T22:43:40.335087] [INFO ] [MAIN ] Derivative Progress: 1505/2083 symbols completed. PSN took 1.2s. Estimated remaining: 3m 39s. Rate: 158.2 symbols/min [2025-10-17T22:43:40.346847] [DEBUG] [LOCAL ] PSTL: Loaded 20382 existing records from primary storage. [2025-10-17T22:43:40.343579] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:40.349870] [INFO ] [MAIN ] PSTL: Loaded 20382 primary data records. [2025-10-17T22:43:40.372368] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1820 records). [2025-10-17T22:43:40.372561] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-10-17T22:43:40.384921] [INFO ] [MAIN ] Derivative Progress: 1506/2083 symbols completed. PSTG took 1.2s. Estimated remaining: 3m 39s. Rate: 158.3 symbols/min [2025-10-17T22:43:40.397097] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:40.643984] [DEBUG] [LOCAL ] PTA: Loaded 15411 existing records from primary storage. [2025-10-17T22:43:40.651230] [INFO ] [MAIN ] PTA: Loaded 15411 primary data records. [2025-10-17T22:43:40.815585] [DEBUG] [LOCAL ] PSX: Loaded 53890 existing records from primary storage. [2025-10-17T22:43:40.832529] [INFO ] [MAIN ] PSX: Loaded 53890 primary data records. [2025-10-17T22:43:41.420230] [DEBUG] [MAIN ] PSTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:41.421345] [INFO ] [MAIN ] PSTL: Generated 1820 derivative records from 20382 primary records. [2025-10-17T22:43:41.421448] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-10-17T22:43:41.441047] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1820 records). [2025-10-17T22:43:41.441794] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-10-17T22:43:41.444502] [INFO ] [MAIN ] Derivative Progress: 1507/2083 symbols completed. PSTL took 1.2s. Estimated remaining: 3m 39s. Rate: 158.1 symbols/min [2025-10-17T22:43:41.445049] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:41.468943] [DEBUG] [MAIN ] PTA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:41.470185] [INFO ] [MAIN ] PTA: Generated 1820 derivative records from 15411 primary records. [2025-10-17T22:43:41.473128] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-10-17T22:43:41.501719] [DEBUG] [MAIN ] PSX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:41.515972] [INFO ] [MAIN ] PSX: Generated 1820 derivative records from 53890 primary records. [2025-10-17T22:43:41.516074] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-10-17T22:43:41.516771] [DEBUG] [LOCAL ] PTA: Derivative data saved (1820 records). [2025-10-17T22:43:41.517304] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-10-17T22:43:41.520983] [INFO ] [MAIN ] Derivative Progress: 1508/2083 symbols completed. PTA took 1.1s. Estimated remaining: 3m 38s. Rate: 158.2 symbols/min [2025-10-17T22:43:41.533866] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:41.549521] [DEBUG] [LOCAL ] PTY: Loaded 38349 existing records from primary storage. [2025-10-17T22:43:41.548978] [DEBUG] [LOCAL ] PSX: Derivative data saved (1820 records). [2025-10-17T22:43:41.550403] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-10-17T22:43:41.553153] [INFO ] [MAIN ] Derivative Progress: 1509/2083 symbols completed. PSX took 1.2s. Estimated remaining: 3m 38s. Rate: 158.3 symbols/min [2025-10-17T22:43:41.549947] [INFO ] [MAIN ] PTY: Loaded 38349 primary data records. [2025-10-17T22:43:41.553353] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:41.887295] [DEBUG] [LOCAL ] PUK: Loaded 45178 existing records from primary storage. [2025-10-17T22:43:41.888345] [INFO ] [MAIN ] PUK: Loaded 45178 primary data records. [2025-10-17T22:43:42.032363] [DEBUG] [LOCAL ] PVH: Loaded 50636 existing records from primary storage. [2025-10-17T22:43:42.184261] [INFO ] [MAIN ] PVH: Loaded 50636 primary data records. [2025-10-17T22:43:42.396681] [DEBUG] [MAIN ] PTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:42.421467] [INFO ] [MAIN ] PTY: Generated 1820 derivative records from 38349 primary records. [2025-10-17T22:43:42.421677] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-10-17T22:43:42.567610] [DEBUG] [LOCAL ] PTY: Derivative data saved (1820 records). [2025-10-17T22:43:42.568203] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-10-17T22:43:42.570455] [INFO ] [MAIN ] Derivative Progress: 1510/2083 symbols completed. PTY took 1.1s. Estimated remaining: 3m 37s. Rate: 158.1 symbols/min [2025-10-17T22:43:42.571626] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:42.599346] [DEBUG] [MAIN ] PUK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:42.598823] [DEBUG] [LOCAL ] PVL: Loaded 4769 existing records from primary storage. [2025-10-17T22:43:42.600560] [INFO ] [MAIN ] PUK: Generated 1820 derivative records from 45178 primary records. [2025-10-17T22:43:42.599787] [INFO ] [MAIN ] PVL: Loaded 4769 primary data records. [2025-10-17T22:43:42.631809] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-10-17T22:43:42.715435] [DEBUG] [LOCAL ] PUK: Derivative data saved (1820 records). [2025-10-17T22:43:42.718864] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-10-17T22:43:42.723024] [INFO ] [MAIN ] Derivative Progress: 1511/2083 symbols completed. PUK took 1.2s. Estimated remaining: 3m 37s. Rate: 158.2 symbols/min [2025-10-17T22:43:42.723692] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:42.932362] [DEBUG] [MAIN ] PVH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:42.942788] [INFO ] [MAIN ] PVH: Generated 1820 derivative records from 50636 primary records. [2025-10-17T22:43:42.942969] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-10-17T22:43:42.974599] [DEBUG] [LOCAL ] PVH: Derivative data saved (1820 records). [2025-10-17T22:43:42.974846] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-10-17T22:43:42.977206] [INFO ] [MAIN ] Derivative Progress: 1512/2083 symbols completed. PVH took 1.4s. Estimated remaining: 3m 37s. Rate: 158.2 symbols/min [2025-10-17T22:43:42.977552] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:43.015008] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:43.024110] [DEBUG] [LOCAL ] PWR: Loaded 47297 existing records from primary storage. [2025-10-17T22:43:43.025138] [INFO ] [MAIN ] PWR: Loaded 47297 primary data records. [2025-10-17T22:43:43.025070] [INFO ] [MAIN ] PVL: Generated 1820 derivative records from 4769 primary records. [2025-10-17T22:43:43.025458] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-10-17T22:43:43.135962] [DEBUG] [LOCAL ] PVL: Derivative data saved (1820 records). [2025-10-17T22:43:43.155756] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-10-17T22:43:43.158270] [INFO ] [MAIN ] Derivative Progress: 1513/2083 symbols completed. PVL took 0.6s. Estimated remaining: 3m 36s. Rate: 158.3 symbols/min [2025-10-17T22:43:43.162734] [DEBUG] [LOCAL ] PX: Loaded 34837 existing records from primary storage. [2025-10-17T22:43:43.179259] [INFO ] [MAIN ] PX: Loaded 34837 primary data records. [2025-10-17T22:43:43.723854] [DEBUG] [MAIN ] PWR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:43.724574] [INFO ] [MAIN ] PWR: Generated 1820 derivative records from 47297 primary records. [2025-10-17T22:43:43.724777] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-10-17T22:43:43.741222] [DEBUG] [LOCAL ] PWR: Derivative data saved (1820 records). [2025-10-17T22:43:43.741306] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-10-17T22:43:43.743596] [INFO ] [MAIN ] Derivative Progress: 1514/2083 symbols completed. PWR took 1.0s. Estimated remaining: 3m 36s. Rate: 158.2 symbols/min [2025-10-17T22:43:43.758764] [DEBUG] [MAIN ] PX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:43.759399] [INFO ] [MAIN ] PX: Generated 1820 derivative records from 34837 primary records. [2025-10-17T22:43:43.759458] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-10-17T22:43:43.775212] [DEBUG] [LOCAL ] PX: Derivative data saved (1820 records). [2025-10-17T22:43:43.775273] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-10-17T22:43:43.777259] [INFO ] [MAIN ] Derivative Progress: 1515/2083 symbols completed. PX took 0.8s. Estimated remaining: 3m 35s. Rate: 158.3 symbols/min [2025-10-17T22:43:43.778086] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:43.778175] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:43.778012] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:43.808259] [DEBUG] [LOCAL ] QD: Loaded 27874 existing records from primary storage. [2025-10-17T22:43:43.808401] [INFO ] [MAIN ] QD: Loaded 27874 primary data records. [2025-10-17T22:43:43.990437] [DEBUG] [LOCAL ] QS: Loaded 54539 existing records from primary storage. [2025-10-17T22:43:44.042534] [INFO ] [MAIN ] QS: Loaded 54539 primary data records. [2025-10-17T22:43:44.043327] [DEBUG] [LOCAL ] QGEN: Loaded 49853 existing records from primary storage. [2025-10-17T22:43:44.045698] [INFO ] [MAIN ] QGEN: Loaded 49853 primary data records. [2025-10-17T22:43:44.796457] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:44.797753] [INFO ] [MAIN ] QD: Generated 1820 derivative records from 27874 primary records. [2025-10-17T22:43:44.798209] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-10-17T22:43:44.816339] [DEBUG] [LOCAL ] QD: Derivative data saved (1820 records). [2025-10-17T22:43:44.816724] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-10-17T22:43:44.818792] [INFO ] [MAIN ] Derivative Progress: 1516/2083 symbols completed. QD took 1.0s. Estimated remaining: 3m 35s. Rate: 158.1 symbols/min [2025-10-17T22:43:44.819304] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:44.838190] [DEBUG] [MAIN ] QS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:44.839208] [INFO ] [MAIN ] QS: Generated 1820 derivative records from 54539 primary records. [2025-10-17T22:43:44.839530] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-10-17T22:43:44.859319] [DEBUG] [LOCAL ] QS: Derivative data saved (1820 records). [2025-10-17T22:43:44.872666] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-10-17T22:43:44.875514] [INFO ] [MAIN ] Derivative Progress: 1517/2083 symbols completed. QS took 1.1s. Estimated remaining: 3m 35s. Rate: 158.2 symbols/min [2025-10-17T22:43:44.875738] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:44.876994] [DEBUG] [MAIN ] QGEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:44.877788] [INFO ] [MAIN ] QGEN: Generated 1820 derivative records from 49853 primary records. [2025-10-17T22:43:44.877913] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-10-17T22:43:44.909590] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1820 records). [2025-10-17T22:43:44.909999] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-10-17T22:43:44.912398] [INFO ] [MAIN ] Derivative Progress: 1518/2083 symbols completed. QGEN took 1.1s. Estimated remaining: 3m 34s. Rate: 158.3 symbols/min [2025-10-17T22:43:44.912798] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:44.944289] [DEBUG] [LOCAL ] QSR: Loaded 53233 existing records from primary storage. [2025-10-17T22:43:44.944664] [INFO ] [MAIN ] QSR: Loaded 53233 primary data records. [2025-10-17T22:43:45.064022] [DEBUG] [LOCAL ] QTWO: Loaded 40143 existing records from primary storage. [2025-10-17T22:43:45.075083] [DEBUG] [LOCAL ] QUAD: Loaded 23589 existing records from primary storage. [2025-10-17T22:43:45.075284] [INFO ] [MAIN ] QUAD: Loaded 23589 primary data records. [2025-10-17T22:43:45.075213] [INFO ] [MAIN ] QTWO: Loaded 40143 primary data records. [2025-10-17T22:43:45.936067] [DEBUG] [MAIN ] QSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:45.937447] [INFO ] [MAIN ] QSR: Generated 1820 derivative records from 53233 primary records. [2025-10-17T22:43:45.939238] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-10-17T22:43:45.978873] [DEBUG] [MAIN ] QTWO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:45.978004] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:45.983181] [INFO ] [MAIN ] QUAD: Generated 1820 derivative records from 23589 primary records. [2025-10-17T22:43:45.979564] [INFO ] [MAIN ] QTWO: Generated 1820 derivative records from 40143 primary records. [2025-10-17T22:43:45.983325] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-10-17T22:43:45.982569] [DEBUG] [LOCAL ] QSR: Derivative data saved (1820 records). [2025-10-17T22:43:45.983822] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-10-17T22:43:45.984134] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-10-17T22:43:45.993587] [INFO ] [MAIN ] Derivative Progress: 1519/2083 symbols completed. QSR took 1.2s. Estimated remaining: 3m 34s. Rate: 158.1 symbols/min [2025-10-17T22:43:45.995012] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:46.014827] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1820 records). [2025-10-17T22:43:46.015184] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-10-17T22:43:46.017532] [INFO ] [MAIN ] Derivative Progress: 1520/2083 symbols completed. QUAD took 1.1s. Estimated remaining: 3m 33s. Rate: 158.2 symbols/min [2025-10-17T22:43:46.017721] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:46.022793] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1820 records). [2025-10-17T22:43:46.023016] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-10-17T22:43:46.025240] [INFO ] [MAIN ] Derivative Progress: 1521/2083 symbols completed. QTWO took 1.1s. Estimated remaining: 3m 33s. Rate: 158.3 symbols/min [2025-10-17T22:43:46.026713] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:46.033574] [DEBUG] [LOCAL ] QVCD: Loaded 4732 existing records from primary storage. [2025-10-17T22:43:46.034317] [DEBUG] [LOCAL ] QVCC: Loaded 9007 existing records from primary storage. [2025-10-17T22:43:46.034491] [INFO ] [MAIN ] QVCC: Loaded 9007 primary data records. [2025-10-17T22:43:46.034050] [INFO ] [MAIN ] QVCD: Loaded 4732 primary data records. [2025-10-17T22:43:46.657475] [DEBUG] [LOCAL ] QXO: Loaded 54207 existing records from primary storage. [2025-10-17T22:43:46.658546] [INFO ] [MAIN ] QXO: Loaded 54207 primary data records. [2025-10-17T22:43:47.042562] [DEBUG] [MAIN ] QVCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:47.042951] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:47.044529] [INFO ] [MAIN ] QVCD: Generated 1820 derivative records from 4732 primary records. [2025-10-17T22:43:47.043771] [INFO ] [MAIN ] QVCC: Generated 1820 derivative records from 9007 primary records. [2025-10-17T22:43:47.044684] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-10-17T22:43:47.045939] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-10-17T22:43:47.076516] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1820 records). [2025-10-17T22:43:47.077364] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1820 records). [2025-10-17T22:43:47.077432] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-10-17T22:43:47.077530] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-10-17T22:43:47.079615] [INFO ] [MAIN ] Derivative Progress: 1522/2083 symbols completed. QVCD took 1.1s. Estimated remaining: 3m 33s. Rate: 158.1 symbols/min [2025-10-17T22:43:47.082286] [INFO ] [MAIN ] Derivative Progress: 1523/2083 symbols completed. QVCC took 1.1s. Estimated remaining: 3m 32s. Rate: 158.2 symbols/min [2025-10-17T22:43:47.082595] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:47.082160] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:47.100216] [DEBUG] [MAIN ] QXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:47.100908] [INFO ] [MAIN ] QXO: Generated 1820 derivative records from 54207 primary records. [2025-10-17T22:43:47.101098] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-10-17T22:43:47.135275] [DEBUG] [LOCAL ] RA: Loaded 22044 existing records from primary storage. [2025-10-17T22:43:47.135918] [INFO ] [MAIN ] RA: Loaded 22044 primary data records. [2025-10-17T22:43:47.136927] [DEBUG] [LOCAL ] QXO: Derivative data saved (1820 records). [2025-10-17T22:43:47.137063] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-10-17T22:43:47.150480] [INFO ] [MAIN ] Derivative Progress: 1524/2083 symbols completed. QXO took 1.1s. Estimated remaining: 3m 32s. Rate: 158.3 symbols/min [2025-10-17T22:43:47.178619] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:47.211668] [DEBUG] [LOCAL ] R: Loaded 28752 existing records from primary storage. [2025-10-17T22:43:47.218257] [INFO ] [MAIN ] R: Loaded 28752 primary data records. [2025-10-17T22:43:47.751560] [DEBUG] [LOCAL ] RACE: Loaded 33535 existing records from primary storage. [2025-10-17T22:43:47.752361] [INFO ] [MAIN ] RACE: Loaded 33535 primary data records. [2025-10-17T22:43:48.083795] [DEBUG] [MAIN ] RA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:48.084819] [INFO ] [MAIN ] RA: Generated 1820 derivative records from 22044 primary records. [2025-10-17T22:43:48.085674] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-10-17T22:43:48.086022] [DEBUG] [MAIN ] R: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:48.087538] [INFO ] [MAIN ] R: Generated 1820 derivative records from 28752 primary records. [2025-10-17T22:43:48.087719] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-10-17T22:43:48.118048] [DEBUG] [LOCAL ] R: Derivative data saved (1820 records). [2025-10-17T22:43:48.118674] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-10-17T22:43:48.120899] [INFO ] [MAIN ] Derivative Progress: 1525/2083 symbols completed. R took 1.0s. Estimated remaining: 3m 32s. Rate: 158.2 symbols/min [2025-10-17T22:43:48.121885] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:48.124602] [DEBUG] [LOCAL ] RA: Derivative data saved (1820 records). [2025-10-17T22:43:48.125226] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-10-17T22:43:48.127532] [INFO ] [MAIN ] Derivative Progress: 1526/2083 symbols completed. RA took 1.0s. Estimated remaining: 3m 31s. Rate: 158.3 symbols/min [2025-10-17T22:43:48.127952] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:48.144301] [DEBUG] [MAIN ] RACE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:48.144972] [INFO ] [MAIN ] RACE: Generated 1820 derivative records from 33535 primary records. [2025-10-17T22:43:48.145169] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-10-17T22:43:48.173514] [DEBUG] [LOCAL ] RACE: Derivative data saved (1820 records). [2025-10-17T22:43:48.173765] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-10-17T22:43:48.175903] [INFO ] [MAIN ] Derivative Progress: 1527/2083 symbols completed. RACE took 1.0s. Estimated remaining: 3m 31s. Rate: 158.4 symbols/min [2025-10-17T22:43:48.176718] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:48.197267] [DEBUG] [LOCAL ] RAMP: Loaded 38244 existing records from primary storage. [2025-10-17T22:43:48.197385] [INFO ] [MAIN ] RAMP: Loaded 38244 primary data records. [2025-10-17T22:43:48.396135] [DEBUG] [LOCAL ] RBC: Loaded 15633 existing records from primary storage. [2025-10-17T22:43:48.392270] [DEBUG] [LOCAL ] RBA: Loaded 46764 existing records from primary storage. [2025-10-17T22:43:48.495791] [INFO ] [MAIN ] RBA: Loaded 46764 primary data records. [2025-10-17T22:43:48.495631] [INFO ] [MAIN ] RBC: Loaded 15633 primary data records. [2025-10-17T22:43:49.180170] [DEBUG] [MAIN ] RAMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:49.181802] [INFO ] [MAIN ] RAMP: Generated 1820 derivative records from 38244 primary records. [2025-10-17T22:43:49.181948] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-10-17T22:43:49.202440] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1820 records). [2025-10-17T22:43:49.202875] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-10-17T22:43:49.204896] [INFO ] [MAIN ] Derivative Progress: 1528/2083 symbols completed. RAMP took 1.1s. Estimated remaining: 3m 31s. Rate: 158.2 symbols/min [2025-10-17T22:43:49.224600] [DEBUG] [MAIN ] RBC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:49.237504] [INFO ] [MAIN ] RBC: Generated 1820 derivative records from 15633 primary records. [2025-10-17T22:43:49.237856] [DEBUG] [MAIN ] RBA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:49.238009] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-10-17T22:43:49.238742] [INFO ] [MAIN ] RBA: Generated 1820 derivative records from 46764 primary records. [2025-10-17T22:43:49.239102] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-10-17T22:43:49.268451] [DEBUG] [LOCAL ] RBC: Derivative data saved (1820 records). [2025-10-17T22:43:49.268544] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-10-17T22:43:49.272056] [INFO ] [MAIN ] Derivative Progress: 1529/2083 symbols completed. RBC took 1.1s. Estimated remaining: 3m 30s. Rate: 158.3 symbols/min [2025-10-17T22:43:49.272942] [DEBUG] [LOCAL ] RBA: Derivative data saved (1820 records). [2025-10-17T22:43:49.273017] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-10-17T22:43:49.275171] [INFO ] [MAIN ] Derivative Progress: 1530/2083 symbols completed. RBA took 1.1s. Estimated remaining: 3m 30s. Rate: 158.4 symbols/min [2025-10-17T22:43:49.275554] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:49.276092] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:49.275712] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:49.285450] [DEBUG] [LOCAL ] RBOT: Loaded 6207 existing records from primary storage. [2025-10-17T22:43:49.285788] [INFO ] [MAIN ] RBOT: Loaded 6207 primary data records. [2025-10-17T22:43:49.637844] [DEBUG] [LOCAL ] RBRK: Loaded 53944 existing records from primary storage. [2025-10-17T22:43:49.638721] [DEBUG] [LOCAL ] RBLX: Loaded 54498 existing records from primary storage. [2025-10-17T22:43:49.638984] [INFO ] [MAIN ] RBRK: Loaded 53944 primary data records. [2025-10-17T22:43:49.639977] [INFO ] [MAIN ] RBLX: Loaded 54498 primary data records. [2025-10-17T22:43:50.263600] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:50.266209] [INFO ] [MAIN ] RBOT: Generated 1820 derivative records from 6207 primary records. [2025-10-17T22:43:50.266751] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-10-17T22:43:50.286032] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1820 records). [2025-10-17T22:43:50.286778] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-10-17T22:43:50.289562] [INFO ] [MAIN ] Derivative Progress: 1531/2083 symbols completed. RBOT took 1.0s. Estimated remaining: 3m 29s. Rate: 158.2 symbols/min [2025-10-17T22:43:50.289735] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:50.332786] [DEBUG] [MAIN ] RBLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:50.333801] [INFO ] [MAIN ] RBLX: Generated 1820 derivative records from 54498 primary records. [2025-10-17T22:43:50.332480] [DEBUG] [MAIN ] RBRK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:50.334995] [INFO ] [MAIN ] RBRK: Generated 1820 derivative records from 53944 primary records. [2025-10-17T22:43:50.335188] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-10-17T22:43:50.335309] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-10-17T22:43:50.372060] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1820 records). [2025-10-17T22:43:50.377732] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-10-17T22:43:50.383126] [INFO ] [MAIN ] Derivative Progress: 1532/2083 symbols completed. RBLX took 1.1s. Estimated remaining: 3m 29s. Rate: 158.3 symbols/min [2025-10-17T22:43:50.383375] [INFO ] [MAIN ] RCD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:50.380784] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1820 records). [2025-10-17T22:43:50.383976] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-10-17T22:43:50.386972] [INFO ] [MAIN ] Derivative Progress: 1533/2083 symbols completed. RBRK took 1.1s. Estimated remaining: 3m 28s. Rate: 158.4 symbols/min [2025-10-17T22:43:50.387425] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:50.406298] [DEBUG] [LOCAL ] RCD: Loaded 3432 existing records from primary storage. [2025-10-17T22:43:50.406596] [INFO ] [MAIN ] RCD: Loaded 3432 primary data records. [2025-10-17T22:43:50.438509] [DEBUG] [LOCAL ] RC: Loaded 49641 existing records from primary storage. [2025-10-17T22:43:50.444611] [INFO ] [MAIN ] RC: Loaded 49641 primary data records. [2025-10-17T22:43:51.049701] [DEBUG] [LOCAL ] RCI: Loaded 49399 existing records from primary storage. [2025-10-17T22:43:51.050364] [INFO ] [MAIN ] RCI: Loaded 49399 primary data records. [2025-10-17T22:43:51.370904] [DEBUG] [MAIN ] RCD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:43:51.372333] [INFO ] [MAIN ] RCD: Generated 1819 derivative records from 3432 primary records. [2025-10-17T22:43:51.374434] [DEBUG] [LOCAL ] RCD: Saving derivative data. [2025-10-17T22:43:51.397566] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:51.401085] [INFO ] [MAIN ] RC: Generated 1820 derivative records from 49641 primary records. [2025-10-17T22:43:51.404221] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-10-17T22:43:51.406159] [DEBUG] [LOCAL ] RCD: Derivative data saved (1819 records). [2025-10-17T22:43:51.406573] [INFO ] [MAIN ] RCD: Successfully saved derivative data. [2025-10-17T22:43:51.408749] [INFO ] [MAIN ] Derivative Progress: 1534/2083 symbols completed. RCD took 1.0s. Estimated remaining: 3m 28s. Rate: 158.2 symbols/min [2025-10-17T22:43:51.416163] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:51.425336] [DEBUG] [LOCAL ] RC: Derivative data saved (1820 records). [2025-10-17T22:43:51.425554] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-10-17T22:43:51.427761] [INFO ] [MAIN ] Derivative Progress: 1535/2083 symbols completed. RC took 1.1s. Estimated remaining: 3m 28s. Rate: 158.3 symbols/min [2025-10-17T22:43:51.427971] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:51.448732] [DEBUG] [MAIN ] RCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:51.453745] [DEBUG] [LOCAL ] RCS: Loaded 12509 existing records from primary storage. [2025-10-17T22:43:51.454003] [INFO ] [MAIN ] RCS: Loaded 12509 primary data records. [2025-10-17T22:43:51.454767] [INFO ] [MAIN ] RCI: Generated 1820 derivative records from 49399 primary records. [2025-10-17T22:43:51.485761] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-10-17T22:43:51.583075] [DEBUG] [LOCAL ] RCI: Derivative data saved (1820 records). [2025-10-17T22:43:51.613621] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-10-17T22:43:51.643263] [DEBUG] [LOCAL ] RCUS: Loaded 43674 existing records from primary storage. [2025-10-17T22:43:51.657927] [INFO ] [MAIN ] Derivative Progress: 1536/2083 symbols completed. RCI took 1.3s. Estimated remaining: 3m 27s. Rate: 158.3 symbols/min [2025-10-17T22:43:51.676530] [INFO ] [MAIN ] RCUS: Loaded 43674 primary data records. [2025-10-17T22:43:51.804162] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:52.133710] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:52.149366] [INFO ] [MAIN ] RCS: Generated 1820 derivative records from 12509 primary records. [2025-10-17T22:43:52.151346] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-17T22:43:52.153731] [DEBUG] [LOCAL ] RDDT: Loaded 54555 existing records from primary storage. [2025-10-17T22:43:52.154534] [INFO ] [MAIN ] RDDT: Loaded 54555 primary data records. [2025-10-17T22:43:52.249429] [DEBUG] [LOCAL ] RCS: Derivative data saved (1820 records). [2025-10-17T22:43:52.257631] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-10-17T22:43:52.260028] [INFO ] [MAIN ] Derivative Progress: 1537/2083 symbols completed. RCS took 0.8s. Estimated remaining: 3m 27s. Rate: 158.3 symbols/min [2025-10-17T22:43:52.271333] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:52.327213] [DEBUG] [MAIN ] RCUS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:52.386874] [INFO ] [MAIN ] RCUS: Generated 1820 derivative records from 43674 primary records. [2025-10-17T22:43:52.502984] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-10-17T22:43:52.549204] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1820 records). [2025-10-17T22:43:52.549411] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-10-17T22:43:52.551688] [INFO ] [MAIN ] Derivative Progress: 1538/2083 symbols completed. RCUS took 1.1s. Estimated remaining: 3m 27s. Rate: 158.3 symbols/min [2025-10-17T22:43:52.552571] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:52.568087] [DEBUG] [LOCAL ] RDN: Loaded 45209 existing records from primary storage. [2025-10-17T22:43:52.571958] [INFO ] [MAIN ] RDN: Loaded 45209 primary data records. [2025-10-17T22:43:52.813094] [DEBUG] [MAIN ] RDDT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:52.973026] [INFO ] [MAIN ] RDDT: Generated 1820 derivative records from 54555 primary records. [2025-10-17T22:43:52.983264] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-10-17T22:43:53.016491] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1820 records). [2025-10-17T22:43:53.018064] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-10-17T22:43:53.018837] [DEBUG] [LOCAL ] RDW: Loaded 53025 existing records from primary storage. [2025-10-17T22:43:53.019343] [INFO ] [MAIN ] RDW: Loaded 53025 primary data records. [2025-10-17T22:43:53.021715] [INFO ] [MAIN ] Derivative Progress: 1539/2083 symbols completed. RDDT took 1.2s. Estimated remaining: 3m 26s. Rate: 158.3 symbols/min [2025-10-17T22:43:53.043367] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:53.345710] [DEBUG] [MAIN ] RDN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:53.346675] [INFO ] [MAIN ] RDN: Generated 1820 derivative records from 45209 primary records. [2025-10-17T22:43:53.346843] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-10-17T22:43:53.382088] [DEBUG] [LOCAL ] RDN: Derivative data saved (1820 records). [2025-10-17T22:43:53.380803] [DEBUG] [LOCAL ] RDY: Loaded 47210 existing records from primary storage. [2025-10-17T22:43:53.382289] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-10-17T22:43:53.382430] [INFO ] [MAIN ] RDY: Loaded 47210 primary data records. [2025-10-17T22:43:53.384809] [INFO ] [MAIN ] Derivative Progress: 1540/2083 symbols completed. RDN took 1.1s. Estimated remaining: 3m 26s. Rate: 158.3 symbols/min [2025-10-17T22:43:53.390287] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:53.752717] [DEBUG] [MAIN ] RDW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:53.753590] [INFO ] [MAIN ] RDW: Generated 1820 derivative records from 53025 primary records. [2025-10-17T22:43:53.753875] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-10-17T22:43:53.786406] [DEBUG] [LOCAL ] RELX: Loaded 49179 existing records from primary storage. [2025-10-17T22:43:53.789116] [INFO ] [MAIN ] RELX: Loaded 49179 primary data records. [2025-10-17T22:43:53.807842] [DEBUG] [LOCAL ] RDW: Derivative data saved (1820 records). [2025-10-17T22:43:53.824675] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-10-17T22:43:53.827425] [INFO ] [MAIN ] Derivative Progress: 1541/2083 symbols completed. RDW took 1.3s. Estimated remaining: 3m 25s. Rate: 158.3 symbols/min [2025-10-17T22:43:53.857797] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:54.131557] [DEBUG] [MAIN ] RDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:54.144316] [INFO ] [MAIN ] RDY: Generated 1820 derivative records from 47210 primary records. [2025-10-17T22:43:54.144895] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-10-17T22:43:54.147259] [DEBUG] [LOCAL ] RERE: Loaded 42117 existing records from primary storage. [2025-10-17T22:43:54.164120] [INFO ] [MAIN ] RERE: Loaded 42117 primary data records. [2025-10-17T22:43:54.164978] [DEBUG] [LOCAL ] RDY: Derivative data saved (1820 records). [2025-10-17T22:43:54.176829] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-10-17T22:43:54.202969] [INFO ] [MAIN ] Derivative Progress: 1542/2083 symbols completed. RDY took 1.2s. Estimated remaining: 3m 25s. Rate: 158.3 symbols/min [2025-10-17T22:43:54.210294] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:54.491304] [DEBUG] [MAIN ] RELX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:54.504149] [INFO ] [MAIN ] RELX: Generated 1820 derivative records from 49179 primary records. [2025-10-17T22:43:54.504921] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-10-17T22:43:54.523144] [DEBUG] [LOCAL ] RELX: Derivative data saved (1820 records). [2025-10-17T22:43:54.524048] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-10-17T22:43:54.526289] [INFO ] [MAIN ] Derivative Progress: 1543/2083 symbols completed. RELX took 1.1s. Estimated remaining: 3m 25s. Rate: 158.3 symbols/min [2025-10-17T22:43:54.541231] [DEBUG] [LOCAL ] RES: Loaded 47647 existing records from primary storage. [2025-10-17T22:43:54.542598] [INFO ] [MAIN ] RES: Loaded 47647 primary data records. [2025-10-17T22:43:54.893227] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:54.894048] [INFO ] [MAIN ] RERE: Generated 1820 derivative records from 42117 primary records. [2025-10-17T22:43:54.894133] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-10-17T22:43:54.912820] [DEBUG] [LOCAL ] RERE: Derivative data saved (1820 records). [2025-10-17T22:43:54.912905] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-10-17T22:43:54.914964] [INFO ] [MAIN ] Derivative Progress: 1544/2083 symbols completed. RERE took 1.1s. Estimated remaining: 3m 24s. Rate: 158.3 symbols/min [2025-10-17T22:43:54.933814] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:54.934405] [INFO ] [MAIN ] RES: Generated 1820 derivative records from 47647 primary records. [2025-10-17T22:43:54.934464] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-10-17T22:43:54.949258] [DEBUG] [LOCAL ] RES: Derivative data saved (1820 records). [2025-10-17T22:43:54.949317] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-10-17T22:43:54.951465] [INFO ] [MAIN ] Derivative Progress: 1545/2083 symbols completed. RES took 0.7s. Estimated remaining: 3m 24s. Rate: 158.4 symbols/min [2025-10-17T22:43:54.952164] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:54.952577] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:54.952713] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:54.972403] [DEBUG] [LOCAL ] REX: Loaded 14756 existing records from primary storage. [2025-10-17T22:43:54.972517] [INFO ] [MAIN ] REX: Loaded 14756 primary data records. [2025-10-17T22:43:55.297417] [DEBUG] [LOCAL ] REVG: Loaded 40973 existing records from primary storage. [2025-10-17T22:43:55.297701] [INFO ] [MAIN ] REVG: Loaded 40973 primary data records. [2025-10-17T22:43:55.417107] [DEBUG] [LOCAL ] REXR: Loaded 52912 existing records from primary storage. [2025-10-17T22:43:55.433907] [INFO ] [MAIN ] REXR: Loaded 52912 primary data records. [2025-10-17T22:43:55.958334] [DEBUG] [MAIN ] REX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:55.959892] [INFO ] [MAIN ] REX: Generated 1820 derivative records from 14756 primary records. [2025-10-17T22:43:55.960986] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-10-17T22:43:55.982102] [DEBUG] [LOCAL ] REX: Derivative data saved (1820 records). [2025-10-17T22:43:55.982274] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-10-17T22:43:55.984511] [INFO ] [MAIN ] Derivative Progress: 1546/2083 symbols completed. REX took 1.0s. Estimated remaining: 3m 24s. Rate: 158.2 symbols/min [2025-10-17T22:43:55.984871] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:56.000186] [DEBUG] [MAIN ] REVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:56.001508] [INFO ] [MAIN ] REVG: Generated 1820 derivative records from 40973 primary records. [2025-10-17T22:43:56.001957] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-10-17T22:43:56.036023] [DEBUG] [MAIN ] REXR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:56.036460] [DEBUG] [LOCAL ] REVG: Derivative data saved (1820 records). [2025-10-17T22:43:56.037589] [INFO ] [MAIN ] REXR: Generated 1820 derivative records from 52912 primary records. [2025-10-17T22:43:56.037906] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-10-17T22:43:56.038251] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-10-17T22:43:56.041275] [INFO ] [MAIN ] Derivative Progress: 1547/2083 symbols completed. REVG took 1.1s. Estimated remaining: 3m 23s. Rate: 158.3 symbols/min [2025-10-17T22:43:56.042249] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:56.071557] [DEBUG] [LOCAL ] REXR: Derivative data saved (1820 records). [2025-10-17T22:43:56.071634] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-10-17T22:43:56.073834] [INFO ] [MAIN ] Derivative Progress: 1548/2083 symbols completed. REXR took 1.1s. Estimated remaining: 3m 23s. Rate: 158.4 symbols/min [2025-10-17T22:43:56.074036] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:56.103858] [DEBUG] [LOCAL ] RFI: Loaded 10522 existing records from primary storage. [2025-10-17T22:43:56.104875] [INFO ] [MAIN ] RFI: Loaded 10522 primary data records. [2025-10-17T22:43:56.104549] [DEBUG] [LOCAL ] REZI: Loaded 47764 existing records from primary storage. [2025-10-17T22:43:56.110705] [INFO ] [MAIN ] REZI: Loaded 47764 primary data records. [2025-10-17T22:43:56.483271] [DEBUG] [LOCAL ] RF: Loaded 54412 existing records from primary storage. [2025-10-17T22:43:56.507607] [INFO ] [MAIN ] RF: Loaded 54412 primary data records. [2025-10-17T22:43:57.118975] [DEBUG] [MAIN ] REZI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:57.120899] [INFO ] [MAIN ] REZI: Generated 1820 derivative records from 47764 primary records. [2025-10-17T22:43:57.121030] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-10-17T22:43:57.154010] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:57.156380] [INFO ] [MAIN ] RFI: Generated 1820 derivative records from 10522 primary records. [2025-10-17T22:43:57.155417] [DEBUG] [LOCAL ] REZI: Derivative data saved (1820 records). [2025-10-17T22:43:57.156609] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-17T22:43:57.156735] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-10-17T22:43:57.159824] [INFO ] [MAIN ] Derivative Progress: 1549/2083 symbols completed. REZI took 1.2s. Estimated remaining: 3m 23s. Rate: 158.2 symbols/min [2025-10-17T22:43:57.161203] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:57.181418] [DEBUG] [LOCAL ] RFI: Derivative data saved (1820 records). [2025-10-17T22:43:57.182475] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-10-17T22:43:57.185718] [INFO ] [MAIN ] Derivative Progress: 1550/2083 symbols completed. RFI took 1.1s. Estimated remaining: 3m 22s. Rate: 158.3 symbols/min [2025-10-17T22:43:57.186027] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:57.203557] [DEBUG] [MAIN ] RF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:57.205823] [INFO ] [MAIN ] RF: Generated 1820 derivative records from 54412 primary records. [2025-10-17T22:43:57.206042] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-10-17T22:43:57.220919] [DEBUG] [LOCAL ] RFL: Loaded 11542 existing records from primary storage. [2025-10-17T22:43:57.223802] [INFO ] [MAIN ] RFL: Loaded 11542 primary data records. [2025-10-17T22:43:57.252902] [DEBUG] [LOCAL ] RFM: Loaded 4229 existing records from primary storage. [2025-10-17T22:43:57.242945] [DEBUG] [LOCAL ] RF: Derivative data saved (1820 records). [2025-10-17T22:43:57.268453] [INFO ] [MAIN ] RFM: Loaded 4229 primary data records. [2025-10-17T22:43:57.287763] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-10-17T22:43:57.298901] [INFO ] [MAIN ] Derivative Progress: 1551/2083 symbols completed. RF took 1.3s. Estimated remaining: 3m 22s. Rate: 158.4 symbols/min [2025-10-17T22:43:57.320737] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:57.535605] [DEBUG] [LOCAL ] RFMZ: Loaded 8929 existing records from primary storage. [2025-10-17T22:43:57.545704] [INFO ] [MAIN ] RFMZ: Loaded 8929 primary data records. [2025-10-17T22:43:58.201080] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:58.203116] [INFO ] [MAIN ] RFL: Generated 1820 derivative records from 11542 primary records. [2025-10-17T22:43:58.203222] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-10-17T22:43:58.226983] [DEBUG] [LOCAL ] RFL: Derivative data saved (1820 records). [2025-10-17T22:43:58.227194] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-10-17T22:43:58.229189] [INFO ] [MAIN ] Derivative Progress: 1552/2083 symbols completed. RFL took 1.1s. Estimated remaining: 3m 21s. Rate: 158.2 symbols/min [2025-10-17T22:43:58.229689] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:58.244715] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:58.245992] [INFO ] [MAIN ] RFM: Generated 1820 derivative records from 4229 primary records. [2025-10-17T22:43:58.246333] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-10-17T22:43:58.288499] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:58.288618] [DEBUG] [LOCAL ] RFM: Derivative data saved (1820 records). [2025-10-17T22:43:58.289831] [INFO ] [MAIN ] RFMZ: Generated 1820 derivative records from 8929 primary records. [2025-10-17T22:43:58.290022] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-10-17T22:43:58.290119] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-10-17T22:43:58.293572] [INFO ] [MAIN ] Derivative Progress: 1553/2083 symbols completed. RFM took 1.1s. Estimated remaining: 3m 21s. Rate: 158.3 symbols/min [2025-10-17T22:43:58.294267] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:58.319856] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1820 records). [2025-10-17T22:43:58.320243] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-10-17T22:43:58.320738] [DEBUG] [LOCAL ] RGA: Loaded 29820 existing records from primary storage. [2025-10-17T22:43:58.322871] [INFO ] [MAIN ] Derivative Progress: 1554/2083 symbols completed. RFMZ took 1.0s. Estimated remaining: 3m 20s. Rate: 158.4 symbols/min [2025-10-17T22:43:58.320850] [INFO ] [MAIN ] RGA: Loaded 29820 primary data records. [2025-10-17T22:43:58.323230] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:58.409597] [DEBUG] [LOCAL ] RGT: Loaded 2793 existing records from primary storage. [2025-10-17T22:43:58.427015] [INFO ] [MAIN ] RGT: Loaded 2793 primary data records. [2025-10-17T22:43:58.445356] [DEBUG] [LOCAL ] RGR: Loaded 21263 existing records from primary storage. [2025-10-17T22:43:58.483880] [INFO ] [MAIN ] RGR: Loaded 21263 primary data records. [2025-10-17T22:43:59.354794] [DEBUG] [MAIN ] RGA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:59.355861] [INFO ] [MAIN ] RGA: Generated 1820 derivative records from 29820 primary records. [2025-10-17T22:43:59.356051] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-10-17T22:43:59.378064] [DEBUG] [LOCAL ] RGA: Derivative data saved (1820 records). [2025-10-17T22:43:59.391403] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-10-17T22:43:59.393782] [INFO ] [MAIN ] Derivative Progress: 1555/2083 symbols completed. RGA took 1.2s. Estimated remaining: 3m 20s. Rate: 158.2 symbols/min [2025-10-17T22:43:59.394246] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:43:59.394451] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:59.401508] [INFO ] [MAIN ] RGT: Generated 1819 derivative records from 2793 primary records. [2025-10-17T22:43:59.408190] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-17T22:43:59.417135] [DEBUG] [MAIN ] RGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:43:59.430842] [DEBUG] [LOCAL ] RGT: Derivative data saved (1819 records). [2025-10-17T22:43:59.432549] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-10-17T22:43:59.432353] [INFO ] [MAIN ] RGR: Generated 1820 derivative records from 21263 primary records. [2025-10-17T22:43:59.434972] [INFO ] [MAIN ] Derivative Progress: 1556/2083 symbols completed. RGT took 1.1s. Estimated remaining: 3m 20s. Rate: 158.3 symbols/min [2025-10-17T22:43:59.435343] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:59.435090] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-10-17T22:43:59.455319] [DEBUG] [LOCAL ] RGR: Derivative data saved (1820 records). [2025-10-17T22:43:59.467140] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-10-17T22:43:59.470210] [INFO ] [MAIN ] Derivative Progress: 1557/2083 symbols completed. RGR took 1.2s. Estimated remaining: 3m 19s. Rate: 158.4 symbols/min [2025-10-17T22:43:59.472517] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:43:59.501347] [DEBUG] [LOCAL ] RH: Loaded 47994 existing records from primary storage. [2025-10-17T22:43:59.501776] [INFO ] [MAIN ] RH: Loaded 47994 primary data records. [2025-10-17T22:43:59.648561] [DEBUG] [LOCAL ] RHI: Loaded 50243 existing records from primary storage. [2025-10-17T22:43:59.677737] [INFO ] [MAIN ] RHI: Loaded 50243 primary data records. [2025-10-17T22:43:59.867861] [DEBUG] [LOCAL ] RHP: Loaded 41203 existing records from primary storage. [2025-10-17T22:43:59.884989] [INFO ] [MAIN ] RHP: Loaded 41203 primary data records. [2025-10-17T22:44:00.532255] [DEBUG] [MAIN ] RH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:00.533686] [INFO ] [MAIN ] RH: Generated 1820 derivative records from 47994 primary records. [2025-10-17T22:44:00.534820] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-10-17T22:44:00.554146] [DEBUG] [LOCAL ] RH: Derivative data saved (1820 records). [2025-10-17T22:44:00.555278] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-10-17T22:44:00.558467] [INFO ] [MAIN ] Derivative Progress: 1558/2083 symbols completed. RH took 1.2s. Estimated remaining: 3m 19s. Rate: 158.2 symbols/min [2025-10-17T22:44:00.581620] [DEBUG] [MAIN ] RHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:00.582485] [INFO ] [MAIN ] RHI: Generated 1820 derivative records from 50243 primary records. [2025-10-17T22:44:00.582566] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-10-17T22:44:00.594684] [DEBUG] [MAIN ] RHP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:00.595691] [INFO ] [MAIN ] RHP: Generated 1820 derivative records from 41203 primary records. [2025-10-17T22:44:00.596025] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-10-17T22:44:00.625942] [DEBUG] [LOCAL ] RHI: Derivative data saved (1820 records). [2025-10-17T22:44:00.627453] [DEBUG] [LOCAL ] RHP: Derivative data saved (1820 records). [2025-10-17T22:44:00.627562] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-10-17T22:44:00.629917] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-10-17T22:44:00.629846] [INFO ] [MAIN ] Derivative Progress: 1559/2083 symbols completed. RHI took 1.2s. Estimated remaining: 3m 19s. Rate: 158.3 symbols/min [2025-10-17T22:44:00.632131] [INFO ] [MAIN ] Derivative Progress: 1560/2083 symbols completed. RHP took 1.2s. Estimated remaining: 3m 18s. Rate: 158.4 symbols/min [2025-10-17T22:44:00.632565] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:00.632921] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:00.633015] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:00.731186] [DEBUG] [LOCAL ] RIO: Loaded 54181 existing records from primary storage. [2025-10-17T22:44:00.731436] [INFO ] [MAIN ] RIO: Loaded 54181 primary data records. [2025-10-17T22:44:00.732105] [DEBUG] [LOCAL ] RIG: Loaded 54455 existing records from primary storage. [2025-10-17T22:44:00.732328] [INFO ] [MAIN ] RIG: Loaded 54455 primary data records. [2025-10-17T22:44:00.919693] [DEBUG] [LOCAL ] RITM: Loaded 53721 existing records from primary storage. [2025-10-17T22:44:00.956460] [INFO ] [MAIN ] RITM: Loaded 53721 primary data records. [2025-10-17T22:44:01.771876] [DEBUG] [MAIN ] RIO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:01.786787] [INFO ] [MAIN ] RIO: Generated 1820 derivative records from 54181 primary records. [2025-10-17T22:44:01.788387] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-10-17T22:44:01.788281] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:01.789410] [INFO ] [MAIN ] RIG: Generated 1820 derivative records from 54455 primary records. [2025-10-17T22:44:01.790815] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-10-17T22:44:01.833428] [DEBUG] [LOCAL ] RIO: Derivative data saved (1820 records). [2025-10-17T22:44:01.841520] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-10-17T22:44:01.841196] [DEBUG] [LOCAL ] RIG: Derivative data saved (1820 records). [2025-10-17T22:44:01.842342] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-10-17T22:44:01.845230] [INFO ] [MAIN ] Derivative Progress: 1561/2083 symbols completed. RIO took 1.2s. Estimated remaining: 3m 18s. Rate: 158.2 symbols/min [2025-10-17T22:44:01.845551] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:01.849443] [INFO ] [MAIN ] Derivative Progress: 1562/2083 symbols completed. RIG took 1.2s. Estimated remaining: 3m 18s. Rate: 158.3 symbols/min [2025-10-17T22:44:01.850640] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:01.875728] [DEBUG] [MAIN ] RITM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:01.883028] [DEBUG] [LOCAL ] RIV: Loaded 12779 existing records from primary storage. [2025-10-17T22:44:01.882598] [INFO ] [MAIN ] RITM: Generated 1820 derivative records from 53721 primary records. [2025-10-17T22:44:01.883442] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-10-17T22:44:01.883535] [INFO ] [MAIN ] RIV: Loaded 12779 primary data records. [2025-10-17T22:44:01.985331] [DEBUG] [LOCAL ] RITM: Derivative data saved (1820 records). [2025-10-17T22:44:01.997491] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-10-17T22:44:02.014104] [INFO ] [MAIN ] Derivative Progress: 1563/2083 symbols completed. RITM took 1.4s. Estimated remaining: 3m 17s. Rate: 158.3 symbols/min [2025-10-17T22:44:02.040117] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:02.297074] [DEBUG] [LOCAL ] RJF: Loaded 47356 existing records from primary storage. [2025-10-17T22:44:02.297518] [INFO ] [MAIN ] RJF: Loaded 47356 primary data records. [2025-10-17T22:44:02.709475] [DEBUG] [LOCAL ] RKT: Loaded 54509 existing records from primary storage. [2025-10-17T22:44:02.749413] [INFO ] [MAIN ] RKT: Loaded 54509 primary data records. [2025-10-17T22:44:02.967713] [DEBUG] [MAIN ] RIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:02.973583] [INFO ] [MAIN ] RIV: Generated 1820 derivative records from 12779 primary records. [2025-10-17T22:44:02.974442] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-10-17T22:44:03.106185] [DEBUG] [LOCAL ] RIV: Derivative data saved (1820 records). [2025-10-17T22:44:03.322558] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-10-17T22:44:03.350438] [INFO ] [MAIN ] Derivative Progress: 1564/2083 symbols completed. RIV took 1.5s. Estimated remaining: 3m 17s. Rate: 158.1 symbols/min [2025-10-17T22:44:03.369165] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:03.395156] [DEBUG] [MAIN ] RJF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:03.396874] [INFO ] [MAIN ] RJF: Generated 1820 derivative records from 47356 primary records. [2025-10-17T22:44:03.397119] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-10-17T22:44:03.430283] [DEBUG] [LOCAL ] RJF: Derivative data saved (1820 records). [2025-10-17T22:44:03.430679] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-10-17T22:44:03.433998] [INFO ] [MAIN ] Derivative Progress: 1565/2083 symbols completed. RJF took 1.6s. Estimated remaining: 3m 17s. Rate: 158.1 symbols/min [2025-10-17T22:44:03.448697] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:03.472903] [DEBUG] [MAIN ] RKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:03.474380] [INFO ] [MAIN ] RKT: Generated 1820 derivative records from 54509 primary records. [2025-10-17T22:44:03.493140] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-10-17T22:44:03.495045] [DEBUG] [LOCAL ] RL: Loaded 40561 existing records from primary storage. [2025-10-17T22:44:03.495195] [INFO ] [MAIN ] RL: Loaded 40561 primary data records. [2025-10-17T22:44:03.674381] [DEBUG] [LOCAL ] RLI: Loaded 35031 existing records from primary storage. [2025-10-17T22:44:03.681206] [DEBUG] [LOCAL ] RKT: Derivative data saved (1820 records). [2025-10-17T22:44:03.691594] [INFO ] [MAIN ] RLI: Loaded 35031 primary data records. [2025-10-17T22:44:03.724799] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-10-17T22:44:03.762703] [INFO ] [MAIN ] Derivative Progress: 1566/2083 symbols completed. RKT took 1.7s. Estimated remaining: 3m 16s. Rate: 158.1 symbols/min [2025-10-17T22:44:03.922275] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:04.219975] [DEBUG] [MAIN ] RL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:04.220905] [INFO ] [MAIN ] RL: Generated 1820 derivative records from 40561 primary records. [2025-10-17T22:44:04.234785] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-10-17T22:44:04.236586] [DEBUG] [LOCAL ] RLJ: Loaded 48741 existing records from primary storage. [2025-10-17T22:44:04.237105] [INFO ] [MAIN ] RLJ: Loaded 48741 primary data records. [2025-10-17T22:44:04.288270] [DEBUG] [LOCAL ] RL: Derivative data saved (1820 records). [2025-10-17T22:44:04.315571] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-10-17T22:44:04.329024] [INFO ] [MAIN ] Derivative Progress: 1567/2083 symbols completed. RL took 1.0s. Estimated remaining: 3m 16s. Rate: 158.1 symbols/min [2025-10-17T22:44:04.355697] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:04.576241] [DEBUG] [MAIN ] RLI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:04.578073] [DEBUG] [LOCAL ] RLTY: Loaded 11297 existing records from primary storage. [2025-10-17T22:44:04.578401] [INFO ] [MAIN ] RLTY: Loaded 11297 primary data records. [2025-10-17T22:44:04.602852] [INFO ] [MAIN ] RLI: Generated 1820 derivative records from 35031 primary records. [2025-10-17T22:44:04.618289] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-10-17T22:44:04.723449] [DEBUG] [LOCAL ] RLI: Derivative data saved (1820 records). [2025-10-17T22:44:04.779351] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-10-17T22:44:04.879548] [INFO ] [MAIN ] Derivative Progress: 1568/2083 symbols completed. RLI took 1.4s. Estimated remaining: 3m 16s. Rate: 158.1 symbols/min [2025-10-17T22:44:04.898573] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:04.918370] [DEBUG] [MAIN ] RLJ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:04.919688] [INFO ] [MAIN ] RLJ: Generated 1820 derivative records from 48741 primary records. [2025-10-17T22:44:04.919920] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-10-17T22:44:04.937310] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1820 records). [2025-10-17T22:44:04.937436] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-10-17T22:44:04.939392] [INFO ] [MAIN ] Derivative Progress: 1569/2083 symbols completed. RLJ took 1.0s. Estimated remaining: 3m 15s. Rate: 158.1 symbols/min [2025-10-17T22:44:04.939687] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:04.973756] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:04.974681] [DEBUG] [LOCAL ] RM: Loaded 7642 existing records from primary storage. [2025-10-17T22:44:04.975415] [INFO ] [MAIN ] RLTY: Generated 1820 derivative records from 11297 primary records. [2025-10-17T22:44:04.975639] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-10-17T22:44:04.975547] [INFO ] [MAIN ] RM: Loaded 7642 primary data records. [2025-10-17T22:44:05.062344] [DEBUG] [LOCAL ] RLX: Loaded 48812 existing records from primary storage. [2025-10-17T22:44:05.075332] [INFO ] [MAIN ] RLX: Loaded 48812 primary data records. [2025-10-17T22:44:05.210514] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1820 records). [2025-10-17T22:44:05.385933] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-10-17T22:44:05.396491] [INFO ] [MAIN ] Derivative Progress: 1570/2083 symbols completed. RLTY took 1.0s. Estimated remaining: 3m 15s. Rate: 158.1 symbols/min [2025-10-17T22:44:05.412249] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:05.644228] [DEBUG] [LOCAL ] RMAX: Loaded 21894 existing records from primary storage. [2025-10-17T22:44:05.645303] [INFO ] [MAIN ] RMAX: Loaded 21894 primary data records. [2025-10-17T22:44:05.788568] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:05.839714] [INFO ] [MAIN ] RM: Generated 1820 derivative records from 7642 primary records. [2025-10-17T22:44:05.950131] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-10-17T22:44:05.978956] [DEBUG] [LOCAL ] RM: Derivative data saved (1820 records). [2025-10-17T22:44:05.992309] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-10-17T22:44:05.994502] [INFO ] [MAIN ] Derivative Progress: 1571/2083 symbols completed. RM took 1.1s. Estimated remaining: 3m 14s. Rate: 158.1 symbols/min [2025-10-17T22:44:05.992243] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:05.994966] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:05.995916] [INFO ] [MAIN ] RLX: Generated 1820 derivative records from 48812 primary records. [2025-10-17T22:44:05.996010] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-10-17T22:44:06.014456] [DEBUG] [LOCAL ] RLX: Derivative data saved (1820 records). [2025-10-17T22:44:06.014835] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-10-17T22:44:06.017164] [INFO ] [MAIN ] Derivative Progress: 1572/2083 symbols completed. RLX took 1.1s. Estimated remaining: 3m 14s. Rate: 158.2 symbols/min [2025-10-17T22:44:06.017430] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:06.039875] [DEBUG] [LOCAL ] RMI: Loaded 4804 existing records from primary storage. [2025-10-17T22:44:06.039703] [DEBUG] [MAIN ] RMAX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:06.040697] [INFO ] [MAIN ] RMAX: Generated 1820 derivative records from 21894 primary records. [2025-10-17T22:44:06.040819] [INFO ] [MAIN ] RMI: Loaded 4804 primary data records. [2025-10-17T22:44:06.041030] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-10-17T22:44:06.178682] [DEBUG] [LOCAL ] RMD: Loaded 42676 existing records from primary storage. [2025-10-17T22:44:06.196408] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1820 records). [2025-10-17T22:44:06.228765] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-10-17T22:44:06.220146] [INFO ] [MAIN ] RMD: Loaded 42676 primary data records. [2025-10-17T22:44:06.241973] [INFO ] [MAIN ] Derivative Progress: 1573/2083 symbols completed. RMAX took 0.8s. Estimated remaining: 3m 13s. Rate: 158.2 symbols/min [2025-10-17T22:44:06.691908] [DEBUG] [MAIN ] RMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:06.692847] [INFO ] [MAIN ] RMI: Generated 1820 derivative records from 4804 primary records. [2025-10-17T22:44:06.692960] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-10-17T22:44:06.709442] [DEBUG] [LOCAL ] RMI: Derivative data saved (1820 records). [2025-10-17T22:44:06.709758] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-10-17T22:44:06.711833] [INFO ] [MAIN ] Derivative Progress: 1574/2083 symbols completed. RMI took 0.7s. Estimated remaining: 3m 13s. Rate: 158.2 symbols/min [2025-10-17T22:44:06.729423] [DEBUG] [MAIN ] RMD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:06.730051] [INFO ] [MAIN ] RMD: Generated 1820 derivative records from 42676 primary records. [2025-10-17T22:44:06.730112] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-10-17T22:44:06.745669] [DEBUG] [LOCAL ] RMD: Derivative data saved (1820 records). [2025-10-17T22:44:06.745734] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-10-17T22:44:06.747825] [INFO ] [MAIN ] Derivative Progress: 1575/2083 symbols completed. RMD took 0.8s. Estimated remaining: 3m 13s. Rate: 158.3 symbols/min [2025-10-17T22:44:06.748233] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:06.748341] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:06.748739] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:06.758282] [DEBUG] [LOCAL ] RMMZ: Loaded 4841 existing records from primary storage. [2025-10-17T22:44:06.760751] [INFO ] [MAIN ] RMMZ: Loaded 4841 primary data records. [2025-10-17T22:44:06.824672] [DEBUG] [LOCAL ] RMM: Loaded 10866 existing records from primary storage. [2025-10-17T22:44:06.845061] [INFO ] [MAIN ] RMM: Loaded 10866 primary data records. [2025-10-17T22:44:06.898132] [DEBUG] [LOCAL ] RMT: Loaded 17753 existing records from primary storage. [2025-10-17T22:44:06.919121] [INFO ] [MAIN ] RMT: Loaded 17753 primary data records. [2025-10-17T22:44:07.736866] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:07.738050] [INFO ] [MAIN ] RMMZ: Generated 1820 derivative records from 4841 primary records. [2025-10-17T22:44:07.738268] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-10-17T22:44:07.756535] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1820 records). [2025-10-17T22:44:07.756707] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-10-17T22:44:07.759043] [INFO ] [MAIN ] Derivative Progress: 1576/2083 symbols completed. RMMZ took 1.0s. Estimated remaining: 3m 12s. Rate: 158.1 symbols/min [2025-10-17T22:44:07.760177] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:07.775543] [DEBUG] [MAIN ] RMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:07.776556] [INFO ] [MAIN ] RMM: Generated 1820 derivative records from 10866 primary records. [2025-10-17T22:44:07.788613] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-10-17T22:44:07.797305] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:07.801838] [INFO ] [MAIN ] RMT: Generated 1820 derivative records from 17753 primary records. [2025-10-17T22:44:07.801930] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-17T22:44:07.822860] [DEBUG] [LOCAL ] RMT: Derivative data saved (1820 records). [2025-10-17T22:44:07.823408] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-10-17T22:44:07.825901] [INFO ] [MAIN ] Derivative Progress: 1577/2083 symbols completed. RMT took 1.1s. Estimated remaining: 3m 12s. Rate: 158.2 symbols/min [2025-10-17T22:44:07.826920] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:07.826693] [DEBUG] [LOCAL ] RMM: Derivative data saved (1820 records). [2025-10-17T22:44:07.827675] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-10-17T22:44:07.830020] [INFO ] [MAIN ] Derivative Progress: 1578/2083 symbols completed. RMM took 1.1s. Estimated remaining: 3m 11s. Rate: 158.3 symbols/min [2025-10-17T22:44:07.830495] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:07.868455] [DEBUG] [LOCAL ] RNG: Loaded 48827 existing records from primary storage. [2025-10-17T22:44:07.875506] [DEBUG] [LOCAL ] RNGR: Loaded 21011 existing records from primary storage. [2025-10-17T22:44:07.875196] [INFO ] [MAIN ] RNG: Loaded 48827 primary data records. [2025-10-17T22:44:07.875699] [INFO ] [MAIN ] RNGR: Loaded 21011 primary data records. [2025-10-17T22:44:07.970727] [DEBUG] [LOCAL ] RNP: Loaded 16390 existing records from primary storage. [2025-10-17T22:44:08.009237] [INFO ] [MAIN ] RNP: Loaded 16390 primary data records. [2025-10-17T22:44:08.810944] [DEBUG] [MAIN ] RNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:08.813238] [INFO ] [MAIN ] RNG: Generated 1820 derivative records from 48827 primary records. [2025-10-17T22:44:08.814193] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-10-17T22:44:08.837019] [DEBUG] [MAIN ] RNGR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:08.840979] [INFO ] [MAIN ] RNGR: Generated 1820 derivative records from 21011 primary records. [2025-10-17T22:44:08.843327] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-10-17T22:44:08.872936] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:08.876297] [INFO ] [MAIN ] RNP: Generated 1820 derivative records from 16390 primary records. [2025-10-17T22:44:08.873838] [DEBUG] [LOCAL ] RNG: Derivative data saved (1820 records). [2025-10-17T22:44:08.877107] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-10-17T22:44:08.877209] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-17T22:44:08.879879] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1820 records). [2025-10-17T22:44:08.879478] [INFO ] [MAIN ] Derivative Progress: 1579/2083 symbols completed. RNG took 1.1s. Estimated remaining: 3m 11s. Rate: 158.1 symbols/min [2025-10-17T22:44:08.880482] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-10-17T22:44:08.880612] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:08.890023] [INFO ] [MAIN ] Derivative Progress: 1580/2083 symbols completed. RNGR took 1.1s. Estimated remaining: 3m 11s. Rate: 158.2 symbols/min [2025-10-17T22:44:08.891736] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:08.901213] [DEBUG] [LOCAL ] RNP: Derivative data saved (1820 records). [2025-10-17T22:44:08.901406] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-10-17T22:44:08.903532] [INFO ] [MAIN ] Derivative Progress: 1581/2083 symbols completed. RNP took 1.1s. Estimated remaining: 3m 10s. Rate: 158.3 symbols/min [2025-10-17T22:44:08.903955] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:08.945291] [DEBUG] [LOCAL ] RNST: Loaded 36994 existing records from primary storage. [2025-10-17T22:44:08.945504] [INFO ] [MAIN ] RNST: Loaded 36994 primary data records. [2025-10-17T22:44:08.998192] [DEBUG] [LOCAL ] ROG: Loaded 22472 existing records from primary storage. [2025-10-17T22:44:09.043060] [DEBUG] [LOCAL ] RNR: Loaded 34313 existing records from primary storage. [2025-10-17T22:44:09.048332] [INFO ] [MAIN ] ROG: Loaded 22472 primary data records. [2025-10-17T22:44:09.065424] [INFO ] [MAIN ] RNR: Loaded 34313 primary data records. [2025-10-17T22:44:09.915895] [DEBUG] [MAIN ] RNST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:09.917762] [INFO ] [MAIN ] RNST: Generated 1820 derivative records from 36994 primary records. [2025-10-17T22:44:09.918755] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-10-17T22:44:09.953507] [DEBUG] [LOCAL ] RNST: Derivative data saved (1820 records). [2025-10-17T22:44:09.945428] [DEBUG] [MAIN ] ROG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:09.953779] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-10-17T22:44:09.955963] [INFO ] [MAIN ] Derivative Progress: 1582/2083 symbols completed. RNST took 1.1s. Estimated remaining: 3m 10s. Rate: 158.1 symbols/min [2025-10-17T22:44:09.956782] [INFO ] [MAIN ] ROG: Generated 1820 derivative records from 22472 primary records. [2025-10-17T22:44:09.957137] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-10-17T22:44:09.957311] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:09.971971] [DEBUG] [MAIN ] RNR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:09.984115] [INFO ] [MAIN ] RNR: Generated 1820 derivative records from 34313 primary records. [2025-10-17T22:44:09.984727] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-10-17T22:44:10.004324] [DEBUG] [LOCAL ] RNR: Derivative data saved (1820 records). [2025-10-17T22:44:10.006422] [DEBUG] [LOCAL ] ROG: Derivative data saved (1820 records). [2025-10-17T22:44:10.005475] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-10-17T22:44:10.008773] [INFO ] [MAIN ] Derivative Progress: 1583/2083 symbols completed. RNR took 1.1s. Estimated remaining: 3m 10s. Rate: 158.2 symbols/min [2025-10-17T22:44:10.008880] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-10-17T22:44:10.011277] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:10.011521] [INFO ] [MAIN ] Derivative Progress: 1584/2083 symbols completed. ROG took 1.1s. Estimated remaining: 3m 9s. Rate: 158.3 symbols/min [2025-10-17T22:44:10.012205] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:10.059409] [DEBUG] [LOCAL ] ROK: Loaded 43878 existing records from primary storage. [2025-10-17T22:44:10.071429] [INFO ] [MAIN ] ROK: Loaded 43878 primary data records. [2025-10-17T22:44:10.276116] [DEBUG] [LOCAL ] RPM: Loaded 42595 existing records from primary storage. [2025-10-17T22:44:10.287027] [INFO ] [MAIN ] RPM: Loaded 42595 primary data records. [2025-10-17T22:44:10.277624] [DEBUG] [LOCAL ] ROL: Loaded 51102 existing records from primary storage. [2025-10-17T22:44:10.493314] [INFO ] [MAIN ] ROL: Loaded 51102 primary data records. [2025-10-17T22:44:11.120255] [DEBUG] [MAIN ] ROK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:11.123258] [INFO ] [MAIN ] ROK: Generated 1820 derivative records from 43878 primary records. [2025-10-17T22:44:11.123760] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-10-17T22:44:11.140852] [DEBUG] [LOCAL ] ROK: Derivative data saved (1820 records). [2025-10-17T22:44:11.141138] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-10-17T22:44:11.143036] [INFO ] [MAIN ] Derivative Progress: 1585/2083 symbols completed. ROK took 1.2s. Estimated remaining: 3m 9s. Rate: 158.1 symbols/min [2025-10-17T22:44:11.143533] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:11.164011] [DEBUG] [MAIN ] ROL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:11.177123] [INFO ] [MAIN ] ROL: Generated 1820 derivative records from 51102 primary records. [2025-10-17T22:44:11.182378] [DEBUG] [MAIN ] RPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:11.182071] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-10-17T22:44:11.183917] [INFO ] [MAIN ] RPM: Generated 1820 derivative records from 42595 primary records. [2025-10-17T22:44:11.184088] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-10-17T22:44:11.199336] [DEBUG] [LOCAL ] RPT: Loaded 19322 existing records from primary storage. [2025-10-17T22:44:11.213042] [INFO ] [MAIN ] RPT: Loaded 19322 primary data records. [2025-10-17T22:44:11.213961] [DEBUG] [LOCAL ] ROL: Derivative data saved (1820 records). [2025-10-17T22:44:11.226261] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-10-17T22:44:11.257457] [INFO ] [MAIN ] Derivative Progress: 1586/2083 symbols completed. ROL took 1.2s. Estimated remaining: 3m 9s. Rate: 158.2 symbols/min [2025-10-17T22:44:11.254617] [DEBUG] [LOCAL ] RPM: Derivative data saved (1820 records). [2025-10-17T22:44:11.298884] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-10-17T22:44:11.292157] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:11.300941] [INFO ] [MAIN ] Derivative Progress: 1587/2083 symbols completed. RPM took 1.3s. Estimated remaining: 3m 8s. Rate: 158.3 symbols/min [2025-10-17T22:44:11.312284] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:11.560943] [DEBUG] [LOCAL ] RQI: Loaded 29541 existing records from primary storage. [2025-10-17T22:44:11.561742] [INFO ] [MAIN ] RQI: Loaded 29541 primary data records. [2025-10-17T22:44:11.699536] [DEBUG] [LOCAL ] RRC: Loaded 53680 existing records from primary storage. [2025-10-17T22:44:11.721053] [INFO ] [MAIN ] RRC: Loaded 53680 primary data records. [2025-10-17T22:44:12.066359] [DEBUG] [MAIN ] RPT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:12.087095] [INFO ] [MAIN ] RPT: Generated 1820 derivative records from 19322 primary records. [2025-10-17T22:44:12.087309] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-10-17T22:44:12.231225] [DEBUG] [LOCAL ] RPT: Derivative data saved (1820 records). [2025-10-17T22:44:12.234017] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-10-17T22:44:12.236441] [INFO ] [MAIN ] Derivative Progress: 1588/2083 symbols completed. RPT took 1.1s. Estimated remaining: 3m 8s. Rate: 158.1 symbols/min [2025-10-17T22:44:12.249778] [DEBUG] [MAIN ] RQI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:12.250572] [INFO ] [MAIN ] RQI: Generated 1820 derivative records from 29541 primary records. [2025-10-17T22:44:12.250840] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-10-17T22:44:12.268256] [DEBUG] [LOCAL ] RQI: Derivative data saved (1820 records). [2025-10-17T22:44:12.269052] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-10-17T22:44:12.271713] [INFO ] [MAIN ] Derivative Progress: 1589/2083 symbols completed. RQI took 1.0s. Estimated remaining: 3m 7s. Rate: 158.2 symbols/min [2025-10-17T22:44:12.284397] [DEBUG] [MAIN ] RRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:12.284972] [INFO ] [MAIN ] RRC: Generated 1820 derivative records from 53680 primary records. [2025-10-17T22:44:12.285031] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-10-17T22:44:12.300036] [DEBUG] [LOCAL ] RRC: Derivative data saved (1820 records). [2025-10-17T22:44:12.300095] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-10-17T22:44:12.302011] [INFO ] [MAIN ] Derivative Progress: 1590/2083 symbols completed. RRC took 1.0s. Estimated remaining: 3m 7s. Rate: 158.3 symbols/min [2025-10-17T22:44:12.302706] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:12.302579] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:12.302664] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:12.310408] [DEBUG] [LOCAL ] RSF: Loaded 4371 existing records from primary storage. [2025-10-17T22:44:12.310761] [INFO ] [MAIN ] RSF: Loaded 4371 primary data records. [2025-10-17T22:44:12.510712] [DEBUG] [LOCAL ] RS: Loaded 25141 existing records from primary storage. [2025-10-17T22:44:12.623978] [INFO ] [MAIN ] RS: Loaded 25141 primary data records. [2025-10-17T22:44:12.739956] [DEBUG] [LOCAL ] RRX: Loaded 41654 existing records from primary storage. [2025-10-17T22:44:12.746139] [INFO ] [MAIN ] RRX: Loaded 41654 primary data records. [2025-10-17T22:44:13.342071] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:13.344168] [INFO ] [MAIN ] RSF: Generated 1820 derivative records from 4371 primary records. [2025-10-17T22:44:13.345771] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-17T22:44:13.364606] [DEBUG] [LOCAL ] RSF: Derivative data saved (1820 records). [2025-10-17T22:44:13.365260] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-10-17T22:44:13.367788] [INFO ] [MAIN ] Derivative Progress: 1591/2083 symbols completed. RSF took 1.1s. Estimated remaining: 3m 7s. Rate: 158.1 symbols/min [2025-10-17T22:44:13.368109] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:13.394958] [DEBUG] [MAIN ] RS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:13.396137] [INFO ] [MAIN ] RS: Generated 1820 derivative records from 25141 primary records. [2025-10-17T22:44:13.396372] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-10-17T22:44:13.433308] [DEBUG] [LOCAL ] RS: Derivative data saved (1820 records). [2025-10-17T22:44:13.433959] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-10-17T22:44:13.436543] [INFO ] [MAIN ] Derivative Progress: 1592/2083 symbols completed. RS took 1.1s. Estimated remaining: 3m 6s. Rate: 158.2 symbols/min [2025-10-17T22:44:13.436791] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:13.433689] [DEBUG] [MAIN ] RRX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:13.438423] [INFO ] [MAIN ] RRX: Generated 1820 derivative records from 41654 primary records. [2025-10-17T22:44:13.452132] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-10-17T22:44:13.470454] [DEBUG] [LOCAL ] RRX: Derivative data saved (1820 records). [2025-10-17T22:44:13.470791] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-10-17T22:44:13.477606] [INFO ] [MAIN ] Derivative Progress: 1593/2083 symbols completed. RRX took 1.2s. Estimated remaining: 3m 6s. Rate: 158.3 symbols/min [2025-10-17T22:44:13.478464] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:13.498281] [DEBUG] [LOCAL ] RSG: Loaded 48206 existing records from primary storage. [2025-10-17T22:44:13.498698] [INFO ] [MAIN ] RSG: Loaded 48206 primary data records. [2025-10-17T22:44:13.666307] [DEBUG] [LOCAL ] RSI: Loaded 47708 existing records from primary storage. [2025-10-17T22:44:13.676866] [INFO ] [MAIN ] RSI: Loaded 47708 primary data records. [2025-10-17T22:44:13.939742] [DEBUG] [LOCAL ] RSKD: Loaded 33929 existing records from primary storage. [2025-10-17T22:44:13.976361] [INFO ] [MAIN ] RSKD: Loaded 33929 primary data records. [2025-10-17T22:44:14.513053] [DEBUG] [MAIN ] RSG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:14.514789] [INFO ] [MAIN ] RSG: Generated 1820 derivative records from 48206 primary records. [2025-10-17T22:44:14.515006] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-10-17T22:44:14.550898] [DEBUG] [LOCAL ] RSG: Derivative data saved (1820 records). [2025-10-17T22:44:14.551329] [DEBUG] [MAIN ] RSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:14.552704] [INFO ] [MAIN ] RSI: Generated 1820 derivative records from 47708 primary records. [2025-10-17T22:44:14.552907] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-10-17T22:44:14.553037] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-10-17T22:44:14.555290] [INFO ] [MAIN ] Derivative Progress: 1594/2083 symbols completed. RSG took 1.2s. Estimated remaining: 3m 6s. Rate: 158.1 symbols/min [2025-10-17T22:44:14.556760] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:14.579106] [DEBUG] [LOCAL ] RSI: Derivative data saved (1820 records). [2025-10-17T22:44:14.579482] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-10-17T22:44:14.584611] [INFO ] [MAIN ] Derivative Progress: 1595/2083 symbols completed. RSI took 1.1s. Estimated remaining: 3m 5s. Rate: 158.2 symbols/min [2025-10-17T22:44:14.585252] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:14.601054] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:14.602232] [INFO ] [MAIN ] RSKD: Generated 1820 derivative records from 33929 primary records. [2025-10-17T22:44:14.602488] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-10-17T22:44:14.634375] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1820 records). [2025-10-17T22:44:14.634535] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-10-17T22:44:14.636963] [INFO ] [MAIN ] Derivative Progress: 1596/2083 symbols completed. RSKD took 1.2s. Estimated remaining: 3m 5s. Rate: 158.3 symbols/min [2025-10-17T22:44:14.637189] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:14.651416] [DEBUG] [LOCAL ] RTO: Loaded 40597 existing records from primary storage. [2025-10-17T22:44:14.651868] [INFO ] [MAIN ] RTO: Loaded 40597 primary data records. [2025-10-17T22:44:14.879667] [DEBUG] [LOCAL ] RTX: Loaded 54486 existing records from primary storage. [2025-10-17T22:44:14.989715] [INFO ] [MAIN ] RTX: Loaded 54486 primary data records. [2025-10-17T22:44:15.114437] [DEBUG] [LOCAL ] RVLV: Loaded 48144 existing records from primary storage. [2025-10-17T22:44:15.118155] [INFO ] [MAIN ] RVLV: Loaded 48144 primary data records. [2025-10-17T22:44:15.675479] [DEBUG] [MAIN ] RTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:15.676786] [INFO ] [MAIN ] RTO: Generated 1820 derivative records from 40597 primary records. [2025-10-17T22:44:15.676940] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-10-17T22:44:15.700478] [DEBUG] [LOCAL ] RTO: Derivative data saved (1820 records). [2025-10-17T22:44:15.701427] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-10-17T22:44:15.703714] [INFO ] [MAIN ] Derivative Progress: 1597/2083 symbols completed. RTO took 1.1s. Estimated remaining: 3m 4s. Rate: 158.1 symbols/min [2025-10-17T22:44:15.703983] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:15.717863] [DEBUG] [MAIN ] RTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:15.719500] [INFO ] [MAIN ] RTX: Generated 1820 derivative records from 54486 primary records. [2025-10-17T22:44:15.719764] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-10-17T22:44:15.737807] [DEBUG] [LOCAL ] RTX: Derivative data saved (1820 records). [2025-10-17T22:44:15.738119] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-10-17T22:44:15.740183] [INFO ] [MAIN ] Derivative Progress: 1598/2083 symbols completed. RTX took 1.2s. Estimated remaining: 3m 4s. Rate: 158.2 symbols/min [2025-10-17T22:44:15.740422] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:15.764271] [DEBUG] [MAIN ] RVLV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:15.764967] [INFO ] [MAIN ] RVLV: Generated 1820 derivative records from 48144 primary records. [2025-10-17T22:44:15.765079] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-10-17T22:44:15.790182] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1820 records). [2025-10-17T22:44:15.791188] [DEBUG] [LOCAL ] RVT: Loaded 26714 existing records from primary storage. [2025-10-17T22:44:15.791305] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-10-17T22:44:15.793529] [INFO ] [MAIN ] Derivative Progress: 1599/2083 symbols completed. RVLV took 1.2s. Estimated remaining: 3m 3s. Rate: 158.3 symbols/min [2025-10-17T22:44:15.793677] [INFO ] [MAIN ] RVT: Loaded 26714 primary data records. [2025-10-17T22:44:15.793789] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:16.133491] [DEBUG] [LOCAL ] RWT: Loaded 41307 existing records from primary storage. [2025-10-17T22:44:16.146131] [INFO ] [MAIN ] RWT: Loaded 41307 primary data records. [2025-10-17T22:44:16.204157] [DEBUG] [LOCAL ] RXO: Loaded 49101 existing records from primary storage. [2025-10-17T22:44:16.236859] [INFO ] [MAIN ] RXO: Loaded 49101 primary data records. [2025-10-17T22:44:16.773204] [DEBUG] [MAIN ] RVT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:16.774318] [INFO ] [MAIN ] RVT: Generated 1820 derivative records from 26714 primary records. [2025-10-17T22:44:16.774748] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-10-17T22:44:16.795514] [DEBUG] [LOCAL ] RVT: Derivative data saved (1820 records). [2025-10-17T22:44:16.796157] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-10-17T22:44:16.798685] [INFO ] [MAIN ] Derivative Progress: 1600/2083 symbols completed. RVT took 1.1s. Estimated remaining: 3m 3s. Rate: 158.1 symbols/min [2025-10-17T22:44:16.799045] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:16.818798] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:16.821452] [INFO ] [MAIN ] RWT: Generated 1820 derivative records from 41307 primary records. [2025-10-17T22:44:16.823695] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-10-17T22:44:16.852490] [DEBUG] [MAIN ] RXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:16.855585] [INFO ] [MAIN ] RXO: Generated 1820 derivative records from 49101 primary records. [2025-10-17T22:44:16.856028] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-10-17T22:44:16.859218] [DEBUG] [LOCAL ] RWT: Derivative data saved (1820 records). [2025-10-17T22:44:16.860023] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-10-17T22:44:16.872029] [INFO ] [MAIN ] Derivative Progress: 1601/2083 symbols completed. RWT took 1.1s. Estimated remaining: 3m 3s. Rate: 158.2 symbols/min [2025-10-17T22:44:16.890158] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:16.892035] [DEBUG] [LOCAL ] RXO: Derivative data saved (1820 records). [2025-10-17T22:44:16.892897] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-10-17T22:44:16.895831] [INFO ] [MAIN ] Derivative Progress: 1602/2083 symbols completed. RXO took 1.1s. Estimated remaining: 3m 2s. Rate: 158.3 symbols/min [2025-10-17T22:44:16.896242] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:16.919814] [DEBUG] [LOCAL ] RY: Loaded 48438 existing records from primary storage. [2025-10-17T22:44:16.932760] [INFO ] [MAIN ] RY: Loaded 48438 primary data records. [2025-10-17T22:44:17.046083] [DEBUG] [LOCAL ] RYI: Loaded 22046 existing records from primary storage. [2025-10-17T22:44:17.091166] [DEBUG] [LOCAL ] RYAM: Loaded 35616 existing records from primary storage. [2025-10-17T22:44:17.084214] [INFO ] [MAIN ] RYI: Loaded 22046 primary data records. [2025-10-17T22:44:17.091787] [INFO ] [MAIN ] RYAM: Loaded 35616 primary data records. [2025-10-17T22:44:18.005111] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:18.004761] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:18.006767] [INFO ] [MAIN ] RYI: Generated 1820 derivative records from 22046 primary records. [2025-10-17T22:44:18.006045] [INFO ] [MAIN ] RY: Generated 1820 derivative records from 48438 primary records. [2025-10-17T22:44:18.007160] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-10-17T22:44:18.007071] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-10-17T22:44:18.038307] [DEBUG] [LOCAL ] RYI: Derivative data saved (1820 records). [2025-10-17T22:44:18.055400] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-10-17T22:44:18.058025] [INFO ] [MAIN ] Derivative Progress: 1603/2083 symbols completed. RYI took 1.2s. Estimated remaining: 3m 2s. Rate: 158.1 symbols/min [2025-10-17T22:44:18.055275] [DEBUG] [LOCAL ] RY: Derivative data saved (1820 records). [2025-10-17T22:44:18.058567] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-10-17T22:44:18.061181] [INFO ] [MAIN ] Derivative Progress: 1604/2083 symbols completed. RY took 1.3s. Estimated remaining: 3m 2s. Rate: 158.2 symbols/min [2025-10-17T22:44:18.059033] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:18.062078] [INFO ] [MAIN ] RYAM: Generated 1820 derivative records from 35616 primary records. [2025-10-17T22:44:18.062173] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-10-17T22:44:18.079504] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1820 records). [2025-10-17T22:44:18.079715] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-10-17T22:44:18.083830] [INFO ] [MAIN ] Derivative Progress: 1605/2083 symbols completed. RYAM took 1.2s. Estimated remaining: 3m 1s. Rate: 158.3 symbols/min [2025-10-17T22:44:18.084462] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:18.084616] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:18.084372] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:18.102423] [DEBUG] [LOCAL ] RZB: Loaded 6031 existing records from primary storage. [2025-10-17T22:44:18.106486] [INFO ] [MAIN ] RZB: Loaded 6031 primary data records. [2025-10-17T22:44:18.106384] [DEBUG] [LOCAL ] RZC: Loaded 6724 existing records from primary storage. [2025-10-17T22:44:18.112022] [INFO ] [MAIN ] RZC: Loaded 6724 primary data records. [2025-10-17T22:44:18.764347] [DEBUG] [LOCAL ] RYN: Loaded 46269 existing records from primary storage. [2025-10-17T22:44:18.766201] [INFO ] [MAIN ] RYN: Loaded 46269 primary data records. [2025-10-17T22:44:19.190386] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:19.191674] [INFO ] [MAIN ] RZB: Generated 1820 derivative records from 6031 primary records. [2025-10-17T22:44:19.194601] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-10-17T22:44:19.230630] [DEBUG] [LOCAL ] RZB: Derivative data saved (1820 records). [2025-10-17T22:44:19.232767] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:19.233760] [INFO ] [MAIN ] RZC: Generated 1820 derivative records from 6724 primary records. [2025-10-17T22:44:19.232406] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-10-17T22:44:19.237523] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-17T22:44:19.237172] [INFO ] [MAIN ] Derivative Progress: 1606/2083 symbols completed. RZB took 1.2s. Estimated remaining: 3m 1s. Rate: 158.1 symbols/min [2025-10-17T22:44:19.238394] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:19.256049] [DEBUG] [LOCAL ] RZC: Derivative data saved (1820 records). [2025-10-17T22:44:19.256386] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-17T22:44:19.258630] [INFO ] [MAIN ] Derivative Progress: 1607/2083 symbols completed. RZC took 1.2s. Estimated remaining: 3m 1s. Rate: 158.2 symbols/min [2025-10-17T22:44:19.258933] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:19.275939] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:19.276633] [INFO ] [MAIN ] RYN: Generated 1820 derivative records from 46269 primary records. [2025-10-17T22:44:19.276884] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-10-17T22:44:19.293471] [DEBUG] [LOCAL ] RYN: Derivative data saved (1820 records). [2025-10-17T22:44:19.293669] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-10-17T22:44:19.295620] [INFO ] [MAIN ] Derivative Progress: 1608/2083 symbols completed. RYN took 1.2s. Estimated remaining: 3m 0s. Rate: 158.3 symbols/min [2025-10-17T22:44:19.295927] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:19.332395] [DEBUG] [LOCAL ] SABA: Loaded 9397 existing records from primary storage. [2025-10-17T22:44:19.333379] [INFO ] [MAIN ] SABA: Loaded 9397 primary data records. [2025-10-17T22:44:19.424542] [DEBUG] [LOCAL ] S: Loaded 54316 existing records from primary storage. [2025-10-17T22:44:19.442458] [INFO ] [MAIN ] S: Loaded 54316 primary data records. [2025-10-17T22:44:19.453373] [DEBUG] [LOCAL ] SA: Loaded 45114 existing records from primary storage. [2025-10-17T22:44:19.475675] [INFO ] [MAIN ] SA: Loaded 45114 primary data records. [2025-10-17T22:44:20.276875] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:20.278697] [INFO ] [MAIN ] SABA: Generated 1820 derivative records from 9397 primary records. [2025-10-17T22:44:20.279032] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-17T22:44:20.302210] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:20.310118] [DEBUG] [LOCAL ] SABA: Derivative data saved (1820 records). [2025-10-17T22:44:20.311160] [INFO ] [MAIN ] S: Generated 1820 derivative records from 54316 primary records. [2025-10-17T22:44:20.311405] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-17T22:44:20.311527] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-17T22:44:20.313590] [INFO ] [MAIN ] Derivative Progress: 1609/2083 symbols completed. SABA took 1.0s. Estimated remaining: 2m 60s. Rate: 158.1 symbols/min [2025-10-17T22:44:20.314750] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:20.339752] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:20.344603] [DEBUG] [LOCAL ] S: Derivative data saved (1820 records). [2025-10-17T22:44:20.345483] [INFO ] [MAIN ] SA: Generated 1820 derivative records from 45114 primary records. [2025-10-17T22:44:20.345699] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-17T22:44:20.345796] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-17T22:44:20.348137] [INFO ] [MAIN ] Derivative Progress: 1610/2083 symbols completed. S took 1.1s. Estimated remaining: 2m 59s. Rate: 158.2 symbols/min [2025-10-17T22:44:20.348789] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:20.365026] [DEBUG] [LOCAL ] SA: Derivative data saved (1820 records). [2025-10-17T22:44:20.365209] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-17T22:44:20.367402] [INFO ] [MAIN ] Derivative Progress: 1611/2083 symbols completed. SA took 1.1s. Estimated remaining: 2m 59s. Rate: 158.3 symbols/min [2025-10-17T22:44:20.367672] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:20.398266] [DEBUG] [LOCAL ] SAH: Loaded 21442 existing records from primary storage. [2025-10-17T22:44:20.399371] [INFO ] [MAIN ] SAH: Loaded 21442 primary data records. [2025-10-17T22:44:20.463211] [DEBUG] [LOCAL ] SAFE: Loaded 30751 existing records from primary storage. [2025-10-17T22:44:20.492624] [DEBUG] [LOCAL ] SAM: Loaded 21607 existing records from primary storage. [2025-10-17T22:44:20.499508] [INFO ] [MAIN ] SAM: Loaded 21607 primary data records. [2025-10-17T22:44:20.520836] [INFO ] [MAIN ] SAFE: Loaded 30751 primary data records. [2025-10-17T22:44:21.424100] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:21.425451] [INFO ] [MAIN ] SAH: Generated 1820 derivative records from 21442 primary records. [2025-10-17T22:44:21.426546] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-17T22:44:21.472272] [DEBUG] [LOCAL ] SAH: Derivative data saved (1820 records). [2025-10-17T22:44:21.472569] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-17T22:44:21.472943] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:21.474111] [INFO ] [MAIN ] SAFE: Generated 1820 derivative records from 30751 primary records. [2025-10-17T22:44:21.473274] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:21.476303] [INFO ] [MAIN ] Derivative Progress: 1612/2083 symbols completed. SAH took 1.1s. Estimated remaining: 2m 59s. Rate: 158.1 symbols/min [2025-10-17T22:44:21.474301] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-17T22:44:21.477340] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:21.477191] [INFO ] [MAIN ] SAM: Generated 1820 derivative records from 21607 primary records. [2025-10-17T22:44:21.478470] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-17T22:44:21.495965] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1820 records). [2025-10-17T22:44:21.503691] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-17T22:44:21.512106] [INFO ] [MAIN ] Derivative Progress: 1613/2083 symbols completed. SAFE took 1.2s. Estimated remaining: 2m 58s. Rate: 158.2 symbols/min [2025-10-17T22:44:21.514367] [DEBUG] [LOCAL ] SAM: Derivative data saved (1820 records). [2025-10-17T22:44:21.514566] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-17T22:44:21.516758] [INFO ] [MAIN ] Derivative Progress: 1614/2083 symbols completed. SAM took 1.1s. Estimated remaining: 2m 58s. Rate: 158.3 symbols/min [2025-10-17T22:44:21.517010] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:21.514508] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:21.593985] [DEBUG] [LOCAL ] SAN: Loaded 53738 existing records from primary storage. [2025-10-17T22:44:21.607510] [INFO ] [MAIN ] SAN: Loaded 53738 primary data records. [2025-10-17T22:44:21.608342] [DEBUG] [LOCAL ] SAP: Loaded 50604 existing records from primary storage. [2025-10-17T22:44:21.641396] [INFO ] [MAIN ] SAP: Loaded 50604 primary data records. [2025-10-17T22:44:21.774697] [DEBUG] [LOCAL ] SAND: Loaded 52633 existing records from primary storage. [2025-10-17T22:44:21.825141] [INFO ] [MAIN ] SAND: Loaded 52633 primary data records. [2025-10-17T22:44:22.582686] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:22.583709] [INFO ] [MAIN ] SAN: Generated 1820 derivative records from 53738 primary records. [2025-10-17T22:44:22.584621] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-17T22:44:22.628576] [DEBUG] [LOCAL ] SAN: Derivative data saved (1820 records). [2025-10-17T22:44:22.628947] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-17T22:44:22.631061] [INFO ] [MAIN ] Derivative Progress: 1615/2083 symbols completed. SAN took 1.2s. Estimated remaining: 2m 58s. Rate: 158.1 symbols/min [2025-10-17T22:44:22.629221] [DEBUG] [MAIN ] SAND: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:22.632299] [INFO ] [MAIN ] SAND: Generated 1820 derivative records from 52633 primary records. [2025-10-17T22:44:22.631275] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:22.632686] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:22.633298] [INFO ] [MAIN ] SAP: Generated 1820 derivative records from 50604 primary records. [2025-10-17T22:44:22.633694] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-10-17T22:44:22.634143] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-17T22:44:22.663437] [DEBUG] [LOCAL ] SAP: Derivative data saved (1820 records). [2025-10-17T22:44:22.664599] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-17T22:44:22.666769] [INFO ] [MAIN ] Derivative Progress: 1616/2083 symbols completed. SAP took 1.1s. Estimated remaining: 2m 57s. Rate: 158.2 symbols/min [2025-10-17T22:44:22.673342] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:22.683049] [DEBUG] [LOCAL ] SAND: Derivative data saved (1820 records). [2025-10-17T22:44:22.683245] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-10-17T22:44:22.684151] [DEBUG] [LOCAL ] SAR: Loaded 17471 existing records from primary storage. [2025-10-17T22:44:22.686189] [INFO ] [MAIN ] Derivative Progress: 1617/2083 symbols completed. SAND took 1.2s. Estimated remaining: 2m 57s. Rate: 158.3 symbols/min [2025-10-17T22:44:22.686392] [INFO ] [MAIN ] SAR: Loaded 17471 primary data records. [2025-10-17T22:44:22.686563] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:23.038044] [DEBUG] [LOCAL ] SB: Loaded 33292 existing records from primary storage. [2025-10-17T22:44:23.039355] [INFO ] [MAIN ] SB: Loaded 33292 primary data records. [2025-10-17T22:44:23.039268] [DEBUG] [LOCAL ] SARO: Loaded 49102 existing records from primary storage. [2025-10-17T22:44:23.050687] [INFO ] [MAIN ] SARO: Loaded 49102 primary data records. [2025-10-17T22:44:23.693293] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:23.694433] [INFO ] [MAIN ] SAR: Generated 1820 derivative records from 17471 primary records. [2025-10-17T22:44:23.694560] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-17T22:44:23.727927] [DEBUG] [LOCAL ] SAR: Derivative data saved (1820 records). [2025-10-17T22:44:23.728258] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-17T22:44:23.728463] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:23.731472] [INFO ] [MAIN ] Derivative Progress: 1618/2083 symbols completed. SAR took 1.1s. Estimated remaining: 2m 56s. Rate: 158.1 symbols/min [2025-10-17T22:44:23.729228] [INFO ] [MAIN ] SB: Generated 1820 derivative records from 33292 primary records. [2025-10-17T22:44:23.731837] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-17T22:44:23.751090] [DEBUG] [LOCAL ] SB: Derivative data saved (1820 records). [2025-10-17T22:44:23.764052] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-17T22:44:23.763985] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:23.764958] [INFO ] [MAIN ] SARO: Generated 1820 derivative records from 49102 primary records. [2025-10-17T22:44:23.767002] [INFO ] [MAIN ] Derivative Progress: 1619/2083 symbols completed. SB took 1.1s. Estimated remaining: 2m 56s. Rate: 158.2 symbols/min [2025-10-17T22:44:23.765055] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-17T22:44:23.782413] [DEBUG] [LOCAL ] SARO: Derivative data saved (1820 records). [2025-10-17T22:44:23.782477] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-17T22:44:23.785114] [INFO ] [MAIN ] Derivative Progress: 1620/2083 symbols completed. SARO took 1.1s. Estimated remaining: 2m 56s. Rate: 158.3 symbols/min [2025-10-17T22:44:23.785544] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:23.785480] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:23.785619] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:23.802176] [DEBUG] [LOCAL ] SBR: Loaded 7937 existing records from primary storage. [2025-10-17T22:44:23.801838] [DEBUG] [LOCAL ] SBI: Loaded 7760 existing records from primary storage. [2025-10-17T22:44:23.802386] [INFO ] [MAIN ] SBR: Loaded 7937 primary data records. [2025-10-17T22:44:23.802330] [INFO ] [MAIN ] SBI: Loaded 7760 primary data records. [2025-10-17T22:44:24.429820] [DEBUG] [LOCAL ] SBH: Loaded 50615 existing records from primary storage. [2025-10-17T22:44:24.430150] [INFO ] [MAIN ] SBH: Loaded 50615 primary data records. [2025-10-17T22:44:24.757021] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:24.770201] [INFO ] [MAIN ] SBI: Generated 1820 derivative records from 7760 primary records. [2025-10-17T22:44:24.771117] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-17T22:44:24.771779] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:24.773102] [INFO ] [MAIN ] SBR: Generated 1820 derivative records from 7937 primary records. [2025-10-17T22:44:24.780578] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-17T22:44:24.799179] [DEBUG] [LOCAL ] SBI: Derivative data saved (1820 records). [2025-10-17T22:44:24.799737] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-17T22:44:24.803719] [DEBUG] [LOCAL ] SBR: Derivative data saved (1820 records). [2025-10-17T22:44:24.805909] [INFO ] [MAIN ] Derivative Progress: 1621/2083 symbols completed. SBI took 1.0s. Estimated remaining: 2m 55s. Rate: 158.1 symbols/min [2025-10-17T22:44:24.806296] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-17T22:44:24.806437] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:24.809886] [INFO ] [MAIN ] Derivative Progress: 1622/2083 symbols completed. SBR took 1.0s. Estimated remaining: 2m 55s. Rate: 158.2 symbols/min [2025-10-17T22:44:24.810298] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:24.828847] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:24.829701] [INFO ] [MAIN ] SBH: Generated 1820 derivative records from 50615 primary records. [2025-10-17T22:44:24.829872] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-17T22:44:24.856542] [DEBUG] [LOCAL ] SBH: Derivative data saved (1820 records). [2025-10-17T22:44:24.856808] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-17T22:44:24.857129] [DEBUG] [LOCAL ] SBSI: Loaded 15203 existing records from primary storage. [2025-10-17T22:44:24.859139] [INFO ] [MAIN ] SBSI: Loaded 15203 primary data records. [2025-10-17T22:44:24.858995] [INFO ] [MAIN ] Derivative Progress: 1623/2083 symbols completed. SBH took 1.1s. Estimated remaining: 2m 54s. Rate: 158.3 symbols/min [2025-10-17T22:44:24.895760] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:25.036448] [DEBUG] [LOCAL ] SBS: Loaded 50057 existing records from primary storage. [2025-10-17T22:44:25.065425] [INFO ] [MAIN ] SBS: Loaded 50057 primary data records. [2025-10-17T22:44:25.423988] [DEBUG] [LOCAL ] SBSW: Loaded 53952 existing records from primary storage. [2025-10-17T22:44:25.428006] [INFO ] [MAIN ] SBSW: Loaded 53952 primary data records. [2025-10-17T22:44:25.876428] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:25.878608] [INFO ] [MAIN ] SBSI: Generated 1820 derivative records from 15203 primary records. [2025-10-17T22:44:25.879409] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-17T22:44:25.897119] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1820 records). [2025-10-17T22:44:25.897685] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-17T22:44:25.899881] [INFO ] [MAIN ] Derivative Progress: 1624/2083 symbols completed. SBSI took 1.1s. Estimated remaining: 2m 54s. Rate: 158.1 symbols/min [2025-10-17T22:44:25.900977] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:25.917131] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:25.918171] [INFO ] [MAIN ] SBS: Generated 1820 derivative records from 50057 primary records. [2025-10-17T22:44:25.918390] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-17T22:44:25.934730] [DEBUG] [LOCAL ] SBS: Derivative data saved (1820 records). [2025-10-17T22:44:25.934961] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-17T22:44:25.937231] [INFO ] [MAIN ] Derivative Progress: 1625/2083 symbols completed. SBS took 1.1s. Estimated remaining: 2m 54s. Rate: 158.2 symbols/min [2025-10-17T22:44:25.937584] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:25.955426] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:25.956175] [INFO ] [MAIN ] SBSW: Generated 1820 derivative records from 53952 primary records. [2025-10-17T22:44:25.956309] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-17T22:44:25.981508] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1820 records). [2025-10-17T22:44:25.981724] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-17T22:44:25.995503] [INFO ] [MAIN ] Derivative Progress: 1626/2083 symbols completed. SBSW took 1.1s. Estimated remaining: 2m 53s. Rate: 158.3 symbols/min [2025-10-17T22:44:25.982045] [DEBUG] [LOCAL ] SCD: Loaded 13601 existing records from primary storage. [2025-10-17T22:44:25.995803] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:25.995943] [INFO ] [MAIN ] SCD: Loaded 13601 primary data records. [2025-10-17T22:44:26.121872] [DEBUG] [LOCAL ] SCCO: Loaded 50329 existing records from primary storage. [2025-10-17T22:44:26.148320] [INFO ] [MAIN ] SCCO: Loaded 50329 primary data records. [2025-10-17T22:44:26.469702] [DEBUG] [LOCAL ] SCHW: Loaded 54465 existing records from primary storage. [2025-10-17T22:44:26.497423] [INFO ] [MAIN ] SCHW: Loaded 54465 primary data records. [2025-10-17T22:44:27.056436] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:27.059853] [INFO ] [MAIN ] SCD: Generated 1820 derivative records from 13601 primary records. [2025-10-17T22:44:27.062487] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-17T22:44:27.096819] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:27.097055] [DEBUG] [LOCAL ] SCD: Derivative data saved (1820 records). [2025-10-17T22:44:27.098451] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-17T22:44:27.104212] [INFO ] [MAIN ] SCCO: Generated 1820 derivative records from 50329 primary records. [2025-10-17T22:44:27.103037] [INFO ] [MAIN ] Derivative Progress: 1627/2083 symbols completed. SCD took 1.2s. Estimated remaining: 2m 53s. Rate: 158.1 symbols/min [2025-10-17T22:44:27.104551] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:27.112945] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-17T22:44:27.118679] [DEBUG] [MAIN ] SCHW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:27.120341] [INFO ] [MAIN ] SCHW: Generated 1820 derivative records from 54465 primary records. [2025-10-17T22:44:27.120731] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-17T22:44:27.157488] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1820 records). [2025-10-17T22:44:27.163418] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1820 records). [2025-10-17T22:44:27.160439] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-17T22:44:27.166099] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-17T22:44:27.165958] [INFO ] [MAIN ] Derivative Progress: 1628/2083 symbols completed. SCCO took 1.3s. Estimated remaining: 2m 53s. Rate: 158.2 symbols/min [2025-10-17T22:44:27.168581] [INFO ] [MAIN ] Derivative Progress: 1629/2083 symbols completed. SCHW took 1.2s. Estimated remaining: 2m 52s. Rate: 158.3 symbols/min [2025-10-17T22:44:27.166409] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:27.168987] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:27.201898] [DEBUG] [LOCAL ] SCL: Loaded 15195 existing records from primary storage. [2025-10-17T22:44:27.202065] [INFO ] [MAIN ] SCL: Loaded 15195 primary data records. [2025-10-17T22:44:27.313632] [DEBUG] [LOCAL ] SCM: Loaded 20521 existing records from primary storage. [2025-10-17T22:44:27.307975] [DEBUG] [LOCAL ] SCI: Loaded 47084 existing records from primary storage. [2025-10-17T22:44:27.330606] [INFO ] [MAIN ] SCM: Loaded 20521 primary data records. [2025-10-17T22:44:27.336365] [INFO ] [MAIN ] SCI: Loaded 47084 primary data records. [2025-10-17T22:44:28.167892] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:28.169340] [INFO ] [MAIN ] SCL: Generated 1820 derivative records from 15195 primary records. [2025-10-17T22:44:28.169620] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-17T22:44:28.188518] [DEBUG] [LOCAL ] SCL: Derivative data saved (1820 records). [2025-10-17T22:44:28.188919] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-17T22:44:28.191237] [INFO ] [MAIN ] Derivative Progress: 1630/2083 symbols completed. SCL took 1.0s. Estimated remaining: 2m 52s. Rate: 158.1 symbols/min [2025-10-17T22:44:28.191673] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:28.210165] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:28.211979] [INFO ] [MAIN ] SCM: Generated 1820 derivative records from 20521 primary records. [2025-10-17T22:44:28.213065] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-17T22:44:28.249551] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:28.248992] [DEBUG] [LOCAL ] SCM: Derivative data saved (1820 records). [2025-10-17T22:44:28.250884] [INFO ] [MAIN ] SCI: Generated 1820 derivative records from 47084 primary records. [2025-10-17T22:44:28.251039] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-17T22:44:28.251213] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-17T22:44:28.253249] [INFO ] [MAIN ] Derivative Progress: 1631/2083 symbols completed. SCM took 1.1s. Estimated remaining: 2m 51s. Rate: 158.2 symbols/min [2025-10-17T22:44:28.254532] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:28.289462] [DEBUG] [LOCAL ] SCI: Derivative data saved (1820 records). [2025-10-17T22:44:28.289822] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-17T22:44:28.292696] [INFO ] [MAIN ] Derivative Progress: 1632/2083 symbols completed. SCI took 1.2s. Estimated remaining: 2m 51s. Rate: 158.3 symbols/min [2025-10-17T22:44:28.293215] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:28.315868] [DEBUG] [LOCAL ] SCS: Loaded 44145 existing records from primary storage. [2025-10-17T22:44:28.316025] [INFO ] [MAIN ] SCS: Loaded 44145 primary data records. [2025-10-17T22:44:28.436288] [DEBUG] [LOCAL ] SD: Loaded 29067 existing records from primary storage. [2025-10-17T22:44:28.436519] [DEBUG] [LOCAL ] SDHC: Loaded 10499 existing records from primary storage. [2025-10-17T22:44:28.436757] [INFO ] [MAIN ] SD: Loaded 29067 primary data records. [2025-10-17T22:44:28.437085] [INFO ] [MAIN ] SDHC: Loaded 10499 primary data records. [2025-10-17T22:44:29.296313] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:29.297719] [INFO ] [MAIN ] SCS: Generated 1820 derivative records from 44145 primary records. [2025-10-17T22:44:29.297911] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-17T22:44:29.316286] [DEBUG] [LOCAL ] SCS: Derivative data saved (1820 records). [2025-10-17T22:44:29.317483] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-17T22:44:29.319626] [INFO ] [MAIN ] Derivative Progress: 1633/2083 symbols completed. SCS took 1.1s. Estimated remaining: 2m 51s. Rate: 158.1 symbols/min [2025-10-17T22:44:29.334859] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:29.336210] [INFO ] [MAIN ] SDHC: Generated 1820 derivative records from 10499 primary records. [2025-10-17T22:44:29.336322] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-17T22:44:29.357287] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:29.360737] [INFO ] [MAIN ] SD: Generated 1820 derivative records from 29067 primary records. [2025-10-17T22:44:29.362842] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-17T22:44:29.365025] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1820 records). [2025-10-17T22:44:29.365295] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-17T22:44:29.367428] [INFO ] [MAIN ] Derivative Progress: 1634/2083 symbols completed. SDHC took 1.1s. Estimated remaining: 2m 50s. Rate: 158.2 symbols/min [2025-10-17T22:44:29.381953] [DEBUG] [LOCAL ] SD: Derivative data saved (1820 records). [2025-10-17T22:44:29.382013] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-17T22:44:29.384149] [INFO ] [MAIN ] Derivative Progress: 1635/2083 symbols completed. SD took 1.1s. Estimated remaining: 2m 50s. Rate: 158.3 symbols/min [2025-10-17T22:44:29.384737] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:29.384835] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:29.384938] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:29.398078] [DEBUG] [LOCAL ] SDHY: Loaded 11214 existing records from primary storage. [2025-10-17T22:44:29.398212] [INFO ] [MAIN ] SDHY: Loaded 11214 primary data records. [2025-10-17T22:44:29.748976] [DEBUG] [LOCAL ] SDRL: Loaded 42072 existing records from primary storage. [2025-10-17T22:44:29.747775] [DEBUG] [LOCAL ] SE: Loaded 54082 existing records from primary storage. [2025-10-17T22:44:29.749325] [INFO ] [MAIN ] SE: Loaded 54082 primary data records. [2025-10-17T22:44:29.749406] [INFO ] [MAIN ] SDRL: Loaded 42072 primary data records. [2025-10-17T22:44:30.385478] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:30.387447] [INFO ] [MAIN ] SDHY: Generated 1820 derivative records from 11214 primary records. [2025-10-17T22:44:30.388511] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-17T22:44:30.407790] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1820 records). [2025-10-17T22:44:30.407895] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-17T22:44:30.410462] [INFO ] [MAIN ] Derivative Progress: 1636/2083 symbols completed. SDHY took 1.0s. Estimated remaining: 2m 50s. Rate: 158.1 symbols/min [2025-10-17T22:44:30.411193] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:30.435989] [DEBUG] [MAIN ] SE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:30.437221] [INFO ] [MAIN ] SE: Generated 1820 derivative records from 54082 primary records. [2025-10-17T22:44:30.453676] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-10-17T22:44:30.454489] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:30.456773] [INFO ] [MAIN ] SDRL: Generated 1820 derivative records from 42072 primary records. [2025-10-17T22:44:30.465729] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-17T22:44:30.472789] [DEBUG] [LOCAL ] SE: Derivative data saved (1820 records). [2025-10-17T22:44:30.473023] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-10-17T22:44:30.486923] [INFO ] [MAIN ] Derivative Progress: 1637/2083 symbols completed. SE took 1.1s. Estimated remaining: 2m 49s. Rate: 158.2 symbols/min [2025-10-17T22:44:30.487828] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:30.504703] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1820 records). [2025-10-17T22:44:30.505706] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-17T22:44:30.508427] [INFO ] [MAIN ] Derivative Progress: 1638/2083 symbols completed. SDRL took 1.1s. Estimated remaining: 2m 49s. Rate: 158.3 symbols/min [2025-10-17T22:44:30.508830] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:30.528618] [DEBUG] [LOCAL ] SEE: Loaded 48915 existing records from primary storage. [2025-10-17T22:44:30.534314] [DEBUG] [LOCAL ] SEG: Loaded 12956 existing records from primary storage. [2025-10-17T22:44:30.534689] [INFO ] [MAIN ] SEG: Loaded 12956 primary data records. [2025-10-17T22:44:30.534595] [INFO ] [MAIN ] SEE: Loaded 48915 primary data records. [2025-10-17T22:44:31.273045] [DEBUG] [LOCAL ] SEI: Loaded 50711 existing records from primary storage. [2025-10-17T22:44:31.273305] [INFO ] [MAIN ] SEI: Loaded 50711 primary data records. [2025-10-17T22:44:31.621828] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:31.626014] [INFO ] [MAIN ] SEG: Generated 1820 derivative records from 12956 primary records. [2025-10-17T22:44:31.626664] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-17T22:44:31.658346] [DEBUG] [LOCAL ] SEG: Derivative data saved (1820 records). [2025-10-17T22:44:31.659387] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-17T22:44:31.662439] [INFO ] [MAIN ] Derivative Progress: 1639/2083 symbols completed. SEG took 1.2s. Estimated remaining: 2m 49s. Rate: 158.1 symbols/min [2025-10-17T22:44:31.663190] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:31.663039] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:31.665451] [INFO ] [MAIN ] SEE: Generated 1820 derivative records from 48915 primary records. [2025-10-17T22:44:31.665864] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-17T22:44:31.687729] [DEBUG] [LOCAL ] SEE: Derivative data saved (1820 records). [2025-10-17T22:44:31.689064] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-17T22:44:31.691799] [INFO ] [MAIN ] Derivative Progress: 1640/2083 symbols completed. SEE took 1.3s. Estimated remaining: 2m 48s. Rate: 158.2 symbols/min [2025-10-17T22:44:31.692062] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:31.707068] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:31.708267] [INFO ] [MAIN ] SEI: Generated 1820 derivative records from 50711 primary records. [2025-10-17T22:44:31.708524] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-17T22:44:31.740186] [DEBUG] [LOCAL ] SEI: Derivative data saved (1820 records). [2025-10-17T22:44:31.741136] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-17T22:44:31.743836] [INFO ] [MAIN ] Derivative Progress: 1641/2083 symbols completed. SEI took 1.2s. Estimated remaining: 2m 48s. Rate: 158.3 symbols/min [2025-10-17T22:44:31.744405] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:31.766529] [DEBUG] [LOCAL ] SEM: Loaded 43811 existing records from primary storage. [2025-10-17T22:44:31.779498] [INFO ] [MAIN ] SEM: Loaded 43811 primary data records. [2025-10-17T22:44:31.905940] [DEBUG] [LOCAL ] SEMR: Loaded 42727 existing records from primary storage. [2025-10-17T22:44:31.922884] [INFO ] [MAIN ] SEMR: Loaded 42727 primary data records. [2025-10-17T22:44:32.235231] [DEBUG] [LOCAL ] SES: Loaded 52357 existing records from primary storage. [2025-10-17T22:44:32.260305] [INFO ] [MAIN ] SES: Loaded 52357 primary data records. [2025-10-17T22:44:32.815427] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:32.817413] [INFO ] [MAIN ] SEM: Generated 1820 derivative records from 43811 primary records. [2025-10-17T22:44:32.817958] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-17T22:44:32.849288] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:32.851581] [INFO ] [MAIN ] SEMR: Generated 1820 derivative records from 42727 primary records. [2025-10-17T22:44:32.852826] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-17T22:44:32.863326] [DEBUG] [LOCAL ] SEM: Derivative data saved (1820 records). [2025-10-17T22:44:32.863531] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-17T22:44:32.871399] [INFO ] [MAIN ] Derivative Progress: 1642/2083 symbols completed. SEM took 1.2s. Estimated remaining: 2m 47s. Rate: 158.1 symbols/min [2025-10-17T22:44:32.872536] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:32.874136] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1820 records). [2025-10-17T22:44:32.874310] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-17T22:44:32.878404] [INFO ] [MAIN ] Derivative Progress: 1643/2083 symbols completed. SEMR took 1.2s. Estimated remaining: 2m 47s. Rate: 158.2 symbols/min [2025-10-17T22:44:32.878922] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:32.892515] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:32.893322] [INFO ] [MAIN ] SES: Generated 1820 derivative records from 52357 primary records. [2025-10-17T22:44:32.893602] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-17T22:44:32.916307] [DEBUG] [LOCAL ] SFB: Loaded 3858 existing records from primary storage. [2025-10-17T22:44:32.920048] [DEBUG] [LOCAL ] SES: Derivative data saved (1820 records). [2025-10-17T22:44:32.920403] [INFO ] [MAIN ] SFB: Loaded 3858 primary data records. [2025-10-17T22:44:32.920197] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-17T22:44:32.922569] [INFO ] [MAIN ] Derivative Progress: 1644/2083 symbols completed. SES took 1.2s. Estimated remaining: 2m 46s. Rate: 158.3 symbols/min [2025-10-17T22:44:32.928439] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:33.064961] [DEBUG] [LOCAL ] SF: Loaded 42171 existing records from primary storage. [2025-10-17T22:44:33.065752] [INFO ] [MAIN ] SF: Loaded 42171 primary data records. [2025-10-17T22:44:33.246040] [DEBUG] [LOCAL ] SFBS: Loaded 21563 existing records from primary storage. [2025-10-17T22:44:33.429924] [INFO ] [MAIN ] SFBS: Loaded 21563 primary data records. [2025-10-17T22:44:34.003345] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:34.004817] [INFO ] [MAIN ] SFB: Generated 1820 derivative records from 3858 primary records. [2025-10-17T22:44:34.005069] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-17T22:44:34.042220] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:34.060222] [DEBUG] [LOCAL ] SFB: Derivative data saved (1820 records). [2025-10-17T22:44:34.061925] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-17T22:44:34.061679] [INFO ] [MAIN ] SF: Generated 1820 derivative records from 42171 primary records. [2025-10-17T22:44:34.064624] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-17T22:44:34.064383] [INFO ] [MAIN ] Derivative Progress: 1645/2083 symbols completed. SFB took 1.2s. Estimated remaining: 2m 46s. Rate: 158.1 symbols/min [2025-10-17T22:44:34.065167] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:34.066445] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:34.067826] [INFO ] [MAIN ] SFBS: Generated 1820 derivative records from 21563 primary records. [2025-10-17T22:44:34.080032] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-17T22:44:34.100902] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1820 records). [2025-10-17T22:44:34.101700] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-17T22:44:34.103833] [INFO ] [MAIN ] Derivative Progress: 1646/2083 symbols completed. SFBS took 1.2s. Estimated remaining: 2m 46s. Rate: 158.1 symbols/min [2025-10-17T22:44:34.104430] [DEBUG] [LOCAL ] SF: Derivative data saved (1820 records). [2025-10-17T22:44:34.104668] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:34.105158] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-17T22:44:34.108954] [INFO ] [MAIN ] Derivative Progress: 1647/2083 symbols completed. SF took 1.2s. Estimated remaining: 2m 45s. Rate: 158.2 symbols/min [2025-10-17T22:44:34.109319] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:34.146549] [DEBUG] [LOCAL ] SFL: Loaded 46032 existing records from primary storage. [2025-10-17T22:44:34.146866] [INFO ] [MAIN ] SFL: Loaded 46032 primary data records. [2025-10-17T22:44:34.309414] [DEBUG] [LOCAL ] SG: Loaded 54264 existing records from primary storage. [2025-10-17T22:44:34.309661] [INFO ] [MAIN ] SG: Loaded 54264 primary data records. [2025-10-17T22:44:34.412036] [DEBUG] [LOCAL ] SGHC: Loaded 47745 existing records from primary storage. [2025-10-17T22:44:34.536996] [INFO ] [MAIN ] SGHC: Loaded 47745 primary data records. [2025-10-17T22:44:35.194757] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:35.196344] [INFO ] [MAIN ] SFL: Generated 1820 derivative records from 46032 primary records. [2025-10-17T22:44:35.197334] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-17T22:44:35.219189] [DEBUG] [LOCAL ] SFL: Derivative data saved (1820 records). [2025-10-17T22:44:35.219812] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-17T22:44:35.221886] [INFO ] [MAIN ] Derivative Progress: 1648/2083 symbols completed. SFL took 1.2s. Estimated remaining: 2m 45s. Rate: 158.1 symbols/min [2025-10-17T22:44:35.237192] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:35.238969] [INFO ] [MAIN ] SG: Generated 1820 derivative records from 54264 primary records. [2025-10-17T22:44:35.239784] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-17T22:44:35.266331] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:35.269245] [DEBUG] [LOCAL ] SG: Derivative data saved (1820 records). [2025-10-17T22:44:35.269460] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-17T22:44:35.270167] [INFO ] [MAIN ] SGHC: Generated 1820 derivative records from 47745 primary records. [2025-10-17T22:44:35.272360] [INFO ] [MAIN ] Derivative Progress: 1649/2083 symbols completed. SG took 1.2s. Estimated remaining: 2m 45s. Rate: 158.1 symbols/min [2025-10-17T22:44:35.272485] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-17T22:44:35.289070] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1820 records). [2025-10-17T22:44:35.289167] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-17T22:44:35.291358] [INFO ] [MAIN ] Derivative Progress: 1650/2083 symbols completed. SGHC took 1.2s. Estimated remaining: 2m 44s. Rate: 158.2 symbols/min [2025-10-17T22:44:35.291807] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:35.291875] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:35.292005] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:35.304934] [DEBUG] [LOCAL ] SGU: Loaded 6653 existing records from primary storage. [2025-10-17T22:44:35.305195] [INFO ] [MAIN ] SGU: Loaded 6653 primary data records. [2025-10-17T22:44:35.457262] [DEBUG] [LOCAL ] SHCO: Loaded 25956 existing records from primary storage. [2025-10-17T22:44:35.473276] [INFO ] [MAIN ] SHCO: Loaded 25956 primary data records. [2025-10-17T22:44:35.726491] [DEBUG] [LOCAL ] SHAK: Loaded 49501 existing records from primary storage. [2025-10-17T22:44:35.759749] [INFO ] [MAIN ] SHAK: Loaded 49501 primary data records. [2025-10-17T22:44:36.348955] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:36.350623] [INFO ] [MAIN ] SGU: Generated 1820 derivative records from 6653 primary records. [2025-10-17T22:44:36.350790] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-17T22:44:36.368338] [DEBUG] [LOCAL ] SGU: Derivative data saved (1820 records). [2025-10-17T22:44:36.368618] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-17T22:44:36.371252] [INFO ] [MAIN ] Derivative Progress: 1651/2083 symbols completed. SGU took 1.1s. Estimated remaining: 2m 44s. Rate: 158.1 symbols/min [2025-10-17T22:44:36.372547] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:36.391182] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:36.392124] [INFO ] [MAIN ] SHCO: Generated 1820 derivative records from 25956 primary records. [2025-10-17T22:44:36.392205] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-17T22:44:36.410569] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1820 records). [2025-10-17T22:44:36.410856] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-10-17T22:44:36.412790] [INFO ] [MAIN ] Derivative Progress: 1652/2083 symbols completed. SHCO took 1.1s. Estimated remaining: 2m 44s. Rate: 158.1 symbols/min [2025-10-17T22:44:36.413008] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:36.430391] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:36.431348] [INFO ] [MAIN ] SHAK: Generated 1820 derivative records from 49501 primary records. [2025-10-17T22:44:36.431456] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-17T22:44:36.448621] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1820 records). [2025-10-17T22:44:36.448946] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-17T22:44:36.451101] [INFO ] [MAIN ] Derivative Progress: 1653/2083 symbols completed. SHAK took 1.2s. Estimated remaining: 2m 43s. Rate: 158.2 symbols/min [2025-10-17T22:44:36.451298] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:36.486079] [DEBUG] [LOCAL ] SHG: Loaded 27006 existing records from primary storage. [2025-10-17T22:44:36.486351] [INFO ] [MAIN ] SHG: Loaded 27006 primary data records. [2025-10-17T22:44:36.605034] [DEBUG] [LOCAL ] SHEL: Loaded 54453 existing records from primary storage. [2025-10-17T22:44:36.608891] [INFO ] [MAIN ] SHEL: Loaded 54453 primary data records. [2025-10-17T22:44:37.130669] [DEBUG] [LOCAL ] SHO: Loaded 50038 existing records from primary storage. [2025-10-17T22:44:37.145148] [INFO ] [MAIN ] SHO: Loaded 50038 primary data records. [2025-10-17T22:44:37.520107] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:37.521928] [INFO ] [MAIN ] SHG: Generated 1820 derivative records from 27006 primary records. [2025-10-17T22:44:37.522592] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-17T22:44:37.544879] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:37.551586] [DEBUG] [LOCAL ] SHG: Derivative data saved (1820 records). [2025-10-17T22:44:37.552468] [INFO ] [MAIN ] SHEL: Generated 1820 derivative records from 54453 primary records. [2025-10-17T22:44:37.553504] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-17T22:44:37.555776] [INFO ] [MAIN ] Derivative Progress: 1654/2083 symbols completed. SHG took 1.1s. Estimated remaining: 2m 43s. Rate: 158.0 symbols/min [2025-10-17T22:44:37.556045] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-17T22:44:37.556528] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:37.575611] [DEBUG] [LOCAL ] SHOC: Loaded 3283 existing records from primary storage. [2025-10-17T22:44:37.577032] [INFO ] [MAIN ] SHOC: Loaded 3283 primary data records. [2025-10-17T22:44:37.592028] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1820 records). [2025-10-17T22:44:37.612354] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-17T22:44:37.626462] [INFO ] [MAIN ] Derivative Progress: 1655/2083 symbols completed. SHEL took 1.3s. Estimated remaining: 2m 42s. Rate: 158.1 symbols/min [2025-10-17T22:44:37.652608] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:37.696071] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:37.700069] [INFO ] [MAIN ] SHO: Generated 1820 derivative records from 50038 primary records. [2025-10-17T22:44:37.700459] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-17T22:44:37.795534] [DEBUG] [LOCAL ] SHO: Derivative data saved (1820 records). [2025-10-17T22:44:37.795691] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-17T22:44:37.797910] [INFO ] [MAIN ] Derivative Progress: 1656/2083 symbols completed. SHO took 1.3s. Estimated remaining: 2m 42s. Rate: 158.2 symbols/min [2025-10-17T22:44:37.914403] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:37.955312] [DEBUG] [LOCAL ] SHW: Loaded 51119 existing records from primary storage. [2025-10-17T22:44:37.956966] [INFO ] [MAIN ] SHW: Loaded 51119 primary data records. [2025-10-17T22:44:38.046635] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:44:38.065436] [INFO ] [MAIN ] SHOC: Generated 1819 derivative records from 3283 primary records. [2025-10-17T22:44:38.099526] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-17T22:44:38.161360] [DEBUG] [LOCAL ] SID: Loaded 43366 existing records from primary storage. [2025-10-17T22:44:38.294996] [INFO ] [MAIN ] SID: Loaded 43366 primary data records. [2025-10-17T22:44:38.347135] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1819 records). [2025-10-17T22:44:38.362225] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-17T22:44:38.379774] [INFO ] [MAIN ] Derivative Progress: 1657/2083 symbols completed. SHOC took 0.8s. Estimated remaining: 2m 42s. Rate: 158.1 symbols/min [2025-10-17T22:44:38.389140] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:38.658989] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:38.660163] [INFO ] [MAIN ] SHW: Generated 1820 derivative records from 51119 primary records. [2025-10-17T22:44:38.660303] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-17T22:44:38.692120] [DEBUG] [LOCAL ] SHW: Derivative data saved (1820 records). [2025-10-17T22:44:38.692252] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-17T22:44:38.695219] [INFO ] [MAIN ] Derivative Progress: 1658/2083 symbols completed. SHW took 1.0s. Estimated remaining: 2m 41s. Rate: 158.1 symbols/min [2025-10-17T22:44:38.691420] [DEBUG] [LOCAL ] SIG: Loaded 46214 existing records from primary storage. [2025-10-17T22:44:38.695553] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:38.695741] [INFO ] [MAIN ] SIG: Loaded 46214 primary data records. [2025-10-17T22:44:38.892098] [DEBUG] [LOCAL ] SII: Loaded 24434 existing records from primary storage. [2025-10-17T22:44:38.899787] [INFO ] [MAIN ] SII: Loaded 24434 primary data records. [2025-10-17T22:44:39.053016] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:39.078474] [INFO ] [MAIN ] SID: Generated 1820 derivative records from 43366 primary records. [2025-10-17T22:44:39.099379] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-17T22:44:39.143554] [DEBUG] [LOCAL ] SID: Derivative data saved (1820 records). [2025-10-17T22:44:39.148928] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-17T22:44:39.156391] [INFO ] [MAIN ] Derivative Progress: 1659/2083 symbols completed. SID took 1.2s. Estimated remaining: 2m 41s. Rate: 158.1 symbols/min [2025-10-17T22:44:39.167196] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:39.421372] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:39.422451] [INFO ] [MAIN ] SIG: Generated 1820 derivative records from 46214 primary records. [2025-10-17T22:44:39.422933] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-17T22:44:39.434401] [DEBUG] [LOCAL ] SILA: Loaded 30851 existing records from primary storage. [2025-10-17T22:44:39.434678] [INFO ] [MAIN ] SILA: Loaded 30851 primary data records. [2025-10-17T22:44:39.578849] [DEBUG] [LOCAL ] SIG: Derivative data saved (1820 records). [2025-10-17T22:44:39.584442] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-17T22:44:39.587237] [INFO ] [MAIN ] Derivative Progress: 1660/2083 symbols completed. SIG took 1.2s. Estimated remaining: 2m 41s. Rate: 158.1 symbols/min [2025-10-17T22:44:39.592561] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:39.774049] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:39.774784] [INFO ] [MAIN ] SII: Generated 1820 derivative records from 24434 primary records. [2025-10-17T22:44:39.774847] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-17T22:44:39.793845] [DEBUG] [LOCAL ] SII: Derivative data saved (1820 records). [2025-10-17T22:44:39.794362] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-17T22:44:39.796680] [INFO ] [MAIN ] Derivative Progress: 1661/2083 symbols completed. SII took 1.1s. Estimated remaining: 2m 40s. Rate: 158.1 symbols/min [2025-10-17T22:44:39.796867] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:39.838293] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:39.850873] [INFO ] [MAIN ] SILA: Generated 1820 derivative records from 30851 primary records. [2025-10-17T22:44:39.851805] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-17T22:44:39.851577] [DEBUG] [LOCAL ] SITC: Loaded 42442 existing records from primary storage. [2025-10-17T22:44:39.860142] [INFO ] [MAIN ] SITC: Loaded 42442 primary data records. [2025-10-17T22:44:39.947841] [DEBUG] [LOCAL ] SILA: Derivative data saved (1820 records). [2025-10-17T22:44:39.980545] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-17T22:44:39.993574] [INFO ] [MAIN ] Derivative Progress: 1662/2083 symbols completed. SILA took 0.8s. Estimated remaining: 2m 40s. Rate: 158.2 symbols/min [2025-10-17T22:44:39.995131] [DEBUG] [LOCAL ] SITE: Loaded 36106 existing records from primary storage. [2025-10-17T22:44:40.000533] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:40.000687] [INFO ] [MAIN ] SITE: Loaded 36106 primary data records. [2025-10-17T22:44:40.555500] [DEBUG] [LOCAL ] SJM: Loaded 50860 existing records from primary storage. [2025-10-17T22:44:40.553818] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:40.555773] [INFO ] [MAIN ] SJM: Loaded 50860 primary data records. [2025-10-17T22:44:40.556519] [INFO ] [MAIN ] SITC: Generated 1820 derivative records from 42442 primary records. [2025-10-17T22:44:40.556986] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-17T22:44:40.651182] [DEBUG] [LOCAL ] SITC: Derivative data saved (1820 records). [2025-10-17T22:44:40.656561] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-17T22:44:40.664059] [INFO ] [MAIN ] Derivative Progress: 1663/2083 symbols completed. SITC took 1.1s. Estimated remaining: 2m 39s. Rate: 158.1 symbols/min [2025-10-17T22:44:40.736760] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:40.755678] [INFO ] [MAIN ] SITE: Generated 1820 derivative records from 36106 primary records. [2025-10-17T22:44:40.894374] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-17T22:44:40.925751] [DEBUG] [LOCAL ] SITE: Derivative data saved (1820 records). [2025-10-17T22:44:40.926255] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-17T22:44:40.928460] [INFO ] [MAIN ] Derivative Progress: 1664/2083 symbols completed. SITE took 1.1s. Estimated remaining: 2m 39s. Rate: 158.1 symbols/min [2025-10-17T22:44:40.948764] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:40.949372] [INFO ] [MAIN ] SJM: Generated 1820 derivative records from 50860 primary records. [2025-10-17T22:44:40.949437] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-17T22:44:40.964902] [DEBUG] [LOCAL ] SJM: Derivative data saved (1820 records). [2025-10-17T22:44:40.964960] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-17T22:44:40.967006] [INFO ] [MAIN ] Derivative Progress: 1665/2083 symbols completed. SJM took 1.0s. Estimated remaining: 2m 38s. Rate: 158.2 symbols/min [2025-10-17T22:44:40.967581] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:40.967758] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:40.967513] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:40.981389] [DEBUG] [LOCAL ] SKIL: Loaded 6839 existing records from primary storage. [2025-10-17T22:44:40.986468] [INFO ] [MAIN ] SKIL: Loaded 6839 primary data records. [2025-10-17T22:44:41.113348] [DEBUG] [LOCAL ] SKE: Loaded 37617 existing records from primary storage. [2025-10-17T22:44:41.113939] [DEBUG] [LOCAL ] SJT: Loaded 22927 existing records from primary storage. [2025-10-17T22:44:41.114160] [INFO ] [MAIN ] SKE: Loaded 37617 primary data records. [2025-10-17T22:44:41.114570] [INFO ] [MAIN ] SJT: Loaded 22927 primary data records. [2025-10-17T22:44:41.976506] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:41.977571] [INFO ] [MAIN ] SKIL: Generated 1820 derivative records from 6839 primary records. [2025-10-17T22:44:41.978081] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-17T22:44:42.010212] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1820 records). [2025-10-17T22:44:42.010808] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-17T22:44:42.013087] [INFO ] [MAIN ] Derivative Progress: 1666/2083 symbols completed. SKIL took 1.0s. Estimated remaining: 2m 38s. Rate: 158.1 symbols/min [2025-10-17T22:44:42.010626] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:42.015100] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:42.017205] [INFO ] [MAIN ] SKE: Generated 1820 derivative records from 37617 primary records. [2025-10-17T22:44:42.017488] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-17T22:44:42.043912] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:42.048292] [INFO ] [MAIN ] SJT: Generated 1820 derivative records from 22927 primary records. [2025-10-17T22:44:42.048714] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-17T22:44:42.052976] [DEBUG] [LOCAL ] SKE: Derivative data saved (1820 records). [2025-10-17T22:44:42.053291] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-17T22:44:42.062102] [INFO ] [MAIN ] Derivative Progress: 1667/2083 symbols completed. SKE took 1.1s. Estimated remaining: 2m 38s. Rate: 158.2 symbols/min [2025-10-17T22:44:42.062274] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:42.071353] [DEBUG] [LOCAL ] SKLZ: Loaded 11752 existing records from primary storage. [2025-10-17T22:44:42.072382] [INFO ] [MAIN ] SKLZ: Loaded 11752 primary data records. [2025-10-17T22:44:42.140172] [DEBUG] [LOCAL ] SJT: Derivative data saved (1820 records). [2025-10-17T22:44:42.157144] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-17T22:44:42.180521] [INFO ] [MAIN ] Derivative Progress: 1668/2083 symbols completed. SJT took 1.2s. Estimated remaining: 2m 37s. Rate: 158.2 symbols/min [2025-10-17T22:44:42.191837] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:42.398421] [DEBUG] [LOCAL ] SKM: Loaded 35792 existing records from primary storage. [2025-10-17T22:44:42.398597] [INFO ] [MAIN ] SKM: Loaded 35792 primary data records. [2025-10-17T22:44:42.705738] [DEBUG] [LOCAL ] SKT: Loaded 43136 existing records from primary storage. [2025-10-17T22:44:42.719349] [INFO ] [MAIN ] SKT: Loaded 43136 primary data records. [2025-10-17T22:44:42.886695] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:42.917946] [INFO ] [MAIN ] SKLZ: Generated 1820 derivative records from 11752 primary records. [2025-10-17T22:44:43.068110] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-17T22:44:43.100521] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1820 records). [2025-10-17T22:44:43.100711] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-17T22:44:43.103310] [INFO ] [MAIN ] Derivative Progress: 1669/2083 symbols completed. SKLZ took 1.1s. Estimated remaining: 2m 37s. Rate: 158.1 symbols/min [2025-10-17T22:44:43.103705] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:43.122560] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:43.124340] [INFO ] [MAIN ] SKM: Generated 1820 derivative records from 35792 primary records. [2025-10-17T22:44:43.124724] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-17T22:44:43.153829] [DEBUG] [LOCAL ] SKM: Derivative data saved (1820 records). [2025-10-17T22:44:43.154339] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-10-17T22:44:43.156540] [INFO ] [MAIN ] Derivative Progress: 1670/2083 symbols completed. SKM took 1.1s. Estimated remaining: 2m 37s. Rate: 158.2 symbols/min [2025-10-17T22:44:43.156834] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:43.183337] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:43.185043] [INFO ] [MAIN ] SKT: Generated 1820 derivative records from 43136 primary records. [2025-10-17T22:44:43.185666] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-17T22:44:43.185544] [DEBUG] [LOCAL ] SKY: Loaded 39132 existing records from primary storage. [2025-10-17T22:44:43.185776] [INFO ] [MAIN ] SKY: Loaded 39132 primary data records. [2025-10-17T22:44:43.286665] [DEBUG] [LOCAL ] SKT: Derivative data saved (1820 records). [2025-10-17T22:44:43.279040] [DEBUG] [LOCAL ] SKYH: Loaded 16482 existing records from primary storage. [2025-10-17T22:44:43.291958] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-17T22:44:43.314728] [INFO ] [MAIN ] Derivative Progress: 1671/2083 symbols completed. SKT took 1.1s. Estimated remaining: 2m 36s. Rate: 158.2 symbols/min [2025-10-17T22:44:43.309770] [INFO ] [MAIN ] SKYH: Loaded 16482 primary data records. [2025-10-17T22:44:43.314937] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:43.851321] [DEBUG] [LOCAL ] SLB: Loaded 54477 existing records from primary storage. [2025-10-17T22:44:43.852221] [INFO ] [MAIN ] SLB: Loaded 54477 primary data records. [2025-10-17T22:44:43.991810] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:44.046024] [INFO ] [MAIN ] SKY: Generated 1820 derivative records from 39132 primary records. [2025-10-17T22:44:44.162428] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-17T22:44:44.193847] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:44.193235] [DEBUG] [LOCAL ] SKY: Derivative data saved (1820 records). [2025-10-17T22:44:44.195100] [INFO ] [MAIN ] SKYH: Generated 1820 derivative records from 16482 primary records. [2025-10-17T22:44:44.195405] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-10-17T22:44:44.198008] [INFO ] [MAIN ] Derivative Progress: 1672/2083 symbols completed. SKY took 1.1s. Estimated remaining: 2m 36s. Rate: 158.1 symbols/min [2025-10-17T22:44:44.198161] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:44.199375] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-17T22:44:44.218474] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1820 records). [2025-10-17T22:44:44.218873] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-17T22:44:44.221329] [INFO ] [MAIN ] Derivative Progress: 1673/2083 symbols completed. SKYH took 1.1s. Estimated remaining: 2m 36s. Rate: 158.2 symbols/min [2025-10-17T22:44:44.221731] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:44.241028] [DEBUG] [MAIN ] SLB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:44.241860] [INFO ] [MAIN ] SLB: Generated 1820 derivative records from 54477 primary records. [2025-10-17T22:44:44.242124] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-10-17T22:44:44.272667] [DEBUG] [LOCAL ] SLB: Derivative data saved (1820 records). [2025-10-17T22:44:44.273304] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-10-17T22:44:44.275256] [INFO ] [MAIN ] Derivative Progress: 1674/2083 symbols completed. SLB took 1.0s. Estimated remaining: 2m 35s. Rate: 158.3 symbols/min [2025-10-17T22:44:44.286337] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:44.287224] [DEBUG] [LOCAL ] SLF: Loaded 39322 existing records from primary storage. [2025-10-17T22:44:44.287358] [INFO ] [MAIN ] SLF: Loaded 39322 primary data records. [2025-10-17T22:44:44.615613] [DEBUG] [LOCAL ] SLG: Loaded 46349 existing records from primary storage. [2025-10-17T22:44:44.615926] [INFO ] [MAIN ] SLG: Loaded 46349 primary data records. [2025-10-17T22:44:44.730459] [DEBUG] [LOCAL ] SLGN: Loaded 41517 existing records from primary storage. [2025-10-17T22:44:44.734277] [INFO ] [MAIN ] SLGN: Loaded 41517 primary data records. [2025-10-17T22:44:45.317797] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:45.318752] [INFO ] [MAIN ] SLF: Generated 1820 derivative records from 39322 primary records. [2025-10-17T22:44:45.319494] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-17T22:44:45.343736] [DEBUG] [LOCAL ] SLF: Derivative data saved (1820 records). [2025-10-17T22:44:45.344304] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-17T22:44:45.349018] [INFO ] [MAIN ] Derivative Progress: 1675/2083 symbols completed. SLF took 1.2s. Estimated remaining: 2m 35s. Rate: 158.1 symbols/min [2025-10-17T22:44:45.350418] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:45.367981] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:45.369002] [INFO ] [MAIN ] SLG: Generated 1820 derivative records from 46349 primary records. [2025-10-17T22:44:45.369149] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-17T22:44:45.391844] [DEBUG] [LOCAL ] SLG: Derivative data saved (1820 records). [2025-10-17T22:44:45.392453] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-17T22:44:45.394690] [INFO ] [MAIN ] Derivative Progress: 1676/2083 symbols completed. SLG took 1.2s. Estimated remaining: 2m 34s. Rate: 158.2 symbols/min [2025-10-17T22:44:45.394966] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:45.420792] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:45.421614] [INFO ] [MAIN ] SLGN: Generated 1820 derivative records from 41517 primary records. [2025-10-17T22:44:45.421709] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-17T22:44:45.439699] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1820 records). [2025-10-17T22:44:45.439933] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-17T22:44:45.455145] [INFO ] [MAIN ] Derivative Progress: 1677/2083 symbols completed. SLGN took 1.2s. Estimated remaining: 2m 34s. Rate: 158.3 symbols/min [2025-10-17T22:44:45.455554] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:45.457583] [DEBUG] [LOCAL ] SLQT: Loaded 44143 existing records from primary storage. [2025-10-17T22:44:45.458266] [INFO ] [MAIN ] SLQT: Loaded 44143 primary data records. [2025-10-17T22:44:45.607949] [DEBUG] [LOCAL ] SLVM: Loaded 28167 existing records from primary storage. [2025-10-17T22:44:45.613480] [INFO ] [MAIN ] SLVM: Loaded 28167 primary data records. [2025-10-17T22:44:46.138955] [DEBUG] [LOCAL ] SM: Loaded 53152 existing records from primary storage. [2025-10-17T22:44:46.148182] [INFO ] [MAIN ] SM: Loaded 53152 primary data records. [2025-10-17T22:44:46.493579] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:46.496246] [INFO ] [MAIN ] SLQT: Generated 1820 derivative records from 44143 primary records. [2025-10-17T22:44:46.496745] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-17T22:44:46.515348] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1820 records). [2025-10-17T22:44:46.516450] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-17T22:44:46.518768] [INFO ] [MAIN ] Derivative Progress: 1678/2083 symbols completed. SLQT took 1.2s. Estimated remaining: 2m 34s. Rate: 158.1 symbols/min [2025-10-17T22:44:46.535273] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:46.536869] [INFO ] [MAIN ] SLVM: Generated 1820 derivative records from 28167 primary records. [2025-10-17T22:44:46.537272] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-17T22:44:46.554821] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1820 records). [2025-10-17T22:44:46.554936] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-17T22:44:46.557193] [INFO ] [MAIN ] Derivative Progress: 1679/2083 symbols completed. SLVM took 1.2s. Estimated remaining: 2m 33s. Rate: 158.2 symbols/min [2025-10-17T22:44:46.572861] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:46.573723] [INFO ] [MAIN ] SM: Generated 1820 derivative records from 53152 primary records. [2025-10-17T22:44:46.573790] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-17T22:44:46.590937] [DEBUG] [LOCAL ] SM: Derivative data saved (1820 records). [2025-10-17T22:44:46.591000] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-17T22:44:46.593421] [INFO ] [MAIN ] Derivative Progress: 1680/2083 symbols completed. SM took 1.1s. Estimated remaining: 2m 33s. Rate: 158.3 symbols/min [2025-10-17T22:44:46.594056] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:46.594330] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:46.594187] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:46.605703] [DEBUG] [LOCAL ] SMBK: Loaded 8414 existing records from primary storage. [2025-10-17T22:44:46.605939] [INFO ] [MAIN ] SMBK: Loaded 8414 primary data records. [2025-10-17T22:44:46.689102] [DEBUG] [LOCAL ] SMC: Loaded 11371 existing records from primary storage. [2025-10-17T22:44:46.713195] [INFO ] [MAIN ] SMC: Loaded 11371 primary data records. [2025-10-17T22:44:47.070597] [DEBUG] [LOCAL ] SMFG: Loaded 49084 existing records from primary storage. [2025-10-17T22:44:47.081986] [INFO ] [MAIN ] SMFG: Loaded 49084 primary data records. [2025-10-17T22:44:47.651756] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:47.653297] [INFO ] [MAIN ] SMBK: Generated 1820 derivative records from 8414 primary records. [2025-10-17T22:44:47.653866] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-17T22:44:47.674898] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1820 records). [2025-10-17T22:44:47.676092] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-17T22:44:47.678862] [INFO ] [MAIN ] Derivative Progress: 1681/2083 symbols completed. SMBK took 1.1s. Estimated remaining: 2m 33s. Rate: 158.1 symbols/min [2025-10-17T22:44:47.679208] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:47.697326] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:47.698455] [INFO ] [MAIN ] SMC: Generated 1820 derivative records from 11371 primary records. [2025-10-17T22:44:47.698708] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-17T22:44:47.719361] [DEBUG] [LOCAL ] SMC: Derivative data saved (1820 records). [2025-10-17T22:44:47.719501] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-17T22:44:47.723809] [INFO ] [MAIN ] Derivative Progress: 1682/2083 symbols completed. SMC took 1.1s. Estimated remaining: 2m 32s. Rate: 158.2 symbols/min [2025-10-17T22:44:47.724476] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:47.738739] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:47.739591] [INFO ] [MAIN ] SMFG: Generated 1820 derivative records from 49084 primary records. [2025-10-17T22:44:47.739817] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-17T22:44:47.770472] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1820 records). [2025-10-17T22:44:47.770607] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-17T22:44:47.772888] [INFO ] [MAIN ] Derivative Progress: 1683/2083 symbols completed. SMFG took 1.2s. Estimated remaining: 2m 32s. Rate: 158.2 symbols/min [2025-10-17T22:44:47.773080] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:47.779695] [DEBUG] [LOCAL ] SMHI: Loaded 13216 existing records from primary storage. [2025-10-17T22:44:47.779924] [INFO ] [MAIN ] SMHI: Loaded 13216 primary data records. [2025-10-17T22:44:47.859367] [DEBUG] [LOCAL ] SMG: Loaded 43860 existing records from primary storage. [2025-10-17T22:44:47.881472] [INFO ] [MAIN ] SMG: Loaded 43860 primary data records. [2025-10-17T22:44:48.000933] [DEBUG] [LOCAL ] SMP: Loaded 19099 existing records from primary storage. [2025-10-17T22:44:48.091746] [INFO ] [MAIN ] SMP: Loaded 19099 primary data records. [2025-10-17T22:44:48.731678] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:48.732802] [INFO ] [MAIN ] SMHI: Generated 1820 derivative records from 13216 primary records. [2025-10-17T22:44:48.733002] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-17T22:44:48.752791] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1820 records). [2025-10-17T22:44:48.766233] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-17T22:44:48.766114] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:48.769481] [INFO ] [MAIN ] SMG: Generated 1820 derivative records from 43860 primary records. [2025-10-17T22:44:48.768715] [INFO ] [MAIN ] Derivative Progress: 1684/2083 symbols completed. SMHI took 1.0s. Estimated remaining: 2m 31s. Rate: 158.1 symbols/min [2025-10-17T22:44:48.769973] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:48.770968] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-17T22:44:48.801451] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:48.803229] [DEBUG] [LOCAL ] SMG: Derivative data saved (1820 records). [2025-10-17T22:44:48.804169] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-17T22:44:48.804029] [INFO ] [MAIN ] SMP: Generated 1820 derivative records from 19099 primary records. [2025-10-17T22:44:48.806443] [INFO ] [MAIN ] Derivative Progress: 1685/2083 symbols completed. SMG took 1.1s. Estimated remaining: 2m 31s. Rate: 158.2 symbols/min [2025-10-17T22:44:48.806905] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:48.806675] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-17T22:44:48.824772] [DEBUG] [LOCAL ] SMP: Derivative data saved (1820 records). [2025-10-17T22:44:48.825095] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-10-17T22:44:48.827298] [INFO ] [MAIN ] Derivative Progress: 1686/2083 symbols completed. SMP took 1.1s. Estimated remaining: 2m 31s. Rate: 158.3 symbols/min [2025-10-17T22:44:48.827479] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:48.873327] [DEBUG] [LOCAL ] SMR: Loaded 54579 existing records from primary storage. [2025-10-17T22:44:48.873552] [INFO ] [MAIN ] SMR: Loaded 54579 primary data records. [2025-10-17T22:44:48.994105] [DEBUG] [LOCAL ] SMWB: Loaded 32540 existing records from primary storage. [2025-10-17T22:44:49.009213] [INFO ] [MAIN ] SMWB: Loaded 32540 primary data records. [2025-10-17T22:44:49.062563] [DEBUG] [LOCAL ] SMRT: Loaded 44571 existing records from primary storage. [2025-10-17T22:44:49.091913] [INFO ] [MAIN ] SMRT: Loaded 44571 primary data records. [2025-10-17T22:44:49.892230] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:49.893195] [INFO ] [MAIN ] SMWB: Generated 1820 derivative records from 32540 primary records. [2025-10-17T22:44:49.893529] [DEBUG] [MAIN ] SMR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:49.894824] [INFO ] [MAIN ] SMR: Generated 1820 derivative records from 54579 primary records. [2025-10-17T22:44:49.893761] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-17T22:44:49.895761] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-10-17T22:44:49.939568] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1820 records). [2025-10-17T22:44:49.940600] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-17T22:44:49.943376] [INFO ] [MAIN ] Derivative Progress: 1687/2083 symbols completed. SMWB took 1.1s. Estimated remaining: 2m 30s. Rate: 158.1 symbols/min [2025-10-17T22:44:49.940496] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:49.944370] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:49.945270] [INFO ] [MAIN ] SMRT: Generated 1820 derivative records from 44571 primary records. [2025-10-17T22:44:49.945659] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-17T22:44:49.963787] [DEBUG] [LOCAL ] SMR: Derivative data saved (1820 records). [2025-10-17T22:44:49.964879] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-10-17T22:44:49.967185] [INFO ] [MAIN ] Derivative Progress: 1688/2083 symbols completed. SMR took 1.2s. Estimated remaining: 2m 30s. Rate: 158.2 symbols/min [2025-10-17T22:44:49.967761] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:49.969939] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1820 records). [2025-10-17T22:44:49.970111] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-17T22:44:49.972114] [INFO ] [MAIN ] Derivative Progress: 1689/2083 symbols completed. SMRT took 1.2s. Estimated remaining: 2m 29s. Rate: 158.3 symbols/min [2025-10-17T22:44:49.972433] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:49.980801] [DEBUG] [LOCAL ] SNDA: Loaded 4539 existing records from primary storage. [2025-10-17T22:44:49.981120] [INFO ] [MAIN ] SNDA: Loaded 4539 primary data records. [2025-10-17T22:44:50.179359] [DEBUG] [LOCAL ] SN: Loaded 50745 existing records from primary storage. [2025-10-17T22:44:50.196043] [INFO ] [MAIN ] SN: Loaded 50745 primary data records. [2025-10-17T22:44:50.414383] [DEBUG] [LOCAL ] SNAP: Loaded 54576 existing records from primary storage. [2025-10-17T22:44:50.420192] [INFO ] [MAIN ] SNAP: Loaded 54576 primary data records. [2025-10-17T22:44:51.017152] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:51.019364] [INFO ] [MAIN ] SNDA: Generated 1820 derivative records from 4539 primary records. [2025-10-17T22:44:51.019776] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-17T22:44:51.053480] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1820 records). [2025-10-17T22:44:51.054031] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-17T22:44:51.056784] [INFO ] [MAIN ] Derivative Progress: 1690/2083 symbols completed. SNDA took 1.1s. Estimated remaining: 2m 29s. Rate: 158.1 symbols/min [2025-10-17T22:44:51.054331] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:51.057973] [INFO ] [MAIN ] SN: Generated 1820 derivative records from 50745 primary records. [2025-10-17T22:44:51.058112] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-17T22:44:51.058235] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:51.078812] [DEBUG] [LOCAL ] SN: Derivative data saved (1820 records). [2025-10-17T22:44:51.086705] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-17T22:44:51.093880] [INFO ] [MAIN ] Derivative Progress: 1691/2083 symbols completed. SN took 1.1s. Estimated remaining: 2m 29s. Rate: 158.2 symbols/min [2025-10-17T22:44:51.094032] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:51.094795] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:51.095680] [INFO ] [MAIN ] SNAP: Generated 1820 derivative records from 54576 primary records. [2025-10-17T22:44:51.095835] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-17T22:44:51.115269] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1820 records). [2025-10-17T22:44:51.115476] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-17T22:44:51.118730] [INFO ] [MAIN ] Derivative Progress: 1692/2083 symbols completed. SNAP took 1.2s. Estimated remaining: 2m 28s. Rate: 158.3 symbols/min [2025-10-17T22:44:51.128737] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:51.159428] [DEBUG] [LOCAL ] SNDR: Loaded 42209 existing records from primary storage. [2025-10-17T22:44:51.159811] [INFO ] [MAIN ] SNDR: Loaded 42209 primary data records. [2025-10-17T22:44:51.275488] [DEBUG] [LOCAL ] SNN: Loaded 44929 existing records from primary storage. [2025-10-17T22:44:51.275788] [INFO ] [MAIN ] SNN: Loaded 44929 primary data records. [2025-10-17T22:44:51.649102] [DEBUG] [LOCAL ] SNOW: Loaded 54371 existing records from primary storage. [2025-10-17T22:44:51.670913] [INFO ] [MAIN ] SNOW: Loaded 54371 primary data records. [2025-10-17T22:44:52.158765] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:52.160072] [INFO ] [MAIN ] SNDR: Generated 1820 derivative records from 42209 primary records. [2025-10-17T22:44:52.160318] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-17T22:44:52.177285] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1820 records). [2025-10-17T22:44:52.179245] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-17T22:44:52.182036] [INFO ] [MAIN ] Derivative Progress: 1693/2083 symbols completed. SNDR took 1.1s. Estimated remaining: 2m 28s. Rate: 158.1 symbols/min [2025-10-17T22:44:52.200133] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:52.201157] [INFO ] [MAIN ] SNN: Generated 1820 derivative records from 44929 primary records. [2025-10-17T22:44:52.201554] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-17T22:44:52.235694] [DEBUG] [LOCAL ] SNN: Derivative data saved (1820 records). [2025-10-17T22:44:52.235972] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-17T22:44:52.239138] [INFO ] [MAIN ] Derivative Progress: 1694/2083 symbols completed. SNN took 1.1s. Estimated remaining: 2m 28s. Rate: 158.2 symbols/min [2025-10-17T22:44:52.239567] [DEBUG] [MAIN ] SNOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:52.240428] [INFO ] [MAIN ] SNOW: Generated 1820 derivative records from 54371 primary records. [2025-10-17T22:44:52.240494] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-10-17T22:44:52.257065] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1820 records). [2025-10-17T22:44:52.257177] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-10-17T22:44:52.259532] [INFO ] [MAIN ] Derivative Progress: 1695/2083 symbols completed. SNOW took 1.1s. Estimated remaining: 2m 27s. Rate: 158.3 symbols/min [2025-10-17T22:44:52.260234] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:52.260042] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:52.260150] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:52.344134] [DEBUG] [LOCAL ] SNX: Loaded 39987 existing records from primary storage. [2025-10-17T22:44:52.358189] [INFO ] [MAIN ] SNX: Loaded 39987 primary data records. [2025-10-17T22:44:52.360705] [DEBUG] [LOCAL ] SNV: Loaded 49816 existing records from primary storage. [2025-10-17T22:44:52.406917] [INFO ] [MAIN ] SNV: Loaded 49816 primary data records. [2025-10-17T22:44:52.399223] [DEBUG] [LOCAL ] SO: Loaded 54394 existing records from primary storage. [2025-10-17T22:44:52.489499] [INFO ] [MAIN ] SO: Loaded 54394 primary data records. [2025-10-17T22:44:53.384151] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:53.401151] [INFO ] [MAIN ] SNX: Generated 1820 derivative records from 39987 primary records. [2025-10-17T22:44:53.401879] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:53.402161] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-17T22:44:53.403080] [INFO ] [MAIN ] SNV: Generated 1820 derivative records from 49816 primary records. [2025-10-17T22:44:53.416435] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-17T22:44:53.425288] [DEBUG] [MAIN ] SO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:53.431065] [INFO ] [MAIN ] SO: Generated 1820 derivative records from 54394 primary records. [2025-10-17T22:44:53.433147] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-17T22:44:53.448750] [DEBUG] [LOCAL ] SNX: Derivative data saved (1820 records). [2025-10-17T22:44:53.456025] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-10-17T22:44:53.460300] [INFO ] [MAIN ] Derivative Progress: 1696/2083 symbols completed. SNX took 1.2s. Estimated remaining: 2m 27s. Rate: 158.1 symbols/min [2025-10-17T22:44:53.464882] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:53.470301] [DEBUG] [LOCAL ] SNV: Derivative data saved (1820 records). [2025-10-17T22:44:53.472570] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-10-17T22:44:53.473094] [DEBUG] [LOCAL ] SO: Derivative data saved (1820 records). [2025-10-17T22:44:53.475956] [INFO ] [MAIN ] Derivative Progress: 1697/2083 symbols completed. SNV took 1.2s. Estimated remaining: 2m 26s. Rate: 158.1 symbols/min [2025-10-17T22:44:53.476199] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:53.476271] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-17T22:44:53.479600] [INFO ] [MAIN ] Derivative Progress: 1698/2083 symbols completed. SO took 1.2s. Estimated remaining: 2m 26s. Rate: 158.2 symbols/min [2025-10-17T22:44:53.480497] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:53.492684] [DEBUG] [LOCAL ] SOJC: Loaded 4852 existing records from primary storage. [2025-10-17T22:44:53.492869] [INFO ] [MAIN ] SOJC: Loaded 4852 primary data records. [2025-10-17T22:44:53.650190] [DEBUG] [LOCAL ] SOBO: Loaded 40006 existing records from primary storage. [2025-10-17T22:44:53.661258] [INFO ] [MAIN ] SOBO: Loaded 40006 primary data records. [2025-10-17T22:44:53.965571] [DEBUG] [LOCAL ] SOC: Loaded 51745 existing records from primary storage. [2025-10-17T22:44:53.969811] [INFO ] [MAIN ] SOC: Loaded 51745 primary data records. [2025-10-17T22:44:54.501187] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:54.502141] [INFO ] [MAIN ] SOJC: Generated 1820 derivative records from 4852 primary records. [2025-10-17T22:44:54.502331] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-17T22:44:54.524872] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1820 records). [2025-10-17T22:44:54.526134] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-17T22:44:54.529561] [INFO ] [MAIN ] Derivative Progress: 1699/2083 symbols completed. SOJC took 1.0s. Estimated remaining: 2m 26s. Rate: 158.1 symbols/min [2025-10-17T22:44:54.532798] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:54.562136] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:54.561781] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:54.563388] [INFO ] [MAIN ] SOC: Generated 1820 derivative records from 51745 primary records. [2025-10-17T22:44:54.563502] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-17T22:44:54.564407] [INFO ] [MAIN ] SOBO: Generated 1820 derivative records from 40006 primary records. [2025-10-17T22:44:54.565788] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-17T22:44:54.604791] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1820 records). [2025-10-17T22:44:54.604997] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-17T22:44:54.600359] [DEBUG] [LOCAL ] SOC: Derivative data saved (1820 records). [2025-10-17T22:44:54.607278] [INFO ] [MAIN ] Derivative Progress: 1700/2083 symbols completed. SOBO took 1.1s. Estimated remaining: 2m 25s. Rate: 158.1 symbols/min [2025-10-17T22:44:54.607616] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-17T22:44:54.613533] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:54.614271] [INFO ] [MAIN ] Derivative Progress: 1701/2083 symbols completed. SOC took 1.1s. Estimated remaining: 2m 25s. Rate: 158.2 symbols/min [2025-10-17T22:44:54.621049] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:54.620920] [DEBUG] [LOCAL ] SOJD: Loaded 13136 existing records from primary storage. [2025-10-17T22:44:54.621689] [INFO ] [MAIN ] SOJD: Loaded 13136 primary data records. [2025-10-17T22:44:54.735955] [DEBUG] [LOCAL ] SOJE: Loaded 8990 existing records from primary storage. [2025-10-17T22:44:54.739790] [INFO ] [MAIN ] SOJE: Loaded 8990 primary data records. [2025-10-17T22:44:54.781449] [DEBUG] [LOCAL ] SOL: Loaded 13596 existing records from primary storage. [2025-10-17T22:44:54.830253] [INFO ] [MAIN ] SOL: Loaded 13596 primary data records. [2025-10-17T22:44:55.639960] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:55.641407] [INFO ] [MAIN ] SOJD: Generated 1820 derivative records from 13136 primary records. [2025-10-17T22:44:55.641767] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-17T22:44:55.668367] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1820 records). [2025-10-17T22:44:55.669161] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-17T22:44:55.671562] [INFO ] [MAIN ] Derivative Progress: 1702/2083 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 25s. Rate: 158.1 symbols/min [2025-10-17T22:44:55.679973] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:55.689584] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:55.691056] [INFO ] [MAIN ] SOJE: Generated 1820 derivative records from 8990 primary records. [2025-10-17T22:44:55.691324] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-17T22:44:55.714953] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:55.721613] [INFO ] [MAIN ] SOL: Generated 1820 derivative records from 13596 primary records. [2025-10-17T22:44:55.723518] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-17T22:44:55.728506] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1820 records). [2025-10-17T22:44:55.728774] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-17T22:44:55.744617] [INFO ] [MAIN ] Derivative Progress: 1703/2083 symbols completed. SOJE took 1.1s. Estimated remaining: 2m 24s. Rate: 158.1 symbols/min [2025-10-17T22:44:55.745818] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:55.761987] [DEBUG] [LOCAL ] SOL: Derivative data saved (1820 records). [2025-10-17T22:44:55.762244] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-17T22:44:55.765543] [INFO ] [MAIN ] Derivative Progress: 1704/2083 symbols completed. SOL took 1.1s. Estimated remaining: 2m 24s. Rate: 158.2 symbols/min [2025-10-17T22:44:55.766229] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:55.787787] [DEBUG] [LOCAL ] SOLV: Loaded 44343 existing records from primary storage. [2025-10-17T22:44:55.788208] [INFO ] [MAIN ] SOLV: Loaded 44343 primary data records. [2025-10-17T22:44:56.067316] [DEBUG] [LOCAL ] SON: Loaded 44067 existing records from primary storage. [2025-10-17T22:44:56.067610] [INFO ] [MAIN ] SON: Loaded 44067 primary data records. [2025-10-17T22:44:56.099272] [DEBUG] [LOCAL ] SONY: Loaded 54159 existing records from primary storage. [2025-10-17T22:44:56.294420] [INFO ] [MAIN ] SONY: Loaded 54159 primary data records. [2025-10-17T22:44:57.048366] [DEBUG] [MAIN ] SOLV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:57.050327] [INFO ] [MAIN ] SOLV: Generated 1820 derivative records from 44343 primary records. [2025-10-17T22:44:57.050409] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-17T22:44:57.071978] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1820 records). [2025-10-17T22:44:57.072283] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-10-17T22:44:57.074267] [INFO ] [MAIN ] Derivative Progress: 1705/2083 symbols completed. SOLV took 1.4s. Estimated remaining: 2m 24s. Rate: 158.0 symbols/min [2025-10-17T22:44:57.074714] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:57.083625] [DEBUG] [LOCAL ] SOR: Loaded 2914 existing records from primary storage. [2025-10-17T22:44:57.083873] [INFO ] [MAIN ] SOR: Loaded 2914 primary data records. [2025-10-17T22:44:57.166084] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:57.199774] [INFO ] [MAIN ] SON: Generated 1820 derivative records from 44067 primary records. [2025-10-17T22:44:57.207250] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-17T22:44:57.458078] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:57.467781] [INFO ] [MAIN ] SONY: Generated 1820 derivative records from 54159 primary records. [2025-10-17T22:44:57.469465] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-17T22:44:57.472965] [DEBUG] [LOCAL ] SON: Derivative data saved (1820 records). [2025-10-17T22:44:57.485179] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-10-17T22:44:57.491729] [INFO ] [MAIN ] Derivative Progress: 1706/2083 symbols completed. SON took 1.7s. Estimated remaining: 2m 23s. Rate: 158.0 symbols/min [2025-10-17T22:44:57.492261] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:57.494031] [DEBUG] [LOCAL ] SONY: Derivative data saved (1820 records). [2025-10-17T22:44:57.494665] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-17T22:44:57.497933] [INFO ] [MAIN ] Derivative Progress: 1707/2083 symbols completed. SONY took 1.7s. Estimated remaining: 2m 23s. Rate: 158.1 symbols/min [2025-10-17T22:44:57.498342] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:57.507722] [DEBUG] [LOCAL ] SOS: Loaded 9578 existing records from primary storage. [2025-10-17T22:44:57.508231] [INFO ] [MAIN ] SOS: Loaded 9578 primary data records. [2025-10-17T22:44:57.623968] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:57.633675] [INFO ] [MAIN ] SOR: Generated 1820 derivative records from 2914 primary records. [2025-10-17T22:44:57.639041] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-17T22:44:57.848402] [DEBUG] [LOCAL ] SPB: Loaded 34547 existing records from primary storage. [2025-10-17T22:44:57.848757] [INFO ] [MAIN ] SPB: Loaded 34547 primary data records. [2025-10-17T22:44:57.848633] [DEBUG] [LOCAL ] SOR: Derivative data saved (1820 records). [2025-10-17T22:44:57.860236] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-17T22:44:57.888092] [INFO ] [MAIN ] Derivative Progress: 1708/2083 symbols completed. SOR took 0.8s. Estimated remaining: 2m 22s. Rate: 158.1 symbols/min [2025-10-17T22:44:58.165443] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:58.166580] [INFO ] [MAIN ] SOS: Generated 1820 derivative records from 9578 primary records. [2025-10-17T22:44:58.167021] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-17T22:44:58.184017] [DEBUG] [LOCAL ] SOS: Derivative data saved (1820 records). [2025-10-17T22:44:58.184242] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-17T22:44:58.186617] [INFO ] [MAIN ] Derivative Progress: 1709/2083 symbols completed. SOS took 0.7s. Estimated remaining: 2m 22s. Rate: 158.1 symbols/min [2025-10-17T22:44:58.201813] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:58.202391] [INFO ] [MAIN ] SPB: Generated 1820 derivative records from 34547 primary records. [2025-10-17T22:44:58.202449] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-17T22:44:58.217744] [DEBUG] [LOCAL ] SPB: Derivative data saved (1820 records). [2025-10-17T22:44:58.217801] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-17T22:44:58.219882] [INFO ] [MAIN ] Derivative Progress: 1710/2083 symbols completed. SPB took 0.7s. Estimated remaining: 2m 21s. Rate: 158.2 symbols/min [2025-10-17T22:44:58.220451] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:58.220559] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:58.220704] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:58.231472] [DEBUG] [LOCAL ] SPE: Loaded 6321 existing records from primary storage. [2025-10-17T22:44:58.231582] [INFO ] [MAIN ] SPE: Loaded 6321 primary data records. [2025-10-17T22:44:58.566034] [DEBUG] [LOCAL ] SPCE: Loaded 50750 existing records from primary storage. [2025-10-17T22:44:58.566418] [INFO ] [MAIN ] SPCE: Loaded 50750 primary data records. [2025-10-17T22:44:58.689762] [DEBUG] [LOCAL ] SPG: Loaded 50898 existing records from primary storage. [2025-10-17T22:44:58.730084] [INFO ] [MAIN ] SPG: Loaded 50898 primary data records. [2025-10-17T22:44:59.201353] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:59.203090] [INFO ] [MAIN ] SPE: Generated 1820 derivative records from 6321 primary records. [2025-10-17T22:44:59.203283] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-17T22:44:59.221207] [DEBUG] [LOCAL ] SPE: Derivative data saved (1820 records). [2025-10-17T22:44:59.221873] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-17T22:44:59.224375] [INFO ] [MAIN ] Derivative Progress: 1711/2083 symbols completed. SPE took 1.0s. Estimated remaining: 2m 21s. Rate: 158.0 symbols/min [2025-10-17T22:44:59.224741] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:59.242451] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:59.243183] [INFO ] [MAIN ] SPCE: Generated 1820 derivative records from 50750 primary records. [2025-10-17T22:44:59.243447] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-17T22:44:59.263758] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1820 records). [2025-10-17T22:44:59.264007] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-17T22:44:59.266815] [INFO ] [MAIN ] Derivative Progress: 1712/2083 symbols completed. SPCE took 1.0s. Estimated remaining: 2m 21s. Rate: 158.1 symbols/min [2025-10-17T22:44:59.279367] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:59.279975] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:44:59.291793] [INFO ] [MAIN ] SPG: Generated 1820 derivative records from 50898 primary records. [2025-10-17T22:44:59.292134] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-17T22:44:59.308113] [DEBUG] [LOCAL ] SPG: Derivative data saved (1820 records). [2025-10-17T22:44:59.308378] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-17T22:44:59.310831] [INFO ] [MAIN ] Derivative Progress: 1713/2083 symbols completed. SPG took 1.1s. Estimated remaining: 2m 20s. Rate: 158.2 symbols/min [2025-10-17T22:44:59.314460] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:44:59.331314] [DEBUG] [LOCAL ] SPGI: Loaded 46609 existing records from primary storage. [2025-10-17T22:44:59.331559] [INFO ] [MAIN ] SPGI: Loaded 46609 primary data records. [2025-10-17T22:44:59.377072] [DEBUG] [LOCAL ] SPH: Loaded 16862 existing records from primary storage. [2025-10-17T22:44:59.407578] [INFO ] [MAIN ] SPH: Loaded 16862 primary data records. [2025-10-17T22:44:59.701144] [DEBUG] [LOCAL ] SPHR: Loaded 41225 existing records from primary storage. [2025-10-17T22:44:59.717737] [INFO ] [MAIN ] SPHR: Loaded 41225 primary data records. [2025-10-17T22:45:00.357574] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:00.358608] [INFO ] [MAIN ] SPGI: Generated 1820 derivative records from 46609 primary records. [2025-10-17T22:45:00.359149] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-17T22:45:00.390969] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1820 records). [2025-10-17T22:45:00.391373] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:00.392180] [INFO ] [MAIN ] SPH: Generated 1820 derivative records from 16862 primary records. [2025-10-17T22:45:00.393122] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-17T22:45:00.396021] [INFO ] [MAIN ] Derivative Progress: 1714/2083 symbols completed. SPGI took 1.2s. Estimated remaining: 2m 20s. Rate: 158.0 symbols/min [2025-10-17T22:45:00.396950] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:00.396856] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-17T22:45:00.418519] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:00.419353] [INFO ] [MAIN ] SPHR: Generated 1820 derivative records from 41225 primary records. [2025-10-17T22:45:00.419529] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-17T22:45:00.444102] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1820 records). [2025-10-17T22:45:00.444708] [DEBUG] [LOCAL ] SPH: Derivative data saved (1820 records). [2025-10-17T22:45:00.444815] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-17T22:45:00.444865] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-17T22:45:00.447228] [INFO ] [MAIN ] Derivative Progress: 1715/2083 symbols completed. SPH took 1.2s. Estimated remaining: 2m 20s. Rate: 158.1 symbols/min [2025-10-17T22:45:00.449941] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:00.450272] [INFO ] [MAIN ] Derivative Progress: 1716/2083 symbols completed. SPHR took 1.1s. Estimated remaining: 2m 19s. Rate: 158.2 symbols/min [2025-10-17T22:45:00.450384] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:00.474950] [DEBUG] [LOCAL ] SPMC: Loaded 5342 existing records from primary storage. [2025-10-17T22:45:00.475299] [INFO ] [MAIN ] SPMC: Loaded 5342 primary data records. [2025-10-17T22:45:00.623009] [DEBUG] [LOCAL ] SPIR: Loaded 38185 existing records from primary storage. [2025-10-17T22:45:00.623789] [INFO ] [MAIN ] SPIR: Loaded 38185 primary data records. [2025-10-17T22:45:00.922836] [DEBUG] [LOCAL ] SPNT: Loaded 35165 existing records from primary storage. [2025-10-17T22:45:00.936719] [INFO ] [MAIN ] SPNT: Loaded 35165 primary data records. [2025-10-17T22:45:01.655015] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:01.657828] [INFO ] [MAIN ] SPMC: Generated 1820 derivative records from 5342 primary records. [2025-10-17T22:45:01.658185] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-17T22:45:01.683136] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1820 records). [2025-10-17T22:45:01.685577] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-17T22:45:01.690429] [INFO ] [MAIN ] Derivative Progress: 1717/2083 symbols completed. SPMC took 1.2s. Estimated remaining: 2m 19s. Rate: 158.0 symbols/min [2025-10-17T22:45:01.692519] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:01.707893] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:01.709715] [INFO ] [MAIN ] SPIR: Generated 1820 derivative records from 38185 primary records. [2025-10-17T22:45:01.710200] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-17T22:45:01.751080] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:01.752814] [INFO ] [MAIN ] SPNT: Generated 1820 derivative records from 35165 primary records. [2025-10-17T22:45:01.753862] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-17T22:45:01.753418] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1820 records). [2025-10-17T22:45:01.754059] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-17T22:45:01.758099] [INFO ] [MAIN ] Derivative Progress: 1718/2083 symbols completed. SPIR took 1.4s. Estimated remaining: 2m 19s. Rate: 158.1 symbols/min [2025-10-17T22:45:01.766907] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:01.806343] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1820 records). [2025-10-17T22:45:01.807117] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-17T22:45:01.809639] [INFO ] [MAIN ] Derivative Progress: 1719/2083 symbols completed. SPNT took 1.4s. Estimated remaining: 2m 18s. Rate: 158.1 symbols/min [2025-10-17T22:45:01.810101] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:01.837532] [DEBUG] [LOCAL ] SPOT: Loaded 51040 existing records from primary storage. [2025-10-17T22:45:01.838094] [INFO ] [MAIN ] SPOT: Loaded 51040 primary data records. [2025-10-17T22:45:01.878787] [DEBUG] [LOCAL ] SPRU: Loaded 10000 existing records from primary storage. [2025-10-17T22:45:01.905524] [INFO ] [MAIN ] SPRU: Loaded 10000 primary data records. [2025-10-17T22:45:02.019811] [DEBUG] [LOCAL ] SPR: Loaded 41640 existing records from primary storage. [2025-10-17T22:45:02.089923] [INFO ] [MAIN ] SPR: Loaded 41640 primary data records. [2025-10-17T22:45:02.988679] [DEBUG] [MAIN ] SPOT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:02.991323] [INFO ] [MAIN ] SPOT: Generated 1820 derivative records from 51040 primary records. [2025-10-17T22:45:02.991750] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-10-17T22:45:03.021113] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:03.022784] [INFO ] [MAIN ] SPRU: Generated 1820 derivative records from 10000 primary records. [2025-10-17T22:45:03.025017] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-17T22:45:03.037898] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1820 records). [2025-10-17T22:45:03.038576] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-10-17T22:45:03.047303] [INFO ] [MAIN ] Derivative Progress: 1720/2083 symbols completed. SPOT took 1.4s. Estimated remaining: 2m 18s. Rate: 157.9 symbols/min [2025-10-17T22:45:03.047793] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:03.049518] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:03.054165] [INFO ] [MAIN ] SPR: Generated 1820 derivative records from 41640 primary records. [2025-10-17T22:45:03.054412] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-17T22:45:03.074424] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1820 records). [2025-10-17T22:45:03.075207] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-10-17T22:45:03.078295] [DEBUG] [LOCAL ] SPR: Derivative data saved (1820 records). [2025-10-17T22:45:03.086369] [INFO ] [MAIN ] Derivative Progress: 1721/2083 symbols completed. SPRU took 1.3s. Estimated remaining: 2m 17s. Rate: 158.0 symbols/min [2025-10-17T22:45:03.086807] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-17T22:45:03.086984] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:03.090119] [INFO ] [MAIN ] Derivative Progress: 1722/2083 symbols completed. SPR took 1.3s. Estimated remaining: 2m 17s. Rate: 158.1 symbols/min [2025-10-17T22:45:03.090898] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:03.104407] [DEBUG] [LOCAL ] SPXC: Loaded 23724 existing records from primary storage. [2025-10-17T22:45:03.104621] [INFO ] [MAIN ] SPXC: Loaded 23724 primary data records. [2025-10-17T22:45:03.163984] [DEBUG] [LOCAL ] SPXX: Loaded 9463 existing records from primary storage. [2025-10-17T22:45:03.189843] [INFO ] [MAIN ] SPXX: Loaded 9463 primary data records. [2025-10-17T22:45:03.579027] [DEBUG] [LOCAL ] SQM: Loaded 49549 existing records from primary storage. [2025-10-17T22:45:03.605045] [INFO ] [MAIN ] SQM: Loaded 49549 primary data records. [2025-10-17T22:45:04.124706] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:04.126246] [INFO ] [MAIN ] SPXC: Generated 1820 derivative records from 23724 primary records. [2025-10-17T22:45:04.126469] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-17T22:45:04.159606] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:04.161147] [INFO ] [MAIN ] SPXX: Generated 1820 derivative records from 9463 primary records. [2025-10-17T22:45:04.161515] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1820 records). [2025-10-17T22:45:04.161706] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-17T22:45:04.161625] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-10-17T22:45:04.164243] [INFO ] [MAIN ] Derivative Progress: 1723/2083 symbols completed. SPXC took 1.1s. Estimated remaining: 2m 17s. Rate: 157.9 symbols/min [2025-10-17T22:45:04.196301] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:04.197354] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1820 records). [2025-10-17T22:45:04.198594] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-17T22:45:04.198527] [INFO ] [MAIN ] SQM: Generated 1820 derivative records from 49549 primary records. [2025-10-17T22:45:04.200901] [INFO ] [MAIN ] Derivative Progress: 1724/2083 symbols completed. SPXX took 1.1s. Estimated remaining: 2m 16s. Rate: 158.0 symbols/min [2025-10-17T22:45:04.201224] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-17T22:45:04.217841] [DEBUG] [LOCAL ] SQM: Derivative data saved (1820 records). [2025-10-17T22:45:04.217965] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-10-17T22:45:04.220205] [INFO ] [MAIN ] Derivative Progress: 1725/2083 symbols completed. SQM took 1.1s. Estimated remaining: 2m 16s. Rate: 158.1 symbols/min [2025-10-17T22:45:04.220799] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:04.220899] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:04.220723] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:04.259420] [DEBUG] [LOCAL ] SQNS: Loaded 27898 existing records from primary storage. [2025-10-17T22:45:04.259747] [INFO ] [MAIN ] SQNS: Loaded 27898 primary data records. [2025-10-17T22:45:04.384107] [DEBUG] [LOCAL ] SR: Loaded 32870 existing records from primary storage. [2025-10-17T22:45:04.384313] [INFO ] [MAIN ] SR: Loaded 32870 primary data records. [2025-10-17T22:45:04.576100] [DEBUG] [LOCAL ] SRE: Loaded 54192 existing records from primary storage. [2025-10-17T22:45:04.682301] [INFO ] [MAIN ] SRE: Loaded 54192 primary data records. [2025-10-17T22:45:05.231943] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:05.232869] [INFO ] [MAIN ] SQNS: Generated 1820 derivative records from 27898 primary records. [2025-10-17T22:45:05.233027] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-17T22:45:05.263897] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:05.265413] [INFO ] [MAIN ] SR: Generated 1820 derivative records from 32870 primary records. [2025-10-17T22:45:05.265567] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-17T22:45:05.268132] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1820 records). [2025-10-17T22:45:05.269970] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-17T22:45:05.280741] [INFO ] [MAIN ] Derivative Progress: 1726/2083 symbols completed. SQNS took 1.1s. Estimated remaining: 2m 16s. Rate: 157.9 symbols/min [2025-10-17T22:45:05.280987] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:05.300823] [DEBUG] [LOCAL ] SR: Derivative data saved (1820 records). [2025-10-17T22:45:05.301089] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-17T22:45:05.303718] [INFO ] [MAIN ] Derivative Progress: 1727/2083 symbols completed. SR took 1.1s. Estimated remaining: 2m 15s. Rate: 158.0 symbols/min [2025-10-17T22:45:05.301474] [DEBUG] [MAIN ] SRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:05.304762] [INFO ] [MAIN ] SRE: Generated 1820 derivative records from 54192 primary records. [2025-10-17T22:45:05.303891] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:05.304978] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-17T22:45:05.329488] [DEBUG] [LOCAL ] SRE: Derivative data saved (1820 records). [2025-10-17T22:45:05.329981] [DEBUG] [LOCAL ] SREA: Loaded 10096 existing records from primary storage. [2025-10-17T22:45:05.329736] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-17T22:45:05.330102] [INFO ] [MAIN ] SREA: Loaded 10096 primary data records. [2025-10-17T22:45:05.352569] [INFO ] [MAIN ] Derivative Progress: 1728/2083 symbols completed. SRE took 1.1s. Estimated remaining: 2m 15s. Rate: 158.1 symbols/min [2025-10-17T22:45:05.363200] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:05.701965] [DEBUG] [LOCAL ] SRG: Loaded 15640 existing records from primary storage. [2025-10-17T22:45:05.701287] [DEBUG] [LOCAL ] SRFM: Loaded 39823 existing records from primary storage. [2025-10-17T22:45:05.702524] [INFO ] [MAIN ] SRG: Loaded 15640 primary data records. [2025-10-17T22:45:05.702428] [INFO ] [MAIN ] SRFM: Loaded 39823 primary data records. [2025-10-17T22:45:06.354410] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:06.355888] [INFO ] [MAIN ] SREA: Generated 1820 derivative records from 10096 primary records. [2025-10-17T22:45:06.356167] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-17T22:45:06.378258] [DEBUG] [LOCAL ] SREA: Derivative data saved (1820 records). [2025-10-17T22:45:06.378785] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-17T22:45:06.381109] [INFO ] [MAIN ] Derivative Progress: 1729/2083 symbols completed. SREA took 1.1s. Estimated remaining: 2m 14s. Rate: 158.0 symbols/min [2025-10-17T22:45:06.381613] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:06.411574] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:45:06.412733] [INFO ] [MAIN ] SRFM: Generated 1819 derivative records from 39823 primary records. [2025-10-17T22:45:06.412865] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-17T22:45:06.426628] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:06.427676] [INFO ] [MAIN ] SRG: Generated 1820 derivative records from 15640 primary records. [2025-10-17T22:45:06.446571] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-17T22:45:06.448602] [DEBUG] [LOCAL ] SRI: Loaded 26831 existing records from primary storage. [2025-10-17T22:45:06.456820] [INFO ] [MAIN ] SRI: Loaded 26831 primary data records. [2025-10-17T22:45:06.482979] [DEBUG] [LOCAL ] SRG: Derivative data saved (1820 records). [2025-10-17T22:45:06.483133] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-17T22:45:06.491915] [INFO ] [MAIN ] Derivative Progress: 1730/2083 symbols completed. SRG took 1.1s. Estimated remaining: 2m 14s. Rate: 158.0 symbols/min [2025-10-17T22:45:06.492605] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:06.529011] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1819 records). [2025-10-17T22:45:06.556266] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-17T22:45:06.579520] [INFO ] [MAIN ] Derivative Progress: 1731/2083 symbols completed. SRFM took 1.3s. Estimated remaining: 2m 14s. Rate: 158.1 symbols/min [2025-10-17T22:45:06.579932] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:06.589790] [DEBUG] [LOCAL ] SRV: Loaded 7537 existing records from primary storage. [2025-10-17T22:45:06.600865] [INFO ] [MAIN ] SRV: Loaded 7537 primary data records. [2025-10-17T22:45:07.102541] [DEBUG] [LOCAL ] SSB: Loaded 43425 existing records from primary storage. [2025-10-17T22:45:07.103549] [INFO ] [MAIN ] SSB: Loaded 43425 primary data records. [2025-10-17T22:45:07.421851] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:07.423565] [INFO ] [MAIN ] SRI: Generated 1820 derivative records from 26831 primary records. [2025-10-17T22:45:07.423988] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-17T22:45:07.438252] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:07.440548] [INFO ] [MAIN ] SRV: Generated 1820 derivative records from 7537 primary records. [2025-10-17T22:45:07.449781] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-17T22:45:07.458351] [DEBUG] [LOCAL ] SRI: Derivative data saved (1820 records). [2025-10-17T22:45:07.465361] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-17T22:45:07.467996] [INFO ] [MAIN ] Derivative Progress: 1732/2083 symbols completed. SRI took 1.1s. Estimated remaining: 2m 13s. Rate: 158.0 symbols/min [2025-10-17T22:45:07.468865] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:07.479899] [DEBUG] [LOCAL ] SRV: Derivative data saved (1820 records). [2025-10-17T22:45:07.480453] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-17T22:45:07.482744] [INFO ] [MAIN ] Derivative Progress: 1733/2083 symbols completed. SRV took 1.0s. Estimated remaining: 2m 13s. Rate: 158.1 symbols/min [2025-10-17T22:45:07.483174] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:07.507053] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:07.507777] [INFO ] [MAIN ] SSB: Generated 1820 derivative records from 43425 primary records. [2025-10-17T22:45:07.514669] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-17T22:45:07.517046] [DEBUG] [LOCAL ] SSD: Loaded 22917 existing records from primary storage. [2025-10-17T22:45:07.524587] [INFO ] [MAIN ] SSD: Loaded 22917 primary data records. [2025-10-17T22:45:07.566088] [DEBUG] [LOCAL ] SSB: Derivative data saved (1820 records). [2025-10-17T22:45:07.612478] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-17T22:45:07.644522] [INFO ] [MAIN ] Derivative Progress: 1734/2083 symbols completed. SSB took 1.1s. Estimated remaining: 2m 12s. Rate: 158.1 symbols/min [2025-10-17T22:45:07.685949] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:07.687458] [DEBUG] [LOCAL ] SSL: Loaded 42084 existing records from primary storage. [2025-10-17T22:45:07.711093] [INFO ] [MAIN ] SSL: Loaded 42084 primary data records. [2025-10-17T22:45:08.197315] [DEBUG] [LOCAL ] SSTK: Loaded 25830 existing records from primary storage. [2025-10-17T22:45:08.205973] [INFO ] [MAIN ] SSTK: Loaded 25830 primary data records. [2025-10-17T22:45:08.523012] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:08.524127] [INFO ] [MAIN ] SSD: Generated 1820 derivative records from 22917 primary records. [2025-10-17T22:45:08.524303] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-17T22:45:08.542409] [DEBUG] [LOCAL ] SSD: Derivative data saved (1820 records). [2025-10-17T22:45:08.543982] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-10-17T22:45:08.547185] [INFO ] [MAIN ] Derivative Progress: 1735/2083 symbols completed. SSD took 1.1s. Estimated remaining: 2m 12s. Rate: 158.0 symbols/min [2025-10-17T22:45:08.548317] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:08.562527] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:08.564430] [INFO ] [MAIN ] SSL: Generated 1820 derivative records from 42084 primary records. [2025-10-17T22:45:08.564663] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-17T22:45:08.581684] [DEBUG] [LOCAL ] SSL: Derivative data saved (1820 records). [2025-10-17T22:45:08.582045] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-17T22:45:08.584263] [INFO ] [MAIN ] Derivative Progress: 1736/2083 symbols completed. SSL took 1.1s. Estimated remaining: 2m 12s. Rate: 158.1 symbols/min [2025-10-17T22:45:08.584448] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:08.600505] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:08.601199] [INFO ] [MAIN ] SSTK: Generated 1820 derivative records from 25830 primary records. [2025-10-17T22:45:08.601512] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-17T22:45:08.631403] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1820 records). [2025-10-17T22:45:08.631766] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-17T22:45:08.634386] [INFO ] [MAIN ] Derivative Progress: 1737/2083 symbols completed. SSTK took 0.9s. Estimated remaining: 2m 11s. Rate: 158.1 symbols/min [2025-10-17T22:45:08.634591] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:08.657953] [DEBUG] [LOCAL ] ST: Loaded 50556 existing records from primary storage. [2025-10-17T22:45:08.658285] [INFO ] [MAIN ] ST: Loaded 50556 primary data records. [2025-10-17T22:45:08.796583] [DEBUG] [LOCAL ] STC: Loaded 17534 existing records from primary storage. [2025-10-17T22:45:08.854243] [DEBUG] [LOCAL ] STAG: Loaded 50883 existing records from primary storage. [2025-10-17T22:45:08.849026] [INFO ] [MAIN ] STC: Loaded 17534 primary data records. [2025-10-17T22:45:08.869736] [INFO ] [MAIN ] STAG: Loaded 50883 primary data records. [2025-10-17T22:45:09.742520] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:09.743774] [INFO ] [MAIN ] ST: Generated 1820 derivative records from 50556 primary records. [2025-10-17T22:45:09.743951] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-17T22:45:09.765573] [DEBUG] [LOCAL ] ST: Derivative data saved (1820 records). [2025-10-17T22:45:09.765739] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-17T22:45:09.767911] [INFO ] [MAIN ] Derivative Progress: 1738/2083 symbols completed. ST took 1.2s. Estimated remaining: 2m 11s. Rate: 158.0 symbols/min [2025-10-17T22:45:09.781981] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:09.782743] [INFO ] [MAIN ] STC: Generated 1820 derivative records from 17534 primary records. [2025-10-17T22:45:09.782841] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-17T22:45:09.803096] [DEBUG] [LOCAL ] STC: Derivative data saved (1820 records). [2025-10-17T22:45:09.803192] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-17T22:45:09.805745] [INFO ] [MAIN ] Derivative Progress: 1739/2083 symbols completed. STC took 1.2s. Estimated remaining: 2m 11s. Rate: 158.0 symbols/min [2025-10-17T22:45:09.818923] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:09.819695] [INFO ] [MAIN ] STAG: Generated 1820 derivative records from 50883 primary records. [2025-10-17T22:45:09.819766] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-17T22:45:09.837347] [DEBUG] [LOCAL ] STAG: Derivative data saved (1820 records). [2025-10-17T22:45:09.837466] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-17T22:45:09.840164] [INFO ] [MAIN ] Derivative Progress: 1740/2083 symbols completed. STAG took 1.3s. Estimated remaining: 2m 10s. Rate: 158.1 symbols/min [2025-10-17T22:45:09.841068] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:09.841187] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:09.840981] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:09.868493] [DEBUG] [LOCAL ] STEL: Loaded 22979 existing records from primary storage. [2025-10-17T22:45:09.868681] [INFO ] [MAIN ] STEL: Loaded 22979 primary data records. [2025-10-17T22:45:10.022117] [DEBUG] [LOCAL ] STE: Loaded 35901 existing records from primary storage. [2025-10-17T22:45:10.034354] [INFO ] [MAIN ] STE: Loaded 35901 primary data records. [2025-10-17T22:45:10.079483] [DEBUG] [LOCAL ] STEM: Loaded 39412 existing records from primary storage. [2025-10-17T22:45:10.101363] [INFO ] [MAIN ] STEM: Loaded 39412 primary data records. [2025-10-17T22:45:10.853764] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:10.854912] [INFO ] [MAIN ] STEL: Generated 1820 derivative records from 22979 primary records. [2025-10-17T22:45:10.855128] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-17T22:45:10.874778] [DEBUG] [LOCAL ] STEL: Derivative data saved (1820 records). [2025-10-17T22:45:10.875212] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-17T22:45:10.879389] [INFO ] [MAIN ] Derivative Progress: 1741/2083 symbols completed. STEL took 1.0s. Estimated remaining: 2m 10s. Rate: 158.0 symbols/min [2025-10-17T22:45:10.880859] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:10.898671] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:10.900796] [INFO ] [MAIN ] STE: Generated 1820 derivative records from 35901 primary records. [2025-10-17T22:45:10.901062] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-10-17T22:45:10.929241] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:10.936127] [DEBUG] [LOCAL ] STE: Derivative data saved (1820 records). [2025-10-17T22:45:10.937043] [INFO ] [MAIN ] STEM: Generated 1820 derivative records from 39412 primary records. [2025-10-17T22:45:10.937324] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-17T22:45:10.937405] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-10-17T22:45:10.940804] [INFO ] [MAIN ] Derivative Progress: 1742/2083 symbols completed. STE took 1.1s. Estimated remaining: 2m 9s. Rate: 158.0 symbols/min [2025-10-17T22:45:10.949031] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:10.964412] [DEBUG] [LOCAL ] STEM: Derivative data saved (1820 records). [2025-10-17T22:45:10.964991] [DEBUG] [LOCAL ] STEW: Loaded 15838 existing records from primary storage. [2025-10-17T22:45:10.965365] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-17T22:45:10.967834] [INFO ] [MAIN ] STEW: Loaded 15838 primary data records. [2025-10-17T22:45:10.967685] [INFO ] [MAIN ] Derivative Progress: 1743/2083 symbols completed. STEM took 1.1s. Estimated remaining: 2m 9s. Rate: 158.1 symbols/min [2025-10-17T22:45:10.968063] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:11.060442] [DEBUG] [LOCAL ] STK: Loaded 9914 existing records from primary storage. [2025-10-17T22:45:11.060562] [INFO ] [MAIN ] STK: Loaded 9914 primary data records. [2025-10-17T22:45:11.640319] [DEBUG] [LOCAL ] STLA: Loaded 54335 existing records from primary storage. [2025-10-17T22:45:11.640813] [INFO ] [MAIN ] STLA: Loaded 54335 primary data records. [2025-10-17T22:45:11.966091] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:11.967240] [INFO ] [MAIN ] STEW: Generated 1820 derivative records from 15838 primary records. [2025-10-17T22:45:11.967500] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-17T22:45:11.997081] [DEBUG] [LOCAL ] STEW: Derivative data saved (1820 records). [2025-10-17T22:45:12.003575] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:12.003790] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-17T22:45:12.004892] [INFO ] [MAIN ] STK: Generated 1820 derivative records from 9914 primary records. [2025-10-17T22:45:12.007304] [INFO ] [MAIN ] Derivative Progress: 1744/2083 symbols completed. STEW took 1.1s. Estimated remaining: 2m 9s. Rate: 158.0 symbols/min [2025-10-17T22:45:12.007494] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:12.007600] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-17T22:45:12.024548] [DEBUG] [LOCAL ] STK: Derivative data saved (1820 records). [2025-10-17T22:45:12.025007] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-17T22:45:12.027560] [INFO ] [MAIN ] Derivative Progress: 1745/2083 symbols completed. STK took 1.1s. Estimated remaining: 2m 8s. Rate: 158.1 symbols/min [2025-10-17T22:45:12.027825] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:12.044214] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:12.044968] [INFO ] [MAIN ] STLA: Generated 1820 derivative records from 54335 primary records. [2025-10-17T22:45:12.045067] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-17T22:45:12.067565] [DEBUG] [LOCAL ] STLA: Derivative data saved (1820 records). [2025-10-17T22:45:12.067682] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-17T22:45:12.069865] [INFO ] [MAIN ] Derivative Progress: 1746/2083 symbols completed. STLA took 1.1s. Estimated remaining: 2m 8s. Rate: 158.1 symbols/min [2025-10-17T22:45:12.070041] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:12.078898] [DEBUG] [LOCAL ] STN: Loaded 23104 existing records from primary storage. [2025-10-17T22:45:12.079022] [INFO ] [MAIN ] STN: Loaded 23104 primary data records. [2025-10-17T22:45:12.302541] [DEBUG] [LOCAL ] STM: Loaded 54352 existing records from primary storage. [2025-10-17T22:45:12.408919] [INFO ] [MAIN ] STM: Loaded 54352 primary data records. [2025-10-17T22:45:12.529800] [DEBUG] [LOCAL ] STNG: Loaded 44277 existing records from primary storage. [2025-10-17T22:45:12.535063] [INFO ] [MAIN ] STNG: Loaded 44277 primary data records. [2025-10-17T22:45:13.037026] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:13.037981] [INFO ] [MAIN ] STN: Generated 1820 derivative records from 23104 primary records. [2025-10-17T22:45:13.038903] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-17T22:45:13.073099] [DEBUG] [LOCAL ] STN: Derivative data saved (1820 records). [2025-10-17T22:45:13.073310] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-17T22:45:13.076136] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:13.075726] [INFO ] [MAIN ] Derivative Progress: 1747/2083 symbols completed. STN took 1.0s. Estimated remaining: 2m 8s. Rate: 158.0 symbols/min [2025-10-17T22:45:13.077144] [INFO ] [MAIN ] STM: Generated 1820 derivative records from 54352 primary records. [2025-10-17T22:45:13.076298] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:13.077240] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-17T22:45:13.095054] [DEBUG] [LOCAL ] STM: Derivative data saved (1820 records). [2025-10-17T22:45:13.095314] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-17T22:45:13.099587] [INFO ] [MAIN ] Derivative Progress: 1748/2083 symbols completed. STM took 1.1s. Estimated remaining: 2m 7s. Rate: 158.1 symbols/min [2025-10-17T22:45:13.099804] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:13.108199] [DEBUG] [LOCAL ] STRV: Loaded 11268 existing records from primary storage. [2025-10-17T22:45:13.108500] [INFO ] [MAIN ] STRV: Loaded 11268 primary data records. [2025-10-17T22:45:13.132514] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:13.152956] [INFO ] [MAIN ] STNG: Generated 1820 derivative records from 44277 primary records. [2025-10-17T22:45:13.159635] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-17T22:45:13.229974] [DEBUG] [LOCAL ] STNG: Derivative data saved (1820 records). [2025-10-17T22:45:13.237470] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-17T22:45:13.243929] [INFO ] [MAIN ] Derivative Progress: 1749/2083 symbols completed. STNG took 1.2s. Estimated remaining: 2m 7s. Rate: 158.1 symbols/min [2025-10-17T22:45:13.244700] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:13.525224] [DEBUG] [LOCAL ] STT: Loaded 51813 existing records from primary storage. [2025-10-17T22:45:13.525757] [INFO ] [MAIN ] STT: Loaded 51813 primary data records. [2025-10-17T22:45:13.526594] [DEBUG] [LOCAL ] STVN: Loaded 27140 existing records from primary storage. [2025-10-17T22:45:13.537786] [INFO ] [MAIN ] STVN: Loaded 27140 primary data records. [2025-10-17T22:45:14.127301] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:45:14.129228] [INFO ] [MAIN ] STRV: Generated 1819 derivative records from 11268 primary records. [2025-10-17T22:45:14.129967] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-17T22:45:14.148080] [DEBUG] [LOCAL ] STRV: Derivative data saved (1819 records). [2025-10-17T22:45:14.148274] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-17T22:45:14.150498] [INFO ] [MAIN ] Derivative Progress: 1750/2083 symbols completed. STRV took 1.1s. Estimated remaining: 2m 6s. Rate: 158.0 symbols/min [2025-10-17T22:45:14.151434] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:14.174776] [DEBUG] [MAIN ] STT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:14.176027] [INFO ] [MAIN ] STT: Generated 1820 derivative records from 51813 primary records. [2025-10-17T22:45:14.176291] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-10-17T22:45:14.195796] [DEBUG] [LOCAL ] STT: Derivative data saved (1820 records). [2025-10-17T22:45:14.208587] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-10-17T22:45:14.208876] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:14.211130] [INFO ] [MAIN ] Derivative Progress: 1751/2083 symbols completed. STT took 1.1s. Estimated remaining: 2m 6s. Rate: 158.1 symbols/min [2025-10-17T22:45:14.212069] [INFO ] [MAIN ] STVN: Generated 1820 derivative records from 27140 primary records. [2025-10-17T22:45:14.212293] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:14.226272] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-17T22:45:14.230332] [DEBUG] [LOCAL ] STXD: Loaded 1262 existing records from primary storage. [2025-10-17T22:45:14.230870] [INFO ] [MAIN ] STXD: Loaded 1262 primary data records. [2025-10-17T22:45:14.376317] [DEBUG] [LOCAL ] STWD: Loaded 52750 existing records from primary storage. [2025-10-17T22:45:14.376451] [DEBUG] [LOCAL ] STVN: Derivative data saved (1820 records). [2025-10-17T22:45:14.387021] [INFO ] [MAIN ] STWD: Loaded 52750 primary data records. [2025-10-17T22:45:14.392362] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-17T22:45:14.483721] [INFO ] [MAIN ] Derivative Progress: 1752/2083 symbols completed. STVN took 1.2s. Estimated remaining: 2m 6s. Rate: 158.1 symbols/min [2025-10-17T22:45:14.633674] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:14.725866] [DEBUG] [LOCAL ] STXE: Loaded 2136 existing records from primary storage. [2025-10-17T22:45:14.754854] [INFO ] [MAIN ] STXE: Loaded 2136 primary data records. [2025-10-17T22:45:15.212680] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:45:15.214273] [INFO ] [MAIN ] STXD: Generated 1819 derivative records from 1262 primary records. [2025-10-17T22:45:15.214589] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-17T22:45:15.235968] [DEBUG] [LOCAL ] STXD: Derivative data saved (1819 records). [2025-10-17T22:45:15.236333] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-17T22:45:15.238559] [INFO ] [MAIN ] Derivative Progress: 1753/2083 symbols completed. STXD took 1.0s. Estimated remaining: 2m 5s. Rate: 158.0 symbols/min [2025-10-17T22:45:15.252942] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:15.253895] [INFO ] [MAIN ] STWD: Generated 1820 derivative records from 52750 primary records. [2025-10-17T22:45:15.254092] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-17T22:45:15.273021] [DEBUG] [LOCAL ] STWD: Derivative data saved (1820 records). [2025-10-17T22:45:15.274121] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-17T22:45:15.277435] [INFO ] [MAIN ] Derivative Progress: 1754/2083 symbols completed. STWD took 1.1s. Estimated remaining: 2m 5s. Rate: 158.1 symbols/min [2025-10-17T22:45:15.291376] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:45:15.291998] [INFO ] [MAIN ] STXE: Generated 1819 derivative records from 2136 primary records. [2025-10-17T22:45:15.292059] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-17T22:45:15.305933] [DEBUG] [LOCAL ] STXE: Derivative data saved (1819 records). [2025-10-17T22:45:15.306005] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-17T22:45:15.308434] [INFO ] [MAIN ] Derivative Progress: 1755/2083 symbols completed. STXE took 0.7s. Estimated remaining: 2m 4s. Rate: 158.2 symbols/min [2025-10-17T22:45:15.309018] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:15.309164] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:15.308942] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:15.316074] [DEBUG] [LOCAL ] STXK: Loaded 1548 existing records from primary storage. [2025-10-17T22:45:15.318543] [DEBUG] [LOCAL ] STXG: Loaded 2452 existing records from primary storage. [2025-10-17T22:45:15.316300] [INFO ] [MAIN ] STXK: Loaded 1548 primary data records. [2025-10-17T22:45:15.341295] [DEBUG] [LOCAL ] STXT: Loaded 2537 existing records from primary storage. [2025-10-17T22:45:15.329973] [INFO ] [MAIN ] STXG: Loaded 2452 primary data records. [2025-10-17T22:45:15.374761] [INFO ] [MAIN ] STXT: Loaded 2537 primary data records. [2025-10-17T22:45:16.340923] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:45:16.355583] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:16.355286] [INFO ] [MAIN ] STXK: Generated 1819 derivative records from 1548 primary records. [2025-10-17T22:45:16.355846] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:45:16.356474] [INFO ] [MAIN ] STXG: Generated 1819 derivative records from 2452 primary records. [2025-10-17T22:45:16.357231] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-17T22:45:16.357083] [INFO ] [MAIN ] STXT: Generated 1820 derivative records from 2537 primary records. [2025-10-17T22:45:16.357183] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-17T22:45:16.357363] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-17T22:45:16.398039] [DEBUG] [LOCAL ] STXG: Derivative data saved (1819 records). [2025-10-17T22:45:16.399871] [DEBUG] [LOCAL ] STXK: Derivative data saved (1819 records). [2025-10-17T22:45:16.400598] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-17T22:45:16.403461] [INFO ] [MAIN ] Derivative Progress: 1756/2083 symbols completed. STXG took 1.1s. Estimated remaining: 2m 4s. Rate: 158.0 symbols/min [2025-10-17T22:45:16.401098] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-17T22:45:16.405968] [INFO ] [MAIN ] Derivative Progress: 1757/2083 symbols completed. STXK took 1.1s. Estimated remaining: 2m 4s. Rate: 158.1 symbols/min [2025-10-17T22:45:16.403614] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:16.407489] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:16.409199] [DEBUG] [LOCAL ] STXT: Derivative data saved (1820 records). [2025-10-17T22:45:16.409342] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-17T22:45:16.411633] [INFO ] [MAIN ] Derivative Progress: 1758/2083 symbols completed. STXT took 1.1s. Estimated remaining: 2m 3s. Rate: 158.2 symbols/min [2025-10-17T22:45:16.412419] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:16.415180] [DEBUG] [LOCAL ] STXV: Loaded 1542 existing records from primary storage. [2025-10-17T22:45:16.415336] [INFO ] [MAIN ] STXV: Loaded 1542 primary data records. [2025-10-17T22:45:16.774816] [DEBUG] [LOCAL ] SU: Loaded 54206 existing records from primary storage. [2025-10-17T22:45:16.775715] [INFO ] [MAIN ] SU: Loaded 54206 primary data records. [2025-10-17T22:45:16.839737] [DEBUG] [LOCAL ] STZ: Loaded 53184 existing records from primary storage. [2025-10-17T22:45:16.857900] [INFO ] [MAIN ] STZ: Loaded 53184 primary data records. [2025-10-17T22:45:17.482795] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:45:17.484538] [INFO ] [MAIN ] STXV: Generated 1819 derivative records from 1542 primary records. [2025-10-17T22:45:17.484805] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-17T22:45:17.502308] [DEBUG] [LOCAL ] STXV: Derivative data saved (1819 records). [2025-10-17T22:45:17.502394] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-17T22:45:17.504881] [INFO ] [MAIN ] Derivative Progress: 1759/2083 symbols completed. STXV took 1.1s. Estimated remaining: 2m 3s. Rate: 158.0 symbols/min [2025-10-17T22:45:17.505378] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:17.522945] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:17.523682] [INFO ] [MAIN ] SU: Generated 1820 derivative records from 54206 primary records. [2025-10-17T22:45:17.523847] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-17T22:45:17.555133] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:17.556781] [INFO ] [MAIN ] STZ: Generated 1820 derivative records from 53184 primary records. [2025-10-17T22:45:17.557359] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-10-17T22:45:17.559279] [DEBUG] [LOCAL ] SU: Derivative data saved (1820 records). [2025-10-17T22:45:17.560107] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-17T22:45:17.562297] [INFO ] [MAIN ] Derivative Progress: 1760/2083 symbols completed. SU took 1.1s. Estimated remaining: 2m 3s. Rate: 158.1 symbols/min [2025-10-17T22:45:17.562441] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:17.589173] [DEBUG] [LOCAL ] STZ: Derivative data saved (1820 records). [2025-10-17T22:45:17.589451] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-10-17T22:45:17.591916] [INFO ] [MAIN ] Derivative Progress: 1761/2083 symbols completed. STZ took 1.2s. Estimated remaining: 2m 2s. Rate: 158.2 symbols/min [2025-10-17T22:45:17.592257] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:17.614028] [DEBUG] [LOCAL ] SUI: Loaded 42659 existing records from primary storage. [2025-10-17T22:45:17.614175] [INFO ] [MAIN ] SUI: Loaded 42659 primary data records. [2025-10-17T22:45:17.803305] [DEBUG] [LOCAL ] SUN: Loaded 39035 existing records from primary storage. [2025-10-17T22:45:17.943146] [INFO ] [MAIN ] SUN: Loaded 39035 primary data records. [2025-10-17T22:45:17.988836] [DEBUG] [LOCAL ] SUPV: Loaded 48638 existing records from primary storage. [2025-10-17T22:45:18.001248] [INFO ] [MAIN ] SUPV: Loaded 48638 primary data records. [2025-10-17T22:45:18.584472] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:18.586292] [INFO ] [MAIN ] SUI: Generated 1820 derivative records from 42659 primary records. [2025-10-17T22:45:18.586923] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-17T22:45:18.605043] [DEBUG] [LOCAL ] SUI: Derivative data saved (1820 records). [2025-10-17T22:45:18.605372] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-17T22:45:18.607999] [INFO ] [MAIN ] Derivative Progress: 1762/2083 symbols completed. SUI took 1.1s. Estimated remaining: 2m 2s. Rate: 158.0 symbols/min [2025-10-17T22:45:18.608298] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:18.630796] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:18.631993] [INFO ] [MAIN ] SUN: Generated 1820 derivative records from 39035 primary records. [2025-10-17T22:45:18.632293] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-17T22:45:18.673451] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:18.675000] [INFO ] [MAIN ] SUPV: Generated 1820 derivative records from 48638 primary records. [2025-10-17T22:45:18.675127] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-17T22:45:18.678036] [DEBUG] [LOCAL ] SUN: Derivative data saved (1820 records). [2025-10-17T22:45:18.686182] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-17T22:45:18.688451] [INFO ] [MAIN ] Derivative Progress: 1763/2083 symbols completed. SUN took 1.1s. Estimated remaining: 2m 1s. Rate: 158.1 symbols/min [2025-10-17T22:45:18.696699] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1820 records). [2025-10-17T22:45:18.695444] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:18.697209] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-17T22:45:18.699753] [INFO ] [MAIN ] Derivative Progress: 1764/2083 symbols completed. SUPV took 1.1s. Estimated remaining: 2m 1s. Rate: 158.2 symbols/min [2025-10-17T22:45:18.699987] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:18.714661] [DEBUG] [LOCAL ] SUZ: Loaded 46367 existing records from primary storage. [2025-10-17T22:45:18.714812] [INFO ] [MAIN ] SUZ: Loaded 46367 primary data records. [2025-10-17T22:45:19.052920] [DEBUG] [LOCAL ] SVV: Loaded 40914 existing records from primary storage. [2025-10-17T22:45:19.067427] [INFO ] [MAIN ] SVV: Loaded 40914 primary data records. [2025-10-17T22:45:19.104455] [DEBUG] [LOCAL ] SW: Loaded 53965 existing records from primary storage. [2025-10-17T22:45:19.112094] [INFO ] [MAIN ] SW: Loaded 53965 primary data records. [2025-10-17T22:45:19.595103] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:19.723237] [INFO ] [MAIN ] SUZ: Generated 1820 derivative records from 46367 primary records. [2025-10-17T22:45:19.723510] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-17T22:45:19.742876] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1820 records). [2025-10-17T22:45:19.744879] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-17T22:45:19.747935] [INFO ] [MAIN ] Derivative Progress: 1765/2083 symbols completed. SUZ took 1.1s. Estimated remaining: 2m 1s. Rate: 158.0 symbols/min [2025-10-17T22:45:19.749093] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:19.776186] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:19.777244] [INFO ] [MAIN ] SW: Generated 1820 derivative records from 53965 primary records. [2025-10-17T22:45:19.790218] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-17T22:45:19.791329] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:19.792136] [INFO ] [MAIN ] SVV: Generated 1820 derivative records from 40914 primary records. [2025-10-17T22:45:19.799542] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-17T22:45:19.808102] [DEBUG] [LOCAL ] SW: Derivative data saved (1820 records). [2025-10-17T22:45:19.808379] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-17T22:45:19.818492] [INFO ] [MAIN ] Derivative Progress: 1766/2083 symbols completed. SW took 1.1s. Estimated remaining: 2m 0s. Rate: 158.1 symbols/min [2025-10-17T22:45:19.819723] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:19.841440] [DEBUG] [LOCAL ] SVV: Derivative data saved (1820 records). [2025-10-17T22:45:19.841723] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-17T22:45:19.843613] [INFO ] [MAIN ] Derivative Progress: 1767/2083 symbols completed. SVV took 1.1s. Estimated remaining: 1m 60s. Rate: 158.2 symbols/min [2025-10-17T22:45:19.857489] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:19.859922] [DEBUG] [LOCAL ] SWK: Loaded 53219 existing records from primary storage. [2025-10-17T22:45:19.860066] [INFO ] [MAIN ] SWK: Loaded 53219 primary data records. [2025-10-17T22:45:20.010277] [DEBUG] [LOCAL ] SWX: Loaded 31339 existing records from primary storage. [2025-10-17T22:45:20.039258] [INFO ] [MAIN ] SWX: Loaded 31339 primary data records. [2025-10-17T22:45:20.300963] [DEBUG] [LOCAL ] SXC: Loaded 42228 existing records from primary storage. [2025-10-17T22:45:20.305559] [INFO ] [MAIN ] SXC: Loaded 42228 primary data records. [2025-10-17T22:45:20.843911] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:20.847419] [INFO ] [MAIN ] SWK: Generated 1820 derivative records from 53219 primary records. [2025-10-17T22:45:20.848592] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-17T22:45:20.876209] [DEBUG] [LOCAL ] SWK: Derivative data saved (1820 records). [2025-10-17T22:45:20.876504] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-17T22:45:20.880278] [INFO ] [MAIN ] Derivative Progress: 1768/2083 symbols completed. SWK took 1.1s. Estimated remaining: 1m 60s. Rate: 158.0 symbols/min [2025-10-17T22:45:20.900680] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:20.914000] [INFO ] [MAIN ] SWX: Generated 1820 derivative records from 31339 primary records. [2025-10-17T22:45:20.914437] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-17T22:45:20.914326] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:20.915988] [INFO ] [MAIN ] SXC: Generated 1820 derivative records from 42228 primary records. [2025-10-17T22:45:20.916085] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-17T22:45:20.946012] [DEBUG] [LOCAL ] SXC: Derivative data saved (1820 records). [2025-10-17T22:45:20.946124] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-17T22:45:20.948732] [INFO ] [MAIN ] Derivative Progress: 1769/2083 symbols completed. SXC took 1.1s. Estimated remaining: 1m 59s. Rate: 158.1 symbols/min [2025-10-17T22:45:20.953026] [DEBUG] [LOCAL ] SWX: Derivative data saved (1820 records). [2025-10-17T22:45:20.953203] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-17T22:45:20.955803] [INFO ] [MAIN ] Derivative Progress: 1770/2083 symbols completed. SWX took 1.1s. Estimated remaining: 1m 59s. Rate: 158.2 symbols/min [2025-10-17T22:45:20.956298] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:20.956498] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:20.956435] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:20.988808] [DEBUG] [LOCAL ] SXI: Loaded 12191 existing records from primary storage. [2025-10-17T22:45:20.988995] [INFO ] [MAIN ] SXI: Loaded 12191 primary data records. [2025-10-17T22:45:21.116374] [DEBUG] [LOCAL ] SXT: Loaded 30246 existing records from primary storage. [2025-10-17T22:45:21.122719] [INFO ] [MAIN ] SXT: Loaded 30246 primary data records. [2025-10-17T22:45:21.481255] [DEBUG] [LOCAL ] SYF: Loaded 54234 existing records from primary storage. [2025-10-17T22:45:21.492840] [INFO ] [MAIN ] SYF: Loaded 54234 primary data records. [2025-10-17T22:45:22.003284] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:22.004794] [INFO ] [MAIN ] SXI: Generated 1820 derivative records from 12191 primary records. [2025-10-17T22:45:22.005030] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-17T22:45:22.022764] [DEBUG] [LOCAL ] SXI: Derivative data saved (1820 records). [2025-10-17T22:45:22.023024] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-17T22:45:22.025159] [INFO ] [MAIN ] Derivative Progress: 1771/2083 symbols completed. SXI took 1.1s. Estimated remaining: 1m 58s. Rate: 158.0 symbols/min [2025-10-17T22:45:22.027552] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:22.043619] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:22.044480] [INFO ] [MAIN ] SXT: Generated 1820 derivative records from 30246 primary records. [2025-10-17T22:45:22.044876] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-17T22:45:22.063332] [DEBUG] [LOCAL ] SXT: Derivative data saved (1820 records). [2025-10-17T22:45:22.064216] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-17T22:45:22.066142] [INFO ] [MAIN ] Derivative Progress: 1772/2083 symbols completed. SXT took 1.1s. Estimated remaining: 1m 58s. Rate: 158.1 symbols/min [2025-10-17T22:45:22.066521] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:22.081537] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:22.082296] [INFO ] [MAIN ] SYF: Generated 1820 derivative records from 54234 primary records. [2025-10-17T22:45:22.082357] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-17T22:45:22.099139] [DEBUG] [LOCAL ] SYF: Derivative data saved (1820 records). [2025-10-17T22:45:22.099377] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-10-17T22:45:22.101505] [INFO ] [MAIN ] Derivative Progress: 1773/2083 symbols completed. SYF took 1.1s. Estimated remaining: 1m 58s. Rate: 158.2 symbols/min [2025-10-17T22:45:22.101785] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:22.145323] [DEBUG] [LOCAL ] SYK: Loaded 47627 existing records from primary storage. [2025-10-17T22:45:22.145580] [INFO ] [MAIN ] SYK: Loaded 47627 primary data records. [2025-10-17T22:45:22.263521] [DEBUG] [LOCAL ] SYY: Loaded 53990 existing records from primary storage. [2025-10-17T22:45:22.269492] [INFO ] [MAIN ] SYY: Loaded 53990 primary data records. [2025-10-17T22:45:22.646704] [DEBUG] [LOCAL ] T: Loaded 54578 existing records from primary storage. [2025-10-17T22:45:22.671525] [INFO ] [MAIN ] T: Loaded 54578 primary data records. [2025-10-17T22:45:23.164274] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:23.165868] [INFO ] [MAIN ] SYK: Generated 1820 derivative records from 47627 primary records. [2025-10-17T22:45:23.166619] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-17T22:45:23.187478] [DEBUG] [LOCAL ] SYK: Derivative data saved (1820 records). [2025-10-17T22:45:23.187672] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-17T22:45:23.189633] [INFO ] [MAIN ] Derivative Progress: 1774/2083 symbols completed. SYK took 1.2s. Estimated remaining: 1m 57s. Rate: 158.0 symbols/min [2025-10-17T22:45:23.202668] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:23.203633] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:23.204676] [INFO ] [MAIN ] SYY: Generated 1820 derivative records from 53990 primary records. [2025-10-17T22:45:23.204850] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-17T22:45:23.221386] [DEBUG] [LOCAL ] SYY: Derivative data saved (1820 records). [2025-10-17T22:45:23.221536] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-17T22:45:23.223684] [INFO ] [MAIN ] Derivative Progress: 1775/2083 symbols completed. SYY took 1.2s. Estimated remaining: 1m 57s. Rate: 158.1 symbols/min [2025-10-17T22:45:23.223924] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:23.240460] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:23.241181] [INFO ] [MAIN ] T: Generated 1820 derivative records from 54578 primary records. [2025-10-17T22:45:23.241318] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-17T22:45:23.258289] [DEBUG] [LOCAL ] T: Derivative data saved (1820 records). [2025-10-17T22:45:23.258484] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-17T22:45:23.260855] [INFO ] [MAIN ] Derivative Progress: 1776/2083 symbols completed. T took 1.2s. Estimated remaining: 1m 56s. Rate: 158.2 symbols/min [2025-10-17T22:45:23.261118] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:23.301471] [DEBUG] [LOCAL ] TAC: Loaded 43866 existing records from primary storage. [2025-10-17T22:45:23.301731] [INFO ] [MAIN ] TAC: Loaded 43866 primary data records. [2025-10-17T22:45:23.431902] [DEBUG] [LOCAL ] TAK: Loaded 50897 existing records from primary storage. [2025-10-17T22:45:23.468664] [INFO ] [MAIN ] TAK: Loaded 50897 primary data records. [2025-10-17T22:45:23.732062] [DEBUG] [LOCAL ] TAL: Loaded 52497 existing records from primary storage. [2025-10-17T22:45:23.744221] [INFO ] [MAIN ] TAL: Loaded 52497 primary data records. [2025-10-17T22:45:24.253081] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:24.255071] [INFO ] [MAIN ] TAC: Generated 1820 derivative records from 43866 primary records. [2025-10-17T22:45:24.255992] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-17T22:45:24.277268] [DEBUG] [LOCAL ] TAC: Derivative data saved (1820 records). [2025-10-17T22:45:24.277525] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-17T22:45:24.279672] [INFO ] [MAIN ] Derivative Progress: 1777/2083 symbols completed. TAC took 1.1s. Estimated remaining: 1m 56s. Rate: 158.0 symbols/min [2025-10-17T22:45:24.280011] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:24.297032] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:24.297934] [INFO ] [MAIN ] TAK: Generated 1820 derivative records from 50897 primary records. [2025-10-17T22:45:24.298061] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-17T22:45:24.316516] [DEBUG] [LOCAL ] TAK: Derivative data saved (1820 records). [2025-10-17T22:45:24.328837] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-17T22:45:24.331218] [INFO ] [MAIN ] Derivative Progress: 1778/2083 symbols completed. TAK took 1.1s. Estimated remaining: 1m 56s. Rate: 158.1 symbols/min [2025-10-17T22:45:24.329103] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:24.332188] [INFO ] [MAIN ] TAL: Generated 1820 derivative records from 52497 primary records. [2025-10-17T22:45:24.332681] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-17T22:45:24.332804] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:24.365308] [DEBUG] [LOCAL ] TAL: Derivative data saved (1820 records). [2025-10-17T22:45:24.365611] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-17T22:45:24.367975] [INFO ] [MAIN ] Derivative Progress: 1779/2083 symbols completed. TAL took 1.1s. Estimated remaining: 1m 55s. Rate: 158.2 symbols/min [2025-10-17T22:45:24.368285] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:24.391770] [DEBUG] [LOCAL ] TALO: Loaded 51714 existing records from primary storage. [2025-10-17T22:45:24.392108] [INFO ] [MAIN ] TALO: Loaded 51714 primary data records. [2025-10-17T22:45:24.460942] [DEBUG] [LOCAL ] TBB: Loaded 11659 existing records from primary storage. [2025-10-17T22:45:24.484024] [INFO ] [MAIN ] TBB: Loaded 11659 primary data records. [2025-10-17T22:45:24.693129] [DEBUG] [LOCAL ] TAP: Loaded 53723 existing records from primary storage. [2025-10-17T22:45:24.725592] [INFO ] [MAIN ] TAP: Loaded 53723 primary data records. [2025-10-17T22:45:25.399584] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:25.400461] [INFO ] [MAIN ] TALO: Generated 1820 derivative records from 51714 primary records. [2025-10-17T22:45:25.401776] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-17T22:45:25.433946] [DEBUG] [LOCAL ] TALO: Derivative data saved (1820 records). [2025-10-17T22:45:25.434340] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-17T22:45:25.434626] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:25.436695] [INFO ] [MAIN ] Derivative Progress: 1780/2083 symbols completed. TALO took 1.2s. Estimated remaining: 1m 55s. Rate: 158.0 symbols/min [2025-10-17T22:45:25.437030] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:25.438079] [INFO ] [MAIN ] TBB: Generated 1820 derivative records from 11659 primary records. [2025-10-17T22:45:25.438487] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-17T22:45:25.457208] [DEBUG] [LOCAL ] TBB: Derivative data saved (1820 records). [2025-10-17T22:45:25.458967] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-10-17T22:45:25.461616] [INFO ] [MAIN ] Derivative Progress: 1781/2083 symbols completed. TBB took 1.1s. Estimated remaining: 1m 55s. Rate: 158.1 symbols/min [2025-10-17T22:45:25.461924] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:25.475364] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:25.476162] [INFO ] [MAIN ] TAP: Generated 1820 derivative records from 53723 primary records. [2025-10-17T22:45:25.476284] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-17T22:45:25.492813] [DEBUG] [LOCAL ] TAP: Derivative data saved (1820 records). [2025-10-17T22:45:25.493149] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-17T22:45:25.495381] [INFO ] [MAIN ] Derivative Progress: 1782/2083 symbols completed. TAP took 1.2s. Estimated remaining: 1m 54s. Rate: 158.2 symbols/min [2025-10-17T22:45:25.495570] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:25.516253] [DEBUG] [LOCAL ] TBN: Loaded 4058 existing records from primary storage. [2025-10-17T22:45:25.533907] [INFO ] [MAIN ] TBN: Loaded 4058 primary data records. [2025-10-17T22:45:25.545825] [DEBUG] [LOCAL ] TBBB: Loaded 36273 existing records from primary storage. [2025-10-17T22:45:25.555278] [DEBUG] [LOCAL ] TBI: Loaded 22962 existing records from primary storage. [2025-10-17T22:45:25.576879] [INFO ] [MAIN ] TBI: Loaded 22962 primary data records. [2025-10-17T22:45:25.588610] [INFO ] [MAIN ] TBBB: Loaded 36273 primary data records. [2025-10-17T22:45:26.477719] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:26.472608] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:26.480324] [INFO ] [MAIN ] TBN: Generated 1820 derivative records from 4058 primary records. [2025-10-17T22:45:26.481679] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-17T22:45:26.480931] [INFO ] [MAIN ] TBBB: Generated 1820 derivative records from 36273 primary records. [2025-10-17T22:45:26.482758] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-17T22:45:26.503790] [DEBUG] [LOCAL ] TBN: Derivative data saved (1820 records). [2025-10-17T22:45:26.519562] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-17T22:45:26.525771] [INFO ] [MAIN ] Derivative Progress: 1783/2083 symbols completed. TBN took 1.0s. Estimated remaining: 1m 54s. Rate: 158.0 symbols/min [2025-10-17T22:45:26.523746] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1820 records). [2025-10-17T22:45:26.526415] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-17T22:45:26.526322] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:26.529488] [INFO ] [MAIN ] TBI: Generated 1820 derivative records from 22962 primary records. [2025-10-17T22:45:26.529671] [INFO ] [MAIN ] Derivative Progress: 1784/2083 symbols completed. TBBB took 1.1s. Estimated remaining: 1m 53s. Rate: 158.1 symbols/min [2025-10-17T22:45:26.529754] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-17T22:45:26.544697] [DEBUG] [LOCAL ] TBI: Derivative data saved (1820 records). [2025-10-17T22:45:26.544755] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-17T22:45:26.546704] [INFO ] [MAIN ] Derivative Progress: 1785/2083 symbols completed. TBI took 1.1s. Estimated remaining: 1m 53s. Rate: 158.2 symbols/min [2025-10-17T22:45:26.547155] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:26.547104] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:26.547201] [INFO ] [MAIN ] TCBX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:26.560371] [DEBUG] [LOCAL ] TCBX: Loaded 10385 existing records from primary storage. [2025-10-17T22:45:26.560568] [INFO ] [MAIN ] TCBX: Loaded 10385 primary data records. [2025-10-17T22:45:26.891737] [DEBUG] [LOCAL ] TDC: Loaded 47237 existing records from primary storage. [2025-10-17T22:45:26.892071] [INFO ] [MAIN ] TDC: Loaded 47237 primary data records. [2025-10-17T22:45:26.996119] [DEBUG] [LOCAL ] TD: Loaded 53086 existing records from primary storage. [2025-10-17T22:45:27.009560] [INFO ] [MAIN ] TD: Loaded 53086 primary data records. [2025-10-17T22:45:27.571290] [DEBUG] [MAIN ] TCBX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:27.572326] [INFO ] [MAIN ] TCBX: Generated 1820 derivative records from 10385 primary records. [2025-10-17T22:45:27.572423] [DEBUG] [LOCAL ] TCBX: Saving derivative data. [2025-10-17T22:45:27.591442] [DEBUG] [LOCAL ] TCBX: Derivative data saved (1820 records). [2025-10-17T22:45:27.592042] [INFO ] [MAIN ] TCBX: Successfully saved derivative data. [2025-10-17T22:45:27.594290] [INFO ] [MAIN ] Derivative Progress: 1786/2083 symbols completed. TCBX took 1.0s. Estimated remaining: 1m 53s. Rate: 158.1 symbols/min [2025-10-17T22:45:27.594708] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:27.608178] [DEBUG] [LOCAL ] TDF: Loaded 6421 existing records from primary storage. [2025-10-17T22:45:27.621245] [INFO ] [MAIN ] TDF: Loaded 6421 primary data records. [2025-10-17T22:45:27.633346] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:27.643999] [INFO ] [MAIN ] TDC: Generated 1820 derivative records from 47237 primary records. [2025-10-17T22:45:27.659522] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-17T22:45:27.734397] [DEBUG] [LOCAL ] TDC: Derivative data saved (1820 records). [2025-10-17T22:45:27.746688] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-17T22:45:27.748688] [INFO ] [MAIN ] Derivative Progress: 1787/2083 symbols completed. TDC took 1.2s. Estimated remaining: 1m 52s. Rate: 158.1 symbols/min [2025-10-17T22:45:27.762117] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:27.762461] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:27.779314] [INFO ] [MAIN ] TD: Generated 1820 derivative records from 53086 primary records. [2025-10-17T22:45:27.789778] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-17T22:45:27.863200] [DEBUG] [LOCAL ] TD: Derivative data saved (1820 records). [2025-10-17T22:45:27.978540] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-17T22:45:27.994506] [INFO ] [MAIN ] Derivative Progress: 1788/2083 symbols completed. TD took 1.4s. Estimated remaining: 1m 52s. Rate: 158.1 symbols/min [2025-10-17T22:45:27.995445] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:28.007928] [DEBUG] [LOCAL ] TDG: Loaded 22499 existing records from primary storage. [2025-10-17T22:45:28.008321] [INFO ] [MAIN ] TDG: Loaded 22499 primary data records. [2025-10-17T22:45:28.336030] [DEBUG] [LOCAL ] TDOC: Loaded 54145 existing records from primary storage. [2025-10-17T22:45:28.337061] [INFO ] [MAIN ] TDOC: Loaded 54145 primary data records. [2025-10-17T22:45:28.388782] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:28.419087] [INFO ] [MAIN ] TDF: Generated 1820 derivative records from 6421 primary records. [2025-10-17T22:45:28.431246] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-17T22:45:28.513263] [DEBUG] [LOCAL ] TDF: Derivative data saved (1820 records). [2025-10-17T22:45:28.517014] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-17T22:45:28.524120] [INFO ] [MAIN ] Derivative Progress: 1789/2083 symbols completed. TDF took 0.9s. Estimated remaining: 1m 52s. Rate: 158.1 symbols/min [2025-10-17T22:45:28.524429] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:28.692149] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:28.693214] [INFO ] [MAIN ] TDG: Generated 1820 derivative records from 22499 primary records. [2025-10-17T22:45:28.693296] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-17T22:45:28.734377] [DEBUG] [LOCAL ] TDG: Derivative data saved (1820 records). [2025-10-17T22:45:28.734663] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-17T22:45:28.737665] [INFO ] [MAIN ] Derivative Progress: 1790/2083 symbols completed. TDG took 1.0s. Estimated remaining: 1m 51s. Rate: 158.1 symbols/min [2025-10-17T22:45:28.735360] [DEBUG] [LOCAL ] TDS: Loaded 43099 existing records from primary storage. [2025-10-17T22:45:28.738119] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:28.738014] [INFO ] [MAIN ] TDS: Loaded 43099 primary data records. [2025-10-17T22:45:28.918038] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:28.928041] [INFO ] [MAIN ] TDOC: Generated 1820 derivative records from 54145 primary records. [2025-10-17T22:45:28.936988] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-17T22:45:29.147723] [DEBUG] [LOCAL ] TDW: Loaded 45635 existing records from primary storage. [2025-10-17T22:45:29.148099] [INFO ] [MAIN ] TDW: Loaded 45635 primary data records. [2025-10-17T22:45:29.177673] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1820 records). [2025-10-17T22:45:29.223169] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-17T22:45:29.237707] [INFO ] [MAIN ] Derivative Progress: 1791/2083 symbols completed. TDOC took 1.2s. Estimated remaining: 1m 51s. Rate: 158.1 symbols/min [2025-10-17T22:45:29.243227] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:29.485565] [DEBUG] [LOCAL ] TDY: Loaded 22564 existing records from primary storage. [2025-10-17T22:45:29.487383] [INFO ] [MAIN ] TDY: Loaded 22564 primary data records. [2025-10-17T22:45:29.556735] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:29.583089] [INFO ] [MAIN ] TDS: Generated 1820 derivative records from 43099 primary records. [2025-10-17T22:45:29.605279] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-17T22:45:29.817497] [DEBUG] [LOCAL ] TDS: Derivative data saved (1820 records). [2025-10-17T22:45:29.817876] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-17T22:45:29.820050] [INFO ] [MAIN ] Derivative Progress: 1792/2083 symbols completed. TDS took 1.3s. Estimated remaining: 1m 50s. Rate: 158.1 symbols/min [2025-10-17T22:45:29.820401] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:29.840092] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:29.843596] [INFO ] [MAIN ] TDW: Generated 1820 derivative records from 45635 primary records. [2025-10-17T22:45:29.843779] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-17T22:45:29.865164] [DEBUG] [LOCAL ] TDW: Derivative data saved (1820 records). [2025-10-17T22:45:29.865427] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-17T22:45:29.864027] [DEBUG] [LOCAL ] TEAF: Loaded 7531 existing records from primary storage. [2025-10-17T22:45:29.867874] [INFO ] [MAIN ] Derivative Progress: 1793/2083 symbols completed. TDW took 1.1s. Estimated remaining: 1m 50s. Rate: 158.2 symbols/min [2025-10-17T22:45:29.868132] [INFO ] [MAIN ] TEAF: Loaded 7531 primary data records. [2025-10-17T22:45:29.879672] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:30.044683] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:30.062271] [INFO ] [MAIN ] TDY: Generated 1820 derivative records from 22564 primary records. [2025-10-17T22:45:30.062501] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-17T22:45:30.220329] [DEBUG] [LOCAL ] TDY: Derivative data saved (1820 records). [2025-10-17T22:45:30.220674] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-17T22:45:30.222720] [INFO ] [MAIN ] Derivative Progress: 1794/2083 symbols completed. TDY took 1.0s. Estimated remaining: 1m 50s. Rate: 158.2 symbols/min [2025-10-17T22:45:30.222957] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:30.243058] [DEBUG] [LOCAL ] TECK: Loaded 54213 existing records from primary storage. [2025-10-17T22:45:30.244267] [INFO ] [MAIN ] TECK: Loaded 54213 primary data records. [2025-10-17T22:45:30.420989] [DEBUG] [LOCAL ] TEF: Loaded 37415 existing records from primary storage. [2025-10-17T22:45:30.555574] [INFO ] [MAIN ] TEF: Loaded 37415 primary data records. [2025-10-17T22:45:30.603199] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:30.648331] [INFO ] [MAIN ] TEAF: Generated 1820 derivative records from 7531 primary records. [2025-10-17T22:45:30.685323] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-17T22:45:30.781927] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1820 records). [2025-10-17T22:45:30.902779] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-17T22:45:30.905365] [INFO ] [MAIN ] Derivative Progress: 1795/2083 symbols completed. TEAF took 1.1s. Estimated remaining: 1m 49s. Rate: 158.1 symbols/min [2025-10-17T22:45:30.905885] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:30.926461] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:30.927520] [INFO ] [MAIN ] TECK: Generated 1820 derivative records from 54213 primary records. [2025-10-17T22:45:30.927620] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-17T22:45:30.957310] [DEBUG] [LOCAL ] TEI: Loaded 21545 existing records from primary storage. [2025-10-17T22:45:30.958736] [INFO ] [MAIN ] TEI: Loaded 21545 primary data records. [2025-10-17T22:45:30.959044] [DEBUG] [LOCAL ] TECK: Derivative data saved (1820 records). [2025-10-17T22:45:30.970182] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-17T22:45:30.972184] [INFO ] [MAIN ] Derivative Progress: 1796/2083 symbols completed. TECK took 1.1s. Estimated remaining: 1m 49s. Rate: 158.2 symbols/min [2025-10-17T22:45:30.981700] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:31.134554] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:31.188846] [INFO ] [MAIN ] TEF: Generated 1820 derivative records from 37415 primary records. [2025-10-17T22:45:31.293953] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-17T22:45:31.334407] [DEBUG] [LOCAL ] TEF: Derivative data saved (1820 records). [2025-10-17T22:45:31.334820] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-17T22:45:31.336845] [INFO ] [MAIN ] Derivative Progress: 1797/2083 symbols completed. TEF took 1.1s. Estimated remaining: 1m 48s. Rate: 158.2 symbols/min [2025-10-17T22:45:31.337129] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:31.357834] [DEBUG] [LOCAL ] TEL: Loaded 51795 existing records from primary storage. [2025-10-17T22:45:31.358034] [INFO ] [MAIN ] TEL: Loaded 51795 primary data records. [2025-10-17T22:45:31.494728] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:31.507689] [INFO ] [MAIN ] TEI: Generated 1820 derivative records from 21545 primary records. [2025-10-17T22:45:31.513637] [DEBUG] [LOCAL ] TEN: Loaded 30927 existing records from primary storage. [2025-10-17T22:45:31.518885] [INFO ] [MAIN ] TEN: Loaded 30927 primary data records. [2025-10-17T22:45:31.518943] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-17T22:45:31.816753] [DEBUG] [LOCAL ] TEI: Derivative data saved (1820 records). [2025-10-17T22:45:31.822824] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-17T22:45:31.836198] [INFO ] [MAIN ] Derivative Progress: 1798/2083 symbols completed. TEI took 0.9s. Estimated remaining: 1m 48s. Rate: 158.1 symbols/min [2025-10-17T22:45:32.041914] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:32.042849] [INFO ] [MAIN ] TEL: Generated 1820 derivative records from 51795 primary records. [2025-10-17T22:45:32.043139] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-17T22:45:32.074906] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:32.075882] [DEBUG] [LOCAL ] TEL: Derivative data saved (1820 records). [2025-10-17T22:45:32.076784] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-17T22:45:32.076577] [INFO ] [MAIN ] TEN: Generated 1820 derivative records from 30927 primary records. [2025-10-17T22:45:32.078794] [INFO ] [MAIN ] Derivative Progress: 1799/2083 symbols completed. TEL took 1.1s. Estimated remaining: 1m 48s. Rate: 158.2 symbols/min [2025-10-17T22:45:32.079123] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-17T22:45:32.094820] [DEBUG] [LOCAL ] TEN: Derivative data saved (1820 records). [2025-10-17T22:45:32.094883] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-17T22:45:32.097043] [INFO ] [MAIN ] Derivative Progress: 1800/2083 symbols completed. TEN took 0.8s. Estimated remaining: 1m 47s. Rate: 158.2 symbols/min [2025-10-17T22:45:32.097903] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:32.097635] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:32.098375] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:32.122888] [DEBUG] [LOCAL ] TEO: Loaded 22984 existing records from primary storage. [2025-10-17T22:45:32.123061] [INFO ] [MAIN ] TEO: Loaded 22984 primary data records. [2025-10-17T22:45:32.270931] [DEBUG] [LOCAL ] TEX: Loaded 44431 existing records from primary storage. [2025-10-17T22:45:32.282119] [INFO ] [MAIN ] TEX: Loaded 44431 primary data records. [2025-10-17T22:45:32.574559] [DEBUG] [LOCAL ] TEVA: Loaded 54406 existing records from primary storage. [2025-10-17T22:45:32.574767] [INFO ] [MAIN ] TEVA: Loaded 54406 primary data records. [2025-10-17T22:45:33.133478] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:33.136710] [INFO ] [MAIN ] TEO: Generated 1820 derivative records from 22984 primary records. [2025-10-17T22:45:33.136924] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-17T22:45:33.161427] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:33.163686] [INFO ] [MAIN ] TEX: Generated 1820 derivative records from 44431 primary records. [2025-10-17T22:45:33.164409] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-17T22:45:33.177266] [DEBUG] [LOCAL ] TEO: Derivative data saved (1820 records). [2025-10-17T22:45:33.180907] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-17T22:45:33.186509] [INFO ] [MAIN ] Derivative Progress: 1801/2083 symbols completed. TEO took 1.1s. Estimated remaining: 1m 47s. Rate: 158.1 symbols/min [2025-10-17T22:45:33.186913] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:33.187858] [DEBUG] [LOCAL ] TEX: Derivative data saved (1820 records). [2025-10-17T22:45:33.188008] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-17T22:45:33.190238] [INFO ] [MAIN ] Derivative Progress: 1802/2083 symbols completed. TEX took 1.1s. Estimated remaining: 1m 47s. Rate: 158.2 symbols/min [2025-10-17T22:45:33.198111] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:33.203811] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:33.204588] [INFO ] [MAIN ] TEVA: Generated 1820 derivative records from 54406 primary records. [2025-10-17T22:45:33.204696] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-17T22:45:33.226832] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1820 records). [2025-10-17T22:45:33.227154] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-10-17T22:45:33.229356] [INFO ] [MAIN ] Derivative Progress: 1803/2083 symbols completed. TEVA took 1.1s. Estimated remaining: 1m 46s. Rate: 158.3 symbols/min [2025-10-17T22:45:33.229488] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:33.279883] [DEBUG] [LOCAL ] TFII: Loaded 33349 existing records from primary storage. [2025-10-17T22:45:33.280158] [INFO ] [MAIN ] TFII: Loaded 33349 primary data records. [2025-10-17T22:45:33.368524] [DEBUG] [LOCAL ] TFIN: Loaded 24116 existing records from primary storage. [2025-10-17T22:45:33.385194] [INFO ] [MAIN ] TFIN: Loaded 24116 primary data records. [2025-10-17T22:45:33.441082] [DEBUG] [LOCAL ] TFC: Loaded 54447 existing records from primary storage. [2025-10-17T22:45:33.458585] [INFO ] [MAIN ] TFC: Loaded 54447 primary data records. [2025-10-17T22:45:34.227014] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:34.228115] [INFO ] [MAIN ] TFII: Generated 1820 derivative records from 33349 primary records. [2025-10-17T22:45:34.228323] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-17T22:45:34.248988] [DEBUG] [LOCAL ] TFII: Derivative data saved (1820 records). [2025-10-17T22:45:34.273257] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-17T22:45:34.275695] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:34.275299] [INFO ] [MAIN ] Derivative Progress: 1804/2083 symbols completed. TFII took 1.1s. Estimated remaining: 1m 46s. Rate: 158.1 symbols/min [2025-10-17T22:45:34.275859] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:34.276441] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:34.277945] [INFO ] [MAIN ] TFC: Generated 1820 derivative records from 54447 primary records. [2025-10-17T22:45:34.277210] [INFO ] [MAIN ] TFIN: Generated 1820 derivative records from 24116 primary records. [2025-10-17T22:45:34.278058] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-17T22:45:34.278136] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-17T22:45:34.306264] [DEBUG] [LOCAL ] TFC: Derivative data saved (1820 records). [2025-10-17T22:45:34.307171] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-17T22:45:34.310458] [INFO ] [MAIN ] Derivative Progress: 1805/2083 symbols completed. TFC took 1.1s. Estimated remaining: 1m 45s. Rate: 158.2 symbols/min [2025-10-17T22:45:34.311168] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:34.313538] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1820 records). [2025-10-17T22:45:34.313603] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-17T22:45:34.316081] [INFO ] [MAIN ] Derivative Progress: 1806/2083 symbols completed. TFIN took 1.1s. Estimated remaining: 1m 45s. Rate: 158.3 symbols/min [2025-10-17T22:45:34.316284] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:34.339150] [DEBUG] [LOCAL ] TG: Loaded 10766 existing records from primary storage. [2025-10-17T22:45:34.339277] [INFO ] [MAIN ] TG: Loaded 10766 primary data records. [2025-10-17T22:45:34.657329] [DEBUG] [LOCAL ] TFPM: Loaded 40129 existing records from primary storage. [2025-10-17T22:45:34.663022] [DEBUG] [LOCAL ] TFX: Loaded 36700 existing records from primary storage. [2025-10-17T22:45:34.671723] [INFO ] [MAIN ] TFPM: Loaded 40129 primary data records. [2025-10-17T22:45:34.671869] [INFO ] [MAIN ] TFX: Loaded 36700 primary data records. [2025-10-17T22:45:35.331460] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:35.332465] [INFO ] [MAIN ] TG: Generated 1820 derivative records from 10766 primary records. [2025-10-17T22:45:35.332542] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-17T22:45:35.350625] [DEBUG] [LOCAL ] TG: Derivative data saved (1820 records). [2025-10-17T22:45:35.350931] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-17T22:45:35.353289] [INFO ] [MAIN ] Derivative Progress: 1807/2083 symbols completed. TG took 1.0s. Estimated remaining: 1m 45s. Rate: 158.1 symbols/min [2025-10-17T22:45:35.353690] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:35.374076] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:35.376635] [INFO ] [MAIN ] TFPM: Generated 1820 derivative records from 40129 primary records. [2025-10-17T22:45:35.377759] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-17T22:45:35.399406] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:35.404084] [INFO ] [MAIN ] TFX: Generated 1820 derivative records from 36700 primary records. [2025-10-17T22:45:35.404747] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-17T22:45:35.427078] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1820 records). [2025-10-17T22:45:35.434045] [DEBUG] [LOCAL ] TFX: Derivative data saved (1820 records). [2025-10-17T22:45:35.448625] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-17T22:45:35.448510] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-17T22:45:35.451056] [INFO ] [MAIN ] Derivative Progress: 1808/2083 symbols completed. TFX took 1.1s. Estimated remaining: 1m 44s. Rate: 158.2 symbols/min [2025-10-17T22:45:35.453787] [INFO ] [MAIN ] Derivative Progress: 1809/2083 symbols completed. TFPM took 1.2s. Estimated remaining: 1m 44s. Rate: 158.3 symbols/min [2025-10-17T22:45:35.453953] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:35.453708] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:35.455096] [DEBUG] [LOCAL ] TGLS: Loaded 27901 existing records from primary storage. [2025-10-17T22:45:35.455296] [INFO ] [MAIN ] TGLS: Loaded 27901 primary data records. [2025-10-17T22:45:35.787980] [DEBUG] [LOCAL ] TGS: Loaded 33978 existing records from primary storage. [2025-10-17T22:45:35.795420] [INFO ] [MAIN ] TGS: Loaded 33978 primary data records. [2025-10-17T22:45:35.901298] [DEBUG] [LOCAL ] TGNA: Loaded 49331 existing records from primary storage. [2025-10-17T22:45:35.915431] [INFO ] [MAIN ] TGNA: Loaded 49331 primary data records. [2025-10-17T22:45:36.438700] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:36.440311] [INFO ] [MAIN ] TGLS: Generated 1820 derivative records from 27901 primary records. [2025-10-17T22:45:36.440737] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-17T22:45:36.461325] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1820 records). [2025-10-17T22:45:36.461632] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-17T22:45:36.463879] [INFO ] [MAIN ] Derivative Progress: 1810/2083 symbols completed. TGLS took 1.1s. Estimated remaining: 1m 44s. Rate: 158.1 symbols/min [2025-10-17T22:45:36.464171] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:36.485037] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:36.486152] [INFO ] [MAIN ] TGS: Generated 1820 derivative records from 33978 primary records. [2025-10-17T22:45:36.486452] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-17T22:45:36.500372] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:36.501869] [INFO ] [MAIN ] TGNA: Generated 1820 derivative records from 49331 primary records. [2025-10-17T22:45:36.509254] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-17T22:45:36.536598] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1820 records). [2025-10-17T22:45:36.536825] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-17T22:45:36.532520] [DEBUG] [LOCAL ] TGS: Derivative data saved (1820 records). [2025-10-17T22:45:36.539242] [INFO ] [MAIN ] Derivative Progress: 1811/2083 symbols completed. TGNA took 1.1s. Estimated remaining: 1m 43s. Rate: 158.2 symbols/min [2025-10-17T22:45:36.539391] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:36.539678] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-17T22:45:36.542339] [INFO ] [MAIN ] Derivative Progress: 1812/2083 symbols completed. TGS took 1.1s. Estimated remaining: 1m 43s. Rate: 158.3 symbols/min [2025-10-17T22:45:36.543502] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:36.602215] [DEBUG] [LOCAL ] TGT: Loaded 54558 existing records from primary storage. [2025-10-17T22:45:36.602459] [INFO ] [MAIN ] TGT: Loaded 54558 primary data records. [2025-10-17T22:45:36.653043] [DEBUG] [LOCAL ] THG: Loaded 22090 existing records from primary storage. [2025-10-17T22:45:36.704837] [INFO ] [MAIN ] THG: Loaded 22090 primary data records. [2025-10-17T22:45:36.715911] [DEBUG] [LOCAL ] THC: Loaded 47601 existing records from primary storage. [2025-10-17T22:45:36.726769] [INFO ] [MAIN ] THC: Loaded 47601 primary data records. [2025-10-17T22:45:37.595185] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:37.596698] [INFO ] [MAIN ] TGT: Generated 1820 derivative records from 54558 primary records. [2025-10-17T22:45:37.596847] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-17T22:45:37.614458] [DEBUG] [LOCAL ] TGT: Derivative data saved (1820 records). [2025-10-17T22:45:37.614819] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-17T22:45:37.616874] [INFO ] [MAIN ] Derivative Progress: 1813/2083 symbols completed. TGT took 1.2s. Estimated remaining: 1m 42s. Rate: 158.1 symbols/min [2025-10-17T22:45:37.635924] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:37.648429] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:37.649377] [INFO ] [MAIN ] THG: Generated 1820 derivative records from 22090 primary records. [2025-10-17T22:45:37.650141] [INFO ] [MAIN ] THC: Generated 1820 derivative records from 47601 primary records. [2025-10-17T22:45:37.650237] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-17T22:45:37.650319] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-17T22:45:37.684672] [DEBUG] [LOCAL ] THC: Derivative data saved (1820 records). [2025-10-17T22:45:37.683236] [DEBUG] [LOCAL ] THG: Derivative data saved (1820 records). [2025-10-17T22:45:37.684864] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-17T22:45:37.687230] [INFO ] [MAIN ] Derivative Progress: 1814/2083 symbols completed. THG took 1.1s. Estimated remaining: 1m 42s. Rate: 158.2 symbols/min [2025-10-17T22:45:37.687354] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-17T22:45:37.689684] [INFO ] [MAIN ] Derivative Progress: 1815/2083 symbols completed. THC took 1.2s. Estimated remaining: 1m 42s. Rate: 158.3 symbols/min [2025-10-17T22:45:37.690242] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:37.690338] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:37.690435] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:37.695287] [DEBUG] [LOCAL ] THLV: Loaded 1535 existing records from primary storage. [2025-10-17T22:45:37.695489] [INFO ] [MAIN ] THLV: Loaded 1535 primary data records. [2025-10-17T22:45:37.781500] [DEBUG] [LOCAL ] THIR: Loaded 2413 existing records from primary storage. [2025-10-17T22:45:37.803023] [INFO ] [MAIN ] THIR: Loaded 2413 primary data records. [2025-10-17T22:45:38.190706] [DEBUG] [LOCAL ] THO: Loaded 41853 existing records from primary storage. [2025-10-17T22:45:38.193522] [INFO ] [MAIN ] THO: Loaded 41853 primary data records. [2025-10-17T22:45:38.706830] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:45:38.708441] [INFO ] [MAIN ] THLV: Generated 1819 derivative records from 1535 primary records. [2025-10-17T22:45:38.710580] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-17T22:45:38.733475] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7799 incomplete bins [2025-10-17T22:45:38.738518] [INFO ] [MAIN ] THIR: Generated 1815 derivative records from 2413 primary records. [2025-10-17T22:45:38.739953] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-17T22:45:38.743217] [DEBUG] [LOCAL ] THLV: Derivative data saved (1819 records). [2025-10-17T22:45:38.743403] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-17T22:45:38.745746] [INFO ] [MAIN ] Derivative Progress: 1816/2083 symbols completed. THLV took 1.1s. Estimated remaining: 1m 41s. Rate: 158.1 symbols/min [2025-10-17T22:45:38.745930] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:38.760249] [DEBUG] [LOCAL ] THIR: Derivative data saved (1815 records). [2025-10-17T22:45:38.760532] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-17T22:45:38.763633] [INFO ] [MAIN ] Derivative Progress: 1817/2083 symbols completed. THIR took 1.1s. Estimated remaining: 1m 41s. Rate: 158.2 symbols/min [2025-10-17T22:45:38.765572] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:38.784393] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:38.785290] [INFO ] [MAIN ] THO: Generated 1820 derivative records from 41853 primary records. [2025-10-17T22:45:38.785374] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-17T22:45:38.806794] [DEBUG] [LOCAL ] THO: Derivative data saved (1820 records). [2025-10-17T22:45:38.806965] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-17T22:45:38.808986] [INFO ] [MAIN ] Derivative Progress: 1818/2083 symbols completed. THO took 1.1s. Estimated remaining: 1m 40s. Rate: 158.3 symbols/min [2025-10-17T22:45:38.809316] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:38.825003] [DEBUG] [LOCAL ] THR: Loaded 20074 existing records from primary storage. [2025-10-17T22:45:38.825166] [INFO ] [MAIN ] THR: Loaded 20074 primary data records. [2025-10-17T22:45:38.912920] [DEBUG] [LOCAL ] THQ: Loaded 25643 existing records from primary storage. [2025-10-17T22:45:38.940905] [INFO ] [MAIN ] THQ: Loaded 25643 primary data records. [2025-10-17T22:45:39.294225] [DEBUG] [LOCAL ] THS: Loaded 39102 existing records from primary storage. [2025-10-17T22:45:39.306208] [INFO ] [MAIN ] THS: Loaded 39102 primary data records. [2025-10-17T22:45:39.834536] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:39.835923] [INFO ] [MAIN ] THR: Generated 1820 derivative records from 20074 primary records. [2025-10-17T22:45:39.836286] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-17T22:45:39.867849] [DEBUG] [LOCAL ] THR: Derivative data saved (1820 records). [2025-10-17T22:45:39.873501] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:39.874365] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-17T22:45:39.876670] [INFO ] [MAIN ] Derivative Progress: 1819/2083 symbols completed. THR took 1.1s. Estimated remaining: 1m 40s. Rate: 158.1 symbols/min [2025-10-17T22:45:39.874282] [INFO ] [MAIN ] THQ: Generated 1820 derivative records from 25643 primary records. [2025-10-17T22:45:39.877141] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-17T22:45:39.877457] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:39.898575] [DEBUG] [LOCAL ] THQ: Derivative data saved (1820 records). [2025-10-17T22:45:39.921073] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-17T22:45:39.924884] [INFO ] [MAIN ] Derivative Progress: 1820/2083 symbols completed. THQ took 1.2s. Estimated remaining: 1m 40s. Rate: 158.2 symbols/min [2025-10-17T22:45:39.925368] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:39.926558] [INFO ] [MAIN ] THS: Generated 1820 derivative records from 39102 primary records. [2025-10-17T22:45:39.926931] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-17T22:45:39.926687] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:39.947490] [DEBUG] [LOCAL ] THW: Loaded 19941 existing records from primary storage. [2025-10-17T22:45:39.951440] [INFO ] [MAIN ] THW: Loaded 19941 primary data records. [2025-10-17T22:45:39.955838] [DEBUG] [LOCAL ] THS: Derivative data saved (1820 records). [2025-10-17T22:45:39.961084] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-17T22:45:39.963199] [INFO ] [MAIN ] Derivative Progress: 1821/2083 symbols completed. THS took 1.2s. Estimated remaining: 1m 39s. Rate: 158.3 symbols/min [2025-10-17T22:45:40.003535] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:40.274976] [DEBUG] [LOCAL ] TISI: Loaded 3366 existing records from primary storage. [2025-10-17T22:45:40.288547] [INFO ] [MAIN ] TISI: Loaded 3366 primary data records. [2025-10-17T22:45:40.313571] [DEBUG] [LOCAL ] TIMB: Loaded 35736 existing records from primary storage. [2025-10-17T22:45:40.352152] [INFO ] [MAIN ] TIMB: Loaded 35736 primary data records. [2025-10-17T22:45:40.995637] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:40.997332] [INFO ] [MAIN ] THW: Generated 1820 derivative records from 19941 primary records. [2025-10-17T22:45:40.997775] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-17T22:45:41.018215] [DEBUG] [LOCAL ] THW: Derivative data saved (1820 records). [2025-10-17T22:45:41.018747] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-17T22:45:41.020997] [INFO ] [MAIN ] Derivative Progress: 1822/2083 symbols completed. THW took 1.1s. Estimated remaining: 1m 39s. Rate: 158.1 symbols/min [2025-10-17T22:45:41.021596] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:41.040543] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:45:41.041283] [INFO ] [MAIN ] TISI: Generated 1819 derivative records from 3366 primary records. [2025-10-17T22:45:41.041485] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-17T22:45:41.066973] [DEBUG] [LOCAL ] TISI: Derivative data saved (1819 records). [2025-10-17T22:45:41.067112] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-17T22:45:41.071672] [INFO ] [MAIN ] Derivative Progress: 1823/2083 symbols completed. TISI took 1.1s. Estimated remaining: 1m 39s. Rate: 158.2 symbols/min [2025-10-17T22:45:41.081226] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:41.083807] [DEBUG] [LOCAL ] TIXT: Loaded 32881 existing records from primary storage. [2025-10-17T22:45:41.091611] [INFO ] [MAIN ] TIXT: Loaded 32881 primary data records. [2025-10-17T22:45:41.118150] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:41.141236] [INFO ] [MAIN ] TIMB: Generated 1820 derivative records from 35736 primary records. [2025-10-17T22:45:41.153425] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-17T22:45:41.300459] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1820 records). [2025-10-17T22:45:41.407782] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-17T22:45:41.428962] [INFO ] [MAIN ] Derivative Progress: 1824/2083 symbols completed. TIMB took 1.5s. Estimated remaining: 1m 38s. Rate: 158.2 symbols/min [2025-10-17T22:45:41.438480] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:41.462581] [DEBUG] [LOCAL ] TJX: Loaded 54444 existing records from primary storage. [2025-10-17T22:45:41.463320] [INFO ] [MAIN ] TJX: Loaded 54444 primary data records. [2025-10-17T22:45:41.630296] [DEBUG] [LOCAL ] TK: Loaded 39692 existing records from primary storage. [2025-10-17T22:45:41.770320] [INFO ] [MAIN ] TK: Loaded 39692 primary data records. [2025-10-17T22:45:41.924612] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:41.931609] [INFO ] [MAIN ] TIXT: Generated 1820 derivative records from 32881 primary records. [2025-10-17T22:45:41.974925] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-17T22:45:42.036934] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1820 records). [2025-10-17T22:45:42.150206] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-17T22:45:42.153146] [INFO ] [MAIN ] Derivative Progress: 1825/2083 symbols completed. TIXT took 1.1s. Estimated remaining: 1m 38s. Rate: 158.1 symbols/min [2025-10-17T22:45:42.153756] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:42.176144] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:42.177049] [INFO ] [MAIN ] TJX: Generated 1820 derivative records from 54444 primary records. [2025-10-17T22:45:42.178385] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-17T22:45:42.207522] [DEBUG] [LOCAL ] TJX: Derivative data saved (1820 records). [2025-10-17T22:45:42.207909] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-17T22:45:42.210313] [INFO ] [MAIN ] Derivative Progress: 1826/2083 symbols completed. TJX took 1.1s. Estimated remaining: 1m 37s. Rate: 158.2 symbols/min [2025-10-17T22:45:42.210720] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:42.237499] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:42.238238] [INFO ] [MAIN ] TK: Generated 1820 derivative records from 39692 primary records. [2025-10-17T22:45:42.238378] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-17T22:45:42.266564] [DEBUG] [LOCAL ] TK: Derivative data saved (1820 records). [2025-10-17T22:45:42.266760] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-10-17T22:45:42.268870] [INFO ] [MAIN ] Derivative Progress: 1827/2083 symbols completed. TK took 0.8s. Estimated remaining: 1m 37s. Rate: 158.3 symbols/min [2025-10-17T22:45:42.269101] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:42.269890] [DEBUG] [LOCAL ] TKC: Loaded 40157 existing records from primary storage. [2025-10-17T22:45:42.270544] [INFO ] [MAIN ] TKC: Loaded 40157 primary data records. [2025-10-17T22:45:42.619938] [DEBUG] [LOCAL ] TKO: Loaded 44357 existing records from primary storage. [2025-10-17T22:45:42.629481] [INFO ] [MAIN ] TKO: Loaded 44357 primary data records. [2025-10-17T22:45:42.713952] [DEBUG] [LOCAL ] TKR: Loaded 40207 existing records from primary storage. [2025-10-17T22:45:42.721551] [INFO ] [MAIN ] TKR: Loaded 40207 primary data records. [2025-10-17T22:45:43.303248] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:43.305156] [INFO ] [MAIN ] TKC: Generated 1820 derivative records from 40157 primary records. [2025-10-17T22:45:43.305542] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-17T22:45:43.323531] [DEBUG] [LOCAL ] TKC: Derivative data saved (1820 records). [2025-10-17T22:45:43.324038] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-17T22:45:43.326252] [INFO ] [MAIN ] Derivative Progress: 1828/2083 symbols completed. TKC took 1.2s. Estimated remaining: 1m 37s. Rate: 158.1 symbols/min [2025-10-17T22:45:43.360050] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:43.361509] [INFO ] [MAIN ] TKO: Generated 1820 derivative records from 44357 primary records. [2025-10-17T22:45:43.360613] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:43.362399] [INFO ] [MAIN ] TKR: Generated 1820 derivative records from 40207 primary records. [2025-10-17T22:45:43.362471] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-17T22:45:43.363426] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-17T22:45:43.394392] [DEBUG] [LOCAL ] TKO: Derivative data saved (1820 records). [2025-10-17T22:45:43.395397] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-10-17T22:45:43.395233] [DEBUG] [LOCAL ] TKR: Derivative data saved (1820 records). [2025-10-17T22:45:43.398310] [INFO ] [MAIN ] Derivative Progress: 1829/2083 symbols completed. TKO took 1.2s. Estimated remaining: 1m 36s. Rate: 158.2 symbols/min [2025-10-17T22:45:43.398429] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-17T22:45:43.400853] [INFO ] [MAIN ] Derivative Progress: 1830/2083 symbols completed. TKR took 1.1s. Estimated remaining: 1m 36s. Rate: 158.3 symbols/min [2025-10-17T22:45:43.401446] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:43.401707] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:43.401532] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:43.442509] [DEBUG] [LOCAL ] TLYS: Loaded 16688 existing records from primary storage. [2025-10-17T22:45:43.442729] [INFO ] [MAIN ] TLYS: Loaded 16688 primary data records. [2025-10-17T22:45:43.597231] [DEBUG] [LOCAL ] TLK: Loaded 39277 existing records from primary storage. [2025-10-17T22:45:43.596267] [DEBUG] [LOCAL ] TM: Loaded 36853 existing records from primary storage. [2025-10-17T22:45:43.607870] [INFO ] [MAIN ] TLK: Loaded 39277 primary data records. [2025-10-17T22:45:43.613084] [INFO ] [MAIN ] TM: Loaded 36853 primary data records. [2025-10-17T22:45:44.429618] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:44.430538] [INFO ] [MAIN ] TLYS: Generated 1820 derivative records from 16688 primary records. [2025-10-17T22:45:44.430741] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-17T22:45:44.462888] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:44.473772] [INFO ] [MAIN ] TLK: Generated 1820 derivative records from 39277 primary records. [2025-10-17T22:45:44.479793] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-17T22:45:44.474957] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1820 records). [2025-10-17T22:45:44.492965] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:44.498923] [INFO ] [MAIN ] TM: Generated 1820 derivative records from 36853 primary records. [2025-10-17T22:45:44.499510] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-17T22:45:44.499574] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-17T22:45:44.503887] [INFO ] [MAIN ] Derivative Progress: 1831/2083 symbols completed. TLYS took 1.1s. Estimated remaining: 1m 36s. Rate: 158.1 symbols/min [2025-10-17T22:45:44.511983] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:44.519990] [DEBUG] [LOCAL ] TLK: Derivative data saved (1820 records). [2025-10-17T22:45:44.520834] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-17T22:45:44.525050] [INFO ] [MAIN ] Derivative Progress: 1832/2083 symbols completed. TLK took 1.1s. Estimated remaining: 1m 35s. Rate: 158.2 symbols/min [2025-10-17T22:45:44.525935] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:44.528235] [DEBUG] [LOCAL ] TM: Derivative data saved (1820 records). [2025-10-17T22:45:44.528351] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-17T22:45:44.532679] [INFO ] [MAIN ] Derivative Progress: 1833/2083 symbols completed. TM took 1.1s. Estimated remaining: 1m 35s. Rate: 158.3 symbols/min [2025-10-17T22:45:44.533026] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:44.599464] [DEBUG] [LOCAL ] TMHC: Loaded 46217 existing records from primary storage. [2025-10-17T22:45:44.613973] [INFO ] [MAIN ] TMHC: Loaded 46217 primary data records. [2025-10-17T22:45:44.665566] [DEBUG] [LOCAL ] TME: Loaded 53970 existing records from primary storage. [2025-10-17T22:45:44.711705] [INFO ] [MAIN ] TME: Loaded 53970 primary data records. [2025-10-17T22:45:44.759518] [DEBUG] [LOCAL ] TMO: Loaded 53193 existing records from primary storage. [2025-10-17T22:45:44.834677] [INFO ] [MAIN ] TMO: Loaded 53193 primary data records. [2025-10-17T22:45:45.603096] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:45.603869] [INFO ] [MAIN ] TMHC: Generated 1820 derivative records from 46217 primary records. [2025-10-17T22:45:45.604396] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-17T22:45:45.658225] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:45.657161] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1820 records). [2025-10-17T22:45:45.658839] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-17T22:45:45.661687] [INFO ] [MAIN ] Derivative Progress: 1834/2083 symbols completed. TMHC took 1.1s. Estimated remaining: 1m 34s. Rate: 158.1 symbols/min [2025-10-17T22:45:45.659791] [INFO ] [MAIN ] TMO: Generated 1820 derivative records from 53193 primary records. [2025-10-17T22:45:45.661910] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:45.658583] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:45.663387] [INFO ] [MAIN ] TME: Generated 1820 derivative records from 53970 primary records. [2025-10-17T22:45:45.663497] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-17T22:45:45.663587] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-17T22:45:45.701263] [DEBUG] [LOCAL ] TMO: Derivative data saved (1820 records). [2025-10-17T22:45:45.708058] [DEBUG] [LOCAL ] TME: Derivative data saved (1820 records). [2025-10-17T22:45:45.708563] [DEBUG] [LOCAL ] TNC: Loaded 14601 existing records from primary storage. [2025-10-17T22:45:45.708241] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-17T22:45:45.708857] [INFO ] [MAIN ] TNC: Loaded 14601 primary data records. [2025-10-17T22:45:45.708730] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-17T22:45:45.717108] [INFO ] [MAIN ] Derivative Progress: 1835/2083 symbols completed. TME took 1.2s. Estimated remaining: 1m 34s. Rate: 158.2 symbols/min [2025-10-17T22:45:45.748387] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:45.760562] [INFO ] [MAIN ] Derivative Progress: 1836/2083 symbols completed. TMO took 1.2s. Estimated remaining: 1m 34s. Rate: 158.2 symbols/min [2025-10-17T22:45:45.783007] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:46.050241] [DEBUG] [LOCAL ] TNET: Loaded 28661 existing records from primary storage. [2025-10-17T22:45:46.058327] [INFO ] [MAIN ] TNET: Loaded 28661 primary data records. [2025-10-17T22:45:46.175184] [DEBUG] [LOCAL ] TNK: Loaded 35859 existing records from primary storage. [2025-10-17T22:45:46.176996] [INFO ] [MAIN ] TNK: Loaded 35859 primary data records. [2025-10-17T22:45:46.684571] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:46.685837] [INFO ] [MAIN ] TNC: Generated 1820 derivative records from 14601 primary records. [2025-10-17T22:45:46.685915] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-17T22:45:46.706882] [DEBUG] [LOCAL ] TNC: Derivative data saved (1820 records). [2025-10-17T22:45:46.707685] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-17T22:45:46.709509] [INFO ] [MAIN ] Derivative Progress: 1837/2083 symbols completed. TNC took 1.0s. Estimated remaining: 1m 33s. Rate: 158.1 symbols/min [2025-10-17T22:45:46.709823] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:46.733010] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:46.733955] [INFO ] [MAIN ] TNET: Generated 1820 derivative records from 28661 primary records. [2025-10-17T22:45:46.734083] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-17T22:45:46.764075] [DEBUG] [LOCAL ] TNET: Derivative data saved (1820 records). [2025-10-17T22:45:46.782743] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:46.793106] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-17T22:45:46.795050] [INFO ] [MAIN ] TNK: Generated 1820 derivative records from 35859 primary records. [2025-10-17T22:45:46.797291] [INFO ] [MAIN ] Derivative Progress: 1838/2083 symbols completed. TNET took 1.0s. Estimated remaining: 1m 33s. Rate: 158.2 symbols/min [2025-10-17T22:45:46.797526] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-17T22:45:46.797456] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:46.798569] [DEBUG] [LOCAL ] TNL: Loaded 42362 existing records from primary storage. [2025-10-17T22:45:46.799709] [INFO ] [MAIN ] TNL: Loaded 42362 primary data records. [2025-10-17T22:45:46.912795] [DEBUG] [LOCAL ] TNK: Derivative data saved (1820 records). [2025-10-17T22:45:46.916275] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-17T22:45:46.939718] [INFO ] [MAIN ] Derivative Progress: 1839/2083 symbols completed. TNK took 1.2s. Estimated remaining: 1m 33s. Rate: 158.2 symbols/min [2025-10-17T22:45:46.994730] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:47.171763] [DEBUG] [LOCAL ] TOL: Loaded 51370 existing records from primary storage. [2025-10-17T22:45:47.172233] [INFO ] [MAIN ] TOL: Loaded 51370 primary data records. [2025-10-17T22:45:47.399080] [DEBUG] [LOCAL ] TOST: Loaded 54470 existing records from primary storage. [2025-10-17T22:45:47.403023] [INFO ] [MAIN ] TOST: Loaded 54470 primary data records. [2025-10-17T22:45:47.403476] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:47.404555] [INFO ] [MAIN ] TNL: Generated 1820 derivative records from 42362 primary records. [2025-10-17T22:45:47.522026] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-17T22:45:47.650742] [DEBUG] [LOCAL ] TNL: Derivative data saved (1820 records). [2025-10-17T22:45:47.651720] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-17T22:45:47.653737] [INFO ] [MAIN ] Derivative Progress: 1840/2083 symbols completed. TNL took 0.9s. Estimated remaining: 1m 32s. Rate: 158.2 symbols/min [2025-10-17T22:45:47.660292] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:47.898754] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:47.899997] [DEBUG] [LOCAL ] TPB: Loaded 26442 existing records from primary storage. [2025-10-17T22:45:47.901033] [INFO ] [MAIN ] TOL: Generated 1820 derivative records from 51370 primary records. [2025-10-17T22:45:47.901533] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-17T22:45:47.901729] [INFO ] [MAIN ] TPB: Loaded 26442 primary data records. [2025-10-17T22:45:48.130312] [DEBUG] [LOCAL ] TOL: Derivative data saved (1820 records). [2025-10-17T22:45:48.131020] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:48.254081] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-17T22:45:48.244085] [INFO ] [MAIN ] TOST: Generated 1820 derivative records from 54470 primary records. [2025-10-17T22:45:48.254915] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-17T22:45:48.257902] [INFO ] [MAIN ] Derivative Progress: 1841/2083 symbols completed. TOL took 1.5s. Estimated remaining: 1m 32s. Rate: 158.1 symbols/min [2025-10-17T22:45:48.267547] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:48.279473] [DEBUG] [LOCAL ] TOST: Derivative data saved (1820 records). [2025-10-17T22:45:48.280175] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-17T22:45:48.282603] [INFO ] [MAIN ] Derivative Progress: 1842/2083 symbols completed. TOST took 1.3s. Estimated remaining: 1m 31s. Rate: 158.2 symbols/min [2025-10-17T22:45:48.283039] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:48.318490] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:48.319355] [INFO ] [MAIN ] TPB: Generated 1820 derivative records from 26442 primary records. [2025-10-17T22:45:48.319573] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-17T22:45:48.362895] [DEBUG] [LOCAL ] TPC: Loaded 39604 existing records from primary storage. [2025-10-17T22:45:48.365548] [DEBUG] [LOCAL ] TPB: Derivative data saved (1820 records). [2025-10-17T22:45:48.365668] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-17T22:45:48.365369] [INFO ] [MAIN ] TPC: Loaded 39604 primary data records. [2025-10-17T22:45:48.372371] [INFO ] [MAIN ] Derivative Progress: 1843/2083 symbols completed. TPB took 0.7s. Estimated remaining: 1m 31s. Rate: 158.3 symbols/min [2025-10-17T22:45:48.502692] [DEBUG] [LOCAL ] TPH: Loaded 45484 existing records from primary storage. [2025-10-17T22:45:48.523923] [INFO ] [MAIN ] TPH: Loaded 45484 primary data records. [2025-10-17T22:45:49.224316] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:49.225333] [INFO ] [MAIN ] TPC: Generated 1820 derivative records from 39604 primary records. [2025-10-17T22:45:49.225739] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-17T22:45:49.254504] [DEBUG] [LOCAL ] TPC: Derivative data saved (1820 records). [2025-10-17T22:45:49.254799] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-17T22:45:49.258382] [INFO ] [MAIN ] Derivative Progress: 1844/2083 symbols completed. TPC took 1.0s. Estimated remaining: 1m 31s. Rate: 158.1 symbols/min [2025-10-17T22:45:49.274287] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:49.275008] [INFO ] [MAIN ] TPH: Generated 1820 derivative records from 45484 primary records. [2025-10-17T22:45:49.275070] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-17T22:45:49.290999] [DEBUG] [LOCAL ] TPH: Derivative data saved (1820 records). [2025-10-17T22:45:49.291113] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-17T22:45:49.293241] [INFO ] [MAIN ] Derivative Progress: 1845/2083 symbols completed. TPH took 1.0s. Estimated remaining: 1m 30s. Rate: 158.2 symbols/min [2025-10-17T22:45:49.293728] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:49.293846] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:49.293956] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:49.312329] [DEBUG] [LOCAL ] TPL: Loaded 12558 existing records from primary storage. [2025-10-17T22:45:49.312569] [INFO ] [MAIN ] TPL: Loaded 12558 primary data records. [2025-10-17T22:45:49.439135] [DEBUG] [LOCAL ] TPVG: Loaded 27655 existing records from primary storage. [2025-10-17T22:45:49.455542] [INFO ] [MAIN ] TPVG: Loaded 27655 primary data records. [2025-10-17T22:45:49.809382] [DEBUG] [LOCAL ] TPR: Loaded 54177 existing records from primary storage. [2025-10-17T22:45:49.947742] [INFO ] [MAIN ] TPR: Loaded 54177 primary data records. [2025-10-17T22:45:50.274733] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:50.276048] [INFO ] [MAIN ] TPL: Generated 1820 derivative records from 12558 primary records. [2025-10-17T22:45:50.276336] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-17T22:45:50.302109] [DEBUG] [LOCAL ] TPL: Derivative data saved (1820 records). [2025-10-17T22:45:50.302246] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-17T22:45:50.304557] [INFO ] [MAIN ] Derivative Progress: 1846/2083 symbols completed. TPL took 1.0s. Estimated remaining: 1m 30s. Rate: 158.1 symbols/min [2025-10-17T22:45:50.318690] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:50.319845] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:50.320724] [INFO ] [MAIN ] TPVG: Generated 1820 derivative records from 27655 primary records. [2025-10-17T22:45:50.320974] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-17T22:45:50.352745] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:50.357620] [DEBUG] [LOCAL ] TPYP: Loaded 8009 existing records from primary storage. [2025-10-17T22:45:50.360055] [INFO ] [MAIN ] TPYP: Loaded 8009 primary data records. [2025-10-17T22:45:50.362066] [INFO ] [MAIN ] TPR: Generated 1820 derivative records from 54177 primary records. [2025-10-17T22:45:50.367550] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-17T22:45:50.388534] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1820 records). [2025-10-17T22:45:50.456942] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-17T22:45:50.467282] [INFO ] [MAIN ] Derivative Progress: 1847/2083 symbols completed. TPVG took 1.2s. Estimated remaining: 1m 30s. Rate: 158.1 symbols/min [2025-10-17T22:45:50.465171] [DEBUG] [LOCAL ] TPR: Derivative data saved (1820 records). [2025-10-17T22:45:50.484867] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:50.488164] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-17T22:45:50.491246] [INFO ] [MAIN ] Derivative Progress: 1848/2083 symbols completed. TPR took 1.2s. Estimated remaining: 1m 29s. Rate: 158.2 symbols/min [2025-10-17T22:45:50.496672] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:50.573909] [DEBUG] [LOCAL ] TPZ: Loaded 4739 existing records from primary storage. [2025-10-17T22:45:50.686169] [INFO ] [MAIN ] TPZ: Loaded 4739 primary data records. [2025-10-17T22:45:50.799161] [DEBUG] [LOCAL ] TR: Loaded 19196 existing records from primary storage. [2025-10-17T22:45:50.803146] [INFO ] [MAIN ] TR: Loaded 19196 primary data records. [2025-10-17T22:45:51.344865] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:51.345747] [INFO ] [MAIN ] TPYP: Generated 1820 derivative records from 8009 primary records. [2025-10-17T22:45:51.346755] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-17T22:45:51.368898] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1820 records). [2025-10-17T22:45:51.369379] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-17T22:45:51.371831] [INFO ] [MAIN ] Derivative Progress: 1849/2083 symbols completed. TPYP took 1.1s. Estimated remaining: 1m 29s. Rate: 158.1 symbols/min [2025-10-17T22:45:51.372097] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:51.385878] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:45:51.386720] [INFO ] [MAIN ] TPZ: Generated 1819 derivative records from 4739 primary records. [2025-10-17T22:45:51.386888] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-17T22:45:51.405507] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1819 records). [2025-10-17T22:45:51.405678] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-17T22:45:51.408626] [INFO ] [MAIN ] Derivative Progress: 1850/2083 symbols completed. TPZ took 0.9s. Estimated remaining: 1m 28s. Rate: 158.2 symbols/min [2025-10-17T22:45:51.408860] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:51.413999] [DEBUG] [LOCAL ] TRAK: Loaded 9840 existing records from primary storage. [2025-10-17T22:45:51.414161] [INFO ] [MAIN ] TRAK: Loaded 9840 primary data records. [2025-10-17T22:45:51.480858] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:51.495958] [INFO ] [MAIN ] TR: Generated 1820 derivative records from 19196 primary records. [2025-10-17T22:45:51.496101] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-17T22:45:51.557731] [DEBUG] [LOCAL ] TRC: Loaded 15736 existing records from primary storage. [2025-10-17T22:45:51.576219] [INFO ] [MAIN ] TRC: Loaded 15736 primary data records. [2025-10-17T22:45:51.859012] [DEBUG] [LOCAL ] TR: Derivative data saved (1820 records). [2025-10-17T22:45:51.864367] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-17T22:45:51.888938] [INFO ] [MAIN ] Derivative Progress: 1851/2083 symbols completed. TR took 1.4s. Estimated remaining: 1m 28s. Rate: 158.1 symbols/min [2025-10-17T22:45:51.900735] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:52.065582] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:52.066503] [INFO ] [MAIN ] TRAK: Generated 1820 derivative records from 9840 primary records. [2025-10-17T22:45:52.066836] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-17T22:45:52.099813] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1820 records). [2025-10-17T22:45:52.100011] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-17T22:45:52.102177] [INFO ] [MAIN ] Derivative Progress: 1852/2083 symbols completed. TRAK took 0.7s. Estimated remaining: 1m 28s. Rate: 158.2 symbols/min [2025-10-17T22:45:52.102442] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:52.133491] [DEBUG] [LOCAL ] TREX: Loaded 50560 existing records from primary storage. [2025-10-17T22:45:52.134093] [INFO ] [MAIN ] TREX: Loaded 50560 primary data records. [2025-10-17T22:45:52.134043] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:52.134908] [INFO ] [MAIN ] TRC: Generated 1820 derivative records from 15736 primary records. [2025-10-17T22:45:52.146005] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-17T22:45:52.289752] [DEBUG] [LOCAL ] TRC: Derivative data saved (1820 records). [2025-10-17T22:45:52.444797] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-17T22:45:52.456032] [INFO ] [MAIN ] Derivative Progress: 1853/2083 symbols completed. TRC took 1.0s. Estimated remaining: 1m 27s. Rate: 158.2 symbols/min [2025-10-17T22:45:52.456354] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:52.475190] [DEBUG] [LOCAL ] TRGP: Loaded 51552 existing records from primary storage. [2025-10-17T22:45:52.475617] [INFO ] [MAIN ] TRGP: Loaded 51552 primary data records. [2025-10-17T22:45:52.834695] [DEBUG] [LOCAL ] TRN: Loaded 37211 existing records from primary storage. [2025-10-17T22:45:52.835081] [INFO ] [MAIN ] TRN: Loaded 37211 primary data records. [2025-10-17T22:45:52.954451] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:52.955794] [INFO ] [MAIN ] TREX: Generated 1820 derivative records from 50560 primary records. [2025-10-17T22:45:52.981717] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-17T22:45:53.178636] [DEBUG] [LOCAL ] TREX: Derivative data saved (1820 records). [2025-10-17T22:45:53.179233] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-17T22:45:53.181497] [INFO ] [MAIN ] Derivative Progress: 1854/2083 symbols completed. TREX took 1.3s. Estimated remaining: 1m 27s. Rate: 158.1 symbols/min [2025-10-17T22:45:53.181999] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:53.210909] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:53.212202] [INFO ] [MAIN ] TRGP: Generated 1820 derivative records from 51552 primary records. [2025-10-17T22:45:53.212601] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-17T22:45:53.243824] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1820 records). [2025-10-17T22:45:53.245045] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-17T22:45:53.248370] [INFO ] [MAIN ] Derivative Progress: 1855/2083 symbols completed. TRGP took 1.1s. Estimated remaining: 1m 26s. Rate: 158.2 symbols/min [2025-10-17T22:45:53.248770] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:53.275785] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:53.277848] [DEBUG] [LOCAL ] TRNO: Loaded 44531 existing records from primary storage. [2025-10-17T22:45:53.276830] [INFO ] [MAIN ] TRN: Generated 1820 derivative records from 37211 primary records. [2025-10-17T22:45:53.278219] [INFO ] [MAIN ] TRNO: Loaded 44531 primary data records. [2025-10-17T22:45:53.278127] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-17T22:45:53.406076] [DEBUG] [LOCAL ] TRN: Derivative data saved (1820 records). [2025-10-17T22:45:53.409947] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-17T22:45:53.413016] [INFO ] [MAIN ] Derivative Progress: 1856/2083 symbols completed. TRN took 1.0s. Estimated remaining: 1m 26s. Rate: 158.2 symbols/min [2025-10-17T22:45:53.413411] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:53.664863] [DEBUG] [LOCAL ] TROX: Loaded 52933 existing records from primary storage. [2025-10-17T22:45:53.665235] [INFO ] [MAIN ] TROX: Loaded 52933 primary data records. [2025-10-17T22:45:53.881780] [DEBUG] [LOCAL ] TRP: Loaded 52912 existing records from primary storage. [2025-10-17T22:45:54.001996] [INFO ] [MAIN ] TRP: Loaded 52912 primary data records. [2025-10-17T22:45:54.326526] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:54.327769] [INFO ] [MAIN ] TRNO: Generated 1820 derivative records from 44531 primary records. [2025-10-17T22:45:54.328015] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-17T22:45:54.347983] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1820 records). [2025-10-17T22:45:54.348191] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-17T22:45:54.350589] [INFO ] [MAIN ] Derivative Progress: 1857/2083 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 26s. Rate: 158.1 symbols/min [2025-10-17T22:45:54.350901] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:54.368995] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:54.369859] [INFO ] [MAIN ] TROX: Generated 1820 derivative records from 52933 primary records. [2025-10-17T22:45:54.370229] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-17T22:45:54.387380] [DEBUG] [LOCAL ] TROX: Derivative data saved (1820 records). [2025-10-17T22:45:54.387501] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-17T22:45:54.389802] [INFO ] [MAIN ] Derivative Progress: 1858/2083 symbols completed. TROX took 1.1s. Estimated remaining: 1m 25s. Rate: 158.2 symbols/min [2025-10-17T22:45:54.406079] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:54.406674] [INFO ] [MAIN ] TRP: Generated 1820 derivative records from 52912 primary records. [2025-10-17T22:45:54.416326] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-17T22:45:54.442688] [DEBUG] [LOCAL ] TRTX: Loaded 37790 existing records from primary storage. [2025-10-17T22:45:54.443231] [INFO ] [MAIN ] TRTX: Loaded 37790 primary data records. [2025-10-17T22:45:54.466702] [DEBUG] [LOCAL ] TRP: Derivative data saved (1820 records). [2025-10-17T22:45:54.485881] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-17T22:45:54.513977] [INFO ] [MAIN ] Derivative Progress: 1859/2083 symbols completed. TRP took 1.1s. Estimated remaining: 1m 25s. Rate: 158.2 symbols/min [2025-10-17T22:45:54.752060] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:54.752785] [INFO ] [MAIN ] TRTX: Generated 1820 derivative records from 37790 primary records. [2025-10-17T22:45:54.752850] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-17T22:45:54.768006] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1820 records). [2025-10-17T22:45:54.768072] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-17T22:45:54.770146] [INFO ] [MAIN ] Derivative Progress: 1860/2083 symbols completed. TRTX took 0.4s. Estimated remaining: 1m 25s. Rate: 158.3 symbols/min [2025-10-17T22:45:54.770891] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:54.771378] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:54.771307] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:54.844124] [DEBUG] [LOCAL ] TRU: Loaded 52194 existing records from primary storage. [2025-10-17T22:45:54.845326] [INFO ] [MAIN ] TRU: Loaded 52194 primary data records. [2025-10-17T22:45:54.963417] [DEBUG] [LOCAL ] TS: Loaded 52431 existing records from primary storage. [2025-10-17T22:45:54.977447] [INFO ] [MAIN ] TS: Loaded 52431 primary data records. [2025-10-17T22:45:55.002772] [DEBUG] [LOCAL ] TRV: Loaded 48191 existing records from primary storage. [2025-10-17T22:45:55.008832] [INFO ] [MAIN ] TRV: Loaded 48191 primary data records. [2025-10-17T22:45:55.834833] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:55.836000] [INFO ] [MAIN ] TRU: Generated 1820 derivative records from 52194 primary records. [2025-10-17T22:45:55.836193] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-17T22:45:55.856956] [DEBUG] [LOCAL ] TRU: Derivative data saved (1820 records). [2025-10-17T22:45:55.858917] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-17T22:45:55.875851] [INFO ] [MAIN ] Derivative Progress: 1861/2083 symbols completed. TRU took 1.1s. Estimated remaining: 1m 24s. Rate: 158.1 symbols/min [2025-10-17T22:45:55.889820] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:55.889631] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:55.890888] [INFO ] [MAIN ] TS: Generated 1820 derivative records from 52431 primary records. [2025-10-17T22:45:55.891625] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:55.892515] [INFO ] [MAIN ] TRV: Generated 1820 derivative records from 48191 primary records. [2025-10-17T22:45:55.891722] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-17T22:45:55.892714] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-17T22:45:55.926161] [DEBUG] [LOCAL ] TRV: Derivative data saved (1820 records). [2025-10-17T22:45:55.926536] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-17T22:45:55.926294] [DEBUG] [LOCAL ] TS: Derivative data saved (1820 records). [2025-10-17T22:45:55.929156] [INFO ] [MAIN ] Derivative Progress: 1862/2083 symbols completed. TRV took 1.2s. Estimated remaining: 1m 24s. Rate: 158.2 symbols/min [2025-10-17T22:45:55.926725] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-17T22:45:55.931885] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:55.931980] [INFO ] [MAIN ] Derivative Progress: 1863/2083 symbols completed. TS took 1.2s. Estimated remaining: 1m 23s. Rate: 158.3 symbols/min [2025-10-17T22:45:55.932772] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:55.958844] [DEBUG] [LOCAL ] TSI: Loaded 8285 existing records from primary storage. [2025-10-17T22:45:55.959132] [INFO ] [MAIN ] TSI: Loaded 8285 primary data records. [2025-10-17T22:45:55.960518] [DEBUG] [LOCAL ] TSE: Loaded 28113 existing records from primary storage. [2025-10-17T22:45:55.993180] [INFO ] [MAIN ] TSE: Loaded 28113 primary data records. [2025-10-17T22:45:56.243340] [DEBUG] [LOCAL ] TSLX: Loaded 36454 existing records from primary storage. [2025-10-17T22:45:56.280830] [INFO ] [MAIN ] TSLX: Loaded 36454 primary data records. [2025-10-17T22:45:56.981752] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:56.983108] [INFO ] [MAIN ] TSI: Generated 1820 derivative records from 8285 primary records. [2025-10-17T22:45:56.983363] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-10-17T22:45:57.000997] [DEBUG] [LOCAL ] TSI: Derivative data saved (1820 records). [2025-10-17T22:45:57.002025] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-10-17T22:45:57.004046] [INFO ] [MAIN ] Derivative Progress: 1864/2083 symbols completed. TSI took 1.1s. Estimated remaining: 1m 23s. Rate: 158.1 symbols/min [2025-10-17T22:45:57.004683] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:57.018790] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:57.019599] [INFO ] [MAIN ] TSE: Generated 1820 derivative records from 28113 primary records. [2025-10-17T22:45:57.019800] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-17T22:45:57.040483] [DEBUG] [LOCAL ] TSE: Derivative data saved (1820 records). [2025-10-17T22:45:57.040808] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-17T22:45:57.043184] [INFO ] [MAIN ] Derivative Progress: 1865/2083 symbols completed. TSE took 1.2s. Estimated remaining: 1m 23s. Rate: 158.2 symbols/min [2025-10-17T22:45:57.043485] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:57.057566] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:57.058405] [INFO ] [MAIN ] TSLX: Generated 1820 derivative records from 36454 primary records. [2025-10-17T22:45:57.058602] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-17T22:45:57.076022] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1820 records). [2025-10-17T22:45:57.076461] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-17T22:45:57.078841] [INFO ] [MAIN ] Derivative Progress: 1866/2083 symbols completed. TSLX took 1.1s. Estimated remaining: 1m 22s. Rate: 158.3 symbols/min [2025-10-17T22:45:57.093582] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:57.130378] [DEBUG] [LOCAL ] TSM: Loaded 54599 existing records from primary storage. [2025-10-17T22:45:57.133043] [INFO ] [MAIN ] TSM: Loaded 54599 primary data records. [2025-10-17T22:45:57.202995] [DEBUG] [LOCAL ] TSQ: Loaded 11828 existing records from primary storage. [2025-10-17T22:45:57.252828] [INFO ] [MAIN ] TSQ: Loaded 11828 primary data records. [2025-10-17T22:45:57.257169] [DEBUG] [LOCAL ] TSN: Loaded 53821 existing records from primary storage. [2025-10-17T22:45:57.268319] [INFO ] [MAIN ] TSN: Loaded 53821 primary data records. [2025-10-17T22:45:58.102997] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:58.105692] [INFO ] [MAIN ] TSM: Generated 1820 derivative records from 54599 primary records. [2025-10-17T22:45:58.105915] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-17T22:45:58.134850] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:58.137685] [INFO ] [MAIN ] TSQ: Generated 1820 derivative records from 11828 primary records. [2025-10-17T22:45:58.145825] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-17T22:45:58.155315] [DEBUG] [LOCAL ] TSM: Derivative data saved (1820 records). [2025-10-17T22:45:58.155452] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-17T22:45:58.153632] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:58.156538] [INFO ] [MAIN ] TSN: Generated 1820 derivative records from 53821 primary records. [2025-10-17T22:45:58.166396] [INFO ] [MAIN ] Derivative Progress: 1867/2083 symbols completed. TSM took 1.2s. Estimated remaining: 1m 22s. Rate: 158.1 symbols/min [2025-10-17T22:45:58.169709] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-17T22:45:58.169395] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:58.174047] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1820 records). [2025-10-17T22:45:58.175147] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-17T22:45:58.177463] [INFO ] [MAIN ] Derivative Progress: 1868/2083 symbols completed. TSQ took 1.1s. Estimated remaining: 1m 22s. Rate: 158.2 symbols/min [2025-10-17T22:45:58.177948] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:58.194758] [DEBUG] [LOCAL ] TSN: Derivative data saved (1820 records). [2025-10-17T22:45:58.194949] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-17T22:45:58.197051] [INFO ] [MAIN ] Derivative Progress: 1869/2083 symbols completed. TSN took 1.2s. Estimated remaining: 1m 21s. Rate: 158.3 symbols/min [2025-10-17T22:45:58.197367] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:58.277510] [DEBUG] [LOCAL ] TT: Loaded 47906 existing records from primary storage. [2025-10-17T22:45:58.289796] [INFO ] [MAIN ] TT: Loaded 47906 primary data records. [2025-10-17T22:45:58.290527] [DEBUG] [LOCAL ] TTE: Loaded 52350 existing records from primary storage. [2025-10-17T22:45:58.312085] [INFO ] [MAIN ] TTE: Loaded 52350 primary data records. [2025-10-17T22:45:58.340074] [DEBUG] [LOCAL ] TTC: Loaded 42525 existing records from primary storage. [2025-10-17T22:45:58.401752] [INFO ] [MAIN ] TTC: Loaded 42525 primary data records. [2025-10-17T22:45:59.261588] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:59.262628] [INFO ] [MAIN ] TT: Generated 1820 derivative records from 47906 primary records. [2025-10-17T22:45:59.262924] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-17T22:45:59.296680] [DEBUG] [LOCAL ] TT: Derivative data saved (1820 records). [2025-10-17T22:45:59.297322] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-17T22:45:59.299567] [INFO ] [MAIN ] Derivative Progress: 1870/2083 symbols completed. TT took 1.1s. Estimated remaining: 1m 21s. Rate: 158.1 symbols/min [2025-10-17T22:45:59.297672] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:59.299732] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:59.312972] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:45:59.313875] [INFO ] [MAIN ] TTE: Generated 1820 derivative records from 52350 primary records. [2025-10-17T22:45:59.315082] [INFO ] [MAIN ] TTC: Generated 1820 derivative records from 42525 primary records. [2025-10-17T22:45:59.315186] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-17T22:45:59.316167] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-17T22:45:59.348251] [DEBUG] [LOCAL ] TTE: Derivative data saved (1820 records). [2025-10-17T22:45:59.348472] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-17T22:45:59.350754] [INFO ] [MAIN ] Derivative Progress: 1871/2083 symbols completed. TTE took 1.2s. Estimated remaining: 1m 20s. Rate: 158.2 symbols/min [2025-10-17T22:45:59.352356] [DEBUG] [LOCAL ] TTC: Derivative data saved (1820 records). [2025-10-17T22:45:59.352418] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-17T22:45:59.350911] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:59.354497] [INFO ] [MAIN ] Derivative Progress: 1872/2083 symbols completed. TTC took 1.2s. Estimated remaining: 1m 20s. Rate: 158.3 symbols/min [2025-10-17T22:45:59.354845] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:45:59.389127] [DEBUG] [LOCAL ] TTI: Loaded 47129 existing records from primary storage. [2025-10-17T22:45:59.389305] [INFO ] [MAIN ] TTI: Loaded 47129 primary data records. [2025-10-17T22:45:59.719824] [DEBUG] [LOCAL ] TUYA: Loaded 46657 existing records from primary storage. [2025-10-17T22:45:59.734261] [INFO ] [MAIN ] TUYA: Loaded 46657 primary data records. [2025-10-17T22:45:59.735081] [DEBUG] [LOCAL ] TU: Loaded 50563 existing records from primary storage. [2025-10-17T22:45:59.735225] [INFO ] [MAIN ] TU: Loaded 50563 primary data records. [2025-10-17T22:46:00.343624] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:00.344593] [INFO ] [MAIN ] TTI: Generated 1820 derivative records from 47129 primary records. [2025-10-17T22:46:00.344824] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-17T22:46:00.362335] [DEBUG] [LOCAL ] TTI: Derivative data saved (1820 records). [2025-10-17T22:46:00.363435] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-17T22:46:00.365630] [INFO ] [MAIN ] Derivative Progress: 1873/2083 symbols completed. TTI took 1.1s. Estimated remaining: 1m 20s. Rate: 158.1 symbols/min [2025-10-17T22:46:00.380554] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:00.381271] [INFO ] [MAIN ] TU: Generated 1820 derivative records from 50563 primary records. [2025-10-17T22:46:00.381412] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-17T22:46:00.412988] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:00.413598] [INFO ] [MAIN ] TUYA: Generated 1820 derivative records from 46657 primary records. [2025-10-17T22:46:00.412741] [DEBUG] [LOCAL ] TU: Derivative data saved (1820 records). [2025-10-17T22:46:00.413741] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-17T22:46:00.415682] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-17T22:46:00.415618] [INFO ] [MAIN ] Derivative Progress: 1874/2083 symbols completed. TU took 1.1s. Estimated remaining: 1m 19s. Rate: 158.2 symbols/min [2025-10-17T22:46:00.431194] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1820 records). [2025-10-17T22:46:00.431252] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-17T22:46:00.434136] [INFO ] [MAIN ] Derivative Progress: 1875/2083 symbols completed. TUYA took 1.1s. Estimated remaining: 1m 19s. Rate: 158.3 symbols/min [2025-10-17T22:46:00.434688] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:00.434838] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:00.434912] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:00.444590] [DEBUG] [LOCAL ] TVC: Loaded 3240 existing records from primary storage. [2025-10-17T22:46:00.442511] [DEBUG] [LOCAL ] TVE: Loaded 2658 existing records from primary storage. [2025-10-17T22:46:00.444814] [INFO ] [MAIN ] TVE: Loaded 2658 primary data records. [2025-10-17T22:46:00.444758] [INFO ] [MAIN ] TVC: Loaded 3240 primary data records. [2025-10-17T22:46:01.083953] [DEBUG] [LOCAL ] TV: Loaded 42121 existing records from primary storage. [2025-10-17T22:46:01.089575] [INFO ] [MAIN ] TV: Loaded 42121 primary data records. [2025-10-17T22:46:01.435849] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:01.441963] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:46:01.443560] [INFO ] [MAIN ] TVE: Generated 1820 derivative records from 2658 primary records. [2025-10-17T22:46:01.443005] [INFO ] [MAIN ] TVC: Generated 1819 derivative records from 3240 primary records. [2025-10-17T22:46:01.444129] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-17T22:46:01.444073] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-17T22:46:01.472965] [DEBUG] [LOCAL ] TVC: Derivative data saved (1819 records). [2025-10-17T22:46:01.470148] [DEBUG] [LOCAL ] TVE: Derivative data saved (1820 records). [2025-10-17T22:46:01.473300] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-17T22:46:01.475719] [INFO ] [MAIN ] Derivative Progress: 1876/2083 symbols completed. TVC took 1.0s. Estimated remaining: 1m 19s. Rate: 158.1 symbols/min [2025-10-17T22:46:01.475881] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:01.473592] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-17T22:46:01.478160] [INFO ] [MAIN ] Derivative Progress: 1877/2083 symbols completed. TVE took 1.0s. Estimated remaining: 1m 18s. Rate: 158.2 symbols/min [2025-10-17T22:46:01.478484] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:01.495568] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:01.496225] [INFO ] [MAIN ] TV: Generated 1820 derivative records from 42121 primary records. [2025-10-17T22:46:01.496372] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-17T22:46:01.512566] [DEBUG] [LOCAL ] TV: Derivative data saved (1820 records). [2025-10-17T22:46:01.512747] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-17T22:46:01.514810] [INFO ] [MAIN ] Derivative Progress: 1878/2083 symbols completed. TV took 1.1s. Estimated remaining: 1m 18s. Rate: 158.3 symbols/min [2025-10-17T22:46:01.515015] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:01.530727] [DEBUG] [LOCAL ] TWN: Loaded 3361 existing records from primary storage. [2025-10-17T22:46:01.530921] [INFO ] [MAIN ] TWN: Loaded 3361 primary data records. [2025-10-17T22:46:01.656568] [DEBUG] [LOCAL ] TWI: Loaded 34457 existing records from primary storage. [2025-10-17T22:46:01.662438] [INFO ] [MAIN ] TWI: Loaded 34457 primary data records. [2025-10-17T22:46:01.927884] [DEBUG] [LOCAL ] TWLO: Loaded 53590 existing records from primary storage. [2025-10-17T22:46:01.960120] [INFO ] [MAIN ] TWLO: Loaded 53590 primary data records. [2025-10-17T22:46:02.505331] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:02.506246] [INFO ] [MAIN ] TWN: Generated 1820 derivative records from 3361 primary records. [2025-10-17T22:46:02.506842] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-17T22:46:02.524575] [DEBUG] [LOCAL ] TWN: Derivative data saved (1820 records). [2025-10-17T22:46:02.524800] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-17T22:46:02.526994] [INFO ] [MAIN ] Derivative Progress: 1879/2083 symbols completed. TWN took 1.0s. Estimated remaining: 1m 17s. Rate: 158.1 symbols/min [2025-10-17T22:46:02.540308] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:02.541191] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:02.542199] [INFO ] [MAIN ] TWI: Generated 1820 derivative records from 34457 primary records. [2025-10-17T22:46:02.542408] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-17T22:46:02.560981] [DEBUG] [LOCAL ] TWI: Derivative data saved (1820 records). [2025-10-17T22:46:02.562139] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-17T22:46:02.564954] [INFO ] [MAIN ] Derivative Progress: 1880/2083 symbols completed. TWI took 1.1s. Estimated remaining: 1m 17s. Rate: 158.2 symbols/min [2025-10-17T22:46:02.565393] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:02.580359] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:02.581166] [INFO ] [MAIN ] TWLO: Generated 1820 derivative records from 53590 primary records. [2025-10-17T22:46:02.581363] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-17T22:46:02.614740] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1820 records). [2025-10-17T22:46:02.614895] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-17T22:46:02.616930] [INFO ] [MAIN ] Derivative Progress: 1881/2083 symbols completed. TWLO took 1.1s. Estimated remaining: 1m 17s. Rate: 158.3 symbols/min [2025-10-17T22:46:02.617218] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:02.642063] [DEBUG] [LOCAL ] TX: Loaded 23667 existing records from primary storage. [2025-10-17T22:46:02.643169] [DEBUG] [LOCAL ] TWO: Loaded 49363 existing records from primary storage. [2025-10-17T22:46:02.642233] [INFO ] [MAIN ] TX: Loaded 23667 primary data records. [2025-10-17T22:46:02.643261] [INFO ] [MAIN ] TWO: Loaded 49363 primary data records. [2025-10-17T22:46:03.296065] [DEBUG] [LOCAL ] TXNM: Loaded 43953 existing records from primary storage. [2025-10-17T22:46:03.304883] [INFO ] [MAIN ] TXNM: Loaded 43953 primary data records. [2025-10-17T22:46:03.658130] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:03.659760] [INFO ] [MAIN ] TWO: Generated 1820 derivative records from 49363 primary records. [2025-10-17T22:46:03.659974] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-17T22:46:03.700438] [DEBUG] [LOCAL ] TWO: Derivative data saved (1820 records). [2025-10-17T22:46:03.701096] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:03.702358] [INFO ] [MAIN ] TX: Generated 1820 derivative records from 23667 primary records. [2025-10-17T22:46:03.702634] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-17T22:46:03.705077] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-17T22:46:03.704851] [INFO ] [MAIN ] Derivative Progress: 1882/2083 symbols completed. TWO took 1.2s. Estimated remaining: 1m 16s. Rate: 158.1 symbols/min [2025-10-17T22:46:03.706687] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:03.726143] [DEBUG] [LOCAL ] TX: Derivative data saved (1820 records). [2025-10-17T22:46:03.726496] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-17T22:46:03.728903] [INFO ] [MAIN ] Derivative Progress: 1883/2083 symbols completed. TX took 1.2s. Estimated remaining: 1m 16s. Rate: 158.2 symbols/min [2025-10-17T22:46:03.729148] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:03.746034] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:03.746764] [INFO ] [MAIN ] TXNM: Generated 1820 derivative records from 43953 primary records. [2025-10-17T22:46:03.746946] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-17T22:46:03.768739] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1820 records). [2025-10-17T22:46:03.769160] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-10-17T22:46:03.771270] [INFO ] [MAIN ] Derivative Progress: 1884/2083 symbols completed. TXNM took 1.2s. Estimated remaining: 1m 15s. Rate: 158.3 symbols/min [2025-10-17T22:46:03.778514] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:03.779561] [DEBUG] [LOCAL ] TXO: Loaded 20129 existing records from primary storage. [2025-10-17T22:46:03.779741] [INFO ] [MAIN ] TXO: Loaded 20129 primary data records. [2025-10-17T22:46:03.884476] [DEBUG] [LOCAL ] TY: Loaded 7674 existing records from primary storage. [2025-10-17T22:46:03.884883] [INFO ] [MAIN ] TY: Loaded 7674 primary data records. [2025-10-17T22:46:04.066871] [DEBUG] [LOCAL ] TXT: Loaded 50302 existing records from primary storage. [2025-10-17T22:46:04.100508] [INFO ] [MAIN ] TXT: Loaded 50302 primary data records. [2025-10-17T22:46:04.805457] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:04.806612] [INFO ] [MAIN ] TXO: Generated 1820 derivative records from 20129 primary records. [2025-10-17T22:46:04.807050] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-17T22:46:04.824570] [DEBUG] [LOCAL ] TXO: Derivative data saved (1820 records). [2025-10-17T22:46:04.824960] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-17T22:46:04.826976] [INFO ] [MAIN ] Derivative Progress: 1885/2083 symbols completed. TXO took 1.1s. Estimated remaining: 1m 15s. Rate: 158.1 symbols/min [2025-10-17T22:46:04.827472] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:04.846108] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:04.846948] [INFO ] [MAIN ] TY: Generated 1820 derivative records from 7674 primary records. [2025-10-17T22:46:04.847122] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-17T22:46:04.875446] [DEBUG] [LOCAL ] TY: Derivative data saved (1820 records). [2025-10-17T22:46:04.875798] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-17T22:46:04.874062] [DEBUG] [LOCAL ] TYG: Loaded 14089 existing records from primary storage. [2025-10-17T22:46:04.878145] [INFO ] [MAIN ] Derivative Progress: 1886/2083 symbols completed. TY took 1.1s. Estimated remaining: 1m 15s. Rate: 158.2 symbols/min [2025-10-17T22:46:04.891177] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:04.890865] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:04.891579] [INFO ] [MAIN ] TYG: Loaded 14089 primary data records. [2025-10-17T22:46:04.892527] [INFO ] [MAIN ] TXT: Generated 1820 derivative records from 50302 primary records. [2025-10-17T22:46:04.892603] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-17T22:46:04.951977] [DEBUG] [LOCAL ] TXT: Derivative data saved (1820 records). [2025-10-17T22:46:04.964522] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-17T22:46:04.980611] [INFO ] [MAIN ] Derivative Progress: 1887/2083 symbols completed. TXT took 1.3s. Estimated remaining: 1m 14s. Rate: 158.3 symbols/min [2025-10-17T22:46:05.003743] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:05.112549] [DEBUG] [LOCAL ] TYL: Loaded 22658 existing records from primary storage. [2025-10-17T22:46:05.231344] [INFO ] [MAIN ] TYL: Loaded 22658 primary data records. [2025-10-17T22:46:05.576670] [DEBUG] [LOCAL ] U: Loaded 54579 existing records from primary storage. [2025-10-17T22:46:05.576971] [INFO ] [MAIN ] U: Loaded 54579 primary data records. [2025-10-17T22:46:05.897000] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:05.898632] [INFO ] [MAIN ] TYG: Generated 1820 derivative records from 14089 primary records. [2025-10-17T22:46:05.898926] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-17T22:46:05.917213] [DEBUG] [LOCAL ] TYG: Derivative data saved (1820 records). [2025-10-17T22:46:05.917910] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-17T22:46:05.920364] [INFO ] [MAIN ] Derivative Progress: 1888/2083 symbols completed. TYG took 1.1s. Estimated remaining: 1m 14s. Rate: 158.1 symbols/min [2025-10-17T22:46:05.937285] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:05.938806] [INFO ] [MAIN ] TYL: Generated 1820 derivative records from 22658 primary records. [2025-10-17T22:46:05.938870] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-17T22:46:05.955310] [DEBUG] [LOCAL ] TYL: Derivative data saved (1820 records). [2025-10-17T22:46:05.955596] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-17T22:46:05.958074] [INFO ] [MAIN ] Derivative Progress: 1889/2083 symbols completed. TYL took 1.1s. Estimated remaining: 1m 14s. Rate: 158.2 symbols/min [2025-10-17T22:46:05.972977] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:05.973525] [INFO ] [MAIN ] U: Generated 1820 derivative records from 54579 primary records. [2025-10-17T22:46:05.973583] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-17T22:46:05.989231] [DEBUG] [LOCAL ] U: Derivative data saved (1820 records). [2025-10-17T22:46:05.989304] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-17T22:46:05.991398] [INFO ] [MAIN ] Derivative Progress: 1890/2083 symbols completed. U took 1.0s. Estimated remaining: 1m 13s. Rate: 158.3 symbols/min [2025-10-17T22:46:05.991827] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:05.991998] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:05.991926] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:06.001162] [DEBUG] [LOCAL ] UAN: Loaded 5477 existing records from primary storage. [2025-10-17T22:46:06.001413] [INFO ] [MAIN ] UAN: Loaded 5477 primary data records. [2025-10-17T22:46:06.381718] [DEBUG] [LOCAL ] UA: Loaded 51219 existing records from primary storage. [2025-10-17T22:46:06.382880] [DEBUG] [LOCAL ] UAA: Loaded 54277 existing records from primary storage. [2025-10-17T22:46:06.384622] [INFO ] [MAIN ] UAA: Loaded 54277 primary data records. [2025-10-17T22:46:06.390790] [INFO ] [MAIN ] UA: Loaded 51219 primary data records. [2025-10-17T22:46:07.162978] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:07.165124] [INFO ] [MAIN ] UAN: Generated 1820 derivative records from 5477 primary records. [2025-10-17T22:46:07.165229] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-17T22:46:07.186859] [DEBUG] [LOCAL ] UAN: Derivative data saved (1820 records). [2025-10-17T22:46:07.188391] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-17T22:46:07.192637] [INFO ] [MAIN ] Derivative Progress: 1891/2083 symbols completed. UAN took 1.2s. Estimated remaining: 1m 13s. Rate: 158.1 symbols/min [2025-10-17T22:46:07.193524] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:07.219922] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:07.221403] [INFO ] [MAIN ] UAA: Generated 1820 derivative records from 54277 primary records. [2025-10-17T22:46:07.221617] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-17T22:46:07.244346] [DEBUG] [LOCAL ] UAA: Derivative data saved (1820 records). [2025-10-17T22:46:07.244887] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-17T22:46:07.247820] [INFO ] [MAIN ] Derivative Progress: 1892/2083 symbols completed. UAA took 1.3s. Estimated remaining: 1m 12s. Rate: 158.2 symbols/min [2025-10-17T22:46:07.264614] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:07.266024] [INFO ] [MAIN ] UA: Generated 1820 derivative records from 51219 primary records. [2025-10-17T22:46:07.263606] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:07.282990] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-17T22:46:07.302961] [DEBUG] [LOCAL ] UA: Derivative data saved (1820 records). [2025-10-17T22:46:07.303352] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-17T22:46:07.306398] [INFO ] [MAIN ] Derivative Progress: 1893/2083 symbols completed. UA took 1.3s. Estimated remaining: 1m 12s. Rate: 158.3 symbols/min [2025-10-17T22:46:07.320496] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:07.323883] [DEBUG] [LOCAL ] UBER: Loaded 54586 existing records from primary storage. [2025-10-17T22:46:07.324115] [INFO ] [MAIN ] UBER: Loaded 54586 primary data records. [2025-10-17T22:46:07.564013] [DEBUG] [LOCAL ] UBS: Loaded 53087 existing records from primary storage. [2025-10-17T22:46:07.692538] [INFO ] [MAIN ] UBS: Loaded 53087 primary data records. [2025-10-17T22:46:07.694167] [DEBUG] [LOCAL ] UCB: Loaded 38433 existing records from primary storage. [2025-10-17T22:46:07.729399] [INFO ] [MAIN ] UCB: Loaded 38433 primary data records. [2025-10-17T22:46:08.351447] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:08.353518] [INFO ] [MAIN ] UBER: Generated 1820 derivative records from 54586 primary records. [2025-10-17T22:46:08.353754] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-17T22:46:08.376083] [DEBUG] [LOCAL ] UBER: Derivative data saved (1820 records). [2025-10-17T22:46:08.378680] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-17T22:46:08.381916] [INFO ] [MAIN ] Derivative Progress: 1894/2083 symbols completed. UBER took 1.2s. Estimated remaining: 1m 12s. Rate: 158.1 symbols/min [2025-10-17T22:46:08.382272] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:08.398786] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:08.399889] [INFO ] [MAIN ] UBS: Generated 1820 derivative records from 53087 primary records. [2025-10-17T22:46:08.400083] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-17T22:46:08.437007] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:08.436696] [DEBUG] [LOCAL ] UBS: Derivative data saved (1820 records). [2025-10-17T22:46:08.438022] [INFO ] [MAIN ] UCB: Generated 1820 derivative records from 38433 primary records. [2025-10-17T22:46:08.438176] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-17T22:46:08.440357] [INFO ] [MAIN ] Derivative Progress: 1895/2083 symbols completed. UBS took 1.2s. Estimated remaining: 1m 11s. Rate: 158.2 symbols/min [2025-10-17T22:46:08.438251] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-10-17T22:46:08.441621] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:08.458358] [DEBUG] [LOCAL ] UCB: Derivative data saved (1820 records). [2025-10-17T22:46:08.458549] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-10-17T22:46:08.462503] [INFO ] [MAIN ] Derivative Progress: 1896/2083 symbols completed. UCB took 1.1s. Estimated remaining: 1m 11s. Rate: 158.3 symbols/min [2025-10-17T22:46:08.462731] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:08.486740] [DEBUG] [LOCAL ] UFI: Loaded 8274 existing records from primary storage. [2025-10-17T22:46:08.486859] [INFO ] [MAIN ] UFI: Loaded 8274 primary data records. [2025-10-17T22:46:08.636542] [DEBUG] [LOCAL ] UDR: Loaded 52826 existing records from primary storage. [2025-10-17T22:46:08.642314] [INFO ] [MAIN ] UDR: Loaded 52826 primary data records. [2025-10-17T22:46:08.997992] [DEBUG] [LOCAL ] UGI: Loaded 51333 existing records from primary storage. [2025-10-17T22:46:09.007522] [INFO ] [MAIN ] UGI: Loaded 51333 primary data records. [2025-10-17T22:46:09.557537] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:09.560175] [INFO ] [MAIN ] UFI: Generated 1820 derivative records from 8274 primary records. [2025-10-17T22:46:09.560999] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-17T22:46:09.590256] [DEBUG] [LOCAL ] UFI: Derivative data saved (1820 records). [2025-10-17T22:46:09.589362] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:09.590426] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-17T22:46:09.591214] [INFO ] [MAIN ] UDR: Generated 1820 derivative records from 52826 primary records. [2025-10-17T22:46:09.593557] [INFO ] [MAIN ] Derivative Progress: 1897/2083 symbols completed. UFI took 1.2s. Estimated remaining: 1m 11s. Rate: 158.1 symbols/min [2025-10-17T22:46:09.593744] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:09.594266] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-17T22:46:09.610904] [DEBUG] [LOCAL ] UDR: Derivative data saved (1820 records). [2025-10-17T22:46:09.613357] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-17T22:46:09.615825] [INFO ] [MAIN ] Derivative Progress: 1898/2083 symbols completed. UDR took 1.2s. Estimated remaining: 1m 10s. Rate: 158.2 symbols/min [2025-10-17T22:46:09.616024] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:09.629779] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:09.630519] [INFO ] [MAIN ] UGI: Generated 1820 derivative records from 51333 primary records. [2025-10-17T22:46:09.630604] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-17T22:46:09.653178] [DEBUG] [LOCAL ] UGI: Derivative data saved (1820 records). [2025-10-17T22:46:09.653434] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-17T22:46:09.655754] [INFO ] [MAIN ] Derivative Progress: 1899/2083 symbols completed. UGI took 1.2s. Estimated remaining: 1m 10s. Rate: 158.2 symbols/min [2025-10-17T22:46:09.656068] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:09.672174] [DEBUG] [LOCAL ] UHAL: Loaded 17102 existing records from primary storage. [2025-10-17T22:46:09.672381] [INFO ] [MAIN ] UHAL: Loaded 17102 primary data records. [2025-10-17T22:46:09.789786] [DEBUG] [LOCAL ] UGP: Loaded 43519 existing records from primary storage. [2025-10-17T22:46:09.790447] [INFO ] [MAIN ] UGP: Loaded 43519 primary data records. [2025-10-17T22:46:10.122010] [DEBUG] [LOCAL ] UHS: Loaded 40593 existing records from primary storage. [2025-10-17T22:46:10.133608] [INFO ] [MAIN ] UHS: Loaded 40593 primary data records. [2025-10-17T22:46:10.641791] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:10.642962] [INFO ] [MAIN ] UHAL: Generated 1820 derivative records from 17102 primary records. [2025-10-17T22:46:10.643385] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-17T22:46:10.665612] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1820 records). [2025-10-17T22:46:10.666014] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-17T22:46:10.676462] [INFO ] [MAIN ] Derivative Progress: 1900/2083 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 9s. Rate: 158.1 symbols/min [2025-10-17T22:46:10.682634] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:10.682845] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:10.683909] [INFO ] [MAIN ] UGP: Generated 1820 derivative records from 43519 primary records. [2025-10-17T22:46:10.685146] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-17T22:46:10.720081] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:10.719730] [DEBUG] [LOCAL ] UGP: Derivative data saved (1820 records). [2025-10-17T22:46:10.721138] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-17T22:46:10.721007] [INFO ] [MAIN ] UHS: Generated 1820 derivative records from 40593 primary records. [2025-10-17T22:46:10.721261] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-17T22:46:10.723696] [INFO ] [MAIN ] Derivative Progress: 1901/2083 symbols completed. UGP took 1.1s. Estimated remaining: 1m 9s. Rate: 158.2 symbols/min [2025-10-17T22:46:10.729554] [DEBUG] [LOCAL ] UHT: Loaded 10371 existing records from primary storage. [2025-10-17T22:46:10.738082] [INFO ] [MAIN ] UHT: Loaded 10371 primary data records. [2025-10-17T22:46:10.728976] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:10.770535] [DEBUG] [LOCAL ] UHS: Derivative data saved (1820 records). [2025-10-17T22:46:10.797206] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-17T22:46:10.814010] [INFO ] [MAIN ] Derivative Progress: 1902/2083 symbols completed. UHS took 1.2s. Estimated remaining: 1m 9s. Rate: 158.2 symbols/min [2025-10-17T22:46:10.844218] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:10.906400] [DEBUG] [LOCAL ] UI: Loaded 14297 existing records from primary storage. [2025-10-17T22:46:10.927784] [INFO ] [MAIN ] UI: Loaded 14297 primary data records. [2025-10-17T22:46:11.304791] [DEBUG] [LOCAL ] UIS: Loaded 37313 existing records from primary storage. [2025-10-17T22:46:11.318539] [INFO ] [MAIN ] UIS: Loaded 37313 primary data records. [2025-10-17T22:46:11.824985] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:11.827237] [INFO ] [MAIN ] UHT: Generated 1820 derivative records from 10371 primary records. [2025-10-17T22:46:11.827738] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-17T22:46:11.850256] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:11.860333] [INFO ] [MAIN ] UI: Generated 1820 derivative records from 14297 primary records. [2025-10-17T22:46:11.860525] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-17T22:46:11.859475] [DEBUG] [LOCAL ] UHT: Derivative data saved (1820 records). [2025-10-17T22:46:11.861377] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-17T22:46:11.872423] [INFO ] [MAIN ] Derivative Progress: 1903/2083 symbols completed. UHT took 1.2s. Estimated remaining: 1m 8s. Rate: 158.1 symbols/min [2025-10-17T22:46:11.881487] [DEBUG] [LOCAL ] UI: Derivative data saved (1820 records). [2025-10-17T22:46:11.881696] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-17T22:46:11.883968] [INFO ] [MAIN ] Derivative Progress: 1904/2083 symbols completed. UI took 1.2s. Estimated remaining: 1m 8s. Rate: 158.2 symbols/min [2025-10-17T22:46:11.899679] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:11.900305] [INFO ] [MAIN ] UIS: Generated 1820 derivative records from 37313 primary records. [2025-10-17T22:46:11.900367] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-17T22:46:11.915108] [DEBUG] [LOCAL ] UIS: Derivative data saved (1820 records). [2025-10-17T22:46:11.915166] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-17T22:46:11.917312] [INFO ] [MAIN ] Derivative Progress: 1905/2083 symbols completed. UIS took 1.1s. Estimated remaining: 1m 7s. Rate: 158.2 symbols/min [2025-10-17T22:46:11.917727] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:11.917863] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:11.917955] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:12.000371] [DEBUG] [LOCAL ] ULS: Loaded 39538 existing records from primary storage. [2025-10-17T22:46:12.001732] [INFO ] [MAIN ] ULS: Loaded 39538 primary data records. [2025-10-17T22:46:12.001542] [DEBUG] [LOCAL ] UL: Loaded 53858 existing records from primary storage. [2025-10-17T22:46:12.007240] [INFO ] [MAIN ] UL: Loaded 53858 primary data records. [2025-10-17T22:46:12.221830] [DEBUG] [LOCAL ] UMC: Loaded 53463 existing records from primary storage. [2025-10-17T22:46:12.242851] [INFO ] [MAIN ] UMC: Loaded 53463 primary data records. [2025-10-17T22:46:13.035503] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:13.048574] [INFO ] [MAIN ] UL: Generated 1820 derivative records from 53858 primary records. [2025-10-17T22:46:13.048845] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-17T22:46:13.049955] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:13.050594] [INFO ] [MAIN ] ULS: Generated 1820 derivative records from 39538 primary records. [2025-10-17T22:46:13.050704] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-17T22:46:13.081119] [DEBUG] [LOCAL ] UL: Derivative data saved (1820 records). [2025-10-17T22:46:13.081611] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-17T22:46:13.092575] [INFO ] [MAIN ] Derivative Progress: 1906/2083 symbols completed. UL took 1.2s. Estimated remaining: 1m 7s. Rate: 158.1 symbols/min [2025-10-17T22:46:13.093491] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:13.100196] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:13.100699] [DEBUG] [LOCAL ] ULS: Derivative data saved (1820 records). [2025-10-17T22:46:13.101394] [INFO ] [MAIN ] UMC: Generated 1820 derivative records from 53463 primary records. [2025-10-17T22:46:13.101497] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-17T22:46:13.103273] [INFO ] [MAIN ] Derivative Progress: 1907/2083 symbols completed. ULS took 1.2s. Estimated remaining: 1m 7s. Rate: 158.2 symbols/min [2025-10-17T22:46:13.103514] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-17T22:46:13.103404] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:13.127474] [DEBUG] [LOCAL ] UMC: Derivative data saved (1820 records). [2025-10-17T22:46:13.127755] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-17T22:46:13.130023] [INFO ] [MAIN ] Derivative Progress: 1908/2083 symbols completed. UMC took 1.2s. Estimated remaining: 1m 6s. Rate: 158.2 symbols/min [2025-10-17T22:46:13.137987] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:13.144067] [DEBUG] [LOCAL ] UNF: Loaded 12140 existing records from primary storage. [2025-10-17T22:46:13.144205] [INFO ] [MAIN ] UNF: Loaded 12140 primary data records. [2025-10-17T22:46:13.262306] [DEBUG] [LOCAL ] UMH: Loaded 34724 existing records from primary storage. [2025-10-17T22:46:13.268480] [INFO ] [MAIN ] UMH: Loaded 34724 primary data records. [2025-10-17T22:46:13.666107] [DEBUG] [LOCAL ] UNFI: Loaded 43232 existing records from primary storage. [2025-10-17T22:46:13.771294] [INFO ] [MAIN ] UNFI: Loaded 43232 primary data records. [2025-10-17T22:46:14.123150] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:14.125069] [INFO ] [MAIN ] UNF: Generated 1820 derivative records from 12140 primary records. [2025-10-17T22:46:14.125237] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-17T22:46:14.159754] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:14.161327] [INFO ] [MAIN ] UMH: Generated 1820 derivative records from 34724 primary records. [2025-10-17T22:46:14.161773] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-17T22:46:14.164329] [DEBUG] [LOCAL ] UNF: Derivative data saved (1820 records). [2025-10-17T22:46:14.173636] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-17T22:46:14.178624] [INFO ] [MAIN ] Derivative Progress: 1909/2083 symbols completed. UNF took 1.1s. Estimated remaining: 1m 6s. Rate: 158.1 symbols/min [2025-10-17T22:46:14.179507] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:14.200228] [DEBUG] [LOCAL ] UMH: Derivative data saved (1820 records). [2025-10-17T22:46:14.201105] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-17T22:46:14.203715] [INFO ] [MAIN ] Derivative Progress: 1910/2083 symbols completed. UMH took 1.1s. Estimated remaining: 1m 6s. Rate: 158.2 symbols/min [2025-10-17T22:46:14.201396] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:14.204628] [INFO ] [MAIN ] UNFI: Generated 1820 derivative records from 43232 primary records. [2025-10-17T22:46:14.204800] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:14.205402] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-17T22:46:14.221879] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1820 records). [2025-10-17T22:46:14.222037] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-17T22:46:14.224341] [INFO ] [MAIN ] Derivative Progress: 1911/2083 symbols completed. UNFI took 1.1s. Estimated remaining: 1m 5s. Rate: 158.2 symbols/min [2025-10-17T22:46:14.224582] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:14.231193] [DEBUG] [LOCAL ] UNMA: Loaded 3559 existing records from primary storage. [2025-10-17T22:46:14.231395] [INFO ] [MAIN ] UNMA: Loaded 3559 primary data records. [2025-10-17T22:46:14.578785] [DEBUG] [LOCAL ] UNH: Loaded 54598 existing records from primary storage. [2025-10-17T22:46:14.580250] [INFO ] [MAIN ] UNH: Loaded 54598 primary data records. [2025-10-17T22:46:14.633720] [DEBUG] [LOCAL ] UNM: Loaded 48817 existing records from primary storage. [2025-10-17T22:46:14.640945] [INFO ] [MAIN ] UNM: Loaded 48817 primary data records. [2025-10-17T22:46:15.272928] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:15.274593] [INFO ] [MAIN ] UNMA: Generated 1820 derivative records from 3559 primary records. [2025-10-17T22:46:15.275038] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-17T22:46:15.295621] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1820 records). [2025-10-17T22:46:15.296077] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-17T22:46:15.298514] [INFO ] [MAIN ] Derivative Progress: 1912/2083 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 5s. Rate: 158.1 symbols/min [2025-10-17T22:46:15.298938] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:15.320819] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:15.321837] [INFO ] [MAIN ] UNH: Generated 1820 derivative records from 54598 primary records. [2025-10-17T22:46:15.321916] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-17T22:46:15.357765] [DEBUG] [LOCAL ] UNH: Derivative data saved (1820 records). [2025-10-17T22:46:15.357993] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-17T22:46:15.360579] [INFO ] [MAIN ] Derivative Progress: 1913/2083 symbols completed. UNH took 1.2s. Estimated remaining: 1m 4s. Rate: 158.2 symbols/min [2025-10-17T22:46:15.355868] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:15.360825] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:15.361886] [INFO ] [MAIN ] UNM: Generated 1820 derivative records from 48817 primary records. [2025-10-17T22:46:15.362190] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-17T22:46:15.379803] [DEBUG] [LOCAL ] UNM: Derivative data saved (1820 records). [2025-10-17T22:46:15.379944] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-17T22:46:15.383697] [INFO ] [MAIN ] Derivative Progress: 1914/2083 symbols completed. UNM took 1.2s. Estimated remaining: 1m 4s. Rate: 158.2 symbols/min [2025-10-17T22:46:15.384103] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:15.425383] [DEBUG] [LOCAL ] UNP: Loaded 54105 existing records from primary storage. [2025-10-17T22:46:15.425658] [INFO ] [MAIN ] UNP: Loaded 54105 primary data records. [2025-10-17T22:46:15.779167] [DEBUG] [LOCAL ] UPS: Loaded 54499 existing records from primary storage. [2025-10-17T22:46:15.779998] [INFO ] [MAIN ] UPS: Loaded 54499 primary data records. [2025-10-17T22:46:15.837479] [DEBUG] [LOCAL ] UP: Loaded 44937 existing records from primary storage. [2025-10-17T22:46:15.863924] [INFO ] [MAIN ] UP: Loaded 44937 primary data records. [2025-10-17T22:46:16.444807] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:16.446611] [INFO ] [MAIN ] UNP: Generated 1820 derivative records from 54105 primary records. [2025-10-17T22:46:16.447327] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-17T22:46:16.468288] [DEBUG] [LOCAL ] UNP: Derivative data saved (1820 records). [2025-10-17T22:46:16.468773] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-17T22:46:16.471426] [INFO ] [MAIN ] Derivative Progress: 1915/2083 symbols completed. UNP took 1.2s. Estimated remaining: 1m 4s. Rate: 158.1 symbols/min [2025-10-17T22:46:16.471671] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:16.490934] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:16.492346] [INFO ] [MAIN ] UPS: Generated 1820 derivative records from 54499 primary records. [2025-10-17T22:46:16.492639] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-17T22:46:16.526858] [DEBUG] [LOCAL ] UPS: Derivative data saved (1820 records). [2025-10-17T22:46:16.523967] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:16.526994] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-10-17T22:46:16.528097] [INFO ] [MAIN ] UP: Generated 1820 derivative records from 44937 primary records. [2025-10-17T22:46:16.528224] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-17T22:46:16.530184] [INFO ] [MAIN ] Derivative Progress: 1916/2083 symbols completed. UPS took 1.1s. Estimated remaining: 1m 3s. Rate: 158.2 symbols/min [2025-10-17T22:46:16.531684] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:16.560911] [DEBUG] [LOCAL ] UP: Derivative data saved (1820 records). [2025-10-17T22:46:16.561217] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-17T22:46:16.563565] [INFO ] [MAIN ] Derivative Progress: 1917/2083 symbols completed. UP took 1.2s. Estimated remaining: 1m 3s. Rate: 158.2 symbols/min [2025-10-17T22:46:16.564092] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:16.581778] [DEBUG] [LOCAL ] USA: Loaded 36917 existing records from primary storage. [2025-10-17T22:46:16.582210] [INFO ] [MAIN ] USA: Loaded 36917 primary data records. [2025-10-17T22:46:16.656367] [DEBUG] [LOCAL ] USAC: Loaded 22019 existing records from primary storage. [2025-10-17T22:46:16.679807] [INFO ] [MAIN ] USAC: Loaded 22019 primary data records. [2025-10-17T22:46:17.302928] [DEBUG] [LOCAL ] USB: Loaded 54468 existing records from primary storage. [2025-10-17T22:46:17.303703] [INFO ] [MAIN ] USB: Loaded 54468 primary data records. [2025-10-17T22:46:17.627340] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:17.628223] [INFO ] [MAIN ] USA: Generated 1820 derivative records from 36917 primary records. [2025-10-17T22:46:17.628450] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-17T22:46:17.662835] [DEBUG] [LOCAL ] USA: Derivative data saved (1820 records). [2025-10-17T22:46:17.661740] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:17.663800] [INFO ] [MAIN ] USAC: Generated 1820 derivative records from 22019 primary records. [2025-10-17T22:46:17.663949] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-17T22:46:17.666174] [INFO ] [MAIN ] Derivative Progress: 1918/2083 symbols completed. USA took 1.2s. Estimated remaining: 1m 3s. Rate: 158.1 symbols/min [2025-10-17T22:46:17.666446] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-17T22:46:17.683383] [DEBUG] [LOCAL ] USAC: Derivative data saved (1820 records). [2025-10-17T22:46:17.683459] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-17T22:46:17.685901] [INFO ] [MAIN ] Derivative Progress: 1919/2083 symbols completed. USAC took 1.2s. Estimated remaining: 1m 2s. Rate: 158.1 symbols/min [2025-10-17T22:46:17.700580] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:17.701123] [INFO ] [MAIN ] USB: Generated 1820 derivative records from 54468 primary records. [2025-10-17T22:46:17.701181] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-17T22:46:17.716036] [DEBUG] [LOCAL ] USB: Derivative data saved (1820 records). [2025-10-17T22:46:17.716094] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-17T22:46:17.718058] [INFO ] [MAIN ] Derivative Progress: 1920/2083 symbols completed. USB took 1.2s. Estimated remaining: 1m 2s. Rate: 158.2 symbols/min [2025-10-17T22:46:17.718417] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:17.718516] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:17.718810] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:17.747375] [DEBUG] [LOCAL ] USPH: Loaded 17392 existing records from primary storage. [2025-10-17T22:46:17.749059] [DEBUG] [LOCAL ] USNA: Loaded 18290 existing records from primary storage. [2025-10-17T22:46:17.748723] [INFO ] [MAIN ] USPH: Loaded 17392 primary data records. [2025-10-17T22:46:17.749364] [INFO ] [MAIN ] USNA: Loaded 18290 primary data records. [2025-10-17T22:46:18.059161] [DEBUG] [LOCAL ] USFD: Loaded 51936 existing records from primary storage. [2025-10-17T22:46:18.241348] [INFO ] [MAIN ] USFD: Loaded 51936 primary data records. [2025-10-17T22:46:18.765080] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:18.767479] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:18.768597] [INFO ] [MAIN ] USPH: Generated 1820 derivative records from 17392 primary records. [2025-10-17T22:46:18.769231] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-17T22:46:18.770242] [INFO ] [MAIN ] USNA: Generated 1820 derivative records from 18290 primary records. [2025-10-17T22:46:18.772164] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-17T22:46:18.792266] [DEBUG] [LOCAL ] USPH: Derivative data saved (1820 records). [2025-10-17T22:46:18.808353] [DEBUG] [LOCAL ] USNA: Derivative data saved (1820 records). [2025-10-17T22:46:18.809550] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-17T22:46:18.809659] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-17T22:46:18.812621] [INFO ] [MAIN ] Derivative Progress: 1921/2083 symbols completed. USNA took 1.1s. Estimated remaining: 1m 1s. Rate: 158.1 symbols/min [2025-10-17T22:46:18.816557] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:18.816685] [INFO ] [MAIN ] Derivative Progress: 1922/2083 symbols completed. USPH took 1.1s. Estimated remaining: 1m 1s. Rate: 158.1 symbols/min [2025-10-17T22:46:18.816990] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:18.831845] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:18.832616] [INFO ] [MAIN ] USFD: Generated 1820 derivative records from 51936 primary records. [2025-10-17T22:46:18.832891] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-17T22:46:18.859852] [DEBUG] [LOCAL ] USFD: Derivative data saved (1820 records). [2025-10-17T22:46:18.860062] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-17T22:46:18.862796] [INFO ] [MAIN ] Derivative Progress: 1923/2083 symbols completed. USFD took 1.1s. Estimated remaining: 1m 1s. Rate: 158.2 symbols/min [2025-10-17T22:46:18.873179] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:18.890307] [DEBUG] [LOCAL ] UTF: Loaded 31389 existing records from primary storage. [2025-10-17T22:46:18.890468] [INFO ] [MAIN ] UTF: Loaded 31389 primary data records. [2025-10-17T22:46:18.993299] [DEBUG] [LOCAL ] UTL: Loaded 12006 existing records from primary storage. [2025-10-17T22:46:18.999872] [INFO ] [MAIN ] UTL: Loaded 12006 primary data records. [2025-10-17T22:46:18.987360] [DEBUG] [LOCAL ] UTI: Loaded 41052 existing records from primary storage. [2025-10-17T22:46:19.055230] [INFO ] [MAIN ] UTI: Loaded 41052 primary data records. [2025-10-17T22:46:19.905463] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:19.906633] [INFO ] [MAIN ] UTF: Generated 1820 derivative records from 31389 primary records. [2025-10-17T22:46:19.906767] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-17T22:46:19.943022] [DEBUG] [LOCAL ] UTF: Derivative data saved (1820 records). [2025-10-17T22:46:19.943414] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-17T22:46:19.945512] [INFO ] [MAIN ] Derivative Progress: 1924/2083 symbols completed. UTF took 1.1s. Estimated remaining: 1m 0s. Rate: 158.1 symbols/min [2025-10-17T22:46:19.946391] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:19.946575] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:19.947908] [INFO ] [MAIN ] UTL: Generated 1820 derivative records from 12006 primary records. [2025-10-17T22:46:19.951109] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-17T22:46:19.972483] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:19.978545] [INFO ] [MAIN ] UTI: Generated 1820 derivative records from 41052 primary records. [2025-10-17T22:46:19.979773] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-17T22:46:19.999551] [DEBUG] [LOCAL ] UTI: Derivative data saved (1820 records). [2025-10-17T22:46:20.000461] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-10-17T22:46:20.002940] [INFO ] [MAIN ] Derivative Progress: 1925/2083 symbols completed. UTI took 1.2s. Estimated remaining: 59.9s. Rate: 158.1 symbols/min [2025-10-17T22:46:20.003549] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:20.005908] [DEBUG] [LOCAL ] UTL: Derivative data saved (1820 records). [2025-10-17T22:46:20.006336] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-17T22:46:20.009333] [INFO ] [MAIN ] Derivative Progress: 1926/2083 symbols completed. UTL took 1.1s. Estimated remaining: 59.5s. Rate: 158.2 symbols/min [2025-10-17T22:46:20.009708] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:20.044955] [DEBUG] [LOCAL ] UVE: Loaded 22261 existing records from primary storage. [2025-10-17T22:46:20.057771] [INFO ] [MAIN ] UVE: Loaded 22261 primary data records. [2025-10-17T22:46:20.090121] [DEBUG] [LOCAL ] UTZ: Loaded 45179 existing records from primary storage. [2025-10-17T22:46:20.096189] [INFO ] [MAIN ] UTZ: Loaded 45179 primary data records. [2025-10-17T22:46:20.128292] [DEBUG] [LOCAL ] UVV: Loaded 22980 existing records from primary storage. [2025-10-17T22:46:20.173146] [INFO ] [MAIN ] UVV: Loaded 22980 primary data records. [2025-10-17T22:46:21.095960] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:21.099065] [INFO ] [MAIN ] UVE: Generated 1820 derivative records from 22261 primary records. [2025-10-17T22:46:21.099368] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-17T22:46:21.113432] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:21.126484] [INFO ] [MAIN ] UTZ: Generated 1820 derivative records from 45179 primary records. [2025-10-17T22:46:21.129106] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-17T22:46:21.149183] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1820 records). [2025-10-17T22:46:21.149334] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-17T22:46:21.152761] [INFO ] [MAIN ] Derivative Progress: 1927/2083 symbols completed. UTZ took 1.2s. Estimated remaining: 59.2s. Rate: 158.1 symbols/min [2025-10-17T22:46:21.161141] [DEBUG] [LOCAL ] UVE: Derivative data saved (1820 records). [2025-10-17T22:46:21.166092] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-17T22:46:21.168334] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:21.168414] [INFO ] [MAIN ] Derivative Progress: 1928/2083 symbols completed. UVE took 1.2s. Estimated remaining: 58.8s. Rate: 158.1 symbols/min [2025-10-17T22:46:21.169689] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:21.169552] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:21.170723] [INFO ] [MAIN ] UVV: Generated 1820 derivative records from 22980 primary records. [2025-10-17T22:46:21.170789] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-17T22:46:21.187228] [DEBUG] [LOCAL ] UVV: Derivative data saved (1820 records). [2025-10-17T22:46:21.187551] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-17T22:46:21.190022] [INFO ] [MAIN ] Derivative Progress: 1929/2083 symbols completed. UVV took 1.2s. Estimated remaining: 58.4s. Rate: 158.2 symbols/min [2025-10-17T22:46:21.190252] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:21.196333] [DEBUG] [LOCAL ] UZD: Loaded 6137 existing records from primary storage. [2025-10-17T22:46:21.196586] [INFO ] [MAIN ] UZD: Loaded 6137 primary data records. [2025-10-17T22:46:21.304063] [DEBUG] [LOCAL ] UZE: Loaded 7329 existing records from primary storage. [2025-10-17T22:46:21.304375] [INFO ] [MAIN ] UZE: Loaded 7329 primary data records. [2025-10-17T22:46:21.654962] [DEBUG] [LOCAL ] UWMC: Loaded 53731 existing records from primary storage. [2025-10-17T22:46:21.665988] [INFO ] [MAIN ] UWMC: Loaded 53731 primary data records. [2025-10-17T22:46:22.180262] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:22.182035] [INFO ] [MAIN ] UZD: Generated 1820 derivative records from 6137 primary records. [2025-10-17T22:46:22.184683] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-17T22:46:22.213881] [DEBUG] [LOCAL ] UZD: Derivative data saved (1820 records). [2025-10-17T22:46:22.214859] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-17T22:46:22.214778] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:22.215879] [INFO ] [MAIN ] UZE: Generated 1820 derivative records from 7329 primary records. [2025-10-17T22:46:22.218137] [INFO ] [MAIN ] Derivative Progress: 1930/2083 symbols completed. UZD took 1.0s. Estimated remaining: 58.1s. Rate: 158.1 symbols/min [2025-10-17T22:46:22.218581] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-17T22:46:22.218478] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:22.239205] [DEBUG] [LOCAL ] UZE: Derivative data saved (1820 records). [2025-10-17T22:46:22.239504] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-17T22:46:22.241699] [INFO ] [MAIN ] Derivative Progress: 1931/2083 symbols completed. UZE took 1.1s. Estimated remaining: 57.7s. Rate: 158.1 symbols/min [2025-10-17T22:46:22.254840] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:22.255318] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:22.256428] [INFO ] [MAIN ] UWMC: Generated 1820 derivative records from 53731 primary records. [2025-10-17T22:46:22.256598] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-17T22:46:22.272413] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1820 records). [2025-10-17T22:46:22.272518] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-17T22:46:22.289112] [INFO ] [MAIN ] Derivative Progress: 1932/2083 symbols completed. UWMC took 1.1s. Estimated remaining: 57.3s. Rate: 158.2 symbols/min [2025-10-17T22:46:22.289419] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:22.312967] [DEBUG] [LOCAL ] V: Loaded 54532 existing records from primary storage. [2025-10-17T22:46:22.320745] [INFO ] [MAIN ] V: Loaded 54532 primary data records. [2025-10-17T22:46:22.455326] [DEBUG] [LOCAL ] VAC: Loaded 34464 existing records from primary storage. [2025-10-17T22:46:22.455587] [INFO ] [MAIN ] VAC: Loaded 34464 primary data records. [2025-10-17T22:46:22.793142] [DEBUG] [LOCAL ] VAL: Loaded 50829 existing records from primary storage. [2025-10-17T22:46:22.815896] [INFO ] [MAIN ] VAL: Loaded 50829 primary data records. [2025-10-17T22:46:23.359398] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:23.361819] [INFO ] [MAIN ] V: Generated 1820 derivative records from 54532 primary records. [2025-10-17T22:46:23.362346] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-17T22:46:23.390008] [DEBUG] [LOCAL ] V: Derivative data saved (1820 records). [2025-10-17T22:46:23.390144] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-17T22:46:23.396920] [INFO ] [MAIN ] Derivative Progress: 1933/2083 symbols completed. V took 1.2s. Estimated remaining: 56.9s. Rate: 158.1 symbols/min [2025-10-17T22:46:23.398244] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:23.399266] [INFO ] [MAIN ] VAC: Generated 1820 derivative records from 34464 primary records. [2025-10-17T22:46:23.399514] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-17T22:46:23.416048] [DEBUG] [LOCAL ] VAC: Derivative data saved (1820 records). [2025-10-17T22:46:23.417052] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-17T22:46:23.419328] [INFO ] [MAIN ] Derivative Progress: 1934/2083 symbols completed. VAC took 1.2s. Estimated remaining: 56.5s. Rate: 158.1 symbols/min [2025-10-17T22:46:23.433947] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:23.434579] [INFO ] [MAIN ] VAL: Generated 1820 derivative records from 50829 primary records. [2025-10-17T22:46:23.434639] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-17T22:46:23.450423] [DEBUG] [LOCAL ] VAL: Derivative data saved (1820 records). [2025-10-17T22:46:23.450485] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-17T22:46:23.452572] [INFO ] [MAIN ] Derivative Progress: 1935/2083 symbols completed. VAL took 1.2s. Estimated remaining: 56.1s. Rate: 158.2 symbols/min [2025-10-17T22:46:23.453513] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:23.453443] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:23.453346] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:23.464776] [DEBUG] [LOCAL ] VATE: Loaded 5266 existing records from primary storage. [2025-10-17T22:46:23.468531] [DEBUG] [LOCAL ] VBF: Loaded 7375 existing records from primary storage. [2025-10-17T22:46:23.468700] [INFO ] [MAIN ] VATE: Loaded 5266 primary data records. [2025-10-17T22:46:23.468807] [INFO ] [MAIN ] VBF: Loaded 7375 primary data records. [2025-10-17T22:46:24.099281] [DEBUG] [LOCAL ] VALE: Loaded 54473 existing records from primary storage. [2025-10-17T22:46:24.109403] [INFO ] [MAIN ] VALE: Loaded 54473 primary data records. [2025-10-17T22:46:24.466170] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:24.468359] [INFO ] [MAIN ] VBF: Generated 1820 derivative records from 7375 primary records. [2025-10-17T22:46:24.468753] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-17T22:46:24.494787] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:24.496542] [INFO ] [MAIN ] VATE: Generated 1820 derivative records from 5266 primary records. [2025-10-17T22:46:24.497602] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-17T22:46:24.516128] [DEBUG] [LOCAL ] VATE: Derivative data saved (1820 records). [2025-10-17T22:46:24.517622] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-17T22:46:24.517343] [DEBUG] [LOCAL ] VBF: Derivative data saved (1820 records). [2025-10-17T22:46:24.522604] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-17T22:46:24.521501] [INFO ] [MAIN ] Derivative Progress: 1936/2083 symbols completed. VATE took 1.1s. Estimated remaining: 55.8s. Rate: 158.1 symbols/min [2025-10-17T22:46:24.526192] [INFO ] [MAIN ] Derivative Progress: 1937/2083 symbols completed. VBF took 1.1s. Estimated remaining: 55.4s. Rate: 158.1 symbols/min [2025-10-17T22:46:24.523892] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:24.539519] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:24.541094] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:24.541796] [INFO ] [MAIN ] VALE: Generated 1820 derivative records from 54473 primary records. [2025-10-17T22:46:24.541865] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-17T22:46:24.566016] [DEBUG] [LOCAL ] VALE: Derivative data saved (1820 records). [2025-10-17T22:46:24.566385] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-17T22:46:24.568639] [INFO ] [MAIN ] Derivative Progress: 1938/2083 symbols completed. VALE took 1.1s. Estimated remaining: 55.0s. Rate: 158.2 symbols/min [2025-10-17T22:46:24.570056] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:24.577438] [DEBUG] [LOCAL ] VCV: Loaded 13798 existing records from primary storage. [2025-10-17T22:46:24.577751] [INFO ] [MAIN ] VCV: Loaded 13798 primary data records. [2025-10-17T22:46:24.684523] [DEBUG] [LOCAL ] VEL: Loaded 12350 existing records from primary storage. [2025-10-17T22:46:24.702661] [INFO ] [MAIN ] VEL: Loaded 12350 primary data records. [2025-10-17T22:46:24.752918] [DEBUG] [LOCAL ] VEEV: Loaded 48056 existing records from primary storage. [2025-10-17T22:46:24.791896] [INFO ] [MAIN ] VEEV: Loaded 48056 primary data records. [2025-10-17T22:46:25.613430] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:25.617158] [INFO ] [MAIN ] VCV: Generated 1820 derivative records from 13798 primary records. [2025-10-17T22:46:25.629562] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-17T22:46:25.630091] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:25.644791] [INFO ] [MAIN ] VEL: Generated 1820 derivative records from 12350 primary records. [2025-10-17T22:46:25.653488] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-17T22:46:25.661234] [DEBUG] [LOCAL ] VCV: Derivative data saved (1820 records). [2025-10-17T22:46:25.657013] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:25.662450] [INFO ] [MAIN ] VEEV: Generated 1820 derivative records from 48056 primary records. [2025-10-17T22:46:25.669566] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-17T22:46:25.669497] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-17T22:46:25.673410] [INFO ] [MAIN ] Derivative Progress: 1939/2083 symbols completed. VCV took 1.1s. Estimated remaining: 54.7s. Rate: 158.1 symbols/min [2025-10-17T22:46:25.673620] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:25.694882] [DEBUG] [LOCAL ] VEL: Derivative data saved (1820 records). [2025-10-17T22:46:25.695826] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-17T22:46:25.699004] [INFO ] [MAIN ] Derivative Progress: 1940/2083 symbols completed. VEL took 1.1s. Estimated remaining: 54.3s. Rate: 158.1 symbols/min [2025-10-17T22:46:25.699200] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:25.702267] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1820 records). [2025-10-17T22:46:25.702481] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-17T22:46:25.704700] [INFO ] [MAIN ] Derivative Progress: 1941/2083 symbols completed. VEEV took 1.2s. Estimated remaining: 53.9s. Rate: 158.2 symbols/min [2025-10-17T22:46:25.704973] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:25.717181] [DEBUG] [LOCAL ] VGI: Loaded 5280 existing records from primary storage. [2025-10-17T22:46:25.717539] [INFO ] [MAIN ] VGI: Loaded 5280 primary data records. [2025-10-17T22:46:25.897052] [DEBUG] [LOCAL ] VET: Loaded 44787 existing records from primary storage. [2025-10-17T22:46:25.916220] [INFO ] [MAIN ] VET: Loaded 44787 primary data records. [2025-10-17T22:46:26.195347] [DEBUG] [LOCAL ] VFC: Loaded 54384 existing records from primary storage. [2025-10-17T22:46:26.222705] [INFO ] [MAIN ] VFC: Loaded 54384 primary data records. [2025-10-17T22:46:26.744397] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:26.745897] [INFO ] [MAIN ] VGI: Generated 1820 derivative records from 5280 primary records. [2025-10-17T22:46:26.746484] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-17T22:46:26.762862] [DEBUG] [LOCAL ] VGI: Derivative data saved (1820 records). [2025-10-17T22:46:26.763102] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-17T22:46:26.765817] [INFO ] [MAIN ] Derivative Progress: 1942/2083 symbols completed. VGI took 1.1s. Estimated remaining: 53.5s. Rate: 158.1 symbols/min [2025-10-17T22:46:26.766274] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:26.791062] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:26.792027] [INFO ] [MAIN ] VET: Generated 1820 derivative records from 44787 primary records. [2025-10-17T22:46:26.799149] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-17T22:46:26.822065] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:26.835178] [DEBUG] [LOCAL ] VET: Derivative data saved (1820 records). [2025-10-17T22:46:26.835726] [DEBUG] [LOCAL ] VGM: Loaded 18936 existing records from primary storage. [2025-10-17T22:46:26.836836] [INFO ] [MAIN ] VGM: Loaded 18936 primary data records. [2025-10-17T22:46:26.836761] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-17T22:46:26.836527] [INFO ] [MAIN ] VFC: Generated 1820 derivative records from 54384 primary records. [2025-10-17T22:46:26.857711] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-17T22:46:26.871347] [INFO ] [MAIN ] Derivative Progress: 1943/2083 symbols completed. VET took 1.2s. Estimated remaining: 53.1s. Rate: 158.1 symbols/min [2025-10-17T22:46:26.922773] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:26.964121] [DEBUG] [LOCAL ] VFC: Derivative data saved (1820 records). [2025-10-17T22:46:26.980465] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-17T22:46:26.985094] [INFO ] [MAIN ] Derivative Progress: 1944/2083 symbols completed. VFC took 1.3s. Estimated remaining: 52.7s. Rate: 158.2 symbols/min [2025-10-17T22:46:26.995765] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:26.990450] [DEBUG] [LOCAL ] VHI: Loaded 2811 existing records from primary storage. [2025-10-17T22:46:26.996062] [INFO ] [MAIN ] VHI: Loaded 2811 primary data records. [2025-10-17T22:46:27.551110] [DEBUG] [LOCAL ] VICI: Loaded 54433 existing records from primary storage. [2025-10-17T22:46:27.552632] [INFO ] [MAIN ] VICI: Loaded 54433 primary data records. [2025-10-17T22:46:27.653028] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:27.664983] [INFO ] [MAIN ] VGM: Generated 1820 derivative records from 18936 primary records. [2025-10-17T22:46:27.685250] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-17T22:46:27.809000] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:27.802537] [DEBUG] [LOCAL ] VGM: Derivative data saved (1820 records). [2025-10-17T22:46:27.912181] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-17T22:46:27.913060] [INFO ] [MAIN ] VHI: Generated 1820 derivative records from 2811 primary records. [2025-10-17T22:46:27.929140] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-17T22:46:27.928986] [INFO ] [MAIN ] Derivative Progress: 1945/2083 symbols completed. VGM took 1.2s. Estimated remaining: 52.4s. Rate: 158.1 symbols/min [2025-10-17T22:46:27.929428] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:27.952855] [DEBUG] [LOCAL ] VHI: Derivative data saved (1820 records). [2025-10-17T22:46:27.953307] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-17T22:46:27.957359] [INFO ] [MAIN ] Derivative Progress: 1946/2083 symbols completed. VHI took 1.0s. Estimated remaining: 52.0s. Rate: 158.1 symbols/min [2025-10-17T22:46:27.957842] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:27.977602] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:27.978373] [INFO ] [MAIN ] VICI: Generated 1820 derivative records from 54433 primary records. [2025-10-17T22:46:27.978548] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-17T22:46:28.012476] [DEBUG] [LOCAL ] VICI: Derivative data saved (1820 records). [2025-10-17T22:46:28.013577] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-17T22:46:28.015750] [INFO ] [MAIN ] Derivative Progress: 1947/2083 symbols completed. VICI took 1.0s. Estimated remaining: 51.6s. Rate: 158.2 symbols/min [2025-10-17T22:46:28.016348] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:28.037257] [DEBUG] [LOCAL ] VIK: Loaded 53232 existing records from primary storage. [2025-10-17T22:46:28.037733] [INFO ] [MAIN ] VIK: Loaded 53232 primary data records. [2025-10-17T22:46:28.227031] [DEBUG] [LOCAL ] VIPS: Loaded 52050 existing records from primary storage. [2025-10-17T22:46:28.265737] [INFO ] [MAIN ] VIPS: Loaded 52050 primary data records. [2025-10-17T22:46:28.510871] [DEBUG] [LOCAL ] VIRT: Loaded 47324 existing records from primary storage. [2025-10-17T22:46:28.516547] [INFO ] [MAIN ] VIRT: Loaded 47324 primary data records. [2025-10-17T22:46:29.074299] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:29.075523] [INFO ] [MAIN ] VIK: Generated 1820 derivative records from 53232 primary records. [2025-10-17T22:46:29.076564] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-17T22:46:29.095778] [DEBUG] [LOCAL ] VIK: Derivative data saved (1820 records). [2025-10-17T22:46:29.095950] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-17T22:46:29.098061] [INFO ] [MAIN ] Derivative Progress: 1948/2083 symbols completed. VIK took 1.2s. Estimated remaining: 51.2s. Rate: 158.1 symbols/min [2025-10-17T22:46:29.113740] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:29.114562] [INFO ] [MAIN ] VIPS: Generated 1820 derivative records from 52050 primary records. [2025-10-17T22:46:29.114892] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-17T22:46:29.146588] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1820 records). [2025-10-17T22:46:29.146940] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-17T22:46:29.149314] [INFO ] [MAIN ] Derivative Progress: 1949/2083 symbols completed. VIPS took 1.2s. Estimated remaining: 50.8s. Rate: 158.1 symbols/min [2025-10-17T22:46:29.146863] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:29.150208] [INFO ] [MAIN ] VIRT: Generated 1820 derivative records from 47324 primary records. [2025-10-17T22:46:29.150279] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-17T22:46:29.165321] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1820 records). [2025-10-17T22:46:29.165381] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-17T22:46:29.167459] [INFO ] [MAIN ] Derivative Progress: 1950/2083 symbols completed. VIRT took 1.2s. Estimated remaining: 50.4s. Rate: 158.2 symbols/min [2025-10-17T22:46:29.168079] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:29.168208] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:29.168333] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:29.187289] [DEBUG] [LOCAL ] VKQ: Loaded 18083 existing records from primary storage. [2025-10-17T22:46:29.187440] [INFO ] [MAIN ] VKQ: Loaded 18083 primary data records. [2025-10-17T22:46:29.419224] [DEBUG] [LOCAL ] VIST: Loaded 47252 existing records from primary storage. [2025-10-17T22:46:29.521392] [DEBUG] [LOCAL ] VIV: Loaded 45447 existing records from primary storage. [2025-10-17T22:46:29.535263] [INFO ] [MAIN ] VIST: Loaded 47252 primary data records. [2025-10-17T22:46:29.535590] [INFO ] [MAIN ] VIV: Loaded 45447 primary data records. [2025-10-17T22:46:30.171135] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:30.172418] [INFO ] [MAIN ] VKQ: Generated 1820 derivative records from 18083 primary records. [2025-10-17T22:46:30.172824] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-17T22:46:30.196268] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1820 records). [2025-10-17T22:46:30.197019] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-17T22:46:30.199692] [INFO ] [MAIN ] Derivative Progress: 1951/2083 symbols completed. VKQ took 1.0s. Estimated remaining: 50.1s. Rate: 158.1 symbols/min [2025-10-17T22:46:30.212345] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:30.213780] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:30.214692] [INFO ] [MAIN ] VIST: Generated 1820 derivative records from 47252 primary records. [2025-10-17T22:46:30.215167] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-17T22:46:30.235459] [DEBUG] [LOCAL ] VIST: Derivative data saved (1820 records). [2025-10-17T22:46:30.235691] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-17T22:46:30.238072] [INFO ] [MAIN ] Derivative Progress: 1952/2083 symbols completed. VIST took 1.1s. Estimated remaining: 49.7s. Rate: 158.1 symbols/min [2025-10-17T22:46:30.238327] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:30.252777] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:30.253808] [INFO ] [MAIN ] VIV: Generated 1820 derivative records from 45447 primary records. [2025-10-17T22:46:30.253959] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-17T22:46:30.280639] [DEBUG] [LOCAL ] VIV: Derivative data saved (1820 records). [2025-10-17T22:46:30.280904] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-17T22:46:30.293564] [INFO ] [MAIN ] Derivative Progress: 1953/2083 symbols completed. VIV took 1.1s. Estimated remaining: 49.3s. Rate: 158.2 symbols/min [2025-10-17T22:46:30.291233] [DEBUG] [LOCAL ] VLN: Loaded 31295 existing records from primary storage. [2025-10-17T22:46:30.293799] [INFO ] [MAIN ] VLN: Loaded 31295 primary data records. [2025-10-17T22:46:30.294052] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:30.630693] [DEBUG] [LOCAL ] VLO: Loaded 53782 existing records from primary storage. [2025-10-17T22:46:30.630964] [INFO ] [MAIN ] VLO: Loaded 53782 primary data records. [2025-10-17T22:46:30.746628] [DEBUG] [LOCAL ] VLRS: Loaded 40231 existing records from primary storage. [2025-10-17T22:46:30.752502] [INFO ] [MAIN ] VLRS: Loaded 40231 primary data records. [2025-10-17T22:46:31.312379] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:31.315403] [INFO ] [MAIN ] VLN: Generated 1820 derivative records from 31295 primary records. [2025-10-17T22:46:31.316139] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-17T22:46:31.335505] [DEBUG] [LOCAL ] VLN: Derivative data saved (1820 records). [2025-10-17T22:46:31.335739] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-17T22:46:31.338166] [INFO ] [MAIN ] Derivative Progress: 1954/2083 symbols completed. VLN took 1.1s. Estimated remaining: 49.0s. Rate: 158.1 symbols/min [2025-10-17T22:46:31.339383] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:31.350532] [DEBUG] [LOCAL ] VLT: Loaded 4468 existing records from primary storage. [2025-10-17T22:46:31.358449] [INFO ] [MAIN ] VLT: Loaded 4468 primary data records. [2025-10-17T22:46:31.364112] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:31.401456] [INFO ] [MAIN ] VLO: Generated 1820 derivative records from 53782 primary records. [2025-10-17T22:46:31.421532] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-17T22:46:31.490889] [DEBUG] [LOCAL ] VLO: Derivative data saved (1820 records). [2025-10-17T22:46:31.526850] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-17T22:46:31.526618] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:31.534471] [INFO ] [MAIN ] Derivative Progress: 1955/2083 symbols completed. VLO took 1.3s. Estimated remaining: 48.6s. Rate: 158.1 symbols/min [2025-10-17T22:46:31.588859] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:31.588670] [INFO ] [MAIN ] VLRS: Generated 1820 derivative records from 40231 primary records. [2025-10-17T22:46:31.705070] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-17T22:46:31.733317] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1820 records). [2025-10-17T22:46:31.733782] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-17T22:46:31.736710] [INFO ] [MAIN ] Derivative Progress: 1956/2083 symbols completed. VLRS took 1.4s. Estimated remaining: 48.2s. Rate: 158.1 symbols/min [2025-10-17T22:46:31.737063] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:31.771943] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:31.784594] [INFO ] [MAIN ] VLT: Generated 1820 derivative records from 4468 primary records. [2025-10-17T22:46:31.785689] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-17T22:46:31.786769] [DEBUG] [LOCAL ] VLTO: Loaded 46842 existing records from primary storage. [2025-10-17T22:46:31.787099] [INFO ] [MAIN ] VLTO: Loaded 46842 primary data records. [2025-10-17T22:46:31.893679] [DEBUG] [LOCAL ] VLT: Derivative data saved (1820 records). [2025-10-17T22:46:31.914795] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-17T22:46:31.917132] [INFO ] [MAIN ] Derivative Progress: 1957/2083 symbols completed. VLT took 0.6s. Estimated remaining: 47.8s. Rate: 158.2 symbols/min [2025-10-17T22:46:31.918396] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:31.989627] [DEBUG] [LOCAL ] VMC: Loaded 43121 existing records from primary storage. [2025-10-17T22:46:32.011400] [INFO ] [MAIN ] VMC: Loaded 43121 primary data records. [2025-10-17T22:46:32.188777] [DEBUG] [LOCAL ] VMI: Loaded 15248 existing records from primary storage. [2025-10-17T22:46:32.211853] [INFO ] [MAIN ] VMI: Loaded 15248 primary data records. [2025-10-17T22:46:32.856208] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:32.857569] [INFO ] [MAIN ] VLTO: Generated 1820 derivative records from 46842 primary records. [2025-10-17T22:46:32.858312] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-17T22:46:32.882534] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1820 records). [2025-10-17T22:46:32.883085] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-17T22:46:32.885225] [INFO ] [MAIN ] Derivative Progress: 1958/2083 symbols completed. VLTO took 1.3s. Estimated remaining: 47.5s. Rate: 158.1 symbols/min [2025-10-17T22:46:32.885529] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:32.901940] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:32.902815] [INFO ] [MAIN ] VMC: Generated 1820 derivative records from 43121 primary records. [2025-10-17T22:46:32.902971] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-17T22:46:32.924536] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:32.933769] [INFO ] [MAIN ] VMI: Generated 1820 derivative records from 15248 primary records. [2025-10-17T22:46:32.933971] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-17T22:46:32.932996] [DEBUG] [LOCAL ] VMC: Derivative data saved (1820 records). [2025-10-17T22:46:32.934814] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-17T22:46:32.937060] [INFO ] [MAIN ] Derivative Progress: 1959/2083 symbols completed. VMC took 1.2s. Estimated remaining: 47.0s. Rate: 158.1 symbols/min [2025-10-17T22:46:32.948931] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:32.967547] [DEBUG] [LOCAL ] VMI: Derivative data saved (1820 records). [2025-10-17T22:46:32.967184] [DEBUG] [LOCAL ] VMO: Loaded 21084 existing records from primary storage. [2025-10-17T22:46:32.967834] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-17T22:46:32.967911] [INFO ] [MAIN ] VMO: Loaded 21084 primary data records. [2025-10-17T22:46:32.970313] [INFO ] [MAIN ] Derivative Progress: 1960/2083 symbols completed. VMI took 1.1s. Estimated remaining: 46.6s. Rate: 158.2 symbols/min [2025-10-17T22:46:33.000409] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:33.022271] [DEBUG] [LOCAL ] VNCE: Loaded 9180 existing records from primary storage. [2025-10-17T22:46:33.044446] [INFO ] [MAIN ] VNCE: Loaded 9180 primary data records. [2025-10-17T22:46:33.618014] [DEBUG] [LOCAL ] VNO: Loaded 49695 existing records from primary storage. [2025-10-17T22:46:33.618456] [INFO ] [MAIN ] VNO: Loaded 49695 primary data records. [2025-10-17T22:46:33.943017] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:33.945058] [INFO ] [MAIN ] VMO: Generated 1820 derivative records from 21084 primary records. [2025-10-17T22:46:33.945671] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-17T22:46:33.959893] [DEBUG] [MAIN ] VNCE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:33.961568] [INFO ] [MAIN ] VNCE: Generated 1820 derivative records from 9180 primary records. [2025-10-17T22:46:33.973148] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-10-17T22:46:33.993097] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1820 records). [2025-10-17T22:46:33.986502] [DEBUG] [LOCAL ] VMO: Derivative data saved (1820 records). [2025-10-17T22:46:33.993466] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-10-17T22:46:33.993744] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-17T22:46:33.996055] [INFO ] [MAIN ] Derivative Progress: 1961/2083 symbols completed. VNCE took 1.0s. Estimated remaining: 46.3s. Rate: 158.1 symbols/min [2025-10-17T22:46:33.998633] [INFO ] [MAIN ] Derivative Progress: 1962/2083 symbols completed. VMO took 1.1s. Estimated remaining: 45.9s. Rate: 158.1 symbols/min [2025-10-17T22:46:33.998501] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:33.998940] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:34.022791] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:34.023638] [INFO ] [MAIN ] VNO: Generated 1820 derivative records from 49695 primary records. [2025-10-17T22:46:34.023787] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-17T22:46:34.028548] [DEBUG] [LOCAL ] VOC: Loaded 9096 existing records from primary storage. [2025-10-17T22:46:34.035603] [INFO ] [MAIN ] VOC: Loaded 9096 primary data records. [2025-10-17T22:46:34.128003] [DEBUG] [LOCAL ] VNO: Derivative data saved (1820 records). [2025-10-17T22:46:34.143862] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-17T22:46:34.153669] [INFO ] [MAIN ] Derivative Progress: 1963/2083 symbols completed. VNO took 1.2s. Estimated remaining: 45.5s. Rate: 158.2 symbols/min [2025-10-17T22:46:34.225270] [DEBUG] [LOCAL ] VNT: Loaded 44708 existing records from primary storage. [2025-10-17T22:46:34.240774] [INFO ] [MAIN ] VNT: Loaded 44708 primary data records. [2025-10-17T22:46:34.688724] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:34.689504] [INFO ] [MAIN ] VOC: Generated 1820 derivative records from 9096 primary records. [2025-10-17T22:46:34.689580] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-17T22:46:34.706441] [DEBUG] [LOCAL ] VOC: Derivative data saved (1820 records). [2025-10-17T22:46:34.706700] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-17T22:46:34.708798] [INFO ] [MAIN ] Derivative Progress: 1964/2083 symbols completed. VOC took 0.7s. Estimated remaining: 45.1s. Rate: 158.2 symbols/min [2025-10-17T22:46:34.724586] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:34.725142] [INFO ] [MAIN ] VNT: Generated 1820 derivative records from 44708 primary records. [2025-10-17T22:46:34.725223] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-17T22:46:34.741699] [DEBUG] [LOCAL ] VNT: Derivative data saved (1820 records). [2025-10-17T22:46:34.741823] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-17T22:46:34.744025] [INFO ] [MAIN ] Derivative Progress: 1965/2083 symbols completed. VNT took 0.7s. Estimated remaining: 44.7s. Rate: 158.2 symbols/min [2025-10-17T22:46:34.744543] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:34.744771] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:34.744673] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:34.754957] [DEBUG] [LOCAL ] VPV: Loaded 5502 existing records from primary storage. [2025-10-17T22:46:34.755107] [INFO ] [MAIN ] VPV: Loaded 5502 primary data records. [2025-10-17T22:46:34.875406] [DEBUG] [LOCAL ] VPG: Loaded 17444 existing records from primary storage. [2025-10-17T22:46:34.901490] [INFO ] [MAIN ] VPG: Loaded 17444 primary data records. [2025-10-17T22:46:35.216901] [DEBUG] [LOCAL ] VOYA: Loaded 42815 existing records from primary storage. [2025-10-17T22:46:35.223330] [INFO ] [MAIN ] VOYA: Loaded 42815 primary data records. [2025-10-17T22:46:35.758844] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:35.759953] [INFO ] [MAIN ] VPV: Generated 1820 derivative records from 5502 primary records. [2025-10-17T22:46:35.760059] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-17T22:46:35.777639] [DEBUG] [LOCAL ] VPV: Derivative data saved (1820 records). [2025-10-17T22:46:35.781276] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-17T22:46:35.783780] [INFO ] [MAIN ] Derivative Progress: 1966/2083 symbols completed. VPV took 1.0s. Estimated remaining: 44.4s. Rate: 158.1 symbols/min [2025-10-17T22:46:35.784248] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:35.798842] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:35.799759] [INFO ] [MAIN ] VPG: Generated 1820 derivative records from 17444 primary records. [2025-10-17T22:46:35.800000] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-17T22:46:35.827560] [DEBUG] [LOCAL ] VPG: Derivative data saved (1820 records). [2025-10-17T22:46:35.832580] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-17T22:46:35.832892] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:35.835180] [INFO ] [MAIN ] Derivative Progress: 1967/2083 symbols completed. VPG took 1.1s. Estimated remaining: 44.0s. Rate: 158.2 symbols/min [2025-10-17T22:46:35.835340] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:35.836281] [INFO ] [MAIN ] VOYA: Generated 1820 derivative records from 42815 primary records. [2025-10-17T22:46:35.836637] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-17T22:46:35.862304] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1820 records). [2025-10-17T22:46:35.862394] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-17T22:46:35.864527] [INFO ] [MAIN ] Derivative Progress: 1968/2083 symbols completed. VOYA took 1.1s. Estimated remaining: 43.6s. Rate: 158.2 symbols/min [2025-10-17T22:46:35.864802] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:35.881338] [DEBUG] [LOCAL ] VRE: Loaded 35807 existing records from primary storage. [2025-10-17T22:46:35.881789] [INFO ] [MAIN ] VRE: Loaded 35807 primary data records. [2025-10-17T22:46:35.944516] [DEBUG] [LOCAL ] VRTS: Loaded 9481 existing records from primary storage. [2025-10-17T22:46:35.972407] [INFO ] [MAIN ] VRTS: Loaded 9481 primary data records. [2025-10-17T22:46:36.387236] [DEBUG] [LOCAL ] VRT: Loaded 54533 existing records from primary storage. [2025-10-17T22:46:36.407068] [INFO ] [MAIN ] VRT: Loaded 54533 primary data records. [2025-10-17T22:46:36.982463] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:36.984111] [INFO ] [MAIN ] VRE: Generated 1820 derivative records from 35807 primary records. [2025-10-17T22:46:36.984358] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-17T22:46:37.020696] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:37.020318] [DEBUG] [LOCAL ] VRE: Derivative data saved (1820 records). [2025-10-17T22:46:37.021797] [INFO ] [MAIN ] VRTS: Generated 1820 derivative records from 9481 primary records. [2025-10-17T22:46:37.020998] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-17T22:46:37.022112] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-17T22:46:37.024507] [INFO ] [MAIN ] Derivative Progress: 1969/2083 symbols completed. VRE took 1.2s. Estimated remaining: 43.3s. Rate: 158.1 symbols/min [2025-10-17T22:46:37.025471] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:37.045499] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1820 records). [2025-10-17T22:46:37.057582] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-17T22:46:37.060618] [INFO ] [MAIN ] Derivative Progress: 1970/2083 symbols completed. VRTS took 1.2s. Estimated remaining: 42.9s. Rate: 158.1 symbols/min [2025-10-17T22:46:37.061360] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:37.060900] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:37.062922] [INFO ] [MAIN ] VRT: Generated 1820 derivative records from 54533 primary records. [2025-10-17T22:46:37.063076] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-17T22:46:37.081588] [DEBUG] [LOCAL ] VRT: Derivative data saved (1820 records). [2025-10-17T22:46:37.081821] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-17T22:46:37.084233] [INFO ] [MAIN ] Derivative Progress: 1971/2083 symbols completed. VRT took 1.2s. Estimated remaining: 42.5s. Rate: 158.2 symbols/min [2025-10-17T22:46:37.084588] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:37.150889] [DEBUG] [LOCAL ] VSCO: Loaded 53511 existing records from primary storage. [2025-10-17T22:46:37.151246] [INFO ] [MAIN ] VSCO: Loaded 53511 primary data records. [2025-10-17T22:46:37.152029] [DEBUG] [LOCAL ] VSH: Loaded 48966 existing records from primary storage. [2025-10-17T22:46:37.174302] [INFO ] [MAIN ] VSH: Loaded 48966 primary data records. [2025-10-17T22:46:37.459687] [DEBUG] [LOCAL ] VST: Loaded 54489 existing records from primary storage. [2025-10-17T22:46:37.512241] [INFO ] [MAIN ] VST: Loaded 54489 primary data records. [2025-10-17T22:46:38.125740] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:38.126835] [INFO ] [MAIN ] VSCO: Generated 1820 derivative records from 53511 primary records. [2025-10-17T22:46:38.126940] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-17T22:46:38.140972] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:38.149903] [INFO ] [MAIN ] VSH: Generated 1820 derivative records from 48966 primary records. [2025-10-17T22:46:38.153987] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-17T22:46:38.159514] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1820 records). [2025-10-17T22:46:38.159785] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-17T22:46:38.170295] [INFO ] [MAIN ] Derivative Progress: 1972/2083 symbols completed. VSCO took 1.1s. Estimated remaining: 42.1s. Rate: 158.1 symbols/min [2025-10-17T22:46:38.177411] [DEBUG] [LOCAL ] VSH: Derivative data saved (1820 records). [2025-10-17T22:46:38.177945] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:38.178103] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-17T22:46:38.180856] [INFO ] [MAIN ] Derivative Progress: 1973/2083 symbols completed. VSH took 1.1s. Estimated remaining: 41.7s. Rate: 158.1 symbols/min [2025-10-17T22:46:38.181369] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:38.198224] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:38.198952] [INFO ] [MAIN ] VST: Generated 1820 derivative records from 54489 primary records. [2025-10-17T22:46:38.199064] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-17T22:46:38.217042] [DEBUG] [LOCAL ] VST: Derivative data saved (1820 records). [2025-10-17T22:46:38.217196] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-17T22:46:38.219367] [INFO ] [MAIN ] Derivative Progress: 1974/2083 symbols completed. VST took 1.1s. Estimated remaining: 41.3s. Rate: 158.2 symbols/min [2025-10-17T22:46:38.220043] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:38.273718] [DEBUG] [LOCAL ] VTEX: Loaded 43610 existing records from primary storage. [2025-10-17T22:46:38.274581] [DEBUG] [LOCAL ] VSTS: Loaded 49618 existing records from primary storage. [2025-10-17T22:46:38.274880] [INFO ] [MAIN ] VTEX: Loaded 43610 primary data records. [2025-10-17T22:46:38.274991] [INFO ] [MAIN ] VSTS: Loaded 49618 primary data records. [2025-10-17T22:46:38.504485] [DEBUG] [LOCAL ] VTLE: Loaded 48615 existing records from primary storage. [2025-10-17T22:46:38.526139] [INFO ] [MAIN ] VTLE: Loaded 48615 primary data records. [2025-10-17T22:46:39.267657] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:39.269473] [INFO ] [MAIN ] VTEX: Generated 1820 derivative records from 43610 primary records. [2025-10-17T22:46:39.269573] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-17T22:46:39.284029] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:39.284696] [INFO ] [MAIN ] VSTS: Generated 1820 derivative records from 49618 primary records. [2025-10-17T22:46:39.296194] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-17T22:46:39.299967] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1820 records). [2025-10-17T22:46:39.300323] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-17T22:46:39.310005] [INFO ] [MAIN ] Derivative Progress: 1975/2083 symbols completed. VTEX took 1.1s. Estimated remaining: 41.0s. Rate: 158.1 symbols/min [2025-10-17T22:46:39.318003] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1820 records). [2025-10-17T22:46:39.318125] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-17T22:46:39.314041] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:39.328834] [INFO ] [MAIN ] Derivative Progress: 1976/2083 symbols completed. VSTS took 1.2s. Estimated remaining: 40.6s. Rate: 158.1 symbols/min [2025-10-17T22:46:39.334420] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:39.334323] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:39.335244] [INFO ] [MAIN ] VTLE: Generated 1820 derivative records from 48615 primary records. [2025-10-17T22:46:39.335605] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-17T22:46:39.362491] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1820 records). [2025-10-17T22:46:39.362741] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-17T22:46:39.365112] [INFO ] [MAIN ] Derivative Progress: 1977/2083 symbols completed. VTLE took 1.1s. Estimated remaining: 40.2s. Rate: 158.2 symbols/min [2025-10-17T22:46:39.365368] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:39.369559] [DEBUG] [LOCAL ] VTN: Loaded 7166 existing records from primary storage. [2025-10-17T22:46:39.369772] [INFO ] [MAIN ] VTN: Loaded 7166 primary data records. [2025-10-17T22:46:39.458125] [DEBUG] [LOCAL ] VTMX: Loaded 17871 existing records from primary storage. [2025-10-17T22:46:39.483796] [INFO ] [MAIN ] VTMX: Loaded 17871 primary data records. [2025-10-17T22:46:39.577370] [DEBUG] [LOCAL ] VTOL: Loaded 19920 existing records from primary storage. [2025-10-17T22:46:39.607387] [INFO ] [MAIN ] VTOL: Loaded 19920 primary data records. [2025-10-17T22:46:40.325076] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:40.326045] [INFO ] [MAIN ] VTN: Generated 1820 derivative records from 7166 primary records. [2025-10-17T22:46:40.329434] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-17T22:46:40.345522] [DEBUG] [LOCAL ] VTN: Derivative data saved (1820 records). [2025-10-17T22:46:40.345758] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-17T22:46:40.347971] [INFO ] [MAIN ] Derivative Progress: 1978/2083 symbols completed. VTN took 1.0s. Estimated remaining: 39.9s. Rate: 158.1 symbols/min [2025-10-17T22:46:40.361910] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:40.363997] [INFO ] [MAIN ] VTMX: Generated 1820 derivative records from 17871 primary records. [2025-10-17T22:46:40.364086] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-17T22:46:40.389454] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:40.393664] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1820 records). [2025-10-17T22:46:40.394455] [INFO ] [MAIN ] VTOL: Generated 1820 derivative records from 19920 primary records. [2025-10-17T22:46:40.393763] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-17T22:46:40.396734] [INFO ] [MAIN ] Derivative Progress: 1979/2083 symbols completed. VTMX took 1.1s. Estimated remaining: 39.5s. Rate: 158.2 symbols/min [2025-10-17T22:46:40.394580] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-17T22:46:40.412064] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1820 records). [2025-10-17T22:46:40.412127] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-17T22:46:40.414207] [INFO ] [MAIN ] Derivative Progress: 1980/2083 symbols completed. VTOL took 1.0s. Estimated remaining: 39.1s. Rate: 158.2 symbols/min [2025-10-17T22:46:40.414668] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:40.414810] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:40.414951] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:40.504354] [DEBUG] [LOCAL ] VVR: Loaded 31776 existing records from primary storage. [2025-10-17T22:46:40.505239] [INFO ] [MAIN ] VVR: Loaded 31776 primary data records. [2025-10-17T22:46:40.503411] [DEBUG] [LOCAL ] VTS: Loaded 30394 existing records from primary storage. [2025-10-17T22:46:40.505432] [INFO ] [MAIN ] VTS: Loaded 30394 primary data records. [2025-10-17T22:46:40.505117] [DEBUG] [LOCAL ] VTR: Loaded 53526 existing records from primary storage. [2025-10-17T22:46:40.505674] [INFO ] [MAIN ] VTR: Loaded 53526 primary data records. [2025-10-17T22:46:41.491929] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:41.505557] [INFO ] [MAIN ] VTR: Generated 1820 derivative records from 53526 primary records. [2025-10-17T22:46:41.505920] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:41.506914] [INFO ] [MAIN ] VTS: Generated 1820 derivative records from 30394 primary records. [2025-10-17T22:46:41.507066] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-17T22:46:41.507152] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-17T22:46:41.541994] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:41.549562] [INFO ] [MAIN ] VVR: Generated 1820 derivative records from 31776 primary records. [2025-10-17T22:46:41.550950] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-17T22:46:41.553197] [DEBUG] [LOCAL ] VTS: Derivative data saved (1820 records). [2025-10-17T22:46:41.562147] [DEBUG] [LOCAL ] VTR: Derivative data saved (1820 records). [2025-10-17T22:46:41.561034] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-17T22:46:41.565700] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-17T22:46:41.572003] [INFO ] [MAIN ] Derivative Progress: 1981/2083 symbols completed. VTR took 1.2s. Estimated remaining: 38.7s. Rate: 158.1 symbols/min [2025-10-17T22:46:41.569866] [DEBUG] [LOCAL ] VVR: Derivative data saved (1820 records). [2025-10-17T22:46:41.574231] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-17T22:46:41.574351] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:41.574469] [INFO ] [MAIN ] Derivative Progress: 1982/2083 symbols completed. VTS took 1.2s. Estimated remaining: 38.3s. Rate: 158.1 symbols/min [2025-10-17T22:46:41.577260] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:41.577322] [INFO ] [MAIN ] Derivative Progress: 1983/2083 symbols completed. VVR took 1.2s. Estimated remaining: 37.9s. Rate: 158.2 symbols/min [2025-10-17T22:46:41.577974] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:41.613988] [DEBUG] [LOCAL ] VVX: Loaded 23319 existing records from primary storage. [2025-10-17T22:46:41.614239] [INFO ] [MAIN ] VVX: Loaded 23319 primary data records. [2025-10-17T22:46:41.793985] [DEBUG] [LOCAL ] VYX: Loaded 49165 existing records from primary storage. [2025-10-17T22:46:41.865494] [INFO ] [MAIN ] VYX: Loaded 49165 primary data records. [2025-10-17T22:46:42.003980] [DEBUG] [LOCAL ] VVV: Loaded 51015 existing records from primary storage. [2025-10-17T22:46:42.019348] [INFO ] [MAIN ] VVV: Loaded 51015 primary data records. [2025-10-17T22:46:42.653934] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:42.656682] [INFO ] [MAIN ] VVX: Generated 1820 derivative records from 23319 primary records. [2025-10-17T22:46:42.657160] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-17T22:46:42.690729] [DEBUG] [LOCAL ] VVX: Derivative data saved (1820 records). [2025-10-17T22:46:42.689401] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:42.691489] [INFO ] [MAIN ] VVV: Generated 1820 derivative records from 51015 primary records. [2025-10-17T22:46:42.691605] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-17T22:46:42.691723] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-17T22:46:42.694676] [INFO ] [MAIN ] Derivative Progress: 1984/2083 symbols completed. VVX took 1.1s. Estimated remaining: 37.6s. Rate: 158.1 symbols/min [2025-10-17T22:46:42.695085] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:42.713342] [DEBUG] [LOCAL ] VVV: Derivative data saved (1820 records). [2025-10-17T22:46:42.721165] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-17T22:46:42.723306] [INFO ] [MAIN ] Derivative Progress: 1985/2083 symbols completed. VVV took 1.1s. Estimated remaining: 37.2s. Rate: 158.1 symbols/min [2025-10-17T22:46:42.727756] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:42.729913] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:42.730779] [INFO ] [MAIN ] VYX: Generated 1820 derivative records from 49165 primary records. [2025-10-17T22:46:42.730943] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-17T22:46:42.747523] [DEBUG] [LOCAL ] VYX: Derivative data saved (1820 records). [2025-10-17T22:46:42.750858] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-17T22:46:42.753489] [INFO ] [MAIN ] Derivative Progress: 1986/2083 symbols completed. VYX took 1.2s. Estimated remaining: 36.8s. Rate: 158.2 symbols/min [2025-10-17T22:46:42.753904] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:42.826316] [DEBUG] [LOCAL ] VZ: Loaded 54571 existing records from primary storage. [2025-10-17T22:46:42.852546] [INFO ] [MAIN ] VZ: Loaded 54571 primary data records. [2025-10-17T22:46:42.884592] [DEBUG] [LOCAL ] WAB: Loaded 44602 existing records from primary storage. [2025-10-17T22:46:42.890559] [DEBUG] [LOCAL ] W: Loaded 54205 existing records from primary storage. [2025-10-17T22:46:42.917538] [INFO ] [MAIN ] W: Loaded 54205 primary data records. [2025-10-17T22:46:42.922870] [INFO ] [MAIN ] WAB: Loaded 44602 primary data records. [2025-10-17T22:46:43.843462] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:43.845211] [INFO ] [MAIN ] W: Generated 1820 derivative records from 54205 primary records. [2025-10-17T22:46:43.844104] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:43.845405] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-17T22:46:43.859315] [INFO ] [MAIN ] VZ: Generated 1820 derivative records from 54571 primary records. [2025-10-17T22:46:43.859589] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:43.867877] [INFO ] [MAIN ] WAB: Generated 1820 derivative records from 44602 primary records. [2025-10-17T22:46:43.860032] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-17T22:46:43.872771] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-17T22:46:43.886178] [DEBUG] [LOCAL ] W: Derivative data saved (1820 records). [2025-10-17T22:46:43.890160] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-17T22:46:43.892793] [INFO ] [MAIN ] Derivative Progress: 1987/2083 symbols completed. W took 1.2s. Estimated remaining: 36.4s. Rate: 158.1 symbols/min [2025-10-17T22:46:43.893230] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:43.910139] [DEBUG] [LOCAL ] WAB: Derivative data saved (1820 records). [2025-10-17T22:46:43.912456] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-17T22:46:43.912800] [DEBUG] [LOCAL ] VZ: Derivative data saved (1820 records). [2025-10-17T22:46:43.913256] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-17T22:46:43.915102] [INFO ] [MAIN ] Derivative Progress: 1988/2083 symbols completed. VZ took 1.2s. Estimated remaining: 36.0s. Rate: 158.1 symbols/min [2025-10-17T22:46:43.917962] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:43.918600] [INFO ] [MAIN ] Derivative Progress: 1989/2083 symbols completed. WAB took 1.2s. Estimated remaining: 35.6s. Rate: 158.2 symbols/min [2025-10-17T22:46:43.918841] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:43.985446] [DEBUG] [LOCAL ] WAT: Loaded 36355 existing records from primary storage. [2025-10-17T22:46:43.985639] [INFO ] [MAIN ] WAT: Loaded 36355 primary data records. [2025-10-17T22:46:43.986511] [DEBUG] [LOCAL ] WAL: Loaded 46291 existing records from primary storage. [2025-10-17T22:46:44.029782] [INFO ] [MAIN ] WAL: Loaded 46291 primary data records. [2025-10-17T22:46:44.173700] [DEBUG] [LOCAL ] WBS: Loaded 49516 existing records from primary storage. [2025-10-17T22:46:44.216459] [INFO ] [MAIN ] WBS: Loaded 49516 primary data records. [2025-10-17T22:46:44.983992] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:44.986532] [INFO ] [MAIN ] WAL: Generated 1820 derivative records from 46291 primary records. [2025-10-17T22:46:44.986772] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-17T22:46:45.012029] [DEBUG] [LOCAL ] WAL: Derivative data saved (1820 records). [2025-10-17T22:46:45.016895] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-17T22:46:45.019819] [INFO ] [MAIN ] Derivative Progress: 1990/2083 symbols completed. WAL took 1.1s. Estimated remaining: 35.3s. Rate: 158.1 symbols/min [2025-10-17T22:46:45.017608] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:45.020006] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:45.021330] [INFO ] [MAIN ] WAT: Generated 1820 derivative records from 36355 primary records. [2025-10-17T22:46:45.021490] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-17T22:46:45.043679] [DEBUG] [LOCAL ] WAT: Derivative data saved (1820 records). [2025-10-17T22:46:45.051620] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-17T22:46:45.058530] [INFO ] [MAIN ] Derivative Progress: 1991/2083 symbols completed. WAT took 1.1s. Estimated remaining: 34.9s. Rate: 158.1 symbols/min [2025-10-17T22:46:45.058847] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:45.059366] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:45.065529] [INFO ] [MAIN ] WBS: Generated 1820 derivative records from 49516 primary records. [2025-10-17T22:46:45.066314] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-17T22:46:45.066085] [DEBUG] [LOCAL ] WBX: Loaded 10496 existing records from primary storage. [2025-10-17T22:46:45.067445] [INFO ] [MAIN ] WBX: Loaded 10496 primary data records. [2025-10-17T22:46:45.163721] [DEBUG] [LOCAL ] WBS: Derivative data saved (1820 records). [2025-10-17T22:46:45.174458] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-17T22:46:45.185031] [INFO ] [MAIN ] Derivative Progress: 1992/2083 symbols completed. WBS took 1.3s. Estimated remaining: 34.5s. Rate: 158.2 symbols/min [2025-10-17T22:46:45.188566] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:45.391420] [DEBUG] [LOCAL ] WCC: Loaded 39530 existing records from primary storage. [2025-10-17T22:46:45.404786] [INFO ] [MAIN ] WCC: Loaded 39530 primary data records. [2025-10-17T22:46:45.720199] [DEBUG] [LOCAL ] WCN: Loaded 48725 existing records from primary storage. [2025-10-17T22:46:45.734135] [INFO ] [MAIN ] WCN: Loaded 48725 primary data records. [2025-10-17T22:46:46.048378] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:46.049534] [INFO ] [MAIN ] WBX: Generated 1820 derivative records from 10496 primary records. [2025-10-17T22:46:46.049978] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-17T22:46:46.070344] [DEBUG] [LOCAL ] WBX: Derivative data saved (1820 records). [2025-10-17T22:46:46.070799] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-17T22:46:46.080934] [INFO ] [MAIN ] Derivative Progress: 1993/2083 symbols completed. WBX took 1.1s. Estimated remaining: 34.2s. Rate: 158.1 symbols/min [2025-10-17T22:46:46.086284] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:46.087283] [INFO ] [MAIN ] WCC: Generated 1820 derivative records from 39530 primary records. [2025-10-17T22:46:46.088204] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-17T22:46:46.104916] [DEBUG] [LOCAL ] WCC: Derivative data saved (1820 records). [2025-10-17T22:46:46.105189] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-17T22:46:46.107245] [INFO ] [MAIN ] Derivative Progress: 1994/2083 symbols completed. WCC took 1.0s. Estimated remaining: 33.8s. Rate: 158.2 symbols/min [2025-10-17T22:46:46.122168] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:46.122731] [INFO ] [MAIN ] WCN: Generated 1820 derivative records from 48725 primary records. [2025-10-17T22:46:46.122793] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-17T22:46:46.138882] [DEBUG] [LOCAL ] WCN: Derivative data saved (1820 records). [2025-10-17T22:46:46.138958] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-17T22:46:46.141214] [INFO ] [MAIN ] Derivative Progress: 1995/2083 symbols completed. WCN took 1.0s. Estimated remaining: 33.4s. Rate: 158.2 symbols/min [2025-10-17T22:46:46.142269] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:46.142197] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:46.142068] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:46.183518] [DEBUG] [LOCAL ] WD: Loaded 23354 existing records from primary storage. [2025-10-17T22:46:46.184333] [INFO ] [MAIN ] WD: Loaded 23354 primary data records. [2025-10-17T22:46:46.184234] [DEBUG] [LOCAL ] WDH: Loaded 18351 existing records from primary storage. [2025-10-17T22:46:46.218011] [INFO ] [MAIN ] WDH: Loaded 18351 primary data records. [2025-10-17T22:46:46.338114] [DEBUG] [LOCAL ] WDI: Loaded 21497 existing records from primary storage. [2025-10-17T22:46:46.383231] [INFO ] [MAIN ] WDI: Loaded 21497 primary data records. [2025-10-17T22:46:47.170466] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:47.171564] [INFO ] [MAIN ] WDH: Generated 1820 derivative records from 18351 primary records. [2025-10-17T22:46:47.171865] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-17T22:46:47.185428] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:47.195776] [INFO ] [MAIN ] WD: Generated 1820 derivative records from 23354 primary records. [2025-10-17T22:46:47.197082] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-17T22:46:47.217180] [DEBUG] [LOCAL ] WDH: Derivative data saved (1820 records). [2025-10-17T22:46:47.224596] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-17T22:46:47.225978] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:47.231515] [INFO ] [MAIN ] WDI: Generated 1820 derivative records from 21497 primary records. [2025-10-17T22:46:47.227956] [INFO ] [MAIN ] Derivative Progress: 1996/2083 symbols completed. WDH took 1.1s. Estimated remaining: 33.0s. Rate: 158.1 symbols/min [2025-10-17T22:46:47.235889] [DEBUG] [LOCAL ] WD: Derivative data saved (1820 records). [2025-10-17T22:46:47.234132] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-17T22:46:47.236393] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:47.236545] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-17T22:46:47.238987] [INFO ] [MAIN ] Derivative Progress: 1997/2083 symbols completed. WD took 1.1s. Estimated remaining: 32.6s. Rate: 158.2 symbols/min [2025-10-17T22:46:47.239240] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:47.257210] [DEBUG] [LOCAL ] WDI: Derivative data saved (1820 records). [2025-10-17T22:46:47.257347] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-17T22:46:47.260189] [INFO ] [MAIN ] Derivative Progress: 1998/2083 symbols completed. WDI took 1.1s. Estimated remaining: 32.2s. Rate: 158.2 symbols/min [2025-10-17T22:46:47.262938] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:47.269799] [DEBUG] [LOCAL ] WEA: Loaded 7901 existing records from primary storage. [2025-10-17T22:46:47.270012] [INFO ] [MAIN ] WEA: Loaded 7901 primary data records. [2025-10-17T22:46:47.593544] [DEBUG] [LOCAL ] WDS: Loaded 43811 existing records from primary storage. [2025-10-17T22:46:47.602243] [INFO ] [MAIN ] WDS: Loaded 43811 primary data records. [2025-10-17T22:46:47.680937] [DEBUG] [LOCAL ] WEAV: Loaded 42907 existing records from primary storage. [2025-10-17T22:46:47.697815] [INFO ] [MAIN ] WEAV: Loaded 42907 primary data records. [2025-10-17T22:46:48.252243] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:48.254206] [INFO ] [MAIN ] WEA: Generated 1820 derivative records from 7901 primary records. [2025-10-17T22:46:48.254313] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-17T22:46:48.270952] [DEBUG] [LOCAL ] WEA: Derivative data saved (1820 records). [2025-10-17T22:46:48.271165] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-17T22:46:48.273555] [INFO ] [MAIN ] Derivative Progress: 1999/2083 symbols completed. WEA took 1.0s. Estimated remaining: 31.9s. Rate: 158.1 symbols/min [2025-10-17T22:46:48.273889] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:48.294870] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:48.295864] [INFO ] [MAIN ] WDS: Generated 1820 derivative records from 43811 primary records. [2025-10-17T22:46:48.296252] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-17T22:46:48.315367] [DEBUG] [LOCAL ] WDS: Derivative data saved (1820 records). [2025-10-17T22:46:48.315546] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-17T22:46:48.317765] [INFO ] [MAIN ] Derivative Progress: 2000/2083 symbols completed. WDS took 1.1s. Estimated remaining: 31.5s. Rate: 158.2 symbols/min [2025-10-17T22:46:48.330303] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:48.331178] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:48.331937] [INFO ] [MAIN ] WEAV: Generated 1820 derivative records from 42907 primary records. [2025-10-17T22:46:48.331998] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-17T22:46:48.363344] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1820 records). [2025-10-17T22:46:48.363588] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-17T22:46:48.365966] [INFO ] [MAIN ] Derivative Progress: 2001/2083 symbols completed. WEAV took 1.1s. Estimated remaining: 31.1s. Rate: 158.2 symbols/min [2025-10-17T22:46:48.366297] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:48.384600] [DEBUG] [LOCAL ] WEC: Loaded 52934 existing records from primary storage. [2025-10-17T22:46:48.384898] [INFO ] [MAIN ] WEC: Loaded 52934 primary data records. [2025-10-17T22:46:48.755226] [DEBUG] [LOCAL ] WELL: Loaded 53089 existing records from primary storage. [2025-10-17T22:46:48.755969] [INFO ] [MAIN ] WELL: Loaded 53089 primary data records. [2025-10-17T22:46:48.828471] [DEBUG] [LOCAL ] WES: Loaded 49260 existing records from primary storage. [2025-10-17T22:46:48.865806] [INFO ] [MAIN ] WES: Loaded 49260 primary data records. [2025-10-17T22:46:49.397040] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:49.398119] [INFO ] [MAIN ] WEC: Generated 1820 derivative records from 52934 primary records. [2025-10-17T22:46:49.398483] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-17T22:46:49.419022] [DEBUG] [LOCAL ] WEC: Derivative data saved (1820 records). [2025-10-17T22:46:49.419371] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-17T22:46:49.429285] [INFO ] [MAIN ] Derivative Progress: 2002/2083 symbols completed. WEC took 1.2s. Estimated remaining: 30.7s. Rate: 158.1 symbols/min [2025-10-17T22:46:49.434808] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:49.435705] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:49.436363] [INFO ] [MAIN ] WELL: Generated 1820 derivative records from 53089 primary records. [2025-10-17T22:46:49.436508] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-17T22:46:49.468321] [DEBUG] [LOCAL ] WELL: Derivative data saved (1820 records). [2025-10-17T22:46:49.468764] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-17T22:46:49.470615] [INFO ] [MAIN ] Derivative Progress: 2003/2083 symbols completed. WELL took 1.1s. Estimated remaining: 30.3s. Rate: 158.2 symbols/min [2025-10-17T22:46:49.468604] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:49.470858] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:49.471691] [INFO ] [MAIN ] WES: Generated 1820 derivative records from 49260 primary records. [2025-10-17T22:46:49.471874] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-17T22:46:49.488751] [DEBUG] [LOCAL ] WES: Derivative data saved (1820 records). [2025-10-17T22:46:49.496832] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-17T22:46:49.499369] [INFO ] [MAIN ] Derivative Progress: 2004/2083 symbols completed. WES took 1.1s. Estimated remaining: 30.0s. Rate: 158.2 symbols/min [2025-10-17T22:46:49.499596] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:49.508103] [DEBUG] [LOCAL ] WF: Loaded 11094 existing records from primary storage. [2025-10-17T22:46:49.508236] [INFO ] [MAIN ] WF: Loaded 11094 primary data records. [2025-10-17T22:46:49.605177] [DEBUG] [LOCAL ] WEX: Loaded 33480 existing records from primary storage. [2025-10-17T22:46:49.621762] [INFO ] [MAIN ] WEX: Loaded 33480 primary data records. [2025-10-17T22:46:49.817429] [DEBUG] [LOCAL ] WFG: Loaded 25178 existing records from primary storage. [2025-10-17T22:46:49.937272] [INFO ] [MAIN ] WFG: Loaded 25178 primary data records. [2025-10-17T22:46:50.478396] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:50.479727] [INFO ] [MAIN ] WF: Generated 1820 derivative records from 11094 primary records. [2025-10-17T22:46:50.480190] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-17T22:46:50.501055] [DEBUG] [LOCAL ] WF: Derivative data saved (1820 records). [2025-10-17T22:46:50.501316] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-17T22:46:50.504416] [INFO ] [MAIN ] Derivative Progress: 2005/2083 symbols completed. WF took 1.0s. Estimated remaining: 29.6s. Rate: 158.1 symbols/min [2025-10-17T22:46:50.504595] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:50.521308] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:50.522358] [INFO ] [MAIN ] WEX: Generated 1820 derivative records from 33480 primary records. [2025-10-17T22:46:50.522823] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-17T22:46:50.545626] [DEBUG] [LOCAL ] WEX: Derivative data saved (1820 records). [2025-10-17T22:46:50.559290] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:50.558919] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-17T22:46:50.560436] [INFO ] [MAIN ] WFG: Generated 1820 derivative records from 25178 primary records. [2025-10-17T22:46:50.575588] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-17T22:46:50.575479] [INFO ] [MAIN ] Derivative Progress: 2006/2083 symbols completed. WEX took 1.1s. Estimated remaining: 29.2s. Rate: 158.2 symbols/min [2025-10-17T22:46:50.575946] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:50.593758] [DEBUG] [LOCAL ] WFG: Derivative data saved (1820 records). [2025-10-17T22:46:50.603751] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-17T22:46:50.607158] [INFO ] [MAIN ] Derivative Progress: 2007/2083 symbols completed. WFG took 1.1s. Estimated remaining: 28.8s. Rate: 158.2 symbols/min [2025-10-17T22:46:50.607424] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:50.609252] [DEBUG] [LOCAL ] WGO: Loaded 38653 existing records from primary storage. [2025-10-17T22:46:50.609399] [INFO ] [MAIN ] WGO: Loaded 38653 primary data records. [2025-10-17T22:46:50.988928] [DEBUG] [LOCAL ] WH: Loaded 45923 existing records from primary storage. [2025-10-17T22:46:51.000206] [INFO ] [MAIN ] WH: Loaded 45923 primary data records. [2025-10-17T22:46:51.001063] [DEBUG] [LOCAL ] WHD: Loaded 40730 existing records from primary storage. [2025-10-17T22:46:51.032865] [INFO ] [MAIN ] WHD: Loaded 40730 primary data records. [2025-10-17T22:46:51.681582] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:51.683165] [INFO ] [MAIN ] WGO: Generated 1820 derivative records from 38653 primary records. [2025-10-17T22:46:51.683466] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-17T22:46:51.706420] [DEBUG] [LOCAL ] WGO: Derivative data saved (1820 records). [2025-10-17T22:46:51.706862] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-17T22:46:51.710879] [INFO ] [MAIN ] Derivative Progress: 2008/2083 symbols completed. WGO took 1.2s. Estimated remaining: 28.5s. Rate: 158.1 symbols/min [2025-10-17T22:46:51.732905] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:51.748220] [INFO ] [MAIN ] WH: Generated 1820 derivative records from 45923 primary records. [2025-10-17T22:46:51.748545] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:51.749811] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-17T22:46:51.749702] [INFO ] [MAIN ] WHD: Generated 1820 derivative records from 40730 primary records. [2025-10-17T22:46:51.749963] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-17T22:46:51.784529] [DEBUG] [LOCAL ] WHD: Derivative data saved (1820 records). [2025-10-17T22:46:51.786904] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-17T22:46:51.789360] [INFO ] [MAIN ] Derivative Progress: 2009/2083 symbols completed. WHD took 1.2s. Estimated remaining: 28.1s. Rate: 158.2 symbols/min [2025-10-17T22:46:51.794522] [DEBUG] [LOCAL ] WH: Derivative data saved (1820 records). [2025-10-17T22:46:51.794749] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-17T22:46:51.797308] [INFO ] [MAIN ] Derivative Progress: 2010/2083 symbols completed. WH took 1.2s. Estimated remaining: 27.7s. Rate: 158.2 symbols/min [2025-10-17T22:46:51.798336] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:51.798436] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:51.798262] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:51.808273] [DEBUG] [LOCAL ] WIA: Loaded 5051 existing records from primary storage. [2025-10-17T22:46:51.812469] [INFO ] [MAIN ] WIA: Loaded 5051 primary data records. [2025-10-17T22:46:51.812967] [DEBUG] [LOCAL ] WHG: Loaded 3165 existing records from primary storage. [2025-10-17T22:46:51.876793] [INFO ] [MAIN ] WHG: Loaded 3165 primary data records. [2025-10-17T22:46:52.315278] [DEBUG] [LOCAL ] WHR: Loaded 49531 existing records from primary storage. [2025-10-17T22:46:52.465952] [INFO ] [MAIN ] WHR: Loaded 49531 primary data records. [2025-10-17T22:46:52.830386] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:52.831403] [INFO ] [MAIN ] WIA: Generated 1820 derivative records from 5051 primary records. [2025-10-17T22:46:52.831756] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-17T22:46:52.848761] [DEBUG] [LOCAL ] WIA: Derivative data saved (1820 records). [2025-10-17T22:46:52.849211] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-17T22:46:52.851450] [INFO ] [MAIN ] Derivative Progress: 2011/2083 symbols completed. WIA took 1.1s. Estimated remaining: 27.3s. Rate: 158.1 symbols/min [2025-10-17T22:46:52.853880] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:52.871379] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:46:52.873212] [INFO ] [MAIN ] WHG: Generated 1819 derivative records from 3165 primary records. [2025-10-17T22:46:52.873705] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-17T22:46:52.897175] [DEBUG] [LOCAL ] WINN: Loaded 11678 existing records from primary storage. [2025-10-17T22:46:52.898150] [INFO ] [MAIN ] WINN: Loaded 11678 primary data records. [2025-10-17T22:46:52.977137] [DEBUG] [LOCAL ] WHG: Derivative data saved (1819 records). [2025-10-17T22:46:52.994251] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-17T22:46:53.007164] [INFO ] [MAIN ] Derivative Progress: 2012/2083 symbols completed. WHG took 1.2s. Estimated remaining: 26.9s. Rate: 158.1 symbols/min [2025-10-17T22:46:53.007439] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:53.041898] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:53.070380] [INFO ] [MAIN ] WHR: Generated 1820 derivative records from 49531 primary records. [2025-10-17T22:46:53.100688] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-17T22:46:53.233535] [DEBUG] [LOCAL ] WHR: Derivative data saved (1820 records). [2025-10-17T22:46:53.233935] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-17T22:46:53.236462] [INFO ] [MAIN ] Derivative Progress: 2013/2083 symbols completed. WHR took 1.4s. Estimated remaining: 26.6s. Rate: 158.2 symbols/min [2025-10-17T22:46:53.236712] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:53.297587] [DEBUG] [LOCAL ] WIW: Loaded 20553 existing records from primary storage. [2025-10-17T22:46:53.298247] [INFO ] [MAIN ] WIW: Loaded 20553 primary data records. [2025-10-17T22:46:53.298169] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7795 incomplete bins [2025-10-17T22:46:53.299013] [INFO ] [MAIN ] WINN: Generated 1819 derivative records from 11678 primary records. [2025-10-17T22:46:53.300772] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-17T22:46:53.300678] [DEBUG] [LOCAL ] WIT: Loaded 53266 existing records from primary storage. [2025-10-17T22:46:53.333374] [INFO ] [MAIN ] WIT: Loaded 53266 primary data records. [2025-10-17T22:46:53.407598] [DEBUG] [LOCAL ] WINN: Derivative data saved (1819 records). [2025-10-17T22:46:53.447001] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-17T22:46:53.474564] [INFO ] [MAIN ] Derivative Progress: 2014/2083 symbols completed. WINN took 0.6s. Estimated remaining: 26.2s. Rate: 158.2 symbols/min [2025-10-17T22:46:53.480701] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:53.959568] [DEBUG] [LOCAL ] WK: Loaded 37823 existing records from primary storage. [2025-10-17T22:46:53.960830] [INFO ] [MAIN ] WK: Loaded 37823 primary data records. [2025-10-17T22:46:54.278228] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:54.280581] [INFO ] [MAIN ] WIT: Generated 1820 derivative records from 53266 primary records. [2025-10-17T22:46:54.282269] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-17T22:46:54.310521] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:54.311874] [INFO ] [MAIN ] WIW: Generated 1820 derivative records from 20553 primary records. [2025-10-17T22:46:54.312224] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-17T22:46:54.332760] [DEBUG] [LOCAL ] WIT: Derivative data saved (1820 records). [2025-10-17T22:46:54.332120] [DEBUG] [LOCAL ] WIW: Derivative data saved (1820 records). [2025-10-17T22:46:54.333029] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-17T22:46:54.333111] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-17T22:46:54.335183] [INFO ] [MAIN ] Derivative Progress: 2015/2083 symbols completed. WIW took 1.1s. Estimated remaining: 25.8s. Rate: 158.1 symbols/min [2025-10-17T22:46:54.337417] [INFO ] [MAIN ] Derivative Progress: 2016/2083 symbols completed. WIT took 1.3s. Estimated remaining: 25.4s. Rate: 158.2 symbols/min [2025-10-17T22:46:54.335337] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:54.337942] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:54.359470] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:54.360314] [INFO ] [MAIN ] WK: Generated 1820 derivative records from 37823 primary records. [2025-10-17T22:46:54.360602] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-17T22:46:54.396597] [DEBUG] [LOCAL ] WK: Derivative data saved (1820 records). [2025-10-17T22:46:54.397799] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-17T22:46:54.400317] [INFO ] [MAIN ] Derivative Progress: 2017/2083 symbols completed. WK took 0.9s. Estimated remaining: 25.0s. Rate: 158.2 symbols/min [2025-10-17T22:46:54.401554] [DEBUG] [LOCAL ] WKC: Loaded 35103 existing records from primary storage. [2025-10-17T22:46:54.401915] [INFO ] [MAIN ] WKC: Loaded 35103 primary data records. [2025-10-17T22:46:54.402057] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:54.561332] [DEBUG] [LOCAL ] WLK: Loaded 46398 existing records from primary storage. [2025-10-17T22:46:54.544890] [DEBUG] [LOCAL ] WLKP: Loaded 7181 existing records from primary storage. [2025-10-17T22:46:54.613418] [INFO ] [MAIN ] WLKP: Loaded 7181 primary data records. [2025-10-17T22:46:54.574575] [INFO ] [MAIN ] WLK: Loaded 46398 primary data records. [2025-10-17T22:46:55.426142] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:55.427284] [INFO ] [MAIN ] WKC: Generated 1820 derivative records from 35103 primary records. [2025-10-17T22:46:55.427582] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-17T22:46:55.452283] [DEBUG] [LOCAL ] WKC: Derivative data saved (1820 records). [2025-10-17T22:46:55.456798] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-17T22:46:55.460502] [INFO ] [MAIN ] Derivative Progress: 2018/2083 symbols completed. WKC took 1.1s. Estimated remaining: 24.7s. Rate: 158.1 symbols/min [2025-10-17T22:46:55.461567] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:55.491676] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:55.492057] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:55.493459] [INFO ] [MAIN ] WLK: Generated 1820 derivative records from 46398 primary records. [2025-10-17T22:46:55.493791] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-17T22:46:55.495183] [INFO ] [MAIN ] WLKP: Generated 1820 derivative records from 7181 primary records. [2025-10-17T22:46:55.496389] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-17T22:46:55.514555] [DEBUG] [LOCAL ] WLK: Derivative data saved (1820 records). [2025-10-17T22:46:55.514766] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-17T22:46:55.524190] [INFO ] [MAIN ] Derivative Progress: 2019/2083 symbols completed. WLK took 1.2s. Estimated remaining: 24.3s. Rate: 158.2 symbols/min [2025-10-17T22:46:55.524594] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:55.535392] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1820 records). [2025-10-17T22:46:55.535814] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-17T22:46:55.539387] [INFO ] [MAIN ] Derivative Progress: 2020/2083 symbols completed. WLKP took 1.1s. Estimated remaining: 23.9s. Rate: 158.2 symbols/min [2025-10-17T22:46:55.539948] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:55.568202] [DEBUG] [LOCAL ] WLY: Loaded 30295 existing records from primary storage. [2025-10-17T22:46:55.568694] [INFO ] [MAIN ] WLY: Loaded 30295 primary data records. [2025-10-17T22:46:55.786171] [DEBUG] [LOCAL ] WM: Loaded 51698 existing records from primary storage. [2025-10-17T22:46:55.819527] [INFO ] [MAIN ] WM: Loaded 51698 primary data records. [2025-10-17T22:46:56.034499] [DEBUG] [LOCAL ] WMB: Loaded 54452 existing records from primary storage. [2025-10-17T22:46:56.053267] [INFO ] [MAIN ] WMB: Loaded 54452 primary data records. [2025-10-17T22:46:56.660369] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:56.662456] [INFO ] [MAIN ] WLY: Generated 1820 derivative records from 30295 primary records. [2025-10-17T22:46:56.662873] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-17T22:46:56.685336] [DEBUG] [LOCAL ] WLY: Derivative data saved (1820 records). [2025-10-17T22:46:56.685937] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-17T22:46:56.688939] [INFO ] [MAIN ] Derivative Progress: 2021/2083 symbols completed. WLY took 1.2s. Estimated remaining: 23.5s. Rate: 158.1 symbols/min [2025-10-17T22:46:56.689922] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:56.703672] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:56.704627] [INFO ] [MAIN ] WM: Generated 1820 derivative records from 51698 primary records. [2025-10-17T22:46:56.705208] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-17T22:46:56.736229] [DEBUG] [LOCAL ] WM: Derivative data saved (1820 records). [2025-10-17T22:46:56.736451] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-17T22:46:56.739149] [INFO ] [MAIN ] Derivative Progress: 2022/2083 symbols completed. WM took 1.2s. Estimated remaining: 23.1s. Rate: 158.2 symbols/min [2025-10-17T22:46:56.749591] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:56.767789] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:56.769262] [DEBUG] [LOCAL ] WMK: Loaded 14886 existing records from primary storage. [2025-10-17T22:46:56.768611] [INFO ] [MAIN ] WMB: Generated 1820 derivative records from 54452 primary records. [2025-10-17T22:46:56.769457] [INFO ] [MAIN ] WMK: Loaded 14886 primary data records. [2025-10-17T22:46:56.769864] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-17T22:46:56.924841] [DEBUG] [LOCAL ] WMB: Derivative data saved (1820 records). [2025-10-17T22:46:56.953795] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-17T22:46:56.956580] [INFO ] [MAIN ] Derivative Progress: 2023/2083 symbols completed. WMB took 1.4s. Estimated remaining: 22.8s. Rate: 158.2 symbols/min [2025-10-17T22:46:56.985041] [DEBUG] [LOCAL ] WMS: Loaded 40206 existing records from primary storage. [2025-10-17T22:46:56.995590] [INFO ] [MAIN ] WMS: Loaded 40206 primary data records. [2025-10-17T22:46:57.737859] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:57.738963] [INFO ] [MAIN ] WMK: Generated 1820 derivative records from 14886 primary records. [2025-10-17T22:46:57.739068] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-17T22:46:57.763236] [DEBUG] [LOCAL ] WMK: Derivative data saved (1820 records). [2025-10-17T22:46:57.763370] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-17T22:46:57.765520] [INFO ] [MAIN ] Derivative Progress: 2024/2083 symbols completed. WMK took 1.1s. Estimated remaining: 22.4s. Rate: 158.1 symbols/min [2025-10-17T22:46:57.784299] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:57.785237] [INFO ] [MAIN ] WMS: Generated 1820 derivative records from 40206 primary records. [2025-10-17T22:46:57.785337] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-17T22:46:57.802695] [DEBUG] [LOCAL ] WMS: Derivative data saved (1820 records). [2025-10-17T22:46:57.802850] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-17T22:46:57.804880] [INFO ] [MAIN ] Derivative Progress: 2025/2083 symbols completed. WMS took 1.1s. Estimated remaining: 22.0s. Rate: 158.2 symbols/min [2025-10-17T22:46:57.805525] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:57.805703] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:57.806453] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:57.894202] [DEBUG] [LOCAL ] WNC: Loaded 39048 existing records from primary storage. [2025-10-17T22:46:57.894414] [DEBUG] [LOCAL ] WOLF: Loaded 53926 existing records from primary storage. [2025-10-17T22:46:57.894678] [INFO ] [MAIN ] WNC: Loaded 39048 primary data records. [2025-10-17T22:46:57.894796] [INFO ] [MAIN ] WOLF: Loaded 53926 primary data records. [2025-10-17T22:46:58.116172] [DEBUG] [LOCAL ] WMT: Loaded 54580 existing records from primary storage. [2025-10-17T22:46:58.142196] [INFO ] [MAIN ] WMT: Loaded 54580 primary data records. [2025-10-17T22:46:58.824178] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:58.825071] [INFO ] [MAIN ] WNC: Generated 1820 derivative records from 39048 primary records. [2025-10-17T22:46:58.825350] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-17T22:46:58.846012] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:58.846805] [INFO ] [MAIN ] WOLF: Generated 1820 derivative records from 53926 primary records. [2025-10-17T22:46:58.846897] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-17T22:46:58.867161] [DEBUG] [LOCAL ] WNC: Derivative data saved (1820 records). [2025-10-17T22:46:58.870292] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-17T22:46:58.873012] [INFO ] [MAIN ] Derivative Progress: 2026/2083 symbols completed. WNC took 1.1s. Estimated remaining: 21.6s. Rate: 158.0 symbols/min [2025-10-17T22:46:58.874057] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:58.875292] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1820 records). [2025-10-17T22:46:58.876124] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-17T22:46:58.878051] [INFO ] [MAIN ] Derivative Progress: 2027/2083 symbols completed. WOLF took 1.1s. Estimated remaining: 21.3s. Rate: 158.1 symbols/min [2025-10-17T22:46:58.891014] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:58.891750] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:58.892433] [INFO ] [MAIN ] WMT: Generated 1820 derivative records from 54580 primary records. [2025-10-17T22:46:58.892569] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-17T22:46:58.914888] [DEBUG] [LOCAL ] WMT: Derivative data saved (1820 records). [2025-10-17T22:46:58.915127] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-17T22:46:58.931295] [INFO ] [MAIN ] Derivative Progress: 2028/2083 symbols completed. WMT took 1.1s. Estimated remaining: 20.9s. Rate: 158.2 symbols/min [2025-10-17T22:46:58.931488] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:58.947364] [DEBUG] [LOCAL ] WOR: Loaded 24332 existing records from primary storage. [2025-10-17T22:46:58.947588] [INFO ] [MAIN ] WOR: Loaded 24332 primary data records. [2025-10-17T22:46:59.058703] [DEBUG] [LOCAL ] WOW: Loaded 31535 existing records from primary storage. [2025-10-17T22:46:59.079951] [INFO ] [MAIN ] WOW: Loaded 31535 primary data records. [2025-10-17T22:46:59.477115] [DEBUG] [LOCAL ] WPC: Loaded 48956 existing records from primary storage. [2025-10-17T22:46:59.596161] [INFO ] [MAIN ] WPC: Loaded 48956 primary data records. [2025-10-17T22:46:59.929098] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:59.932555] [INFO ] [MAIN ] WOR: Generated 1820 derivative records from 24332 primary records. [2025-10-17T22:46:59.933701] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-17T22:46:59.961965] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:46:59.965305] [INFO ] [MAIN ] WOW: Generated 1820 derivative records from 31535 primary records. [2025-10-17T22:46:59.965461] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-17T22:46:59.964520] [DEBUG] [LOCAL ] WOR: Derivative data saved (1820 records). [2025-10-17T22:46:59.965554] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-17T22:46:59.967515] [INFO ] [MAIN ] Derivative Progress: 2029/2083 symbols completed. WOR took 1.1s. Estimated remaining: 20.5s. Rate: 158.0 symbols/min [2025-10-17T22:46:59.967876] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:46:59.985817] [DEBUG] [LOCAL ] WOW: Derivative data saved (1820 records). [2025-10-17T22:46:59.987639] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-17T22:46:59.990566] [INFO ] [MAIN ] Derivative Progress: 2030/2083 symbols completed. WOW took 1.1s. Estimated remaining: 20.1s. Rate: 158.1 symbols/min [2025-10-17T22:46:59.990845] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:00.005181] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:00.006010] [INFO ] [MAIN ] WPC: Generated 1820 derivative records from 48956 primary records. [2025-10-17T22:47:00.006176] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-17T22:47:00.023279] [DEBUG] [LOCAL ] WPC: Derivative data saved (1820 records). [2025-10-17T22:47:00.023405] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-17T22:47:00.026173] [INFO ] [MAIN ] Derivative Progress: 2031/2083 symbols completed. WPC took 1.1s. Estimated remaining: 19.7s. Rate: 158.2 symbols/min [2025-10-17T22:47:00.026448] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:00.065966] [DEBUG] [LOCAL ] WPP: Loaded 34978 existing records from primary storage. [2025-10-17T22:47:00.081428] [INFO ] [MAIN ] WPP: Loaded 34978 primary data records. [2025-10-17T22:47:00.103065] [DEBUG] [LOCAL ] WPM: Loaded 53554 existing records from primary storage. [2025-10-17T22:47:00.103310] [INFO ] [MAIN ] WPM: Loaded 53554 primary data records. [2025-10-17T22:47:00.366335] [DEBUG] [LOCAL ] WRB: Loaded 51552 existing records from primary storage. [2025-10-17T22:47:00.446577] [INFO ] [MAIN ] WRB: Loaded 51552 primary data records. [2025-10-17T22:47:01.080131] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:01.082622] [INFO ] [MAIN ] WPP: Generated 1820 derivative records from 34978 primary records. [2025-10-17T22:47:01.085764] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-17T22:47:01.121833] [DEBUG] [LOCAL ] WPP: Derivative data saved (1820 records). [2025-10-17T22:47:01.122326] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-17T22:47:01.124358] [INFO ] [MAIN ] Derivative Progress: 2032/2083 symbols completed. WPP took 1.1s. Estimated remaining: 19.4s. Rate: 158.0 symbols/min [2025-10-17T22:47:01.125102] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:01.124958] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:01.126556] [INFO ] [MAIN ] WPM: Generated 1820 derivative records from 53554 primary records. [2025-10-17T22:47:01.126636] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-17T22:47:01.161105] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:01.162021] [INFO ] [MAIN ] WRB: Generated 1820 derivative records from 51552 primary records. [2025-10-17T22:47:01.162083] [DEBUG] [LOCAL ] WPM: Derivative data saved (1820 records). [2025-10-17T22:47:01.162198] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-17T22:47:01.162257] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-17T22:47:01.164972] [INFO ] [MAIN ] Derivative Progress: 2033/2083 symbols completed. WPM took 1.2s. Estimated remaining: 19.0s. Rate: 158.1 symbols/min [2025-10-17T22:47:01.172791] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:01.182056] [DEBUG] [LOCAL ] WRB: Derivative data saved (1820 records). [2025-10-17T22:47:01.182206] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-17T22:47:01.184555] [INFO ] [MAIN ] Derivative Progress: 2034/2083 symbols completed. WRB took 1.2s. Estimated remaining: 18.6s. Rate: 158.2 symbols/min [2025-10-17T22:47:01.198470] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:01.231554] [DEBUG] [LOCAL ] WS: Loaded 23730 existing records from primary storage. [2025-10-17T22:47:01.231827] [INFO ] [MAIN ] WS: Loaded 23730 primary data records. [2025-10-17T22:47:01.254559] [DEBUG] [LOCAL ] WRBY: Loaded 51470 existing records from primary storage. [2025-10-17T22:47:01.264906] [INFO ] [MAIN ] WRBY: Loaded 51470 primary data records. [2025-10-17T22:47:01.891235] [DEBUG] [LOCAL ] WSM: Loaded 49738 existing records from primary storage. [2025-10-17T22:47:01.892638] [INFO ] [MAIN ] WSM: Loaded 49738 primary data records. [2025-10-17T22:47:02.224821] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:02.226492] [INFO ] [MAIN ] WS: Generated 1820 derivative records from 23730 primary records. [2025-10-17T22:47:02.226750] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-17T22:47:02.248525] [DEBUG] [LOCAL ] WS: Derivative data saved (1820 records). [2025-10-17T22:47:02.261685] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-17T22:47:02.264341] [INFO ] [MAIN ] Derivative Progress: 2035/2083 symbols completed. WS took 1.1s. Estimated remaining: 18.2s. Rate: 158.0 symbols/min [2025-10-17T22:47:02.265055] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:02.264857] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:02.266117] [INFO ] [MAIN ] WRBY: Generated 1820 derivative records from 51470 primary records. [2025-10-17T22:47:02.266868] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-17T22:47:02.302593] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1820 records). [2025-10-17T22:47:02.303008] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-17T22:47:02.302833] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:02.305460] [INFO ] [MAIN ] Derivative Progress: 2036/2083 symbols completed. WRBY took 1.2s. Estimated remaining: 17.8s. Rate: 158.1 symbols/min [2025-10-17T22:47:02.313823] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:02.313609] [INFO ] [MAIN ] WSM: Generated 1820 derivative records from 49738 primary records. [2025-10-17T22:47:02.314515] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-17T22:47:02.336364] [DEBUG] [LOCAL ] WSO: Loaded 26167 existing records from primary storage. [2025-10-17T22:47:02.340902] [DEBUG] [LOCAL ] WSM: Derivative data saved (1820 records). [2025-10-17T22:47:02.338496] [INFO ] [MAIN ] WSO: Loaded 26167 primary data records. [2025-10-17T22:47:02.341179] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-17T22:47:02.343255] [INFO ] [MAIN ] Derivative Progress: 2037/2083 symbols completed. WSM took 1.1s. Estimated remaining: 17.4s. Rate: 158.2 symbols/min [2025-10-17T22:47:02.355209] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:02.541248] [DEBUG] [LOCAL ] WSR: Loaded 23238 existing records from primary storage. [2025-10-17T22:47:02.658015] [INFO ] [MAIN ] WSR: Loaded 23238 primary data records. [2025-10-17T22:47:02.798666] [DEBUG] [LOCAL ] WST: Loaded 37318 existing records from primary storage. [2025-10-17T22:47:02.798862] [INFO ] [MAIN ] WST: Loaded 37318 primary data records. [2025-10-17T22:47:03.369611] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:03.370845] [INFO ] [MAIN ] WSO: Generated 1820 derivative records from 26167 primary records. [2025-10-17T22:47:03.371336] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-17T22:47:03.390929] [DEBUG] [LOCAL ] WSO: Derivative data saved (1820 records). [2025-10-17T22:47:03.391335] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-17T22:47:03.393477] [INFO ] [MAIN ] Derivative Progress: 2038/2083 symbols completed. WSO took 1.1s. Estimated remaining: 17.1s. Rate: 158.0 symbols/min [2025-10-17T22:47:03.411120] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:03.411803] [INFO ] [MAIN ] WSR: Generated 1820 derivative records from 23238 primary records. [2025-10-17T22:47:03.411881] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-17T22:47:03.439755] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:03.442676] [DEBUG] [LOCAL ] WSR: Derivative data saved (1820 records). [2025-10-17T22:47:03.442605] [INFO ] [MAIN ] WST: Generated 1820 derivative records from 37318 primary records. [2025-10-17T22:47:03.442797] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-17T22:47:03.442874] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-17T22:47:03.444986] [INFO ] [MAIN ] Derivative Progress: 2039/2083 symbols completed. WSR took 1.1s. Estimated remaining: 16.7s. Rate: 158.1 symbols/min [2025-10-17T22:47:03.460305] [DEBUG] [LOCAL ] WST: Derivative data saved (1820 records). [2025-10-17T22:47:03.460365] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-17T22:47:03.462475] [INFO ] [MAIN ] Derivative Progress: 2040/2083 symbols completed. WST took 1.1s. Estimated remaining: 16.3s. Rate: 158.2 symbols/min [2025-10-17T22:47:03.462845] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:03.463051] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:03.462964] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:03.535319] [DEBUG] [LOCAL ] WTRG: Loaded 51704 existing records from primary storage. [2025-10-17T22:47:03.548569] [INFO ] [MAIN ] WTRG: Loaded 51704 primary data records. [2025-10-17T22:47:03.583523] [DEBUG] [LOCAL ] WT: Loaded 48844 existing records from primary storage. [2025-10-17T22:47:03.598974] [INFO ] [MAIN ] WT: Loaded 48844 primary data records. [2025-10-17T22:47:03.657846] [DEBUG] [LOCAL ] WTI: Loaded 45285 existing records from primary storage. [2025-10-17T22:47:03.715710] [INFO ] [MAIN ] WTI: Loaded 45285 primary data records. [2025-10-17T22:47:04.495548] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:04.501543] [INFO ] [MAIN ] WT: Generated 1820 derivative records from 48844 primary records. [2025-10-17T22:47:04.501666] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-17T22:47:04.500831] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:04.503214] [INFO ] [MAIN ] WTRG: Generated 1820 derivative records from 51704 primary records. [2025-10-17T22:47:04.503589] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-17T22:47:04.541142] [DEBUG] [LOCAL ] WT: Derivative data saved (1820 records). [2025-10-17T22:47:04.541826] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-17T22:47:04.544515] [INFO ] [MAIN ] Derivative Progress: 2041/2083 symbols completed. WT took 1.1s. Estimated remaining: 15.9s. Rate: 158.0 symbols/min [2025-10-17T22:47:04.559131] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:04.559730] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:04.560682] [INFO ] [MAIN ] WTI: Generated 1820 derivative records from 45285 primary records. [2025-10-17T22:47:04.561221] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-17T22:47:04.562186] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1820 records). [2025-10-17T22:47:04.562436] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-17T22:47:04.564256] [INFO ] [MAIN ] Derivative Progress: 2042/2083 symbols completed. WTRG took 1.1s. Estimated remaining: 15.6s. Rate: 158.1 symbols/min [2025-10-17T22:47:04.564720] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:04.580759] [DEBUG] [LOCAL ] WTI: Derivative data saved (1820 records). [2025-10-17T22:47:04.580870] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-17T22:47:04.583198] [INFO ] [MAIN ] Derivative Progress: 2043/2083 symbols completed. WTI took 1.1s. Estimated remaining: 15.2s. Rate: 158.2 symbols/min [2025-10-17T22:47:04.587550] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:04.596303] [DEBUG] [LOCAL ] WTS: Loaded 17595 existing records from primary storage. [2025-10-17T22:47:04.596389] [INFO ] [MAIN ] WTS: Loaded 17595 primary data records. [2025-10-17T22:47:04.943632] [DEBUG] [LOCAL ] WTTR: Loaded 45312 existing records from primary storage. [2025-10-17T22:47:04.965293] [INFO ] [MAIN ] WTTR: Loaded 45312 primary data records. [2025-10-17T22:47:05.108705] [DEBUG] [LOCAL ] WU: Loaded 54258 existing records from primary storage. [2025-10-17T22:47:05.133192] [INFO ] [MAIN ] WU: Loaded 54258 primary data records. [2025-10-17T22:47:05.619614] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:05.621245] [INFO ] [MAIN ] WTS: Generated 1820 derivative records from 17595 primary records. [2025-10-17T22:47:05.621361] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-17T22:47:05.639437] [DEBUG] [LOCAL ] WTS: Derivative data saved (1820 records). [2025-10-17T22:47:05.639840] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-17T22:47:05.641787] [INFO ] [MAIN ] Derivative Progress: 2044/2083 symbols completed. WTS took 1.1s. Estimated remaining: 14.8s. Rate: 158.0 symbols/min [2025-10-17T22:47:05.641974] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:05.660176] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:05.660950] [INFO ] [MAIN ] WTTR: Generated 1820 derivative records from 45312 primary records. [2025-10-17T22:47:05.661210] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-17T22:47:05.682591] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1820 records). [2025-10-17T22:47:05.682881] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-17T22:47:05.685497] [INFO ] [MAIN ] Derivative Progress: 2045/2083 symbols completed. WTTR took 1.1s. Estimated remaining: 14.4s. Rate: 158.1 symbols/min [2025-10-17T22:47:05.685894] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:05.714530] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:05.715333] [INFO ] [MAIN ] WU: Generated 1820 derivative records from 54258 primary records. [2025-10-17T22:47:05.715547] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-17T22:47:05.732715] [DEBUG] [LOCAL ] WU: Derivative data saved (1820 records). [2025-10-17T22:47:05.733081] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-17T22:47:05.748911] [INFO ] [MAIN ] Derivative Progress: 2046/2083 symbols completed. WU took 1.2s. Estimated remaining: 14.0s. Rate: 158.2 symbols/min [2025-10-17T22:47:05.749119] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:05.750551] [DEBUG] [LOCAL ] WWW: Loaded 49933 existing records from primary storage. [2025-10-17T22:47:05.750856] [INFO ] [MAIN ] WWW: Loaded 49933 primary data records. [2025-10-17T22:47:05.950038] [DEBUG] [LOCAL ] WY: Loaded 53997 existing records from primary storage. [2025-10-17T22:47:05.966428] [INFO ] [MAIN ] WY: Loaded 53997 primary data records. [2025-10-17T22:47:06.004072] [DEBUG] [LOCAL ] XFLT: Loaded 30459 existing records from primary storage. [2025-10-17T22:47:06.015784] [INFO ] [MAIN ] XFLT: Loaded 30459 primary data records. [2025-10-17T22:47:06.770460] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:06.771531] [INFO ] [MAIN ] WWW: Generated 1820 derivative records from 49933 primary records. [2025-10-17T22:47:06.771793] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-17T22:47:06.790823] [DEBUG] [LOCAL ] WWW: Derivative data saved (1820 records). [2025-10-17T22:47:06.791170] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-17T22:47:06.793159] [INFO ] [MAIN ] Derivative Progress: 2047/2083 symbols completed. WWW took 1.2s. Estimated remaining: 13.7s. Rate: 158.0 symbols/min [2025-10-17T22:47:06.793893] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:06.817616] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:06.826407] [INFO ] [MAIN ] WY: Generated 1820 derivative records from 53997 primary records. [2025-10-17T22:47:06.831900] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-17T22:47:06.831555] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:06.833483] [INFO ] [MAIN ] XFLT: Generated 1820 derivative records from 30459 primary records. [2025-10-17T22:47:06.834098] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-17T22:47:06.862247] [DEBUG] [LOCAL ] WY: Derivative data saved (1820 records). [2025-10-17T22:47:06.862951] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-17T22:47:06.865446] [INFO ] [MAIN ] Derivative Progress: 2048/2083 symbols completed. WY took 1.2s. Estimated remaining: 13.3s. Rate: 158.1 symbols/min [2025-10-17T22:47:06.866040] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:06.870396] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1820 records). [2025-10-17T22:47:06.870582] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-17T22:47:06.884233] [INFO ] [MAIN ] Derivative Progress: 2049/2083 symbols completed. XFLT took 1.1s. Estimated remaining: 12.9s. Rate: 158.2 symbols/min [2025-10-17T22:47:06.884557] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:06.903807] [DEBUG] [LOCAL ] XHR: Loaded 44119 existing records from primary storage. [2025-10-17T22:47:06.903966] [INFO ] [MAIN ] XHR: Loaded 44119 primary data records. [2025-10-17T22:47:07.067526] [DEBUG] [LOCAL ] XPER: Loaded 31034 existing records from primary storage. [2025-10-17T22:47:07.090239] [INFO ] [MAIN ] XPER: Loaded 31034 primary data records. [2025-10-17T22:47:07.382678] [DEBUG] [LOCAL ] XOM: Loaded 54573 existing records from primary storage. [2025-10-17T22:47:07.386324] [INFO ] [MAIN ] XOM: Loaded 54573 primary data records. [2025-10-17T22:47:07.901711] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:07.902820] [INFO ] [MAIN ] XHR: Generated 1820 derivative records from 44119 primary records. [2025-10-17T22:47:07.903095] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-17T22:47:07.920577] [DEBUG] [LOCAL ] XHR: Derivative data saved (1820 records). [2025-10-17T22:47:07.924271] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-17T22:47:07.926475] [INFO ] [MAIN ] Derivative Progress: 2050/2083 symbols completed. XHR took 1.1s. Estimated remaining: 12.5s. Rate: 158.0 symbols/min [2025-10-17T22:47:07.926737] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:07.941305] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:07.942298] [INFO ] [MAIN ] XPER: Generated 1820 derivative records from 31034 primary records. [2025-10-17T22:47:07.942516] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-17T22:47:07.975307] [DEBUG] [LOCAL ] XPER: Derivative data saved (1820 records). [2025-10-17T22:47:07.975631] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-17T22:47:07.977776] [INFO ] [MAIN ] Derivative Progress: 2051/2083 symbols completed. XPER took 1.1s. Estimated remaining: 12.1s. Rate: 158.1 symbols/min [2025-10-17T22:47:07.978241] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:07.978385] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:07.979576] [INFO ] [MAIN ] XOM: Generated 1820 derivative records from 54573 primary records. [2025-10-17T22:47:07.979752] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-17T22:47:08.012691] [DEBUG] [LOCAL ] XOM: Derivative data saved (1820 records). [2025-10-17T22:47:08.012905] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-17T22:47:08.015107] [INFO ] [MAIN ] Derivative Progress: 2052/2083 symbols completed. XOM took 1.1s. Estimated remaining: 11.8s. Rate: 158.2 symbols/min [2025-10-17T22:47:08.015347] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:08.047816] [DEBUG] [LOCAL ] XPEV: Loaded 54409 existing records from primary storage. [2025-10-17T22:47:08.048141] [INFO ] [MAIN ] XPEV: Loaded 54409 primary data records. [2025-10-17T22:47:08.181984] [DEBUG] [LOCAL ] XPOF: Loaded 37953 existing records from primary storage. [2025-10-17T22:47:08.183132] [DEBUG] [LOCAL ] XPO: Loaded 48306 existing records from primary storage. [2025-10-17T22:47:08.198960] [INFO ] [MAIN ] XPO: Loaded 48306 primary data records. [2025-10-17T22:47:08.188573] [INFO ] [MAIN ] XPOF: Loaded 37953 primary data records. [2025-10-17T22:47:09.048700] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:09.051503] [INFO ] [MAIN ] XPEV: Generated 1820 derivative records from 54409 primary records. [2025-10-17T22:47:09.051792] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-17T22:47:09.066019] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:09.067458] [INFO ] [MAIN ] XPO: Generated 1820 derivative records from 48306 primary records. [2025-10-17T22:47:09.076133] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-17T22:47:09.085899] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1820 records). [2025-10-17T22:47:09.099696] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-17T22:47:09.102365] [DEBUG] [LOCAL ] XPO: Derivative data saved (1820 records). [2025-10-17T22:47:09.104370] [INFO ] [MAIN ] Derivative Progress: 2053/2083 symbols completed. XPEV took 1.2s. Estimated remaining: 11.4s. Rate: 158.0 symbols/min [2025-10-17T22:47:09.104968] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-17T22:47:09.119201] [INFO ] [MAIN ] Derivative Progress: 2054/2083 symbols completed. XPO took 1.1s. Estimated remaining: 11.0s. Rate: 158.1 symbols/min [2025-10-17T22:47:09.119797] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:09.120366] [INFO ] [MAIN ] XPOF: Generated 1820 derivative records from 37953 primary records. [2025-10-17T22:47:09.120424] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-17T22:47:09.135949] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1820 records). [2025-10-17T22:47:09.136009] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-17T22:47:09.138176] [INFO ] [MAIN ] Derivative Progress: 2055/2083 symbols completed. XPOF took 1.1s. Estimated remaining: 10.6s. Rate: 158.2 symbols/min [2025-10-17T22:47:09.138592] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:09.138803] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:09.138714] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:09.189870] [DEBUG] [LOCAL ] XYF: Loaded 28115 existing records from primary storage. [2025-10-17T22:47:09.190748] [INFO ] [MAIN ] XYF: Loaded 28115 primary data records. [2025-10-17T22:47:09.235843] [DEBUG] [LOCAL ] XPRO: Loaded 46552 existing records from primary storage. [2025-10-17T22:47:09.260603] [INFO ] [MAIN ] XPRO: Loaded 46552 primary data records. [2025-10-17T22:47:09.378991] [DEBUG] [LOCAL ] XYL: Loaded 48469 existing records from primary storage. [2025-10-17T22:47:09.447245] [INFO ] [MAIN ] XYL: Loaded 48469 primary data records. [2025-10-17T22:47:10.163933] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:10.177463] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:10.178254] [INFO ] [MAIN ] XPRO: Generated 1820 derivative records from 46552 primary records. [2025-10-17T22:47:10.178879] [INFO ] [MAIN ] XYF: Generated 1820 derivative records from 28115 primary records. [2025-10-17T22:47:10.179117] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-17T22:47:10.179417] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-17T22:47:10.209349] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1820 records). [2025-10-17T22:47:10.209817] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-17T22:47:10.212353] [INFO ] [MAIN ] Derivative Progress: 2056/2083 symbols completed. XPRO took 1.1s. Estimated remaining: 10.3s. Rate: 158.0 symbols/min [2025-10-17T22:47:10.213080] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:10.215500] [DEBUG] [LOCAL ] XYF: Derivative data saved (1820 records). [2025-10-17T22:47:10.215701] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-17T22:47:10.217524] [INFO ] [MAIN ] Derivative Progress: 2057/2083 symbols completed. XYF took 1.1s. Estimated remaining: 9.9s. Rate: 158.1 symbols/min [2025-10-17T22:47:10.218763] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:10.235794] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:10.236615] [INFO ] [MAIN ] XYL: Generated 1820 derivative records from 48469 primary records. [2025-10-17T22:47:10.236710] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-17T22:47:10.253895] [DEBUG] [LOCAL ] XYL: Derivative data saved (1820 records). [2025-10-17T22:47:10.262936] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-17T22:47:10.265867] [INFO ] [MAIN ] Derivative Progress: 2058/2083 symbols completed. XYL took 1.1s. Estimated remaining: 9.5s. Rate: 158.2 symbols/min [2025-10-17T22:47:10.266166] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:10.290323] [DEBUG] [LOCAL ] YALA: Loaded 37162 existing records from primary storage. [2025-10-17T22:47:10.290534] [INFO ] [MAIN ] YALA: Loaded 37162 primary data records. [2025-10-17T22:47:10.442265] [DEBUG] [LOCAL ] YELP: Loaded 46079 existing records from primary storage. [2025-10-17T22:47:10.475751] [INFO ] [MAIN ] YELP: Loaded 46079 primary data records. [2025-10-17T22:47:10.728807] [DEBUG] [LOCAL ] YETI: Loaded 53250 existing records from primary storage. [2025-10-17T22:47:10.740106] [INFO ] [MAIN ] YETI: Loaded 53250 primary data records. [2025-10-17T22:47:11.278482] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:11.279639] [INFO ] [MAIN ] YALA: Generated 1820 derivative records from 37162 primary records. [2025-10-17T22:47:11.280005] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-17T22:47:11.297280] [DEBUG] [LOCAL ] YALA: Derivative data saved (1820 records). [2025-10-17T22:47:11.297601] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-17T22:47:11.299665] [INFO ] [MAIN ] Derivative Progress: 2059/2083 symbols completed. YALA took 1.1s. Estimated remaining: 9.1s. Rate: 158.0 symbols/min [2025-10-17T22:47:11.300353] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:11.318987] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:11.319884] [INFO ] [MAIN ] YELP: Generated 1820 derivative records from 46079 primary records. [2025-10-17T22:47:11.320057] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-17T22:47:11.339451] [DEBUG] [LOCAL ] YELP: Derivative data saved (1820 records). [2025-10-17T22:47:11.339964] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-17T22:47:11.351162] [INFO ] [MAIN ] Derivative Progress: 2060/2083 symbols completed. YELP took 1.1s. Estimated remaining: 8.7s. Rate: 158.1 symbols/min [2025-10-17T22:47:11.356035] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:11.356802] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:11.357771] [INFO ] [MAIN ] YETI: Generated 1820 derivative records from 53250 primary records. [2025-10-17T22:47:11.357942] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-17T22:47:11.383830] [DEBUG] [LOCAL ] YETI: Derivative data saved (1820 records). [2025-10-17T22:47:11.384026] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-17T22:47:11.386036] [INFO ] [MAIN ] Derivative Progress: 2061/2083 symbols completed. YETI took 1.1s. Estimated remaining: 8.3s. Rate: 158.2 symbols/min [2025-10-17T22:47:11.386341] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:11.403445] [DEBUG] [LOCAL ] YEXT: Loaded 43806 existing records from primary storage. [2025-10-17T22:47:11.403725] [INFO ] [MAIN ] YEXT: Loaded 43806 primary data records. [2025-10-17T22:47:11.771782] [DEBUG] [LOCAL ] YOU: Loaded 50363 existing records from primary storage. [2025-10-17T22:47:11.774307] [DEBUG] [LOCAL ] YMM: Loaded 53373 existing records from primary storage. [2025-10-17T22:47:11.775921] [INFO ] [MAIN ] YOU: Loaded 50363 primary data records. [2025-10-17T22:47:11.775813] [INFO ] [MAIN ] YMM: Loaded 53373 primary data records. [2025-10-17T22:47:12.450686] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:12.452286] [INFO ] [MAIN ] YEXT: Generated 1820 derivative records from 43806 primary records. [2025-10-17T22:47:12.452700] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-17T22:47:12.473777] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1820 records). [2025-10-17T22:47:12.474950] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-17T22:47:12.478447] [INFO ] [MAIN ] Derivative Progress: 2062/2083 symbols completed. YEXT took 1.2s. Estimated remaining: 8.0s. Rate: 158.0 symbols/min [2025-10-17T22:47:12.480024] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:12.501597] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:12.502600] [INFO ] [MAIN ] YOU: Generated 1820 derivative records from 50363 primary records. [2025-10-17T22:47:12.503005] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-17T22:47:12.518257] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:12.520305] [INFO ] [MAIN ] YMM: Generated 1820 derivative records from 53373 primary records. [2025-10-17T22:47:12.521083] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-17T22:47:12.538190] [DEBUG] [LOCAL ] YOU: Derivative data saved (1820 records). [2025-10-17T22:47:12.545666] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-17T22:47:12.547663] [INFO ] [MAIN ] Derivative Progress: 2063/2083 symbols completed. YOU took 1.2s. Estimated remaining: 7.6s. Rate: 158.1 symbols/min [2025-10-17T22:47:12.547890] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:12.556679] [DEBUG] [LOCAL ] YMM: Derivative data saved (1820 records). [2025-10-17T22:47:12.556914] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-17T22:47:12.559146] [INFO ] [MAIN ] Derivative Progress: 2064/2083 symbols completed. YMM took 1.2s. Estimated remaining: 7.2s. Rate: 158.2 symbols/min [2025-10-17T22:47:12.559408] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:12.584459] [DEBUG] [LOCAL ] YRD: Loaded 11657 existing records from primary storage. [2025-10-17T22:47:12.584609] [INFO ] [MAIN ] YRD: Loaded 11657 primary data records. [2025-10-17T22:47:12.709792] [DEBUG] [LOCAL ] YPF: Loaded 51423 existing records from primary storage. [2025-10-17T22:47:12.726053] [INFO ] [MAIN ] YPF: Loaded 51423 primary data records. [2025-10-17T22:47:12.845612] [DEBUG] [LOCAL ] YSG: Loaded 25852 existing records from primary storage. [2025-10-17T22:47:12.871230] [INFO ] [MAIN ] YSG: Loaded 25852 primary data records. [2025-10-17T22:47:13.638076] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:13.638957] [INFO ] [MAIN ] YRD: Generated 1820 derivative records from 11657 primary records. [2025-10-17T22:47:13.639203] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-17T22:47:13.656366] [DEBUG] [LOCAL ] YRD: Derivative data saved (1820 records). [2025-10-17T22:47:13.656571] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-17T22:47:13.658742] [INFO ] [MAIN ] Derivative Progress: 2065/2083 symbols completed. YRD took 1.1s. Estimated remaining: 6.8s. Rate: 158.0 symbols/min [2025-10-17T22:47:13.660962] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:13.676489] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:13.677425] [INFO ] [MAIN ] YPF: Generated 1820 derivative records from 51423 primary records. [2025-10-17T22:47:13.677599] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-17T22:47:13.696144] [DEBUG] [LOCAL ] YPF: Derivative data saved (1820 records). [2025-10-17T22:47:13.697516] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-17T22:47:13.701364] [INFO ] [MAIN ] Derivative Progress: 2066/2083 symbols completed. YPF took 1.2s. Estimated remaining: 6.5s. Rate: 158.1 symbols/min [2025-10-17T22:47:13.701960] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:13.716730] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:13.717605] [INFO ] [MAIN ] YSG: Generated 1820 derivative records from 25852 primary records. [2025-10-17T22:47:13.717772] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-17T22:47:13.750071] [DEBUG] [LOCAL ] YSG: Derivative data saved (1820 records). [2025-10-17T22:47:13.750310] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-17T22:47:13.753774] [INFO ] [MAIN ] Derivative Progress: 2067/2083 symbols completed. YSG took 1.2s. Estimated remaining: 6.1s. Rate: 158.2 symbols/min [2025-10-17T22:47:13.754244] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:13.772949] [DEBUG] [LOCAL ] YUM: Loaded 51918 existing records from primary storage. [2025-10-17T22:47:13.773165] [INFO ] [MAIN ] YUM: Loaded 51918 primary data records. [2025-10-17T22:47:13.985267] [DEBUG] [LOCAL ] YUMC: Loaded 53359 existing records from primary storage. [2025-10-17T22:47:14.036133] [INFO ] [MAIN ] YUMC: Loaded 53359 primary data records. [2025-10-17T22:47:14.270045] [DEBUG] [LOCAL ] ZBH: Loaded 51528 existing records from primary storage. [2025-10-17T22:47:14.270675] [INFO ] [MAIN ] ZBH: Loaded 51528 primary data records. [2025-10-17T22:47:14.792551] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:14.794193] [INFO ] [MAIN ] YUM: Generated 1820 derivative records from 51918 primary records. [2025-10-17T22:47:14.794477] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-17T22:47:14.816076] [DEBUG] [LOCAL ] YUM: Derivative data saved (1820 records). [2025-10-17T22:47:14.816293] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-17T22:47:14.818493] [INFO ] [MAIN ] Derivative Progress: 2068/2083 symbols completed. YUM took 1.2s. Estimated remaining: 5.7s. Rate: 158.0 symbols/min [2025-10-17T22:47:14.833985] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:14.835067] [INFO ] [MAIN ] YUMC: Generated 1820 derivative records from 53359 primary records. [2025-10-17T22:47:14.835265] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-17T22:47:14.855362] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1820 records). [2025-10-17T22:47:14.855574] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-17T22:47:14.857961] [INFO ] [MAIN ] Derivative Progress: 2069/2083 symbols completed. YUMC took 1.2s. Estimated remaining: 5.3s. Rate: 158.1 symbols/min [2025-10-17T22:47:14.877077] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:14.877876] [INFO ] [MAIN ] ZBH: Generated 1820 derivative records from 51528 primary records. [2025-10-17T22:47:14.877953] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-17T22:47:14.898160] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1820 records). [2025-10-17T22:47:14.898291] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-17T22:47:14.901076] [INFO ] [MAIN ] Derivative Progress: 2070/2083 symbols completed. ZBH took 1.1s. Estimated remaining: 4.9s. Rate: 158.2 symbols/min [2025-10-17T22:47:14.901579] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:14.901831] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:14.902318] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:14.943453] [DEBUG] [LOCAL ] ZEPP: Loaded 19285 existing records from primary storage. [2025-10-17T22:47:14.943687] [INFO ] [MAIN ] ZEPP: Loaded 19285 primary data records. [2025-10-17T22:47:15.057582] [DEBUG] [LOCAL ] ZGN: Loaded 41539 existing records from primary storage. [2025-10-17T22:47:15.082470] [INFO ] [MAIN ] ZGN: Loaded 41539 primary data records. [2025-10-17T22:47:15.421067] [DEBUG] [LOCAL ] ZETA: Loaded 54397 existing records from primary storage. [2025-10-17T22:47:15.421435] [INFO ] [MAIN ] ZETA: Loaded 54397 primary data records. [2025-10-17T22:47:15.998058] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:15.999308] [INFO ] [MAIN ] ZEPP: Generated 1820 derivative records from 19285 primary records. [2025-10-17T22:47:15.999738] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-17T22:47:16.018096] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1820 records). [2025-10-17T22:47:16.019916] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-17T22:47:16.023052] [INFO ] [MAIN ] Derivative Progress: 2071/2083 symbols completed. ZEPP took 1.1s. Estimated remaining: 4.6s. Rate: 158.0 symbols/min [2025-10-17T22:47:16.023905] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:16.038262] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:16.039201] [INFO ] [MAIN ] ZGN: Generated 1820 derivative records from 41539 primary records. [2025-10-17T22:47:16.039435] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-17T22:47:16.056606] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1820 records). [2025-10-17T22:47:16.056729] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-17T22:47:16.058956] [INFO ] [MAIN ] Derivative Progress: 2072/2083 symbols completed. ZGN took 1.2s. Estimated remaining: 4.2s. Rate: 158.1 symbols/min [2025-10-17T22:47:16.059281] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:16.091157] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:16.093263] [INFO ] [MAIN ] ZETA: Generated 1820 derivative records from 54397 primary records. [2025-10-17T22:47:16.093437] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-17T22:47:16.093884] [DEBUG] [LOCAL ] ZH: Loaded 25565 existing records from primary storage. [2025-10-17T22:47:16.094931] [INFO ] [MAIN ] ZH: Loaded 25565 primary data records. [2025-10-17T22:47:16.150827] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1820 records). [2025-10-17T22:47:16.168777] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-17T22:47:16.179708] [INFO ] [MAIN ] Derivative Progress: 2073/2083 symbols completed. ZETA took 1.3s. Estimated remaining: 3.8s. Rate: 158.1 symbols/min [2025-10-17T22:47:16.185991] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:16.433669] [DEBUG] [LOCAL ] ZIM: Loaded 54263 existing records from primary storage. [2025-10-17T22:47:16.444040] [INFO ] [MAIN ] ZIM: Loaded 54263 primary data records. [2025-10-17T22:47:16.588742] [DEBUG] [LOCAL ] ZIP: Loaded 44273 existing records from primary storage. [2025-10-17T22:47:16.589269] [INFO ] [MAIN ] ZIP: Loaded 44273 primary data records. [2025-10-17T22:47:17.174394] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:17.176250] [INFO ] [MAIN ] ZH: Generated 1820 derivative records from 25565 primary records. [2025-10-17T22:47:17.177464] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-17T22:47:17.198011] [DEBUG] [LOCAL ] ZH: Derivative data saved (1820 records). [2025-10-17T22:47:17.198400] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-17T22:47:17.200990] [INFO ] [MAIN ] Derivative Progress: 2074/2083 symbols completed. ZH took 1.2s. Estimated remaining: 3.4s. Rate: 158.0 symbols/min [2025-10-17T22:47:17.201389] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:17.224294] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:17.225309] [INFO ] [MAIN ] ZIM: Generated 1820 derivative records from 54263 primary records. [2025-10-17T22:47:17.225434] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-17T22:47:17.258617] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1820 records). [2025-10-17T22:47:17.258877] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:17.269001] [INFO ] [MAIN ] ZIP: Generated 1820 derivative records from 44273 primary records. [2025-10-17T22:47:17.268256] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-17T22:47:17.271437] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-17T22:47:17.271351] [INFO ] [MAIN ] Derivative Progress: 2075/2083 symbols completed. ZIM took 1.2s. Estimated remaining: 3.0s. Rate: 158.1 symbols/min [2025-10-17T22:47:17.272309] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:17.290238] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1820 records). [2025-10-17T22:47:17.290390] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-17T22:47:17.292521] [INFO ] [MAIN ] Derivative Progress: 2076/2083 symbols completed. ZIP took 1.1s. Estimated remaining: 2.7s. Rate: 158.1 symbols/min [2025-10-17T22:47:17.304515] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:17.308393] [DEBUG] [LOCAL ] ZKH: Loaded 7505 existing records from primary storage. [2025-10-17T22:47:17.309315] [DEBUG] [LOCAL ] ZK: Loaded 39593 existing records from primary storage. [2025-10-17T22:47:17.308544] [INFO ] [MAIN ] ZKH: Loaded 7505 primary data records. [2025-10-17T22:47:17.320762] [INFO ] [MAIN ] ZK: Loaded 39593 primary data records. [2025-10-17T22:47:17.958420] [DEBUG] [LOCAL ] ZTO: Loaded 50253 existing records from primary storage. [2025-10-17T22:47:17.960313] [INFO ] [MAIN ] ZTO: Loaded 50253 primary data records. [2025-10-17T22:47:18.295566] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:18.297278] [INFO ] [MAIN ] ZKH: Generated 1820 derivative records from 7505 primary records. [2025-10-17T22:47:18.297761] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-17T22:47:18.326789] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1820 records). [2025-10-17T22:47:18.327136] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-17T22:47:18.334659] [INFO ] [MAIN ] Derivative Progress: 2077/2083 symbols completed. ZKH took 1.1s. Estimated remaining: 2.3s. Rate: 158.0 symbols/min [2025-10-17T22:47:18.335378] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:18.335003] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:18.336776] [INFO ] [MAIN ] ZK: Generated 1820 derivative records from 39593 primary records. [2025-10-17T22:47:18.337424] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-17T22:47:18.355005] [DEBUG] [LOCAL ] ZK: Derivative data saved (1820 records). [2025-10-17T22:47:18.355397] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-17T22:47:18.357728] [INFO ] [MAIN ] Derivative Progress: 2078/2083 symbols completed. ZK took 1.2s. Estimated remaining: 1.9s. Rate: 158.1 symbols/min [2025-10-17T22:47:18.357957] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:18.384465] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:18.385373] [DEBUG] [LOCAL ] ZTR: Loaded 16868 existing records from primary storage. [2025-10-17T22:47:18.386129] [INFO ] [MAIN ] ZTO: Generated 1820 derivative records from 50253 primary records. [2025-10-17T22:47:18.386415] [INFO ] [MAIN ] ZTR: Loaded 16868 primary data records. [2025-10-17T22:47:18.386485] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-17T22:47:18.522996] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1820 records). [2025-10-17T22:47:18.573344] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-17T22:47:18.702496] [INFO ] [MAIN ] Derivative Progress: 2079/2083 symbols completed. ZTO took 1.4s. Estimated remaining: 1.5s. Rate: 158.1 symbols/min [2025-10-17T22:47:18.716101] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:18.741629] [DEBUG] [LOCAL ] ZTS: Loaded 53916 existing records from primary storage. [2025-10-17T22:47:18.742188] [INFO ] [MAIN ] ZTS: Loaded 53916 primary data records. [2025-10-17T22:47:18.909975] [DEBUG] [LOCAL ] ZVIA: Loaded 36311 existing records from primary storage. [2025-10-17T22:47:18.930349] [INFO ] [MAIN ] ZVIA: Loaded 36311 primary data records. [2025-10-17T22:47:19.200696] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:19.222560] [INFO ] [MAIN ] ZTR: Generated 1820 derivative records from 16868 primary records. [2025-10-17T22:47:19.223051] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-17T22:47:19.322381] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1820 records). [2025-10-17T22:47:19.339706] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-17T22:47:19.343981] [INFO ] [MAIN ] Derivative Progress: 2080/2083 symbols completed. ZTR took 1.0s. Estimated remaining: 1.1s. Rate: 158.0 symbols/min [2025-10-17T22:47:19.366502] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-17T22:47:19.507587] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:19.508639] [INFO ] [MAIN ] ZTS: Generated 1820 derivative records from 53916 primary records. [2025-10-17T22:47:19.509607] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-17T22:47:19.532938] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1820 records). [2025-10-17T22:47:19.533240] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-17T22:47:19.535273] [INFO ] [MAIN ] Derivative Progress: 2081/2083 symbols completed. ZTS took 1.2s. Estimated remaining: 0.8s. Rate: 158.1 symbols/min [2025-10-17T22:47:19.562787] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:19.563439] [INFO ] [MAIN ] ZVIA: Generated 1820 derivative records from 36311 primary records. [2025-10-17T22:47:19.563501] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-17T22:47:19.588697] [DEBUG] [LOCAL ] ZWS: Loaded 43041 existing records from primary storage. [2025-10-17T22:47:19.589510] [INFO ] [MAIN ] ZWS: Loaded 43041 primary data records. [2025-10-17T22:47:19.694561] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1820 records). [2025-10-17T22:47:19.695143] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-17T22:47:19.708797] [INFO ] [MAIN ] Derivative Progress: 2082/2083 symbols completed. ZVIA took 1.0s. Estimated remaining: 0.4s. Rate: 158.1 symbols/min [2025-10-17T22:47:19.910743] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7794 incomplete bins [2025-10-17T22:47:19.911405] [INFO ] [MAIN ] ZWS: Generated 1820 derivative records from 43041 primary records. [2025-10-17T22:47:19.911467] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-17T22:47:19.926771] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1820 records). [2025-10-17T22:47:19.926828] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-17T22:47:19.929003] [INFO ] [MAIN ] Derivative Progress: 2083/2083 symbols completed. ZWS took 0.6s. Estimated remaining: 0.0s. Rate: 158.1 symbols/min [2025-10-17T22:47:19.930917] [INFO ] [MAIN ] Parallel derivative generation completed in 13m 10s [2025-10-17T22:47:19.931137] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2083/2083 symbols) [2025-10-17T22:47:20.555234] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2083/2083 @ 100.00%)' [2025-10-17T22:47:20.555922] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-17T22:47:20.557119] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-17T22:47:20.557313] [INFO ] [STATE ] Last completion updated: 2025-10-17T22:47:20.557201